OK I have now tried with 3 build machines all varying components the 
last one being a server. All 3 of these machines are segfaulting, all 
saying it is a ld segfault with libc. No packages are actually failing 
and stopping the build. This is the segfault that is showing on each 
machine but of course libc version is dependent on the OS being used.
[47152.769257] ld[22617]: segfault at 403 ip 00007f2149cfd435 sp 
00007fffb83ccb50 error 4 in libc-2.15.so[7f2149cb6000+197000]
2012-04-18T14:50:08-07:00 localhost kernel: [47163.860996] ld[31096]: 
segfault at 403 ip 00007fc2da152435 sp 00007fffab491c30 error 4 in 
libc-2.15.so[7fc2da10b000+197000]

My first question is what from these 3 machines can I share with the 
list to help? The qa.log's on all 3 look almost identical just depending 
on if I build a full image or just start fresh and build only perl. I 
have attached one for example. Can anyone explain the qa.log to me? 
Would cooker logs from each machine help? I dont want to just attach a 
bunch of things if they would not be of help.

I have tried enabling core files as per Khem suggestion's but for some 
reason I am not able to either find them or it is not producing any. I 
have set all 3 to unlimited.

My current setup:

My first machine:
Toshiba Qosmio x505-887 nvidia graphics, Have tried with Ubuntu 10.04 
32&64bit and 11.04 64bit, Fedora 16 32bit, ArchLinux,

1st machine borrowed:
Dell xps 400 tower nvidia graphics, Have tried ArchLinux, Ubuntu 10.04 
32bit and 12.04 server beta 32bit

2nd machine borrowed
Dell poweredge 1750, setup with Ubuntu server 12.04 beta and 10.04 
server both 32bit

I will have these borrowed machine for about a week more to help me try 
and figure this out. But I am really at a loss as now 3 machines have 
the same issues how am I this unlucky?

My steps to build
1. Fresh install of OS
2. Update the OS completely
3. reconfigure dash if on Ubuntu
4. Download distro requirements from the OE and your Distro page, then 
reboot
5. clone the angstrom setup scripts
6. setup for BBXM as per Angstrom setup page
7. source my environment
8. bitbake perl

That is what I have done each time, am I missing something? Not doing 
something properly? Again OE classic(gumstix overo) builds on my laptop 
the Toshiba, and has been for awhile. This started once I bought a BBXM 
and went to setup a dedicated install for the BBXM. If this is hardware 
related as mentioned before what hardware could it be since the 
poweredge does not have the nvidia graphics the other 2 did.

Thank you for your time and help.