help with next generation bkbits please

[Larry McVoy <lm@bitmover.com>]

Hi,

we're trying to upgrade bkbits.net for your pushing&pulling pleasure
and we're having some problems.

We wanted to throw lots of memory at the problem so we went with an
ASUS SK8V motherboard, opteron 148, 4 x 1GB registered / ECC dimms.
We thought we would be careful so we bought dimms that ASUS claims works.

We can't get the system to stabilize and we're looking for either 
    a) information on how to do that or
    b) a suggestion for a machine which will support 4GB or more

What we are currently seeing looks like a cache writeback problem.
I have a simple memory scrubber, see below, which just cycles through a
series of patterns, verifying the previous one and writing a new one,
switch pattern, repeat until pattern list is exhausted, then loop.
We cycle through the offset into the array, 0xdeadbeef, 0x50505050,
0x0a0a0a0a, 0x55555555, 0xaaaaaaaa, 0, 0xffffffff.

What we see is that for 16x4 bytes in a row we will get errors where
what we get is the previous value.  In other words, we just went through
a loop that verified that all the data is 0xdeadbeef and then set it
to 0x50505050, and then in the next loop 16 values will be 0xdeadbeef.
In other words, it looks like the cache writeback didn't work, it's as
if the dirty bits were cleared for some reason.

Does anyone have any idea what might be causing this and what we need
to do to fix it?  We'd really like to get you guys a nicer machine.
-- 
---
Larry McVoy                lm at bitmover.com           http://www.bitkeeper.com