Re: Don't use dbench for benchmarks

[Stephen Lord <lord@sgi.com>]

Alan Cox wrote:

>>I must be having a bad day, I can only think of irritable things to post.
>>Continuing that theme: please don't use dbench for benchmarks.  At all.
>>It's an unreliable indicator of anything in particular except perhaps
>>stability.  Please, use something else for your benchmarks.
>>
>
>Im not 100% sure that is the case. Done 30 or 40 times and done from a 
>reboot for the 30-40 pass sequence its quite a passable guide to
>both stability and I/O behaviour under some server loads. 
>

dbench tells you two things:

 o how repeatable your filesystem performance is under load from 
multiple processes,
    and is the available bandwidth equally shared between the threads. 
Various versions
    of linux (especially the elevator code) have shown different 
characteristics here, but
    nowadays things are pretty fair.

 o once you have repeatable performance it tells you if your performance 
regressed or
    improved (on identical hardware of course).

However, there are 'interesting' aspects of the test (and any other 
memory stressing
test), it performs better if you push as much out to swap as you can 
first. So I find
a dbench 8 runs better after a dbench 64 than it did before it. This 
means you need
a VERY controlled environment to make the results mean anything.

Steve

p.s. I really only use it to see if XFS can survive heavy load and 
memory pressure.