Re: Kernel Scalability

[William Lee Irwin III <wli@holomorphy.com>]

On Wed, 2 May 2007, Daniel J Blueman wrote:
>> There are 128-processor IA64 systems which run recent 2.6 kernels out
>> there; the per-processor counters, RCU and page-fault scalability work
>> has been instrumental to the necessary scaling for decent resource
>> usage on these.
>> IIRC, there were some patches being developed to improve pagecache
>> scalability lately too, but I guess it all depends on what kind of
>> workload you have...

On Wed, May 02, 2007 at 07:39:48PM +0200, l.genoni@oltrelinux.com wrote:
> To stay on systems probably more familiar to the user who asked this 
> question, there are also some 64 core X86_64 bot AMD and Intel out there, 
> here the 2.6 kernel is doing 
> very well even on those intel CPU with shared L2 cache.
> I have some 16 and 32 core Opteron and never had scalability problems.
> You have to pay a lot of attention to your kernel configuration  (100 HZ, 
> just BKL preemption), and to the 
> filesystems you decide to use.

One doesn't typically experience scalability problems per se. One
rather compares slopes of scaling lines and notes relative scaling
across kernels, be they versions of the same kernel or different
codebases altogether. It's still possible to have scalability
problems, of course, where things basically slowdown severely or
appear to stop entirely.

Nonlinear scalability is generally considered to be where the limits
of scaling set in. There is usually linear scaling until some number
of processors, and then the limit is where the linearity breaks down.
Linear scalability is defined as adding resources (e.g. cpus) to the
system resulting in a linear increase in performance.

To characterize a kernel's scalability, one should say three things:
(1) workload/benchmark
(2) linear scaling coefficient
(3) upper limit on linearity

So you would say that when running dbench, Linux scales with a
coefficient of 0.85 up to 78 processors or similar.


-- wli