Re: [PATCH] Software receive packet steering

[David Miller <davem@davemloft.net>]

From: Tom Herbert <therbert@google.com>
Date: Thu, 9 Apr 2009 09:43:07 -0700

> The bimodal behavior between polling and non-polling states does give
> us fits.  I looked at the parked mode idea, but the latency hit seems
> too high.  We've considered holding the interface in polling state for
> longer periods of time, maybe this could trade off CPU cycles (on the
> core taking interrupts) for lower latency and higher throughput.

The sweet spot is usually obtained by having moderate HW interrupt
mitigation settings.  Unfortunately not all drivers do this
universally and have been well tuned.  tg3 is one driver that does do
this correctly.

I would imagine that a non-trivial swath of the issues you guys run
into are actually driver related.  It took us a while to get the tg3
HW interrupt mitigations to play just-right with NAPI.

And we were able to get it right because on a particular system the
NAPI transition was incredibly expensive (some big NUMA SGI box)
so all of the effects were pronounced.