Re: NAPI wait before enabling irq's [was Re: [Cbe-oss-dev] Spider DMA wrongness]

[akepner@sgi.com]

On Thu, 14 Dec 2006, Linas Vepstas wrote:

> On Wed, Nov 08, 2006 at 07:38:12AM +1100, Benjamin Herrenschmidt wrote:
>>
>> What about Linas patches to do interrupt mitigation with NAPI polling ?
>> That didn't end up working ?
>
> It seems to be "working as designed", which is different than "working
> as naively expected".
>
> For large packets:
> -- a packet comes in
> -- rx interrupt generated
> -- rx interrupts turned off
> -- tcp poll function runs, receives packet
> -- completes all work before next packet has arrived,
>   so interupts are turned back on.
> -- go to start
>
> This results in a high number of interrupts, and a high cpu usage.
> We were able to prove that napi works by stalling in the poll function
> just long enough to allow the next packet to arrive.  In this case,
> napi works great, and number of irqs is vastly reduced.
> ....

This sounds awfully familiar. We went through the same
with the tg3 driver on Altix. In that case we succeeded
getting interrupt coalescence added to the driver, which
ended up working pretty well for us. See the thread
beginning with:

http://oss.sgi.com/archives/netdev/2005-05/msg00497.html

if you're interested.

As for the "stalling NAPI" idea, Jamal did a bit of work
with that idea and wrote it up in:

www.kernel.org/pub/linux/kernel/people/hadi/docs/UKUUG2005.pdf

-- 
Arthur