From mboxrd@z Thu Jan 1 00:00:00 1970 From: Eric Dumazet Subject: Re: [PATCH] net: Update netdev_alloc_frag to work more efficiently with TCP and GRO Date: Wed, 20 Jun 2012 07:36:30 +0200 Message-ID: <1340170590.4604.784.camel@edumazet-glaptop> References: <20120620004306.17814.58369.stgit@gitlad.jf.intel.com> Mime-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit Cc: netdev@vger.kernel.org, davem@davemloft.net, jeffrey.t.kirsher@intel.com To: Alexander Duyck Return-path: Received: from mail-wi0-f178.google.com ([209.85.212.178]:43079 "EHLO mail-wi0-f178.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752104Ab2FTFgg (ORCPT ); Wed, 20 Jun 2012 01:36:36 -0400 Received: by wibhn6 with SMTP id hn6so4039159wib.1 for ; Tue, 19 Jun 2012 22:36:34 -0700 (PDT) In-Reply-To: <20120620004306.17814.58369.stgit@gitlad.jf.intel.com> Sender: netdev-owner@vger.kernel.org List-ID: On Tue, 2012-06-19 at 17:43 -0700, Alexander Duyck wrote: > This patch is meant to help improve system performance when > netdev_alloc_frag is used in scenarios in which buffers are short lived. > This is accomplished by allowing the page offset to be reset in the event > that the page count is 1. I also reordered the direction in which we give > out sections of the page so that we start at the end of the page and end at > the start. The main motivation being that I preferred to have offset > represent the amount of page remaining to be used. > > My primary test case was using ixgbe in combination with TCP. With this > patch applied I saw CPU utilization drop from 3.4% to 3.0% for a single > thread of netperf receiving a TCP stream via ixgbe. > > I also tested several scenarios in which the page reuse would not be > possible such as UDP flows and routing. In both of these scenarios I saw > no noticeable performance degradation compared to the kernel without this > patch. > > Cc: Eric Dumazet > Signed-off-by: Alexander Duyck > --- > > net/core/skbuff.c | 15 +++++++++++---- > 1 files changed, 11 insertions(+), 4 deletions(-) > > diff --git a/net/core/skbuff.c b/net/core/skbuff.c > index 5b21522..eb3853c 100644 > --- a/net/core/skbuff.c > +++ b/net/core/skbuff.c > @@ -317,15 +317,22 @@ void *netdev_alloc_frag(unsigned int fragsz) > if (unlikely(!nc->page)) { > refill: > nc->page = alloc_page(GFP_ATOMIC | __GFP_COLD); > - nc->offset = 0; > } > if (likely(nc->page)) { > - if (nc->offset + fragsz > PAGE_SIZE) { > + unsigned int offset = PAGE_SIZE; > + > + if (page_count(nc->page) != 1) > + offset = nc->offset; > + > + if (offset < fragsz) { > put_page(nc->page); > goto refill; > } > - data = page_address(nc->page) + nc->offset; > - nc->offset += fragsz; > + > + offset -= fragsz; > + nc->offset = offset; > + > + data = page_address(nc->page) + offset; > get_page(nc->page); > } > local_irq_restore(flags); > I tested this idea one month ago and got not convincing results, because the branch was taken half of the time. The cases where page can be reused is probably specific to ixgbe because it uses a different allocator for the frags themselves. netdev_alloc_frag() is only used to allocate the skb head. For typical nics, we allocate frags to populate the RX ring _way_ before packet is received by the NIC. Then, I played with using order-2 pages instead of order-0 ones if PAGE_SIZE < 8192. No clear win either, but you might try this too.