public inbox for netdev@vger.kernel.org
 help / color / mirror / Atom feed
From: Rick Jones <rick.jones2@hp.com>
To: Tom Herbert <therbert@google.com>
Cc: davem@davemloft.net, netdev@vger.kernel.org
Subject: Re: [PATCH v2] net: Allow no-cache copy from user on transmit
Date: Wed, 23 Mar 2011 11:51:23 -0700	[thread overview]
Message-ID: <1300906283.25347.1467.camel@tardy> (raw)
In-Reply-To: <alpine.DEB.2.00.1103231003120.16608@pokey.mtv.corp.google.com>

On Wed, 2011-03-23 at 10:10 -0700, Tom Herbert wrote:
> This patch uses __copy_from_user_nocache (from skb_copy_to_page)
> on transmit to bypass data cache for a performance improvement.
> This functionality is configurable per device using ethtool, the
> device must also be doing TX csum offload to enable.  It seems
> reasonable to set this when the netdevice does not copy or
> otherwise touch the data.
> 
> This patch was tested using 200 instances of netperf TCP_RR with
> 1400 byte request and one byte reply.  Platform is 16 core AMD x86.
> 
> No-cache copy disabled:
>    672703 tps, 97.13% utilization
>    50/90/99% latency:244.31 484.205 1028.41
> 
> No-cache copy enabled:
>    702113 tps, 96.16% utilization,
>    50/90/99% latency 238.56 467.56 956.955
> 
> Using 14000 byte request and response sizes demonstrate the
> effects more dramatically:
> 
> No-cache copy disabled:
>    79571 tps, 34.34 %utlization
>    50/90/95% latency 1584.46 2319.59 5001.76
> 
> No-cache copy enabled:
>    83856 tps, 34.81% utilization
>    50/90/95% latency 2508.42 2622.62 2735.88
> 
> Note especially the effect on tail latency (95th percentile).
> 
> This seems to provide a nice performance improvement and is
> consistent in the tests I ran.  Presumably, this would provide
> the greatest benfits in the presence of an application workload
> stressing the cache and a lot of transmit data happening.  I don't
> yet see a downside to using this.
> 
> Signed-off-by: Tom Herbert <therbert@google.com>

Having raised the question about tying it to CKO and seeing it addressed
to my satisfaction I'll go ahead and:

Acked-by: Rick Jones <rick.jones2@hp.com>

rick jones


      parent reply	other threads:[~2011-03-23 18:51 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-03-23 17:10 [PATCH v2] net: Allow no-cache copy from user on transmit Tom Herbert
2011-03-23 18:42 ` Michał Mirosław
2011-03-23 19:25   ` Stephen Hemminger
2011-03-23 19:48     ` Tom Herbert
2011-03-23 18:51 ` Rick Jones [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1300906283.25347.1467.camel@tardy \
    --to=rick.jones2@hp.com \
    --cc=davem@davemloft.net \
    --cc=netdev@vger.kernel.org \
    --cc=therbert@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox