From: David Vrabel <david.vrabel@citrix.com>
To: Wei Liu <wei.liu2@citrix.com>, David Vrabel <david.vrabel@citrix.com>
Cc: <netdev@vger.kernel.org>, Ian Campbell <ian.campbell@citrix.com>,
<xen-devel@lists.xenproject.org>,
Jonathan Davies <jonathan.davies@citrix.com>
Subject: Re: [Xen-devel] [RFC PATCHv1 net-next] xen-netback: always fully coalesce guest Rx packets
Date: Mon, 19 Jan 2015 17:36:10 +0000 [thread overview]
Message-ID: <54BD408A.6080405@citrix.com> (raw)
In-Reply-To: <20150113143033.GN4226@zion.uk.xensource.com>
On 13/01/15 14:30, Wei Liu wrote:
> On Tue, Jan 13, 2015 at 02:05:17PM +0000, David Vrabel wrote:
>> Always fully coalesce guest Rx packets into the minimum number of ring
>> slots. Reducing the number of slots per packet has significant
>> performance benefits (e.g., 7.2 Gbit/s to 11 Gbit/s in an off-host
>> receive test).
>>
>
> Good number.
>
>> However, this does increase the number of grant ops per packet which
>> decreases performance with some workloads (intrahost VM to VM)
>
> Do you have figures before and after this change?
Some better (more rigorous) results done by Jonathan Davies shows no
regressions with full coalescing even without the grant copy
optimization, and a big improvement to single stream receive.
baseline Full coalesce
Interhost aggregate 24 Gb/s 24 Gb/s
Interhost VM receive 7.2 Gb/s 11 Gb/s
Intrahost single stream 14 Gb/s 14 Gb/s
Intrahost aggregate 34 Gb/s 34 Gb/s
We do not measure the performance of dom0 to guest traffic but my ad-hoc
measurements suggest this may be 5-10% slower. I don't think this is a
very important use case though.
So...
>> /unless/ grant copy has been optimized for adjacent ops with the same
>> source or destination (see "grant-table: defer releasing pages
>> acquired in a grant copy"[1]).
>>
>> Do we need to retain the existing path and make the always coalesce
>> path conditional on a suitable version of Xen?
...I think the answer to this is no.
>> ---
>> drivers/net/xen-netback/common.h | 1 -
>> drivers/net/xen-netback/netback.c | 106 ++-----------------------------------
>> 2 files changed, 3 insertions(+), 104 deletions(-)
>
> Love the diffstat!
Yes, it's always nice when you delete code and it goes faster... :)
David
next prev parent reply other threads:[~2015-01-19 17:51 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-01-13 14:05 [RFC PATCHv1 net-next] xen-netback: always fully coalesce guest Rx packets David Vrabel
2015-01-13 14:30 ` Wei Liu
2015-01-19 17:36 ` David Vrabel [this message]
2015-01-20 11:21 ` [Xen-devel] " Ian Campbell
2015-01-20 11:23 ` Ian Campbell
2015-01-20 11:34 ` Ian Campbell
2015-01-20 11:38 ` David Vrabel
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=54BD408A.6080405@citrix.com \
--to=david.vrabel@citrix.com \
--cc=ian.campbell@citrix.com \
--cc=jonathan.davies@citrix.com \
--cc=netdev@vger.kernel.org \
--cc=wei.liu2@citrix.com \
--cc=xen-devel@lists.xenproject.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).