All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Reese Faucette" <reese@myri.com>
To: xen-devel@lists.xensource.com
Subject: Re: vif interface dropping 80% packets
Date: Tue, 6 Feb 2007 14:52:48 -0800	[thread overview]
Message-ID: <00b901c74a41$86ba3b70$58c31fac@bart> (raw)
In-Reply-To: 08CA2245AFCF444DB3AC415E47CC40AF71789E@G3W0072.americas.hpqcorp.net

> You are probably using jumbo packets for native, right? What is the MTU 
> when you get
> 9.88 Gb/s? I was thinking MTU=1500  when I said unrealistic. Not sure why 
> you cannot
> get higher MTU in Xen to work. I have not tried MTU > 1500 bytes in Xen 
> myself  but
> I believe Herbert Xu has done that successfully.

ok, true - got me there.  TCP test with native linux sending to dom0 and 
1500 MTU is 9.1GB/s and 23% of 1 CPU used on receiver.

> If you get larger MTU to work, keep in mind that in Xen there is an extra 
> data copy
> to transfer the packet from dom0 to guest which will have a higher impact 
> on performance
> for larger MTUs when compared to linux.

of course - i don't expect there to be no impact, but the numbers i was 
getting with mtu=1500 were horrid, like 70Mb/s using netperf with 
TCP_SENDFILE.  a slower sender actually resulted in better throughput due to 
fewer dropped packets.  (e.g. using TCP_STREAM got 220Mb/s, better but still 
stinky)

update:
MTU=9000 does work, I had failed to set one of the vif interfaces - plenty 
of interfaces to change ;-)
The performance is better with 9k MTU, as expected:
TCP_STREAM and TCP_SENDFILE both get ~1.8Gb/s, xentop reports 87% 
utilization for dom0, so I guess that's about all I can expect without code 
changes.

If I understand the Xen bridge network flow, though, it's a real bummer that

> First off, try switching to 3.0.4 and use the included 2.6.16-xen kernel.

I can try, but the issue i had before was that 2.6.16 did not have the
ethernet driver I need for the main ethernet connection:
0000:06:00.1 Ethernet controller: Intel Corporation Enterprise Southbridge 
DPT LAN Copper (rev 01)
It comes with 2.6.18, but not 2.6.16, and the driver does not compile under
2.6.16, so i was stuck with 2.6.18.

before I spend a lot of time converting to 3.0.4, a couple of questions:
1) any reason to expect better perf on 3.0.4 ?
2) if yes, Will the patch "fedora-36252.patch" work on the 2.6.16 kernel 
included with 3.0.4, or have conflicts crept in?

thanks!
-reese

  reply	other threads:[~2007-02-06 22:52 UTC|newest]

Thread overview: 13+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-02-06  0:30 vif interface dropping 80% packets Reese Faucette
2007-02-06  2:33 ` Reese Faucette
2007-02-06 13:43 ` Ian Pratt
2007-02-06 18:12 ` Santos, Jose Renato G
2007-02-06 18:58   ` Reese Faucette
2007-02-06 19:40     ` Santos, Jose Renato G
2007-02-06 22:52       ` Reese Faucette [this message]
2007-02-06 23:06         ` Ian Pratt
2007-02-06 23:35           ` Reese Faucette
2007-02-06 23:59             ` Ian Pratt
2007-02-07 20:52               ` Reese Faucette
2007-02-07 22:28                 ` Ian Pratt
2007-02-07  0:16             ` Santos, Jose Renato G

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='00b901c74a41$86ba3b70$58c31fac@bart' \
    --to=reese@myri.com \
    --cc=xen-devel@lists.xensource.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.