From: Ben Greear <greearb@candelatech.com>
To: Simon Chen <simonchennj@gmail.com>
Cc: netdev@vger.kernel.org
Subject: Re: under-performing bonded interfaces
Date: Wed, 16 Nov 2011 16:01:15 -0800 [thread overview]
Message-ID: <4EC44ECB.4050201@candelatech.com> (raw)
In-Reply-To: <CANj2EbeMRzicixHwrKpCQ3mMqQ1qbyjbRCxpW+CmVRREAhyeRQ@mail.gmail.com>
On 11/16/2011 03:44 PM, Simon Chen wrote:
> Hello,
>
> I am bonding two 10G interfaces (ixgbe driver) under Debian 6.0.2. The
> bonded interface for some reason can only achieve 12Gbps aggregated
> throughput. If a single NIC is used, I can get close to 10Gbps.
>
> I've tried different bonding modes (balance-xor, 802.3ad, balance-alb,
> balance-tlb), and different xmit hashing policy (layer2, layer2+3,
> layer3+4). I've increased all types of kernel parameters for TCP. MTU
> on the physical and bonded interface is set to 8000 and 9000. The MTU
> on the switch is 9200+.
>
> Instead of nperf (a single server), I also tried my own TCP sender and
> receivers.
>
> All those done, still only 12Gbps... How can I really achieve close to 20Gbps?
>
> (I also tried cutting loose the switch in between, and also getting
> 12G, so not an issue with the switch.)
How much can you get if you run each of the NIC ports independently
w/out bonding? Plz send the 'dmesg' messages about ixgbe (ie, how
many lanes, how many GT/s). What is your processor?
Thanks,
Ben
--
Ben Greear <greearb@candelatech.com>
Candela Technologies Inc http://www.candelatech.com
next prev parent reply other threads:[~2011-11-17 0:01 UTC|newest]
Thread overview: 15+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-11-16 23:44 under-performing bonded interfaces Simon Chen
2011-11-17 0:01 ` Ben Greear [this message]
2011-11-17 0:05 ` Simon Chen
2011-11-17 0:07 ` Ben Greear
2011-11-17 0:57 ` Ben Hutchings
2011-11-17 1:38 ` Simon Chen
2011-11-17 1:45 ` Simon Chen
2011-11-17 1:45 ` Rick Jones
2011-11-17 2:51 ` Ben Hutchings
2011-12-22 1:26 ` Simon Chen
2011-12-22 1:36 ` Stephen Hemminger
2011-12-22 3:31 ` Ben Greear
2011-12-22 2:28 ` Simon Chen
2011-12-22 5:43 ` Eric Dumazet
2011-12-23 15:03 ` Simon Chen
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4EC44ECB.4050201@candelatech.com \
--to=greearb@candelatech.com \
--cc=netdev@vger.kernel.org \
--cc=simonchennj@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.