From: Stephen Hemminger <shemminger@osdl.org>
To: Matt Leininger <mlleinin@hpcn.ca.sandia.gov>
Cc: Shirley Ma <xma@us.ibm.com>,
netdev@vger.kernel.org,
Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
openib-general@openib.org,
"David S. Miller" <davem@davemloft.net>,
mst@mellanox.co.il
Subject: Re: [openib-general] Re: TSO and IPoIB performance degradation
Date: Tue, 7 Mar 2006 13:49:07 -0800 [thread overview]
Message-ID: <20060307134907.733d3d27@localhost.localdomain> (raw)
In-Reply-To: <1141767891.6119.903.camel@localhost>
On Tue, 07 Mar 2006 13:44:51 -0800
Matt Leininger <mlleinin@hpcn.ca.sandia.gov> wrote:
> On Mon, 2006-03-06 at 19:13 -0800, Shirley Ma wrote:
> >
> > > More likely you are getting hit by the fact that TSO prevents the
> > congestion
> > window from increasing properly. This was fixed in 2.6.15 (around mid
> > of Nov 2005).
> >
> > Yep, I noticed the same problem. After updating to the new kernel, the
> > performance are much better, but it's still lower than before.
>
> Here is an updated version of OpenIB IPoIB performance for various
> kernels with and without one of the TSO patches. The netperf
> performance for the latest kernels has not improved the TSO performance
> drop.
>
> Any comments or suggestions would be appreciated.
>
> - Matt
Configuration information? like did you increase the tcp_rmem, tcp_wmem?
Tcpdump traces of what is being sent and available window?
Is IB using NAPI or just doing netif_rx()?
WARNING: multiple messages have this Message-ID (diff)
From: Stephen Hemminger <shemminger@osdl.org>
To: Matt Leininger <mlleinin@hpcn.ca.sandia.gov>
Cc: netdev@vger.kernel.org,
Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
openib-general@openib.org,
"David S. Miller" <davem@davemloft.net>
Subject: Re: Re: TSO and IPoIB performance degradation
Date: Tue, 7 Mar 2006 13:49:07 -0800 [thread overview]
Message-ID: <20060307134907.733d3d27@localhost.localdomain> (raw)
In-Reply-To: <1141767891.6119.903.camel@localhost>
On Tue, 07 Mar 2006 13:44:51 -0800
Matt Leininger <mlleinin@hpcn.ca.sandia.gov> wrote:
> On Mon, 2006-03-06 at 19:13 -0800, Shirley Ma wrote:
> >
> > > More likely you are getting hit by the fact that TSO prevents the
> > congestion
> > window from increasing properly. This was fixed in 2.6.15 (around mid
> > of Nov 2005).
> >
> > Yep, I noticed the same problem. After updating to the new kernel, the
> > performance are much better, but it's still lower than before.
>
> Here is an updated version of OpenIB IPoIB performance for various
> kernels with and without one of the TSO patches. The netperf
> performance for the latest kernels has not improved the TSO performance
> drop.
>
> Any comments or suggestions would be appreciated.
>
> - Matt
Configuration information? like did you increase the tcp_rmem, tcp_wmem?
Tcpdump traces of what is being sent and available window?
Is IB using NAPI or just doing netif_rx()?
next prev parent reply other threads:[~2006-03-07 21:49 UTC|newest]
Thread overview: 65+ messages / expand[flat|nested] mbox.gz Atom feed top
2006-03-06 22:34 TSO and IPoIB performance degradation Michael S. Tsirkin
2006-03-06 22:40 ` David S. Miller
2006-03-06 22:40 ` David S. Miller
2006-03-06 22:50 ` Stephen Hemminger
2006-03-06 22:50 ` Stephen Hemminger
2006-03-07 3:13 ` Shirley Ma
2006-03-07 21:44 ` [openib-general] " Matt Leininger
2006-03-07 21:44 ` Matt Leininger
2006-03-07 21:49 ` Stephen Hemminger [this message]
2006-03-07 21:49 ` Stephen Hemminger
2006-03-07 21:53 ` [openib-general] " Michael S. Tsirkin
2006-03-07 21:53 ` Michael S. Tsirkin
2006-03-08 0:11 ` [openib-general] " Matt Leininger
2006-03-08 0:11 ` Matt Leininger
2006-03-08 0:18 ` [openib-general] " David S. Miller
2006-03-08 0:18 ` David S. Miller
2006-03-08 1:17 ` [openib-general] " Roland Dreier
2006-03-08 1:17 ` Roland Dreier
2006-03-08 1:23 ` [openib-general] " David S. Miller
2006-03-08 1:23 ` David S. Miller
2006-03-08 1:34 ` [openib-general] " Roland Dreier
2006-03-08 1:34 ` Roland Dreier
2006-03-08 12:53 ` Michael S. Tsirkin
2006-03-08 12:53 ` Michael S. Tsirkin
2006-03-08 20:53 ` David S. Miller
2006-03-09 23:48 ` David S. Miller
2006-03-09 23:48 ` David S. Miller
2006-03-10 0:10 ` Michael S. Tsirkin
2006-03-10 0:10 ` Michael S. Tsirkin
2006-03-10 0:38 ` Michael S. Tsirkin
2006-03-10 7:18 ` David S. Miller
2006-03-10 7:18 ` David S. Miller
2006-03-10 0:21 ` Rick Jones
2006-03-10 0:21 ` Rick Jones
2006-03-10 7:23 ` David S. Miller
2006-03-10 7:23 ` David S. Miller
2006-03-10 17:44 ` Rick Jones
2006-03-10 17:44 ` Rick Jones
2006-03-20 9:06 ` Michael S. Tsirkin
2006-03-20 9:06 ` Michael S. Tsirkin
2006-03-20 9:55 ` David S. Miller
2006-03-20 9:55 ` David S. Miller
2006-03-20 10:22 ` Michael S. Tsirkin
2006-03-20 10:22 ` Michael S. Tsirkin
2006-03-20 10:37 ` David S. Miller
2006-03-20 10:37 ` David S. Miller
2006-03-20 11:27 ` Michael S. Tsirkin
2006-03-20 11:27 ` Michael S. Tsirkin
2006-03-20 11:47 ` Arjan van de Ven
2006-03-20 11:47 ` Arjan van de Ven
2006-03-20 11:49 ` Lennert Buytenhek
2006-03-20 11:49 ` Lennert Buytenhek
2006-03-20 11:53 ` Arjan van de Ven
2006-03-20 11:53 ` Arjan van de Ven
2006-03-20 13:35 ` Michael S. Tsirkin
2006-03-20 13:35 ` Michael S. Tsirkin
2006-03-20 12:04 ` Michael S. Tsirkin
2006-03-20 12:04 ` Michael S. Tsirkin
2006-03-20 15:09 ` Benjamin LaHaise
2006-03-20 15:09 ` Benjamin LaHaise
2006-03-20 18:58 ` Rick Jones
2006-03-20 18:58 ` Rick Jones
2006-03-20 23:00 ` David S. Miller
2006-03-20 23:00 ` David S. Miller
2006-04-27 4:13 ` Troy Benjegerdes
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20060307134907.733d3d27@localhost.localdomain \
--to=shemminger@osdl.org \
--cc=davem@davemloft.net \
--cc=linux-kernel@vger.kernel.org \
--cc=mlleinin@hpcn.ca.sandia.gov \
--cc=mst@mellanox.co.il \
--cc=netdev@vger.kernel.org \
--cc=openib-general@openib.org \
--cc=xma@us.ibm.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.