Re: tcp bw in 2.6

[David Miller <davem@davemloft.net>]

From: lm@bitmover.com (Larry McVoy)
Date: Mon, 1 Oct 2007 19:20:59 -0700

> A short summary is "can someone please post a test program that sources
> and sinks data at the wire speed?"  because apparently I'm too old and
> clueless to write such a thing.

You're not showing us your test program so there is no way we
can help you out.

My initial inclination, even without that critical information,
is to ask whether you are setting any socket options in way?

In particular, SO_RCVLOWAT can have a large effect here, if you're
setting it to something, that would explain why dd is doing better.  A
lot of people link to "helper libraries" with interfaces to setup
sockets with all sorts of socket option settings by default, try not
using such things if possible.

You also shouldn't dork at all with the receive and send buffer sizes.
They are adjusted dynamically by the kernel as the window grows.  But
if you set them to specific values, this dynamic logic is turned off.