From: Rick Jones <rick.jones2@hp.com>
To: Jerry Chu <hkchu@google.com>
Cc: Jason Wang <jasowang@redhat.com>,
"netdev@vger.kernel.org" <netdev@vger.kernel.org>,
"Michael S. Tsirkin" <mst@redhat.com>
Subject: Re: qlen check in tun.c
Date: Wed, 19 Jun 2013 14:37:11 -0700 [thread overview]
Message-ID: <51C22487.4080505@hp.com> (raw)
In-Reply-To: <CAPshTCg=v0Sy-bDg=RrGT=JGKVLTgCj3rZwKG_EK9p5C2sJOmA@mail.gmail.com>
On 06/19/2013 01:42 PM, Jerry Chu wrote:
> On Wed, Jun 19, 2013 at 12:49 PM, Rick Jones <rick.jones2@hp.com> wrote:
>> Assuming this single-stream is a netperf test, what happens when you cap the
>> socket buffers to 724000 bytes? Put another way, is this simply a situation
>> where the autotuning of the socket buffers/window is taking a connection
>> somewhere it shouldn't go?
>
> You have a good point - for single netperf streaming the TCP window seems to
> grow much larger than necessary. Manually capping socket buffer seems to make
> the problem go away without hurting throughput - but only to some extent.
> Unfortunately manual setting is undesirable, and the autotuning code
> is difficult to "tune".
>
...
>> Just what is the bandwidthXdelay product through the openvswitch?
>
> Unlike the traditional NIC, for tuntap it'd be CPU b/w times scheduling delay.
> Both can have a large variance. I haven't figured out how to right size the
> qlen in this scenario.
In perhaps overly broad, handwaving terms, doesn't wireless have a
similar problem with highly variable latency/delay?
In theory, if your max scheduling delay is 10 milliseconds, your still
not large enough 8192 entry queue should still get you 1 GB/s assuming
that it is >> 1 GB/s between scheduling delays. Is there really an
expectation/requirement to get better than that or have even larger
scheduling delays? The existence of 40 and 100 GbE (even bonded 10GbE)
notwithstanding, once one is talking about 1 GB/s one is looking more at
SR-IOV I would think, not going through an Openvswitch.
Do you actually still see single-stream drops at 8192? That should be
something like 11 MB of queuing - I don't think I've seen tcp_[wr]mem go
above 6 MB thusfar...
rick
next prev parent reply other threads:[~2013-06-19 21:37 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-06-19 2:31 qlen check in tun.c Jerry Chu
2013-06-19 3:29 ` Jason Wang
2013-06-19 19:39 ` Jerry Chu
2013-06-19 19:49 ` Rick Jones
2013-06-19 20:42 ` Jerry Chu
2013-06-19 21:37 ` Rick Jones [this message]
2013-06-20 8:07 ` Michael S. Tsirkin
2013-06-24 5:13 ` Jason Wang
2013-06-25 22:23 ` Jerry Chu
2013-06-26 5:23 ` Jason Wang
[not found] ` <CAPshTCjbOnZJ6c2tyLbBqZ3Pz=xi+cBMvi=0BqPDyiXJ+jDDOA@mail.gmail.com>
2013-06-26 5:44 ` Jason Wang
2013-06-21 6:44 ` Jason Wang
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=51C22487.4080505@hp.com \
--to=rick.jones2@hp.com \
--cc=hkchu@google.com \
--cc=jasowang@redhat.com \
--cc=mst@redhat.com \
--cc=netdev@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.