From: Robert Olsson <Robert.Olsson@data.slu.se>
To: "David S. Miller" <davem@redhat.com>
Cc: hadi@cyberus.ca, greearb@candelatech.com, jgarzik@pobox.com,
scott.feldman@intel.com, netdev@oss.sgi.com, ricardoz@us.ibm.com
Subject: Re: [e1000 2.6 10/11] TxDescriptors -> 1024 default
Date: Sat, 13 Sep 2003 13:52:36 +0200 [thread overview]
Message-ID: <16227.1284.893748.365713@robur.slu.se> (raw)
In-Reply-To: <20030912204947.5267e3aa.davem@redhat.com>
David S. Miller writes:
> On 11 Sep 2003 21:34:23 -0400
> jamal <hadi@cyberus.ca> wrote:
>
> > dont increase the tx descriptor ring size - that would truly wasting
> > memory; 256 is pretty adequate.
> > * increase instead the txquelen (as suggested by Davem); user space
> > tools like ip or ifconfig could do it. The standard size has been around
> > 100 for 100Mbps; i suppose it is fair to say that Gige can move data out
> > at 10x that; so set it to 1000. Maybe you can do this from the driver
> > based on what negotiated speed is detected?
>
> I spoke with Alexey once about this, actually tx_queue_len can
> be arbitrarily large but it should be reasonable nonetheless.
>
> Our preliminary conclusions were that values of 1000 for 100Mbit and
> faster were probably appropriate. Maybe something larger for 1Gbit,
> who knows.
>
> We also determined that the only connection between TX descriptor
> ring size and dev->tx_queue_len was that the latter should be large
> enough to handle, at a minimum, the amount of pending TX descriptor
> ACKs that can be pending considering mitigation et al.
>
> So if TX irq mitigation can defer up to N TX descriptor completions
> then dev->tx_queue_len must be at least that large.
>
> Back to the main topic, maybe we should set dev->tx_queue_len to
> 1000 by default for all ethernet devices.
Hello!
Yes sounds like adequate setting for GIGE. This is what use for production
and lab but rather than increasing dev->tx_queue_len to 1000 we replace the
pfifo_fast with the pfifo qdisc w. setting a qlen of 1000.
And with we have tx_descriptor_ring_size 256 which is tuned to the NIC's
"TX service interval" with respect to interrupt mitigation etc. This seems
good enough even for small packets.
For routers this setting is even more crucial as we need to serialize
several flows and we know the flows are bursty.
Cheers.
--ro
next prev parent reply other threads:[~2003-09-13 11:52 UTC|newest]
Thread overview: 46+ messages / expand[flat|nested] mbox.gz Atom feed top
2003-09-09 3:14 [e1000 2.6 10/11] TxDescriptors -> 1024 default Feldman, Scott
2003-09-11 19:18 ` Jeff Garzik
2003-09-11 19:45 ` Ben Greear
2003-09-11 19:59 ` Jeff Garzik
2003-09-11 20:12 ` David S. Miller
2003-09-11 20:40 ` Ben Greear
2003-09-11 21:07 ` David S. Miller
2003-09-11 21:29 ` Ben Greear
2003-09-11 21:29 ` David S. Miller
2003-09-11 21:47 ` Ricardo C Gonzalez
2003-09-11 22:00 ` Jeff Garzik
2003-09-11 22:15 ` Ben Greear
2003-09-11 23:02 ` David S. Miller
2003-09-11 23:22 ` Ben Greear
2003-09-11 23:29 ` David S. Miller
2003-09-12 1:34 ` jamal
2003-09-12 2:20 ` Ricardo C Gonzalez
2003-09-12 3:05 ` jamal
2003-09-13 3:49 ` David S. Miller
2003-09-13 11:52 ` Robert Olsson [this message]
2003-09-15 12:12 ` jamal
2003-09-15 13:45 ` Robert Olsson
2003-09-15 23:15 ` David S. Miller
2003-09-16 9:28 ` Robert Olsson
2003-09-14 19:08 ` Ricardo C Gonzalez
2003-09-15 2:50 ` David Brownell
2003-09-15 8:17 ` David S. Miller
2004-05-15 12:14 ` TxDescriptors -> 1024 default. Please not for every NIC! Marc Herbert
2004-05-19 9:30 ` Marc Herbert
2004-05-19 10:27 ` Pekka Pietikainen
2004-05-20 14:11 ` Luis R. Rodriguez
2004-05-20 16:38 ` [Prism54-devel] " Jean Tourrilhes
2004-05-20 16:45 ` Tomasz Torcz
2004-05-20 17:13 ` zero copy TX in benchmarks was " Andi Kleen
2004-05-19 11:54 ` Andi Kleen
[not found] <3F60DE5B.1010700@pobox.com>
2003-09-11 21:27 ` [e1000 2.6 10/11] TxDescriptors -> 1024 default Ricardo C Gonzalez
-- strict thread matches above, loose matches on Subject: below --
2003-09-12 5:13 Feldman, Scott
2003-09-12 12:44 ` jamal
2003-09-12 15:29 ` Donald Becker
2003-09-12 17:44 ` Ricardo C Gonzalez
2003-09-15 11:37 ` jamal
2003-09-12 18:12 ` Ben Greear
2003-09-12 18:31 ` Ricardo C Gonzalez
2003-09-15 11:29 ` jamal
[not found] <Pine.LNX.4.58.0405141430340.4622@fcat>
2004-05-18 14:34 ` Ricardo C Gonzalez
2004-06-02 19:11 ` Marc Herbert
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=16227.1284.893748.365713@robur.slu.se \
--to=robert.olsson@data.slu.se \
--cc=davem@redhat.com \
--cc=greearb@candelatech.com \
--cc=hadi@cyberus.ca \
--cc=jgarzik@pobox.com \
--cc=netdev@oss.sgi.com \
--cc=ricardoz@us.ibm.com \
--cc=scott.feldman@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).