From: "Ethy H. Brito" <ethy.brito@inexo.com.br>
To: lartc@vger.kernel.org
Subject: Re: Traffic shaping at 10~300mbps at a 10Gbps link
Date: Wed, 09 Jun 2021 15:04:13 +0000 [thread overview]
Message-ID: <20210609120413.25de5029@babalu> (raw)
In-Reply-To: <20210607133853.045a96d5@babalu>
Hi Guys!
Doesn't anybody can help me with this?
Any help will be appreciated.
Cheers
Ethy
On Mon, 7 Jun 2021 13:38:53 -0300
"Ethy H. Brito" <ethy.brito@inexo.com.br> wrote:
> Hi
>
> I am having a hard time trying to shape 3000 users at ceil speeds from 10 to 300mbps in a 7/7Gbps link using
> HTB+SFQ+TC(filter by IP hashkey mask) for a few days now tweaking HTB and SFQ parameters with no luck so far.
>
> Everything seems right, up 4Gbps overall download speed with shaping on.
> I have no significant packets delay, no dropped packets and no high CPU average loads (not more than 20% - htop info)
>
> But when the speed comes to about 4.5Gbps download (upload is about 500mbps), chaos kicks in.
> CPU load goes sky high (all 24x2.4Ghz physical cores above 90% - 48x2.4Ghz if count that virtualization is on) and as a
> consequence packets are dropped (as reported by tc -s class sh ...), RTT goes above 200ms and a lots of ungry users. This
> goes from about 7PM to 11 PM every day.
>
> If I turn shaping off, everything return to normality immediately and peaks of not more than 5Gbps (1 second average) are
> observed and a CPU load of about 5%. So I infer the uplink is not crowded.
>
> I use one root HTB qdisc and one root (1:) HTB class.
> Then about 20~30 same level (1:xx) inner classes to (sort of) separate the users by region
> And under these inner classes, goes the almost 3000 leaves (1:xxxx).
> I have one class with about 900 users and this quantity decreases by the other inner classes having some of them with just
> one user.
>
> Is the way I'm using HTB+SFQ+TC suitable for this job?
>
> Since the script that creates the shaping environment is too long I do not post it here.
>
> What can I inform you guys to help me solve this?
> Fragments of code, stats, some measurements? What?
>
> Thanks.
>
> Regards
>
> Ethy
--
Ethy H. Brito /"\
InterNexo Ltda. \ / CAMPANHA DA FITA ASCII - CONTRA MAIL HTML
+55 (12) 3797-6860 X ASCII RIBBON CAMPAIGN - AGAINST HTML MAIL
S.J.Campos - Brasil / \
PGP key: http://www.inexo.com.br/~ethy/0xC3F222A0.asc
next prev parent reply other threads:[~2021-06-09 15:04 UTC|newest]
Thread overview: 13+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-06-07 16:38 Traffic shaping at 10~300mbps at a 10Gbps link Ethy H. Brito
2021-06-09 15:04 ` Ethy H. Brito [this message]
2021-06-09 19:11 ` Adam Niescierowicz
2021-06-09 19:30 ` Ethy H. Brito
2021-06-09 19:57 ` Adam Niescierowicz
2021-06-09 22:13 ` Ethy H. Brito
2021-06-12 11:24 ` Anatoly Muliarski
2021-06-14 16:13 ` Ethy H. Brito
2021-06-16 11:43 ` cronolog+lartc
2021-06-16 12:08 ` Erik Auerswald
2021-07-07 2:10 ` L A Walsh
[not found] <20210617121839.39aefb12@babalu>
2021-06-17 16:17 ` Jesper Dangaard Brouer
-- strict thread matches above, loose matches on Subject: below --
2021-06-17 17:57 Ethy H. Brito
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20210609120413.25de5029@babalu \
--to=ethy.brito@inexo.com.br \
--cc=lartc@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.