From: Jakub Kicinski <kuba@kernel.org>
To: Tariq Toukan <ttoukan.linux@gmail.com>
Cc: Yael Chemla <ychemla@nvidia.com>,
davem@davemloft.net, netdev@vger.kernel.org, edumazet@google.com,
pabeni@redhat.com, andrew+netdev@lunn.ch, horms@kernel.org,
Willem de Bruijn <willemb@google.com>,
shuah@kernel.org, linux-kselftest@vger.kernel.org,
Tariq Toukan <tariqt@nvidia.com>, Gal Pressman <gal@nvidia.com>,
noren@nvidia.com
Subject: Re: [PATCH net-next v2 1/2] selftests: drv-net: rss: validate min RSS table size
Date: Tue, 17 Feb 2026 13:57:27 -0800 [thread overview]
Message-ID: <20260217135727.292acc4e@kernel.org> (raw)
In-Reply-To: <ba1885cc-57e7-488b-946b-d08c1644dcaa@gmail.com>
On Mon, 16 Feb 2026 10:28:52 +0200 Tariq Toukan wrote:
> >> This ignores multiple other considerations:
> >>
> >> 1. Existing behavior: In general, mlx5e today implies 2x factor, so it
> >> would fail this new test.
> >>
> >> 2. Device resources: In large scale (high num of channels, or high num
> >> of netdevs on the same chip, or both), it is not obvious that increasing
> >> the indirection table size is still desirable, or even possible. To pass
> >> the selftest, you'll have to limit the max number of channels.
> >>
> >> 3. ch_max should win: Related to point #2. Driver should not enforce
> >> limitations on supported ch_max just to fulfill the recommendation and
> >> pass the test. I prefer flexibility, give the admin the control. That
> >> means, driver would use 4x factor (or larger) whenever possible, but
> >> would not block configurations in which the 4x factor cannot be satisfied.
> >
> > Oh I see.. I wasn't aware the CX7 has a limitation of the indirection
> > table size.
>
> There is a limitation, we read it from FW.
> It's usually not small, much larger than 256.
>
> But currently it can vary according to FW decisions in scale (resource
> management).
>
> > I wrote the test because of a similar limitation in a
> > different NIC, but that one has been fixed.. I have limited access to
> > CX7 NICs, the one I tested on maxed out at 63 queues so the test has
> > passed.
> >
> > Is it not possible to create an indirection table larger than 256
> > entries?
>
> It is possible, depending on the exposed FW capability.
> As of today, there are high-scale configurations (many VFs for example)
> where the FW exposed cap is lowered.
Not entirely sure what you expect the outcome of this discussion to be.
The 2x indirection table has been proven inadequate for real production
use. I'm not talking about some theory or benchmarks, actual workloads
reported machines/NICs with such table as unusable (workload starts
choking way before reaching expected machine capacity).
That said I just checked out of curiosity and the OCP NIC spec also
states:
The minimum supported indirection table size MUST be 128. The minimum
SHOULD be at least 4 times the number of supported receive queues.
so I guess the 4x isn't exactly a new recommendation.
next prev parent reply other threads:[~2026-02-17 21:57 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-01-31 22:54 [PATCH net-next v2 1/2] selftests: drv-net: rss: validate min RSS table size Jakub Kicinski
2026-01-31 22:54 ` [PATCH net-next v2 2/2] docs: networking: mention that RSS table should be 4x the queue count Jakub Kicinski
2026-02-01 7:56 ` Eric Dumazet
2026-02-03 1:10 ` [PATCH net-next v2 1/2] selftests: drv-net: rss: validate min RSS table size patchwork-bot+netdevbpf
2026-02-11 20:10 ` Yael Chemla
2026-02-11 21:43 ` Jakub Kicinski
2026-02-12 9:41 ` Tariq Toukan
2026-02-13 1:22 ` Jakub Kicinski
2026-02-16 8:28 ` Tariq Toukan
2026-02-17 21:57 ` Jakub Kicinski [this message]
2026-02-18 8:02 ` Tariq Toukan
2026-02-18 15:45 ` Jakub Kicinski
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260217135727.292acc4e@kernel.org \
--to=kuba@kernel.org \
--cc=andrew+netdev@lunn.ch \
--cc=davem@davemloft.net \
--cc=edumazet@google.com \
--cc=gal@nvidia.com \
--cc=horms@kernel.org \
--cc=linux-kselftest@vger.kernel.org \
--cc=netdev@vger.kernel.org \
--cc=noren@nvidia.com \
--cc=pabeni@redhat.com \
--cc=shuah@kernel.org \
--cc=tariqt@nvidia.com \
--cc=ttoukan.linux@gmail.com \
--cc=willemb@google.com \
--cc=ychemla@nvidia.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox