From: Joe Damato <jdamato@fastly.com>
To: Alex Lazar <alazar@nvidia.com>
Cc: "aleksander.lobakin@intel.com" <aleksander.lobakin@intel.com>,
"almasrymina@google.com" <almasrymina@google.com>,
"amritha.nambiar@intel.com" <amritha.nambiar@intel.com>,
"bigeasy@linutronix.de" <bigeasy@linutronix.de>,
"bjorn@rivosinc.com" <bjorn@rivosinc.com>,
"corbet@lwn.net" <corbet@lwn.net>,
Dan Jurgens <danielj@nvidia.com>,
"davem@davemloft.net" <davem@davemloft.net>,
"donald.hunter@gmail.com" <donald.hunter@gmail.com>,
"dsahern@kernel.org" <dsahern@kernel.org>,
"edumazet@google.com" <edumazet@google.com>,
"hawk@kernel.org" <hawk@kernel.org>,
"jiri@resnulli.us" <jiri@resnulli.us>,
"johannes.berg@intel.com" <johannes.berg@intel.com>,
"kuba@kernel.org" <kuba@kernel.org>,
"leitao@debian.org" <leitao@debian.org>,
"leon@kernel.org" <leon@kernel.org>,
"linux-doc@vger.kernel.org" <linux-doc@vger.kernel.org>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"linux-rdma@vger.kernel.org" <linux-rdma@vger.kernel.org>,
"lorenzo@kernel.org" <lorenzo@kernel.org>,
"michael.chan@broadcom.com" <michael.chan@broadcom.com>,
"mkarsten@uwaterloo.ca" <mkarsten@uwaterloo.ca>,
"netdev@vger.kernel.org" <netdev@vger.kernel.org>,
"pabeni@redhat.com" <pabeni@redhat.com>,
Saeed Mahameed <saeedm@nvidia.com>,
"sdf@fomichev.me" <sdf@fomichev.me>,
"skhawaja@google.com" <skhawaja@google.com>,
"sridhar.samudrala@intel.com" <sridhar.samudrala@intel.com>,
Tariq Toukan <tariqt@nvidia.com>,
"willemdebruijn.kernel@gmail.com"
<willemdebruijn.kernel@gmail.com>,
"xuanzhuo@linux.alibaba.com" <xuanzhuo@linux.alibaba.com>,
Gal Pressman <gal@nvidia.com>, Nimrod Oren <noren@nvidia.com>,
Dror Tennenbaum <drort@nvidia.com>,
Dragos Tatulea <dtatulea@nvidia.com>
Subject: Re: [net-next v6 0/9] Add support for per-NAPI config via netlink
Date: Wed, 18 Dec 2024 09:08:58 -0800 [thread overview]
Message-ID: <Z2MBqrc2FM2rizqP@LQ3V64L9R2> (raw)
In-Reply-To: <DM8PR12MB5447837576EA58F490D6D4BFAD052@DM8PR12MB5447.namprd12.prod.outlook.com>
On Wed, Dec 18, 2024 at 11:22:33AM +0000, Alex Lazar wrote:
> Hi Joe and all,
>
> I am part of the NVIDIA Eth drivers team, and we are experiencing a problem,
> sibesced to this change: commit 86e25f40aa1e ("net: napi: Add napi_config")
>
> The issue occurs when sending packets from one machine to another.
> On the receiver side, we have XSK (XDPsock) that receives the packet and sends it
> back to the sender.
> At some point, one packet (packet A) gets "stuck," and if we send a new packet
> (packet B), it "pushes" the previous one. Packet A is then processed by the NAPI
> poll, and packet B gets stuck, and so on.
>
> Your change involves moving napi_hash_del() and napi_hash_add() from
> netif_napi_del() and netif_napi_add_weight() to napi_enable() and napi_disable().
> If I move them back to netif_napi_del() and netif_napi_add_weight(),
> the issue is resolved (I moved the entire if/else block, not just the napi_hash_del/add).
>
> This issue occurs with both the new and old APIs (netif_napi_add/_config).
> Moving the napi_hash_add() and napi_hash_del() functions resolves it for both.
> I am debugging this, no breakthrough so far.
>
> I would appreciate if you could look into this.
> We can provide more details per request.
I appreciate your report, but there is not a lot in your message to
help debug the issue.
Can you please:
1.) Verify that the kernel tree you are testing on has commit
cecc1555a8c2 ("net: Make napi_hash_lock irq safe") included ? If it
does not, can you pull in that commit and re-run your test and
report back if that fixes your problem?
2.) If (1) does not fix your problem, can you please reply with at
least the following information:
- Specify what device this is happening on (in case I have access
to one)
- Which driver is affected
- Which upstream kernel SHA you are building your test kernel from
- The reproducer program(s) with clear instructions on how exactly
to run it/them in order to reproduce the issue
Thanks,
Joe
next prev parent reply other threads:[~2024-12-18 17:09 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-12-18 11:22 [net-next v6 0/9] Add support for per-NAPI config via netlink Alex Lazar
2024-12-18 17:08 ` Joe Damato [this message]
2024-12-20 17:40 ` Joe Damato
2024-12-23 8:17 ` Alex Lazar
2024-12-30 14:31 ` Joe Damato
2025-01-10 18:16 ` Joe Damato
2025-01-10 18:26 ` Stanislav Fomichev
2025-01-10 18:58 ` Martin Karsten
2025-01-12 8:05 ` Alex Lazar
-- strict thread matches above, loose matches on Subject: below --
2024-10-11 18:44 Joe Damato
2024-10-15 1:10 ` patchwork-bot+netdevbpf
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=Z2MBqrc2FM2rizqP@LQ3V64L9R2 \
--to=jdamato@fastly.com \
--cc=alazar@nvidia.com \
--cc=aleksander.lobakin@intel.com \
--cc=almasrymina@google.com \
--cc=amritha.nambiar@intel.com \
--cc=bigeasy@linutronix.de \
--cc=bjorn@rivosinc.com \
--cc=corbet@lwn.net \
--cc=danielj@nvidia.com \
--cc=davem@davemloft.net \
--cc=donald.hunter@gmail.com \
--cc=drort@nvidia.com \
--cc=dsahern@kernel.org \
--cc=dtatulea@nvidia.com \
--cc=edumazet@google.com \
--cc=gal@nvidia.com \
--cc=hawk@kernel.org \
--cc=jiri@resnulli.us \
--cc=johannes.berg@intel.com \
--cc=kuba@kernel.org \
--cc=leitao@debian.org \
--cc=leon@kernel.org \
--cc=linux-doc@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-rdma@vger.kernel.org \
--cc=lorenzo@kernel.org \
--cc=michael.chan@broadcom.com \
--cc=mkarsten@uwaterloo.ca \
--cc=netdev@vger.kernel.org \
--cc=noren@nvidia.com \
--cc=pabeni@redhat.com \
--cc=saeedm@nvidia.com \
--cc=sdf@fomichev.me \
--cc=skhawaja@google.com \
--cc=sridhar.samudrala@intel.com \
--cc=tariqt@nvidia.com \
--cc=willemdebruijn.kernel@gmail.com \
--cc=xuanzhuo@linux.alibaba.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).