From: Richard Gobert <richardbgobert@gmail.com>
To: Gal Pressman <gal@nvidia.com>
Cc: davem@davemloft.net, edumazet@google.com, kuba@kernel.org,
pabeni@redhat.com, aleksander.lobakin@intel.com,
lixiaoyan@google.com, lucien.xin@gmail.com,
alexanderduyck@fb.com, netdev@vger.kernel.org,
linux-kernel@vger.kernel.org
Subject: Re: [PATCH v3 1/1] gro: decrease size of CB
Date: Fri, 30 Jun 2023 17:39:25 +0200 [thread overview]
Message-ID: <20230630153923.GA18237@debian> (raw)
In-Reply-To: <431d8445-9593-73df-d431-d5e76c9085cf@nvidia.com>
I haven't been able to reproduce it yet, I tried two different setups:
- 2 VMs running locally on my PC, and a geneve interface for each. Over
these geneve interfaces, I sent tcp traffic with a similar iperf
command as yours.
- A geneve tunnel over veth peers inside two separate namespaces as
David suggested.
The throughput looked fine and identical with and without my patch in both
setups.
Although I did validate it while working on the patch, a problem may arise
from:
- Packing CB members into a union, which could've led to some sort of
corruption.
- Calling `gro_pull_from_frag0` on the current skb before inserting it
into `gro_list`.
Could I ask you to run some tests:
- Running the script I attached here on one machine and checking whether
it reproduces the problem.
- Reverting part of my commit:
- Reverting the change to CB struct while keeping the changes to
`gro_pull_from_frag0`.
- Checking whether the regression remains.
Also, could you give me some more details:
- The VMs' NIC and driver. Are you using Qemu?
- iperf results.
- The exact kernel versions (commit hashes) you are using.
- Did you run the commands (sysctl/ethtool) on the receiving VM?
Here are the commands I used for the namespaces test's setup:
```
ip netns add ns1
ip link add veth0 type veth peer name veth1
ip link set veth1 netns ns1
ip a add 192.168.1.1/32 dev veth0
ip link set veth0 up
ip r add 192.168.1.0/24 dev veth0
ip netns exec ns1 ip a add 192.168.1.2/32 dev veth1
ip netns exec ns1 ip link set veth1 up
ip netns exec ns1 ip r add 192.168.1.0/24 dev veth1
ip link add name gnv0 type geneve id 1000 remote 192.168.1.2
ip a add 10.0.0.1/32 dev gnv0
ip link set gnv0 up
ip r add 10.0.1.1/32 dev gnv0
ip netns exec ns1 ip link add name gnv0 type geneve id 1000 remote 192.168.1.1
ip netns exec ns1 ip a add 10.0.1.1/32 dev gnv0
ip netns exec ns1 ip link set gnv0 up
ip netns exec ns1 ip r add 10.0.0.1/32 dev gnv0
ethtool -K veth0 generic-receive-offload off
ip netns exec ns1 ethtool -K veth1 generic-receive-offload off
# quick way to enable gro on veth devices
ethtool -K veth0 tcp-segmentation-offload off
ip netns exec ns1 ethtool -K veth1 tcp-segmentation-offload off
```
I'll continue looking into it on Monday. It would be great if someone from
your team can write a test that reproduces this issue.
Thanks.
next prev parent reply other threads:[~2023-06-30 15:40 UTC|newest]
Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-06-01 16:09 [PATCH v3 0/1] gro: decrease size of CB Richard Gobert
2023-06-01 16:14 ` [PATCH v3 1/1] " Richard Gobert
2023-06-06 7:25 ` Eric Dumazet
2023-06-26 8:55 ` Gal Pressman
2023-06-27 14:21 ` David Ahern
[not found] ` <b3908ce2-43e1-b56d-5d1d-48a932a2a016@nvidia.com>
2023-06-28 14:19 ` David Ahern
2023-08-23 14:43 ` Gal Pressman
2023-08-24 3:31 ` David Ahern
2023-06-29 12:36 ` Richard Gobert
[not found] ` <431d8445-9593-73df-d431-d5e76c9085cf@nvidia.com>
2023-06-30 15:39 ` Richard Gobert [this message]
2023-07-02 14:41 ` Gal Pressman
2023-07-02 14:46 ` Gal Pressman
2023-07-03 14:23 ` Richard Gobert
2023-07-07 12:31 ` Richard Gobert
2023-07-09 6:55 ` Gal Pressman
2023-06-02 14:22 ` [PATCH v3 0/1] " Alexander Lobakin
2023-06-05 13:58 ` Richard Gobert
2023-06-06 13:24 ` Alexander Lobakin
2023-06-06 9:20 ` patchwork-bot+netdevbpf
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20230630153923.GA18237@debian \
--to=richardbgobert@gmail.com \
--cc=aleksander.lobakin@intel.com \
--cc=alexanderduyck@fb.com \
--cc=davem@davemloft.net \
--cc=edumazet@google.com \
--cc=gal@nvidia.com \
--cc=kuba@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=lixiaoyan@google.com \
--cc=lucien.xin@gmail.com \
--cc=netdev@vger.kernel.org \
--cc=pabeni@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).