* [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
@ 2024-08-06 9:16 bugzilla-daemon
2024-08-06 21:16 ` [Bug 219129] " bugzilla-daemon
` (12 more replies)
0 siblings, 13 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-06 9:16 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
Bug ID: 219129
Summary: virtio net performance degradation between Windows and
Linux guest in kernel 6.10.3
Product: Virtualization
Version: unspecified
Hardware: All
OS: Linux
Status: NEW
Severity: normal
Priority: P3
Component: kvm
Assignee: virtualization_kvm@kernel-bugs.osdl.org
Reporter: anton.wd@gmail.com
Regression: No
After kernel upgrade from 6.10.2 to 6.10.3 network performance has become very
low between Windows and Linux guest.
Steps to reproduce:
MTU 9000 for all adapters and bridge (Jumbo frame 9014 in Windows)
KVM host, qemu 9.0.2, bridge (e.g. br0)
Linux guest, virtio net adapter bridged to host br0, address e.g. 192.168.0.1
Windows 11 guest, virtio net adapter, bridged to host br0, address e.g.
192.168.0.2
When accessing Linux guest from Windows 11 and if kvm host OR Linux guest has
kernel version 6.10.3 then network performance is poor.
iperf3 for example:
$ iperf3.exe --client 192.168.0.1
Connecting to host 192.168.0.1, port 5201
[ 5] local 192.168.0.2 port 49849 connected to 192.168.0.1 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.01 sec 256 KBytes 2.08 Mbits/sec
[ 5] 1.01-2.01 sec 128 KBytes 1.04 Mbits/sec
[ 5] 2.01-3.01 sec 0.00 Bytes 0.00 bits/sec
[ 5] 3.01-4.01 sec 128 KBytes 1.05 Mbits/sec
[ 5] 4.01-5.00 sec 0.00 Bytes 0.00 bits/sec
[ 5] 5.00-6.01 sec 0.00 Bytes 0.00 bits/sec
[ 5] 6.01-7.01 sec 0.00 Bytes 0.00 bits/sec
[ 5] 7.01-8.01 sec 128 KBytes 1.05 Mbits/sec
[ 5] 8.01-9.01 sec 0.00 Bytes 0.00 bits/sec
[ 5] 9.01-10.01 sec 0.00 Bytes 0.00 bits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.01 sec 640 KBytes 524 Kbits/sec sender
[ 5] 0.00-10.02 sec 384 KBytes 314 Kbits/sec receiver
iperf Done.
If kvm host AND Linux guest has kernel version 6.10.2 then performance seems ok
$ iperf3.exe --client 192.168.0.1
Connecting to host 192.168.0.1, port 5201
[ 5] local 192.168.0.2 port 50092 connected to 192.168.0.1 port 5201
[ ID] Interval Transfer Bitrate
[ 5] 0.00-1.01 sec 3.86 GBytes 33.0 Gbits/sec
[ 5] 1.01-2.01 sec 3.78 GBytes 32.4 Gbits/sec
[ 5] 2.01-3.02 sec 3.72 GBytes 31.6 Gbits/sec
[ 5] 3.02-4.01 sec 3.75 GBytes 32.2 Gbits/sec
[ 5] 4.01-5.01 sec 3.80 GBytes 32.8 Gbits/sec
[ 5] 5.01-6.01 sec 3.64 GBytes 31.3 Gbits/sec
[ 5] 6.01-7.01 sec 3.90 GBytes 33.6 Gbits/sec
[ 5] 7.01-8.00 sec 3.94 GBytes 33.9 Gbits/sec
[ 5] 8.00-9.00 sec 3.83 GBytes 32.9 Gbits/sec
[ 5] 9.00-10.00 sec 3.87 GBytes 33.3 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 38.1 GBytes 32.7 Gbits/sec sender
[ 5] 0.00-10.01 sec 38.1 GBytes 32.7 Gbits/sec receiver
iperf Done.
The following entries appear in the kernel logs on Linux guest:
[ 157.294081] enp3s0: bad gso: type: 1, size: 8960
[ 157.294298] enp3s0: bad gso: type: 1, size: 8960
[ 157.623938] enp3s0: bad gso: type: 1, size: 8960
[ 157.938094] enp3s0: bad gso: type: 1, size: 8960
[ 158.249957] enp3s0: bad gso: type: 1, size: 8960
[ 158.593349] enp3s0: bad gso: type: 1, size: 8960
[ 158.909346] enp3s0: bad gso: type: 1, size: 8960
[ 159.236646] enp3s0: bad gso: type: 1, size: 8960
[ 159.236721] enp3s0: bad gso: type: 1, size: 8960
[ 159.236745] enp3s0: bad gso: type: 1, size: 8960
This is also reproduced for bare metal Windows 11 PC with bridged physical
network adapter to br0 on kvm host.
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
@ 2024-08-06 21:16 ` bugzilla-daemon
2024-08-11 13:34 ` bugzilla-daemon
` (11 subsequent siblings)
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-06 21:16 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
James Tucker (jftucker@gmail.com) changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |jftucker@gmail.com
--- Comment #1 from James Tucker (jftucker@gmail.com) ---
Likely caused by e269d79c7d35aa3808b1f3c1737d63dab504ddc8, fixed by
89add40066f9ed9abe5f7f886fe5789ff7e0c50e
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
2024-08-06 21:16 ` [Bug 219129] " bugzilla-daemon
@ 2024-08-11 13:34 ` bugzilla-daemon
2024-08-12 7:18 ` bugzilla-daemon
` (10 subsequent siblings)
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-11 13:34 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
--- Comment #2 from Thomas Clark (kernel@clark.bz) ---
Any idea when this fix will show up in a released kernel?
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
2024-08-06 21:16 ` [Bug 219129] " bugzilla-daemon
2024-08-11 13:34 ` bugzilla-daemon
@ 2024-08-12 7:18 ` bugzilla-daemon
2024-08-13 15:46 ` bugzilla-daemon
` (9 subsequent siblings)
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-12 7:18 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
--- Comment #3 from Christian Heusel (christian@heusel.eu) ---
No that is not yet clear, but I have proposed it's inclusion to the stable
kernels a few days ago:
https://lore.kernel.org/all/60bc20c5-7512-44f7-88cb-abc540437ae1@heusel.eu
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
` (2 preceding siblings ...)
2024-08-12 7:18 ` bugzilla-daemon
@ 2024-08-13 15:46 ` bugzilla-daemon
2024-08-13 16:22 ` bugzilla-daemon
` (8 subsequent siblings)
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-13 15:46 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
--- Comment #4 from alexucu@gmail.com ---
This doesn't seem to be fixed in 6.10.4 just yet, at least on Arch's default
kernel variant.
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
` (3 preceding siblings ...)
2024-08-13 15:46 ` bugzilla-daemon
@ 2024-08-13 16:22 ` bugzilla-daemon
2024-08-13 16:39 ` bugzilla-daemon
` (7 subsequent siblings)
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-13 16:22 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
--- Comment #5 from Christian Heusel (christian@heusel.eu) ---
Yes this is expected as the patch has not yet been included in the stable
series 😅
I'll wait for a bit and poke the thread again.
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
` (4 preceding siblings ...)
2024-08-13 16:22 ` bugzilla-daemon
@ 2024-08-13 16:39 ` bugzilla-daemon
2024-08-14 10:24 ` bugzilla-daemon
` (6 subsequent siblings)
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-13 16:39 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
--- Comment #6 from Jordan Whited (jordan@jordanwhited.com) ---
https://github.com/jwhited/tun-einval-repro/blob/main/main.go contains a
simplified reproduction of the issue. This writes a GSO_TCPv4 packet to a TUN
device w/GSO=1240 and 2 equal length segments. The write returns EINVAL with
e269d79c7d35aa3808b1f3c1737d63dab504ddc8 absent the fix in
89add40066f9ed9abe5f7f886fe5789ff7e0c50e.
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
` (5 preceding siblings ...)
2024-08-13 16:39 ` bugzilla-daemon
@ 2024-08-14 10:24 ` bugzilla-daemon
2024-08-14 15:27 ` bugzilla-daemon
` (5 subsequent siblings)
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-14 10:24 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
--- Comment #7 from Christian Heusel (christian@heusel.eu) ---
The patch made it to the 6.10 and 6.6 stable queues :)
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
` (6 preceding siblings ...)
2024-08-14 10:24 ` bugzilla-daemon
@ 2024-08-14 15:27 ` bugzilla-daemon
2024-08-15 1:11 ` bugzilla-daemon
` (4 subsequent siblings)
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-14 15:27 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
--- Comment #8 from Thomas Clark (kernel@clark.bz) ---
Thank you!
On 8/14/24 03:24, bugzilla-daemon@kernel.org wrote:
> https://bugzilla.kernel.org/show_bug.cgi?id=219129
>
> --- Comment #7 from Christian Heusel (christian@heusel.eu) ---
> The patch made it to the 6.10 and 6.6 stable queues :)
>
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
` (7 preceding siblings ...)
2024-08-14 15:27 ` bugzilla-daemon
@ 2024-08-15 1:11 ` bugzilla-daemon
2024-08-26 18:52 ` bugzilla-daemon
` (3 subsequent siblings)
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-15 1:11 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
Raymond Jay Golo (rjgolo@gmail.com) changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |rjgolo@gmail.com
--- Comment #9 from Raymond Jay Golo (rjgolo@gmail.com) ---
I can confirm that performance has been restored with 6.10.5 on my Linode
instance. I was wondering why it was suddenly failing to connect to update
servers due to extremely slow downloads or timeouts and now everything is OK.
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
` (8 preceding siblings ...)
2024-08-15 1:11 ` bugzilla-daemon
@ 2024-08-26 18:52 ` bugzilla-daemon
2024-08-26 18:52 ` bugzilla-daemon
` (2 subsequent siblings)
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-26 18:52 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
Salvatore Bonaccorso (carnil@debian.org) changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |carnil@debian.org
--- Comment #10 from Salvatore Bonaccorso (carnil@debian.org) ---
Report on the regressions list:
https://lore.kernel.org/regressions/ZsyMzW-4ee_U8NoX@eldamar.lan/T/#m390d6ef7b733149949fb329ae1abffec5cefb99b
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
` (9 preceding siblings ...)
2024-08-26 18:52 ` bugzilla-daemon
@ 2024-08-26 18:52 ` bugzilla-daemon
2024-08-27 14:44 ` bugzilla-daemon
2024-08-28 16:26 ` bugzilla-daemon
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-26 18:52 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
--- Comment #11 from Salvatore Bonaccorso (carnil@debian.org) ---
And a downstream report in Debian: https://bugs.debian.org/1079684
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
` (10 preceding siblings ...)
2024-08-26 18:52 ` bugzilla-daemon
@ 2024-08-27 14:44 ` bugzilla-daemon
2024-08-28 16:26 ` bugzilla-daemon
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-27 14:44 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
--- Comment #12 from Christian Heusel (christian@heusel.eu) ---
Fix is queued up for 6.1 now aswell, thanks @carnil!
https://lore.kernel.org/all/2024082741-crease-mug-f658@gregkh
https://git.kernel.org/pub/scm/linux/kernel/git/stable/stable-queue.git/tree/queue-6.1/net-drop-bad-gso-csum_start-and-offset-in-virtio_net_hdr.patch
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread* [Bug 219129] virtio net performance degradation between Windows and Linux guest in kernel 6.10.3
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
` (11 preceding siblings ...)
2024-08-27 14:44 ` bugzilla-daemon
@ 2024-08-28 16:26 ` bugzilla-daemon
12 siblings, 0 replies; 14+ messages in thread
From: bugzilla-daemon @ 2024-08-28 16:26 UTC (permalink / raw)
To: kvm
https://bugzilla.kernel.org/show_bug.cgi?id=219129
Karl Tischler (info@it-connect-unix.de) changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |info@it-connect-unix.de
--- Comment #13 from Karl Tischler (info@it-connect-unix.de) ---
The degraded network performance also seems to be a problem in kernel 5.15.165.
Should I file a new bug report?
--
You may reply to this email to add a comment.
You are receiving this mail because:
You are watching the assignee of the bug.
^ permalink raw reply [flat|nested] 14+ messages in thread
end of thread, other threads:[~2024-08-28 16:26 UTC | newest]
Thread overview: 14+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-08-06 9:16 [Bug 219129] New: virtio net performance degradation between Windows and Linux guest in kernel 6.10.3 bugzilla-daemon
2024-08-06 21:16 ` [Bug 219129] " bugzilla-daemon
2024-08-11 13:34 ` bugzilla-daemon
2024-08-12 7:18 ` bugzilla-daemon
2024-08-13 15:46 ` bugzilla-daemon
2024-08-13 16:22 ` bugzilla-daemon
2024-08-13 16:39 ` bugzilla-daemon
2024-08-14 10:24 ` bugzilla-daemon
2024-08-14 15:27 ` bugzilla-daemon
2024-08-15 1:11 ` bugzilla-daemon
2024-08-26 18:52 ` bugzilla-daemon
2024-08-26 18:52 ` bugzilla-daemon
2024-08-27 14:44 ` bugzilla-daemon
2024-08-28 16:26 ` bugzilla-daemon
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).