From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 4CC562D46AB for ; Tue, 15 Jul 2025 09:43:40 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=170.10.129.124 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1752572625; cv=none; b=F/JSpOSSgu+CLnfJL60snvRlHoibBcHXzZ4Os58/D/xRyBq1VBJnO0UDtCCaRoFxHJQr8LLaO7ivTiU4+7KSeiGsAvLCx8bTNUOh5lCed4PEmxVz47gZCwv+/6/fHLqQuGdQua2vqmHW/ECCh+50cX0dOqiUrYVx9T+r3fEqHzE= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1752572625; c=relaxed/simple; bh=izVGqEo59aQaJ/J3dKmYZUnzyzOQr38MLYsTGyUr5V0=; h=Date:From:To:Cc:Subject:Message-ID:References:MIME-Version: Content-Type:Content-Disposition:In-Reply-To; b=QiKAYbdAxEtrpnc6l5MaonX96ovZyLjNFuMCQpccZmmaRWLlIf8YV1asdZEArYLDxbx1k7+8orJHYUqkb1TDN/ZBwIo4IHWxXVrr9z6T6q8VI1aeZUO/0gzpqX5+Uo5jhDq7pRkVY8bx8lOP11PtLyBj4SMf13MojdksY9tTLSQ= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=redhat.com; spf=pass smtp.mailfrom=redhat.com; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b=Zd+0ipyE; arc=none smtp.client-ip=170.10.129.124 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=redhat.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=redhat.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="Zd+0ipyE" DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1752572619; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=wHMd57pfXhcnKNyhyGblHFv+xYATdiBZA7QtN8Jk8ZM=; b=Zd+0ipyEzQpJ2GVGQZj2Esq8jY2Hs+Dmw9w7aKFptsCIqvk+8JOCLD1As3iaxRokdMR7ve 8oMI4TYbv2UwJHqlCe/YnKifHt9NrBHz4s4bI6YzyoZStr541FjRVognnaEN5r63DCzE2k Ah1ltZsVJw+RhZsHUGU7PQZh7ynuJbk= Received: from mail-wm1-f72.google.com (mail-wm1-f72.google.com [209.85.128.72]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-19-ri3dKmOnNDaGj5dEc9oaAA-1; Tue, 15 Jul 2025 05:43:37 -0400 X-MC-Unique: ri3dKmOnNDaGj5dEc9oaAA-1 X-Mimecast-MFC-AGG-ID: ri3dKmOnNDaGj5dEc9oaAA_1752572617 Received: by mail-wm1-f72.google.com with SMTP id 5b1f17b1804b1-45624f0be48so4885545e9.3 for ; Tue, 15 Jul 2025 02:43:37 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1752572616; x=1753177416; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=wHMd57pfXhcnKNyhyGblHFv+xYATdiBZA7QtN8Jk8ZM=; b=s5DowF/NEadCgv+lbc1jWr7L/ssWkhDXu4tZXbEdb0UonWr7NuEVv1BCHrEZtoR127 4eQaAtMmOFJkRDREJT4py9MeL4weeu/I1Yz7Asp1xJjB2jY3hUG1t/Pdf0aWCkQ02Ztb v9RRge0LYyAms4fu77f3JV9NVTZzROeGLASCaFoqd1YozclmNpDP+PrKipyjaH+oP4Lh tfDmAXOyRW9jDXqkT+eaeCA8klZujxoFBIuXgrYkU3TtsBtw3oNhMxUOPqlpf2ut1v6o RpZNMbEVY9lbj1snnUO2v/15VcCxoy/OuKfpjzMBkQ3h6RouoVv6DvfFKdRTiAvSPfcJ 4DqA== X-Forwarded-Encrypted: i=1; AJvYcCXZPaWiNxeqUtvr68jH/MR7j9YTefsSkMZ+gkqdWUZcsrouwe/kKKDArYu36K14Lfm0te3JRw0=@vger.kernel.org X-Gm-Message-State: AOJu0Yz1c3thLfY+IpH5VfFAh/Pblhhobg5xO2OCh5pApggyte/c8pce 2Na7fQVedW2qcAMW1zXnKnNjX39z6ssikW1xpXChMtJMkAV1ds+4XG3ihKomkZxtPqzMjVWhniv xr60nW7wU1UfG3gRIzHqWmE7kUA+BF6fEQmblTHKmyK2Z5DVMr2jY1bcBfQ== X-Gm-Gg: ASbGnctFGig7vETNZ0UDkX9Y6w706KewAQbsJqo+/xJUsT08hmMIuIc1PjKjR3qj2mw RpN2DBG4CUENkxHGx9PmnDdQJ05A7DDh+2RjAZFth1kaF6Nb1b0Pia0qwmdBjW+4gYNAyiYUQ6K zdcphFdYwHNv+1l/aaUUlxFWpSal372sv5v3QsZ4a5/2btTzkTzStgHAA4hHUzxZemvJfZiDb2B 4rZJl5KP0aJzGyYCzfZI0F0YshL5jhNyVjVHT8lY9T6hb2H2u1XFgsrmc/nFX+SiLyeDi6eAptm /NqTSPUP7lOwJku1md7eMjDnv1U= X-Received: by 2002:a05:600c:821b:b0:43c:ec4c:25b4 with SMTP id 5b1f17b1804b1-4555f89f507mr187240735e9.10.1752572616439; Tue, 15 Jul 2025 02:43:36 -0700 (PDT) X-Google-Smtp-Source: AGHT+IFN73ANiZ06ERUP471KmOgFnUFAPyMUPH/okS1ibcPZuQjxLvuh1FG3xOFXv+UfdNO1P57u2Q== X-Received: by 2002:a05:600c:821b:b0:43c:ec4c:25b4 with SMTP id 5b1f17b1804b1-4555f89f507mr187240285e9.10.1752572615932; Tue, 15 Jul 2025 02:43:35 -0700 (PDT) Received: from debian ([2001:4649:f075:0:a45e:6b9:73fc:f9aa]) by smtp.gmail.com with ESMTPSA id ffacd0b85a97d-3b5e8bd1833sm14279030f8f.8.2025.07.15.02.43.32 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 15 Jul 2025 02:43:34 -0700 (PDT) Date: Tue, 15 Jul 2025 11:43:30 +0200 From: Guillaume Nault To: Salvatore Bonaccorso Cc: Stefano Brivio , Aaron Conole , Jakub Kicinski , "David S. Miller" , David Ahern , Eric Dumazet , Simon Horman , netdev@vger.kernel.org, Paolo Abeni , Charles Bordet , linux-kernel@vger.kernel.org, regressions@lists.linux.dev, stable@vger.kernel.org, 1108860@bugs.debian.org Subject: Re: [regression] Wireguard fragmentation fails with VXLAN since 8930424777e4 ("tunnels: Accept PACKET_HOST skb_tunnel_check_pmtu().") causing network timeouts Message-ID: References: Precedence: bulk X-Mailing-List: stable@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: On Mon, Jul 14, 2025 at 09:57:52PM +0200, Salvatore Bonaccorso wrote: > Hi, > > Charles Bordet reported the following issue (full context in > https://bugs.debian.org/1108860) > > > Dear Maintainer, > > > > What led up to the situation? > > We run a production environment using Debian 12 VMs, with a network > > topology involving VXLAN tunnels encapsulated inside Wireguard > > interfaces. This setup has worked reliably for over a year, with MTU set > > to 1500 on all interfaces except the Wireguard interface (set to 1420). > > Wireguard kernel fragmentation allowed this configuration to function > > without issues, even though the effective path MTU is lower than 1500. > > > > What exactly did you do (or not do) that was effective (or ineffective)? > > We performed a routine system upgrade, updating all packages include the > > kernel. After the upgrade, we observed severe network issues (timeouts, > > very slow HTTP/HTTPS, and apt update failures) on all VMs behind the > > router. SSH and small-packet traffic continued to work. > > > > To diagnose, we: > > > > * Restored a backup (with the previous kernel): the problem disappeared. > > * Repeated the upgrade, confirming the issue reappeared. > > * Systematically tested each kernel version from 6.1.124-1 up to > > 6.1.140-1. The problem first appears with kernel 6.1.135-1; all earlier > > versions work as expected. > > * Kernel version from the backports (6.12.32-1) did not resolve the > > problem. > > > > What was the outcome of this action? > > > > * With kernel 6.1.135-1 or later, network timeouts occur for > > large-packet protocols (HTTP, apt, etc.), while SSH and small-packet > > protocols work. > > * With kernel 6.1.133-1 or earlier, everything works as expected. > > > > What outcome did you expect instead? > > We expected the network to function as before, with Wireguard handling > > fragmentation transparently and no application-level timeouts, > > regardless of the kernel version. > > While triaging the issue we found that the commit 8930424777e4 > ("tunnels: Accept PACKET_HOST in skb_tunnel_check_pmtu()." introduces > the issue and Charles confirmed that the issue was present as well in > 6.12.35 and 6.15.4 (other version up could potentially still be > affected, but we wanted to check it is not a 6.1.y specific > regression). > > Reverthing the commit fixes Charles' issue. > > Does that ring a bell? It doesn't ring a bell. Do you have more details on the setup that has the problem? Or, ideally, a self-contained reproducer? > Regards, > Salvatore >