From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.remote-ip=209.85.208.41 ARC-Seal: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; cv=none; t=1794283042; b=spVNWZCTE0/P+5DlAoY016nXkOnB+0xe1awFnV3XglRxgcUXRJ27pfUb3fP50ieu7SB5 sHkgDbVwEoR6LKkf1S9jQB3GOQJ0QvcSfGCpx85TI5/i+6D3iAbBgWFaWKyTRNiJVOHSF EIZXGa6sI/mzX7+LWzvxQOuP03keeixRR18KXO5IwBQnDWrisxnXb5tGvglzfDkhmNVn3 9vL5gYVcISOO35jY3hQDbfi2h9jBll85+HCdBJN6dr/m0KavWw3aBx3MB+cj2LprZNlnI 5OIIE+gX4XtzvAcuSX+Ej5h0cZJmYttqoSiKKdT/WzqtZicUANghDYnbIwNYd6mTxIg== ARC-Message-Signature: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; c=relaxed/relaxed; t=1794283042; h=DMARC-Filter:Received:DKIM-Signature:X-Google-DKIM-Signature: X-Forwarded-Encrypted:X-Gm-Message-State:X-Gm-Gg:X-Received:Received: From:To:Cc:Subject:Date:Message-ID:X-Mailer:MIME-Version: Content-Transfer-Encoding; bh=eceI8dL07kv9yfwsc+DTSqIVxIuF3lFqQT3hh7B4xzA=; b=r2MoRi/h4v4/fG5eYWDvjClPQu1nXCds80vZV6mfTAQmSmKyDbJLMKgcG82dVkkChJxE qG1eLo4Kgedcgs3vn05V0BhfPqkQA3QqSS5KWEbRUHfkVJ/VuirUmQpxXE7UMcVHZaFv1 ApqTXOt2d8OhCAcVIL+rWlyQKRRd7PhD1JU/yo2oZw/MgvHlYlXdiKCPHrN6RJ8k8hJrl Dr9tBFEdAROhGQHfwnqmfmwRfoFeUnaO5ukmlYDiTOhb0MgMucIeN8IT2sSA/iLwcFrsK AOUZPxbX7lGRvuQxWUI/BaV/c7UPrJ4QRHCtD5XNm1D6bh0ETrGp26a89ft+FpbGvyw== ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass header.from=cloudflare.com; spf=pass smtp.mailfrom=cloudflare.com; dkim=pass header.d=cloudflare.com header.i=@cloudflare.com header.a=rsa-sha256 header.s=google09082023 header.b=Sjhac5WE; arc=none smtp.remote-ip=209.85.208.41 Received: from mail-ed1-f41.google.com (mail-ed1-f41.google.com [209.85.208.41]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 4E854606A325 for ; Tue, 10 Nov 2026 03:57:21 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.2 smtp.subspace.kernel.org 4E854606A325 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=cloudflare.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=cloudflare.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=cloudflare.com header.i=@cloudflare.com header.a=rsa-sha256 header.s=google09082023 header.b=Sjhac5WE Received: by mail-ed1-f41.google.com with SMTP id 4fb4d7f45d1cf-6b47c1a3c74so1927663a12.3 for ; Mon, 09 Nov 2026 19:57:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cloudflare.com; s=google09082023; t=1794283040; x=1794887840; darn=vger.kernel.org; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to:content-type; bh=eceI8dL07kv9yfwsc+DTSqIVxIuF3lFqQT3hh7B4xzA=; b=Sjhac5WEpLMCRdzSW227ZB0OGfUzyJQ+60RcTN/gXuPK3juyGLV2WRUal9Bd3hSPBk 6Uzhd+Xr0DGNQFarvdrHtHyK2F+vDZARjeCc2R2NHeWmWLeA8EzDQO11az8jAzjgu6iJ 0ogHzqmzPWnJ2xNTste74JJxgrQ0le2++J3gwoFyD3BRNdb3IUGb6dd3N8tdM3GS4+SH JIAdaAgmFU0oBWiwIszafWVzI7+Ijj/qPraflFBY8JhoAYZLdqVLQGI+F3bm5PhrAGio dusDcN5L9YZ65U4n2MK38Y2NIBxfSlPTFjotQHiccK/K/8/kiT0OrwQyl50knQF5U4Fb QZbg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20260707; t=1794283040; x=1794887840; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to:content-type; bh=eceI8dL07kv9yfwsc+DTSqIVxIuF3lFqQT3hh7B4xzA=; b=VUs02sodFwJ3VOFQkCY2wYMacDBJmPZk/NdN7bob5YhhgbCEi/x4XrSbklZiZVGa5e JhjA7BDUQcGvSQT18mur215O1zoCYaHVZVzbT4+nDUC+O04yfcbRUZ2M7ifiH3LCsZWU EqHGQhomNf7goGkH81mWbmnTVmoGFXmWcf39wntLtqmJR9B39mJaxvtQGOkL31mWHI9h MJMPoqe224mwPGSGj4yEgOgzO4Vhpqvt5641E6pfpKUN1vggmo9f9WT8EWNwDs+F87NL AcjDJPPOxrUbjhHmnOnplcbXW49rFzjuj6csrMTJyjToNz0FhjbxUI16fkcLfouEMJik UHgA== X-Forwarded-Encrypted: i=1; AL+hErEWgzyQ4D90hn3yJDd9bSrDSY81m2HGN9yCONY7v+QniHqs08iX0voNofWnwYkfeTfEeUMbbaw=@vger.kernel.org X-Gm-Message-State: APuU4Z+LzJNdId4RCugO5SENvvPJYLcdr8nYcMiTcjGdHtbs7ulblwUb fMrWKC38U8S1q7WyALCugdYmec/sk7l3qF81zI93vehFXB03SZVx5ykUVWKbKvgVwMA= X-Gm-Gg: AYBFou2cO4wQdC11pBJtrB/pEyuShywVt3MEoOYtLyrrFFwILLZ/uy7j4FBRCKm3tmU Z3nIgmVwy+WwCx/yxONshduEtRnd475skrPkQlLuxhPJo2NfMxJ4KP+KuxoLGdILW93GF6WChvy ulIaibcijz51BAVvpYx8FZG0HQ0uqQUzh+89zgGsaZv1c5eCfPV6ZeDVLwgW4W1C6HTO1JXFkAj bgsbzFT12Kv8zZEMssn8hkdnqCJTTXCcyfnc5CogoIyWVhSRtr6NkSgOzgEBoZr/0WG473j/cmq T8QiIOK24zvZn+lRJRkHt8VIzwP5YMlszh68j865MHeMxS6Zyw/VGAnNxVENn6ZAybaO0XI0j1f pB9gUo+0rKMkNt1XWwf5eUTKLkxXEuDX2Hm68fiJ6CXeSCee5ONlivKEvmP3dMRXa/BVO/Z0x9p ilHZmWQcS33SZeXlej9wR7yPQcEITUFwn+NrIxW9Q13hwfXn0yysp/Xkt6t3OSkkZpwK2VBTMKo bYbHygoRgqZg9Uod/OoFD4gD8v7ob6656S3Eir2ae5OGd/zxP8D/3PPfr7UJQCJD/F5746Vqvle HmaQowATP6EQP9YI9wnLxtHYD/dMXFSc/kpA+J+zZ1Rh3jgNoG5Ltv6VCr7/YFNx X-Received: by 2002:a05:6402:205b:b0:6b7:1d62:3916 with SMTP id 4fb4d7f45d1cf-6b755626b9dmr778195a12.0.1794283039727; Mon, 09 Nov 2026 19:57:19 -0800 (PST) Received: from L9JK9NPFH9.lan ([104.28.20.56]) by smtp.gmail.com with ESMTPSA id 4fb4d7f45d1cf-6b7579047c9sm548801a12.33.2026.11.09.19.57.16 (version=TLS1_3 cipher=TLS_CHACHA20_POLY1305_SHA256 bits=256/256); Mon, 09 Nov 2026 19:57:18 -0800 (PST) From: Tianyi Gao To: bpf@vger.kernel.org, netdev@vger.kernel.org, Alexei Starovoitov , Daniel Borkmann , Andrii Nakryiko , Martin KaFai Lau , Jakub Kicinski , Jesper Dangaard Brouer Cc: John Fastabend , Stanislav Fomichev , Lorenzo Bianconi , Vladimir Vdovin , "David S. Miller" , Eric Dumazet , Paolo Abeni , Simon Horman , Andrew Lunn , Donald Hunter , Eduard Zingerman , Kumar Kartikeya Dwivedi , Song Liu , Yonghong Song , Jiri Olsa , Emil Tsalapatis , Ihor Solodrai , Tony Nguyen , Przemek Kitszel , Maciej Fijalkowski , Alexander Lobakin , Magnus Karlsson , Tushar Vyavahare , Jason Xing , Nikolay Aleksandrov , Madalin Bucur , Ioana Ciornei , Jonathan Corbet , Shuah Khan , Shuah Khan , Randy Dunlap , Nathan Chancellor , Nick Desaulniers , Bill Wendling , Justin Stitt , Chris J Arges , Jakub Sitnicki , linux-doc@vger.kernel.org, linux-kselftest@vger.kernel.org, intel-wired-lan@lists.osuosl.org, llvm@lists.linux.dev, kernel-team@cloudflare.com, Tianyi Gao Subject: [PATCH bpf-next 00/15] xdp: add SKB core extensions to keep RX metadata until skb creation Date: Tue, 10 Nov 2026 03:56:58 +0000 Message-ID: X-Mailer: git-send-email 2.56.0 X-Mailing-List: netdev@vger.kernel.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Transfer-Encoding: 8bit An skb gets its RX hash, VLAN tag and checksum status from the RX descriptor, which describes the packet before the XDP program ran. Without this series: - On XDP_PASS, the values are stale. After the program strips a UDP tunnel header, the stack applies the outer CHECKSUM_UNNECESSARY to the inner packet [1]. If the outer UDP checksum is 0, a packet with a bad inner checksum reaches the socket. - On XDP_REDIRECT, the values are lost. The skb that cpumap or veth builds from the xdp_frame has no RX hash and no VLAN tag, and its checksum status is CHECKSUM_NONE. In one use case, an XDP program redirects packets into a veth device. The checksum status is lost, so GRO verifies every checksum in software. With one TCP flow, this costs 34% of the receiving CPU. Another use case [2] is load balancing IPsec tunnel traffic with cpumap. Without the RX hash, GRO on cpumap puts all flows into the same bucket. In a cpumap test with 16 TCP flows and no IPsec, the throughput is 17.6 Gbit/s instead of 23.4. This series introduces SKB core extensions for XDP. It reserves an skb core extension area in the headroom, right after the space for struct xdp_frame. An XDP program stores RX metadata in the area with kfuncs, and the kernel sets the skb fields from it. This design was initially proposed in [3]. The layout of the area follows skb extensions (struct skb_ext). A small header gives the offset of each entry. An entry takes headroom only when the program stores it, so the area does not grow with each new type of RX metadata, unlike [4]. Unlike skb_ext, the area needs no allocation. This series supports three types of RX metadata. Each type has a store kfunc, and bpf_xdp_skb_ext_del() deletes an entry: - The RX hash and its type: bpf_xdp_skb_ext_store_rx_hash(). - The VLAN tag and its protocol: bpf_xdp_skb_ext_store_rx_vlan(). - The checksum status: bpf_xdp_skb_ext_store_rx_csum(). Only XDP_CHECKSUM_NONE, or XDP_CHECKSUM_UNNECESSARY with a csum_level up to SKB_MAX_CSUM_LEVEL, are allowed [5][6]. The kernel sets the skb fields from the area: - After XDP_REDIRECT, in __xdp_build_skb_from_frame(). - On XDP_PASS, in the NIC driver. A driver that does this sets the new XDP feature skb-ext-pass. On other native XDP drivers, the kernel warns once when the program returns XDP_PASS with stored values, and ignores the area. This series adds the support to ice. The existing XDP RX metadata kfuncs are bpf_xdp_metadata_rx_*(). Only a device-bound program can call them. Programs on cpumap and devmap are not device-bound, so they cannot call them. Relaxing this check would change their semantics. So this series adds three load kfuncs, bpf_xdp_skb_ext_load_rx_*(). They read the stored values. bpf_xdp_adjust_head(), bpf_xdp_adjust_meta() and bpf_xdp_pull_data() do not move the packet or the metadata into the area. In this series, the area takes at most 20 bytes of headroom. With the hardware RX timestamp, the RX queue index and CHECKSUM_COMPLETE, it would take up to 40 bytes. Lorenzo's RX checksum kfunc series v5 [7] also defines enum xdp_checksum. The series that is merged second drops its copy. Performance: We measured on ice (E810, 25 Gbit/s) with bpf-next 0fb18ce8a2e9, patches 1-3 of [7] and this series. In the RX metadata column, the XDP program reads a value with bpf_xdp_metadata_rx_*() and stores it. The veth test stores the checksum status, and the cpumap test stores the RX hash. The kernel then sets the value on the skb. Baseline does not store it. Each value is the median of 5 rounds: test metric baseline RX metadata veth, 1 TCP flow RX CPU busy 100% 66% (-34%) veth, 1 TCP flow RX cycles/pkt 2027 1343 (-34%) cpumap, 16 TCP flows throughput 17.6 Gbit/s 23.4 (+33%) cpumap, 16 TCP flows pkts/GRO skb 3.4 7.5 (+122%) Both veth columns reach line rate, so the gain is in CPU time. A store kfunc takes 2.9 to 4.9 ns. Details are in [8]. Not in this series: - XDP_PASS support in mlx5 and bnxt. To align with Lorenzo's series [7], we plan to add xmo_rx_checksum and XDP_PASS support to them together, one driver at a time. - AF_XDP zero-copy. User space can write the headroom of zero-copy buffers, so the store kfuncs return -EOPNOTSUPP there. - Packets that enter XDP as an skb and leave it as an skb. This happens in generic XDP, and on XDP_PASS in veth when its peer sends it an skb. The series only sets the stored values on an skb that the kernel builds from an xdp_buff or an xdp_frame. - Stored entries on frames that dpaa and dpaa2 redirect. These drivers move data_hard_start before XDP_REDIRECT, so patch 2 clears the flag of the area. [1] https://lore.kernel.org/all/20260227153231.78d16b69@kernel.org/ [2] https://lore.kernel.org/all/ca38f2ed-999f-4ce1-8035-8ee9247f27f2@kernel.org/ [3] https://lore.kernel.org/all/1d5521eb-84fc-4417-a3f5-6366694d160a@kernel.org/ [4] https://lore.kernel.org/all/175146824674.1421237.18351246421763677468.stgit@firesoul/ [5] https://lore.kernel.org/all/20260722113525.34092660@kernel.org/ [6] https://lore.kernel.org/all/20260721183256.6f49d6e1@kernel.org/ [7] https://lore.kernel.org/all/20260715-bpf-xdp-meta-rxcksum-v5-0-623d5c0d0ab7@kernel.org/ [8] https://github.com/tgao-cf/skb-core-extensions-bench Tianyi Gao (15): xdp: reserve an skb core extension area after the xdp_frame net: dpaa, dpaa2: clear the skb core extension flag xdp: add kfuncs to store RX hash and VLAN tag xdp: add a kfunc to delete skb core extension entries xdp: add a kfunc to store the RX checksum status selftests/bpf: Test the skb core extension kfuncs xdp: set skb RX metadata from the skb core extension area of xdp_frame selftests/bpf: Test RX metadata on skbs built from xdp_frames xdp: add the skb-ext-pass XDP feature and warn without it xdp: warn on XDP_PASS with stored values when XDP runs on an skb ice: set skb RX metadata from the skb core extension area of xdp_buff selftests: drv-net: xdp: test the stored RX metadata on XDP_PASS xdp: add kfuncs to load the stored RX metadata selftests/bpf: Test the load kfuncs on cpumap and veth docs: net: document the skb core extension area Documentation/netlink/specs/netdev.yaml | 5 + Documentation/networking/xdp-rx-metadata.rst | 127 +++++- .../net/ethernet/freescale/dpaa/dpaa_eth.c | 2 + .../net/ethernet/freescale/dpaa2/dpaa2-eth.c | 2 + drivers/net/ethernet/intel/ice/ice_main.c | 3 +- drivers/net/ethernet/intel/ice/ice_sf_eth.c | 3 +- drivers/net/ethernet/intel/ice/ice_txrx.c | 4 +- drivers/net/ethernet/intel/ice/ice_txrx_lib.c | 7 +- drivers/net/ethernet/intel/ice/ice_txrx_lib.h | 3 +- drivers/net/ethernet/intel/ice/ice_xsk.c | 2 +- drivers/net/veth.c | 5 +- include/net/xdp.h | 74 +++ include/uapi/linux/netdev.h | 6 +- net/bpf/test_run.c | 4 +- net/core/dev.c | 2 + net/core/filter.c | 8 +- net/core/xdp.c | 428 +++++++++++++++++- tools/include/uapi/linux/netdev.h | 6 +- .../selftests/bpf/prog_tests/test_xsk.c | 25 + .../selftests/bpf/prog_tests/test_xsk.h | 2 + .../selftests/bpf/prog_tests/xdp_bonding.c | 8 +- .../bpf/prog_tests/xdp_do_redirect.c | 8 +- .../selftests/bpf/prog_tests/xdp_pull_data.c | 12 +- .../selftests/bpf/prog_tests/xdp_skb_ext.c | 375 +++++++++++++++ .../selftests/bpf/progs/test_xdp_pull_data.c | 7 + .../selftests/bpf/progs/test_xdp_skb_ext.c | 173 +++++++ .../selftests/bpf/progs/xdp_skb_ext_failure.c | 16 + .../selftests/bpf/progs/xdp_skb_ext_success.c | 245 ++++++++++ .../selftests/bpf/progs/xsk_xdp_progs.c | 13 + tools/testing/selftests/bpf/xdp_skb_ext.h | 53 +++ .../drivers/net/hw/lib/py/__init__.py | 3 +- .../selftests/drivers/net/hw/xdp_metadata.py | 118 ++++- .../drivers/net/hw/xdp_skb_ext.bpf.c | 166 +++++++ 33 files changed, 1873 insertions(+), 42 deletions(-) create mode 100644 tools/testing/selftests/bpf/prog_tests/xdp_skb_ext.c create mode 100644 tools/testing/selftests/bpf/progs/test_xdp_skb_ext.c create mode 100644 tools/testing/selftests/bpf/progs/xdp_skb_ext_failure.c create mode 100644 tools/testing/selftests/bpf/progs/xdp_skb_ext_success.c create mode 100644 tools/testing/selftests/bpf/xdp_skb_ext.h create mode 100644 tools/testing/selftests/drivers/net/hw/xdp_skb_ext.bpf.c base-commit: 0fb18ce8a2e9de830433923cf65838933d615359 -- 2.56.0