Netdev List
 help / color / mirror / Atom feed
* [PATCH net-next v2] net: dst: avoid false sharing between tclassid and __rcuref
@ 2026-11-20  6:16 Jiebin Sun
  0 siblings, 0 replies; only message in thread
From: Jiebin Sun @ 2026-11-20  6:16 UTC (permalink / raw)
  To: netdev
  Cc: edumazet, davem, kuba, pabeni, horms, linux-kernel, tim.c.chen,
	tianyou.li, wangyang.guo

On x86-64 with CONFIG_IP_ROUTE_CLASSID=y, ip_rcv_finish_core() reads
dst_entry::tclassid from the cache line containing __rcuref. Concurrent
reference updates cause false sharing with this load.

Swap expires with {error, __pad, tclassid} to move tclassid and error
into the first cache line without growing dst_entry. The structures
that embed it, including rtable, rt6_info, and metadata_dst, keep
their sizes.

pahole on x86-64 (sizes and offsets in bytes)

  +----------------------+--------+-------+
  | Struct or field      | Before | After |
  +----------------------+--------+-------+
  | sizeof(dst_entry)    |    136 |   136 |
  | dst_entry.expires    |     24 |    96 |
  | dst_entry.__rcuref   |     64 |    64 |
  | dst_entry.tclassid   |    100 |    28 |
  +----------------------+--------+-------+

The IPv4 loopback paths are shown below.

  TX: __dev_queue_xmit() -> skb_dst_force() -> dst_hold_safe()
      -> rcuref_get()
  RX: ip_rcv_finish_core() -> skb_dst(skb)->tclassid

At the tclassid load, separate 30-second perf c2c runs recorded:

  +----------+------------+-------------+
  | Kernel   | Local HITM | Remote HITM |
  +----------+------------+-------------+
  | Baseline |       2624 |        2611 |
  | Swap     |          1 |           0 |
  +----------+------------+-------------+

Memcached over IPv4 loopback (64 threads each, 5 x 60s,
20s warmup, mean ops/s)
Baseline: commit 6628e7d4c6b2 ("Linux 7.4-rc1")

  +-----------+-----------------+
  | Memcached | Improvement (%) |
  +-----------+-----------------+
  | default   |          +32.55 |
  | hit       |          +45.79 |
  | balanced  |           -0.12 |
  | large     |          +45.62 |
  +-----------+-----------------+

Default client

  memtier_benchmark -s 127.0.0.1 -p 11221 -P memcache_text
    -t 64 -c 1 --pipeline=16 --test-time=60 --ratio=1:100
    --data-size=32 --key-maximum=10000000

Server

  memcached -c 4096 -t 64 -u pnp -p 11221 -l 127.0.0.1

Client variants

  hit:      --key-maximum=1000
  balanced: --key-maximum=1000 --ratio=1:1
  large:    --key-maximum=1000 --data-size=1024

Suggested-by: Eric Dumazet <edumazet@kernel.org>
Suggested-by: Tim Chen <tim.c.chen@linux.intel.com>
Reviewed-by: Tianyou Li <tianyou.li@intel.com>
Reviewed-by: Wangyang Guo <wangyang.guo@intel.com>
Signed-off-by: Jiebin Sun <jiebin.sun@intel.com>
---
Changes in v2:
- Swap expires with error/__pad/tclassid and show the pahole results.
- Clarify the loopback path and keep the memcached and c2c tables.

 include/net/dst.h | 8 ++++----
 1 file changed, 4 insertions(+), 4 deletions(-)

diff --git a/include/net/dst.h b/include/net/dst.h
index dbedfe72e1fd..a692fe85f4bc 100644
--- a/include/net/dst.h
+++ b/include/net/dst.h
@@ -30,7 +30,9 @@ struct dst_entry {
 	};
 	struct  dst_ops	        *ops;
 	unsigned long		_metrics;
-	unsigned long           expires;
+	short			error;
+	short			__pad;
+	__u32			tclassid;
 #ifdef CONFIG_XFRM
 	struct xfrm_state	*xfrm;
 #else
@@ -74,9 +76,7 @@ struct dst_entry {
 	int			__use;
 	unsigned long		lastuse;
 	struct rcu_head		rcu_head;
-	short			error;
-	short			__pad;
-	__u32			tclassid;
+	unsigned long		expires;
 #ifndef CONFIG_64BIT
 	struct lwtunnel_state   *lwtstate;
 	rcuref_t		__rcuref;	/* 32-bit offset 64 */

base-commit: 66726ba54a01a2951688a56f5eb4d13d063acbea
-- 
2.52.0


^ permalink raw reply related	[flat|nested] only message in thread

only message in thread, other threads:[~2026-11-20  6:11 UTC | newest]

Thread overview: (only message) (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2026-11-20  6:16 [PATCH net-next v2] net: dst: avoid false sharing between tclassid and __rcuref Jiebin Sun

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox