* [PATCH net v2 1/1] packet: synchronize pressure clearing with ring reconfiguration
@ 2026-07-27 16:19 Ren Wei
2026-07-28 11:44 ` Willem de Bruijn
0 siblings, 1 reply; 6+ messages in thread
From: Ren Wei @ 2026-07-27 16:19 UTC (permalink / raw)
To: netdev
Cc: willemdebruijn.kernel, davem, edumazet, pabeni, horms, vega,
zihanx, enjou1224z
From: Zihan Xi <zihanx@nebusec.ai>
packet_set_ring() updates the RX ring state under sk_receive_queue.lock,
but publishes the tpacket receive mode through po->prot_hook.func after
releasing that lock. packet_poll() and packet_recvmsg() can therefore run
the pressure clearing path after the ring has been cleared while still
seeing tpacket_rcv, causing __packet_rcv_has_room() to dereference stale
or NULL ring storage.
Serialize pressure clearing with RX ring reconfiguration and update the
receive hook while holding the same queue lock when changing the RX ring.
Keep packet_poll() on the unlocked helper, and let packet_recvmsg()
take the queue lock only when PACKET_SOCK_PRESSURE is already set so the
fix avoids an unconditional extra lock acquisition on the normal recv
path.
Fixes: 2ccdbaa6d55b ("packet: rollover lock contention avoidance")
Cc: stable@vger.kernel.org
Reported-by: Vega <vega@nebusec.ai>
Assisted-by: Codex:gpt-5.4
Signed-off-by: Zihan Xi <zihanx@nebusec.ai>
Signed-off-by: Ren Wei <enjou1224z@gmail.com>
---
changes in v2:
- only take sk_receive_queue.lock in packet_recvmsg() when
PACKET_SOCK_PRESSURE is already set
- keep packet_poll() on the unlocked helper under its existing queue lock
- v1 Link: https://lore.kernel.org/all/24f7311aed0c9ff06b8ea982647b82bf543ec369.1784454542.git.xizh2024@lzu.edu.cn/
net/packet/af_packet.c | 21 +++++++++++++++++----
1 file changed, 17 insertions(+), 4 deletions(-)
diff --git a/net/packet/af_packet.c b/net/packet/af_packet.c
index 8e6f3a734ba0..0107e55de6ff 100644
--- a/net/packet/af_packet.c
+++ b/net/packet/af_packet.c
@@ -1315,13 +1315,25 @@ static int packet_rcv_has_room(struct packet_sock *po, struct sk_buff *skb)
return ret;
}
-static void packet_rcv_try_clear_pressure(struct packet_sock *po)
+static void __packet_rcv_try_clear_pressure(struct packet_sock *po)
{
if (packet_sock_flag(po, PACKET_SOCK_PRESSURE) &&
__packet_rcv_has_room(po, NULL) == ROOM_NORMAL)
packet_sock_flag_set(po, PACKET_SOCK_PRESSURE, false);
}
+static void packet_rcv_try_clear_pressure(struct packet_sock *po)
+{
+ struct sock *sk = &po->sk;
+
+ if (!packet_sock_flag(po, PACKET_SOCK_PRESSURE))
+ return;
+
+ spin_lock_bh(&sk->sk_receive_queue.lock);
+ __packet_rcv_try_clear_pressure(po);
+ spin_unlock_bh(&sk->sk_receive_queue.lock);
+}
+
static void packet_sock_destruct(struct sock *sk)
{
skb_queue_purge(&sk->sk_error_queue);
@@ -4304,7 +4316,7 @@ static __poll_t packet_poll(struct file *file, struct socket *sock,
TP_STATUS_KERNEL))
mask |= EPOLLIN | EPOLLRDNORM;
}
- packet_rcv_try_clear_pressure(po);
+ __packet_rcv_try_clear_pressure(po);
spin_unlock_bh(&sk->sk_receive_queue.lock);
spin_lock_bh(&sk->sk_write_queue.lock);
if (po->tx_ring.pg_vec) {
@@ -4544,14 +4556,15 @@ static int packet_set_ring(struct sock *sk, union tpacket_req_u *req_u,
rb->frame_max = (req->tp_frame_nr - 1);
rb->head = 0;
rb->frame_size = req->tp_frame_size;
+ if (!tx_ring)
+ po->prot_hook.func = po->rx_ring.pg_vec ?
+ tpacket_rcv : packet_rcv;
spin_unlock_bh(&rb_queue->lock);
swap(rb->pg_vec_order, order);
swap(rb->pg_vec_len, req->tp_block_nr);
rb->pg_vec_pages = req->tp_block_size/PAGE_SIZE;
- po->prot_hook.func = (po->rx_ring.pg_vec) ?
- tpacket_rcv : packet_rcv;
skb_queue_purge(rb_queue);
if (atomic_long_read(&po->mapped))
pr_err("packet_mmap: vma is busy: %ld\n",
--
2.43.0
^ permalink raw reply related [flat|nested] 6+ messages in thread
* Re: [PATCH net v2 1/1] packet: synchronize pressure clearing with ring reconfiguration
2026-07-27 16:19 [PATCH net v2 1/1] packet: synchronize pressure clearing with ring reconfiguration Ren Wei
@ 2026-07-28 11:44 ` Willem de Bruijn
2026-07-28 12:46 ` zihan xi
0 siblings, 1 reply; 6+ messages in thread
From: Willem de Bruijn @ 2026-07-28 11:44 UTC (permalink / raw)
To: Ren Wei, netdev
Cc: willemdebruijn.kernel, davem, edumazet, pabeni, horms, vega,
zihanx, enjou1224z
Ren Wei wrote:
> From: Zihan Xi <zihanx@nebusec.ai>
>
> packet_set_ring() updates the RX ring state under sk_receive_queue.lock,
> but publishes the tpacket receive mode through po->prot_hook.func after
> releasing that lock. packet_poll() and packet_recvmsg() can therefore run
> the pressure clearing path after the ring has been cleared while still
> seeing tpacket_rcv, causing __packet_rcv_has_room() to dereference stale
> or NULL ring storage.
>
> Serialize pressure clearing with RX ring reconfiguration and update the
> receive hook while holding the same queue lock when changing the RX ring.
> Keep packet_poll() on the unlocked helper,
Because it already holds the lock.
> and let packet_recvmsg()
> take the queue lock only when PACKET_SOCK_PRESSURE is already set
which is sufficient, because if the socket moves from tpacket_rcv to
packet_rcv, the socket is detached and a synchronize_net has passed,
so no new packets could arrive to set PACKET_SOCK_PRESSURE if it was
unset.
> so the
> fix avoids an unconditional extra lock acquisition on the normal recv
> path.
>
> Fixes: 2ccdbaa6d55b ("packet: rollover lock contention avoidance")
> Cc: stable@vger.kernel.org
> Reported-by: Vega <vega@nebusec.ai>
> Assisted-by: Codex:gpt-5.4
> Signed-off-by: Zihan Xi <zihanx@nebusec.ai>
> Signed-off-by: Ren Wei <enjou1224z@gmail.com>
> ---
> changes in v2:
> - only take sk_receive_queue.lock in packet_recvmsg() when
> PACKET_SOCK_PRESSURE is already set
> - keep packet_poll() on the unlocked helper under its existing queue lock
> - v1 Link: https://lore.kernel.org/all/24f7311aed0c9ff06b8ea982647b82bf543ec369.1784454542.git.xizh2024@lzu.edu.cn/
>
> net/packet/af_packet.c | 21 +++++++++++++++++----
> 1 file changed, 17 insertions(+), 4 deletions(-)
>
> diff --git a/net/packet/af_packet.c b/net/packet/af_packet.c
> index 8e6f3a734ba0..0107e55de6ff 100644
> --- a/net/packet/af_packet.c
> +++ b/net/packet/af_packet.c
> @@ -1315,13 +1315,25 @@ static int packet_rcv_has_room(struct packet_sock *po, struct sk_buff *skb)
> return ret;
> }
>
> -static void packet_rcv_try_clear_pressure(struct packet_sock *po)
> +static void __packet_rcv_try_clear_pressure(struct packet_sock *po)
> {
> if (packet_sock_flag(po, PACKET_SOCK_PRESSURE) &&
> __packet_rcv_has_room(po, NULL) == ROOM_NORMAL)
> packet_sock_flag_set(po, PACKET_SOCK_PRESSURE, false);
> }
>
> +static void packet_rcv_try_clear_pressure(struct packet_sock *po)
> +{
> + struct sock *sk = &po->sk;
> +
> + if (!packet_sock_flag(po, PACKET_SOCK_PRESSURE))
> + return;
> +
> + spin_lock_bh(&sk->sk_receive_queue.lock);
> + __packet_rcv_try_clear_pressure(po);
> + spin_unlock_bh(&sk->sk_receive_queue.lock);
> +}
> +
> static void packet_sock_destruct(struct sock *sk)
> {
> skb_queue_purge(&sk->sk_error_queue);
> @@ -4304,7 +4316,7 @@ static __poll_t packet_poll(struct file *file, struct socket *sock,
> TP_STATUS_KERNEL))
> mask |= EPOLLIN | EPOLLRDNORM;
> }
> - packet_rcv_try_clear_pressure(po);
> + __packet_rcv_try_clear_pressure(po);
> spin_unlock_bh(&sk->sk_receive_queue.lock);
> spin_lock_bh(&sk->sk_write_queue.lock);
> if (po->tx_ring.pg_vec) {
> @@ -4544,14 +4556,15 @@ static int packet_set_ring(struct sock *sk, union tpacket_req_u *req_u,
> rb->frame_max = (req->tp_frame_nr - 1);
> rb->head = 0;
> rb->frame_size = req->tp_frame_size;
> + if (!tx_ring)
> + po->prot_hook.func = po->rx_ring.pg_vec ?
> + tpacket_rcv : packet_rcv;
Same question: why this new condition on !tx_ring here, that is
missing below. It looks benign to me, but especially for fixes only
make necessary changes.
> spin_unlock_bh(&rb_queue->lock);
>
> swap(rb->pg_vec_order, order);
> swap(rb->pg_vec_len, req->tp_block_nr);
>
> rb->pg_vec_pages = req->tp_block_size/PAGE_SIZE;
> - po->prot_hook.func = (po->rx_ring.pg_vec) ?
> - tpacket_rcv : packet_rcv;
> skb_queue_purge(rb_queue);
> if (atomic_long_read(&po->mapped))
> pr_err("packet_mmap: vma is busy: %ld\n",
> --
> 2.43.0
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH net v2 1/1] packet: synchronize pressure clearing with ring reconfiguration
2026-07-28 11:44 ` Willem de Bruijn
@ 2026-07-28 12:46 ` zihan xi
2026-07-28 13:31 ` Willem de Bruijn
0 siblings, 1 reply; 6+ messages in thread
From: zihan xi @ 2026-07-28 12:46 UTC (permalink / raw)
To: Willem de Bruijn; +Cc: Ren Wei, netdev, davem, edumazet, pabeni, horms, vega
On Tue, Jul 28, 2026 at 7:44 PM Willem de Bruijn
<willemdebruijn.kernel@gmail.com> wrote:
>
> Ren Wei wrote:
> > From: Zihan Xi <zihanx@nebusec.ai>
> >
> > packet_set_ring() updates the RX ring state under sk_receive_queue.lock,
> > but publishes the tpacket receive mode through po->prot_hook.func after
> > releasing that lock. packet_poll() and packet_recvmsg() can therefore run
> > the pressure clearing path after the ring has been cleared while still
> > seeing tpacket_rcv, causing __packet_rcv_has_room() to dereference stale
> > or NULL ring storage.
> >
> > Serialize pressure clearing with RX ring reconfiguration and update the
> > receive hook while holding the same queue lock when changing the RX ring.
> > Keep packet_poll() on the unlocked helper,
>
> Because it already holds the lock.
>
> > and let packet_recvmsg()
> > take the queue lock only when PACKET_SOCK_PRESSURE is already set
>
> which is sufficient, because if the socket moves from tpacket_rcv to
> packet_rcv, the socket is detached and a synchronize_net has passed,
> so no new packets could arrive to set PACKET_SOCK_PRESSURE if it was
> unset.
>
> > so the
> > fix avoids an unconditional extra lock acquisition on the normal recv
> > path.
> >
> > Fixes: 2ccdbaa6d55b ("packet: rollover lock contention avoidance")
> > Cc: stable@vger.kernel.org
> > Reported-by: Vega <vega@nebusec.ai>
> > Assisted-by: Codex:gpt-5.4
> > Signed-off-by: Zihan Xi <zihanx@nebusec.ai>
> > Signed-off-by: Ren Wei <enjou1224z@gmail.com>
> > ---
> > changes in v2:
> > - only take sk_receive_queue.lock in packet_recvmsg() when
> > PACKET_SOCK_PRESSURE is already set
> > - keep packet_poll() on the unlocked helper under its existing queue lock
> > - v1 Link: https://lore.kernel.org/all/24f7311aed0c9ff06b8ea982647b82bf543ec369.1784454542.git.xizh2024@lzu.edu.cn/
> >
> > net/packet/af_packet.c | 21 +++++++++++++++++----
> > 1 file changed, 17 insertions(+), 4 deletions(-)
> >
> > diff --git a/net/packet/af_packet.c b/net/packet/af_packet.c
> > index 8e6f3a734ba0..0107e55de6ff 100644
> > --- a/net/packet/af_packet.c
> > +++ b/net/packet/af_packet.c
> > @@ -1315,13 +1315,25 @@ static int packet_rcv_has_room(struct packet_sock *po, struct sk_buff *skb)
> > return ret;
> > }
> >
> > -static void packet_rcv_try_clear_pressure(struct packet_sock *po)
> > +static void __packet_rcv_try_clear_pressure(struct packet_sock *po)
> > {
> > if (packet_sock_flag(po, PACKET_SOCK_PRESSURE) &&
> > __packet_rcv_has_room(po, NULL) == ROOM_NORMAL)
> > packet_sock_flag_set(po, PACKET_SOCK_PRESSURE, false);
> > }
> >
> > +static void packet_rcv_try_clear_pressure(struct packet_sock *po)
> > +{
> > + struct sock *sk = &po->sk;
> > +
> > + if (!packet_sock_flag(po, PACKET_SOCK_PRESSURE))
> > + return;
> > +
> > + spin_lock_bh(&sk->sk_receive_queue.lock);
> > + __packet_rcv_try_clear_pressure(po);
> > + spin_unlock_bh(&sk->sk_receive_queue.lock);
> > +}
> > +
> > static void packet_sock_destruct(struct sock *sk)
> > {
> > skb_queue_purge(&sk->sk_error_queue);
> > @@ -4304,7 +4316,7 @@ static __poll_t packet_poll(struct file *file, struct socket *sock,
> > TP_STATUS_KERNEL))
> > mask |= EPOLLIN | EPOLLRDNORM;
> > }
> > - packet_rcv_try_clear_pressure(po);
> > + __packet_rcv_try_clear_pressure(po);
> > spin_unlock_bh(&sk->sk_receive_queue.lock);
> > spin_lock_bh(&sk->sk_write_queue.lock);
> > if (po->tx_ring.pg_vec) {
> > @@ -4544,14 +4556,15 @@ static int packet_set_ring(struct sock *sk, union tpacket_req_u *req_u,
> > rb->frame_max = (req->tp_frame_nr - 1);
> > rb->head = 0;
> > rb->frame_size = req->tp_frame_size;
> > + if (!tx_ring)
> > + po->prot_hook.func = po->rx_ring.pg_vec ?
> > + tpacket_rcv : packet_rcv;
>
> Same question: why this new condition on !tx_ring here, that is
> missing below. It looks benign to me, but especially for fixes only
> make necessary changes.
>
> > spin_unlock_bh(&rb_queue->lock);
> >
> > swap(rb->pg_vec_order, order);
> > swap(rb->pg_vec_len, req->tp_block_nr);
> >
> > rb->pg_vec_pages = req->tp_block_size/PAGE_SIZE;
> > - po->prot_hook.func = (po->rx_ring.pg_vec) ?
> > - tpacket_rcv : packet_rcv;
> > skb_queue_purge(rb_queue);
> > if (atomic_long_read(&po->mapped))
> > pr_err("packet_mmap: vma is busy: %ld\n",
> > --
> > 2.43.0
>
>
Hi Willem,
Thanks. Yes, that is the intended reasoning for the packet_recvmsg()
fast path.
If PACKET_SOCK_PRESSURE is already clear when packet_recvmsg() reaches
the pressure-clearing path, then after the RX hook switches away from
tpacket_rcv the socket has already been detached and synchronize_net()
has completed, so no new packet input can arrive and set the flag
again. In that case skipping the extra lock acquisition is sufficient.
For the !tx_ring condition: po->prot_hook.func is RX-side state, and
this fix is meant to publish it under the same sk_receive_queue.lock
domain that protects RX ring reconfiguration.
A TX ring reconfiguration does not change po->rx_ring.pg_vec, so it
does not need to rewrite po->prot_hook.func. Keeping the assignment
under !tx_ring avoids an unnecessary write on a TX-only path and keeps
the moved publication strictly tied to the RX ring transition that
actually needs serialization.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH net v2 1/1] packet: synchronize pressure clearing with ring reconfiguration
2026-07-28 12:46 ` zihan xi
@ 2026-07-28 13:31 ` Willem de Bruijn
2026-07-28 14:00 ` zihan xi
0 siblings, 1 reply; 6+ messages in thread
From: Willem de Bruijn @ 2026-07-28 13:31 UTC (permalink / raw)
To: zihan xi, Willem de Bruijn
Cc: Ren Wei, netdev, davem, edumazet, pabeni, horms, vega
zihan xi wrote:
> On Tue, Jul 28, 2026 at 7:44 PM Willem de Bruijn
> <willemdebruijn.kernel@gmail.com> wrote:
> >
> > Ren Wei wrote:
> > > From: Zihan Xi <zihanx@nebusec.ai>
> > >
> > > packet_set_ring() updates the RX ring state under sk_receive_queue.lock,
> > > but publishes the tpacket receive mode through po->prot_hook.func after
> > > releasing that lock. packet_poll() and packet_recvmsg() can therefore run
> > > the pressure clearing path after the ring has been cleared while still
> > > seeing tpacket_rcv, causing __packet_rcv_has_room() to dereference stale
> > > or NULL ring storage.
> > >
> > > Serialize pressure clearing with RX ring reconfiguration and update the
> > > receive hook while holding the same queue lock when changing the RX ring.
> > > Keep packet_poll() on the unlocked helper,
> >
> > Because it already holds the lock.
> >
> > > and let packet_recvmsg()
> > > take the queue lock only when PACKET_SOCK_PRESSURE is already set
> >
> > which is sufficient, because if the socket moves from tpacket_rcv to
> > packet_rcv, the socket is detached and a synchronize_net has passed,
> > so no new packets could arrive to set PACKET_SOCK_PRESSURE if it was
> > unset.
> >
> > > so the
> > > fix avoids an unconditional extra lock acquisition on the normal recv
> > > path.
> > >
> > > Fixes: 2ccdbaa6d55b ("packet: rollover lock contention avoidance")
> > > Cc: stable@vger.kernel.org
> > > Reported-by: Vega <vega@nebusec.ai>
> > > Assisted-by: Codex:gpt-5.4
> > > Signed-off-by: Zihan Xi <zihanx@nebusec.ai>
> > > Signed-off-by: Ren Wei <enjou1224z@gmail.com>
> > > ---
> > > changes in v2:
> > > - only take sk_receive_queue.lock in packet_recvmsg() when
> > > PACKET_SOCK_PRESSURE is already set
> > > - keep packet_poll() on the unlocked helper under its existing queue lock
> > > - v1 Link: https://lore.kernel.org/all/24f7311aed0c9ff06b8ea982647b82bf543ec369.1784454542.git.xizh2024@lzu.edu.cn/
> > >
> > > net/packet/af_packet.c | 21 +++++++++++++++++----
> > > 1 file changed, 17 insertions(+), 4 deletions(-)
> > >
> > > diff --git a/net/packet/af_packet.c b/net/packet/af_packet.c
> > > index 8e6f3a734ba0..0107e55de6ff 100644
> > > --- a/net/packet/af_packet.c
> > > +++ b/net/packet/af_packet.c
> > > @@ -1315,13 +1315,25 @@ static int packet_rcv_has_room(struct packet_sock *po, struct sk_buff *skb)
> > > return ret;
> > > }
> > >
> > > -static void packet_rcv_try_clear_pressure(struct packet_sock *po)
> > > +static void __packet_rcv_try_clear_pressure(struct packet_sock *po)
> > > {
> > > if (packet_sock_flag(po, PACKET_SOCK_PRESSURE) &&
> > > __packet_rcv_has_room(po, NULL) == ROOM_NORMAL)
> > > packet_sock_flag_set(po, PACKET_SOCK_PRESSURE, false);
> > > }
> > >
> > > +static void packet_rcv_try_clear_pressure(struct packet_sock *po)
> > > +{
> > > + struct sock *sk = &po->sk;
> > > +
> > > + if (!packet_sock_flag(po, PACKET_SOCK_PRESSURE))
> > > + return;
> > > +
> > > + spin_lock_bh(&sk->sk_receive_queue.lock);
> > > + __packet_rcv_try_clear_pressure(po);
> > > + spin_unlock_bh(&sk->sk_receive_queue.lock);
> > > +}
> > > +
> > > static void packet_sock_destruct(struct sock *sk)
> > > {
> > > skb_queue_purge(&sk->sk_error_queue);
> > > @@ -4304,7 +4316,7 @@ static __poll_t packet_poll(struct file *file, struct socket *sock,
> > > TP_STATUS_KERNEL))
> > > mask |= EPOLLIN | EPOLLRDNORM;
> > > }
> > > - packet_rcv_try_clear_pressure(po);
> > > + __packet_rcv_try_clear_pressure(po);
> > > spin_unlock_bh(&sk->sk_receive_queue.lock);
> > > spin_lock_bh(&sk->sk_write_queue.lock);
> > > if (po->tx_ring.pg_vec) {
> > > @@ -4544,14 +4556,15 @@ static int packet_set_ring(struct sock *sk, union tpacket_req_u *req_u,
> > > rb->frame_max = (req->tp_frame_nr - 1);
> > > rb->head = 0;
> > > rb->frame_size = req->tp_frame_size;
> > > + if (!tx_ring)
> > > + po->prot_hook.func = po->rx_ring.pg_vec ?
> > > + tpacket_rcv : packet_rcv;
> >
> > Same question: why this new condition on !tx_ring here, that is
> > missing below. It looks benign to me, but especially for fixes only
> > make necessary changes.
> >
> > > spin_unlock_bh(&rb_queue->lock);
> > >
> > > swap(rb->pg_vec_order, order);
> > > swap(rb->pg_vec_len, req->tp_block_nr);
> > >
> > > rb->pg_vec_pages = req->tp_block_size/PAGE_SIZE;
> > > - po->prot_hook.func = (po->rx_ring.pg_vec) ?
> > > - tpacket_rcv : packet_rcv;
> > > skb_queue_purge(rb_queue);
> > > if (atomic_long_read(&po->mapped))
> > > pr_err("packet_mmap: vma is busy: %ld\n",
> > > --
> > > 2.43.0
> >
> >
> Hi Willem,
>
> Thanks. Yes, that is the intended reasoning for the packet_recvmsg()
> fast path.
>
> If PACKET_SOCK_PRESSURE is already clear when packet_recvmsg() reaches
> the pressure-clearing path, then after the RX hook switches away from
> tpacket_rcv the socket has already been detached and synchronize_net()
> has completed, so no new packet input can arrive and set the flag
> again. In that case skipping the extra lock acquisition is sufficient.
Thanks. Please add this context to the commit message. It's not
entirely obvious. Will be helpful next time someone does a git blame.
> For the !tx_ring condition: po->prot_hook.func is RX-side state, and
> this fix is meant to publish it under the same sk_receive_queue.lock
> domain that protects RX ring reconfiguration.
>
> A TX ring reconfiguration does not change po->rx_ring.pg_vec, so it
> does not need to rewrite po->prot_hook.func. Keeping the assignment
> under !tx_ring avoids an unnecessary write on a TX-only path and keeps
> the moved publication strictly tied to the RX ring transition that
> actually needs serialization.
Still, this is a change that is not strictly required for the fix. It
may be relatively easy to reason that it has no unintentional side
effects. But it is even easier to do so by avoiding such unnecessary
changes altogether. It would not be the first NOOP that proves to not
be entirely NOOP. I suggest moving the original code as is, instead.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH net v2 1/1] packet: synchronize pressure clearing with ring reconfiguration
2026-07-28 13:31 ` Willem de Bruijn
@ 2026-07-28 14:00 ` zihan xi
2026-07-28 15:18 ` Willem de Bruijn
0 siblings, 1 reply; 6+ messages in thread
From: zihan xi @ 2026-07-28 14:00 UTC (permalink / raw)
To: Willem de Bruijn; +Cc: Ren Wei, netdev, davem, edumazet, pabeni, horms, vega
On Tue, Jul 28, 2026 at 9:31 PM Willem de Bruijn
<willemdebruijn.kernel@gmail.com> wrote:
>
> zihan xi wrote:
> > On Tue, Jul 28, 2026 at 7:44 PM Willem de Bruijn
> > <willemdebruijn.kernel@gmail.com> wrote:
> > >
> > > Ren Wei wrote:
> > > > From: Zihan Xi <zihanx@nebusec.ai>
> > > >
> > > > packet_set_ring() updates the RX ring state under sk_receive_queue.lock,
> > > > but publishes the tpacket receive mode through po->prot_hook.func after
> > > > releasing that lock. packet_poll() and packet_recvmsg() can therefore run
> > > > the pressure clearing path after the ring has been cleared while still
> > > > seeing tpacket_rcv, causing __packet_rcv_has_room() to dereference stale
> > > > or NULL ring storage.
> > > >
> > > > Serialize pressure clearing with RX ring reconfiguration and update the
> > > > receive hook while holding the same queue lock when changing the RX ring.
> > > > Keep packet_poll() on the unlocked helper,
> > >
> > > Because it already holds the lock.
> > >
> > > > and let packet_recvmsg()
> > > > take the queue lock only when PACKET_SOCK_PRESSURE is already set
> > >
> > > which is sufficient, because if the socket moves from tpacket_rcv to
> > > packet_rcv, the socket is detached and a synchronize_net has passed,
> > > so no new packets could arrive to set PACKET_SOCK_PRESSURE if it was
> > > unset.
> > >
> > > > so the
> > > > fix avoids an unconditional extra lock acquisition on the normal recv
> > > > path.
> > > >
> > > > Fixes: 2ccdbaa6d55b ("packet: rollover lock contention avoidance")
> > > > Cc: stable@vger.kernel.org
> > > > Reported-by: Vega <vega@nebusec.ai>
> > > > Assisted-by: Codex:gpt-5.4
> > > > Signed-off-by: Zihan Xi <zihanx@nebusec.ai>
> > > > Signed-off-by: Ren Wei <enjou1224z@gmail.com>
> > > > ---
> > > > changes in v2:
> > > > - only take sk_receive_queue.lock in packet_recvmsg() when
> > > > PACKET_SOCK_PRESSURE is already set
> > > > - keep packet_poll() on the unlocked helper under its existing queue lock
> > > > - v1 Link: https://lore.kernel.org/all/24f7311aed0c9ff06b8ea982647b82bf543ec369.1784454542.git.xizh2024@lzu.edu.cn/
> > > >
> > > > net/packet/af_packet.c | 21 +++++++++++++++++----
> > > > 1 file changed, 17 insertions(+), 4 deletions(-)
> > > >
> > > > diff --git a/net/packet/af_packet.c b/net/packet/af_packet.c
> > > > index 8e6f3a734ba0..0107e55de6ff 100644
> > > > --- a/net/packet/af_packet.c
> > > > +++ b/net/packet/af_packet.c
> > > > @@ -1315,13 +1315,25 @@ static int packet_rcv_has_room(struct packet_sock *po, struct sk_buff *skb)
> > > > return ret;
> > > > }
> > > >
> > > > -static void packet_rcv_try_clear_pressure(struct packet_sock *po)
> > > > +static void __packet_rcv_try_clear_pressure(struct packet_sock *po)
> > > > {
> > > > if (packet_sock_flag(po, PACKET_SOCK_PRESSURE) &&
> > > > __packet_rcv_has_room(po, NULL) == ROOM_NORMAL)
> > > > packet_sock_flag_set(po, PACKET_SOCK_PRESSURE, false);
> > > > }
> > > >
> > > > +static void packet_rcv_try_clear_pressure(struct packet_sock *po)
> > > > +{
> > > > + struct sock *sk = &po->sk;
> > > > +
> > > > + if (!packet_sock_flag(po, PACKET_SOCK_PRESSURE))
> > > > + return;
> > > > +
> > > > + spin_lock_bh(&sk->sk_receive_queue.lock);
> > > > + __packet_rcv_try_clear_pressure(po);
> > > > + spin_unlock_bh(&sk->sk_receive_queue.lock);
> > > > +}
> > > > +
> > > > static void packet_sock_destruct(struct sock *sk)
> > > > {
> > > > skb_queue_purge(&sk->sk_error_queue);
> > > > @@ -4304,7 +4316,7 @@ static __poll_t packet_poll(struct file *file, struct socket *sock,
> > > > TP_STATUS_KERNEL))
> > > > mask |= EPOLLIN | EPOLLRDNORM;
> > > > }
> > > > - packet_rcv_try_clear_pressure(po);
> > > > + __packet_rcv_try_clear_pressure(po);
> > > > spin_unlock_bh(&sk->sk_receive_queue.lock);
> > > > spin_lock_bh(&sk->sk_write_queue.lock);
> > > > if (po->tx_ring.pg_vec) {
> > > > @@ -4544,14 +4556,15 @@ static int packet_set_ring(struct sock *sk, union tpacket_req_u *req_u,
> > > > rb->frame_max = (req->tp_frame_nr - 1);
> > > > rb->head = 0;
> > > > rb->frame_size = req->tp_frame_size;
> > > > + if (!tx_ring)
> > > > + po->prot_hook.func = po->rx_ring.pg_vec ?
> > > > + tpacket_rcv : packet_rcv;
> > >
> > > Same question: why this new condition on !tx_ring here, that is
> > > missing below. It looks benign to me, but especially for fixes only
> > > make necessary changes.
> > >
> > > > spin_unlock_bh(&rb_queue->lock);
> > > >
> > > > swap(rb->pg_vec_order, order);
> > > > swap(rb->pg_vec_len, req->tp_block_nr);
> > > >
> > > > rb->pg_vec_pages = req->tp_block_size/PAGE_SIZE;
> > > > - po->prot_hook.func = (po->rx_ring.pg_vec) ?
> > > > - tpacket_rcv : packet_rcv;
> > > > skb_queue_purge(rb_queue);
> > > > if (atomic_long_read(&po->mapped))
> > > > pr_err("packet_mmap: vma is busy: %ld\n",
> > > > --
> > > > 2.43.0
> > >
> > >
> > Hi Willem,
> >
> > Thanks. Yes, that is the intended reasoning for the packet_recvmsg()
> > fast path.
> >
> > If PACKET_SOCK_PRESSURE is already clear when packet_recvmsg() reaches
> > the pressure-clearing path, then after the RX hook switches away from
> > tpacket_rcv the socket has already been detached and synchronize_net()
> > has completed, so no new packet input can arrive and set the flag
> > again. In that case skipping the extra lock acquisition is sufficient.
>
> Thanks. Please add this context to the commit message. It's not
> entirely obvious. Will be helpful next time someone does a git blame.
>
> > For the !tx_ring condition: po->prot_hook.func is RX-side state, and
> > this fix is meant to publish it under the same sk_receive_queue.lock
> > domain that protects RX ring reconfiguration.
> >
> > A TX ring reconfiguration does not change po->rx_ring.pg_vec, so it
> > does not need to rewrite po->prot_hook.func. Keeping the assignment
> > under !tx_ring avoids an unnecessary write on a TX-only path and keeps
> > the moved publication strictly tied to the RX ring transition that
> > actually needs serialization.
>
> Still, this is a change that is not strictly required for the fix. It
> may be relatively easy to reason that it has no unintentional side
> effects. But it is even easier to do so by avoiding such unnecessary
> changes altogether. It would not be the first NOOP that proves to not
> be entirely NOOP. I suggest moving the original code as is, instead.
Thanks, agreed.
I'll make this change in v3: keep the receive hook assignment otherwise
unchanged and only move the existing assignment into the
sk_receive_queue.lock section. That avoids the extra !tx_ring behavior
change while still keeping the hook publication serialized with the ring
state update.
I'll also add the packet_recvmsg() fast-path reasoning to the v3 commit
message.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH net v2 1/1] packet: synchronize pressure clearing with ring reconfiguration
2026-07-28 14:00 ` zihan xi
@ 2026-07-28 15:18 ` Willem de Bruijn
0 siblings, 0 replies; 6+ messages in thread
From: Willem de Bruijn @ 2026-07-28 15:18 UTC (permalink / raw)
To: zihan xi, Willem de Bruijn
Cc: Ren Wei, netdev, davem, edumazet, pabeni, horms, vega
zihan xi wrote:
> On Tue, Jul 28, 2026 at 9:31 PM Willem de Bruijn
> <willemdebruijn.kernel@gmail.com> wrote:
> >
> > zihan xi wrote:
> > > On Tue, Jul 28, 2026 at 7:44 PM Willem de Bruijn
> > > <willemdebruijn.kernel@gmail.com> wrote:
> > > >
> > > > Ren Wei wrote:
> > > > > From: Zihan Xi <zihanx@nebusec.ai>
> > > > >
> > > > > packet_set_ring() updates the RX ring state under sk_receive_queue.lock,
> > > > > but publishes the tpacket receive mode through po->prot_hook.func after
> > > > > releasing that lock. packet_poll() and packet_recvmsg() can therefore run
> > > > > the pressure clearing path after the ring has been cleared while still
> > > > > seeing tpacket_rcv, causing __packet_rcv_has_room() to dereference stale
> > > > > or NULL ring storage.
> > > > >
> > > > > Serialize pressure clearing with RX ring reconfiguration and update the
> > > > > receive hook while holding the same queue lock when changing the RX ring.
> > > > > Keep packet_poll() on the unlocked helper,
> > > >
> > > > Because it already holds the lock.
> > > >
> > > > > and let packet_recvmsg()
> > > > > take the queue lock only when PACKET_SOCK_PRESSURE is already set
> > > >
> > > > which is sufficient, because if the socket moves from tpacket_rcv to
> > > > packet_rcv, the socket is detached and a synchronize_net has passed,
> > > > so no new packets could arrive to set PACKET_SOCK_PRESSURE if it was
> > > > unset.
> > > >
> > > > > so the
> > > > > fix avoids an unconditional extra lock acquisition on the normal recv
> > > > > path.
> > > > >
> > > > > Fixes: 2ccdbaa6d55b ("packet: rollover lock contention avoidance")
> > > > > Cc: stable@vger.kernel.org
> > > > > Reported-by: Vega <vega@nebusec.ai>
> > > > > Assisted-by: Codex:gpt-5.4
> > > > > Signed-off-by: Zihan Xi <zihanx@nebusec.ai>
> > > > > Signed-off-by: Ren Wei <enjou1224z@gmail.com>
> > > > > ---
> > > > > changes in v2:
> > > > > - only take sk_receive_queue.lock in packet_recvmsg() when
> > > > > PACKET_SOCK_PRESSURE is already set
> > > > > - keep packet_poll() on the unlocked helper under its existing queue lock
> > > > > - v1 Link: https://lore.kernel.org/all/24f7311aed0c9ff06b8ea982647b82bf543ec369.1784454542.git.xizh2024@lzu.edu.cn/
> > > > >
> > > > > net/packet/af_packet.c | 21 +++++++++++++++++----
> > > > > 1 file changed, 17 insertions(+), 4 deletions(-)
> > > > >
> > > > > diff --git a/net/packet/af_packet.c b/net/packet/af_packet.c
> > > > > index 8e6f3a734ba0..0107e55de6ff 100644
> > > > > --- a/net/packet/af_packet.c
> > > > > +++ b/net/packet/af_packet.c
> > > > > @@ -1315,13 +1315,25 @@ static int packet_rcv_has_room(struct packet_sock *po, struct sk_buff *skb)
> > > > > return ret;
> > > > > }
> > > > >
> > > > > -static void packet_rcv_try_clear_pressure(struct packet_sock *po)
> > > > > +static void __packet_rcv_try_clear_pressure(struct packet_sock *po)
> > > > > {
> > > > > if (packet_sock_flag(po, PACKET_SOCK_PRESSURE) &&
> > > > > __packet_rcv_has_room(po, NULL) == ROOM_NORMAL)
> > > > > packet_sock_flag_set(po, PACKET_SOCK_PRESSURE, false);
> > > > > }
> > > > >
> > > > > +static void packet_rcv_try_clear_pressure(struct packet_sock *po)
> > > > > +{
> > > > > + struct sock *sk = &po->sk;
> > > > > +
> > > > > + if (!packet_sock_flag(po, PACKET_SOCK_PRESSURE))
> > > > > + return;
> > > > > +
> > > > > + spin_lock_bh(&sk->sk_receive_queue.lock);
> > > > > + __packet_rcv_try_clear_pressure(po);
> > > > > + spin_unlock_bh(&sk->sk_receive_queue.lock);
> > > > > +}
> > > > > +
> > > > > static void packet_sock_destruct(struct sock *sk)
> > > > > {
> > > > > skb_queue_purge(&sk->sk_error_queue);
> > > > > @@ -4304,7 +4316,7 @@ static __poll_t packet_poll(struct file *file, struct socket *sock,
> > > > > TP_STATUS_KERNEL))
> > > > > mask |= EPOLLIN | EPOLLRDNORM;
> > > > > }
> > > > > - packet_rcv_try_clear_pressure(po);
> > > > > + __packet_rcv_try_clear_pressure(po);
> > > > > spin_unlock_bh(&sk->sk_receive_queue.lock);
> > > > > spin_lock_bh(&sk->sk_write_queue.lock);
> > > > > if (po->tx_ring.pg_vec) {
> > > > > @@ -4544,14 +4556,15 @@ static int packet_set_ring(struct sock *sk, union tpacket_req_u *req_u,
> > > > > rb->frame_max = (req->tp_frame_nr - 1);
> > > > > rb->head = 0;
> > > > > rb->frame_size = req->tp_frame_size;
> > > > > + if (!tx_ring)
> > > > > + po->prot_hook.func = po->rx_ring.pg_vec ?
> > > > > + tpacket_rcv : packet_rcv;
> > > >
> > > > Same question: why this new condition on !tx_ring here, that is
> > > > missing below. It looks benign to me, but especially for fixes only
> > > > make necessary changes.
> > > >
> > > > > spin_unlock_bh(&rb_queue->lock);
> > > > >
> > > > > swap(rb->pg_vec_order, order);
> > > > > swap(rb->pg_vec_len, req->tp_block_nr);
> > > > >
> > > > > rb->pg_vec_pages = req->tp_block_size/PAGE_SIZE;
> > > > > - po->prot_hook.func = (po->rx_ring.pg_vec) ?
> > > > > - tpacket_rcv : packet_rcv;
> > > > > skb_queue_purge(rb_queue);
> > > > > if (atomic_long_read(&po->mapped))
> > > > > pr_err("packet_mmap: vma is busy: %ld\n",
> > > > > --
> > > > > 2.43.0
> > > >
> > > >
> > > Hi Willem,
> > >
> > > Thanks. Yes, that is the intended reasoning for the packet_recvmsg()
> > > fast path.
> > >
> > > If PACKET_SOCK_PRESSURE is already clear when packet_recvmsg() reaches
> > > the pressure-clearing path, then after the RX hook switches away from
> > > tpacket_rcv the socket has already been detached and synchronize_net()
> > > has completed, so no new packet input can arrive and set the flag
> > > again. In that case skipping the extra lock acquisition is sufficient.
> >
> > Thanks. Please add this context to the commit message. It's not
> > entirely obvious. Will be helpful next time someone does a git blame.
> >
> > > For the !tx_ring condition: po->prot_hook.func is RX-side state, and
> > > this fix is meant to publish it under the same sk_receive_queue.lock
> > > domain that protects RX ring reconfiguration.
> > >
> > > A TX ring reconfiguration does not change po->rx_ring.pg_vec, so it
> > > does not need to rewrite po->prot_hook.func. Keeping the assignment
> > > under !tx_ring avoids an unnecessary write on a TX-only path and keeps
> > > the moved publication strictly tied to the RX ring transition that
> > > actually needs serialization.
> >
> > Still, this is a change that is not strictly required for the fix. It
> > may be relatively easy to reason that it has no unintentional side
> > effects. But it is even easier to do so by avoiding such unnecessary
> > changes altogether. It would not be the first NOOP that proves to not
> > be entirely NOOP. I suggest moving the original code as is, instead.
>
> Thanks, agreed.
>
> I'll make this change in v3: keep the receive hook assignment otherwise
> unchanged and only move the existing assignment into the
> sk_receive_queue.lock section. That avoids the extra !tx_ring behavior
> change while still keeping the hook publication serialized with the ring
> state update.
>
> I'll also add the packet_recvmsg() fast-path reasoning to the v3 commit
> message.
Great, thanks.
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2026-07-28 15:18 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2026-07-27 16:19 [PATCH net v2 1/1] packet: synchronize pressure clearing with ring reconfiguration Ren Wei
2026-07-28 11:44 ` Willem de Bruijn
2026-07-28 12:46 ` zihan xi
2026-07-28 13:31 ` Willem de Bruijn
2026-07-28 14:00 ` zihan xi
2026-07-28 15:18 ` Willem de Bruijn
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox