From: Justin Suess <utilityemal77@gmail.com>
To: sashiko-reviews@lists.linux.dev
Cc: bpf@vger.kernel.org
Subject: Re: [PATCH bpf-next 1/1] bpf: fix deadlock in special field destruction in NMI
Date: Tue, 19 May 2026 11:59:42 -0400 [thread overview]
Message-ID: <agyG3eQwgmoJwmj2@suesslenovo> (raw)
In-Reply-To: <agxkV-hsdwhvMliI@suesslenovo>
On Tue, May 19, 2026 at 10:42:44AM -0400, Justin Suess wrote:
> Looks like this kfunc also tries to eagerly free fields and is callable
> from tp_btf/nmi_handler with no recovery mechanism.
>
> I don't see a good way to handle this at all... it also is effectively
> already bugged in the existing code unless I'm missing something
>
> Since you can use it to call abritrary dtors in NMI.
>
> 1.
>
> In some context where task_acquire is valid:
>
> struct blah {
> struct task_struct __kptr* task;
> }
>
> b = bpf_task_acquire(...)
> a = bpf_obj_new(typeof(*blah_ptr));
> bpf_kptr_xchg(a->task, b);
>
> 2.
>
> Then xchg a into map
> bpf_kptr_xchg([map slot], a);
> ...
>
> 3.
>
> In tp_btf/nmi_handler we exchange the obj out of the map
> and then drop it.
>
> c = bpf_kptr_xchg([slot where a is stored], NULL);
> bpf_obj_drop(c);
>
> And because this can be called on an object not in a map, we don't have
> a good recovery mechanism.
>
> Because tp_btf/nmi_handler is always in_nmi and hence irqs_disabled, in
> the code before this patch the task_struct dtor will be invoked and
> cause a deadlock.
>
> This patch will not fix the issue and just free a struct blah holding the
> reference without actually dropping it.
>
> Unless I'm missing something then this whole approach taken by this
> patch can't handle this case since the bpf_obj is detached from the map
> entirely and has no allocator recovery mechanism at all.
>
> Then we are back to square 1 needing to defer the freeing with irq work.
>
> Kumar / Alexei do you have anything on this?
I've confirmed this is a viable mechanism to deadlock as well
Using the above approach, just exchanging out of a map and dropping the
bpf_obj containing a task_struct kptr can be used to cause a deadlock
outside any map path:
On 576482b55c19e7ec00e162a0fde4c4f1a95128c7 (bpf-next/master) w/ RCU_NOCB_CPU/RCU_EXPERT:
[ 10.773819] ================================
[ 10.773820] WARNING: inconsistent lock state
[ 10.773821] 7.1.0-rc2-g576482b55c19 #150 Not tainted
[ 10.773822] --------------------------------
[ 10.773822] inconsistent {INITIAL USE} -> {IN-NMI} usage.
[ 10.773823] test_progs/471 [HC1[1]:SC0[0]:HE0:SE1] takes:
[ 10.773825] ffff98623d66f0e8 (&rdp->nocb_lock){-.-.}-{2:2}, at: __call_rcu_common.constprop.0+0x54a/0x730
[ 10.773832] {INITIAL USE} state was registered at:
[ 10.773832] lock_acquire+0xbf/0x2e0
[ 10.773835] _raw_spin_lock+0x30/0x40
[ 10.773838] rcu_nocb_gp_kthread+0x13f/0xb90
[ 10.773840] kthread+0xf4/0x130
[ 10.773845] ret_from_fork+0x264/0x330
[ 10.773848] ret_from_fork_asm+0x1a/0x30
[ 10.773851] irq event stamp: 1127908
[ 10.773851] hardirqs last enabled at (1127907): [<ffffffff87104484>] _raw_spin_unlock_irqrestore+0x44/0x60
[ 10.773853] hardirqs last disabled at (1127908): [<ffffffff871041a1>] _raw_spin_lock_irqsave+0x51/0x60
[ 10.773854] softirqs last enabled at (1127782): [<ffffffff862e6b80>] __irq_exit_rcu+0xc0/0x100
[ 10.773857] softirqs last disabled at (1127777): [<ffffffff862e6b80>] __irq_exit_rcu+0xc0/0x100
[ 10.773858]
other info that might help us debug this:
[ 10.773859] Possible unsafe locking scenario:
[ 10.773859] CPU0
[ 10.773859] ----
[ 10.773860] lock(&rdp->nocb_lock);
[ 10.773861] <Interrupt>
[ 10.773861] lock(&rdp->nocb_lock);
[ 10.773862]
*** DEADLOCK ***
[ 10.773862] 4 locks held by test_progs/471:
[ 10.773863] #0: ffffffff885ccaf0 (dup_mmap_sem){.+.+}-{0:0}, at: copy_process+0x1e39/0x2b80
[ 10.773866] #1: ffff9861c33a2ff8 (&mm->mmap_lock){++++}-{4:4}, at: dup_mmap+0x83/0x990
[ 10.773871] #2: ffff9861c1152ff8 (&mm->mmap_lock/1){+.+.}-{4:4}, at: dup_mmap+0xc8/0x990
[ 10.773874] #3: ffffffff885f43b8 (kmemleak_lock){-.-.}-{2:2}, at: __create_object+0x3a/0xa0
[ 10.773877]
stack backtrace:
[ 10.773879] CPU: 1 UID: 0 PID: 471 Comm: test_progs Not tainted 7.1.0-rc2-g576482b55c19 #150 PREEMPT(full)
[ 10.773881] Hardware name: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.17.0-0-gb52ca86e094d-prebuilt.qemu.org 04/01/2014
[ 10.773882] Call Trace:
[ 10.773883] <NMI>
[ 10.773884] dump_stack_lvl+0x5d/0x80
[ 10.773887] print_usage_bug.part.0+0x22b/0x2c0
[ 10.773891] lock_acquire+0x295/0x2e0
[ 10.773893] ? __call_rcu_common.constprop.0+0x54a/0x730
[ 10.773896] _raw_spin_lock+0x30/0x40
[ 10.773898] ? __call_rcu_common.constprop.0+0x54a/0x730
[ 10.773899] __call_rcu_common.constprop.0+0x54a/0x730
[ 10.773903] bpf_obj_free_fields+0x118/0x250
[ 10.773907] bpf_obj_drop+0x4f/0x80
[ 10.773910] bpf_prog_b7ff9c2e6c583824_clear_task_kptrs_from_nmi+0x174/0x1f4
[ 10.773912] bpf_trace_run3+0x126/0x430
[ 10.773916] ? __pfx_perf_event_nmi_handler+0x10/0x10
[ 10.773919] nmi_handle.part.0+0x15b/0x250
[ 10.773922] ? __pfx_perf_event_nmi_handler+0x10/0x10
[ 10.773924] default_do_nmi+0x120/0x180
[ 10.773927] exc_nmi+0xe3/0x110
[ 10.773928] end_repeat_nmi+0xf/0x53
[ 10.773931] RIP: 0010:__link_object+0xb4/0x270
[ 10.773932] Code: 00 00 00 48 c7 c6 80 36 bb 89 48 c7 43 70 00 00 00 00 48 c7 43 78 00 00 00 00 48 89 3d 35 62 50 03 eb 66 48 89 c8 48 8b 48 30 <48> 8d 70 10 48 39 d1 73 11 48 03 48 38 48 39 cf 0f 82 2f 01 00 00
[ 10.773933] RSP: 0018:ffffb516013b7a60 EFLAGS: 00000082
[ 10.773935] RAX: ffff9861c37b5c80 RBX: ffff9861df869878 RCX: ffff9861c3776420
[ 10.773936] RDX: ffff9861c3769e00 RSI: ffff9861c43564f8 RDI: ffff9861c3769d00
[ 10.773936] RBP: 0000000000000100 R08: 0000000000000000 R09: 0000000000000000
[ 10.773937] R10: 0000000000000000 R11: 0000000000000000 R12: ffff9861c3769d00
[ 10.773937] R13: 0000000000000286 R14: 0000000000000000 R15: 0000000000000001
[ 10.773943] ? __link_object+0xb4/0x270
[ 10.773945] ? __link_object+0xb4/0x270
[ 10.773947] </NMI>
[ 10.773947] <TASK>
[ 10.773948] __create_object+0x51/0xa0
[ 10.773951] kmem_cache_alloc_from_sheaf_noprof+0x1e2/0x290
[ 10.773956] mas_dup_build+0x41d/0x7f0
[ 10.773960] __mt_dup+0x78/0xf0
[ 10.773967] dup_mmap+0x12e/0x990
[ 10.773972] ? srso_alias_return_thunk+0x5/0xfbef5
[ 10.773973] ? lock_acquire+0xbf/0x2e0
[ 10.773979] copy_process+0x1e45/0x2b80
[ 10.773985] kernel_clone+0xbb/0x3d0
[ 10.773986] ? srso_alias_return_thunk+0x5/0xfbef5
[ 10.773987] ? __lock_acquire+0x481/0x2590
[ 10.773993] __do_sys_clone+0x65/0x90
[ 10.773998] do_syscall_64+0xa1/0x5f0
[ 10.774002] entry_SYSCALL_64_after_hwframe+0x76/0x7e
[ 10.774003] RIP: 0033:0x7f9da26e8f2f
[ 10.774005] Code: 89 e7 e8 c4 0e f6 ff 45 31 c0 31 d2 31 f6 64 48 8b 04 25 10 00 00 00 bf 11 00 20 01 4c 8d 90 d0 02 00 00 b8 38 00 00 00 0f 05 <48> 3d 00 f0 ff ff 77 59 89 c5 85 c0 75 31 64 48 8b 04 25 10 00 00
[ 10.774005] RSP: 002b:00007ffc278b4540 EFLAGS: 00000246 ORIG_RAX: 0000000000000038
[ 10.774007] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f9da26e8f2f
[ 10.774007] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000001200011
[ 10.774008] RBP: 00007ffc278b4740 R08: 0000000000000000 R09: 0000000000000001
[ 10.774008] R10: 00007f9da2acaf10 R11: 0000000000000246 R12: 0000000000000003
[ 10.774009] R13: 0000000000000001 R14: 0000000000000000 R15: 00005625de8b38d0
[ 10.774014] </TASK>
[ 10.866584] perf: interrupt took too long (6193 > 6190), lowering kernel.perf_event_max_sample_rate to 32000
[ 16.630663] kauditd_printk_skb: 30 callbacks suppressed
I can give the reproducer if wished.
You can see the path involves bpf_obj_drop and not any map methods at
all.
But basically this makes the whole mechanism of relying on map allocators to
recycle and free objects in irqs_disabled contexts unsound because kptrs
can live and be released outside map contexts.
next prev parent reply other threads:[~2026-05-19 15:59 UTC|newest]
Thread overview: 14+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-05-19 1:14 [PATCH bpf-next 0/1] bpf: Fix deadlock in freeing of special fields in NMI Justin Suess
2026-05-19 1:14 ` [PATCH bpf-next 1/1] bpf: fix deadlock in special field destruction " Justin Suess
2026-05-19 1:51 ` sashiko-bot
2026-05-19 14:42 ` Justin Suess
2026-05-19 15:59 ` Justin Suess [this message]
2026-05-19 19:27 ` Kumar Kartikeya Dwivedi
2026-05-19 23:19 ` Justin Suess
2026-06-06 16:27 ` Justin Suess
2026-06-07 2:40 ` Kumar Kartikeya Dwivedi
2026-06-07 15:05 ` Justin Suess
2026-05-19 10:25 ` kernel test robot
2026-05-19 12:31 ` Mykyta Yatsenko
2026-05-19 13:22 ` Justin Suess
2026-05-19 13:55 ` Mykyta Yatsenko
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=agyG3eQwgmoJwmj2@suesslenovo \
--to=utilityemal77@gmail.com \
--cc=bpf@vger.kernel.org \
--cc=sashiko-reviews@lists.linux.dev \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox