From: Dave Jiang <dave.jiang@intel.com>
To: Guixin Liu <kanie@linux.alibaba.com>,
Davidlohr Bueso <dave@stgolabs.net>,
Jonathan Cameron <jic23@kernel.org>,
Alison Schofield <alison.schofield@intel.com>,
Vishal Verma <vishal.l.verma@intel.com>,
Dan Williams <djbw@kernel.org>, Ira Weiny <iweiny@kernel.org>,
Li Ming <ming.li@zohomail.com>,
Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
"Rafael J . Wysocki" <rafael@kernel.org>,
Danilo Krummrich <dakr@kernel.org>,
Shaikh Kamaluddin <shaikhkamal2012@gmail.com>
Cc: linux-cxl@vger.kernel.org, driver-core@lists.linux.dev
Subject: Re: [PATCH v4 0/2] cxl/memdev: Fix poison debugfs vs unbind deadlock
Date: Mon, 21 Sep 2026 07:48:24 -0700 [thread overview]
Message-ID: <87d0de25-4328-407b-813e-6aea672a08e1@intel.com> (raw)
In-Reply-To: <20260916025453.3532614-1-kanie@linux.alibaba.com>
On 9/15/26 7:54 PM, Guixin Liu wrote:
> Writing a memdev poison debugfs file while cxl_mem is being unbound
> deadlocks. Patch 2 fixes it by not waiting for the device lock in those
> handlers. Patch 1 adds the trylock guard it uses.
>
> Patch 2 does not build without patch 1, so the two need to travel
> together.
>
> Testing:
>
> Reproduced on a QEMU CXL topology whose type3 devices advertise poison
> inject support:
>
> while :; do echo 0 > /sys/kernel/debug/cxl/mem0/inject_poison; done &
> while :; do
> echo mem0 > /sys/bus/cxl/drivers/cxl_mem/unbind
> echo mem0 > /sys/bus/cxl/drivers/cxl_mem/bind
> done
>
> Without the fix the unbind wedges within seconds. The three tasks
> involved, from /proc/<pid>/stack:
>
> writer, state S, holds the debugfs reference and waits for the lock
> cxl_debugfs_poison_inject+0x25/0xa0 [cxl_mem]
> debugfs_attr_write+0x61/0xb0
> full_proxy_write+0xfc/0x1c0
> vfs_write+0x1d4/0xe60
>
> unbind, state D, holds the lock and waits for the reference to drain
> remove_one+0x27f/0x3d0
> debugfs_remove+0x44/0x60
> release_nodes+0xfa/0x2c0
> devres_release_all+0x113/0x1a0
> device_unbind_cleanup+0x76/0x260
> device_release_driver_internal+0x3eb/0x540
> unbind_store+0xde/0x100
>
> cxl_port workqueue, state D, blocked on the same lock
> device_release_driver_internal+0x96/0x540
> detach_memdev+0x79/0xb0 [cxl_core]
> process_one_work+0x6b0/0xfb0
>
> The writer is in interruptible sleep and can be killed; the unbind
> cannot, and because cxl_bus_wq is an ordered workqueue the wedged
> detach_memdev() blocks every other CXL bus work item behind it.
>
> The same deadlock shows up with a pciehp hot-remove racing the writer
> loop: the pciehp thread hits the same debugfs_remove() drain holding
> the memdev lock, and the hot-remove wedges the same way. With both
> patches applied the hot-remove flow completes normally.
>
> With both patches applied, 46 unbind/bind cycles against the same writer
> loop all completed, no task was left in D state, and the writer collected
> 10920 EBUSY returns from the contended trylock. Note that lockdep stays
> quiet either way: one leg of the cycle is the debugfs active_users
> completion rather than a lock it tracks.
>
> v3 -> v4:
> - reword the patch 2 commit message per Alison: enumerate the teardown
> paths that race a poison write into an unbind, and state that mixing
> poison writes with cxl_mem teardown is not a supported use of this
> debug ABI, though the fix keeps the cost of doing so to a failed write
> - add the pciehp hot-remove reproduction, reported during v3 review,
> to the patch 2 commit message
> - collect Jonathan's Reviewed-by on both patches (no code change)
>
> v1 -> v2:
> - add the device_trylock() guard and use ACQUIRE(device_try, ...) instead
> of open-coding device_trylock()/device_unlock(), keeping the style the
> Fixes: commit established (Shaikh Kamaluddin)
> - cut the changelog down to the failing condition, the consequence and
> the fix; the call graph and the reproducer live here instead
> - say how the issue was found and how it was tested
>
> v2 -> v3:
> - rebase onto v7.3-rc2 (master), per Dave's request to send the series
> against Linus's tags rather than cxl/next
>
> v1:
> https://lore.kernel.org/linux-cxl/20260826125248.4003792-1-kanie@linux.alibaba.com/
>
> v2:
> https://lore.kernel.org/linux-cxl/20260831124809.889829-1-kanie@linux.alibaba.com/
>
> v3:
> https://lore.kernel.org/linux-cxl/20260910094017.4032170-1-kanie@linux.alibaba.com/
>
> Guixin Liu (2):
> driver core: Add conditional guard support for device_trylock()
> cxl/memdev: Fix deadlock between poison debugfs and cxl_mem unbind
>
> drivers/cxl/mem.c | 14 ++++++++++----
> include/linux/device.h | 1 +
> 2 files changed, 11 insertions(+), 4 deletions(-)
>
Applied to cxl/next:
18f269585447
391bc7ab9be6
prev parent reply other threads:[~2026-09-21 14:48 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-09-16 2:54 [PATCH v4 0/2] cxl/memdev: Fix poison debugfs vs unbind deadlock Guixin Liu
2026-09-16 2:54 ` [PATCH v4 1/2] driver core: Add conditional guard support for device_trylock() Guixin Liu
2026-09-16 2:54 ` [PATCH v4 2/2] cxl/memdev: Fix deadlock between poison debugfs and cxl_mem unbind Guixin Liu
2026-09-18 19:30 ` Alison Schofield
2026-09-18 15:26 ` [PATCH v4 0/2] cxl/memdev: Fix poison debugfs vs unbind deadlock Dave Jiang
2026-09-18 17:30 ` Greg Kroah-Hartman
2026-09-21 14:48 ` Dave Jiang [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87d0de25-4328-407b-813e-6aea672a08e1@intel.com \
--to=dave.jiang@intel.com \
--cc=alison.schofield@intel.com \
--cc=dakr@kernel.org \
--cc=dave@stgolabs.net \
--cc=djbw@kernel.org \
--cc=driver-core@lists.linux.dev \
--cc=gregkh@linuxfoundation.org \
--cc=iweiny@kernel.org \
--cc=jic23@kernel.org \
--cc=kanie@linux.alibaba.com \
--cc=linux-cxl@vger.kernel.org \
--cc=ming.li@zohomail.com \
--cc=rafael@kernel.org \
--cc=shaikhkamal2012@gmail.com \
--cc=vishal.l.verma@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox