From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-ed1-f50.google.com (mail-ed1-f50.google.com [209.85.208.50]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id D58082F3621 for ; Sat, 29 Aug 2026 09:48:48 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.208.50 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1787996930; cv=none; b=eZZ+tuapLYkF0/I1ugxB+Go2YCEx5ipVsVxIBP/HIlP31sD8B9Bcs4ipGIBA6HUlA1fP8tfgvjaM9KxIid4xAy2PZlRR1/mh/fhx20G6LmSVk8b83ScE6Oy5Zvjl1k/xCuypK4W3R0J8rvs4+QC1/pwwaxW2372igsj9tW0/QeQ= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1787996930; c=relaxed/simple; bh=4NaOSnad3ovSdHyfMpXrqbIZhtmfgN/COGu0UHmwoHs=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version; b=JOxczBLLxX7c8UpZZHiYvTNFpxX51a83p1jfSdzoY946qkeK+6l+VUFq/U7r6l+csIg6gl2WA87ZStDFNif51SwWoQHOMjPdPwIWJjbdT2V+k6IMywoJMHIPAZKeqIsedmKDP2nJd2geYCj4Ykn75x4imyA7RqWR5/K9uBkavO4= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=MLLEarkT; arc=none smtp.client-ip=209.85.208.50 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="MLLEarkT" Received: by mail-ed1-f50.google.com with SMTP id 4fb4d7f45d1cf-6a173ad7cf4so2837517a12.3 for ; Sat, 29 Aug 2026 02:48:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1787996927; x=1788601727; darn=lists.linux.dev; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:from:to:cc:subject:date:message-id:reply-to:content-type; bh=vr48OlihL3z/Xr4r4Y0Vtz7OZXseZdEoR3eobBbUMjA=; b=MLLEarkT9RWjZy8/WVFhXBonMYGqU/NdN+KZI/aoDMArbESyepRMt+PtTVJoBQAYCK zRc8sFtr0WsmPTOo2dtwA6M+qaJptWHM8RSMLXnL3TUrk7q7VjbNFlNyXARe+uEY9HjB AJ7iJbS+YycQG1IiIxRXVXRoE5jdFuSJsHwLRYk47WgD+i6PrvsOC3l2HF+pVXZ5fgSn M19pDDHC44Y+eAZS7RM8Yy6AYoviIW17ghDya9PGxnR2RwWtzYQ9CbDS0BIXjaxad7ns 9SkpxvkEh62N3r2viM4Pf8PnTqxPnBWYzv7Bvz8b/hLh125OthQ/z4dlwKNgBs7DVUqz 331A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1787996927; x=1788601727; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from:x-gm-gg:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to:content-type; bh=vr48OlihL3z/Xr4r4Y0Vtz7OZXseZdEoR3eobBbUMjA=; b=nYnCDMksZ74+/Afn8hsufeuTVpW3mc4j8Iy+NvnXYkcx7bWCZNWj4lex3xYY5d47VW mEPRoqQ3InEEOE+mX2sn1wmhgpYRfOLzNMJNoOADjuGLLLWlPLdtMoSzU11fn5iNqkdP qxmBG0q66O5356y72dUeZMg+fe3eh7MsuBGxqBVUPvbunPEqRkbIqCKrJ5xCz/KW8khw EioUYLyh5PsTWtZzgL5hbw69DFsg8M0jwDR4VAweTu3EUsVmaBOTW7BLm1bZfgXCw+J3 4k5hgs4rZj3ZZdfadSwHIRY12GFgOXKcsc6yqg/GjbNvoAqwHZoeEhOvlZRSTutFPLiE Urfw== X-Forwarded-Encrypted: i=1; AHgh+RqQ3cdNUy/T3bVENunFy0KGZ8grwyisRxoYSA4FYj8IX45BabgfSuLO7xMylcVc7LbIiJl0T2TeCZfzOg==@lists.linux.dev X-Gm-Message-State: AFuF++nplRLOojL6VTjQT3cROMM8vW5jVPzhQ43fP+8ggkU7Rdo9Iu/U HxRY0AkhMTFalr/JAVHKeEzeUpblHVpVDf/CVGuKQAoVclMq5vufJISSHJWD9UGyHhw= X-Gm-Gg: AR+sD119M8xWYhCZXr5CLqBq4tozBspE/2mg8k5P40L2umYjrbh59fIr07ICnk0p6j3 umwFISLCA1Pox8g1ibjDirX3g+AF5uB/cUMB6ApoIDOG0UWeyDjEEPerT9tsEeOEvqDAUZOhlmb X5FlcUj/2L7T7hs6ufiUEFIvrTGD824LXkAdC6/cEaRo3znklD28N2r1Wq8bmzrnMRwzotITwEF g+O0XgghVuXYRpY7lnBw0Z69D1IIW5KJgvq1D3/UaPM3c3B4cY1IPi+iU2aotu8lvpQ7ZLstJJY b081gteKgxNqowGE288H+3PSpYUAvUdEYTFJ8sp92Q9iTol4aTEVLHeqBZjx9HSi/0TqO1lsuMG /8lxm7Gn9k9YuQmaVlL7BkfRcyXnMquosrg7MljLzMwO2CIRnmav8RwmM3VEqiLwzB/yOZGgszJ MTWtPFn+OCuypm8FGDqPj+XsGXWxbZnIUAPYD1SzfKAVxR4FjRNEjn8UEcPRIu0cEKb5kXMpS5E lET5rVv02fpnpEqDlX8ni0e2K8Cada9IQmHcak= X-Received: by 2002:a17:907:c1f:b0:c21:757:1bb4 with SMTP id a640c23a62f3a-c25571d8ff6mr949921466b.16.1787996926837; Sat, 29 Aug 2026 02:48:46 -0700 (PDT) Received: from Lenovo (public-gprs210891.centertel.pl. [46.134.163.12]) by smtp.gmail.com with ESMTPSA id a640c23a62f3a-c255ee28596sm190811766b.20.2026.08.29.02.48.45 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 29 Aug 2026 02:48:46 -0700 (PDT) From: Marcin Dawid To: "Rafael J. Wysocki" Cc: linux-pm@vger.kernel.org, regressions@lists.linux.dev, stable@vger.kernel.org, "Jiakai Xu" , "Sasha Levin" , "Greg Kroah-Hartman" , linux-kernel@vger.kernel.org Subject: [REGRESSION] 6.12.y: s2idle hangs after 171ef40fce41 ("PM: sleep: Use complete() in device_pm_sleep_init()") Date: Sat, 29 Aug 2026 11:47:47 +0200 Message-ID: <20260829094750.574649-1-mdawid@gmail.com> X-Mailer: git-send-email 2.55.0 Precedence: bulk X-Mailing-List: regressions@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Hi, My ThinkPad P16v stopped suspending after a kernel update. I bisected the problem to commit 171ef40fce41 ("PM: sleep: Use complete() in device_pm_sleep_init()"), the 6.12.y backport of mainline commit 3855941f1e40. Reverting this commit fixes the problem. #regzbot introduced: 171ef40fce41b13f5115d988c45997e94113c7ab Symptoms: When I close the lid my laptop does not go to sleep and its fans keep running. If I open the lid, the screen stays black and the laptop does not respond. I must do a hard reset. Only the lid triggers this. Calling "systemctl suspend" with the lid open works. In every hang, the kernel log ends like this, here on 6.12.105: [ 94.290011] PM: suspend entry (s2idle) [ 94.296689] Filesystems sync: 0.004 seconds This is the last output visible in the journal. System: Manjaro Linux (rolling release), x86_64, systemd 261 Lenovo ThinkPad P16v Gen 1 (21FE0011PB) AMD Ryzen 7 PRO 7840HS w/ Radeon 780M Graphics BIOS N3VET59W (1.59), 05/13/2025 2x NVMe, WiFi Qualcomm QCNFA765 (ath11k_pci), USB4/Thunderbolt /sys/power/mem_sleep: [s2idle] (the laptop does not support S3) Affected versions: 6.12.y: last working 6.12.96 -> first bad 6.12.97 I only see the hang on 6.12.y. I also tested 6.18.45, 7.1.8 and mainline 7.2, which carry the same commit and the laptop suspends normally on all three (see the table below). The latest 6.12.107 still has the commit and no fix or revert. I tested it and it hangs the same way. Reproducing the problem: I bisected stable branch between 6.12.96 (good) and 6.12.103 (bad). Every tested kernel was built from the kernel.org stable tree using config based on the Manjaro 6.12.96 (trimmed with make localmodconfig and updated with make olddefconfig). 171ef40fce41b13f5115d988c45997e94113c7ab is the first bad commit PM: sleep: Use complete() in device_pm_sleep_init() [ Upstream commit 3855941f1e4069182c895d5093c5fa589f5b38bd ] Bisect log: git bisect start # status: waiting for both 'good' and 'bad' commits # bad: [25c09b42358e73e1476e517b296edb6344f2e4bd] Linux 6.12.103 git bisect bad 25c09b42358e73e1476e517b296edb6344f2e4bd # status: waiting for 'good' commit(s), 'bad' commit known # good: [6d15a1029d425b15c59463910ebdccc4afe760d6] Linux 6.12.96 git bisect good 6d15a1029d425b15c59463910ebdccc4afe760d6 # bad: [afb45d1142b3031f408c0505d1c3e89edc68fb49] iio: adc: ad7380: select REGMAP git bisect bad afb45d1142b3031f408c0505d1c3e89edc68fb49 # bad: [29c801cbd8ad1a27adef6a325cc5a1e6ef275a97] selftest/mm: register existing mapping with userfaultfd in hugetlb-mremap git bisect bad 29c801cbd8ad1a27adef6a325cc5a1e6ef275a97 # bad: [eb7cb798e563b3f3b3baeb9cc6f7455764267e50] IB/mlx5: Properly support implicit ODP rereg_mr git bisect bad eb7cb798e563b3f3b3baeb9cc6f7455764267e50 # good: [5d52b6dc6fd0640e355877e8370b21eb84dc13e0] sysfs: clamp show() return value in sysfs_kf_read() git bisect good 5d52b6dc6fd0640e355877e8370b21eb84dc13e0 # bad: [fa766e5e53ad389d6ec810783f5d5367010f9412] media: qcom: venus: drop extra padding in NV12 raw size calculation git bisect bad fa766e5e53ad389d6ec810783f5d5367010f9412 # bad: [962eae1f30e57ac8e6e20a8b862e269145dc6d9a] driver core: Guard deferred probe timeout extension with delayed_work_pending() git bisect bad 962eae1f30e57ac8e6e20a8b862e269145dc6d9a # good: [16723523c74f90d487df270ae4dad263542aab26] cpufreq: conservative: Simplify frequency limit handling git bisect good 16723523c74f90d487df270ae4dad263542aab26 # good: [7d9fbee252f84de3e6947a40eec01481c9d8afbb] RDMA/hns: Fix log flood after cmd_mbox failure git bisect good 7d9fbee252f84de3e6947a40eec01481c9d8afbb # bad: [7670a3a6ccaf6f081c474338d204461c67d9e126] MIPS: DEC: Remove do_IRQ() call indirection git bisect bad 7670a3a6ccaf6f081c474338d204461c67d9e126 # bad: [171ef40fce41b13f5115d988c45997e94113c7ab] PM: sleep: Use complete() in device_pm_sleep_init() git bisect bad 171ef40fce41b13f5115d988c45997e94113c7ab # good: [5452b60cb1db44cf507aa9b85ab51901ed593c6c] RDMA/counter: Fix incorrect port index in rdma_counter_init() error cleanup git bisect good 5452b60cb1db44cf507aa9b85ab51901ed593c6c # first 'bad' commit: [171ef40fce41b13f5115d988c45997e94113c7ab] PM: sleep: Use complete() in device_pm_sleep_init() What I tested: All tests were done on the same machine, on AC power, by closing and opening the lid. One cycle means that the laptop went to sleep and woke up. The numbers come from the system journal: 6.12.96 Manjaro, before the commit works - 48 cycles over 29 days 6.12.103 (with the commit) hangs - first attempt after boot 6.12.103 with the commit reverted works - 5 cycles in one boot 6.12.103 /sys/power/pm_async set to 0 works - 11 cycles in one boot 6.12.104 Manjaro hangs - first attempt after boot 6.12.105 (with the commit) hangs - first attempt after boot 6.12.105 with the commit reverted works - 10 cycles in one boot 6.12.105 /sys/power/pm_async set to 0 works - 11 cycles in one boot 6.12.107 (with the commit) hangs - first attempt after boot 6.18.45 Manjaro works - 7 cycles over 2 boots 7.1.8 Manjaro works - 12 cycles over 5 boots 7.2 mainline, built from source works - 11 cycles over 5 boots Every hang happened on the first suspend attempt after boot and never after a successful cycle. Setting /sys/power/pm_async to 0 is a workaround I found. The original bad kernel suspends normally with this flag set to 0. I have used this workaround without failures. Changing /sys/power/pm_async back to 1 on a running system did not immediately reproduce the problem. I did this on 6.12.105 and after 11 successful cycles with pm_async=0 the next 3 cycles also worked. The first suspend attempt hung again after reboot. With the commit reverted, 6.12.105 logs this when I close the lid: [ 154.523353] PM: suspend entry (s2idle) [ 154.530033] Filesystems sync: 0.003 seconds [ 155.273772] Freezing user space processes [...] [ 155.273951] PM: Some devices failed to suspend, or early wake event detected [... device resume messages ...] [ 155.290012] PM: suspend exit [ 155.290087] PM: suspend entry (s2idle) [ 156.163505] Filesystems sync: 0.004 seconds [... no error this time; the laptop enters s2idle and later resumes ...] [ 156.223357] PM: suspend exit With the commit present, the same 6.12.105 stops at the "Filesystems sync" line: [ 94.290011] PM: suspend entry (s2idle) [ 94.296689] Filesystems sync: 0.004 seconds 6.18.45, 7.1.8 and mainline 7.2 contain the same change and log the same failed first attempt, but their second attempt suspends normally. Calling "systemctl suspend" with the lid open succeeds on the first attempt on 6.12.105 with the commit, never logs "Some devices failed to suspend" and did not hang in 18 cycles over 7 boots. My local settings: Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.12-x86_64 root=UUID=985b52ba-a61a-41f8-ab5c-fad209ce7c44 rw zswap.enabled=0 resume=UUID=9f557da2-d7c5-4623-83c0-3ea696bb1b3c udev.log_priority=3 Module options: thinkpad_acpi fan_control=1 Other: /sys/power/disk set to "shutdown", vm.swappiness=100, vm.page-cluster=0, CoolerControl daemon, a local systemd unit that reloads ath11k_pci after resume I can test patches or collect more information if needed. Regards, Marcin Dawid