From: Mario Limonciello <superm1@kernel.org>
To: "Rafael J. Wysocki" <rafael@kernel.org>
Cc: "Alex Deucher" <alexander.deucher@amd.com>,
"Bjorn Helgaas" <bhelgaas@google.com>,
"open list:RADEON and AMDGPU DRM DRIVERS"
<amd-gfx@lists.freedesktop.org>,
"open list:HIBERNATION (aka Software Suspend,
aka swsusp)" <linux-pm@vger.kernel.org>,
"open list:PCI SUBSYSTEM" <linux-pci@vger.kernel.org>,
"open list" <linux-kernel@vger.kernel.org>,
"Mario Limonciello" <mario.limonciello@amd.com>,
"AceLan Kao" <acelan.kao@canonical.com>,
"Kai-Heng Feng" <kaihengf@nvidia.com>,
"Mark Pearson" <mpearson-lenovo@squebb.ca>,
"Merthan Karakaş" <m3rthn.k@gmail.com>,
"Denis Benato" <benato.denis96@gmail.com>
Subject: Re: [PATCH v2 1/3] PM: Use hibernate flows for system power off
Date: Fri, 16 May 2025 14:33:24 -0500 [thread overview]
Message-ID: <d77b51a6-24a0-4b24-b3f8-c6de8809b686@kernel.org> (raw)
In-Reply-To: <CAJZ5v0jifqTP_eZ33nBmKPCuLWrrVF_0jNGf5CpHU6nXuK8qBw@mail.gmail.com>
On 5/16/2025 9:58 AM, Rafael J. Wysocki wrote:
> On Wed, May 14, 2025 at 9:34 PM Mario Limonciello <superm1@kernel.org> wrote:
>>
>> From: Mario Limonciello <mario.limonciello@amd.com>
>>
>> When the system is powered off the kernel will call device_shutdown()
>> which will issue callbacks into PCI core to wake up a device and call
>> it's shutdown() callback. This will leave devices in ACPI D0 which can
>> cause some devices to misbehave with spurious wakeups and also leave some
>> devices on which will consume power needlessly.
>>
>> The issue won't happen if the device is in D3 before system shutdown, so
>> putting device to low power state before shutdown solves the issue.
>>
>> ACPI Spec 6.5, "7.4.2.5 System \_S4 State" says "Devices states are
>> compatible with the current Power Resource states. In other words, all
>> devices are in the D3 state when the system state is S4."
>>
>> The following "7.4.2.6 System \_S5 State (Soft Off)" states "The S5
>> state is similar to the S4 state except that OSPM does not save any
>> context." so it's safe to assume devices should be at D3 for S5.
>>
>> To accomplish this, modify the PM core to call all the device hibernate
>> callbacks when turning off the system when the kernel is compiled with
>> hibernate support. If compiled without hibernate support or hibernate fails
>> fall back into the previous shutdown flow.
>>
>> Cc: AceLan Kao <acelan.kao@canonical.com>
>> Cc: Kai-Heng Feng <kaihengf@nvidia.com>
>> Cc: Mark Pearson <mpearson-lenovo@squebb.ca>
>> Cc: Merthan Karakaş <m3rthn.k@gmail.com>
>> Tested-by: Denis Benato <benato.denis96@gmail.com>
>> Link: https://lore.kernel.org/linux-pci/20231213182656.6165-1-mario.limonciello@amd.com/
>> Link: https://lore.kernel.org/linux-pci/20250506041934.1409302-1-superm1@kernel.org/
>> Signed-off-by: Mario Limonciello <mario.limonciello@amd.com>
>> ---
>> v2:
>> * Handle failures to hibernate (fall back to shutdown)
>> * Don't use dedicated events
>> * Only allow under CONFIG_HIBERNATE_CALLBACKS
>> ---
>> kernel/reboot.c | 12 ++++++++++++
>> 1 file changed, 12 insertions(+)
>>
>> diff --git a/kernel/reboot.c b/kernel/reboot.c
>> index ec087827c85cd..52f5e6e36a6f8 100644
>> --- a/kernel/reboot.c
>> +++ b/kernel/reboot.c
>> @@ -13,6 +13,7 @@
>> #include <linux/kexec.h>
>> #include <linux/kmod.h>
>> #include <linux/kmsg_dump.h>
>> +#include <linux/pm.h>
>> #include <linux/reboot.h>
>> #include <linux/suspend.h>
>> #include <linux/syscalls.h>
>> @@ -305,6 +306,17 @@ static void kernel_shutdown_prepare(enum system_states state)
>> (state == SYSTEM_HALT) ? SYS_HALT : SYS_POWER_OFF, NULL);
>> system_state = state;
>> usermodehelper_disable();
>> +#ifdef CONFIG_HIBERNATE_CALLBACKS
>> + if (dpm_suspend_start(PMSG_HIBERNATE))
>> + goto resume_devices;
>
> A failure of one device may trigger a cascade of failures when trying
> to resume devices and it is not even necessary to resume the ones that
> have been powered off successfully.
Right it "shouldn't" be necessary, but I wanted to make sure that we had
a clean (expected) slate going into device_shutdown().
Otherwise drivers might not have been prepared to go right from
poweroff() to shutdown() callbacks.
>
> IMV this should just ignore errors during the processing of devices,
> so maybe introduce PMSG_POWEROFF for it?
Hmm - I guess it depends upon the failures that occurred. I'll start
plumbing a new message and see how it looks.
I don't "think" we can safely call dpm_suspend_end() if
dpm_suspend_start() failed though.
>
> It should also ignore wakeup events that occur while devices are powered off.
>
>> + if (dpm_suspend_end(PMSG_HIBERNATE))
>> + goto resume_devices;
>> + return;
>> +
>> +resume_devices:
>> + pr_emerg("Failed to power off devices, using shutdown instead.\n");
>> + dpm_resume_end(PMSG_RESTORE);
>
> Unfortunately, PMSG_RESTORE is not the right resume action for
> PMSG_HIBERNATE because it may not power-up things (some drivers assume
> that the restore kernel will power-up devices and so they don't do it
> in "restore" callbacks).
>
> I do realize that hibernation uses it to reverse PMSG_HIBERNATE, but
> it should not do that either. That may be fixed later, though.
>
>> +#endif
>> device_shutdown();
>> }
>> /**
>> --
>
> I'd prefer to get back to this series after the 6.16 merge window
> starts. It is sort of last minute for 6.16 and it is far from ready
> IMV.
Sure, I'll get a start on your feedback above and submit a fixed up
version after the merge window.
next prev parent reply other threads:[~2025-05-16 19:33 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-05-14 19:34 [PATCH v2 0/3] Improvements to S5 power consumption Mario Limonciello
2025-05-14 19:34 ` [PATCH v2 1/3] PM: Use hibernate flows for system power off Mario Limonciello
2025-05-16 14:58 ` Rafael J. Wysocki
2025-05-16 19:33 ` Mario Limonciello [this message]
2025-05-16 19:53 ` Rafael J. Wysocki
2025-05-14 19:34 ` [PATCH v2 2/3] PCI: Put PCIe ports with downstream devices into D3 at hibernate Mario Limonciello
2025-05-18 6:20 ` Lukas Wunner
2025-05-14 19:34 ` [PATCH v2 3/3] drm/amd: Avoid evicting resources at S5 Mario Limonciello
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=d77b51a6-24a0-4b24-b3f8-c6de8809b686@kernel.org \
--to=superm1@kernel.org \
--cc=acelan.kao@canonical.com \
--cc=alexander.deucher@amd.com \
--cc=amd-gfx@lists.freedesktop.org \
--cc=benato.denis96@gmail.com \
--cc=bhelgaas@google.com \
--cc=kaihengf@nvidia.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-pci@vger.kernel.org \
--cc=linux-pm@vger.kernel.org \
--cc=m3rthn.k@gmail.com \
--cc=mario.limonciello@amd.com \
--cc=mpearson-lenovo@squebb.ca \
--cc=rafael@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.