From: "Rafael J. Wysocki" <rafael@kernel.org>
To: Mario Limonciello <mario.limonciello@amd.com>
Cc: Samuel Zhang <guoqing.zhang@amd.com>,
alexander.deucher@amd.com, christian.koenig@amd.com,
rafael@kernel.org, len.brown@intel.com, pavel@kernel.org,
gregkh@linuxfoundation.org, dakr@kernel.org, airlied@gmail.com,
simona@ffwll.ch, ray.huang@amd.com, matthew.auld@intel.com,
matthew.brost@intel.com, maarten.lankhorst@linux.intel.com,
mripard@kernel.org, tzimmermann@suse.de, lijo.lazar@amd.com,
victor.zhao@amd.com, haijun.chang@amd.com, Qing.Ma@amd.com,
Owen.Zhang2@amd.com, linux-pm@vger.kernel.org,
linux-kernel@vger.kernel.org, amd-gfx@lists.freedesktop.org,
dri-devel@lists.freedesktop.org
Subject: Re: [PATCH v3 3/5] PM: hibernate: shrink shmem pages after dev_pm_ops.prepare()
Date: Tue, 8 Jul 2025 16:33:04 +0200 [thread overview]
Message-ID: <CAJZ5v0iscejFdRXQAPkzdN0xBdZDnx5LzVvsN2SGC0ByBku85A@mail.gmail.com> (raw)
In-Reply-To: <bd30f96b-44d2-4127-a019-f02bc2689aa2@amd.com>
On Tue, Jul 8, 2025 at 4:28 PM Mario Limonciello
<mario.limonciello@amd.com> wrote:
>
> On 7/8/2025 3:42 AM, Samuel Zhang wrote:
> > When hibernate with data center dGPUs, huge number of VRAM data will be
> > moved to shmem during dev_pm_ops.prepare(). These shmem pages take a lot
> > of system memory so that there's no enough free memory for creating the
> > hibernation image. This will cause hibernation fail and abort.
> >
> > After dev_pm_ops.prepare(), call shrink_all_memory() to force move shmem
> > pages to swap disk and reclaim the pages, so that there's enough system
> > memory for hibernation image and less pages needed to copy to the image.
> >
> > This patch can only flush and free about half shmem pages. It will be
> > better to flush and free more pages, even all of shmem pages, so that
> > there're less pages to be copied to the hibernation image and the overall
> > hibernation time can be reduced.
> >
> > Signed-off-by: Samuel Zhang <guoqing.zhang@amd.com>
>
> AFAICT this didn't tangibly change and was just reordered in the series,
> I think you should carry Rafael's A-b tag forward.
Yes, please.
> > ---
> > kernel/power/hibernate.c | 26 ++++++++++++++++++++++++++
> > 1 file changed, 26 insertions(+)
> >
> > diff --git a/kernel/power/hibernate.c b/kernel/power/hibernate.c
> > index 10a01af63a80..7ae9d9a7aa1d 100644
> > --- a/kernel/power/hibernate.c
> > +++ b/kernel/power/hibernate.c
> > @@ -370,6 +370,23 @@ static int create_image(int platform_mode)
> > return error;
> > }
> >
> > +static void shrink_shmem_memory(void)
> > +{
> > + struct sysinfo info;
> > + unsigned long nr_shmem_pages, nr_freed_pages;
> > +
> > + si_meminfo(&info);
> > + nr_shmem_pages = info.sharedram; /* current page count used for shmem */
> > + /*
> > + * The intent is to reclaim all shmem pages. Though shrink_all_memory() can
> > + * only reclaim about half of them, it's enough for creating the hibernation
> > + * image.
> > + */
> > + nr_freed_pages = shrink_all_memory(nr_shmem_pages);
> > + pr_debug("requested to reclaim %lu shmem pages, actually freed %lu pages\n",
> > + nr_shmem_pages, nr_freed_pages);
> > +}
> > +
> > /**
> > * hibernation_snapshot - Quiesce devices and create a hibernation image.
> > * @platform_mode: If set, use platform driver to prepare for the transition.
> > @@ -411,6 +428,15 @@ int hibernation_snapshot(int platform_mode)
> > goto Thaw;
> > }
> >
> > + /*
> > + * Device drivers may move lots of data to shmem in dpm_prepare(). The shmem
> > + * pages will use lots of system memory, causing hibernation image creation
> > + * fail due to insufficient free memory.
> > + * This call is to force flush the shmem pages to swap disk and reclaim
> > + * the system memory so that image creation can succeed.
> > + */
> > + shrink_shmem_memory();
> > +
> > suspend_console();
> > pm_restrict_gfp_mask();
> >
>
next prev parent reply other threads:[~2025-07-08 14:33 UTC|newest]
Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-07-08 7:42 [PATCH v3 0/5] reduce system memory requirement for hibernation Samuel Zhang
2025-07-08 7:42 ` [PATCH v3 1/5] drm/ttm: add new api ttm_device_prepare_hibernation() Samuel Zhang
2025-07-08 8:38 ` Christian König
2025-07-08 7:42 ` [PATCH v3 2/5] drm/amdgpu: move GTT to shmem after eviction for hibernation Samuel Zhang
2025-07-08 8:41 ` Christian König
2025-07-08 7:42 ` [PATCH v3 3/5] PM: hibernate: shrink shmem pages after dev_pm_ops.prepare() Samuel Zhang
2025-07-08 14:28 ` Mario Limonciello
2025-07-08 14:33 ` Rafael J. Wysocki [this message]
2025-07-08 7:42 ` [PATCH v3 4/5] PM: hibernate: add new api pm_transition_event() Samuel Zhang
2025-07-08 14:36 ` Mario Limonciello
2025-07-08 14:39 ` Rafael J. Wysocki
2025-07-08 16:07 ` Zhang, GuoQing (Sam)
2025-07-08 16:11 ` Mario Limonciello
2025-07-08 7:42 ` [PATCH v3 5/5] drm/amdgpu: do not resume device in thaw for normal hibernation Samuel Zhang
2025-07-08 10:28 ` Lazar, Lijo
2025-07-08 14:40 ` Mario Limonciello
2025-07-08 16:08 ` Zhang, GuoQing (Sam)
2025-07-08 16:11 ` Mario Limonciello
2025-07-08 14:31 ` [PATCH v3 0/5] reduce system memory requirement for hibernation Mario Limonciello
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAJZ5v0iscejFdRXQAPkzdN0xBdZDnx5LzVvsN2SGC0ByBku85A@mail.gmail.com \
--to=rafael@kernel.org \
--cc=Owen.Zhang2@amd.com \
--cc=Qing.Ma@amd.com \
--cc=airlied@gmail.com \
--cc=alexander.deucher@amd.com \
--cc=amd-gfx@lists.freedesktop.org \
--cc=christian.koenig@amd.com \
--cc=dakr@kernel.org \
--cc=dri-devel@lists.freedesktop.org \
--cc=gregkh@linuxfoundation.org \
--cc=guoqing.zhang@amd.com \
--cc=haijun.chang@amd.com \
--cc=len.brown@intel.com \
--cc=lijo.lazar@amd.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-pm@vger.kernel.org \
--cc=maarten.lankhorst@linux.intel.com \
--cc=mario.limonciello@amd.com \
--cc=matthew.auld@intel.com \
--cc=matthew.brost@intel.com \
--cc=mripard@kernel.org \
--cc=pavel@kernel.org \
--cc=ray.huang@amd.com \
--cc=simona@ffwll.ch \
--cc=tzimmermann@suse.de \
--cc=victor.zhao@amd.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).