From: Jinjie Ruan <ruanjinjie@huawei.com>
To: Vladimir Murzin <vladimir.murzin@arm.com>,
<linux-arm-kernel@lists.infradead.org>
Cc: mark.rutland@arm.com, maz@kernel.org, stable@vger.kernel.org,
catalin.marinas@arm.com, will@kernel.org
Subject: Re: [RFC PATCH 03/36] arm64: hibernate: mask DAIF before restoring hibernated kernel
Date: Tue, 14 Jul 2026 20:35:23 +0800 [thread overview]
Message-ID: <9a2cb267-717c-428e-b6f3-4f01a00df89b@huawei.com> (raw)
In-Reply-To: <8157087e-74e9-47bc-ad57-c2641a58acc8@arm.com>
On 7/14/2026 5:37 PM, Vladimir Murzin wrote:
> On 7/10/26 04:28, Jinjie Ruan wrote:
>>> @@ -465,9 +466,21 @@ int __nocfi swsusp_arch_resume(void)
>>> if (el2_reset_needed())
>>> __hyp_set_vectors(el2_vectors);
>>>
>>> + /*
>>> + * It is necessary to mask all DAIF exceptions here as:
>>> + *
>>> + * - The copy of swsusp_arch_suspend_exit() in the hibernation
>>> + * text cannot handle taking any exceptions.
>>> + *
>>> + * - The suspended kernel masked all DAIF exceptions in
>>> + * swsusp_arch_resume(), and expects to be re-entered in the
>>> + * same state : with all DAIF exceptions masked.
>>> + */
>>> + flags = local_daif_save();
>>> hibernate_exit(virt_to_phys(tmp_pg_dir), resume_hdr.ttbr1_el1,
>>> resume_hdr.reenter_kernel, restore_pblist,
>>> resume_hdr.__hyp_stub_vectors, virt_to_phys(zero_page));
>>> + local_daif_restore(flags);
>> I believe that the local_daif_save() here is also unnecessary because
>> hibernate_exit() returns from the "return 0 branch" of
>> __cpu_suspend_enter() in swsusp_arch_suspend(), and before that,
>> local_daif_save() has already been called to mask all exceptions.
>>
>> swsusp_arch_suspend(void)
>> -> flags = local_daif_save();
>> -> if (__cpu_suspend_enter(&state)) {
>> ...
>> } else { // _cpu_resume <- hibernate_exit()
>>
>> ...
>> in_suspend = 0;
>> ...
>> }
>> -> local_daif_restore(flags);
I mean that the return point of hibernate_exit() has already restored
the interrupt mask with local_daif_restore().
>
> I'm not sure I follow, we are protecting path
>
> ...
> load_image_and_restore()
> -> hibernation_restore()
> -> resume_target_kernel()
> -> local_irq_disable()
> -> swsusp_arch_resume()
> -> swsusp_arch_suspend_exit (aka hibernate_exit())
> -> ...
>
>
> issue can be easily observed with debug diff bellow applied on top of the
> series
>
> diff --git a/arch/arm64/kernel/hibernate.c b/arch/arm64/kernel/hibernate.c
> index 4dd40593f736..709f5f4c420a 100644
> --- a/arch/arm64/kernel/hibernate.c
> +++ b/arch/arm64/kernel/hibernate.c
> @@ -476,6 +476,7 @@ int __nocfi swsusp_arch_resume(void)
> * swsusp_arch_resume(), and expects to be re-entered in the
> * same state : with all DAIF exceptions masked.
> */
> + arm64_debug_exc_context(CRITICAL_CONTEXT);
> flags = local_all_irqs_save_mask(CRITICAL_CONTEXT);
> hibernate_exit(virt_to_phys(tmp_pg_dir), resume_hdr.ttbr1_el1,
> resume_hdr.reenter_kernel, restore_pblist,
>
> That would generate warning when run on qemu
>
> ------------[ cut here ]------------
> Unexpected DAIF+ALLINT: 0xc0 + 0x0 (expected 0x3c0 + 0x2000)
> WARNING: ./arch/arm64/include/asm/interrupts/common_flags.h:175 at swsusp_arch_resume+0x2d0/0x32c, CPU#0: sh/100
> Modules linked in:
> CPU: 0 UID: 0 PID: 100 Comm: sh Not tainted 7.2.0-rc2-00041-gc07d2a0843b2-dirty #288 PREEMPTLAZY
> Hardware name: linux,dummy-virt (DT)
> pstate: 614000c5 (nZCv daIF -ALLINT +PAN -UAO -TCO +DIT -SSBS BTYPE=--)
I encountered some problems when trying to enter the
swsusp_arch_resume() process on QEMU.
Considering that this is the key code, it is necessary to mask the debug
and serror exception , and also to mask ALLINT.
Therefore, LGTM except for the noreturn issue.
Reviewed-by: Jinjie Ruan <ruanjinjie@huawei.com>
> pc : swsusp_arch_resume+0x2d0/0x32c
> lr : swsusp_arch_resume+0x2d0/0x32c
> sp : ffff800081adba80
> x29: ffff800081adbad0 x28: fff00000024ff000 x27: 0000000000000000
> x26: 0000000000000000 x25: 0000000000000000 x24: ffff8000815cd000
> x23: ffff8000815b4000 x22: ffff8000815c28d8 x21: ffff8000815c2000
> x20: fff000000a839000 x19: 0000000000000000 x18: 0000000000000006
> x17: 0000000000000000 x16: 0000000000000000 x15: ffff800081adb64f
> x14: ffff800081adb470 x13: ffff800101adb647 x12: 000000648200003c
> x11: ffff8000815cd8e8 x10: 0000000000000161 x9 : ffff8000815cd8e8
> x8 : 0000000000000162 x7 : ffff8000816258e8 x6 : ffff8000816258e8
> x5 : 3fffffffffffefff x4 : bffffffffffff000 x3 : 0000000000000000
> x2 : 0000000000000000 x1 : 0000000000000000 x0 : fff00000024ff000
> Call trace:
> swsusp_arch_resume+0x2d0/0x32c (P)
> hibernation_restore+0xe0/0x1a4
> load_image_and_restore+0x60/0xb0
> hibernate+0x228/0x374
> state_store+0xe8/0xf4
> kobj_attr_store+0x18/0x34
> sysfs_kf_write+0x5c/0x78
> kernfs_fop_write_iter+0x130/0x200
> vfs_write+0x20c/0x380
> ksys_write+0x70/0x110
> __arm64_sys_write+0x1c/0x28
> invoke_syscall.constprop.0+0x58/0x100
> do_el0_svc+0x40/0xc0
> el0_svc+0x200/0xa0c
> el0t_64_sync_handler+0x110/0x20c
> el0t_64_sync+0x1ac/0x1b0
> ---[ end trace 0000000000000000 ]---
>
> Cheers
> Vladimir
>
next prev parent reply other threads:[~2026-07-14 12:35 UTC|newest]
Thread overview: 109+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-07-09 12:12 [RFC PATCH 00/36] arm64: Add support for FEAT_NMI Vladimir Murzin
2026-07-09 12:12 ` [RFC PATCH 01/36] arm64: ptrace: Remove INIT_PSTATE_EL2 Vladimir Murzin
2026-07-09 12:36 ` Jinjie Ruan
2026-07-09 12:12 ` [RFC PATCH 02/36] arm64: debug: don't mask DAIF for mdscr_write() Vladimir Murzin
2026-07-09 13:06 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 03/36] arm64: hibernate: mask DAIF before restoring hibernated kernel Vladimir Murzin
2026-07-09 13:19 ` Jinjie Ruan
2026-07-10 3:00 ` Jinjie Ruan
2026-07-14 9:35 ` Vladimir Murzin
2026-07-10 3:28 ` Jinjie Ruan
2026-07-14 9:37 ` Vladimir Murzin
2026-07-14 12:35 ` Jinjie Ruan [this message]
2026-07-10 3:40 ` Liao, Chang
2026-07-14 9:42 ` Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 04/36] arm64: suspend: rely on daif helpers to handle PMR Vladimir Murzin
2026-07-10 3:41 ` Jinjie Ruan
2026-07-10 4:06 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 05/36] arm64: suspend: Initialize PMR on resume Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 06/36] arm64: irq: introduce a helper for GIC priority initialization Vladimir Murzin
2026-07-10 4:16 ` Jinjie Ruan
2026-07-14 9:46 ` Vladimir Murzin
2026-07-10 7:29 ` Jinjie Ruan
2026-07-14 9:56 ` Vladimir Murzin
2026-07-10 7:44 ` Jinjie Ruan
2026-07-14 10:02 ` Vladimir Murzin
2026-07-14 11:05 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 07/36] arm64: entry: mask DAIF before returning from C EL1 handlers Vladimir Murzin
2026-07-10 7:57 ` Jinjie Ruan
2026-07-14 10:13 ` Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 08/36] irqchip/gic-v3: make the unmasking of pseudo-NMIs explicit when handling IRQs Vladimir Murzin
2026-07-10 8:04 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 09/36] arm64: irqflags: introduce arm64-specific irqflags type Vladimir Murzin
2026-07-10 8:40 ` Jinjie Ruan
2026-07-14 11:50 ` Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 10/36] arm64: irqflags: save and use both DAIF and PMR Vladimir Murzin
2026-07-10 3:53 ` Liao, Chang
2026-07-10 8:11 ` Jinjie Ruan
2026-07-14 9:44 ` Vladimir Murzin
2026-07-14 11:30 ` Liao, Chang
2026-07-10 8:47 ` Jinjie Ruan
2026-07-10 9:02 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 11/36] arm64: interrupts: introduce interrupt masking helpers for entry code Vladimir Murzin
2026-07-10 9:19 ` Jinjie Ruan
2026-07-14 11:54 ` Vladimir Murzin
2026-07-10 9:39 ` Liao, Chang
2026-07-10 9:39 ` Jinjie Ruan
2026-07-10 9:44 ` Jinjie Ruan
2026-07-14 7:33 ` Liao, Chang
2026-07-14 15:45 ` Vladimir Murzin
2026-07-15 6:42 ` Liao, Chang
2026-07-09 12:13 ` [RFC PATCH 12/36] arm64: entry: replace DAIF helpers with entry helpers Vladimir Murzin
2026-07-10 9:36 ` Jinjie Ruan
2026-07-10 10:01 ` Jinjie Ruan
2026-07-14 12:00 ` Vladimir Murzin
2026-07-14 12:14 ` Liao, Chang
2026-07-09 12:13 ` [RFC PATCH 13/36] arm64: process: Use helper to check exception state Vladimir Murzin
2026-07-10 10:00 ` Jinjie Ruan
2026-07-14 12:46 ` Liao, Chang
2026-07-09 12:13 ` [RFC PATCH 14/36] arm64: interrupts: introduce generic interrupt masking helpers Vladimir Murzin
2026-07-13 8:43 ` Jinjie Ruan
2026-07-14 12:52 ` Vladimir Murzin
2026-07-14 12:45 ` Jinjie Ruan
2026-07-14 13:13 ` Liao, Chang
2026-07-09 12:13 ` [RFC PATCH 15/36] arm64: replace local_daif helpers Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 16/36] arm64: cpuidle: use new helpers to bypass interrupt priority masking Vladimir Murzin
2026-07-13 8:28 ` Jinjie Ruan
2026-07-14 12:51 ` Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 17/36] arm64: remove daifflags.h Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 18/36] arm64: gicv3: remove GIC_PRIO_PSR_I_SET Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 19/36] arm64: cpufeature: Remove system_has_prio_mask_debugging() Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 20/36] arm64: irqflags: Switch to CONFIG_DEBUG_IRQFLAGS Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 21/36] arm64: Kconfig: Remove CONFIG_ARM64_DEBUG_PRIORITY_MASKING Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 22/36] efi/runtime-wrappers: Permit architectures to override IRQ flags checks Vladimir Murzin
2026-07-13 8:27 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 23/36] arm64/efi: Implement override for " Vladimir Murzin
2026-07-13 8:22 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 24/36] arm64: booting: Document boot requirements for FEAT_NMI Vladimir Murzin
2026-07-10 2:39 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 25/36] arm64: sysreg: Add definitions for immediate versions of MSR ALLINT Vladimir Murzin
2026-07-14 11:01 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 26/36] arm64: ptrace: Add PSR_ALLINT_BIT Vladimir Murzin
2026-07-10 2:16 ` Jinjie Ruan
2026-07-14 9:30 ` Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 27/36] arm64: idreg: Add an override for FEAT_NMI Vladimir Murzin
2026-07-10 2:17 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 28/36] arm64: cpufeature: Detect PE support " Vladimir Murzin
2026-07-10 2:25 ` Jinjie Ruan
2026-07-14 9:33 ` Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 29/36] arm64: nmi: Manage masking for superpriority interrupts Vladimir Murzin
2026-07-10 10:04 ` Jinjie Ruan
2026-07-10 10:08 ` Jinjie Ruan
2026-07-14 12:41 ` Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 30/36] arm64: irq: Report FEAT_NMI masking local IRQs Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 31/36] arm64: nmi: Add handling of superpriority interrupts as NMIs Vladimir Murzin
2026-07-10 10:13 ` Jinjie Ruan
2026-07-14 16:24 ` Vladimir Murzin
2026-07-09 12:13 ` [RFC PATCH 32/36] arm64: suspend: Always initialise PSTATE.ALLINT Vladimir Murzin
2026-07-13 8:00 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 33/36] arm64/efi: Add ALLINT to IRQ flags checks Vladimir Murzin
2026-07-13 8:03 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 34/36] arm64: kprobes: Disable NMIs Vladimir Murzin
2026-07-13 8:12 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 35/36] arm64: nmi: Add Kconfig for NMI Vladimir Murzin
2026-07-10 2:41 ` Jinjie Ruan
2026-07-14 8:52 ` Jinjie Ruan
2026-07-09 12:13 ` [RFC PATCH 36/36] irqchip/gic-v3: Implement FEAT_GICv3_NMI support Vladimir Murzin
2026-07-14 8:37 ` [RFC PATCH 00/36] arm64: Add support for FEAT_NMI Jinjie Ruan
[not found] ` <bb6e80db-dd5e-405f-9aa9-2a59fae3a1dc@huawei.com>
2026-07-14 10:32 ` Vladimir Murzin
2026-07-14 15:18 ` Vladimir Murzin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=9a2cb267-717c-428e-b6f3-4f01a00df89b@huawei.com \
--to=ruanjinjie@huawei.com \
--cc=catalin.marinas@arm.com \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=mark.rutland@arm.com \
--cc=maz@kernel.org \
--cc=stable@vger.kernel.org \
--cc=vladimir.murzin@arm.com \
--cc=will@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox