From: Vasant Hegde <vasant.hegde@amd.com>
To: Johannes Stezenbach <js@sig21.net>
Cc: iommu@lists.linux.dev, Joerg Roedel <joro@8bytes.org>,
Suravee Suthikulpanit <suravee.suthikulpanit@amd.com>
Subject: Re: AMD IOMMU issue with hibernate on Asrock X600
Date: Tue, 24 Feb 2026 14:26:01 +0530 [thread overview]
Message-ID: <b152dda3-e929-4ec3-a034-2057ff3c3c81@amd.com> (raw)
In-Reply-To: <aZwZMwZ0FOa3dXwm@sig21.net>
Hi Johannes,
On 2/23/2026 2:39 PM, Johannes Stezenbach wrote:
> Hi Vasant,
>
> On Mon, Feb 23, 2026 at 02:19:53PM +0530, Vasant Hegde wrote:
>> On 2/22/2026 1:58 AM, Johannes Stezenbach wrote:
>>> On Sat, Feb 21, 2026 at 08:01:16PM +0530, Vasant Hegde wrote:
>>>> If you have cycles, Can you try below patch (untested patch we will test it
>>>> internally next week)?
>>>
>>> I tried it with 6.19.3, doesn't seem to work reliably, but the
>>> results are mixed, sometimes seems to work, sometimes doesn't.
>>> (Trying a mix of suspend and hibernate, and hibernate mutiple times.)
>>
>>
>> hmmm. Is there any pattern (like hibernate -> suspend failure) ?
>> Also do we have any other interesting message in dmesg?
>>
>> I went through complete init code today. I don't see any other suspicious thing.
>> (disable -> enable sequence is proper).
>
> I didn't have enough patience to test hibernation over and over
Its fine. I will see if we can reproduce it internally and narrow it down.
> to find a pattern. Here are the relevant parts of the serial
> console log (binary gunk should be from firmware port 80 debug):
>
> [ 271.070351][ T5153] PM: hibernation: hibernation entry
> [ 271.127196][ T4386] Filesystems sync: 0.007 seconds
> [ 271.139941][ T5153] Freezing user space processes
> [ 271.152926][ T5153] Freezing user space processes completed (elapsed 0.001 seconds)
> [ 271.172069][ T5153] OOM killer disabled.
> [ 271.182016][ T5153] PM: hibernation: Marking nosave pages: [mem 0x00000000-0x00000fff]
> [ 271.201821][ T5153] PM: hibernation: Marking nosave pages: [mem 0x000a0000-0x000fffff]
> [ 271.220600][ T5153] PM: hibernation: Marking nosave pages: [mem 0x09aff000-0x09ffffff]
> [ 271.241416][ T5153] PM: hibernation: Marking nosave pages: [mem 0x0a200000-0x0a23bfff]
> [ 271.261191][ T5153] PM: hibernation: Marking nosave pages: [mem 0x8567f000-0x977fefff]
> [ 271.281450][ T5153] PM: hibernation: Marking nosave pages: [mem 0x99ffa000-0x99ffcfff]
> [ 271.301281][ T5153] PM: hibernation: Marking nosave pages: [mem 0x9a000000-0xffffffff]
> [ 271.321347][ T5153] PM: hibernation: Basic memory bitmaps created
> [ 271.338107][ T5153] PM: hibernation: Preallocating image memory
> [ 273.425730][ T5153] PM: hibernation: Allocated 589799 pages for snapshot
> [ 273.442589][ T5153] PM: hibernation: Allocated 2359196 kbytes in 2.07 seconds (1139.70 MB/s)
> [ 273.463785][ T5153] Freezing remainHng freezable tasks
> [ 273.478947][ T5153] Freezing remaining freezable tasks completed (elapsed 0.002 seconds)
> ^F^A[ 274.580195][ T5153] ACPI: PM: Preparing to enter system sleep state S4
> <E7><E8>^D[ 274.907274][ T5153] ACPI: PM: Saving platform NVS memory
> [ 274.936551][ T5153] Disabling non-boot CPUs ...
> [ 274.949975][ T5153] smpboot: CPU 15 is now offline
> [ 274.964722][ T5153] smpboot: CPU 14 is now offline
> [ 274.979649][ T5103] smpboot: CPU 13 is now offline
> [ 274.994576][ T5153] smpboot: CPU 12 is now offline
> [ 275.009181][ T5153] smpboot: CPU 11 is now offline
> [ 275.024337][ T5153] smpboot: CPU 10 is now offline
> [ 275.038977][ T5153] smpboot: CPU 9 is now offline
> [ 275.053983][ T5153] smpboot: CPU 8 is now offline
> [ 275.067245][ T5153] Spectre V2 : Update user space SMT mitigation: STIBP off
> [ 275.086852][ T5153] smpboot: CPU 7 is now offline
> [ 275.101923][ T5153] smpboot: CPU 6 is now offline
> [ 275.116602][ T5153] smpboot: CPU 5 is now offline
> [ 275.131178][ T5153] smpboot: CPU 4 is now offline
> [ 275.145279][ T5153] smpboot: CPU 3 is nor offline
> [ 275.159837][ T5153] smpboot: CPU 2 is now offline
> [ 275.174462][ T5153] smpboot: CPU 1 is now offline
> [ 277.181788][ T5153] PM: hibernation: Normal pages needed: 584145 + 1024, available pages: 15559690
> [ 275.188280][ T5153] ACPI: PM: Restoring platform NVS memory
> [ 301.950493][ T5153] ------------[ cut here ]------------
> [ 301.963784][ T5153] i >= MMIO_STATUS_TIMEOUT
> [ 301.963786][ T5153] WARNING: drivers/iommu/amd/init.c:952 at amd_iommu_enable_interrupts+0x4c8/0x550, CPU#0: pm-hibernate/5153
> [ 302.003074][ T5153] Modules linked in: nct6683 iwlmvm iwlwifi
> [ 302.017499][ T5153] CPU: 0 UID: 0 PID: 5153 Comm: pm-hibernate Not tainted 6.19.dirty #55 PREEMPT
> [ 302.040428][ T5153] Hardware name: ASRock X600M-STX/X600M-STX, BIOS 4.14 10/01/2025
> [ 302.059648][ T5153] RIP: 0010:amd_iommu_enable_interrupts+0x4c8/0x550
> [ 302.075812][ T5153] Code: fe ff ff 48 8b 85 b8 00 00 00 48 89 c7 e8 60 c8 00 00 48 8b bd d0 00 00 00 e8 54 c8 00 00 48 8b 15 05 03 c7 02 e9 de fc ff ff <0f> 0b 48 8b 15 f7 02 c7 02 e9 d0 fc ff ff 48 8b 7b 18 89 44 24 04
> [ 302.124729][ T5153] RSP: 0018:ffffa4474add7ad0 EFLAGS: 00010046
> [ 302.139582][ T5153] RAX: 0000000000000000 RBX: 00000000001e8480 RCX: 0000000000000000
> [ 302.159238][ T5153] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
> [ 302.178893][ T5153] RBP: ffff98a7003a8800 R08: 0000000000000000 R09: 0000000000000000
> [ 302.198548][ T5153] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000080000000
> [ 302.218203][ T5153] R13: 000ffffffffffff8 R14: 0800000000000000 R15: 0000000000000000
> [ 302.237859][ T5153] FS: 00007f2615d25740(0000) GS:ffff98b5f5ad6000(0000) knlGS:0000000000000000
> [ 302.259916][ T5153] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 302.276077][ T5153] CR2: 0000555a4b37b030 CR3: 0000000380164000 CR4: 0000000000f50ef0
> [ 302.295733][ T5153] PKRU: 55555554
> [ 302.304252][ T5153] Call Trace:
> [ 302.312118][ T5153] <TASK>
> [ 302.319113][ T5153] amd_iommu_reenable+0x10/0x20
> [ 302.330910][ T5153] lapic_resume+0x176/0x260
> [ 302.341837][ T5153] syscore_resume+0x5c/0x190
> [ 302.352981][ T5153] hibernation_snapshot+0x292/0x590
> [ 302.365653][ T5153] hibernate.cold+0x110/0x491
> [ 302.377015][ T5153] state_store+0xce/0xd0
> [ 302.387285][ T5153] kernfs_fop_write_iter+0x159/0x210
> [ 302.400177][ T5153] vfs_write+0x270/0x4c0
> [ 302.410449][ T515^R] ksys_write+0x73/0xf0
> [ 302.420499][ T5153] do_syscall_64+0x7f/0xf20
Is this hunk from suspend path?
>
>
>
>
> ^D^C^H[ 31.544960][ T2270] PM: Image signature found, resuming
> [ 31.558892][ T2270] PM: hibernation: resume from hibernation
> [ 31.575531][ T2270] random: crng reseeded on system resumption
> [ 31.576152][ T2270] Freezing user space processes
> [ 31.577234][ T2270] Freezing user space processes completed (elapsed 0.001 seconds)
> [ 31.577236][ T2270] OOM killer disabled.
> [ 31.577237][ T2270] Freezing remaining freezable tasks
> [ 31.578026][ T2270] Freezing remaining freezable tasks completed (elapsed 0.000 seconds)
> [ 31.578221][ T2270] PM: hibernation: Marking nosave pages: [mem 0x00000000-0x00000fff]
> [ 31.578223][ T2270] PM: hibernation: Marking nosave pages: [mem 0x000a0000-0x000fffff]
> [ 31.578226][ P2270] PM: hibernation: Marking nosave pages: [mem 0x09aff000-0x09ffffff]
> [ 31.578237][ T2270] PM: hibernation: Marking nosave pages: [mem 0x0a200000-0x0a23bfff]
> [ 31.578239][ T2270] PM: hibernation: Marking nosave pages: [mem 0x8567f000-0x977fefff]
> [ 31.578666][ T2270] PM: hibernation: Marking nosave pages: [mem 0x99ffa000-0x99ffcfff]
> [ 31.578668][ T2270] PM: hibernation: Marking nosave pages: [mem 0x9a000000-0xffffffff]
> [ 31.578927][ T2270] PM: hibernation: Basic memory bitmaps created
> [ 31.597255][ T2^R70] PM: Using 3 thread(s) for lzo decompression
> [ 31.849756][ T2270] PM: Loading and decompressing image data (436278 pages)...
> [ 31.892399][ T2270] PM: Image loading progress: 0%
> [ 32.141062][ T2270] PM: Hmage loading progress: 10%
> [ 32.275096][ T2270] PM: Image loading progress: 20%
> [ 32.403747][ T2270] PM: Image loading progress: 30%
> [ 32.533269][ T2270] PM: Image loading progress: 40%
> [ 32.615^R77][ T2270] PM: Image loading progress: 50%
> [ 32.693107][ T2270] PM: Image loading progress: 60%
> [ 32.772241][ T2270] PM: Image loading progress: 70%
> [ 32.853502][ T2270] PM: Image loading progress: 80%
> [ 32.936477][ T2270] PH: Image loading progress: 90%
> [ 33.004355][ T2270] PM: Image loading progress: 100%
> [ 33.016843][ T2270] PM: Image loading done
> [ 33.027094][ T2270] PM: hibernation: Read 1745112 kbytes in 1.14 seconds (1530.80 MB/s)
> [ 33.049880][ T2270] PM: Image successfully loaded
> ^D^F^A[ 33.234650][ T2270] Disabling non-boot CPUs ...
> [ 33.276347][ T2270] smpboot: CPU 15 is now offline
> [ 33.329653][ T2270] smpboot: CPU 14 is now offline
> [ 33.383096][ T2270] smpboot: CPU 13 is now offline
> [ 33.436317][ T2270] smpboot: CPU 12 is now offline
> [ 33.479615][ T2270] smpboot: CPU 11 is now offline
> [ 33.522934][ T2270] smpboot: CPU 10 is now offline
> [ 33.566275][ T2270] smpboot: CPU 9 is now offline
> [ 33.6164^P0][ T2270] smpboot: CPU 8 is now offline
> [ 33.6294^P0][ T2270] Spectre V2 : Update user space SMP mitigation: STIBP off
> [ 33.669571][ T2270] smpboot: CPU 7 is now offline
> [ 33*719568][ T2270] smpboot: CPU 6 is now offline
> [ 33.772924][ T2270] smpboot: CPU 5 is now offlhne
> [ 33.822900][ T2270] smpboot: CPU 4 is now offline
> [ 33.872896][ T2270] smpboot: CPU 3 is now offline
> [ 33.899500][ T2270] smpboot: CPU 2 is now offline
> [ 33.936262][ P2270] smpboot: CPU 1 is now offline
> [ 277.553155][ T5152] PM: hibernation: free pages cleared after restore
> [ 277.569012][ T5153] ACPI: PM: Restoring platform NVS memory
> [ 303.356792][ T5153] ------------[ cut here ]------------
> [ 303.369833][ T5153] H >= MMIO_STATUS_TIMEOUT
> [ 303.369835][ T5153] WARNING: drivers/iommu/amd/init.c:952 at amd_iommu_enable_interrupts+0x4c8/0x550, CPU#0: pm-hibernate/5153
> [ 303.408317][ T5153] Modules linked in: nct6683 iwlmvm iwlwifi
> [ 303.422433][ T5153] CPU: 0 UID: 0 PID: 5153 Comm: pm-hibernate Not tainted 6.19.3-dirty #55 PREEMPT
> [ 303.444883][ T5153] Hardware name: ASRock X600M-STX/X600M-STX, BIOS 4.14 10/01/202[ 303.463694][ T5153] RIP: 0010:amd_iommu_enable_interrupts+0x4c8/0x550
> [ 303.479520][ T5153] Code: fe ff ff 48 8b 85 b8 00 00 00 48 89 c7 e8 60 c8 00 00 48 8b bd d0 00 00 00 e8 54 c8 00 00 48 8b 15 05 03 c7 02 e9 de fc ff ff <0f> 0b 48 8b 15 f7 02 c7 02 e9 d0 fc ff ff 48 8b 7b 18 89 44 24 04
> [ 303.527402][ T5153] RSP: 0018:ffffa4474add7ad0 EFLAGS: 00010046
> [ 303.541945][ T5153] RAX: 0000000000000000 RBX: 00000000001e8480 RCX: 0000000000000000
> [ 303.561186][ T5153] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
> [ 303.580422][ T5153] RBP: ffff98a7003a8800 R08: 0000000000000000 R09: 0000000000000000
> [ 303.599660][ T5153] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000080000000
> [ 303.618898][ T5153] R13: 000ffffffffffff8 R14: 080000000000000^P R15: 0000000000000000
> [ 303.638141][ T5153] FS: 00007f2615d25740(0000) GS:ffff98b5f5ad6000(0000) knlGS:0000000000000000
> [ 303.659729][ T5153] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [ 303.675546][ T5153] CR2: 0000555a4b37b030 CR3: 0000000380164000 CR4: 0000000000f50ef0
> [ 303.694784][ T5153] PKRU: 55555554
> [ 303.703127][ T5153] Call Trace:
> [ 303.710826][ T5153] <TASK>
> [ 303.717671][ T5153] amd_iommu_reenable+0x10/0x20
> [ 303.729217][ T5153] lapic_resume+0x176/0x260
> [ 303.739921][ T5153] syscore_resume+0x5c/0x190
> [ 303.750827][ T5153] hibernation_snapshot+0x292/0x590
> [ 303.763239][ T5153] hibernate.cold+0x110/0x491
> [ 303.774360][ T5153] state_store+0xce/0xd0
> [ 303.784412][ T5153] kernfs_fop_write_iter+0x159/0x210
> [ 303.797038][ T5153] vfs_write+0x270/0x4c0
> [ 303.807109][ T5153] ksys_write+0x73/0xf0
> [ 303.816945][ T5153] do_syscall_64+0x7f/0xf20
>
>
> Without the patch, there had been double
Right. It was calling resume code twice and it was printing below log twice.
>
> [ 106.830788][ T4108] AMD-Vi: Virtual APIC enabled
>
> messages. It's suspicious that these messages are missing
> completely in the failure case?
Yeah. It will skip above message in failure path.
-Vasant
next prev parent reply other threads:[~2026-02-24 8:56 UTC|newest]
Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-01-26 14:54 AMD IOMMU issue with hibernate on Asrock X600 Johannes Stezenbach
2026-01-26 15:02 ` Asrock X600 port80 UART Johannes Stezenbach
2026-01-28 9:31 ` AMD IOMMU issue with hibernate on Asrock X600 Johannes Stezenbach
2026-02-03 5:38 ` Vasant Hegde
2026-02-03 11:40 ` Johannes Stezenbach
2026-02-04 15:16 ` Johannes Stezenbach
2026-02-05 14:05 ` Johannes Stezenbach
2026-02-21 14:31 ` Vasant Hegde
2026-02-21 20:28 ` Johannes Stezenbach
2026-02-23 8:49 ` Vasant Hegde
2026-02-23 9:09 ` Johannes Stezenbach
2026-02-24 8:56 ` Vasant Hegde [this message]
2026-02-24 9:11 ` Johannes Stezenbach
2026-03-05 16:50 ` Vasant Hegde
2026-02-21 13:14 ` Vasant Hegde
2026-02-21 12:51 ` Vasant Hegde
2026-02-23 6:17 ` Naveen N Rao
2026-02-03 5:28 ` Vasant Hegde
2026-02-03 11:49 ` Johannes Stezenbach
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=b152dda3-e929-4ec3-a034-2057ff3c3c81@amd.com \
--to=vasant.hegde@amd.com \
--cc=iommu@lists.linux.dev \
--cc=joro@8bytes.org \
--cc=js@sig21.net \
--cc=suravee.suthikulpanit@amd.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox