From: Johannes Stezenbach <js@sig21.net>
To: Vasant Hegde <vasant.hegde@amd.com>
Cc: iommu@lists.linux.dev, Joerg Roedel <joro@8bytes.org>,
Suravee Suthikulpanit <suravee.suthikulpanit@amd.com>
Subject: Re: AMD IOMMU issue with hibernate on Asrock X600
Date: Mon, 23 Feb 2026 10:09:07 +0100 [thread overview]
Message-ID: <aZwZMwZ0FOa3dXwm@sig21.net> (raw)
In-Reply-To: <cf136d02-986f-402c-81d9-8971229abe9e@amd.com>
Hi Vasant,
On Mon, Feb 23, 2026 at 02:19:53PM +0530, Vasant Hegde wrote:
> On 2/22/2026 1:58 AM, Johannes Stezenbach wrote:
> > On Sat, Feb 21, 2026 at 08:01:16PM +0530, Vasant Hegde wrote:
> >> If you have cycles, Can you try below patch (untested patch we will test it
> >> internally next week)?
> >
> > I tried it with 6.19.3, doesn't seem to work reliably, but the
> > results are mixed, sometimes seems to work, sometimes doesn't.
> > (Trying a mix of suspend and hibernate, and hibernate mutiple times.)
>
>
> hmmm. Is there any pattern (like hibernate -> suspend failure) ?
> Also do we have any other interesting message in dmesg?
>
> I went through complete init code today. I don't see any other suspicious thing.
> (disable -> enable sequence is proper).
I didn't have enough patience to test hibernation over and over
to find a pattern. Here are the relevant parts of the serial
console log (binary gunk should be from firmware port 80 debug):
[ 271.070351][ T5153] PM: hibernation: hibernation entry
[ 271.127196][ T4386] Filesystems sync: 0.007 seconds
[ 271.139941][ T5153] Freezing user space processes
[ 271.152926][ T5153] Freezing user space processes completed (elapsed 0.001 seconds)
[ 271.172069][ T5153] OOM killer disabled.
[ 271.182016][ T5153] PM: hibernation: Marking nosave pages: [mem 0x00000000-0x00000fff]
[ 271.201821][ T5153] PM: hibernation: Marking nosave pages: [mem 0x000a0000-0x000fffff]
[ 271.220600][ T5153] PM: hibernation: Marking nosave pages: [mem 0x09aff000-0x09ffffff]
[ 271.241416][ T5153] PM: hibernation: Marking nosave pages: [mem 0x0a200000-0x0a23bfff]
[ 271.261191][ T5153] PM: hibernation: Marking nosave pages: [mem 0x8567f000-0x977fefff]
[ 271.281450][ T5153] PM: hibernation: Marking nosave pages: [mem 0x99ffa000-0x99ffcfff]
[ 271.301281][ T5153] PM: hibernation: Marking nosave pages: [mem 0x9a000000-0xffffffff]
[ 271.321347][ T5153] PM: hibernation: Basic memory bitmaps created
[ 271.338107][ T5153] PM: hibernation: Preallocating image memory
[ 273.425730][ T5153] PM: hibernation: Allocated 589799 pages for snapshot
[ 273.442589][ T5153] PM: hibernation: Allocated 2359196 kbytes in 2.07 seconds (1139.70 MB/s)
[ 273.463785][ T5153] Freezing remainHng freezable tasks
[ 273.478947][ T5153] Freezing remaining freezable tasks completed (elapsed 0.002 seconds)
^F^A[ 274.580195][ T5153] ACPI: PM: Preparing to enter system sleep state S4
<E7><E8>^D[ 274.907274][ T5153] ACPI: PM: Saving platform NVS memory
[ 274.936551][ T5153] Disabling non-boot CPUs ...
[ 274.949975][ T5153] smpboot: CPU 15 is now offline
[ 274.964722][ T5153] smpboot: CPU 14 is now offline
[ 274.979649][ T5103] smpboot: CPU 13 is now offline
[ 274.994576][ T5153] smpboot: CPU 12 is now offline
[ 275.009181][ T5153] smpboot: CPU 11 is now offline
[ 275.024337][ T5153] smpboot: CPU 10 is now offline
[ 275.038977][ T5153] smpboot: CPU 9 is now offline
[ 275.053983][ T5153] smpboot: CPU 8 is now offline
[ 275.067245][ T5153] Spectre V2 : Update user space SMT mitigation: STIBP off
[ 275.086852][ T5153] smpboot: CPU 7 is now offline
[ 275.101923][ T5153] smpboot: CPU 6 is now offline
[ 275.116602][ T5153] smpboot: CPU 5 is now offline
[ 275.131178][ T5153] smpboot: CPU 4 is now offline
[ 275.145279][ T5153] smpboot: CPU 3 is nor offline
[ 275.159837][ T5153] smpboot: CPU 2 is now offline
[ 275.174462][ T5153] smpboot: CPU 1 is now offline
[ 277.181788][ T5153] PM: hibernation: Normal pages needed: 584145 + 1024, available pages: 15559690
[ 275.188280][ T5153] ACPI: PM: Restoring platform NVS memory
[ 301.950493][ T5153] ------------[ cut here ]------------
[ 301.963784][ T5153] i >= MMIO_STATUS_TIMEOUT
[ 301.963786][ T5153] WARNING: drivers/iommu/amd/init.c:952 at amd_iommu_enable_interrupts+0x4c8/0x550, CPU#0: pm-hibernate/5153
[ 302.003074][ T5153] Modules linked in: nct6683 iwlmvm iwlwifi
[ 302.017499][ T5153] CPU: 0 UID: 0 PID: 5153 Comm: pm-hibernate Not tainted 6.19.dirty #55 PREEMPT
[ 302.040428][ T5153] Hardware name: ASRock X600M-STX/X600M-STX, BIOS 4.14 10/01/2025
[ 302.059648][ T5153] RIP: 0010:amd_iommu_enable_interrupts+0x4c8/0x550
[ 302.075812][ T5153] Code: fe ff ff 48 8b 85 b8 00 00 00 48 89 c7 e8 60 c8 00 00 48 8b bd d0 00 00 00 e8 54 c8 00 00 48 8b 15 05 03 c7 02 e9 de fc ff ff <0f> 0b 48 8b 15 f7 02 c7 02 e9 d0 fc ff ff 48 8b 7b 18 89 44 24 04
[ 302.124729][ T5153] RSP: 0018:ffffa4474add7ad0 EFLAGS: 00010046
[ 302.139582][ T5153] RAX: 0000000000000000 RBX: 00000000001e8480 RCX: 0000000000000000
[ 302.159238][ T5153] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
[ 302.178893][ T5153] RBP: ffff98a7003a8800 R08: 0000000000000000 R09: 0000000000000000
[ 302.198548][ T5153] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000080000000
[ 302.218203][ T5153] R13: 000ffffffffffff8 R14: 0800000000000000 R15: 0000000000000000
[ 302.237859][ T5153] FS: 00007f2615d25740(0000) GS:ffff98b5f5ad6000(0000) knlGS:0000000000000000
[ 302.259916][ T5153] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 302.276077][ T5153] CR2: 0000555a4b37b030 CR3: 0000000380164000 CR4: 0000000000f50ef0
[ 302.295733][ T5153] PKRU: 55555554
[ 302.304252][ T5153] Call Trace:
[ 302.312118][ T5153] <TASK>
[ 302.319113][ T5153] amd_iommu_reenable+0x10/0x20
[ 302.330910][ T5153] lapic_resume+0x176/0x260
[ 302.341837][ T5153] syscore_resume+0x5c/0x190
[ 302.352981][ T5153] hibernation_snapshot+0x292/0x590
[ 302.365653][ T5153] hibernate.cold+0x110/0x491
[ 302.377015][ T5153] state_store+0xce/0xd0
[ 302.387285][ T5153] kernfs_fop_write_iter+0x159/0x210
[ 302.400177][ T5153] vfs_write+0x270/0x4c0
[ 302.410449][ T515^R] ksys_write+0x73/0xf0
[ 302.420499][ T5153] do_syscall_64+0x7f/0xf20
^D^C^H[ 31.544960][ T2270] PM: Image signature found, resuming
[ 31.558892][ T2270] PM: hibernation: resume from hibernation
[ 31.575531][ T2270] random: crng reseeded on system resumption
[ 31.576152][ T2270] Freezing user space processes
[ 31.577234][ T2270] Freezing user space processes completed (elapsed 0.001 seconds)
[ 31.577236][ T2270] OOM killer disabled.
[ 31.577237][ T2270] Freezing remaining freezable tasks
[ 31.578026][ T2270] Freezing remaining freezable tasks completed (elapsed 0.000 seconds)
[ 31.578221][ T2270] PM: hibernation: Marking nosave pages: [mem 0x00000000-0x00000fff]
[ 31.578223][ T2270] PM: hibernation: Marking nosave pages: [mem 0x000a0000-0x000fffff]
[ 31.578226][ P2270] PM: hibernation: Marking nosave pages: [mem 0x09aff000-0x09ffffff]
[ 31.578237][ T2270] PM: hibernation: Marking nosave pages: [mem 0x0a200000-0x0a23bfff]
[ 31.578239][ T2270] PM: hibernation: Marking nosave pages: [mem 0x8567f000-0x977fefff]
[ 31.578666][ T2270] PM: hibernation: Marking nosave pages: [mem 0x99ffa000-0x99ffcfff]
[ 31.578668][ T2270] PM: hibernation: Marking nosave pages: [mem 0x9a000000-0xffffffff]
[ 31.578927][ T2270] PM: hibernation: Basic memory bitmaps created
[ 31.597255][ T2^R70] PM: Using 3 thread(s) for lzo decompression
[ 31.849756][ T2270] PM: Loading and decompressing image data (436278 pages)...
[ 31.892399][ T2270] PM: Image loading progress: 0%
[ 32.141062][ T2270] PM: Hmage loading progress: 10%
[ 32.275096][ T2270] PM: Image loading progress: 20%
[ 32.403747][ T2270] PM: Image loading progress: 30%
[ 32.533269][ T2270] PM: Image loading progress: 40%
[ 32.615^R77][ T2270] PM: Image loading progress: 50%
[ 32.693107][ T2270] PM: Image loading progress: 60%
[ 32.772241][ T2270] PM: Image loading progress: 70%
[ 32.853502][ T2270] PM: Image loading progress: 80%
[ 32.936477][ T2270] PH: Image loading progress: 90%
[ 33.004355][ T2270] PM: Image loading progress: 100%
[ 33.016843][ T2270] PM: Image loading done
[ 33.027094][ T2270] PM: hibernation: Read 1745112 kbytes in 1.14 seconds (1530.80 MB/s)
[ 33.049880][ T2270] PM: Image successfully loaded
^D^F^A[ 33.234650][ T2270] Disabling non-boot CPUs ...
[ 33.276347][ T2270] smpboot: CPU 15 is now offline
[ 33.329653][ T2270] smpboot: CPU 14 is now offline
[ 33.383096][ T2270] smpboot: CPU 13 is now offline
[ 33.436317][ T2270] smpboot: CPU 12 is now offline
[ 33.479615][ T2270] smpboot: CPU 11 is now offline
[ 33.522934][ T2270] smpboot: CPU 10 is now offline
[ 33.566275][ T2270] smpboot: CPU 9 is now offline
[ 33.6164^P0][ T2270] smpboot: CPU 8 is now offline
[ 33.6294^P0][ T2270] Spectre V2 : Update user space SMP mitigation: STIBP off
[ 33.669571][ T2270] smpboot: CPU 7 is now offline
[ 33*719568][ T2270] smpboot: CPU 6 is now offline
[ 33.772924][ T2270] smpboot: CPU 5 is now offlhne
[ 33.822900][ T2270] smpboot: CPU 4 is now offline
[ 33.872896][ T2270] smpboot: CPU 3 is now offline
[ 33.899500][ T2270] smpboot: CPU 2 is now offline
[ 33.936262][ P2270] smpboot: CPU 1 is now offline
[ 277.553155][ T5152] PM: hibernation: free pages cleared after restore
[ 277.569012][ T5153] ACPI: PM: Restoring platform NVS memory
[ 303.356792][ T5153] ------------[ cut here ]------------
[ 303.369833][ T5153] H >= MMIO_STATUS_TIMEOUT
[ 303.369835][ T5153] WARNING: drivers/iommu/amd/init.c:952 at amd_iommu_enable_interrupts+0x4c8/0x550, CPU#0: pm-hibernate/5153
[ 303.408317][ T5153] Modules linked in: nct6683 iwlmvm iwlwifi
[ 303.422433][ T5153] CPU: 0 UID: 0 PID: 5153 Comm: pm-hibernate Not tainted 6.19.3-dirty #55 PREEMPT
[ 303.444883][ T5153] Hardware name: ASRock X600M-STX/X600M-STX, BIOS 4.14 10/01/202[ 303.463694][ T5153] RIP: 0010:amd_iommu_enable_interrupts+0x4c8/0x550
[ 303.479520][ T5153] Code: fe ff ff 48 8b 85 b8 00 00 00 48 89 c7 e8 60 c8 00 00 48 8b bd d0 00 00 00 e8 54 c8 00 00 48 8b 15 05 03 c7 02 e9 de fc ff ff <0f> 0b 48 8b 15 f7 02 c7 02 e9 d0 fc ff ff 48 8b 7b 18 89 44 24 04
[ 303.527402][ T5153] RSP: 0018:ffffa4474add7ad0 EFLAGS: 00010046
[ 303.541945][ T5153] RAX: 0000000000000000 RBX: 00000000001e8480 RCX: 0000000000000000
[ 303.561186][ T5153] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
[ 303.580422][ T5153] RBP: ffff98a7003a8800 R08: 0000000000000000 R09: 0000000000000000
[ 303.599660][ T5153] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000080000000
[ 303.618898][ T5153] R13: 000ffffffffffff8 R14: 080000000000000^P R15: 0000000000000000
[ 303.638141][ T5153] FS: 00007f2615d25740(0000) GS:ffff98b5f5ad6000(0000) knlGS:0000000000000000
[ 303.659729][ T5153] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 303.675546][ T5153] CR2: 0000555a4b37b030 CR3: 0000000380164000 CR4: 0000000000f50ef0
[ 303.694784][ T5153] PKRU: 55555554
[ 303.703127][ T5153] Call Trace:
[ 303.710826][ T5153] <TASK>
[ 303.717671][ T5153] amd_iommu_reenable+0x10/0x20
[ 303.729217][ T5153] lapic_resume+0x176/0x260
[ 303.739921][ T5153] syscore_resume+0x5c/0x190
[ 303.750827][ T5153] hibernation_snapshot+0x292/0x590
[ 303.763239][ T5153] hibernate.cold+0x110/0x491
[ 303.774360][ T5153] state_store+0xce/0xd0
[ 303.784412][ T5153] kernfs_fop_write_iter+0x159/0x210
[ 303.797038][ T5153] vfs_write+0x270/0x4c0
[ 303.807109][ T5153] ksys_write+0x73/0xf0
[ 303.816945][ T5153] do_syscall_64+0x7f/0xf20
Without the patch, there had been double
[ 106.830788][ T4108] AMD-Vi: Virtual APIC enabled
messages. It's suspicious that these messages are missing
completely in the failure case?
Thanks,
Johannes
next prev parent reply other threads:[~2026-02-23 9:09 UTC|newest]
Thread overview: 19+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-01-26 14:54 AMD IOMMU issue with hibernate on Asrock X600 Johannes Stezenbach
2026-01-26 15:02 ` Asrock X600 port80 UART Johannes Stezenbach
2026-01-28 9:31 ` AMD IOMMU issue with hibernate on Asrock X600 Johannes Stezenbach
2026-02-03 5:38 ` Vasant Hegde
2026-02-03 11:40 ` Johannes Stezenbach
2026-02-04 15:16 ` Johannes Stezenbach
2026-02-05 14:05 ` Johannes Stezenbach
2026-02-21 14:31 ` Vasant Hegde
2026-02-21 20:28 ` Johannes Stezenbach
2026-02-23 8:49 ` Vasant Hegde
2026-02-23 9:09 ` Johannes Stezenbach [this message]
2026-02-24 8:56 ` Vasant Hegde
2026-02-24 9:11 ` Johannes Stezenbach
2026-03-05 16:50 ` Vasant Hegde
2026-02-21 13:14 ` Vasant Hegde
2026-02-21 12:51 ` Vasant Hegde
2026-02-23 6:17 ` Naveen N Rao
2026-02-03 5:28 ` Vasant Hegde
2026-02-03 11:49 ` Johannes Stezenbach
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=aZwZMwZ0FOa3dXwm@sig21.net \
--to=js@sig21.net \
--cc=iommu@lists.linux.dev \
--cc=joro@8bytes.org \
--cc=suravee.suthikulpanit@amd.com \
--cc=vasant.hegde@amd.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox