Linux USB
 help / color / mirror / Atom feed
* IBM Power S822LC: pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
@ 2026-05-06 16:06 Paul Menzel
  2026-05-06 17:30 ` Michal Pecio
  0 siblings, 1 reply; 7+ messages in thread
From: Paul Menzel @ 2026-05-06 16:06 UTC (permalink / raw)
  To: Mathias Nyman, Greg Kroah-Hartman; +Cc: linux-usb, LKML

[-- Attachment #1: Type: text/plain, Size: 2188 bytes --]

Dear Linux folks,


On the IBM Power S822LC (8335-GCA POWER8), rebooting into Linux 7.1-rc2+ 
with kexec results in the warning below:

     [    0.000000] Linux version 7.1.0-rc2+ (x@b) (gcc (Ubuntu 
11.2.0-7ubuntu2) 11.2.0, GNU ld (GNU Binutils for Ubuntu) 2.37) #3 SMP 
PREEMPT Wed May  6 08:50:5
     […]
     [    0.000000] Hardware name: 8335-GCA POWER8 (raw) 0x4d0200 
opal:skiboot-5.4.8-5787ad3 PowerNV
     […]
     [    1.593760] NET: Registered PF_UNIX/PF_LOCAL protocol family
     [    1.593859] pci 0021:0d:00.0: enabling device (0140 -> 0142)
     [    1.627080] pci 0021:0d:00.0: xHCI HW did not halt within 32000 
usec status = 0x0
     [    1.627094] pci 0021:0d:00.0: quirk_usb_early_handoff+0x0/0x300 
took 32465 usecs
     [    1.627123] PCI: CLS 0 bytes, default 128
     […]

I built:

     $ git log --oneline --no-decorate  -1
     74fe02ce122a Merge tag 'wq-for-7.1-rc2-fixes' of 
git://git.kernel.org/pub/scm/linux/kernel/git/tj/wq

The warning is from `drivers/usb/host/pci-quirks.c`:

     /*
      * PCI Quirks for xHCI.
      *
      * Takes care of the handoff between the Pre-OS (i.e. BIOS) and the OS.
      * It signals to the BIOS that the OS wants control of the host 
controller,
      * and then waits 1 second for the BIOS to hand over control.
      * If we timeout, assume the BIOS is broken and take control anyway.
      */
     static void quirk_usb_handoff_xhci(struct pci_dev *pdev)
     {
     […]
             /* Wait for the HC to halt - poll every 125 usec (one 
microframe). */
             timeout = handshake(op_reg_base + XHCI_STS_OFFSET, 
XHCI_STS_HALT, 1,
                             XHCI_MAX_HALT_USEC, 125);
             if (timeout) {
                     val = readl(op_reg_base + XHCI_STS_OFFSET);
                     dev_warn(&pdev->dev,
                              "xHCI HW did not halt within %d usec 
status = 0x%x\n",
                              XHCI_MAX_HALT_USEC, val);
             }
     […]

In the kexec case, Linux runs before. I am able to reproduce it also 
when running 7.1-rc2+, and then kexec’ing into the same Linux kernel.

Please find the output of `dmesg` attached.


Kind regards,

Paul

[-- Attachment #2: 20260506--linux-7.10.0-rc2+-74fe02ce122a--messages.txt --]
[-- Type: text/plain, Size: 84279 bytes --]

[    0.000000] hash-mmu: Page sizes from device-tree:
[    0.000000] hash-mmu: base_shift=12: shift=12, sllp=0x0000, avpnm=0x00000000, tlbiel=1, penc=0
[    0.000000] hash-mmu: base_shift=12: shift=16, sllp=0x0000, avpnm=0x00000000, tlbiel=1, penc=7
[    0.000000] hash-mmu: base_shift=12: shift=24, sllp=0x0000, avpnm=0x00000000, tlbiel=1, penc=56
[    0.000000] hash-mmu: base_shift=16: shift=16, sllp=0x0110, avpnm=0x00000000, tlbiel=1, penc=1
[    0.000000] hash-mmu: base_shift=16: shift=24, sllp=0x0110, avpnm=0x00000000, tlbiel=1, penc=8
[    0.000000] hash-mmu: base_shift=20: shift=20, sllp=0x0130, avpnm=0x00000000, tlbiel=0, penc=2
[    0.000000] hash-mmu: base_shift=24: shift=24, sllp=0x0100, avpnm=0x00000001, tlbiel=0, penc=0
[    0.000000] hash-mmu: base_shift=34: shift=34, sllp=0x0120, avpnm=0x000007ff, tlbiel=0, penc=3
[    0.000000] Enabling pkeys with max key count 32
[    0.000000] Activating Kernel Userspace Access Prevention
[    0.000000] Activating Kernel Userspace Execution Prevention
[    0.000000] hash-mmu: Page orders: linear mapping = 24, virtual = 16, io = 16, vmemmap = 24
[    0.000000] hash-mmu: Using 1TB segments
[    0.000000] hash-mmu: Initializing hash mmu with SLB
[    0.000000] Linux version 7.1.0-rc2+ (pmenzel@flughafenberlinbrandenburgwillybrandt.molgen.mpg.de) (gcc (Ubuntu 11.2.0-7ubuntu2) 11.2.0, GNU ld (GNU Binutils for Ubuntu) 2.37) #3 SMP PREEMPT Wed May  6 08:50:58 CEST 2026
[    0.000000] OF: reserved mem: 0x0000000039c00000..0x000000003a7801ff (11776 KiB) map non-reusable ibm,firmware-allocs-memory@39c00000
[    0.000000] OF: reserved mem: 0x0000008000000000..0x0000008000c401ff (12544 KiB) map non-reusable ibm,firmware-allocs-memory@8000000000
[    0.000000] OF: reserved mem: 0x0000000030000000..0x00000000302fffff (3072 KiB) map non-reusable ibm,firmware-code@30000000
[    0.000000] OF: reserved mem: 0x0000000031000000..0x0000000031bfffff (12288 KiB) map non-reusable ibm,firmware-data@31000000
[    0.000000] OF: reserved mem: 0x0000000030300000..0x0000000030ffffff (13312 KiB) map non-reusable ibm,firmware-heap@30300000
[    0.000000] OF: reserved mem: 0x0000000031c00000..0x0000000032ddffff (18304 KiB) map non-reusable ibm,firmware-stacks@31c00000
[    0.000000] OF: reserved mem: 0x000000fffd440000..0x000000fffd6bffff (2560 KiB) map non-reusable ibm,hbrt-code-image@fffd440000
[    0.000000] OF: reserved mem: 0x000000fffd6c0000..0x000000fffd6fffff (256 KiB) map non-reusable ibm,hbrt-target-image@fffd6c0000
[    0.000000] OF: reserved mem: 0x000000fffd700000..0x000000fffd7fffff (1024 KiB) map non-reusable ibm,hbrt-vpd-image@fffd700000
[    0.000000] OF: reserved mem: 0x000000fffd800000..0x000000fffdbfffff (4096 KiB) map non-reusable ibm,homer-image@fffd800000
[    0.000000] OF: reserved mem: 0x000000fffdc00000..0x000000fffdffffff (4096 KiB) map non-reusable ibm,homer-image@fffdc00000
[    0.000000] OF: reserved mem: 0x000000ffff800000..0x000000ffffffffff (8192 KiB) map non-reusable ibm,occ-common-area@ffff800000
[    0.000000] Found initrd at 0xc000000005680000:0xc000000008a34449
[    0.000000] OPAL: Found non-mapped LPC bus on chip 0
[    0.000000] Hardware name: 8335-GCA POWER8 (raw) 0x4d0200 opal:skiboot-5.4.8-5787ad3 PowerNV
[    0.000000] printk: legacy bootconsole [udbg0] enabled
[    0.000000] CPU maps initialized for 8 threads per core
[    0.000000]  (thread shift is 3)
[    0.000000] Allocated 5760 bytes for 160 pacas
[    0.000000] -----------------------------------------------------
[    0.000000] phys_mem_size     = 0x10000000000
[    0.000000] dcache_bsize      = 0x80
[    0.000000] icache_bsize      = 0x80
[    0.000000] cpu_features      = 0x000000fb8f5db187
[    0.000000]   possible        = 0x003ffbfbcf5fb187
[    0.000000]   always          = 0x0000000380008181
[    0.000000] cpu_user_features = 0xdc0065c2 0xef000000
[    0.000000] mmu_features      = 0x7c006e01
[    0.000000]   possible        = 0x00000000fe00fe41
[    0.000000]   always          = 0x0000000000000000
[    0.000000] firmware_features = 0x0000000110000000
[    0.000000] vmalloc start     = 0xc008000000000000
[    0.000000] IO start          = 0xc00a000000000000
[    0.000000] vmemmap start     = 0xc00c000000000000
[    0.000000] hash-mmu: ppc64_pft_size    = 0x0
[    0.000000] hash-mmu: htab_hash_mask    = 0x7fffff
[    0.000000] -----------------------------------------------------
[    0.000000] NODE_DATA(0) allocated [mem 0x7fff934780-0x7fff93bfff]
[    0.000000] NODE_DATA(8) allocated [mem 0xffff07d880-0xffff0850ff]
[    0.000000] rfi-flush: ori type flush available
[    0.000000] rfi-flush: patched 13 locations (ori type flush)
[    0.000000] count-cache-flush: flush disabled.
[    0.000000] link-stack-flush: software flush enabled.
[    0.000000] entry-flush: patched 61 locations (no flush)
[    0.000000] uaccess-flush: patched 1 locations (no flush)
[    0.000000] stf-barrier: hwsync barrier available
[    0.000000] stf-barrier: patched 61 entry locations (hwsync barrier)
[    0.000000] stf-barrier: patched 13 exit locations (hwsync barrier)
[    0.000000] OPAL nvram setup, 589824 bytes
[    0.000000] barrier-nospec: using ORI speculation barrier
[    0.000000] barrier-nospec: patched 298 locations
[    0.000000] Top of RAM: 0x10000000000, Total RAM: 0x10000000000
[    0.000000] Memory hole size: 0MB
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000000000000-0x000000ffffffffff]
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x0000007fffffffff]
[    0.000000]   node   8: [mem 0x0000008000000000-0x000000ffffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x0000007fffffffff]
[    0.000000] Initmem setup node 8 [mem 0x0000008000000000-0x000000ffffffffff]
[    0.000000] percpu: Embedded 3 pages/cpu s126744 r0 d69864 u262144
[    0.000000] pcpu-alloc: s126744 r0 d69864 u262144 alloc=1*1048576
[    0.000000] pcpu-alloc: [0] 000 001 002 003 [0] 004 005 006 007 
[    0.000000] pcpu-alloc: [0] 008 009 010 011 [0] 012 013 014 015 
[    0.000000] pcpu-alloc: [0] 016 017 018 019 [0] 020 021 022 023 
[    0.000000] pcpu-alloc: [0] 024 025 026 027 [0] 028 029 030 031 
[    0.000000] pcpu-alloc: [0] 032 033 034 035 [0] 036 037 038 039 
[    0.000000] pcpu-alloc: [0] 040 041 042 043 [0] 044 045 046 047 
[    0.000000] pcpu-alloc: [0] 048 049 050 051 [0] 052 053 054 055 
[    0.000000] pcpu-alloc: [0] 056 057 058 059 [0] 060 061 062 063 
[    0.000000] pcpu-alloc: [0] 064 065 066 067 [0] 068 069 070 071 
[    0.000000] pcpu-alloc: [0] 072 073 074 075 [0] 076 077 078 079 
[    0.000000] pcpu-alloc: [1] 080 081 082 083 [1] 084 085 086 087 
[    0.000000] pcpu-alloc: [1] 088 089 090 091 [1] 092 093 094 095 
[    0.000000] pcpu-alloc: [1] 096 097 098 099 [1] 100 101 102 103 
[    0.000000] pcpu-alloc: [1] 104 105 106 107 [1] 108 109 110 111 
[    0.000000] pcpu-alloc: [1] 112 113 114 115 [1] 116 117 118 119 
[    0.000000] pcpu-alloc: [1] 120 121 122 123 [1] 124 125 126 127 
[    0.000000] pcpu-alloc: [1] 128 129 130 131 [1] 132 133 134 135 
[    0.000000] pcpu-alloc: [1] 136 137 138 139 [1] 140 141 142 143 
[    0.000000] pcpu-alloc: [1] 144 145 146 147 [1] 148 149 150 151 
[    0.000000] pcpu-alloc: [1] 152 153 154 155 [1] 156 157 158 159 
[    0.000000] Kernel command line: root=UUID=2c3dd738-785a-469b-843e-9f0ba8b47b0d ro rootflags=subvol=@ quiet splash 
[    0.000000] Unknown kernel command line parameters "splash", will be passed to user space.
[    0.000000] printk: log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] printk: log_buf_len total cpu_extra contributions: 651264 bytes
[    0.000000] printk: log_buf_len min size: 131072 bytes
[    0.000000] printk: log buffer data + meta data: 1048576 + 4456448 = 5505024 bytes
[    0.000000] printk: early log buf free: 123808(94%)
[    0.000000] kvm_cma_reserve: reserving 52428 MiB for global area
[    0.000000] cma: Reserved 52428 MiB at 0x0000000100000000
[    0.000000] Fallback order for Node 0: 0 8 
[    0.000000] Fallback order for Node 8: 8 0 
[    0.000000] Built 2 zonelists, mobility grouping on.  Total pages: 16777216
[    0.000000] Policy zone: Normal
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] stackdepot: allocating hash table via alloc_large_system_hash
[    0.000000] stackdepot hash table entries: 1048576 (order: 8, 16777216 bytes, linear)
[    0.000000] stackdepot: allocating space for 8191 stack pools via memblock
[    0.000000] SLUB: HWalign=128, Order=0-3, MinObjects=0, CPUs=160, Nodes=9
[    0.000000] ftrace: allocating 51243 entries in 13 pages
[    0.000000] ftrace: allocated 13 pages with 3 groups
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=2048 to nr_cpu_ids=160.
[    0.000000] 	Trampoline variant of Tasks RCU enabled.
[    0.000000] 	Rude variant of Tasks RCU enabled.
[    0.000000] 	Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=160
[    0.000000] RCU Tasks: Setting shift to 8 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=160.
[    0.000000] RCU Tasks Rude: Setting shift to 8 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=160.
[    0.000000] NR_IRQS: 512, nr_irqs: 512, preallocated irqs: 16
[    0.000000] ICS OPAL backend registered
[    0.000000] rcu: srcu_init: Setting srcu_struct sizes to big.
[    0.000000] time_init: decrementer frequency = 512.000000 MHz
[    0.000000] time_init: processor frequency   = 2926.000000 MHz
[    0.000001] clocksource: timebase: mask: 0xffffffffffffffff max_cycles: 0x761537d007, max_idle_ns: 440795202126 ns
[    0.000012] clocksource: timebase mult[1f40000] shift[24] registered
[    0.000026] clockevent: decrementer mult[83126e98] shift[32] cpu[0]
[    0.006585] Console: colour dummy device 80x25
[    0.006747] printk: legacy console [hvc0] enabled
[    0.006756] printk: legacy bootconsole [udbg0] disabled
[    0.017250] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.017275] pid_max: default: 163840 minimum: 1280
[    0.142947] Yama: becoming mindful.
[    0.142975] SELinux:  Initializing.
[    0.198807] TOMOYO Linux initialized
[    0.233462] Dentry cache hash table entries: 33554432 (order: 12, 268435456 bytes, vmalloc)
[    0.246051] Inode-cache hash table entries: 16777216 (order: 11, 134217728 bytes, vmalloc)
[    0.252805] Mount-cache hash table entries: 524288 (order: 6, 4194304 bytes, vmalloc)
[    0.253238] Mountpoint-cache hash table entries: 524288 (order: 6, 4194304 bytes, vmalloc)
[    0.259651] VFS: Finished mounting rootfs on nullfs
[    0.304680] POWER8 performance monitor hardware support registered
[    0.305353] rcu: Hierarchical SRCU implementation.
[    0.305359] rcu: 	Max phase no-delay instances is 1000.
[    0.305652] Timer migration: 4 hierarchy levels; 8 children per group; 3 crossnode level
[    0.317377] smp: Bringing up secondary CPUs ...
[    0.679222] smp: Brought up 2 nodes, 160 CPUs
[    0.679244] numa: Node 0 CPUs: 0-79
[    0.679270] numa: Node 8 CPUs: 80-159
[    0.723053] Memory: 1017008576K/1073741824K available (22080K kernel code, 3392K rwdata, 10688K rodata, 8768K init, 4181K bss, 2474688K reserved, 53690368K cma-reserved)
[    0.758408] devtmpfs: initialized
[    1.110158] Initializing IODA2 PHB (/pciex@3fffe40000000)
[    1.110330] PCI host bridge /pciex@3fffe40000000 (primary) ranges:
[    1.110361]  MEM 0x00003fe000000000..0x00003fe07ffeffff -> 0x0000000080000000 
[    1.110811]  MEM 0x0000200000000000..0x000020ffffffffff -> 0x0000200000000000 (M64 #0..15)
[    1.110826]  Using M64 #15 as default window
[    1.110891]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    1.110903]                  M64: 0x10000000000 [segment=0x100000000]
[    1.110919]   Allocated bitmap for 2040 MSIs (base IRQ 0x800)
[    1.112752] Initializing IODA2 PHB (/pciex@3fffe40100000)
[    1.112866] PCI host bridge /pciex@3fffe40100000  ranges:
[    1.112889]  MEM 0x00003fe080000000..0x00003fe0fffeffff -> 0x0000000080000000 
[    1.113314]  MEM 0x0000210000000000..0x000021ffffffffff -> 0x0000210000000000 (M64 #0..15)
[    1.113328]  Using M64 #15 as default window
[    1.113391]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    1.113402]                  M64: 0x10000000000 [segment=0x100000000]
[    1.113417]   Allocated bitmap for 2040 MSIs (base IRQ 0x1000)
[    1.115339] Initializing IODA2 PHB (/pciex@3fffe41000000)
[    1.115474] PCI host bridge /pciex@3fffe41000000  ranges:
[    1.115498]  MEM 0x00003fe800000000..0x00003fe87ffeffff -> 0x0000000080000000 
[    1.115924]  MEM 0x0000240000000000..0x000024ffffffffff -> 0x0000240000000000 (M64 #0..15)
[    1.115938]  Using M64 #15 as default window
[    1.115998]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    1.116009]                  M64: 0x10000000000 [segment=0x100000000]
[    1.116024]   Allocated bitmap for 2040 MSIs (base IRQ 0x10800)
[    1.117944] Initializing IODA2 PHB (/pciex@3fffe41100000)
[    1.118061] PCI host bridge /pciex@3fffe41100000  ranges:
[    1.118084]  MEM 0x00003fe880000000..0x00003fe8fffeffff -> 0x0000000080000000 
[    1.118510]  MEM 0x0000250000000000..0x000025ffffffffff -> 0x0000250000000000 (M64 #0..15)
[    1.118524]  Using M64 #15 as default window
[    1.118583]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    1.118594]                  M64: 0x10000000000 [segment=0x100000000]
[    1.118609]   Allocated bitmap for 2040 MSIs (base IRQ 0x11000)
[    1.120723] Initializing IODA2 PHB (/pciex@3fffe41200000)
[    1.120863] PCI host bridge /pciex@3fffe41200000  ranges:
[    1.120886]  MEM 0x00003fe900000000..0x00003fe97ffeffff -> 0x0000000080000000 
[    1.121311]  MEM 0x0000260000000000..0x000026ffffffffff -> 0x0000260000000000 (M64 #0..15)
[    1.121324]  Using M64 #15 as default window
[    1.121380]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    1.121391]                  M64: 0x10000000000 [segment=0x100000000]
[    1.121406]   Allocated bitmap for 2040 MSIs (base IRQ 0x11800)
[    1.125864] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    1.125939] posixtimers hash table entries: 131072 (order: 5, 2097152 bytes, vmalloc)
[    1.130038] futex hash table entries: 32768 (4194304 bytes on 2 NUMA nodes, total 8192 KiB, linear).
[    1.202258] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    1.204054] audit: initializing netlink subsys (disabled)
[    1.204585] audit: type=2000 audit(1778050876.196:1): state=initialized audit_enabled=0 res=1
[    1.208116] thermal_sys: Registered thermal governor 'fair_share'
[    1.208126] thermal_sys: Registered thermal governor 'bang_bang'
[    1.208135] thermal_sys: Registered thermal governor 'step_wise'
[    1.208144] thermal_sys: Registered thermal governor 'user_space'
[    1.208315] cpuidle: using governor ladder
[    1.208403] cpuidle: using governor menu
[    1.209675] pstore: Using crash dump compression: deflate
[    1.209685] pstore: Registered nvram as persistent store backend
[    1.214159] EEH: PowerNV platform initialized
[    1.406801] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    1.420321] HugeTLB: registered 16.0 MiB page size, pre-allocated 0 pages
[    1.420327] HugeTLB: 0 KiB vmemmap can be freed for a 16.0 MiB page
[    1.420332] HugeTLB: registered 16.0 GiB page size, pre-allocated 0 pages
[    1.420336] HugeTLB: 0 KiB vmemmap can be freed for a 16.0 GiB page
[    1.440032] iommu: Default domain type: Translated
[    1.440037] iommu: DMA domain TLB invalidation policy: strict mode
[    1.454595] SCSI subsystem initialized
[    1.455030] libata version 3.00 loaded.
[    1.455262] usbcore: registered new interface driver usbfs
[    1.455316] usbcore: registered new interface driver hub
[    1.455632] usbcore: registered new device driver usb
[    1.455794] pps_core: LinuxPPS API ver. 1 registered
[    1.455797] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    1.455815] PTP clock support registered
[    1.456560] EDAC MC: Ver: 3.0.0
[    1.459096] NetLabel: Initializing
[    1.459099] NetLabel:  domain hash size = 128
[    1.459102] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    1.459156] NetLabel:  unlabeled traffic allowed by default
[    1.459359] PCI: Probing PCI hardware
[    1.459637] PCI host bridge to bus 0000:00
[    1.459644] pci_bus 0000:00: root bus resource [mem 0x3fe000000000-0x3fe07ffeffff] (bus address [0x80000000-0xfffeffff])
[    1.459652] pci_bus 0000:00: root bus resource [mem 0x200000000000-0x20fdffffffff 64bit pref]
[    1.459658] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.459663] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to ff
[    1.459738] pci 0000:00:00.0: [1014:03dc] type 01 class 0x060400 PCIe Root Port
[    1.459783] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[    1.459923] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    1.462061] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[    1.462098] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to ff
[    1.462353] PCI host bridge to bus 0001:00
[    1.462359] pci_bus 0001:00: root bus resource [mem 0x3fe080000000-0x3fe0fffeffff] (bus address [0x80000000-0xfffeffff])
[    1.462365] pci_bus 0001:00: root bus resource [mem 0x210000000000-0x21fdffffffff 64bit pref]
[    1.462371] pci_bus 0001:00: root bus resource [bus 00-ff]
[    1.462375] pci_bus 0001:00: busn_res: [bus 00-ff] end is updated to ff
[    1.462427] pci 0001:00:00.0: [1014:03dc] type 01 class 0x060400 PCIe Root Port
[    1.462472] pci 0001:00:00.0: PCI bridge to [bus 01]
[    1.462489] pci 0001:00:00.0:   bridge window [mem 0x3fe080000000-0x3fe0ffefffff]
[    1.462509] pci 0001:00:00.0:   bridge window [mem 0x210000000000-0x21fdffffffff 64bit pref]
[    1.462612] pci 0001:00:00.0: PME# supported from D0 D3hot D3cold
[    1.464691] pci 0001:01:00.0: [14e4:168a] type 00 class 0x020000 PCIe Endpoint
[    1.464773] pci 0001:01:00.0: BAR 0 [mem 0x210000000000-0x2100007fffff 64bit pref]
[    1.464783] pci 0001:01:00.0: BAR 2 [mem 0x210000800000-0x210000ffffff 64bit pref]
[    1.464791] pci 0001:01:00.0: BAR 4 [mem 0x210004000000-0x21000400ffff 64bit pref]
[    1.464798] pci 0001:01:00.0: ROM [mem 0x00000000-0x0003ffff pref]
[    1.465017] pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
[    1.477309] pci 0001:01:00.1: [14e4:168a] type 00 class 0x020000 PCIe Endpoint
[    1.477383] pci 0001:01:00.1: BAR 0 [mem 0x210001000000-0x2100017fffff 64bit pref]
[    1.477391] pci 0001:01:00.1: BAR 2 [mem 0x210001800000-0x210001ffffff 64bit pref]
[    1.477398] pci 0001:01:00.1: BAR 4 [mem 0x210004010000-0x21000401ffff 64bit pref]
[    1.477403] pci 0001:01:00.1: ROM [mem 0x00000000-0x0003ffff pref]
[    1.477606] pci 0001:01:00.1: PME# supported from D0 D3hot D3cold
[    1.489280] pci 0001:01:00.2: [14e4:168a] type 00 class 0x020000 PCIe Endpoint
[    1.489354] pci 0001:01:00.2: BAR 0 [mem 0x210002000000-0x2100027fffff 64bit pref]
[    1.489361] pci 0001:01:00.2: BAR 2 [mem 0x210002800000-0x210002ffffff 64bit pref]
[    1.489369] pci 0001:01:00.2: BAR 4 [mem 0x210004020000-0x21000402ffff 64bit pref]
[    1.489374] pci 0001:01:00.2: ROM [mem 0x00000000-0x0003ffff pref]
[    1.489577] pci 0001:01:00.2: PME# supported from D0 D3hot D3cold
[    1.501284] pci 0001:01:00.3: [14e4:168a] type 00 class 0x020000 PCIe Endpoint
[    1.501359] pci 0001:01:00.3: BAR 0 [mem 0x210003000000-0x2100037fffff 64bit pref]
[    1.501367] pci 0001:01:00.3: BAR 2 [mem 0x210003800000-0x210003ffffff 64bit pref]
[    1.501374] pci 0001:01:00.3: BAR 4 [mem 0x210004030000-0x21000403ffff 64bit pref]
[    1.501379] pci 0001:01:00.3: ROM [mem 0x00000000-0x0003ffff pref]
[    1.501585] pci 0001:01:00.3: PME# supported from D0 D3hot D3cold
[    1.513259] pci 0001:01:00.0: ASPM: default states L0s
[    1.513365] pci 0001:00:00.0: PCI bridge to [bus 01]
[    1.513396] pci_bus 0001:00: busn_res: [bus 00-ff] end is updated to 01
[    1.513550] PCI host bridge to bus 0020:00
[    1.513555] pci_bus 0020:00: root bus resource [mem 0x3fe800000000-0x3fe87ffeffff] (bus address [0x80000000-0xfffeffff])
[    1.513559] pci_bus 0020:00: root bus resource [mem 0x240000000000-0x24fdffffffff 64bit pref]
[    1.513564] pci_bus 0020:00: root bus resource [bus 00-ff]
[    1.513567] pci_bus 0020:00: busn_res: [bus 00-ff] end is updated to ff
[    1.513614] pci 0020:00:00.0: [1014:03dc] type 01 class 0x060400 PCIe Root Port
[    1.513655] pci 0020:00:00.0: PCI bridge to [bus 01-ff]
[    1.513784] pci 0020:00:00.0: PME# supported from D0 D3hot D3cold
[    1.515649] pci 0020:00:00.0: PCI bridge to [bus 01-ff]
[    1.515683] pci_bus 0020:00: busn_res: [bus 00-ff] end is updated to ff
[    1.519571] PCI host bridge to bus 0021:00
[    1.519576] pci_bus 0021:00: root bus resource [mem 0x3fe880000000-0x3fe8fffeffff] (bus address [0x80000000-0xfffeffff])
[    1.519582] pci_bus 0021:00: root bus resource [mem 0x250000000000-0x25fdffffffff 64bit pref]
[    1.519586] pci_bus 0021:00: root bus resource [bus 00-ff]
[    1.519589] pci_bus 0021:00: busn_res: [bus 00-ff] end is updated to ff
[    1.519637] pci 0021:00:00.0: [1014:03dc] type 01 class 0x060400 PCIe Root Port
[    1.519681] pci 0021:00:00.0: PCI bridge to [bus 01-15]
[    1.519697] pci 0021:00:00.0:   bridge window [mem 0x3fe880000000-0x3fe8ffefffff]
[    1.519716] pci 0021:00:00.0:   bridge window [mem 0x250000000000-0x25fdffffffff 64bit pref]
[    1.519815] pci 0021:00:00.0: PME# supported from D0 D3hot D3cold
[    1.521678] pci 0021:01:00.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Upstream Port
[    1.521723] pci 0021:01:00.0: BAR 0 [mem 0x3fe883800000-0x3fe88383ffff]
[    1.521732] pci 0021:01:00.0: PCI bridge to [bus 02-15]
[    1.521749] pci 0021:01:00.0:   bridge window [mem 0x3fe880000000-0x3fe8ffefffff]
[    1.521770] pci 0021:01:00.0:   bridge window [mem 0x250000000000-0x25fdffffffff 64bit pref]
[    1.521999] pci 0021:01:00.0: PME# supported from D0 D3hot D3cold
[    1.522389] pci 0021:01:00.1: [10b5:87d0] type 00 class 0x088000 PCIe Endpoint
[    1.522459] pci 0021:01:00.1: BAR 0 [mem 0x3fe883840000-0x3fe883841fff]
[    1.522524] pci 0021:01:00.1: BAR 0 [mem size 0x00002000]: requesting alignment to 0x10000
[    1.522886] pci 0021:01:00.2: [10b5:87d0] type 00 class 0x088000 PCIe Endpoint
[    1.522956] pci 0021:01:00.2: BAR 0 [mem 0x3fe883850000-0x3fe883851fff]
[    1.523022] pci 0021:01:00.2: BAR 0 [mem size 0x00002000]: requesting alignment to 0x10000
[    1.523384] pci 0021:01:00.3: [10b5:87d0] type 00 class 0x088000 PCIe Endpoint
[    1.523455] pci 0021:01:00.3: BAR 0 [mem 0x3fe883860000-0x3fe883861fff]
[    1.523520] pci 0021:01:00.3: BAR 0 [mem size 0x00002000]: requesting alignment to 0x10000
[    1.523884] pci 0021:01:00.4: [10b5:87d0] type 00 class 0x088000 PCIe Endpoint
[    1.523956] pci 0021:01:00.4: BAR 0 [mem 0x3fe883870000-0x3fe883871fff]
[    1.524021] pci 0021:01:00.4: BAR 0 [mem size 0x00002000]: requesting alignment to 0x10000
[    1.524358] pci 0021:00:00.0: PCI bridge to [bus 01-15]
[    1.524625] pci 0021:02:01.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.524677] pci 0021:02:01.0: PCI bridge to [bus 03-07]
[    1.524695] pci 0021:02:01.0:   bridge window [mem 0x3fe880000000-0x3fe8807fffff]
[    1.524717] pci 0021:02:01.0:   bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]
[    1.524966] pci 0021:02:01.0: PME# supported from D0 D3hot D3cold
[    1.525685] pci 0021:02:08.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.525738] pci 0021:02:08.0: PCI bridge to [bus 08-0c]
[    1.526021] pci 0021:02:08.0: PME# supported from D0 D3hot D3cold
[    1.526435] pci 0021:02:09.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.526489] pci 0021:02:09.0: PCI bridge to [bus 0d]
[    1.526507] pci 0021:02:09.0:   bridge window [mem 0x3fe880800000-0x3fe880ffffff]
[    1.526772] pci 0021:02:09.0: PME# supported from D0 D3hot D3cold
[    1.527185] pci 0021:02:0a.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.527239] pci 0021:02:0a.0: PCI bridge to [bus 0e]
[    1.527258] pci 0021:02:0a.0:   bridge window [mem 0x3fe881000000-0x3fe8817fffff]
[    1.527523] pci 0021:02:0a.0: PME# supported from D0 D3hot D3cold
[    1.527946] pci 0021:02:0b.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.528001] pci 0021:02:0b.0: PCI bridge to [bus 0f-10]
[    1.528019] pci 0021:02:0b.0:   bridge window [mem 0x3fe881800000-0x3fe882ffffff]
[    1.528287] pci 0021:02:0b.0: PME# supported from D0 D3hot D3cold
[    1.528711] pci 0021:02:0c.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.528767] pci 0021:02:0c.0: PCI bridge to [bus 11-15]
[    1.529060] pci 0021:02:0c.0: PME# supported from D0 D3hot D3cold
[    1.530316] pci 0021:01:00.0: PCI bridge to [bus 02-15]
[    1.530509] pci 0021:02:01.0: PCI bridge to [bus 03-07]
[    1.530706] pci 0021:02:08.0: PCI bridge to [bus 08-0c]
[    1.530945] pci 0021:0d:00.0: [104c:8241] type 00 class 0x0c0330 PCIe Endpoint
[    1.531038] pci 0021:0d:00.0: BAR 0 [mem 0x3fe880800000-0x3fe88080ffff 64bit]
[    1.531047] pci 0021:0d:00.0: BAR 2 [mem 0x3fe880810000-0x3fe880811fff 64bit]
[    1.531103] pci 0021:0d:00.0: BAR 2 [mem size 0x00002000 64bit]: requesting alignment to 0x10000
[    1.531221] pci 0021:0d:00.0: supports D1 D2
[    1.531223] pci 0021:0d:00.0: PME# supported from D0 D1 D2 D3hot
[    1.536985] pci 0021:0d:00.0: ASPM: default states L1
[    1.537033] pci 0021:02:09.0: PCI bridge to [bus 0d]
[    1.537264] pci 0021:0e:00.0: [1b4b:9235] type 00 class 0x010601 PCIe Legacy Endpoint
[    1.537352] pci 0021:0e:00.0: BAR 0 [io  0x8000-0x8007]
[    1.537358] pci 0021:0e:00.0: BAR 1 [io  0x8040-0x8043]
[    1.537364] pci 0021:0e:00.0: BAR 2 [io  0x8100-0x8107]
[    1.537369] pci 0021:0e:00.0: BAR 3 [io  0x8140-0x8143]
[    1.537375] pci 0021:0e:00.0: BAR 4 [io  0x800000-0x80001f]
[    1.537380] pci 0021:0e:00.0: BAR 5 [mem 0x3fe881000000-0x3fe8810007ff]
[    1.537386] pci 0021:0e:00.0: ROM [mem 0x3fe8d0000000-0x3fe8d000ffff pref]
[    1.537425] pci 0021:0e:00.0: Enabling fixed DMA alias to 00.1
[    1.537434] pci 0021:0e:00.0: BAR 5 [mem size 0x00000800]: requesting alignment to 0x10000
[    1.537538] pci 0021:0e:00.0: PME# supported from D3hot
[    1.545010] pci 0021:0e:00.0: ASPM: default states L1
[    1.545027] pci 0021:02:0a.0: PCI bridge to [bus 0e]
[    1.545263] pci 0021:0f:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge
[    1.545330] pci 0021:0f:00.0: PCI bridge to [bus 10]
[    1.545354] pci 0021:0f:00.0:   bridge window [mem 0x3fe881800000-0x3fe882ffffff]
[    1.545594] pci 0021:0f:00.0: supports D1 D2
[    1.545597] pci 0021:0f:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    1.545879] pci 0021:0f:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    1.545913] pci 0021:02:0b.0: PCI bridge to [bus 0f-10]
[    1.546030] pci_bus 0021:10: extended config space not accessible
[    1.546115] pci 0021:10:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint
[    1.546224] pci 0021:10:00.0: BAR 0 [mem 0x3fe882000000-0x3fe882ffffff]
[    1.546231] pci 0021:10:00.0: BAR 1 [mem 0x3fe881800000-0x3fe88181ffff]
[    1.546238] pci 0021:10:00.0: BAR 2 [io  0x0000-0x007f]
[    1.546352] pci 0021:10:00.0: supports D1 D2
[    1.546355] pci 0021:10:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    1.548013] pci 0021:0f:00.0: PCI bridge to [bus 10]
[    1.548229] pci 0021:02:0c.0: PCI bridge to [bus 11-15]
[    1.548339] pci_bus 0021:00: busn_res: [bus 00-ff] end is updated to 15
[    1.548504] PCI host bridge to bus 0022:00
[    1.548509] pci_bus 0022:00: root bus resource [mem 0x3fe900000000-0x3fe97ffeffff] (bus address [0x80000000-0xfffeffff])
[    1.548514] pci_bus 0022:00: root bus resource [mem 0x260000000000-0x26fdffffffff 64bit pref]
[    1.548525] pci_bus 0022:00: root bus resource [bus 00-ff]
[    1.548528] pci_bus 0022:00: busn_res: [bus 00-ff] end is updated to ff
[    1.548575] pci 0022:00:00.0: [1014:03dc] type 01 class 0x060400 PCIe Root Port
[    1.548616] pci 0022:00:00.0: PCI bridge to [bus 01-ff]
[    1.548747] pci 0022:00:00.0: PME# supported from D0 D3hot D3cold
[    1.550572] pci 0022:00:00.0: PCI bridge to [bus 01-ff]
[    1.550606] pci_bus 0022:00: busn_res: [bus 00-ff] end is updated to ff
[    1.550614] pci 0000:00:00.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 01-ff] (unused)
[    1.550618] pci 0000:00:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 01-ff] (unused)
[    1.550622] pci 0000:00:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff] to [bus 01-ff] (unused)
[    1.550627] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[    1.550644] pci_bus 0000:00: resource 4 [mem 0x3fe000000000-0x3fe07ffeffff]
[    1.550647] pci_bus 0000:00: resource 5 [mem 0x200000000000-0x20fdffffffff 64bit pref]
[    1.550650] pci_bus 0000:01: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    1.550653] pci_bus 0000:01: resource 1 [mem 0x00000000-0xffffffffffffffff disabled]
[    1.550656] pci_bus 0000:01: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.550660] pci 0001:00:00.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 01] (unused)
[    1.550684] pci 0001:00:00.0: bridge window [mem 0x00800000-0x007fffff] to [bus 01] add_size 800000 add_align 800000
[    1.550695] pci 0001:00:00.0: bridge window [mem 0x210000000000-0x2100ffffffff 64bit pref]: assigned
[    1.550699] pci 0001:00:00.0: bridge window [mem 0x3fe080000000-0x3fe0807fffff]: assigned
[    1.550740] pci 0001:01:00.0: BAR 0 [mem 0x210000000000-0x2100007fffff 64bit pref]: assigned
[    1.550763] pci 0001:01:00.0: BAR 2 [mem 0x210000800000-0x210000ffffff 64bit pref]: assigned
[    1.550786] pci 0001:01:00.1: BAR 0 [mem 0x210001000000-0x2100017fffff 64bit pref]: assigned
[    1.550808] pci 0001:01:00.1: BAR 2 [mem 0x210001800000-0x210001ffffff 64bit pref]: assigned
[    1.550829] pci 0001:01:00.2: BAR 0 [mem 0x210002000000-0x2100027fffff 64bit pref]: assigned
[    1.550852] pci 0001:01:00.2: BAR 2 [mem 0x210002800000-0x210002ffffff 64bit pref]: assigned
[    1.550875] pci 0001:01:00.3: BAR 0 [mem 0x210003000000-0x2100037fffff 64bit pref]: assigned
[    1.550898] pci 0001:01:00.3: BAR 2 [mem 0x210003800000-0x210003ffffff 64bit pref]: assigned
[    1.550920] pci 0001:01:00.0: ROM [mem 0x3fe080000000-0x3fe08003ffff pref]: assigned
[    1.550924] pci 0001:01:00.1: ROM [mem 0x3fe080040000-0x3fe08007ffff pref]: assigned
[    1.550927] pci 0001:01:00.2: ROM [mem 0x3fe080080000-0x3fe0800bffff pref]: assigned
[    1.550930] pci 0001:01:00.3: ROM [mem 0x3fe0800c0000-0x3fe0800fffff pref]: assigned
[    1.550934] pci 0001:01:00.0: BAR 4 [mem 0x210004000000-0x21000400ffff 64bit pref]: assigned
[    1.550956] pci 0001:01:00.1: BAR 4 [mem 0x210004010000-0x21000401ffff 64bit pref]: assigned
[    1.550978] pci 0001:01:00.2: BAR 4 [mem 0x210004020000-0x21000402ffff 64bit pref]: assigned
[    1.551001] pci 0001:01:00.3: BAR 4 [mem 0x210004030000-0x21000403ffff 64bit pref]: assigned
[    1.551036] pci 0001:00:00.0: PCI bridge to [bus 01]
[    1.551044] pci 0001:00:00.0:   bridge window [mem 0x3fe080000000-0x3fe0ffefffff]
[    1.551050] pci 0001:00:00.0:   bridge window [mem 0x210000000000-0x21fdfff0ffff 64bit pref]
[    1.551059] pci_bus 0001:00: resource 4 [mem 0x3fe080000000-0x3fe0fffeffff]
[    1.551062] pci_bus 0001:00: resource 5 [mem 0x210000000000-0x21fdffffffff 64bit pref]
[    1.551065] pci_bus 0001:01: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    1.551068] pci_bus 0001:01: resource 1 [mem 0x3fe080000000-0x3fe0ffefffff]
[    1.551070] pci_bus 0001:01: resource 2 [mem 0x210000000000-0x21fdfff0ffff 64bit pref]
[    1.551074] pci 0020:00:00.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 01-ff] (unused)
[    1.551077] pci 0020:00:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 01-ff] (unused)
[    1.551080] pci 0020:00:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff] to [bus 01-ff] (unused)
[    1.551084] pci 0020:00:00.0: PCI bridge to [bus 01-ff]
[    1.551101] pci_bus 0020:00: resource 4 [mem 0x3fe800000000-0x3fe87ffeffff]
[    1.551104] pci_bus 0020:00: resource 5 [mem 0x240000000000-0x24fdffffffff 64bit pref]
[    1.551107] pci_bus 0020:01: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    1.551109] pci_bus 0020:01: resource 1 [mem 0x00000000-0xffffffffffffffff disabled]
[    1.551112] pci_bus 0020:01: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.551118] pci 0021:02:01.0: bridge window [io  0x1000-0x0fff] to [bus 03-07] add_size 1000
[    1.551123] pci 0021:02:01.0: bridge window [mem 0x100000000-0xffffffff 64bit pref] to [bus 03-07] add_size 100000000 add_align 100000000
[    1.551129] pci 0021:02:01.0: bridge window [mem 0x00800000-0x007fffff] to [bus 03-07] add_size 800000 add_align 800000
[    1.551133] pci 0021:02:08.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 08-0c] (unused)
[    1.551136] pci 0021:02:08.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 08-0c] (unused)
[    1.551139] pci 0021:02:08.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff] to [bus 08-0c] (unused)
[    1.551143] pci 0021:02:09.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 0d] (unused)
[    1.551146] pci 0021:02:09.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 0d] (unused)
[    1.551150] pci 0021:02:0a.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 0e] (unused)
[    1.551156] pci 0021:0f:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 10] (unused)
[    1.551161] pci 0021:02:0b.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 0f-10] (unused)
[    1.551164] pci 0021:02:0c.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 11-15] (unused)
[    1.551168] pci 0021:02:0c.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 11-15] (unused)
[    1.551171] pci 0021:02:0c.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff] to [bus 11-15] (unused)
[    1.551176] pci 0021:01:00.0: bridge window [io  0x1000-0x2fff] to [bus 02-15] add_size 1000
[    1.551182] pci 0021:01:00.0: bridge window [mem 0x100000000-0xffffffff 64bit pref] to [bus 02-15] add_size 100000000 add_align 100000000
[    1.551189] pci 0021:01:00.0: bridge window [mem 0x00800000-0x02ffffff] to [bus 02-15] add_size 800000 add_align 800000
[    1.551195] pci 0021:00:00.0: bridge window [io  0x1000-0x2fff] to [bus 01-15] add_size 1000
[    1.551200] pci 0021:00:00.0: bridge window [mem 0x100000000-0xffffffff 64bit pref] to [bus 01-15] add_size 100000000 add_align 100000000
[    1.551207] pci 0021:00:00.0: bridge window [mem 0x00800000-0x037fffff] to [bus 01-15] add_size 800000 add_align 800000
[    1.551217] pci 0021:00:00.0: bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]: assigned
[    1.551220] pci 0021:00:00.0: bridge window [mem 0x3fe880000000-0x3fe8837fffff]: assigned
[    1.551224] pci 0021:00:00.0: bridge window [io  size 0x3000]: can't assign; no space
[    1.551227] pci 0021:00:00.0: bridge window [io  size 0x3000]: failed to assign
[    1.551234] pci 0021:00:00.0: bridge window [io  size 0x2000]: can't assign; no space
[    1.551237] pci 0021:00:00.0: bridge window [io  size 0x2000]: failed to assign
[    1.551258] pci 0021:01:00.0: bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]: assigned
[    1.551261] pci 0021:01:00.0: bridge window [mem 0x3fe880000000-0x3fe882ffffff]: assigned
[    1.551264] pci 0021:01:00.0: BAR 0 [mem 0x3fe883000000-0x3fe88303ffff]: assigned
[    1.551272] pci 0021:01:00.1: BAR 0 [mem 0x3fe883040000-0x3fe883041fff]: assigned
[    1.551279] pci 0021:01:00.2: BAR 0 [mem 0x3fe883050000-0x3fe883051fff]: assigned
[    1.551286] pci 0021:01:00.3: BAR 0 [mem 0x3fe883060000-0x3fe883061fff]: assigned
[    1.551294] pci 0021:01:00.4: BAR 0 [mem 0x3fe883070000-0x3fe883071fff]: assigned
[    1.551301] pci 0021:01:00.0: bridge window [io  size 0x3000]: can't assign; no space
[    1.551304] pci 0021:01:00.0: bridge window [io  size 0x3000]: failed to assign
[    1.551314] pci 0021:01:00.0: bridge window [io  size 0x2000]: can't assign; no space
[    1.551317] pci 0021:01:00.0: bridge window [io  size 0x2000]: failed to assign
[    1.551339] pci 0021:02:01.0: bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]: assigned
[    1.551342] pci 0021:02:0b.0: bridge window [mem 0x3fe880000000-0x3fe8817fffff]: assigned
[    1.551346] pci 0021:02:01.0: bridge window [mem 0x3fe881800000-0x3fe881ffffff]: assigned
[    1.551349] pci 0021:02:09.0: bridge window [mem 0x3fe882000000-0x3fe8827fffff]: assigned
[    1.551352] pci 0021:02:0a.0: bridge window [mem 0x3fe882800000-0x3fe882ffffff]: assigned
[    1.551355] pci 0021:02:01.0: bridge window [io  size 0x1000]: can't assign; no space
[    1.551358] pci 0021:02:01.0: bridge window [io  size 0x1000]: failed to assign
[    1.551362] pci 0021:02:0a.0: bridge window [io  size 0x1000]: can't assign; no space
[    1.551365] pci 0021:02:0a.0: bridge window [io  size 0x1000]: failed to assign
[    1.551369] pci 0021:02:0b.0: bridge window [io  size 0x1000]: can't assign; no space
[    1.551372] pci 0021:02:0b.0: bridge window [io  size 0x1000]: failed to assign
[    1.551382] pci 0021:02:0a.0: bridge window [io  size 0x1000]: can't assign; no space
[    1.551384] pci 0021:02:0a.0: bridge window [io  size 0x1000]: failed to assign
[    1.551387] pci 0021:02:0b.0: bridge window [io  size 0x1000]: can't assign; no space
[    1.551390] pci 0021:02:0b.0: bridge window [io  size 0x1000]: failed to assign
[    1.551393] pci 0021:02:01.0: bridge window [io  size 0x1000]: can't assign; no space
[    1.551395] pci 0021:02:01.0: bridge window [io  size 0x1000]: failed to assign
[    1.551403] pci 0021:02:01.0: PCI bridge to [bus 03-07]
[    1.551411] pci 0021:02:01.0:   bridge window [mem 0x3fe881800000-0x3fe881ffffff]
[    1.551418] pci 0021:02:01.0:   bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]
[    1.551428] pci 0021:02:08.0: PCI bridge to [bus 08-0c]
[    1.551451] pci 0021:0d:00.0: BAR 0 [mem 0x3fe882000000-0x3fe88200ffff 64bit]: assigned
[    1.551474] pci 0021:0d:00.0: BAR 2 [mem 0x3fe882010000-0x3fe882011fff 64bit]: assigned
[    1.551494] pci 0021:02:09.0: PCI bridge to [bus 0d]
[    1.551501] pci 0021:02:09.0:   bridge window [mem 0x3fe882000000-0x3fe8827fffff]
[    1.551529] pci 0021:0e:00.0: BAR 5 [mem 0x3fe882800000-0x3fe8828007ff]: assigned
[    1.551537] pci 0021:0e:00.0: ROM [mem 0x3fe882810000-0x3fe88281ffff pref]: assigned
[    1.551540] pci 0021:0e:00.0: BAR 4 [io  size 0x0020]: can't assign; no space
[    1.551543] pci 0021:0e:00.0: BAR 4 [io  size 0x0020]: failed to assign
[    1.551547] pci 0021:0e:00.0: BAR 0 [io  size 0x0008]: can't assign; no space
[    1.551550] pci 0021:0e:00.0: BAR 0 [io  size 0x0008]: failed to assign
[    1.551554] pci 0021:0e:00.0: BAR 2 [io  size 0x0008]: can't assign; no space
[    1.551557] pci 0021:0e:00.0: BAR 2 [io  size 0x0008]: failed to assign
[    1.551561] pci 0021:0e:00.0: BAR 1 [io  size 0x0004]: can't assign; no space
[    1.551563] pci 0021:0e:00.0: BAR 1 [io  size 0x0004]: failed to assign
[    1.551567] pci 0021:0e:00.0: BAR 3 [io  size 0x0004]: can't assign; no space
[    1.551570] pci 0021:0e:00.0: BAR 3 [io  size 0x0004]: failed to assign
[    1.551578] pci 0021:0e:00.0: BAR 4 [io  size 0x0020]: can't assign; no space
[    1.551581] pci 0021:0e:00.0: BAR 4 [io  size 0x0020]: failed to assign
[    1.551584] pci 0021:0e:00.0: BAR 0 [io  size 0x0008]: can't assign; no space
[    1.551586] pci 0021:0e:00.0: BAR 0 [io  size 0x0008]: failed to assign
[    1.551589] pci 0021:0e:00.0: BAR 2 [io  size 0x0008]: can't assign; no space
[    1.551592] pci 0021:0e:00.0: BAR 2 [io  size 0x0008]: failed to assign
[    1.551594] pci 0021:0e:00.0: BAR 1 [io  size 0x0004]: can't assign; no space
[    1.551597] pci 0021:0e:00.0: BAR 1 [io  size 0x0004]: failed to assign
[    1.551600] pci 0021:0e:00.0: BAR 3 [io  size 0x0004]: can't assign; no space
[    1.551602] pci 0021:0e:00.0: BAR 3 [io  size 0x0004]: failed to assign
[    1.551612] pci 0021:02:0a.0: PCI bridge to [bus 0e]
[    1.551620] pci 0021:02:0a.0:   bridge window [mem 0x3fe882800000-0x3fe882ffffff]
[    1.551636] pci 0021:0f:00.0: bridge window [mem 0x3fe880000000-0x3fe8817fffff]: assigned
[    1.551639] pci 0021:0f:00.0: bridge window [io  size 0x1000]: can't assign; no space
[    1.551642] pci 0021:0f:00.0: bridge window [io  size 0x1000]: failed to assign
[    1.551647] pci 0021:0f:00.0: bridge window [io  size 0x1000]: can't assign; no space
[    1.551649] pci 0021:0f:00.0: bridge window [io  size 0x1000]: failed to assign
[    1.551657] pci 0021:10:00.0: BAR 0 [mem 0x3fe880000000-0x3fe880ffffff]: assigned
[    1.551667] pci 0021:10:00.0: BAR 1 [mem 0x3fe881000000-0x3fe88101ffff]: assigned
[    1.551676] pci 0021:10:00.0: BAR 2 [io  size 0x0080]: can't assign; no space
[    1.551678] pci 0021:10:00.0: BAR 2 [io  size 0x0080]: failed to assign
[    1.551684] pci 0021:10:00.0: BAR 2 [io  size 0x0080]: can't assign; no space
[    1.551686] pci 0021:10:00.0: BAR 2 [io  size 0x0080]: failed to assign
[    1.551691] pci 0021:0f:00.0: PCI bridge to [bus 10]
[    1.551700] pci 0021:0f:00.0:   bridge window [mem 0x3fe880000000-0x3fe8817fffff]
[    1.551717] pci 0021:02:0b.0: PCI bridge to [bus 0f-10]
[    1.551727] pci 0021:02:0b.0:   bridge window [mem 0x3fe880000000-0x3fe8817fffff]
[    1.551745] pci 0021:02:0c.0: PCI bridge to [bus 11-15]
[    1.551765] pci 0021:01:00.0: PCI bridge to [bus 02-15]
[    1.551773] pci 0021:01:00.0:   bridge window [mem 0x3fe880000000-0x3fe8ffefffff]
[    1.551779] pci 0021:01:00.0:   bridge window [mem 0x250000000000-0x25fdfff0ffff 64bit pref]
[    1.551789] pci 0021:00:00.0: PCI bridge to [bus 01-15]
[    1.551797] pci 0021:00:00.0:   bridge window [mem 0x3fe880000000-0x3fe8ffefffff]
[    1.551803] pci 0021:00:00.0:   bridge window [mem 0x250000000000-0x25fdfff0ffff 64bit pref]
[    1.551813] pci_bus 0021:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    1.551819] pci_bus 0021:00: resource 4 [mem 0x3fe880000000-0x3fe8fffeffff]
[    1.551822] pci_bus 0021:00: resource 5 [mem 0x250000000000-0x25fdffffffff 64bit pref]
[    1.551825] pci_bus 0021:01: resource 0 [io  size 0x2000]
[    1.551828] pci_bus 0021:01: resource 1 [mem 0x3fe880000000-0x3fe8ffefffff]
[    1.551830] pci_bus 0021:01: resource 2 [mem 0x250000000000-0x25fdfff0ffff 64bit pref]
[    1.551833] pci_bus 0021:02: resource 0 [io  size 0x2000]
[    1.551836] pci_bus 0021:02: resource 1 [mem 0x3fe880000000-0x3fe8ffefffff]
[    1.551839] pci_bus 0021:02: resource 2 [mem 0x250000000000-0x25fdfff0ffff 64bit pref]
[    1.551841] pci_bus 0021:03: resource 0 [io  size 0x1000]
[    1.551844] pci_bus 0021:03: resource 1 [mem 0x3fe881800000-0x3fe881ffffff]
[    1.551848] pci_bus 0021:03: resource 2 [mem 0x250000000000-0x2500ffffffff 64bit pref]
[    1.551851] pci_bus 0021:08: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    1.551854] pci_bus 0021:08: resource 1 [mem 0x00000000-0xffffffffffffffff disabled]
[    1.551857] pci_bus 0021:08: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.551859] pci_bus 0021:0d: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    1.551862] pci_bus 0021:0d: resource 1 [mem 0x3fe882000000-0x3fe8827fffff]
[    1.551865] pci_bus 0021:0d: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.551868] pci_bus 0021:0e: resource 0 [io  size 0x1000]
[    1.551870] pci_bus 0021:0e: resource 1 [mem 0x3fe882800000-0x3fe882ffffff]
[    1.551873] pci_bus 0021:0e: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.551876] pci_bus 0021:0f: resource 0 [io  size 0x1000]
[    1.551879] pci_bus 0021:0f: resource 1 [mem 0x3fe880000000-0x3fe8817fffff]
[    1.551881] pci_bus 0021:0f: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.551884] pci_bus 0021:10: resource 0 [io  size 0x1000]
[    1.551887] pci_bus 0021:10: resource 1 [mem 0x3fe880000000-0x3fe8817fffff]
[    1.551889] pci_bus 0021:10: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.551892] pci_bus 0021:11: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    1.551895] pci_bus 0021:11: resource 1 [mem 0x00000000-0xffffffffffffffff disabled]
[    1.551898] pci_bus 0021:11: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.551901] pci 0022:00:00.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 01-ff] (unused)
[    1.551904] pci 0022:00:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 01-ff] (unused)
[    1.551908] pci 0022:00:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff] to [bus 01-ff] (unused)
[    1.551911] pci 0022:00:00.0: PCI bridge to [bus 01-ff]
[    1.551928] pci_bus 0022:00: resource 4 [mem 0x3fe900000000-0x3fe97ffeffff]
[    1.551931] pci_bus 0022:00: resource 5 [mem 0x260000000000-0x26fdffffffff 64bit pref]
[    1.551934] pci_bus 0022:01: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    1.551937] pci_bus 0022:01: resource 1 [mem 0x00000000-0xffffffffffffffff disabled]
[    1.551940] pci_bus 0022:01: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.551943] pci_bus 0000:00: Configuring PE for bus
[    1.551946] pci 0000:00     : [PE# fe] Secondary bus 0x0000000000000000 associated with PE#fe
[    1.552089] pci 0000:00:00.0: Configured PE#fe
[    1.552193] pci_bus 0001:00: Configuring PE for bus
[    1.552196] pci 0001:00     : [PE# fe] Secondary bus 0x0000000000000000 associated with PE#fe
[    1.552336] pci 0001:00:00.0: Configured PE#fe
[    1.552433] pci_bus 0001:01: Configuring PE for bus
[    1.552458] pci 0001:01     : [PE# 00] Secondary bus 0x0000000000000001 associated with PE#0
[    1.552601] pci 0001:01:00.0: Configured PE#0
[    1.552603] pci 0001:01     : [PE# 00] Setting up 32-bit TCE table at 0..80000000
[    1.553510] IOMMU table initialized, virtual merging enabled
[    1.553512] pci 0001:01     : [PE# 00] Setting up window#0 0..ffffffffff pg=10000
[    1.553521] pci 0001:01     : [PE# 00] Enabling 64-bit DMA bypass
[    1.553581] pci 0001:01:00.0: Adding to iommu group 0
[    1.553958] pci 0001:01:00.1: Added to existing PE#0
[    1.553977] pci 0001:01:00.1: Adding to iommu group 0
[    1.554314] pci 0001:01:00.2: Added to existing PE#0
[    1.554331] pci 0001:01:00.2: Adding to iommu group 0
[    1.554643] pci 0001:01:00.3: Added to existing PE#0
[    1.554660] pci 0001:01:00.3: Adding to iommu group 0
[    1.555003] pci_bus 0020:00: Configuring PE for bus
[    1.555006] pci 0020:00     : [PE# fe] Secondary bus 0x0000000000000000 associated with PE#fe
[    1.555147] pci 0020:00:00.0: Configured PE#fe
[    1.555250] pci_bus 0021:00: Configuring PE for bus
[    1.555252] pci 0021:00     : [PE# fe] Secondary bus 0x0000000000000000 associated with PE#fe
[    1.555393] pci 0021:00:00.0: Configured PE#fe
[    1.555494] pci_bus 0021:01: Configuring PE for bus
[    1.555501] pci 0021:01     : [PE# fd] Secondary bus 0x0000000000000001 associated with PE#fd
[    1.555643] pci 0021:01:00.0: Configured PE#fd
[    1.555902] pci 0021:01:00.1: Added to existing PE#fd
[    1.555904] pci 0021:01     : [PE# fd] Setting up 32-bit TCE table at 0..80000000
[    1.556874] pci 0021:01     : [PE# fd] Setting up window#0 0..ffffffffff pg=10000
[    1.556883] pci 0021:01     : [PE# fd] Enabling 64-bit DMA bypass
[    1.556927] pci 0021:01:00.1: Adding to iommu group 1
[    1.557103] pci 0021:01:00.2: Added to existing PE#fd
[    1.557122] pci 0021:01:00.2: Adding to iommu group 1
[    1.557280] pci 0021:01:00.3: Added to existing PE#fd
[    1.557298] pci 0021:01:00.3: Adding to iommu group 1
[    1.557440] pci 0021:01:00.4: Added to existing PE#fd
[    1.557457] pci 0021:01:00.4: Adding to iommu group 1
[    1.557603] pci_bus 0021:02: Configuring PE for bus
[    1.557610] pci 0021:02     : [PE# fc] Secondary bus 0x0000000000000002 associated with PE#fc
[    1.557751] pci 0021:02:01.0: Configured PE#fc
[    1.557998] pci 0021:02:08.0: Added to existing PE#fc
[    1.558247] pci 0021:02:09.0: Added to existing PE#fc
[    1.558499] pci 0021:02:0a.0: Added to existing PE#fc
[    1.558745] pci 0021:02:0b.0: Added to existing PE#fc
[    1.558997] pci 0021:02:0c.0: Added to existing PE#fc
[    1.559223] pci_bus 0021:0d: Configuring PE for bus
[    1.559229] pci 0021:0d     : [PE# fb] Secondary bus 0x000000000000000d associated with PE#fb
[    1.559371] pci 0021:0d:00.0: Configured PE#fb
[    1.559374] pci 0021:0d     : [PE# fb] Setting up 32-bit TCE table at 0..80000000
[    1.560325] pci 0021:0d     : [PE# fb] Setting up window#0 0..ffffffffff pg=10000
[    1.560332] pci 0021:0d     : [PE# fb] Enabling 64-bit DMA bypass
[    1.560376] pci 0021:0d:00.0: Adding to iommu group 2
[    1.560572] pci_bus 0021:0e: Configuring PE for bus
[    1.560579] pci 0021:0e     : [PE# fa] Secondary bus 0x000000000000000e associated with PE#fa
[    1.560720] pci 0021:0e:00.0: Configured PE#fa
[    1.560723] pci 0021:0e     : [PE# fa] Setting up 32-bit TCE table at 0..80000000
[    1.561701] pci 0021:0e     : [PE# fa] Setting up window#0 0..ffffffffff pg=10000
[    1.561708] pci 0021:0e     : [PE# fa] Enabling 64-bit DMA bypass
[    1.561783] pci 0021:0e:00.0: Adding to iommu group 3
[    1.561952] pci_bus 0021:0f: Configuring PE for bus
[    1.561958] pci 0021:0f     : [PE# f9] Secondary bus 0x000000000000000f associated with PE#f9
[    1.562099] pci 0021:0f:00.0: Configured PE#f9
[    1.562322] pci_bus 0021:10: Configuring PE for bus
[    1.562329] pci 0021:10     : [PE# f8] Secondary bus 0x0000000000000010..0x0000000000000010 associated with PE#f8
[    1.562472] pci 0021:10:00.0: Configured PE#f8
[    1.562474] pci 0021:10     : [PE# f8] Setting up 32-bit TCE table at 0..80000000
[    1.563445] pci 0021:10     : [PE# f8] Setting up window#0 0..ffffffffff pg=10000
[    1.563452] pci 0021:10     : [PE# f8] Enabling 64-bit DMA bypass
[    1.563498] pci 0021:10:00.0: Adding to iommu group 4
[    1.563660] pci_bus 0022:00: Configuring PE for bus
[    1.563663] pci 0022:00     : [PE# fe] Secondary bus 0x0000000000000000 associated with PE#fe
[    1.563805] pci 0022:00:00.0: Configured PE#fe
[    1.564012] pci 0001:00:00.0: enabling device (0141 -> 0143)
[    1.564027] pci 0021:00:00.0: enabling device (0141 -> 0143)
[    1.564042] pci 0021:01:00.0: enabling device (0141 -> 0143)
[    1.564059] pci 0021:02:09.0: enabling device (0141 -> 0143)
[    1.564077] pci 0021:02:0a.0: enabling device (0141 -> 0143)
[    1.564095] pci 0021:02:0b.0: enabling device (0141 -> 0143)
[    1.564115] pci 0021:0f:00.0: enabling device (0141 -> 0143)
[    1.564128] EEH: Capable adapter found: recovery enabled.
[    1.564319] PCI: Probing PCI hardware done
[    1.564434] pci 0021:10:00.0: vgaarb: setting as boot VGA device
[    1.564437] pci 0021:10:00.0: vgaarb: bridge control possible
[    1.564439] pci 0021:10:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    1.564443] vgaarb: loaded
[    1.565342] clocksource: Switched to clocksource timebase
[    1.570409] VFS: Disk quotas dquot_6.6.0
[    1.570793] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
[    1.581033] NET: Registered PF_INET protocol family
[    1.581275] IP idents hash table entries: 262144 (order: 5, 2097152 bytes, vmalloc)
[    1.589191] tcp_listen_portaddr_hash hash table entries: 65536 (order: 4, 1048576 bytes, vmalloc)
[    1.589444] Table-perturb hash table entries: 65536 (order: 2, 262144 bytes, vmalloc)
[    1.589467] TCP established hash table entries: 524288 (order: 6, 4194304 bytes, vmalloc)
[    1.590267] TCP bind hash table entries: 65536 (order: 5, 2097152 bytes, vmalloc)
[    1.590549] TCP: Hash tables configured (established 524288 bind 65536)
[    1.591767] UDP hash table entries: 65536 (order: 6, 4194304 bytes, vmalloc)
[    1.593760] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    1.593859] pci 0021:0d:00.0: enabling device (0140 -> 0142)
[    1.627080] pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
[    1.627094] pci 0021:0d:00.0: quirk_usb_early_handoff+0x0/0x300 took 32465 usecs
[    1.627123] PCI: CLS 0 bytes, default 128
[    1.627300] Trying to unpack rootfs image as initramfs...
[    1.633227] random: crng init done
[    1.637735] Initialise system trusted keyrings
[    1.637773] Key type blacklist registered
[    1.637903] workingset: timestamp_bits=38 (anon: 34) max_order=24 bucket_order=0 (anon: 0)
[    1.641817] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    1.642754] fuse: init (API version 7.45)
[    1.662427] Key type asymmetric registered
[    1.662430] Asymmetric key parser 'x509' registered
[    1.662672] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[    1.662946] io scheduler mq-deadline registered
[    1.682613] ledtrig-cpu: registered to indicate activity on CPUs
[    1.683033] pci 0021:10:00.0: enabling device (0141 -> 0143)
[    1.683294] hvc0: raw protocol on /ibm,opal/consoles/serial@0 (boot console)
[    1.683302] hvc0: No interrupts property, using OPAL event
[    1.684333] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    1.693441] Non-volatile memory driver v1.3
[    1.736173] loop: module loaded
[    1.738055] tun: Universal TUN/TAP device driver, 1.6
[    1.738236] PPP generic driver version 2.4.2
[    1.738528] VFIO - User Level meta-driver version: 0.3
[    1.739374] xhci_hcd 0021:0d:00.0: xHCI Host Controller
[    1.739431] xhci_hcd 0021:0d:00.0: new USB bus registered, assigned bus number 1
[    1.794727] Freeing initrd memory: 52928K
[    1.801984] xhci_hcd 0021:0d:00.0: Host halt failed, -110
[    1.801988] xhci_hcd 0021:0d:00.0: can't setup: -110
[    1.802137] xhci_hcd 0021:0d:00.0: USB bus 1 deregistered
[    1.802154] xhci_hcd 0021:0d:00.0: init 0021:0d:00.0 fail, -110
[    1.802250] xhci_hcd 0021:0d:00.0: probe with driver xhci_hcd failed with error -110
[    1.802802] mousedev: PS/2 mouse device common for all mice
[    1.817314] rtc-opal opal-rtc: registered as rtc0
[    1.833264] rtc-opal opal-rtc: setting system clock to 2026-05-06T07:01:17 UTC (1778050877)
[    1.833299] i2c_dev: i2c /dev entries driver
[    1.838768] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[    1.839017] device-mapper: uevent: version 1.0.3
[    1.839567] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev
[    1.839576] powernv-cpufreq: cpufreq pstate min 0xffffffd5 nominal 0xffffffef max 0x0
[    1.839578] powernv-cpufreq: Workload Optimized Frequency is disabled in the platform
[    1.853421] powernv_idle_driver registered
[    1.854516] NET: Registered PF_INET6 protocol family
[    1.858060] Segment Routing with IPv6
[    1.858088] In-situ OAM (IOAM) with IPv6
[    1.858135] NET: Registered PF_PACKET protocol family
[    1.858280] Key type dns_resolver registered
[    1.867760] registered taskstats version 1
[    1.875741] Loading compiled-in X.509 certificates
[    1.877080] Loaded X.509 cert 'Build time autogenerated kernel key: e8777919b07b958e05390190c252dd0554826a36'
[    1.889770] Demotion targets for Node 0: null
[    1.889773] Demotion targets for Node 8: null
[    1.889821] kmemleak: Kernel memory leak detector initialized (mem pool available: 5807)
[    1.889824] kmemleak: Automatic memory scanning thread started
[    1.890972] Key type .fscrypt registered
[    1.890974] Key type fscrypt-provisioning registered
[    1.891009] Key type big_key registered
[    1.891013] trusted_key: H_PKS_WRAP_OBJECT interface not supported
[    1.903045] Key type encrypted registered
[    1.903049] ima: No TPM chip found, activating TPM-bypass!
[    1.903061] ima: Allocated hash algorithm: sha256
[    1.903087] ima: No architecture policies found
[    1.903159] evm: Initialising EVM extended attributes:
[    1.903160] evm: security.selinux
[    1.903162] evm: security.SMACK64
[    1.903163] evm: security.SMACK64EXEC
[    1.903165] evm: security.SMACK64TRANSMUTE
[    1.903166] evm: security.SMACK64MMAP
[    1.903168] evm: security.apparmor
[    1.903169] evm: security.ima
[    1.903170] evm: security.capability
[    1.903172] evm: HMAC attrs: 0x1
[    1.903217] SED: plpks not available
[    1.905316] PM: genpd: Disabling unused power domains
[    1.905449] integrity: Unable to open file: /etc/keys/x509_ima.der (-2)
[    1.905457] integrity: Unable to open file: /etc/keys/x509_evm.der (-2)
[    1.908676] Freeing unused kernel image (initmem) memory: 8768K
[    1.908752] Run /init as init process
[    1.908754]   with arguments:
[    1.908756]     /init
[    1.908758]     splash
[    1.908760]   with environment:
[    1.908761]     HOME=/
[    1.908763]     TERM=linux
[    2.275710] ahci 0021:0e:00.0: enabling device (0541 -> 0543)
[    2.275985] ahci 0021:0e:00.0: iommu: 64-bit OK but direct DMA is limited by 0
[    2.275988] ahci 0021:0e:00.0: iommu: 64-bit OK but direct DMA is limited by 0
[    2.286072] ahci 0021:0e:00.0: AHCI vers 0001.0000, 32 command slots, 6 Gbps, SATA mode
[    2.286076] ahci 0021:0e:00.0: 4/4 ports implemented (port mask 0xf)
[    2.286079] ahci 0021:0e:00.0: flags: 64bit ncq sntf led only pmp fbs pio slum part sxs 
[    2.288839] scsi host0: ahci
[    2.290329] scsi host1: ahci
[    2.291218] scsi host2: ahci
[    2.292102] scsi host3: ahci
[    2.292459] ata1: SATA max UDMA/133 abar m2048@0x3fe882800000 port 0x3fe882800100 irq 39 lpm-pol 1 ext
[    2.292463] ata2: SATA max UDMA/133 abar m2048@0x3fe882800000 port 0x3fe882800180 irq 39 lpm-pol 1 ext
[    2.292466] ata3: SATA max UDMA/133 abar m2048@0x3fe882800000 port 0x3fe882800200 irq 39 lpm-pol 1 ext
[    2.292469] ata4: SATA max UDMA/133 abar m2048@0x3fe882800000 port 0x3fe882800280 irq 39 lpm-pol 1 ext
[    2.399805] ata3: SATA link down (SStatus 0 SControl 300)
[    2.399871] ata4: SATA link down (SStatus 0 SControl 300)
[    2.565242] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    2.565278] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    2.565709] ata2.00: ATA-10: ST1000NX0313         00LY266 00LY265IBM, BE33, max UDMA/133
[    2.565839] ata2.00: 1953525168 sectors, multi 0: LBA48 NCQ (depth 32), AA
[    2.565842] ata2.00: Features: DIPM
[    2.566430] ata2.00: configured for UDMA/133
[    2.596915] ata1.00: ATA-10: ST1000NX0313         00LY266 00LY265IBM, BE33, max UDMA/133
[    2.597096] ata1.00: 1953525168 sectors, multi 0: LBA48 NCQ (depth 32), AA
[    2.597099] ata1.00: Features: DIPM
[    2.597720] ata1.00: configured for UDMA/133
[    2.598119] scsi 0:0:0:0: Direct-Access     ATA      ST1000NX0313     BE33 PQ: 0 ANSI: 5
[    2.598804] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    2.598956] sd 0:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[    2.598964] sd 0:0:0:0: [sda] 4096-byte physical blocks
[    2.598994] sd 0:0:0:0: [sda] Write Protect is off
[    2.599000] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    2.599044] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.599097] sd 0:0:0:0: [sda] Preferred minimum I/O size 4096 bytes
[    2.599197] scsi 1:0:0:0: Direct-Access     ATA      ST1000NX0313     BE33 PQ: 0 ANSI: 5
[    2.599952] sd 1:0:0:0: Attached scsi generic sg1 type 0
[    2.600042] sd 1:0:0:0: [sdb] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[    2.600049] sd 1:0:0:0: [sdb] 4096-byte physical blocks
[    2.600071] sd 1:0:0:0: [sdb] Write Protect is off
[    2.600077] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    2.600118] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.600167] sd 1:0:0:0: [sdb] Preferred minimum I/O size 4096 bytes
[    2.706268] sd 1:0:0:0: [sdb] Attached SCSI disk
[    2.752402]  sda: sda1 sda2
[    2.752653] sd 0:0:0:0: [sda] Attached SCSI disk
[    2.782168] ast 0021:10:00.0: Platform has no I/O space, using MMIO
[    2.782182] ast 0021:10:00.0: Using P2A bridge for configuration
[    2.782184] ast 0021:10:00.0: AST 2400 detected
[    2.782408] ast 0021:10:00.0: [drm] Using analog VGA
[    2.853220] [drm] Initialized ast 0.1.0 for 0021:10:00.0 on minor 0
[    2.947768] Console: switching to colour frame buffer device 128x48
[    3.023023] ast 0021:10:00.0: [drm] fb0: astdrmfb frame buffer device
[    3.337220] raid6: vpermxor8 gen() 29923 MB/s
[    3.405222] raid6: vpermxor4 gen() 28230 MB/s
[    3.473215] raid6: vpermxor2 gen() 22763 MB/s
[    3.541232] raid6: vpermxor1 gen() 15843 MB/s
[    3.609246] raid6: altivecx8 gen() 15626 MB/s
[    3.677225] raid6: altivecx4 gen() 18234 MB/s
[    3.745233] raid6: altivecx2 gen() 13441 MB/s
[    3.813219] raid6: altivecx1 gen() 10658 MB/s
[    3.881278] raid6: int64x8  gen()  5273 MB/s
[    3.949225] raid6: int64x4  gen()  5865 MB/s
[    4.017280] raid6: int64x2  gen()  4494 MB/s
[    4.085264] raid6: int64x1  gen()  4001 MB/s
[    4.085266] raid6: using algorithm vpermxor8 gen() 29923 MB/s
[    4.085268] raid6: using intx1 recovery algorithm
[    4.088109] xor: measuring software checksum speed
[    4.088230]    altivec         : 27566 MB/sec
[    4.088461]    32regs_prefetch : 14372 MB/sec
[    4.088670]    32regs          : 15812 MB/sec
[    4.088899]    8regs_prefetch  : 14448 MB/sec
[    4.089107]    8regs           : 15924 MB/sec
[    4.089108] xor: using function: altivec (27566 MB/sec)
[    4.270944] Btrfs loaded, zoned=yes, fsverity=no
[    4.309057] BTRFS: device label root devid 1 transid 8211691 /dev/sda2 (8:2) scanned by mount (1192)
[    4.311880] BTRFS info (device sda2): first mount of filesystem 2c3dd738-785a-469b-843e-9f0ba8b47b0d
[    4.311885] BTRFS info (device sda2): using crc32c checksum algorithm
[    4.311891] BTRFS warning (device sda2): space cache v1 is being deprecated and will be removed in a future release, please use -o space_cache=v2
[    7.561624] BTRFS info (device sda2): enabling disk space caching
[    7.747547] Not activating Mandatory Access Control as /sbin/tomoyo-init does not exist.
[    8.815011] systemd[1]: Inserted module 'autofs4'
[    8.905035] systemd[1]: systemd 248.3-1ubuntu8.6 running in system mode. (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS -OPENSSL +ACL +BLKID +CURL +ELFUTILS -FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP -LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[    8.908376] systemd[1]: Detected architecture ppc64-le.
[    8.917189] systemd[1]: Hostname set to <flughafenberlinbrandenburgwillybrandt.molgen.mpg.de>.
[   10.015375] block sda: the capability attribute has been deprecated.
[   10.944328] systemd[1]: /etc/systemd/system/docker.service:26: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[   11.040503] systemd[1]: /lib/systemd/system/rtas_errd.service:12: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[   11.040524] systemd[1]: /lib/systemd/system/rtas_errd.service:13: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[   11.056093] systemd[1]: /lib/systemd/system/opal_errd.service:10: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[   11.056106] systemd[1]: /lib/systemd/system/opal_errd.service:11: Standard output type syslog is obsolete, automatically updating to journal. Please update your unit file, and consider removing the setting altogether.
[   11.158928] systemd[1]: Queued start job for default target Multi-User System.
[   11.195222] systemd[1]: Created slice Virtual Machine and Container Slice.
[   11.197941] systemd[1]: Created slice system-modprobe.slice.
[   11.199280] systemd[1]: Created slice system-serial\x2dgetty.slice.
[   11.200556] systemd[1]: Created slice system-systemd\x2dfsck.slice.
[   11.201946] systemd[1]: Created slice User and Session Slice.
[   11.202068] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[   11.202156] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[   11.202656] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[   11.202709] systemd[1]: Reached target Local Encrypted Volumes.
[   11.202785] systemd[1]: Reached target Slices.
[   11.202811] systemd[1]: Reached target Swap.
[   11.202844] systemd[1]: Reached target Local Verity Integrity Protected Volumes.
[   11.202868] systemd[1]: Reached target Libvirt guests shutdown.
[   11.203015] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[   11.208896] systemd[1]: Listening on RPCbind Server Activation Socket.
[   11.209179] systemd[1]: Listening on Syslog Socket.
[   11.209372] systemd[1]: Listening on fsck to fsckd communication Socket.
[   11.209495] systemd[1]: Listening on initctl Compatibility Named Pipe.
[   11.209883] systemd[1]: Listening on Journal Audit Socket.
[   11.210052] systemd[1]: Listening on Journal Socket (/dev/log).
[   11.210267] systemd[1]: Listening on Journal Socket.
[   11.210522] systemd[1]: Listening on Network Service Netlink Socket.
[   11.210779] systemd[1]: Listening on udev Control Socket.
[   11.210942] systemd[1]: Listening on udev Kernel Socket.
[   11.213350] systemd[1]: Mounting Huge Pages File System...
[   11.215642] systemd[1]: Mounting POSIX Message Queue File System...
[   11.217797] systemd[1]: Mounting Proc NFSD mountpoint...
[   11.220052] systemd[1]: Mounting RPC Pipe File System...
[   11.222383] systemd[1]: Mounting Kernel Debug File System...
[   11.224615] systemd[1]: Mounting Kernel Trace File System...
[   11.229878] systemd[1]: Starting Journal Service...
[   11.229979] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped.
[   11.232481] systemd[1]: Starting Set the console keyboard layout...
[   11.234920] systemd[1]: Starting Create list of static device nodes for the current kernel...
[   11.236732] systemd[1]: Starting Load Kernel Module configfs...
[   11.238486] systemd[1]: Starting Load Kernel Module drm...
[   11.240260] systemd[1]: Starting Load Kernel Module fuse...
[   11.240332] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped.
[   11.240677] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped.
[   11.240724] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[   11.243413] systemd[1]: Starting Load Kernel Modules...
[   11.245944] systemd[1]: Starting Remount Root and Kernel File Systems...
[   11.248274] systemd[1]: Starting Coldplug All udev Devices...
[   11.250629] systemd[1]: Starting Uncomplicated firewall...
[   11.253395] systemd[1]: Mounted Huge Pages File System.
[   11.253545] systemd[1]: Mounted POSIX Message Queue File System.
[   11.253675] systemd[1]: Mounted Kernel Debug File System.
[   11.253807] systemd[1]: Mounted Kernel Trace File System.
[   11.254551] systemd[1]: Finished Create list of static device nodes for the current kernel.
[   11.255018] systemd[1]: modprobe@configfs.service: Deactivated successfully.
[   11.255567] systemd[1]: Finished Load Kernel Module configfs.
[   11.255961] systemd[1]: modprobe@fuse.service: Deactivated successfully.
[   11.256452] systemd[1]: Finished Load Kernel Module fuse.
[   11.259007] systemd[1]: Mounting FUSE Control File System...
[   11.261332] systemd[1]: Mounting Kernel Configuration File System...
[   11.262398] systemd[1]: Mounted FUSE Control File System.
[   11.263534] systemd[1]: Mounted Kernel Configuration File System.
[   11.298164] systemd[1]: modprobe@drm.service: Deactivated successfully.
[   11.298748] systemd[1]: Finished Load Kernel Module drm.
[   11.382962] systemd[1]: Finished Uncomplicated firewall.
[   11.412742] RPC: Registered named UNIX socket transport module.
[   11.412746] RPC: Registered udp transport module.
[   11.412748] RPC: Registered tcp transport module.
[   11.412749] RPC: Registered tcp-with-tls transport module.
[   11.412751] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   11.414281] systemd[1]: Mounted RPC Pipe File System.
[   11.416885] systemd[1]: Starting pNFS block layout mapping daemon...
[   11.462458] systemd[1]: Finished Remount Root and Kernel File Systems.
[   11.529885] systemd[1]: Condition check resulted in Rebuild Hardware Database being skipped.
[   11.573607] systemd[1]: Starting Platform Persistent Storage Archival...
[   11.576023] systemd[1]: Starting Load/Save Random Seed...
[   11.578614] systemd[1]: Starting Create System Users...
[   11.578820] systemd[1]: Started Journal Service.
[   11.664888] lp: driver loaded but no devices found
[   11.851964] ppdev: user-space parallel port driver
[   11.919415] systemd-journald[1288]: Received client request to flush runtime journal.
[   12.425032] systemd-journald[1288]: File /var/log/journal/11882866fe9241ad9ffe6ba0e37fae72/system.journal corrupted or uncleanly shut down, renaming and replacing.
[   16.543160] at24 0-0051: supply vcc not found, using dummy regulator
[   16.587583] at24 0-0051: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   16.589498] at24 0-0052: supply vcc not found, using dummy regulator
[   16.592283] IPMI message handler: version 39.2
[   16.627468] at24 0-0052: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.627583] at24 0-0053: supply vcc not found, using dummy regulator
[   16.628132] at24 0-0053: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.628196] at24 0-0054: supply vcc not found, using dummy regulator
[   16.628739] at24 0-0054: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.628803] at24 0-0055: supply vcc not found, using dummy regulator
[   16.629462] at24 0-0055: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.629549] at24 1-0050: supply vcc not found, using dummy regulator
[   16.674815] ipmi device interface
[   16.717591] ipmi-powernv ibm,opal:ipmi: Unable to map irq from device tree
[   16.720172] at24 1-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   16.720263] at24 1-0052: supply vcc not found, using dummy regulator
[   16.720854] at24 1-0052: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.720943] at24 1-0053: supply vcc not found, using dummy regulator
[   16.721559] at24 1-0053: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.721645] ipmi-powernv ibm,opal:ipmi: IPMI message handler: Found new BMC (man_id: 0x000000, prod_id: 0xaabb, dev_id: 0x20)
[   16.721652] at24 1-0054: supply vcc not found, using dummy regulator
[   16.722199] at24 1-0054: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.722259] at24 1-0055: supply vcc not found, using dummy regulator
[   16.722861] at24 1-0055: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.722937] at24 2-0052: supply vcc not found, using dummy regulator
[   16.753979] at24 2-0052: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.754047] at24 2-0053: supply vcc not found, using dummy regulator
[   16.754706] at24 2-0053: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.754806] at24 2-0054: supply vcc not found, using dummy regulator
[   16.755388] at24 2-0054: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.755454] at24 2-0055: supply vcc not found, using dummy regulator
[   16.756038] at24 2-0055: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   16.756105] at24 2-0056: supply vcc not found, using dummy regulator
[   16.756718] at24 2-0056: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   16.756790] at24 3-0052: supply vcc not found, using dummy regulator
[   17.071037] io scheduler bfq registered
[   17.163576] bnx2x 0001:01:00.0: msix capability found
[   17.163651] bnx2x 0001:01:00.0: enabling device (0140 -> 0142)
[   17.163808] bnx2x 0001:01:00.0: iommu: 64-bit OK but direct DMA is limited by 0
[   17.163812] bnx2x 0001:01:00.0: iommu: 64-bit OK but direct DMA is limited by 0
[   17.163875] bnx2x 0001:01:00.0: part number 0-0-0-0
[   17.251010] bnx2x 0001:01:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[   17.251098] bnx2x 0001:01:00.1: msix capability found
[   17.251149] bnx2x 0001:01:00.1: enabling device (0140 -> 0142)
[   17.251316] bnx2x 0001:01:00.1: iommu: 64-bit OK but direct DMA is limited by 0
[   17.251321] bnx2x 0001:01:00.1: iommu: 64-bit OK but direct DMA is limited by 0
[   17.251386] bnx2x 0001:01:00.1: part number 0-0-0-0
[   17.314551] bnx2x 0001:01:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[   17.314614] bnx2x 0001:01:00.2: msix capability found
[   17.314666] bnx2x 0001:01:00.2: enabling device (0140 -> 0142)
[   17.314833] bnx2x 0001:01:00.2: iommu: 64-bit OK but direct DMA is limited by 0
[   17.314838] bnx2x 0001:01:00.2: iommu: 64-bit OK but direct DMA is limited by 0
[   17.314903] bnx2x 0001:01:00.2: part number 0-0-0-0
[   17.378567] bnx2x 0001:01:00.2: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[   17.378626] bnx2x 0001:01:00.3: msix capability found
[   17.378675] bnx2x 0001:01:00.3: enabling device (0140 -> 0142)
[   17.378846] bnx2x 0001:01:00.3: iommu: 64-bit OK but direct DMA is limited by 0
[   17.378851] bnx2x 0001:01:00.3: iommu: 64-bit OK but direct DMA is limited by 0
[   17.378919] bnx2x 0001:01:00.3: part number 0-0-0-0
[   17.437729] bnx2x 0001:01:00.3: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link)
[   17.440628] bnx2x 0001:01:00.0 enP1p1s0f0: renamed from eth0
[   17.441777] bnx2x 0001:01:00.1 enP1p1s0f1: renamed from eth1
[   17.445251] bnx2x 0001:01:00.2 enP1p1s0f2: renamed from eth2
[   17.449353] bnx2x 0001:01:00.3 enP1p1s0f3: renamed from eth3
[   17.901533] powernv_rng: Registered powernv hwrng.
[   17.901992] Kernel attempted to read user page (0) - exploit attempt? (uid: 0)
[   17.902011] BUG: Kernel NULL pointer dereference on read at 0x00000000
[   17.902018] Faulting instruction address: 0xc0000000000e7138
[   17.902027] Oops: Kernel access of bad area, sig: 11 [#1]
[   17.902034] LE PAGE_SIZE=64K MMU=Hash  SMP NR_CPUS=2048 NUMA PowerNV
[   17.902045] Modules linked in: powernv_rng(+) bnx2x ofpart ibmpowernv bfq mdio cmdlinepart powernv_flash ipmi_powernv ipmi_devintf mtd ipmi_msghandler at24(+) vmx_crypto opal_prd sch_fq_codel nfsd parport_pc ppdev auth_rpcgss nfs_acl lp lockd grace parport sunrpc autofs4 btrfs xor libblake2b raid6_pq ast drm_shmem_helper drm_client_lib i2c_algo_bit drm_kms_helper drm ahci drm_panel_orientation_quirks libahci
[   17.902185] CPU: 147 UID: 0 PID: 2626 Comm: hwrng Not tainted 7.1.0-rc2+ #3 PREEMPTLAZY 
[   17.902197] Hardware name: 8335-GCA POWER8 (raw) 0x4d0200 opal:skiboot-5.4.8-5787ad3 PowerNV
[   17.902204] NIP:  c0000000000e7138 LR: c00800001ec8013c CTR: c0000000000e70fc
[   17.902212] REGS: c000000092913c50 TRAP: 0300   Not tainted  (7.1.0-rc2+)
[   17.902222] MSR:  900000000280b033 <SF,HV,VEC,VSX,EE,FP,ME,IR,DR,RI,LE>  CR: 44420220  XER: 20000000
[   17.902269] CFAR: c00800001ec8026c DAR: 0000000000000000 DSISR: 40000000 IRQMASK: 0 
               GPR00: c00800001ec8013c c000000092913ef0 c000000001c18100 c00000002222d900 
               GPR04: c00000002222d900 0000000000000080 0000000000000001 0000000000000000 
               GPR08: 0000000000000000 c000000002212000 c0000000951e1780 c00800001ec80258 
               GPR12: c0000000000e70fc c00000ffff6fd700 c0000000001d11c0 c00000001b99b9c0 
               GPR16: 0000000000000000 0000000000000000 0000000000000000 0000000000000000 
               GPR20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000 
               GPR24: 0000000000000000 c000000002fe6a58 0000000000000000 0000000000000000 
               GPR28: c000000002fe6a20 0000000000000010 000000000000000f c00000002222d900 
[   17.902406] NIP [c0000000000e7138] pnv_get_random_long+0x3c/0x114
[   17.902426] LR [c00800001ec8013c] powernv_rng_read+0x78/0xc4 [powernv_rng]
[   17.902444] Call Trace:
[   17.902448] [c000000092913ef0] [c000000092913f30] 0xc000000092913f30 (unreliable)
[   17.902463] [c000000092913f30] [c000000000decd58] hwrng_fillfn+0xd4/0x3dc
[   17.902484] [c000000092913f90] [c0000000001d1328] kthread+0x170/0x1a4
[   17.902498] [c000000092913fe0] [c00000000000d030] start_kernel_thread+0x14/0x18
[   17.902513] Code: 60000000 7d2000a6 71290010 418200bc e94d0908 812a0000 39290001 912a0000 e90d0030 3d220060 39299f00 7d08482a <e9280000> 7c0004ac e8e90000 0c070000 
[   17.902569] ---[ end trace 0000000000000000 ]---
[   18.008801] pstore: backend (nvram) writing error (-1)

[   18.015458] note: hwrng[2626] exited with irqs disabled
[   18.015483] note: hwrng[2626] exited with preempt_count 1
[   18.309967] bnx2x 0001:01:00.0: Direct firmware load for bnx2x/bnx2x-e2-7.13.21.0.fw failed with error -2
[   18.793748] at24 3-0052: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   18.793840] at24 3-0053: supply vcc not found, using dummy regulator
[   18.794394] at24 3-0053: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   18.794490] at24 3-0054: supply vcc not found, using dummy regulator
[   18.795011] at24 3-0054: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   18.795071] at24 3-0055: supply vcc not found, using dummy regulator
[   18.795580] at24 3-0055: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   18.795638] at24 3-0057: supply vcc not found, using dummy regulator
[   18.796198] at24 3-0057: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   18.796258] at24 4-0051: supply vcc not found, using dummy regulator
[   18.878651] bnx2x 0001:01:00.0 enP1p1s0f0: using MSI-X  IRQs: sp 40  fp[0] 42 ... fp[9] 51
[   19.081229] bnx2x 0001:01:00.0 enP1p1s0f0: NIC Link is Up, 10000 Mbps full duplex, Flow control: ON - receive & transmit
[   19.318954] at24 4-0051: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   19.319133] at24 4-0052: supply vcc not found, using dummy regulator
[   19.319799] at24 4-0052: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   19.319876] at24 4-0053: supply vcc not found, using dummy regulator
[   19.320594] at24 4-0053: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   19.320672] at24 4-0054: supply vcc not found, using dummy regulator
[   19.321309] at24 4-0054: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   19.321390] at24 4-0055: supply vcc not found, using dummy regulator
[   19.322020] at24 4-0055: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   19.322122] at24 5-0050: supply vcc not found, using dummy regulator
[   21.349730] at24 5-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   21.349834] at24 5-0052: supply vcc not found, using dummy regulator
[   21.350485] at24 5-0052: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   21.350554] at24 5-0053: supply vcc not found, using dummy regulator
[   21.351142] at24 5-0053: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   21.351304] at24 5-0054: supply vcc not found, using dummy regulator
[   21.351917] at24 5-0054: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   21.351985] at24 5-0055: supply vcc not found, using dummy regulator
[   21.352704] at24 5-0055: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   21.352777] at24 6-0052: supply vcc not found, using dummy regulator
[   23.365702] at24 6-0052: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   23.365808] at24 6-0053: supply vcc not found, using dummy regulator
[   23.366453] at24 6-0053: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   23.366521] at24 6-0054: supply vcc not found, using dummy regulator
[   23.367107] at24 6-0054: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   23.367268] at24 6-0055: supply vcc not found, using dummy regulator
[   23.367819] at24 6-0055: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   23.367889] at24 6-0056: supply vcc not found, using dummy regulator
[   23.368615] at24 6-0056: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   23.368687] at24 7-0052: supply vcc not found, using dummy regulator
[   25.381710] at24 7-0052: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   25.381865] at24 7-0053: supply vcc not found, using dummy regulator
[   25.382468] at24 7-0053: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   25.382539] at24 7-0054: supply vcc not found, using dummy regulator
[   25.383161] at24 7-0054: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   25.383228] at24 7-0055: supply vcc not found, using dummy regulator
[   25.383758] at24 7-0055: 256 byte 24c02 EEPROM, writable, 1 bytes/write
[   25.383825] at24 7-0057: supply vcc not found, using dummy regulator
[   25.384407] at24 7-0057: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   25.384476] at24 8-0050: supply vcc not found, using dummy regulator
[   25.384732] at24 8-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   25.384801] at24 8-0051: supply vcc not found, using dummy regulator
[   25.385061] at24 8-0051: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   25.385136] at24 9-0050: supply vcc not found, using dummy regulator
[   25.385418] at24 9-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   25.385492] at24 9-0051: supply vcc not found, using dummy regulator
[   25.385781] at24 9-0051: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   25.385860] at24 10-0050: supply vcc not found, using dummy regulator
[   25.386215] at24 10-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   25.386298] at24 11-0050: supply vcc not found, using dummy regulator
[   25.386599] at24 11-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   25.386675] at24 11-0051: supply vcc not found, using dummy regulator
[   25.386938] at24 11-0051: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   25.387008] at24 12-0050: supply vcc not found, using dummy regulator
[   25.387267] at24 12-0050: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   25.387340] at24 12-0051: supply vcc not found, using dummy regulator
[   25.387665] at24 12-0051: 16384 byte 24c128 EEPROM, writable, 1 bytes/write
[   26.523961] SGI XFS with ACLs, security attributes, realtime, quota, no debug enabled
[   26.531480] XFS (sdb): Mounting V5 Filesystem 4765af8c-1797-4fb3-833f-9790bf53c3cd
[   26.634162] XFS (sdb): Starting recovery (logdev: internal)
[   28.626258] XFS (sdb): Ending recovery (logdev: internal)
[   28.692207] xfs filesystem being mounted at /amd/flughafenberlinbrandenburgwillybrandt/0 supports timestamps until 2038-01-19 (0x7fffffff)
[   30.334824] KVM-HV: Enabling IRQ bypass
[   30.547364] systemd-journald[1288]: Failed to read journal file /var/log/journal/11882866fe9241ad9ffe6ba0e37fae72/user-5272.journal for rotation, trying to move it out of the way: Device or resource busy
[   31.925222] NFSD: Unable to initialize client recovery tracking! (-110)
[   31.925290] NFSD: Is nfsdcld running? If not, enable CONFIG_NFSD_LEGACY_CLIENT_TRACKING.
[   31.925396] NFSD: starting 90-second grace period (net effffff9)
[   32.631318] Process accounting resumed
[   38.234701] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: IBM Power S822LC: pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
  2026-05-06 16:06 IBM Power S822LC: pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0 Paul Menzel
@ 2026-05-06 17:30 ` Michal Pecio
  2026-05-11 21:57   ` Paul Menzel
  0 siblings, 1 reply; 7+ messages in thread
From: Michal Pecio @ 2026-05-06 17:30 UTC (permalink / raw)
  To: Paul Menzel; +Cc: Mathias Nyman, Greg Kroah-Hartman, linux-usb, LKML

On Wed, 6 May 2026 18:06:20 +0200, Paul Menzel wrote:
> Dear Linux folks,
> 
> 
> On the IBM Power S822LC (8335-GCA POWER8), rebooting into Linux 7.1-rc2+ 
> with kexec results in the warning below:
> 
>      [    0.000000] Linux version 7.1.0-rc2+ (x@b) (gcc (Ubuntu 
> 11.2.0-7ubuntu2) 11.2.0, GNU ld (GNU Binutils for Ubuntu) 2.37) #3 SMP 
> PREEMPT Wed May  6 08:50:5
>      […]
>      [    0.000000] Hardware name: 8335-GCA POWER8 (raw) 0x4d0200 
> opal:skiboot-5.4.8-5787ad3 PowerNV
>      […]
>      [    1.593760] NET: Registered PF_UNIX/PF_LOCAL protocol family
>      [    1.593859] pci 0021:0d:00.0: enabling device (0140 -> 0142)
>      [    1.627080] pci 0021:0d:00.0: xHCI HW did not halt within 32000 
> usec status = 0x0
>      [    1.627094] pci 0021:0d:00.0: quirk_usb_early_handoff+0x0/0x300 
> took 32465 usecs
>      [    1.627123] PCI: CLS 0 bytes, default 128

Hi,

Does it work any better if kexecing other kernel versions?

What if you increase XHCI_MAX_HALT_USEC by 10* or 100* ?

Does the controller work normally after this warning?

Regards,
Michal

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: IBM Power S822LC: pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
  2026-05-06 17:30 ` Michal Pecio
@ 2026-05-11 21:57   ` Paul Menzel
  2026-05-11 23:20     ` Michal Pecio
  0 siblings, 1 reply; 7+ messages in thread
From: Paul Menzel @ 2026-05-11 21:57 UTC (permalink / raw)
  To: Michal Pecio
  Cc: Mathias Nyman, Greg Kroah-Hartman, linux-usb, LKML, linuxppc-dev

[-- Attachment #1: Type: text/plain, Size: 2370 bytes --]

[Cc: +linuxppc-dev]

Dear Michal,


Thank you for your reply.

Am 06.05.26 um 19:30 schrieb Michal Pecio:
> On Wed, 6 May 2026 18:06:20 +0200, Paul Menzel wrote:

>> On the IBM Power S822LC (8335-GCA POWER8), rebooting into Linux 7.1-rc2+
>> with kexec results in the warning below:
>>
>>       [    0.000000] Linux version 7.1.0-rc2+ (x@b) (gcc (Ubuntu 11.2.0-7ubuntu2) 11.2.0, GNU ld (GNU Binutils for Ubuntu) 2.37) #3 SMP PREEMPT Wed May  6 08:50:5
>>       […]
>>       [    0.000000] Hardware name: 8335-GCA POWER8 (raw) 0x4d0200 opal:skiboot-5.4.8-5787ad3 PowerNV
>>       […]
>>       [    1.593760] NET: Registered PF_UNIX/PF_LOCAL protocol family
>>       [    1.593859] pci 0021:0d:00.0: enabling device (0140 -> 0142)
>>       [    1.627080] pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
>>       [    1.627094] pci 0021:0d:00.0: quirk_usb_early_handoff+0x0/0x300 took 32465 usecs
>>       [    1.627123] PCI: CLS 0 bytes, default 128

> Does it work any better if kexecing other kernel versions?

No, the problem goes as far back as 5.17-rc7. (I didn’t try anything 
before.)

> What if you increase XHCI_MAX_HALT_USEC by 10* or 100* ?

I have to test this.

> Does the controller work normally after this warning?
It does not look like it. In the log attached to my report, later on 
there is:

     [    1.739374] xhci_hcd 0021:0d:00.0: xHCI Host Controller
     [    1.739431] xhci_hcd 0021:0d:00.0: new USB bus registered, 
assigned bus number 1
     [    1.794727] Freeing initrd memory: 52928K
     [    1.801984] xhci_hcd 0021:0d:00.0: Host halt failed, -110
     [    1.801988] xhci_hcd 0021:0d:00.0: can't setup: -110
     [    1.802137] xhci_hcd 0021:0d:00.0: USB bus 1 deregistered
     [    1.802154] xhci_hcd 0021:0d:00.0: init 0021:0d:00.0 fail, -110
     [    1.802250] xhci_hcd 0021:0d:00.0: probe with driver xhci_hcd 
failed with error -110

`lsusb` also does not list the device. But I need to check on hardware.


Kind regards,

Paul


PS: Claude Sonnet 4.6 cooked up the attached patch, which does *not* 
help though, but does get it to the return code 0x10, which Claude 
replied to with:

> ● The status change 0x0 → 0x10 is meaningful: 0x10 is PCD (Port Change Detect, bit 4),
>   HCHalted=0. The old-kernel reset (from our commit) did take effect …

Please excuse, if I attach/cite hallucinations.

[-- Attachment #2: 0001-usb-xhci-Reset-controller-on-kexec-to-prevent-stale-.patch --]
[-- Type: text/x-patch, Size: 3340 bytes --]

From b110d128ebe662a02319af6899d8dc50759a1147 Mon Sep 17 00:00:00 2001
From: Paul Menzel <pmenzel@molgen.mpg.de>
Date: Mon, 11 May 2026 17:33:35 +0200
Subject: [PATCH] usb: xhci: Reset controller on kexec to prevent stale state
 in next kernel
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit

When kexec is used to boot into a new Linux kernel, xhci_shutdown() only
halts the xHCI controller (CMD_RUN=0, waits for STS_HALT) without
resetting it.  After halt, the controller still holds stale internal state
from the old kernel: the DCBAA pointer, scratchpad buffer address, event
and command ring dequeue pointers, and so on, all pointing into the old
kernel's now-invalid memory.

If platform firmware (e.g. OPAL on IBM POWER8) then touches the USB
controller during the kexec transition – for example to provide a USB
keyboard console – it may attempt to use those stale ring-buffer
pointers.  This leaves the controller in an undefined, running state
(STS_HALT=0) when the new kernel arrives.  The new kernel's early
quirk_usb_handoff_xhci() fixup then fails to halt the controller and
the xHCI driver can no longer initialise it, producing:

  IBM Power S822LC: pci 0021:0d:00.0: xHCI HW did not halt within
                    32000 usec status = 0x0

A Petitboot-to-Linux kexec chain works correctly because Petitboot, as
the active USB owner, properly halted the controller; the new kernel
finds it cleanly halted.

Fix this by issuing a controller reset (CMD_RESET) after the halt
whenever kexec is in progress.  The reset clears all internal state
(DCBAA, scratchpad, ring buffers, port state) so that any firmware or
the incoming kernel always starts from a well-known, initialisation-ready
state.  This mirrors the approach already used for the
XHCI_SPURIOUS_WAKEUP and XHCI_RESET_TO_DEFAULT quirks.

Link: https://lore.kernel.org/all/fb68e15d-b8f2-42ac-aa65-0d9fedcfcdbd@molgen.mpg.de/
Signed-off-by: Paul Menzel <pmenzel@molgen.mpg.de>
Assisted-by: Claude Sonnet 4.6 <noreply@anthropic.com>
---
 drivers/usb/host/xhci.c | 12 +++++++++---
 1 file changed, 9 insertions(+), 3 deletions(-)

diff --git a/drivers/usb/host/xhci.c b/drivers/usb/host/xhci.c
index a54f5b57f2055..55031d03ad40e 100644
--- a/drivers/usb/host/xhci.c
+++ b/drivers/usb/host/xhci.c
@@ -9,6 +9,7 @@
  */
 
 #include <linux/jiffies.h>
+#include <linux/kexec.h>
 #include <linux/pci.h>
 #include <linux/iommu.h>
 #include <linux/iopoll.h>
@@ -775,11 +776,16 @@ void xhci_shutdown(struct usb_hcd *hcd)
 	xhci_halt(xhci);
 
 	/*
-	 * Workaround for spurious wakeps at shutdown with HSW, and for boot
-	 * firmware delay in ADL-P PCH if port are left in U3 at shutdown
+	 * Workaround for spurious wakeups at shutdown with HSW, and for boot
+	 * firmware delay in ADL-P PCH if ports are left in U3 at shutdown.
+	 * Also reset on kexec to leave the controller in a clean state with
+	 * all internal state (DCBAA, scratchpad, rings) cleared, so the next
+	 * kernel can initialize it without interference from stale pointers
+	 * into the old kernel's memory.
 	 */
 	if (xhci->quirks & XHCI_SPURIOUS_WAKEUP ||
-	    xhci->quirks & XHCI_RESET_TO_DEFAULT)
+	    xhci->quirks & XHCI_RESET_TO_DEFAULT ||
+	    kexec_in_progress)
 		xhci_reset(xhci, XHCI_RESET_SHORT_USEC);
 
 	spin_unlock_irq(&xhci->lock);
-- 
2.54.0


^ permalink raw reply related	[flat|nested] 7+ messages in thread

* Re: IBM Power S822LC: pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
  2026-05-11 21:57   ` Paul Menzel
@ 2026-05-11 23:20     ` Michal Pecio
  2026-05-12  6:17       ` Paul Menzel
  0 siblings, 1 reply; 7+ messages in thread
From: Michal Pecio @ 2026-05-11 23:20 UTC (permalink / raw)
  To: Paul Menzel
  Cc: Mathias Nyman, Greg Kroah-Hartman, linux-usb, LKML, linuxppc-dev

On Mon, 11 May 2026 23:57:33 +0200, Paul Menzel wrote:
> Am 06.05.26 um 19:30 schrieb Michal Pecio:
> > On Wed, 6 May 2026 18:06:20 +0200, Paul Menzel wrote:  
> >> On the IBM Power S822LC (8335-GCA POWER8), rebooting into Linux 7.1-rc2+
> >> with kexec results in the warning below:
> >>
> >>       [    0.000000] Linux version 7.1.0-rc2+ (x@b) (gcc (Ubuntu 11.2.0-7ubuntu2) 11.2.0, GNU ld (GNU Binutils for Ubuntu) 2.37) #3 SMP PREEMPT Wed May  6 08:50:5
> >>       […]
> >>       [    0.000000] Hardware name: 8335-GCA POWER8 (raw) 0x4d0200 opal:skiboot-5.4.8-5787ad3 PowerNV
> >>       […]
> >>       [    1.593760] NET: Registered PF_UNIX/PF_LOCAL protocol family
> >>       [    1.593859] pci 0021:0d:00.0: enabling device (0140 -> 0142)
> >>       [    1.627080] pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
> >>       [    1.627094] pci 0021:0d:00.0: quirk_usb_early_handoff+0x0/0x300 took 32465 usecs
> >>       [    1.627123] PCI: CLS 0 bytes, default 128  
> 
> > Does it work any better if kexecing other kernel versions?  
> 
> No, the problem goes as far back as 5.17-rc7. (I didn’t try anything 
> before.)
> 
> > What if you increase XHCI_MAX_HALT_USEC by 10* or 100* ?  
> 
> I have to test this.

I missed your dmesg attachment previously.

This may not help if another halt attempt 200ms later fails too.
Per spec (5.4.1.1), the HC is supposed to complete halt in 16ms.

> > Does the controller work normally after this warning?  
> It does not look like it. In the log attached to my report, later on 
> there is:
> 
>      [    1.739374] xhci_hcd 0021:0d:00.0: xHCI Host Controller
>      [    1.739431] xhci_hcd 0021:0d:00.0: new USB bus registered, 
> assigned bus number 1
>      [    1.794727] Freeing initrd memory: 52928K
>      [    1.801984] xhci_hcd 0021:0d:00.0: Host halt failed, -110
>      [    1.801988] xhci_hcd 0021:0d:00.0: can't setup: -110
>      [    1.802137] xhci_hcd 0021:0d:00.0: USB bus 1 deregistered
>      [    1.802154] xhci_hcd 0021:0d:00.0: init 0021:0d:00.0 fail, -110
>      [    1.802250] xhci_hcd 0021:0d:00.0: probe with driver xhci_hcd 
> failed with error -110

Right, this chip seems stuck and the driver fails to reinitialize it.

> PS: Claude Sonnet 4.6 cooked up the attached patch, which does *not* 
> help though, but does get it to the return code 0x10, which Claude 
> replied to with:
> 
> > ● The status change 0x0 → 0x10 is meaningful: 0x10 is PCD (Port Change Detect, bit 4),
> >   HCHalted=0. The old-kernel reset (from our commit) did take effect …  

Do you mean that running xhci_reset() before kexec() causes the new
kernel to see 0x10 instead of 0x0 in the status register? Is this
reproducible, not random or a one time fluke?

A little odd, one could expect reset to have the opposite effect.

Is there truly some machine firmware running during kexec() and using
the HC, as your LLM says?

I honestly don't know what to do with this. I think I would start with
looking whether xhci_shutdown() in the old kernel manages to halt it
successfully or if it also fails, and what's the USBSTS there.

It seems that you can get such information by enabling dynamic debug

  echo 'module xhci_hcd +p' >/proc/dynamic_debug/control

and capcturing old kernel's log up to kexec() through a serial cable.

Regards,
Michal






^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: IBM Power S822LC: pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
  2026-05-11 23:20     ` Michal Pecio
@ 2026-05-12  6:17       ` Paul Menzel
  2026-05-12  8:22         ` Michal Pecio
  0 siblings, 1 reply; 7+ messages in thread
From: Paul Menzel @ 2026-05-12  6:17 UTC (permalink / raw)
  To: Michal Pecio
  Cc: Mathias Nyman, Greg Kroah-Hartman, linux-usb, LKML, linuxppc-dev

[-- Attachment #1: Type: text/plain, Size: 5871 bytes --]

Dear Michal,


Thank you for your reply.

Am 12.05.26 um 01:20 schrieb Michal Pecio:
> On Mon, 11 May 2026 23:57:33 +0200, Paul Menzel wrote:
>> Am 06.05.26 um 19:30 schrieb Michal Pecio:
>>> On Wed, 6 May 2026 18:06:20 +0200, Paul Menzel wrote:
>>>> On the IBM Power S822LC (8335-GCA POWER8), rebooting into Linux 7.1-rc2+
>>>> with kexec results in the warning below:
>>>>
>>>>        [    0.000000] Linux version 7.1.0-rc2+ (x@b) (gcc (Ubuntu 11.2.0-7ubuntu2) 11.2.0, GNU ld (GNU Binutils for Ubuntu) 2.37) #3 SMP PREEMPT Wed May  6 08:50:5
>>>>        […]
>>>>        [    0.000000] Hardware name: 8335-GCA POWER8 (raw) 0x4d0200 opal:skiboot-5.4.8-5787ad3 PowerNV
>>>>        […]
>>>>        [    1.593760] NET: Registered PF_UNIX/PF_LOCAL protocol family
>>>>        [    1.593859] pci 0021:0d:00.0: enabling device (0140 -> 0142)
>>>>        [    1.627080] pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
>>>>        [    1.627094] pci 0021:0d:00.0: quirk_usb_early_handoff+0x0/0x300 took 32465 usecs
>>>>        [    1.627123] PCI: CLS 0 bytes, default 128
>>
>>> Does it work any better if kexecing other kernel versions?
>>
>> No, the problem goes as far back as 5.17-rc7. (I didn’t try anything
>> before.)
>>
>>> What if you increase XHCI_MAX_HALT_USEC by 10* or 100* ?
>>
>> I have to test this.
> 
> I missed your dmesg attachment previously.
> 
> This may not help if another halt attempt 200ms later fails too.
> Per spec (5.4.1.1), the HC is supposed to complete halt in 16ms.
> 
>>> Does the controller work normally after this warning?
>> It does not look like it. In the log attached to my report, later on
>> there is:
>>
>>       [    1.739374] xhci_hcd 0021:0d:00.0: xHCI Host Controller
>>       [    1.739431] xhci_hcd 0021:0d:00.0: new USB bus registered,
>> assigned bus number 1
>>       [    1.794727] Freeing initrd memory: 52928K
>>       [    1.801984] xhci_hcd 0021:0d:00.0: Host halt failed, -110
>>       [    1.801988] xhci_hcd 0021:0d:00.0: can't setup: -110
>>       [    1.802137] xhci_hcd 0021:0d:00.0: USB bus 1 deregistered
>>       [    1.802154] xhci_hcd 0021:0d:00.0: init 0021:0d:00.0 fail, -110
>>       [    1.802250] xhci_hcd 0021:0d:00.0: probe with driver xhci_hcd failed with error -110
> 
> Right, this chip seems stuck and the driver fails to reinitialize it.
> 
>> PS: Claude Sonnet 4.6 cooked up the attached patch, which does *not*
>> help though, but does get it to the return code 0x10, which Claude
>> replied to with:
>>
>>> ● The status change 0x0 → 0x10 is meaningful: 0x10 is PCD (Port Change Detect, bit 4),
>>>    HCHalted=0. The old-kernel reset (from our commit) did take effect …
> 
> Do you mean that running xhci_reset() before kexec() causes the new
> kernel to see 0x10 instead of 0x0 in the status register? Is this
> reproducible, not random or a one time fluke?

It’s reproducible.

> A little odd, one could expect reset to have the opposite effect.
> 
> Is there truly some machine firmware running during kexec() and using
> the HC, as your LLM says?

Sorry, I should have only posted the diff. Claude Sonnet’s assumption, 
that OPAL is involved when kexec’ing is incorrect to my knowledge. Also, 
I do not know, why there is no such problem with the kexec-based 
bootloader Petitboot [1].

> I honestly don't know what to do with this. I think I would start with
> looking whether xhci_shutdown() in the old kernel manages to halt it
> successfully or if it also fails, and what's the USBSTS there.
> 
> It seems that you can get such information by enabling dynamic debug
> 
>    echo 'module xhci_hcd +p' >/proc/dynamic_debug/control
> 
> and capturing old kernel's log up to kexec() through a serial cable.
Unfortunately, nothing is logged over the serial console (BMC SOL) after 
running `sudo kexec -e` or `sudo systemctl reboot`. I just see:

     [69530.180531343,5] OPAL: Switch to big-endian OS
     [69538.407292205,5] OPAL: Switch to little-endian OS

Which is the OPAL firmware, so it might be involved? No idea, if it 
touches the xHCI controller. But strangely no xHCI messages are there – 
also after booting with Petitboot and initialized xHCI controller? No 
idea, if it points to, that during kexec or shutdown nothing is power off?

With `sudo systemctl reboot` only the line below are logged:

     [  121.811384] libvirt-guests.sh[3366]: Running guests on default URI:
     [  121.811988] libvirt-guests.sh[3376]: no running guests.
     [ … (systemd service stop notifications)]
     [  136.254846] systemd-shutdown[1]: Waiting for process: watch_ldconfig
     [  218.549684] reboot: Restarting system
     [69760.484679183,5] OPAL: Reboot request...
       3.55778|Ignoring boot flags, incorrect version 0x0
       3.59881|ISTEP  6. 3

On reboot with dynamic debug enabled for all files under `drivers/usb/`

     [    0.000000] Kernel command line: 
root=UUID=2c3dd738-785a-469b-843e-9f0ba8b47b0d ro rootflags=subvol=@ 
debug dyndbg="file drivers/usb/* +p"

the messages below are logged:

     […]
     [    1.747254] pci 0021:0d:00.0: enabling device (0140 -> 0142)
     [    1.780627] pci 0021:0d:00.0: xHCI HW did not halt within 32000 
usec status = 0x10
     [    2.013904] pci 0021:0d:00.0: quirk_usb_early_handoff+0x0/0x304 
took 260410 usecs
     […]
     [    2.126883] ehci_hcd: block sizes: qh 144 qtd 96 itd 192 sitd 96
     [    2.126979] ohci_hcd: block sizes: ed 112 td 96
     [    2.127558] xhci_hcd 0021:0d:00.0: xHCI Host Controller
     [    2.127629] xhci_hcd 0021:0d:00.0: new USB bus registered, 
assigned bus number 1
     [    2.127791] xhci_hcd 0021:0d:00.0: // Halt the HC
     […]

Please find attached a log of a “Petitboot reboot” with dynamic debug 
enabled and the xHCI controller being initialized.


Kind regards,

Paul


[1]: https://open-power.github.io/petitboot/overview.html

[-- Attachment #2: 2026512--ibm-power-s822lc--system-firmware--petitboot--linux-7.1-rc3+--messages-from-bmc-sol.txt --]
[-- Type: text/plain, Size: 101237 bytes --]

[  OK  ] Reached target Reboot.
[  136.254846] systemd-shutdown[1]: Waiting for process: watch_ldconfig
[  218.549684] reboot: Restarting system
[69760.484679183,5] OPAL: Reboot request...
  3.55778|Ignoring boot flags, incorrect version 0x0
  3.59881|ISTEP  6. 3
  4.07483|ISTEP  6. 4
  4.07573|ISTEP  6. 5
 15.94154|HWAS|PRESENT> DIMM[03]=AAAAAAAAAAAAAAAA
 15.94155|HWAS|PRESENT> Membuf[04]=CCCC000000000000
 15.94155|HWAS|PRESENT> Proc[05]=C000000000000000
 16.04125|ISTEP  6. 6
 16.14925|ISTEP  6. 7
 17.96459|ISTEP  6. 8
 18.00345|ISTEP  6. 9
 19.03391|ISTEP  6.10
 19.06355|ISTEP  6.11
 20.79904|ISTEP  6.12
 20.80057|ISTEP  6.13
 20.80108|ISTEP  7. 1
 20.86926|ISTEP  7. 2
 20.98399|ISTEP  7. 3
 21.01609|ISTEP  7. 4
 21.05662|ISTEP  7. 5
 21.28237|ISTEP  7. 6
 21.31203|ISTEP  7. 7
 21.53382|ISTEP  7. 8
 21.68040|ISTEP  7. 9
 21.68112|ISTEP  8. 1
 21.84613|ISTEP  8. 2
 22.66079|ISTEP  8. 3
 22.67099|ISTEP  8. 4
 22.90594|ISTEP  8. 5
 22.90662|ISTEP  8. 6
 23.51434|ISTEP  8. 7
 23.51485|ISTEP  8. 8
 23.52607|ISTEP  9. 1
 23.96245|ISTEP  9. 2
 24.93432|ISTEP 10. 1
 25.24073|ISTEP 10. 2
 26.57594|ISTEP 10. 3
 26.57670|ISTEP 10. 4
 26.57755|ISTEP 10. 5
 26.58028|ISTEP 10. 6
 26.58096|ISTEP 10. 7
 26.58171|ISTEP 10. 8
 26.58226|ISTEP 10. 9
 26.58371|ISTEP 10.10
 26.58423|ISTEP 10.11
 26.58479|ISTEP 10.12
 26.58554|ISTEP 10.13
 26.58621|ISTEP 10.14
 26.58686|ISTEP 11. 1
 26.91702|ISTEP 11. 2
 26.91770|ISTEP 11. 3
 27.11370|ISTEP 11. 4
 27.31698|ISTEP 11. 5
 27.50244|ISTEP 11. 6
 29.60954|ISTEP 11. 7
 29.61067|ISTEP 11. 8
 30.20078|ISTEP 11. 9
 30.20189|ISTEP 11.10
 30.29292|ISTEP 11.11
 30.29351|ISTEP 11.12
 30.29408|ISTEP 11.13
 30.29708|ISTEP 12. 1
 30.43517|ISTEP 12. 2
 30.51834|ISTEP 12. 3
 30.55074|ISTEP 12. 4
 30.94139|ISTEP 12. 5
 30.94200|ISTEP 13. 1
 31.05412|ISTEP 13. 2
 31.09793|ISTEP 13. 3
 31.09890|ISTEP 13. 4
 31.12123|ISTEP 13. 5
 31.12979|ISTEP 13. 6
 32.74207|ISTEP 13. 7
 33.04061|ISTEP 13. 8
 33.27481|ISTEP 13. 9
 41.39987|ISTEP 13.10
 41.43510|ISTEP 13.11
 41.64725|ISTEP 13.12
 41.64787|ISTEP 14. 1
 41.68187|ISTEP 14. 2
 41.70307|ISTEP 14. 3
 52.76563|ISTEP 14. 4
 52.95543|ISTEP 14. 5
 53.14179|ISTEP 14. 6
 53.15399|ISTEP 14. 7
 53.38434|ISTEP 14. 8
 53.38658|ISTEP 15. 1
 54.58624|ISTEP 15. 2
 54.60815|ISTEP 15. 3
 54.76842|ISTEP 16. 1
 55.98270|ISTEP 16. 2
 56.56017|ISTEP 16. 3
 56.60654|ISTEP 16. 4
 56.59459|ISTEP 18.13
 56.76118|ISTEP 18.14
 56.76014|ISTEP 20. 1
 57.49291|ISTEP 21. 1
 71.35695|htmgt|OCCs are now running in ACTIVE state
 79.91373|ISTEP 21. 2
 79.91461|ISTEP 21. 3
[   80.117982180,5] SkiBoot skiboot-5.4.8-5787ad3 starting...
[   80.117987063,5] initial console log level: memory 7, driver 5
[   80.117990236,6] CPU: P8 generation processor(max 8 threads/core)
[   80.117993016,7] CPU: Boot CPU PIR is 0x0448 PVR is 0x004d0200
[   80.117996115,7] CPU: Initial max PIR set to 0x1fff
[   80.118480557,5] OPAL table: 0x300bfc40 .. 0x300c0110, branch table: 0x30002000
[   80.118487216,5] FDT: Parsing fdt @0xff00000
[   80.125002864,5] XSCOM: chip 0x0 at 0x3fc0000000000 [P8 DD2.0]
[   80.125013978,5] XSCOM: chip 0x8 at 0x3fc4000000000 [P8 DD2.0]
[   80.125022156,6] XSTOP: XSCOM addr = 0x2010c82, FIR bit = 31
[   80.125025715,6] MFSI 0:0: Initialized
[   80.125028115,6] MFSI 0:2: Initialized
[   80.125030391,6] MFSI 0:1: Initialized
[   80.125032997,6] MFSI 8:0: Initialized
[   80.125035229,6] MFSI 8:2: Initialized
[   80.125037501,6] MFSI 8:1: Initialized
[   80.125446754,5] LPC: LPC[000]: Initialized, access via XSCOM @0xb0020
[   80.125594474,5] LPC: LPC: Default bus on chip 0x0
[   80.125781476,6] MEM: parsing reserved memory from node /ibm,hostboot/reserved-memory
[   80.125792012,7] HOMER: Init chip 0
[   80.125795084,7]   PBA BAR0 : 0x000000fffd800000
[   80.125797937,7]   PBA MASK0: 0x0000000000300000
[   80.125800762,7]   HOMER Image at 0xfffd800000 size 4MB
[   80.125804558,7]   PBA BAR2 : 0x400000fffda00000
[   80.125807377,7]   PBA MASK2: 0x0000000000000000
[   80.125809969,7]   SLW Image at 0xfffda00000 size 1MB
[   80.125813596,7]   PBA BAR3 : 0x000000ffff800000
[   80.125816285,7]   PBA MASK3: 0x0000000000700000
[   80.125818974,7]   OCC Common Area at 0xffff800000 size 8MB
[   80.125822027,7] HOMER: Init chip 8
[   80.125824767,7]   PBA BAR0 : 0x000000fffdc00000
[   80.125827488,7]   PBA MASK0: 0x0000000000300000
[   80.125830137,7]   HOMER Image at 0xfffdc00000 size 4MB
[   80.125833953,7]   PBA BAR2 : 0x400000fffde00000
[   80.125836700,7]   PBA MASK2: 0x0000000000000000
[   80.125839337,7]   SLW Image at 0xfffde00000 size 1MB
[   80.125843076,7]   PBA BAR3 : 0x000000ffff800000
[   80.125845799,7]   PBA MASK3: 0x0000000000700000
[   80.125848466,7]   OCC Common Area at 0xffff800000 size 8MB
[   80.125869570,7] CPU idle state device tree init
[   80.125873204,4] SLW: HB-provided idle states property found
[   80.126083282,7] AST: PNOR LPC offset: 0x0c000000
[   80.126166842,5] PLAT: Using virtual UART
[   80.126528216,7] UART: Using LPC IRQ 4
[   80.143999154,5] PLAT: Detected Firestone platform
[   80.144135666,5] PLAT: Detected BMC platform AMI
[   80.148585815,5] CENTAUR: Found centaur for chip 0x0 channel 0
[   80.148699427,5] CENTAUR:   FSI host: 0x0 cMFSI0 port 3
[   80.152233333,5] CENTAUR: Found centaur for chip 0x0 channel 1
[   80.153362406,5] CENTAUR:   FSI host: 0x0 cMFSI0 port 2
[   80.153531603,5] CENTAUR: Found centaur for chip 0x0 channel 4
[   80.153673101,5] CENTAUR:   FSI host: 0x0 cMFSI0 port 7
[   80.153836896,5] CENTAUR: Found centaur for chip 0x0 channel 5
[   80.153979684,5] CENTAUR:   FSI host: 0x0 cMFSI0 port 6
[   80.154127591,5] CENTAUR: Found centaur for chip 0x8 channel 0
[   80.154254399,5] CENTAUR:   FSI host: 0x8 cMFSI0 port 3
[   80.154403686,5] CENTAUR: Found centaur for chip 0x8 channel 1
[   80.154535133,5] CENTAUR:   FSI host: 0x8 cMFSI0 port 2
[   80.154691074,5] CENTAUR: Found centaur for chip 0x8 channel 4
[   80.154829556,5] CENTAUR:   FSI host: 0x8 cMFSI0 port 7
[   80.154989938,5] CENTAUR: Found centaur for chip 0x8 channel 5
[   80.155132165,5] CENTAUR:   FSI host: 0x8 cMFSI0 port 6
[   80.155465473,5] PSI[0x000]: Found PSI bridge [active=0]
[   80.155592181,5] PSI[0x008]: Found PSI bridge [active=0]
[   80.158614429,5] CPU: All 160 processors called in...
[    3.233065494,5] FLASH: Found system flash: Micron N25Qx512Ax id:0
[    3.233233068,5] BT: Interface initialized, IO 0x00e4
[    4.182382675,5] NVRAM: Size is 576 KB
[    4.369080420,5] STB: secure mode off
[    4.369140092,5] STB: trusted mode off
[    4.369566159,5] CAPI: Preloading ucode 200ea
[    4.369639028,5] FLASH: Queueing preload of 2/200ea
[    4.370686865,5] FLASH: Queueing preload of 0/0
[    4.370941121,5] FLASH: Queueing preload of 1/0
[    4.370957164,7] FFS: Partition map size: 0x1000
[    4.389039663,5] STB: sb_verify skipped resource 2, secure_mode=0
[    4.389079966,5] Chip 0 Found PBCQ0 at /xscom@3fc0000000000/pbcq@2012000
[    4.389083430,7] PHB3[0:0]: X[PE]=0x02012000 X[PCI]=0x09012000 X[SPCI]=0x09013c00
[    4.389135807,7] PHB3[0:0] REGS     = 0x0003fffe40000000 [4k]
[    4.392477649,7] PHB3[0:0] PCIBAR   = 0x0003fffe40000000
[    4.392622719,7] PHB3[0:0] MMIO0    = 0x0000200000000000 [0x0000010000000000]
[    4.392760725,7] PHB3[0:0] MMIO1    = 0x00003fe000000000 [0x0000000080000000]
[    4.393095987,5] STB: tb_measure skipped resource 2, trusted_mode=0
[    4.393096019,7] PHB3[0:0] BAREN    = 0xf800000000000000
[    4.393100878,7] PHB3[0:0] NEWBAREN = 0xf800000000000000
[    4.393251009,7] PHB3[0:0] IRSNC    = 0x0100000000000000
[    4.393538459,7] PHB3[0:0] IRSNM    = 0xff00000000000000
[    4.393540047,7] PHB3[0:0] LSI      = 0xff00000000000000
[    4.393549399,5] Chip 0 Found PBCQ1 at /xscom@3fc0000000000/pbcq@2012400
[    4.393552740,7] PHB3[0:1]: X[PE]=0x02012400 X[PCI]=0x09012400 X[SPCI]=0x09013c40
[    4.393684174,7] PHB3[0:1] REGS     = 0x0003fffe40100000 [4k]
[    4.394560018,5] Chip 8 Found PBCQ0 at /xscom@3fc4000000000/pbcq@2012000
[    4.420029039,5] Chip 8 Found PBCQ1 at /xscom@3fc4000000000/pbcq@2012400
[    4.498102214,5] Chip 8 Found PBCQ2 at /xscom@3fc4000000000/pbcq@2012800
[    5.307139256,3] PHB#0000: Base location code not found !
[   12.195095370,3] PHB#0001: Base location code not found !
[   14.099757254,5] STB: sb_verify skipped resource 0, secure_mode=0
[   14.099765189,7] BT: seq 0x06 netfn 0x06 cmd 0x2e: Message sent to host
[   14.103404449,5] STB: tb_measure skipped resource 0, trusted_mode=0
[   14.106082703,3] FLASH: No ROOTFS partition
[   14.106082366,7] PHB#0001: Default system config: 0x441100fc30000000
[   14.106085028,7] PHB#0001: New system config    : 0x441000fc30000000
[   14.106086927,7] PHB#0001: PHB_RESET is 0x0000000000000000
[   14.106380480,7] PHB#0001: Waiting for DLP PG reset to complete...
[   14.116134664,3] PHB#0020: Base location code not found !
[   14.177545774,3] PHB#0021: Base location code not found !
[   14.239001217,3] PHB#0022: Base location code not found !
[   14.300659349,5] PCI: Resetting PHBs...
[   15.403506378,5] PCI: Probing slots...
[   17.050652146,5] PHB#0000:00:00.0 [ROOT] 1014 03dc R:00 C:060400 B:01..ff SLOT=Slot5 
[   17.057843060,5] PHB#0001:00:00.0 [ROOT] 1014 03dc R:00 C:060400 B:01..01 SLOT=Slot4 
[   17.058056959,5] PHB#0001:01:00.0 [EP  ] 14e4 168a R:10 C:020000 (      ethernet) LOC_CODE=Slot4
[   17.058399770,5] PHB#0001:01:00.1 [EP  ] 14e4 168a R:10 C:020000 (      ethernet) LOC_CODE=Slot4
[   17.058581757,5] PHB#0001:01:00.2 [EP  ] 14e4 168a R:10 C:020000 (      ethernet) LOC_CODE=Slot4
[   17.058821871,5] PHB#0001:01:00.3 [EP  ] 14e4 168a R:10 C:020000 (      ethernet) LOC_CODE=Slot4
[   17.059004337,5] PHB#0020:00:00.0 [ROOT] 1014 03dc R:00 C:060400 B:01..ff SLOT=Slot2 
[   17.063433559,5] PHB#0021:00:00.0 [ROOT] 1014 03dc R:00 C:060400 B:01..15 SLOT=Backplane PLX 
[   17.066253618,5] PHB#0021:01:00.0 [SWUP] 10b5 8725 R:ca C:060400 B:02..15 LOC_CODE=Backplane PLX
[   17.066560945,5] PHB#0021:02:01.0 [SWDN] 10b5 8725 R:ca C:060400 B:03..07 SLOT=Slot3 
[   17.066717637,5] PHB#0021:02:08.0 [SWDN] 10b5 8725 R:ca C:060400 B:08..0c 
[   17.066874277,5] PHB#0021:02:09.0 [SWDN] 10b5 8725 R:ca C:060400 B:0d..0d SLOT=Backplane USB 
[   17.067106465,5] PHB#0021:0d:00.0 [EP  ] 104c 8241 R:02 C:0c0330 (      usb-xhci) LOC_CODE=Backplane USB
[   17.067297268,5] PHB#0021:02:0a.0 [SWDN] 10b5 8725 R:ca C:060400 B:0e..0e SLOT=Backplane SATA 
[   17.067533050,5] PHB#0021:0e:00.0 [LGCY] 1b4b 9235 R:11 C:010601 (          sata) LOC_CODE=Backplane SATA
[   17.067730570,5] PHB#0021:02:0b.0 [SWDN] 10b5 8725 R:ca C:060400 B:0f..10 SLOT=Backplane BMC 
[   17.067947977,5] PHB#0021:0f:00.0 [ETOX] 1a03 1150 R:03 C:060400 B:10..10 LOC_CODE=Backplane BMC
[   17.068186999,5] PHB#0021:10:00.0 [PCID] 1a03 2000 R:30 C:030000 (           vga) LOC_CODE=Backplane BMC
[   17.068365599,5] PHB#0021:02:0c.0 [SWDN] 10b5 8725 R:ca C:060400 B:11..15 
[   17.068521160,5] PHB#0021:01:00.1 [EP  ] 10b5 87d0 R:ca C:088000 (system-peripheral) LOC_CODE=Backplane PLX
[   17.068771935,5] PHB#0021:01:00.2 [EP  ] 10b5 87d0 R:ca C:088000 (system-peripheral) LOC_CODE=Backplane PLX
[   17.069032903,5] PHB#0021:01:00.3 [EP  ] 10b5 87d0 R:ca C:088000 (system-peripheral) LOC_CODE=Backplane PLX
[   17.081235104,5] PHB#0021:01:00.4 [EP  ] 10b5 87d0 R:ca C:088000 (system-peripheral) LOC_CODE=Backplane PLX
[   17.081682809,5] PHB#0022:00:00.0 [ROOT] 1014 03dc R:00 C:060400 B:01..ff SLOT=Slot1 
[   17.082095871,5] Releasing unused memory:
 Petitboot (v1.4.4-e414dbe)                           8335-GCA 781329A
 ──────────────────────────────────────────────────────────────────────────────
    Ubuntu, with Linux 6.18.0 (recovery mode)
    Ubuntu, with Linux 6.18.0
    Ubuntu, with Linux 7.1.0-rc2+ (recovery mode)                              
    Ubuntu, with Linux 7.1.0-rc2+               
    Ubuntu, with Linux 7.1.0-rc3+ (recovery mode)
    Ubuntu, with Linux 7.1.0-rc3+
    Ubuntu, with Linux 7.1.0-rc3-00003-g25aa150d26ed (recovery mode)           
    Ubuntu, with Linux 7.1.0-rc3-00003-g25aa150d26ed
    Ubuntu, with Linux 7.1.0-rc3-00004-g3cc4dd04d913 (recovery mode)           
 *  Ubuntu, with Linux 7.1.0-rc3-00004-g3cc4dd04d913                
    Ubuntu, with Linux 7.1.0-rc3-00004-g6ce87c477add (recovery mode)
    Ubuntu, with Linux 7.1.0-rc3-00004-g6ce87c477add
    Ubuntu

  System information
  System configuration
  System status log
  Language
  Rescan devices
 ──────────────────────────────────────────────────────────────────────────────
 Enter=accept, e=edit, n=new, x=exit, l=language, g=log, h=help
The system is going down NOW!
Sent SIGTERM to all processes
Sent SIGKILL to all processes
[  262.992689] kexec_core: Starting new kernel
[  285.266465642,5] OPAL: Switch to big-endian OS
[  288.033408942,5] OPAL: Switch to little-endian OS
[    0.000000] hash-mmu: Page sizes from device-tree:
[    0.000000] hash-mmu: base_shift=12: shift=12, sllp=0x0000, avpnm=0x00000000, tlbiel=1, penc=0
[    0.000000] hash-mmu: base_shift=12: shift=16, sllp=0x0000, avpnm=0x00000000, tlbiel=1, penc=7
[    0.000000] hash-mmu: base_shift=12: shift=24, sllp=0x0000, avpnm=0x00000000, tlbiel=1, penc=56
[    0.000000] hash-mmu: base_shift=16: shift=16, sllp=0x0110, avpnm=0x00000000, tlbiel=1, penc=1
[    0.000000] hash-mmu: base_shift=16: shift=24, sllp=0x0110, avpnm=0x00000000, tlbiel=1, penc=8
[    0.000000] hash-mmu: base_shift=20: shift=20, sllp=0x0130, avpnm=0x00000000, tlbiel=0, penc=2
[    0.000000] hash-mmu: base_shift=24: shift=24, sllp=0x0100, avpnm=0x00000001, tlbiel=0, penc=0
[    0.000000] hash-mmu: base_shift=34: shift=34, sllp=0x0120, avpnm=0x000007ff, tlbiel=0, penc=3
[    0.000000] Enabling pkeys with max key count 32
[    0.000000] Activating Kernel Userspace Access Prevention
[    0.000000] Activating Kernel Userspace Execution Prevention
[    0.000000] hash-mmu: Page orders: linear mapping = 24, virtual = 16, io = 16, vmemmap = 24
[    0.000000] hash-mmu: Using 1TB segments
[    0.000000] hash-mmu: Initializing hash mmu with SLB
[    0.000000] Linux version 7.1.0-rc3-00004-g3cc4dd04d913 (pmenzel@flughafenberlinbrandenburgwillybrandt.molgen.mpg.de) (gcc (Ubuntu 11.2.0-7ubuntu2) 11.2.0, GNU ld (GNU Binut
ils for Ubuntu) 2.37) #24 SMP PREEMPT Mon May 11 23:54:48 CEST 2026
[    0.000000] OF: reserved mem: 0x0000000039c00000..0x000000003a7801ff (11776 KiB) map non-reusable ibm,firmware-allocs-memory@39c00000
[    0.000000] OF: reserved mem: 0x0000008000000000..0x0000008000c401ff (12544 KiB) map non-reusable ibm,firmware-allocs-memory@8000000000
[    0.000000] OF: reserved mem: 0x0000000030000000..0x00000000302fffff (3072 KiB) map non-reusable ibm,firmware-code@30000000
[    0.000000] OF: reserved mem: 0x0000000031000000..0x0000000031bfffff (12288 KiB) map non-reusable ibm,firmware-data@31000000
[    0.000000] OF: reserved mem: 0x0000000030300000..0x0000000030ffffff (13312 KiB) map non-reusable ibm,firmware-heap@30300000
[    0.000000] OF: reserved mem: 0x0000000031c00000..0x0000000032ddffff (18304 KiB) map non-reusable ibm,firmware-stacks@31c00000
[    0.000000] OF: reserved mem: 0x000000fffd440000..0x000000fffd6bffff (2560 KiB) map non-reusable ibm,hbrt-code-image@fffd440000
[    0.000000] OF: reserved mem: 0x000000fffd6c0000..0x000000fffd6fffff (256 KiB) map non-reusable ibm,hbrt-target-image@fffd6c0000
[    0.000000] OF: reserved mem: 0x000000fffd700000..0x000000fffd7fffff (1024 KiB) map non-reusable ibm,hbrt-vpd-image@fffd700000
[    0.000000] OF: reserved mem: 0x000000fffd800000..0x000000fffdbfffff (4096 KiB) map non-reusable ibm,homer-image@fffd800000
[    0.000000] OF: reserved mem: 0x000000fffdc00000..0x000000fffdffffff (4096 KiB) map non-reusable ibm,homer-image@fffdc00000
[    0.000000] OF: reserved mem: 0x000000ffff800000..0x000000ffffffffff (8192 KiB) map non-reusable ibm,occ-common-area@ffff800000
[    0.000000] Found initrd at 0xc000000004500000:0xc0000000078b46ac
[    0.000000] OPAL: Found non-mapped LPC bus on chip 0
[    0.000000] Hardware name: 8335-GCA POWER8 (raw) 0x4d0200 opal:skiboot-5.4.8-5787ad3 PowerNV
[    0.000000] printk: legacy bootconsole [udbg0] enabled
[    0.000000] CPU maps initialized for 8 threads per core
[    0.000000]  (thread shift is 3)
[    0.000000] Allocated 5760 bytes for 160 pacas
[    0.000000] -----------------------------------------------------
[    0.000000] phys_mem_size     = 0x10000000000
[    0.000000] dcache_bsize      = 0x80
[    0.000000] icache_bsize      = 0x80
[    0.000000] cpu_features      = 0x000000fb8f5db187
[    0.000000]   possible        = 0x003ffbfbcf5fb187
[    0.000000]   always          = 0x0000000380008181
[    0.000000] cpu_user_features = 0xdc0065c2 0xef000000
[    0.000000] mmu_features      = 0x7c006e01
[    0.000000]   possible        = 0x00000000fe00fe41
[    0.000000]   always          = 0x0000000000000000
[    0.000000] firmware_features = 0x0000000110000000
[    0.000000] vmalloc start     = 0xc008000000000000
[    0.000000] IO start          = 0xc00a000000000000
[    0.000000] vmemmap start     = 0xc00c000000000000
[    0.000000] hash-mmu: ppc64_pft_size    = 0x0
[    0.000000] hash-mmu: htab_hash_mask    = 0x7fffff
[    0.000000] -----------------------------------------------------
[    0.000000] NODE_DATA(0) allocated [mem 0x7fff934780-0x7fff93bfff]
[    0.000000] NODE_DATA(8) allocated [mem 0xffff07d880-0xffff0850ff]
[    0.000000] rfi-flush: ori type flush available
[    0.000000] rfi-flush: patched 13 locations (ori type flush)
[    0.000000] count-cache-flush: flush disabled.
[    0.000000] link-stack-flush: software flush enabled.
[    0.000000] entry-flush: patched 61 locations (no flush)
[    0.000000] uaccess-flush: patched 1 locations (no flush)
[    0.000000] stf-barrier: hwsync barrier available
[    0.000000] stf-barrier: patched 61 entry locations (hwsync barrier)
[    0.000000] stf-barrier: patched 13 exit locations (hwsync barrier)
[    0.000000] OPAL nvram setup, 589824 bytes
[    0.000000] barrier-nospec: using ORI speculation barrier
[    0.000000] barrier-nospec: patched 298 locations
[    0.000000] Top of RAM: 0x10000000000, Total RAM: 0x10000000000
[    0.000000] Memory hole size: 0MB
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000000000000-0x000000ffffffffff]
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x0000007fffffffff]
[    0.000000]   node   8: [mem 0x0000008000000000-0x000000ffffffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x0000007fffffffff]
[    0.000000] Initmem setup node 8 [mem 0x0000008000000000-0x000000ffffffffff]
[    0.000000] percpu: Embedded 3 pages/cpu s126744 r0 d69864 u262144
[    0.000000] pcpu-alloc: s126744 r0 d69864 u262144 alloc=1*1048576
[    0.000000] pcpu-alloc: [0] 000 001 002 003 [0] 004 005 006 007 
[    0.000000] pcpu-alloc: [0] 008 009 010 011 [0] 012 013 014 015 
[    0.000000] pcpu-alloc: [0] 016 017 018 019 [0] 020 021 022 023 
[    0.000000] pcpu-alloc: [0] 024 025 026 027 [0] 028 029 030 031 
[    0.000000] pcpu-alloc: [0] 032 033 034 035 [0] 036 037 038 039 
[    0.000000] pcpu-alloc: [0] 040 041 042 043 [0] 044 045 046 047 
[    0.000000] pcpu-alloc: [0] 048 049 050 051 [0] 052 053 054 055 
[    0.000000] pcpu-alloc: [0] 056 057 058 059 [0] 060 061 062 063 
[    0.000000] pcpu-alloc: [0] 064 065 066 067 [0] 068 069 070 071 
[    0.000000] pcpu-alloc: [0] 072 073 074 075 [0] 076 077 078 079 
[    0.000000] pcpu-alloc: [1] 080 081 082 083 [1] 084 085 086 087 
[    0.000000] pcpu-alloc: [1] 088 089 090 091 [1] 092 093 094 095 
[    0.000000] pcpu-alloc: [1] 096 097 098 099 [1] 100 101 102 103 
[    0.000000] pcpu-alloc: [1] 104 105 106 107 [1] 108 109 110 111 
[    0.000000] pcpu-alloc: [1] 112 113 114 115 [1] 116 117 118 119 
[    0.000000] pcpu-alloc: [1] 120 121 122 123 [1] 124 125 126 127 
[    0.000000] pcpu-alloc: [1] 128 129 130 131 [1] 132 133 134 135 
[    0.000000] pcpu-alloc: [1] 136 137 138 139 [1] 140 141 142 143 
[    0.000000] pcpu-alloc: [1] 144 145 146 147 [1] 148 149 150 151 
[    0.000000] pcpu-alloc: [1] 152 153 154 155 [1] 156 157 158 159 
[    0.000000] Kernel command line: root=UUID=2c3dd738-785a-469b-843e-9f0ba8b47b0d ro rootflags=subvol=@ debug dyndbg="file drivers/usb/* +p"
[    0.000000] printk: log_buf_len individual max cpu contribution: 4096 bytes
[    0.000000] printk: log_buf_len total cpu_extra contributions: 651264 bytes
[    0.000000] printk: log_buf_len min size: 131072 bytes
[    0.000000] printk: log buffer data + meta data: 1048576 + 4456448 = 5505024 bytes
[    0.000000] printk: early log buf free: 123848(94%)
[    0.000000] kvm_cma_reserve: reserving 52428 MiB for global area
[    0.000000] cma: Reserved 52428 MiB at 0x0000000100000000
[    0.000000] Fallback order for Node 0: 0 8 
[    0.000000] Fallback order for Node 8: 8 0 
[    0.000000] Built 2 zonelists, mobility grouping on.  Total pages: 16777216
[    0.000000] Policy zone: Normal
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] stackdepot: allocating hash table via alloc_large_system_hash
[    0.000000] stackdepot hash table entries: 1048576 (order: 8, 16777216 bytes, linear)
[    0.000000] stackdepot: allocating space for 8191 stack pools via memblock
[    0.000000] SLUB: HWalign=128, Order=0-3, MinObjects=0, CPUs=160, Nodes=9
[    0.000000] ftrace: allocating 51243 entries in 13 pages
[    0.000000] ftrace: allocated 13 pages with 3 groups
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=2048 to nr_cpu_ids=160.
[    0.000000] 	Trampoline variant of Tasks RCU enabled.
[    0.000000] 	Rude variant of Tasks RCU enabled.
[    0.000000] 	Tracing variant of Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=160
[    0.000000] RCU Tasks: Setting shift to 8 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=160.
[    0.000000] RCU Tasks Rude: Setting shift to 8 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=160.
[    0.000000] NR_IRQS: 512, nr_irqs: 512, preallocated irqs: 16
[    0.000000] ICS OPAL backend registered
[    0.000000] rcu: srcu_init: Setting srcu_struct sizes to big.
[    0.000000] time_init: decrementer frequency = 512.000000 MHz
[    0.000000] time_init: processor frequency   = 2926.000000 MHz
[    0.000001] clocksource: timebase: mask: 0xffffffffffffffff max_cycles: 0x761537d007, max_idle_ns: 440795202126 ns
[    0.003491] clocksource: timebase mult[1f40000] shift[24] registered
[    0.008809] clockevent: decrementer mult[83126e98] shift[32] cpu[0]
[    0.015631] Console: colour dummy device 80x25
[    0.017004] printk: legacy console [hvc0] enabled
[    0.017004] printk: legacy console [hvc0] enabled
[    0.021370] printk: legacy bootconsole [udbg0] disabled
[    0.021370] printk: legacy bootconsole [udbg0] disabled
[    0.038285] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    0.038504] pid_max: default: 163840 minimum: 1280
[    0.164384] Yama: becoming mindful.
[    0.164589] SELinux:  Initializing.
[    0.220509] TOMOYO Linux initialized
[    0.254463] Dentry cache hash table entries: 33554432 (order: 12, 268435456 bytes, vmalloc)
[    0.267078] Inode-cache hash table entries: 16777216 (order: 11, 134217728 bytes, vmalloc)
[    0.273921] Mount-cache hash table entries: 524288 (order: 6, 4194304 bytes, vmalloc)
[    0.274529] Mountpoint-cache hash table entries: 524288 (order: 6, 4194304 bytes, vmalloc)
[    0.281139] VFS: Finished mounting rootfs on nullfs
[    0.326152] POWER8 performance monitor hardware support registered
[    0.326910] rcu: Hierarchical SRCU implementation.
[    0.326965] rcu: 	Max phase no-delay instances is 1000.
[    0.327402] Timer migration: 4 hierarchy levels; 8 children per group; 3 crossnode level
[    0.342095] smp: Bringing up secondary CPUs ...
[    0.696127] smp: Brought up 2 nodes, 160 CPUs
[    0.696378] numa: Node 0 CPUs: 0-79
[    0.696577] numa: Node 8 CPUs: 80-159
[    0.739633] Memory: 1017120960K/1073741824K available (22080K kernel code, 3392K rwdata, 10688K rodata, 8768K init, 4181K bss, 2361920K reserved, 53690368K cma-reserved)
[    0.775343] devtmpfs: initialized
[    1.118274] Initializing IODA2 PHB (/pciex@3fffe40000000)
[    1.118564] PCI host bridge /pciex@3fffe40000000 (primary) ranges:
[    1.118806]  MEM 0x00003fe000000000..0x00003fe07ffeffff -> 0x0000000080000000 
[    1.119430]  MEM 0x0000200000000000..0x000020ffffffffff -> 0x0000200000000000 (M64 #0..15)
[    1.119548]  Using M64 #15 as default window
[    1.119740]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    1.119927]                  M64: 0x10000000000 [segment=0x100000000]
[    1.119967]   Allocated bitmap for 2040 MSIs (base IRQ 0x800)
[    1.121788] Initializing IODA2 PHB (/pciex@3fffe40100000)
[    1.121969] PCI host bridge /pciex@3fffe40100000  ranges:
[    1.122164]  MEM 0x00003fe080000000..0x00003fe0fffeffff -> 0x0000000080000000 
[    1.122611]  MEM 0x0000210000000000..0x000021ffffffffff -> 0x0000210000000000 (M64 #0..15)
[    1.122651]  Using M64 #15 as default window
[    1.122723]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    1.122757]                  M64: 0x10000000000 [segment=0x100000000]
[    1.122802]   Allocated bitmap for 2040 MSIs (base IRQ 0x1000)
[    1.124618] Initializing IODA2 PHB (/pciex@3fffe41000000)
[    1.124886] PCI host bridge /pciex@3fffe41000000  ranges:
[    1.124929]  MEM 0x00003fe800000000..0x00003fe87ffeffff -> 0x0000000080000000 
[    1.125375]  MEM 0x0000240000000000..0x000024ffffffffff -> 0x0000240000000000 (M64 #0..15)
[    1.125453]  Using M64 #15 as default window
[    1.125676]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    1.125710]                  M64: 0x10000000000 [segment=0x100000000]
[    1.125748]   Allocated bitmap for 2040 MSIs (base IRQ 0x10800)
[    1.127651] Initializing IODA2 PHB (/pciex@3fffe41100000)
[    1.127977] PCI host bridge /pciex@3fffe41100000  ranges:
[    1.128173]  MEM 0x00003fe880000000..0x00003fe8fffeffff -> 0x0000000080000000 
[    1.128801]  MEM 0x0000250000000000..0x000025ffffffffff -> 0x0000250000000000 (M64 #0..15)
[    1.128920]  Using M64 #15 as default window
[    1.129102]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    1.129286]                  M64: 0x10000000000 [segment=0x100000000]
[    1.129324]   Allocated bitmap for 2040 MSIs (base IRQ 0x11000)
[    1.131385] Initializing IODA2 PHB (/pciex@3fffe41200000)
[    1.131519] PCI host bridge /pciex@3fffe41200000  ranges:
[    1.131715]  MEM 0x00003fe900000000..0x00003fe97ffeffff -> 0x0000000080000000 
[    1.132159]  MEM 0x0000260000000000..0x000026ffffffffff -> 0x0000260000000000 (M64 #0..15)
[    1.132199]  Using M64 #15 as default window
[    1.132288]   256 (255) PE's M32: 0x80000000 [segment=0x800000]
[    1.132475]                  M64: 0x10000000000 [segment=0x100000000]
[    1.132513]   Allocated bitmap for 2040 MSIs (base IRQ 0x11800)
[    1.136944] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    1.137280] posixtimers hash table entries: 131072 (order: 5, 2097152 bytes, vmalloc)
[    1.141234] futex hash table entries: 32768 (4194304 bytes on 2 NUMA nodes, total 8192 KiB, linear).
[    1.211915] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    1.213962] audit: initializing netlink subsys (disabled)
[    1.214353] audit: type=2000 audit(1778566019.192:1): state=initialized audit_enabled=0 res=1
[    1.217966] thermal_sys: Registered thermal governor 'fair_share'
[    1.217976] thermal_sys: Registered thermal governor 'bang_bang'
[    1.218126] thermal_sys: Registered thermal governor 'step_wise'
[    1.218233] thermal_sys: Registered thermal governor 'user_space'
[    1.218436] cpuidle: using governor ladder
[    1.218713] cpuidle: using governor menu
[    1.220227] pstore: Using crash dump compression: deflate
[    1.220295] pstore: Registered nvram as persistent store backend
[    1.224911] EEH: PowerNV platform initialized
[    1.413432] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    1.429436] HugeTLB: registered 16.0 MiB page size, pre-allocated 0 apges
[  [    1.429961] HugeTLB: 0 KiB vmemmap can be freed for a 16.0 GiB [    1.454285] iommu: Default domain type: Translated
[    1.454428] iommu: DMA [    1.473059] SCSI subsystem initialized
[    1.473435] libata version 3.00 loade[    1.473667] usbcore: registered new interface driver usbfs
[ 1] usbcore: registered new interface driver hub
[    1.474069] usbcore: registered new device driver usb
[    1.474233] pps_core: LinuxPPS API ver. 1 registered
[    1.474287] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    1.474314] PTP clock support registered
[    1.475096] EDAC MC: Ver: 3.0.0
[    1.477117] NetLabel: Initializing
[    1.477134] NetLabel:  domain hash size = 128
[    1.477146] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    1.477364] NetLabel:  unlabeled traffic allowed by default
[    1.477571] PCI: Probing PCI hardware
[    1.477820] PCI host bridge to bus 0000:00
[    1.477919] pci_bus 0000:00: root bus resource [mem 0x3fe000000000-0x3fe07ffeffff] (bus address [0x80000000-0xfffeffff])
[    1.477943] pci_bus 0000:00: root bus resource [mem 0x200000000000-0x20fdffffffff 64bit pref]
[    1.477965] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.477979] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to ff
[    1.478046] pci 0000:00:00.0: [1014:03dc] type 01 class 0x060400 PCIe Root Port
[    1.478103] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[    1.478374] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    1.481241] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[    1.481408] pci_bus 0000:00: busn_res: [bus 00-ff] end is updated to ff
[    1.481781] PCI host bridge to bus 0001:00
[    1.481810] pci_bus 0001:00: root bus resource [mem 0x3fe080000000-0x3fe0fffeffff] (bus address [0x80000000-0xfffeffff])
[    1.481833] pci_bus 0001:00: root bus resource [mem 0x210000000000-0x21fdffffffff 64bit pref]
[    1.481854] pci_bus 0001:00: root bus resource [bus 00-ff]
[    1.481866] pci_bus 0001:00: busn_res: [bus 00-ff] end is updated to ff
[    1.482055] pci 0001:00:00.0: [1014:03dc] type 01 class 0x060400 PCIe Root Port
[    1.482111] pci 0001:00:00.0: PCI bridge to [bus 01]
[    1.482136] pci 0001:00:00.0:   bridge window [mem 0x3fe080000000-0x3fe0807fffff]
[    1.482294] pci 0001:00:00.0:   bridge window [mem 0x210000000000-0x2100ffffffff 64bit pref]
[    1.482544] pci 0001:00:00.0: PME# supported from D0 D3hot D3cold
[    1.484548] pci 0001:01:00.0: [14e4:168a] type 00 class 0x020000 PCIe Endpoint
[    1.484636] pci 0001:01:00.0: BAR 0 [mem 0x210000000000-0x2100007fffff 64bit pref]
[    1.484658] pci 0001:01:00.0: BAR 2 [mem 0x210000800000-0x210000ffffff 64bit pref]
[    1.484680] pci 0001:01:00.0: BAR 4 [mem 0x210004000000-0x21000400ffff 64bit pref]
[    1.484700] pci 0001:01:00.0: ROM [mem 0x00000000-0x0003ffff pref]
[    1.484921] pci 0001:01:00.0: PME# supported from D0 D3hot D3cold
[    1.496189] pci 0001:01:00.1: [14e4:168a] type 00 class 0x020000 PCIe Endpoint
[    1.496278] pci 0001:01:00.1: BAR 0 [mem 0x210001000000-0x2100017fffff 64bit pref]
[    1.496300] pci 0001:01:00.1: BAR 2 [mem 0x210001800000-0x210001ffffff 64bit pref]
[    1.496322] pci 0001:01:00.1: BAR 4 [mem 0x210004010000-0x21000401ffff 64bit pref]
[    1.496341] pci 0001:01:00.1: ROM [mem 0x00000000-0x0003ffff pref]
[    1.496557] pci 0001:01:00.1: PME# supported from D0 D3hot D3cold
[    1.508234] pci 0001:01:00.2: [14e4:168a] type 00 class 0x020000 PCIe Endpoint
[    1.508323] pci 0001:01:00.2: BAR 0 [mem 0x210002000000-0x2100027fffff 64bit pref]
[    1.508479] pci 0001:01:00.2: BAR 2 [mem 0x210002800000-0x210002ffffff 64bit pref]
[    1.508501] pci 0001:01:00.2: BAR 4 [mem 0x210004020000-0x21000402ffff 64bit pref]
[    1.508522] pci 0001:01:00.2: ROM [mem 0x00000000-0x0003ffff pref]
[    1.508736] pci 0001:01:00.2: PME# supported from D0 D3hot D3cold
[    1.520387] pci 0001:01:00.3: [14e4:168a] type 00 class 0x020000 PCIe Endpoint
[    1.520477] pci 0001:01:00.3: BAR 0 [mem 0x210003000000-0x2100037fffff 64bit pref]
[    1.520499] pci 0001:01:00.3: BAR 2 [mem 0x210003800000-0x210003ffffff 64bit pref]
[    1.520521] pci 0001:01:00.3: BAR 4 [mem 0x210004030000-0x21000403ffff 64bit pref]
[    1.520541] pci 0001:01:00.3: ROM [mem 0x00000000-0x0003ffff pref]
[    1.520756] pci 0001:01:00.3: PME# supported from D0 D3hot D3cold
[    1.539898] pci 0001:01:00.0: ASPM: default states L0s
[    1.540016] pci 0001:00:00.0: PCI bridge to [bus 01]
[    1.540058] pci_bus 0001:00: busn_res: [bus 00-ff] end is updated to 01
[    1.540223] PCI host bridge to bus 0020:00
[    1.540235] pci_bus 0020:00: root bus resource [mem 0x3fe800000000-0x3fe87ffeffff] (bus address [0x80000000-0xfffeffff])
[    1.540258] pci_bus 0020:00: root bus resource [mem 0x240000000000-0x24fdffffffff 64bit pref]
[    1.540280] pci_bus 0020:00: root bus resource [bus 00-ff]
[    1.540293] pci_bus 0020:00: busn_res: [bus 00-ff] end is updated to ff
[    1.540353] pci 0020:00:00.0: [1014:03dc] type 01 class 0x060400 PCIe Root Port
[    1.540417] pci 0020:00:00.0: PCI bridge to [bus 01-ff]
[    1.540561] pci 0020:00:00.0: PME# supported from D0 D3hot D3cold
[    1.542392] pci 0020:00:00.0: PCI bridge to [bus 01-ff]
[    1.542437] pci_bus 0020:00: busn_res: [bus 00-ff] end is updated to ff
[    1.546295] PCI host bridge to bus 0021:00
[    1.546308] pci_bus 0021:00: root bus resource [mem 0x3fe880000000-0x3fe8fffeffff] (bus address [0x80000000-0xfffeffff])
[    1.546330] pci_bus 0021:00: root bus resource [mem 0x250000000000-0x25fdffffffff 64bit pref]
[    1.546351] pci_bus 0021:00: root bus resource [bus 00-ff]
[    1.546364] pci_bus 0021:00: busn_res: [bus 00-ff] end is updated to ff
[    1.546425] pci 0021:00:00.0: [1014:03dc] type 01 class 0x060400 PCIe Root Port
[    1.546481] pci 0021:00:00.0: PCI bridge to [bus 01-15]
[    1.546507] pci 0021:00:00.0:   bridge window [mem 0x3fe880000000-0x3fe8837fffff]
[    1.546541] pci 0021:00:00.0:   bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]
[    1.546656] pci 0021:00:00.0: PME# supported from D0 D3hot D3cold
[    1.548565] pci 0021:01:00.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Upstream Port
[    1.548623] pci 0021:01:00.0: BAR 0 [mem 0x3fe883000000-0x3fe88303ffff]
[    1.548646] pci 0021:01:00.0: PCI bridge to [bus 02-15]
[    1.548673] pci 0021:01:00.0:   bridge window [mem 0x3fe880000000-0x3fe882ffffff]
[    1.548708] pci 0021:01:00.0:   bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]
[    1.548953] pci 0021:01:00.0: PME# supported from D0 D3hot D3cold
[    1.549367] pci 0021:01:00.1: [10b5:87d0] type 00 class 0x088000 PCIe Endpoint
[    1.549451] pci 0021:01:00.1: BAR 0 [mem 0x3fe883040000-0x3fe883041fff]
[    1.549491] pci 0021:01:00.1: enabling Extended Tags
[    1.549543] pci 0021:01:00.1: BAR 0 [mem size 0x00002000]: requesting alignment to 0x10000
[    1.549917] pci 0021:01:00.2: [10b5:87d0] type 00 class 0x088000 PCIe Endpoint
[    1.550001] pci 0021:01:00.2: BAR 0 [mem 0x3fe883042000-0x3fe883043fff]
[    1.550041] pci 0021:01:00.2: enabling Extended Tags
[    1.550093] pci 0021:01:00.2: BAR 0 [mem size 0x00002000]: requesting alignment to 0x10000
[    1.550479] pci 0021:01:00.3: [10b5:87d0] type 00 class 0x088000 PCIe Endpoint
[    1.550567] pci 0021:01:00.3: BAR 0 [mem 0x3fe883044000-0x3fe883045fff]
[    1.550607] pci 0021:01:00.3: enabling Extended Tags
[    1.550660] pci 0021:01:00.3: BAR 0 [mem size 0x00002000]: requesting alignment to 0x10000
[    1.551044] pci 0021:01:00.4: [10b5:87d0] type 00 class 0x088000 PCIe Endpoint
[    1.551130] pci 0021:01:00.4: BAR 0 [mem 0x3fe883046000-0x3fe883047fff]
[    1.551171] pci 0021:01:00.4: enabling Extended Tags
[    1.551224] pci 0021:01:00.4: BAR 0 [mem size 0x00002000]: requesting alignment to 0x10000
[    1.551579] pci 0021:00:00.0: PCI bridge to [bus 01-15]
[    1.551855] pci 0021:02:01.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.551928] pci 0021:02:01.0: PCI bridge to [bus 03-07]
[    1.551956] pci 0021:02:01.0:   bridge window [mem 0x3fe880000000-0x3fe8807fffff]
[    1.551991] pci 0021:02:01.0:   bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]
[    1.552253] pci 0021:02:01.0: PME# supported from D0 D3hot D3cold
[    1.552968] pci 0021:02:08.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.560126] pci 0021:02:08.0: PCI bridge to [bus 08-0c]
[    1.560417] pci 0021:02:08.0: PME# supported from D0 D3hot D3cold
[    1.561158] pci 0021:02:09.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.561815] pci 0021:02:09.0: PCI bridge to [bus 0d]
[    1.562299] pci 0021:02:09.0:   bridge window [mem 0x3fe880800000-0x3fe880ffffff]
[    1.563134] pci 0021:02:09.0: PME# supported from D0 D3hot D3cold
[    1.588467] pci 0021:02:0a.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.589016] pci 0021:02:0a.0: PCI bridge to [bus 0e]
[    1.589503] pci 0021:02:0a.0:   bridge window [mem 0x3fe881000000-0x3fe8817fffff]
[    1.590290] pci 0021:02:0a.0: PME# supported from D0 D3hot D3cold
[    1.591118] pci 0021:02:0b.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.591673] pci 0021:02:0b.0: PCI bridge to [bus 0f-10]
[    1.591702] pci 0021:02:0b.0:   bridge window [mem 0x3fe881800000-0x3fe882ffffff]
[    1.592923] pci 0021:02:0b.0: PME# supported from D0 D3hot D3cold
[    1.613140] pci 0021:02:0c.0: [10b5:8725] type 01 class 0x060400 PCIe Switch Downstream Port
[    1.629394] pci 0021:02:0c.0: PCI bridge to [bus 11-15]
[    1.630229] pci 0021:02:0c.0: PME# supported from D0 D3hot D3cold
[    1.632512] pci 0021:01:00.0: PCI bridge to [bus 02-15]
[    1.632719] pci 0021:02:01.0: PCI bridge to [bus 03-07]
[    1.632920] pci 0021:02:08.0: PCI bridge to [bus 08-0c]
[    1.638010] pci 0021:0d:00.0: [104c:8241] type 00 class 0x0c0330 PCIe Endpoint
[    1.638479] pci 0021:0d:00.0: BAR 0 [mem 0x3fe880800000-0x3fe88080ffff 64bit]
[    1.639419] pci 0021:0d:00.0: BAR 2 [mem 0x3fe880810000-0x3fe880811fff 64bit]
[    1.640652] pci 0021:0d:00.0: BAR 2 [mem size 0x00002000 64bit]: requesting alignment to 0x10000
[    1.641822] pci 0021:0d:00.0: supports D1 D2
[    1.642329] pci 0021:0d:00.0: PME# supported from D0 D1 D2 D3hot
[    1.649805] pci 0021:0d:00.0: ASPM: default states L1
[    1.649862] pci 0021:02:09.0: PCI bridge to [bus 0d]
[    1.650261] pci 0021:0e:00.0: [1b4b:9235] type 00 class 0x010601 PCIe Legacy Endpoint
[    1.650364] pci 0021:0e:00.0: BAR 0 [io  0x8000-0x8007]
[    1.650381] pci 0021:0e:00.0: BAR 1 [io  0x8040-0x8043]
[    1.650671] pci 0021:0e:00.0: BAR 2 [io  0x8100-0x8107]
[    1.651222] pci 0021:0e:00.0: BAR 3 [io  0x8140-0x8143]
[    1.651750] pci 0021:0e:00.0: BAR 4 [io  0x800000-0x80001f]
[    1.652274] pci 0021:0e:00.0: BAR 5 [mem 0x3fe881010000-0x3fe8810107ff]
[    1.652867] pci 0021:0e:00.0: ROM [mem 0x3fe8d0000000-0x3fe8d000ffff pref]
[    1.676961] pci 0021:0e:00.0: Enabling fixed DMA alias to 00.1
[    1.677419] pci 0021:0e:00.0: BAR 5 [mem size 0x00000800]: requesting alignment to 0x10000
[    1.678049] pci 0021:0e:00.0: PME# supported from D3hot
[    1.684944] pci 0021:0e:00.0: ASPM: default states L1
[    1.684972] pci 0021:02:0a.0: PCI bridge to [bus 0e]
[    1.685217] pci 0021:0f:00.0: [1a03:1150] type 01 class 0x060400 PCIe to PCI/PCI-X bridge
[    1.685299] pci 0021:0f:00.0: PCI bridge to [bus 10]
[    1.685334] pci 0021:0f:00.0:   bridge window [mem 0x3fe881800000-0x3fe882ffffff]
[    1.685412] pci 0021:0f:00.0: enabling Extended Tags
[    1.685605] pci 0021:0f:00.0: supports D1 D2
[    1.685618] pci 0021:0f:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    1.685910] pci 0021:0f:00.0: disabling ASPM on pre-1.1 PCIe device.  You can enable it with 'pcie_aspm=force'
[    1.689075] pci 0021:02:0b.0: PCI bridge to [bus 0f-10]
[    1.698486] pci_bus 0021:10: extended config space not accessible
[    1.708296] pci 0021:10:00.0: [1a03:2000] type 00 class 0x030000 conventional PCI endpoint
[    1.709359] pci 0021:10:00.0: BAR 0 [mem 0x3fe882000000-0x3fe882ffffff]
[    1.709796] pci 0021:10:00.0: BAR 1 [mem 0x3fe881800000-0x3fe88181ffff]
[    1.710360] pci 0021:10:00.0: BAR 2 [io  0x0000-0x007f]
[    1.710942] pci 0021:10:00.0: supports D1 D2
[    1.710954] pci 0021:10:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    1.713641] pci 0021:0f:00.0: PCI bridge to [bus 10]
[    1.713871] pci 0021:02:0c.0: PCI bridge to [bus 11-15]
[    1.713991] pci_bus 0021:00: busn_res: [bus 00-ff] end is updated to 15
[    1.728088] PCI host bridge to bus 0022:00
[    1.728101] pci_bus 0022:00: root bus resource [mem 0x3fe900000000-0x3fe97ffeffff] (bus address [0x80000000-0xfffeffff])
[    1.729596] pci_bus 0022:00: root bus resource [mem 0x260000000000-0x26fdffffffff 64bit pref]
[    1.730796] pci_bus 0022:00: root bus resource [bus 00-ff]
[    1.731862] pci_bus 0022:00: busn_res: [bus 00-ff] end is updated to ff
[    1.732574] pci 0022:00:00.0: [1014:03dc] type 01 class 0x060400 PCIe Root Port
[    1.747368] pci 0022:00:00.0: PCI bridge to [bus 01-ff]
[    1.748074] pci 0022:00:00.0: PME# supported from D0 D3hot D3cold
[    1.750379] pci 0022:00:00.0: PCI bridge to [bus 01-ff]
[    1.759156] pci_bus 0022:00: busn_res: [bus 00-ff] end is updated to ff
[    1.759638] pci 0000:00:00.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 01-ff] (unused)
[    1.760640] pci 0000:00:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 01-ff] (unused)
[    1.761651] pci 0000:00:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff] to [bus 01-ff] (unused)
[    1.762688] pci 0000:00:00.0: PCI bridge to [bus 01-ff]
[    1.781323] pci_bus 0000:00: resource 4 [mem 0x3fe000000000-0x3fe07ffeffff]
[    1.781766] pci_bus 0000:00: resource 5 [mem 0x200000000000-0x20fdffffffff 64bit pref]
[    1.782327] pci_bus 0000:01: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    1.788685] pci_bus 0000:01: resource 1 [mem 0x00000000-0xffffffffffffffff disabled]
[    1.789667] pci_bus 0000:01: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.790173] pci 0001:00:00.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 01] (unused)
[    1.791223] pci 0001:00:00.0: bridge window [mem 0x00800000-0x007fffff] to [bus 01] add_size 800000 add_align 800000
[    1.792273] pci 0001:00:00.0: bridge window [mem 0x210000000000-0x2100ffffffff 64bit pref]: assigned
[    1.792876] pci 0001:00:00.0: bridge window [mem 0x3fe080000000-0x3fe0807fffff]: assigned
[    1.808046] pci 0001:01:00.0: BAR 0 [mem 0x210000000000-0x2100007fffff 64bit pref]: assigned
[    1.808543] pci 0001:01:00.0: BAR 2 [mem 0x210000800000-0x210000ffffff 64bit pref]: assigned
[    1.809568] pci 0001:01:00.1: BAR 0 [mem 0x210001000000-0x2100017fffff 64bit pref]: assigned
[    1.810100] pci 0001:01:00.1: BAR 2 [mem 0x210001800000-0x210001ffffff 64bit pref]: assigned
[    1.811100] pci 0001:01:00.2: BAR 0 [mem 0x210002000000-0x2100027fffff 64bit pref]: assigned
[    1.811660] pci 0001:01:00.2: BAR 2 [mem 0x210002800000-0x210002ffffff 64bit pref]: assigned
[    1.812666] pci 0001:01:00.3: BAR 0 [mem 0x210003000000-0x2100037fffff 64bit pref]: assigned
[    1.839149] pci 0001:01:00.3: BAR 2 [mem 0x210003800000-0x210003ffffff 64bit pref]: assigned
[    1.840940] pci 0001:01:00.0: ROM [mem 0x3fe080000000-0x3fe08003ffff pref]: assigned
[    1.841441] pci 0001:01:00.1: ROM [mem 0x3fe080040000-0x3fe08007ffff pref]: assigned
[    1.841969] pci 0001:01:00.2: ROM [mem 0x3fe080080000-0x3fe0800bffff pref]: assigned
[    1.856089] pci 0001:01:00.3: ROM [mem 0x3fe0800c0000-0x3fe0800fffff pref]: assigned
[    1.856603] pci 0001:01:00.0: BAR 4 [mem 0x210004000000-0x21000400ffff 64bit pref]: assigned
[    1.857181] pci 0001:01:00.1: BAR 4 [mem 0x210004010000-0x21000401ffff 64bit pref]: assigned
[    1.858197] pci 0001:01:00.2: BAR 4 [mem 0x210004020000-0x21000402ffff 64bit pref]: assigned
[    1.858715] pci 0001:01:00.3: BAR 4 [mem 0x210004030000-0x21000403ffff 64bit pref]: assigned
[    1.859765] pci 0001:00:00.0: PCI bridge to [bus 01]
[    1.860260] pci 0001:00:00.0:   bridge window [mem 0x3fe080000000-0x3fe0ffefffff]
[    1.860769] pci 0001:00:00.0:   bridge window [mem 0x210000000000-0x21fdfff0ffff 64bit pref]
[    1.861819] pci_bus 0001:00: resource 4 [mem 0x3fe080000000-0x3fe0fffeffff]
[    1.862318] pci_bus 0001:00: resource 5 [mem 0x210000000000-0x21fdffffffff 64bit pref]
[    1.862894] pci_bus 0001:01: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    1.869212] pci_bus 0001:01: resource 1 [mem 0x3fe080000000-0x3fe0ffefffff]
[    1.870223] pci_bus 0001:01: resource 2 [mem 0x210000000000-0x21fdfff0ffff 64bit pref]
[    1.870746] pci 0020:00:00.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 01-ff] (unused)
[    1.871781] pci 0020:00:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 01-ff] (unused)
[    1.872829] pci 0020:00:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff] to [bus 01-ff] (unused)
[    1.897860] pci 0020:00:00.0: PCI bridge to [bus 01-ff]
[    1.897887] pci_bus 0020:00: resource 4 [mem 0x3fe800000000-0x3fe87ffeffff]
[    1.898881] pci_bus 0020:00: resource 5 [mem 0x240000000000-0x24fdffffffff 64bit pref]
[    1.899395] pci_bus 0020:01: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    1.899919] pci_bus 0020:01: resource 1 [mem 0x00000000-0xffffffffffffffff disabled]
[    1.900970] pci_bus 0020:01: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    1.901510] pci 0021:02:01.0: bridge window [io  0x1000-0x0fff] to [bus 03-07] add_size 1000
[    1.902565] pci 0021:02:01.0: bridge window [mem 0x100000000-0xffffffff 64bit pref] to [bus 03-07] add_size 100000000 add_align 100000000
[    1.907250] pci 0021:02:01.0: bridge window [mem 0x00800000-0x007fffff] to [bus 03-07] add_size 800000 add_align 800000
[    1.908276] pci 0021:02:08.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 08-0c] (unused)
[    1.909313] pci 0021:02:08.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 08-0c] (unused)
[    1.910401] pci 0021:02:08.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff] to [bus 08-0c] (unused)
[    1.910871] pci 0021:02:09.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 0d] (unused)
[    1.911858] pci 0021:02:09.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 0d] (unused)
[    1.934590] pci 0021:02:0a.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 0e] (unused)
[    1.937715] pci 0021:0f:00.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 10] (unused)
[    1.938757] pci 0021:02:0b.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 0f-10] (unused)
[    1.939789] pci 0021:02:0c.0: disabling bridge window [io  0x0000-0xffffffffffffffff] to [bus 11-15] (unused)
[    1.940307] pci 0021:02:0c.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff 64bit pref] to [bus 11-15] (unused)
[    1.941336] pci 0021:02:0c.0: disabling bridge window [mem 0x00000000-0xffffffffffffffff] to [bus 11-15] (unused)
[    1.942392] pci 0021:01:00.0: bridge window [io  0x1000-0x2fff] to [bus 02-15] add_size 1000
[    1.947244] pci 0021:01:00.0: bridge window [mem 0x100000000-0xffffffff 64bit pref] to [bus 02-15] add_size 100000000 add_align 100000000
[    1.948305] pci 0021:01:00.0: bridge window [mem 0x00800000-0x02ffffff] to [bus 02-15] add_size 800000 add_align 800000
[    1.949318] pci 0021:00:00.0: bridge window [io  0x1000-0x2fff] to [bus 01-15] add_size 1000
[    1.949846] pci 0021:00:00.0: bridge window [mem 0x100000000-0xffffffff 64bit pref] to [bus 01-15] add_size 100000000 add_align 100000000
[    1.950883] pci 0021:00:00.0: bridge window [mem 0x00800000-0x037fffff] to [bus 01-15] add_size 800000 add_align 800000
[    1.951979] pci 0021:00:00.0: bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]: assigned
[    1.957261] pci 0021:00:00.0: bridge window [mem 0x3fe880000000-0x3fe8837fffff]: assigned
[    1.957758] pci 0021:00:00.0: bridge window [io  size 0x3000]: can't assign; no space
[    1.958799] pci 0021:00:00.0: bridge window [io  size 0x3000]: failed to assign
[    1.959329] pci 0021:00:00.0: bridge window [io  size 0x2000]: can't assign; no space
[    1.959843] pci 0021:00:00.0: bridge window [io  size 0x2000]: failed to assign
[    1.960880] pci 0021:01:00.0: bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]: assigned
[    1.961397] pci 0021:01:00.0: bridge window [mem 0x3fe880000000-0x3fe882ffffff]: assigned
[    1.962372] pci 0021:01:00.0: BAR 0 [mem 0x3fe883000000-0x3fe88303ffff]: assigned
[    1.978126] pci 0021:01:00.1: BAR 0 [mem 0x3fe883040000-0x3fe883041fff]: assigned
[    1.979136] pci 0021:01:00.2: BAR 0 [mem 0x3fe883050000-0x3fe883051fff]: assigned
[    1.980472] pci 0021:01:00.3: BAR 0 [mem 0x3fe883060000-0x3fe883061fff]: assigned
[    1.981001] pci 0021:01:00.4: BAR 0 [mem 0x3fe883070000-0x3fe883071fff]: assigned
[    1.981533] pci 0021:01:00.0: bridge window [io  size 0x3000]: can't assign; no space
[    1.982616] pci 0021:01:00.0: bridge window [io  size 0x3000]: failed to assign
[    2.005393] pci 0021:01:00.0: bridge window [io  size 0x2000]: can't assign; no space
[    2.007959] pci 0021:01:00.0: bridge window [io  size 0x2000]: failed to assign
[    2.008496] pci 0021:02:01.0: bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]: assigned
[    2.009509] pci 0021:02:0b.0: bridge window [mem 0x3fe880000000-0x3fe8817fffff]: assigned
[    2.010536] pci 0021:02:01.0: bridge window [mem 0x3fe881800000-0x3fe881ffffff]: assigned
[    2.011030] pci 0021:02:09.0: bridge window [mem 0x3fe882000000-0x3fe8827fffff]: assigned
[    2.011554] pci 0021:02:0a.0: bridge window [mem 0x3fe882800000-0x3fe882ffffff]: assigned
[    2.012638] pci 0021:02:01.0: bridge window [io  size 0x1000]: can't assign; no space
[    2.017534] pci 0021:02:01.0: bridge window [io  size 0x1000]: failed to assign
[    2.018054] pci 0021:02:0a.0: bridge window [io  size 0x1000]: can't assign; no space
[    2.019073] pci 0021:02:0a.0: bridge window [io  size 0x1000]: failed to assign
[    2.019604] pci 0021:02:0b.0: bridge window [io  size 0x1000]: can't assign; no space
[    2.020640] pci 0021:02:0b.0: bridge window [io  size 0x1000]: failed to assign
[    2.021164] pci 0021:02:0a.0: bridge window [io  size 0x1000]: can't assign; no space
[    2.021700] pci 0021:02:0a.0: bridge window [io  size 0x1000]: failed to assign
[    2.022175] pci 0021:02:0b.0: bridge window [io  size 0x1000]: can't assign; no space
[    2.061650] pci 0021:02:0b.0: bridge window [io  size 0x1000]: failed to assign
[    2.062175] pci 0021:02:01.0: bridge window [io  size 0x1000]: can't assign; no space
[    2.062708] pci 0021:02:01.0: bridge window [io  size 0x1000]: failed to assign
[    2.097873] pci 0021:02:01.0: PCI bridge to [bus 03-07]
[    2.097892] pci 0021:02:01.0:   bridge window [mem 0x3fe881800000-0x3fe881ffffff]
[    2.098901] pci 0021:02:01.0:   bridge window [mem 0x250000000000-0x2500ffffffff 64bit pref]
[    2.099430] pci 0021:02:08.0: PCI bridge to [bus 08-0c]
[    2.099961] pci 0021:0d:00.0: BAR 0 [mem 0x3fe882000000-0x3fe88200ffff 64bit]: assigned
[    2.100998] pci 0021:0d:00.0: BAR 2 [mem 0x3fe882010000-0x3fe882011fff 64bit]: assigned
[    2.101530] pci 0021:02:09.0: PCI bridge to [bus 0d]
[    2.102080] pci 0021:02:09.0:   bridge window [mem 0x3fe882000000-0x3fe8827fffff]
[    2.102611] pci 0021:0e:00.0: BAR 5 [mem 0x3fe882800000-0x3fe8828007ff]: assigned
[    2.107055] pci 0021:0e:00.0: ROM [mem 0x3fe882810000-0x3fe88281ffff pref]: assigned
[    2.108073] pci 0021:0e:00.0: BAR 4 [io  size 0x0020]: can't assign; no space
[    2.108604] pci 0021:0e:00.0: BAR 4 [io  size 0x0020]: failed to assign
[    2.109130] pci 0021:0e:00.0: BAR 0 [io  size 0x0008]: can't assign; no space
[    2.110175] pci 0021:0e:00.0: BAR 0 [io  size 0x0008]: failed to assign
[    2.110692] pci 0021:0e:00.0: BAR 2 [io  size 0x0008]: can't assign; no space
[    2.111229] pci 0021:0e:00.0: BAR 2 [io  size 0x0008]: failed to assign
[    2.111745] pci 0021:0e:00.0: BAR 1 [io  size 0x0004]: can't assign; no space
[    2.112261] pci 0021:0e:00.0: BAR 1 [io  size 0x0004]: failed to assign
[    2.112837] pci 0021:0e:00.0: BAR 3 [io  size 0x0004]: can't assign; no space
[    2.138526] pci 0021:0e:00.0: BAR 3 [io  size 0x0004]: failed to assign
[    2.139053] pci 0021:0e:00.0: BAR 4 [io  size 0x0020]: can't assign; no space
[    2.139568] pci 0021:0e:00.0: BAR 4 [io  size 0x0020]: failed to assign
[    2.140098] pci 0021:0e:00.0: BAR 0 [io  size 0x0008]: can't assign; no space
[    2.141158] pci 0021:0e:00.0: BAR 0 [io  size 0x0008]: failed to assign
[    2.141719] pci 0021:0e:00.0: BAR 2 [io  size 0x0008]: can't assign; no space
[    2.142224] pci 0021:0e:00.0: BAR 2 [io  size 0x0008]: failed to assign
[    2.142706] pci 0021:0e:00.0: BAR 1 [io  size 0x0004]: can't assign; no space
[    2.147091] pci 0021:0e:00.0: BAR 1 [io  size 0x0004]: failed to assign
[    2.148133] pci 0021:0e:00.0: BAR 3 [io  size 0x0004]: can't assign; no space
[    2.148665] pci 0021:0e:00.0: BAR 3 [io  size 0x0004]: failed to assign
[    2.149198] pci 0021:02:0a.0: PCI bridge to [bus 0e]
[    2.149726] pci 0021:02:0a.0:   bridge window [mem 0x3fe882800000-0x3fe882ffffff]
[    2.150298] pci 0021:0f:00.0: bridge window [mem 0x3fe880000000-0x3fe8817fffff]: assigned
[    2.150810] pci 0021:0f:00.0: bridge window [io  size 0x1000]: can't assign; no space
[    2.151857] pci 0021:0f:00.0: bridge window [io  size 0x1000]: failed to assign
[    2.152391] pci 0021:0f:00.0: bridge window [io  size 0x1000]: can't assign; no space
[    2.177104] pci 0021:0f:00.0: bridge window [io  size 0x1000]: failed to assign
[    2.177595] pci 0021:10:00.0: BAR 0 [mem 0x3fe880000000-0x3fe880ffffff]: assigned
[    2.178139] pci 0021:10:00.0: BAR 1 [mem 0x3fe881000000-0x3fe88101ffff]: assigned
[    2.178646] pci 0021:10:00.0: BAR 2 [io  size 0x0080]: can't assign; no space
[    2.179650] pci 0021:10:00.0: BAR 2 [io  size 0x0080]: failed to assign
[    2.180168] pci 0021:10:00.0: BAR 2 [io  size 0x0080]: can't assign; no space
[    2.180689] pci 0021:10:00.0: BAR 2 [io  size 0x0080]: failed to assign
[    2.181218] pci 0021:0f:00.0: PCI bridge to [bus 10]
[    2.181747] pci 0021:0f:00.0:   bridge window [mem 0x3fe880000000-0x3fe8817fffff]
[    2.182706] pci 0021:02:0b.0: PCI bridge to [bus 0f-10]
[    2.182840] pci 0021:02:0b.0:   bridge window [mem 0x3fe880000000-0x3fe8817fffff]
[    2.188109] pci 0021:02:0c.0: PCI bridge to [bus 11-15]
[    2.188647] pci 0021:01:00.0: PCI bridge to [bus 02-15]
[    2.189204] pci 0021:01:00.0:   bridge window [mem 0x3fe880000000-0x3fe8ffefffff]
[    2.189716] pci 0021:01:00.0:   bridge window [mem 0x250000000000-0x25fdfff0ffff 64bit pref]
[    2.190249] pci 0021:00:00.0: PCI bridge to [bus 01-15]
[    2.190768] pci 0021:00:00.0:   bridge window [mem 0x3fe880000000-0x3fe8ffefffff]
[    2.191806] pci 0021:00:00.0:   bridge window [mem 0x250000000000-0x25fdfff0ffff 64bit pref]
[    2.192358] pci_bus 0021:00: Some PCI device resources are unassigned, try booting with pci=realloc
[    2.224173] pci_bus 0021:00: resource 4 [mem 0x3fe880000000-0x3fe8fffeffff]
[    2.224673] pci_bus 0021:00: resource 5 [mem 0x250000000000-0x25fdffffffff 64bit pref]
[    2.225179] pci_bus 0021:01: resource 0 [io  size 0x2000]
[    2.225688] pci_bus 0021:01: resource 1 [mem 0x3fe880000000-0x3fe8ffefffff]
[    2.226206] pci_bus 0021:01: resource 2 [mem 0x250000000000-0x25fdfff0ffff 64bit pref]
[    2.227223] pci_bus 0021:02: resource 0 [io  size 0x2000]
[    2.227712] pci_bus 0021:02: resource 1 [mem 0x3fe880000000-0x3fe8ffefffff]
[    2.228240] pci_bus 0021:02: resource 2 [mem 0x250000000000-0x25fdfff0ffff 64bit pref]
[    2.228768] pci_bus 0021:03: resource 0 [io  size 0x1000]
[    2.229290] pci_bus 0021:03: resource 1 [mem 0x3fe881800000-0x3fe881ffffff]
[    2.229862] pci_bus 0021:03: resource 2 [mem 0x250000000000-0x2500ffffffff 64bit pref]
[    2.230864] pci_bus 0021:08: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    2.231383] pci_bus 0021:08: resource 1 [mem 0x00000000-0xffffffffffffffff disabled]
[    2.232420] pci_bus 0021:08: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    2.236779] pci_bus 0021:0d: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    2.237273] pci_bus 0021:0d: resource 1 [mem 0x3fe882000000-0x3fe8827fffff]
[    2.238313] pci_bus 0021:0d: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    2.238860] pci_bus 0021:0e: resource 0 [io  size 0x1000]
[    2.239366] pci_bus 0021:0e: resource 1 [mem 0x3fe882800000-0x3fe882ffffff]
[    2.239889] pci_bus 0021:0e: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    2.240938] pci_bus 0021:0f: resource 0 [io  size 0x1000]
[    2.241465] pci_bus 0021:0f: resource 1 [mem 0x3fe880000000-0x3fe8817fffff]
[    2.242003] pci_bus 0021:0f: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    2.259071] pci_bus 0021:10: resource 0 [io  size 0x1000]
[    2.259084] pci_bus 0021:10: resource 1 [mem 0x3fe880000000-0x3fe8817fffff]
[    2.261389] pci_bus 0021:10: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    2.261911] pci_bus 0021:11: resource 0 [io  0x0000-0xffffffffffffffff disabled]
[    2.262439] pci_bus 0021:11: resource 1 [mem 0x00000000-0xffffffffffffffff disabled]
[    2.267243] pci_bus 0021:11: resource 2 [mem 0x00000000-0xffffffffffffffff 64bit pref disabled]
[    2.267777] pci 0022:00:00.0: disabling bridge window [io  0xcondary bus 0x000000000000000d associated with PE#fb
[    2.357640] pci 0021:0d:00.0: Configured PE#fb
[    2.357653] pci 0021:0d     : [PE# fb] Setting up 32-bit TCE table at 0..80000000
[    2.358652] pci 0021:0d     : [PE# fb] Setting up window#0 0..ffffffffff pg=10000
[    2.358674] pci 0021:0d     : [PE# fb] Enabling 64-bit DMA bypass
[    2.358739] pci 0021:0d:00.0: Adding to iommu group 2
[    2.358953] pci_bus 0021:0e: Configuring PE for bus
[    2.358970] pci 0021:0e     : [PE# fa] Secondary bus 0x000000000000000e associated with PE#fa
[    2.359129] pci 0021:0e:00.0: Configured PE#fa
[    2.359141] pci 0021:0e     : [PE# fa] Setting up 32-bit TCE table at 0..80000000
[    2.360124] pci 0021:0e     : [PE# fa] Setting up window#0 0..ffffffffff pg=10000
[    2.360147] pci 0021:0e     : [PE# fa] Enabling 64-bit DMA bypass
[    2.360203] pci 0021:0e:00.0: Adding to iommu group 3
[    2.360382] pci_bus 0021:0f: Configuring PE for bus
[    2.360399] pci 0021:0f     : [PE# f9] Secondary bus 0x000000000000000f associated with PE#f9
[    2.360556] pci 0021:0f:00.0: Configured PE#f9
[    2.360791] pci_bus 0021:10: Configuring PE for bus
[    2.360808] pci 0021:10     : [PE# f8] Secondary bus 0x0000000000000010..0x0000000000000010 associated with PE#f8
[    2.360968] pci 0021:10:00.0: Configured PE#f8
[    2.360981] pci 0021:10     : [PE# f8] Setting up 32-bit TCE table at 0..80000000
[    2.361997] pci 0021:10     : [PE# f8] Setting up window#0 0..ffffffffff pg=10000
[    2.362019] pci 0021:10     : [PE# f8] Enabling 64-bit DMA bypass
[    2.362075] pci 0021:10:00.0: Adding to iommu group 4
[    2.362250] pci_bus 0022:00: Configuring PE for bus
[    2.362263] pci 0022:00     : [PE# fe] Secondary bus 0x0000000000000000 associated with PE#fe
[    2.362423] pci 0022:00:00.0: Configured PE#fe
[    2.362675] pci 0001:00:00.0: enabling device (0141 -> 0143)
[    2.362702] pci 0021:00:00.0: enabling device (0141 -> 0143)
[    2.362729] pci 0021:01:00.0: enabling device (0141 -> 0143)
[    2.362759] pci 0021:02:09.0: enabling device (0141 -> 0143)
[    2.362789] pci 0021:02:0a.0: enabling device (0141 -> 0143)
[    2.362818] pci 0021:02:0b.0: enabling device (0141 -> 0143)
[    2.362850] pci 0021:0f:00.0: enabling device (0141 -> 0143)
[    2.362875] EEH: Capable adapter found: recovery enabled.
[    2.363095] PCI: Probing PCI hardware done
[    2.363220] pci 0021:10:00.0: vgaarb: setting as boot VGA device
[    2.363235] pci 0021:10:00.0: vgaarb: bridge control possible
[    2.363250] pci 0021:10:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[    2.363267] vgaarb: loaded
[    2.364218] clocksource: Switched to clocksource timebase
[    2.366614] random: crng init done
[    2.368674] VFS: Disk quotas dquot_6.6.0
[    2.368948] VFS: Dquot-cache hash table entries: 8192 (order 0, 65536 bytes)
[    2.378899] NET: Registered PF_INET protocol family
[    2.379088] IP idents hash table entries: 262144 (order: 5, 2097152 bytes, vmalloc)
[    2.386366] tcp_listen_portaddr_hash hash table entries: 65536 (order: 4, 1048576 bytes, vmalloc)
[    2.386526] Table-perturb hash table entries: 65536 (order: 2, 262144 bytes, vmalloc)
[    2.386562] TCP established hash table entries: 524288 (order: 6, 4194304 bytes, vmalloc)
[    2.387375] TCP bind hash table entries: 65536 (order: 5, 2097152 bytes, vmalloc)
[    2.387588] TCP: Hash tables configured (established 524288 bind 65536)
[    2.388857] UDP hash table entries: 65536 (order: 6, 4194304 bytes, vmalloc)
[    2.390674] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    2.390778] pci 0021:0d:00.0: enabling device (0140 -> 0142)
[    2.390848] PCI: CLS 0 bytes, default 128
[    2.391065] Trying to unpack rootfs image as initramfs...
[    2.404204] Initialise system trusted keyrings
[    2.404293] Key type blacklist registered
[    2.404465] workingset: timestamp_bits=38 (anon: 34) max_order=24 bucket_order=0 (anon: 0)
[    2.409659] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    2.410968] fuse: init (API version 7.45)
[    2.437376] Key type asymmetric registered
[    2.437410] Asymmetric key parser 'x509' registered
[    2.437801] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244)
[    2.438206] io scheduler mq-deadline registered
[    2.445487] ledtrig-cpu: registered to indicate activity on CPUs
[    2.446235] pci 0021:10:00.0: enabling device (0141 -> 0143)
[    2.446625] hvc0: raw protocol on /ibm,opal/consoles/serial@0 (boot console)
[    2.446652] hvc0: No interrupts property, using OPAL event
[    2.447958] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    2.460379] Non-volatile memory driver v1.3
[    2.518747] loop: module loaded
[    2.521650] tun: Universal TUN/TAP device driver, 1.6
[    2.522001] PPP generic driver version 2.4.2
[    2.522375] VFIO - User Level meta-driver version: 0.3
[    2.522578] ehci_hcd: block sizes: qh 144 qtd 96 itd 192 sitd 96
[    2.522709] ohci_hcd: block sizes: ed 112 td 96
[    2.523433] xhci_hcd 0021:0d:00.0: xHCI Host Controller
[    2.523570] xhci_hcd 0021:0d:00.0: new USB bus registered, assigned bus number 1
[    2.523615] xhci_hcd 0021:0d:00.0: // Halt the HC
[    2.523636] xhci_hcd 0021:0d:00.0: Resetting HCD
[    2.523654] xhci_hcd 0021:0d:00.0: // Reset the HC
[    2.523727] xhci_hcd 0021:0d:00.0: Wait for controller to be ready for doorbell rings
[    2.523872] xhci_hcd 0021:0d:00.0: Reset complete
[    2.523887] xhci_hcd 0021:0d:00.0: iommu: 64-bit OK but direct DMA is limited by 0
[    2.523905] xhci_hcd 0021:0d:00.0: Enabling 64-bit DMA addresses.
[    2.523921] xhci_hcd 0021:0d:00.0: iommu: 64-bit OK but direct DMA is limited by 0
[    2.523942] xhci_hcd 0021:0d:00.0: HCD page size set to 4K
[    2.523956] xhci_hcd 0021:0d:00.0: Starting xhci_mem_init
[    2.523975] xhci_hcd 0021:0d:00.0: Device context base array address = 0x0800008001b40000 (DMA), 000000002cfc5ae9 (virt)
[    2.524089] xhci_hcd 0021:0d:00.0: Allocated command ring at 00000000b7497c78
[    2.524162] xhci_hcd 0021:0d:00.0: Allocating primary event ring
[    2.524191] xhci_hcd 0021:0d:00.0: Allocating 1 scratchpad buffers
[    2.524253] xhci_hcd 0021:0d:00.0: Ext Cap 000000004f63d022, port offset = 1, count = 4, revision = 0x2
[    2.524282] xhci_hcd 0021:0d:00.0: Ext Cap 0000000000d52812, port offset = 5, count = 4, revision = 0x3
[    2.524448] xhci_hcd 0021:0d:00.0: Found 4 USB 2.0 ports and 4 USB 3.0 ports.
[    2.524469] xhci_hcd 0021:0d:00.0: Finished xhci_mem_init
[    2.524483] xhci_hcd 0021:0d:00.0: Starting xhci_init
[    2.524496] xhci_hcd 0021:0d:00.0: xHC can handle at most 64 device slots
[    2.524516] xhci_hcd 0021:0d:00.0: Setting Max device slots reg = 0x40
[    2.524537] xhci_hcd 0021:0d:00.0: Setting command ring address to 0x800008001b50001
[    2.524559] xhci_hcd 0021:0d:00.0: Doorbell array is located at offset 0x5c0 from cap regs base addr
[    2.524734] xhci_hcd 0021:0d:00.0: // Write event ring dequeue pointer, preserving EHB bit
[    2.524751] xhci_hcd 0021:0d:00.0: Finished xhci_init
[    2.524765] xhci_hcd 0021:0d:00.0: hcc params 0x0270f06d hci version 0x96 quirks 0x0000000004000000
[    2.524791] xhci_hcd 0021:0d:00.0: Got SBRN 48
[    2.524805] xhci_hcd 0021:0d:00.0: MWI active
[    2.524818] xhci_hcd 0021:0d:00.0: Finished xhci_pci_reinit
[    2.524831] xhci_hcd 0021:0d:00.0: supports USB remote wakeup
[    2.525430] xhci_hcd 0021:0d:00.0: xhci_run
[    2.525532] xhci_hcd 0021:0d:00.0: ERST deq = 64'h800008001b51000
[    2.525552] xhci_hcd 0021:0d:00.0: Finished xhci_run for main hcd
[    2.525979] xhci_hcd 0021:0d:00.0: xHCI Host Controller
[    2.526066] xhci_hcd 0021:0d:00.0: new USB bus registered, assigned bus number 2
[    2.526087] xhci_hcd 0021:0d:00.0: Host supports USB 3.0 SuperSpeed
[    2.526103] xhci_hcd 0021:0d:00.0: supports USB remote wakeup
[    2.526118] xhci_hcd 0021:0d:00.0: Enable interrupts
[    2.526135] xhci_hcd 0021:0d:00.0: Enable primary interrupter
[    2.526157] xhci_hcd 0021:0d:00.0: // Turn on HC, cmd = 0x5.
[    2.526332] xhci_hcd 0021:0d:00.0: Port change event, 1-3, id 3, portsc: 0x206e1
[    2.526355] xhci_hcd 0021:0d:00.0: handle_port_status: starting usb1 port polling.
[    2.526483] usb usb1: default language 0x0409
[    2.526644] usb usb1: udev 1, busnum 1, minor = 0
[    2.526658] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 7.01
[    2.526677] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.526694] usb usb1: Product: xHCI Host Controller
[    2.526708] usb usb1: Manufacturer: Linux 7.1.0-rc3-00004-g3cc4dd04d913 xhci-hcd
[    2.526876] usb usb1: SerialNumber: 0021:0d:00.0
[    2.527135] usb usb1: usb_probe_device
[    2.527181] usb usb1: configuration #1 chosen from 1 choice
[    2.527200] xHCI xhci_add_endpoint called for root hub
[    2.527214] xHCI xhci_check_bandwidth called for root hub
[    2.527245] usb usb1: adding 1-0:1.0 (config #1, interface 0)
[    2.527459] hub 1-0:1.0: usb_probe_interface
[    2.527474] hub 1-0:1.0: usb_probe_interface - got id
[    2.527488] hub 1-0:1.0: USB hub found
[    2.527525] hub 1-0:1.0: 4 ports detected
[    2.527669] hub 1-0:1.0: standalone hub
[    2.527680] hub 1-0:1.0: individual port power switching
[    2.527694] hub 1-0:1.0: individual port over-current protection
[    2.527708] hub 1-0:1.0: Single TT
[    2.527718] hub 1-0:1.0: TT requires at most 8 FS bit times (666 ns)
[    2.527734] hub 1-0:1.0: power on to power good time: 20ms
[    2.527769] hub 1-0:1.0: local power source is good
[    2.528150] hub 1-0:1.0: enabling power on all ports
[    2.528181] xhci_hcd 0021:0d:00.0: set port power 1-1 ON, portsc: 0x2a0
[    2.528230] xhci_hcd 0021:0d:00.0: set port power 1-2 ON, portsc: 0x2a0
[    2.528268] xhci_hcd 0021:0d:00.0: set port power 1-3 ON, portsc: 0x206e1
[    2.528456] xhci_hcd 0021:0d:00.0: set port power 1-4 ON, portsc: 0x2a0
[    2.528685] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    2.528733] usb usb2: skipped 1 descriptor after endpoint
[    2.528761] usb usb2: default language 0x0409
[    2.528812] usb usb2: udev 1, busnum 2, minor = 128
[    2.528966] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 7.01
[    2.529508] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    2.529791] usb usb2: Product: xHCI Host Controller
[    2.530102] usb usb2: Manufacturer: Linux 7.1.0-rc3-00004-g3cc4dd04d913 xhci-hcd
[    2.530364] usb usb2: SerialNumber: 0021:0d:00.0
[    2.530835] usb usb2: usb_probe_device
[    2.530889] usb usb2: configuration #1 chosen from 1 choice
[    2.531139] xHCI xhci_add_endpoint called for root hub
[    2.531152] xHCI xhci_check_bandwidth called for root hub
[    2.531441] usb usb2: adding 2-0:1.0 (config #1, interface 0)
[    2.531741] hub 2-0:1.0: usb_probe_interface
[    2.531959] hub 2-0:1.0: usb_probe_interface - got id
[    2.532247] hub 2-0:1.0: USB hub found
[    2.532547] hub 2-0:1.0: 4 ports detected
[    2.532692] hub 2-0:1.0: standalone hub
[    2.532875] hub 2-0:1.0: individual port power switching
[    2.533927] hub 2-0:1.0: individual port over-current protection
[    2.534451] hub 2-0:1.0: TT requires at most 8 FS bit times (666 ns)
[    2.534978] hub 2-0:1.0: power on to power good time: 100ms
[    2.535521] hub 2-0:1.0: local power source is good
[    2.536064] usb usb2-port1: peered to usb1-port1
[    2.536615] usb usb2-port2: peered to usb1-port2
[    2.537134] usb usb2-port3: peered to usb1-port3
[    2.537208] usb usb2-port4: peered to usb1-port4
[    2.537619] hub 2-0:1.0: enabling power on all ports
[    2.538171] xhci_hcd 0021:0d:00.0: set port power 2-1 ON, portsc: 0x2a0
[    2.538719] xhci_hcd 0021:0d:00.0: set port power 2-2 ON, portsc: 0x2a0
[    2.539303] xhci_hcd 0021:0d:00.0: set port power 2-3 ON, portsc: 0x2a0
[    2.540350] xhci_hcd 0021:0d:00.0: set port power 2-4 ON, portsc: 0x2a0
[    2.541781] mousedev: PS/2 mouse device common for all mice
[    2.556134] xhci_hcd 0021:0d:00.0: Get port status 1-1 read: 0x2a0, return 0x100
[    2.556179] xhci_hcd 0021:0d:00.0: Get port status 1-2 read: 0x2a0, return 0x100
[    2.556213] xhci_hcd 0021:0d:00.0: Get port status 1-3 read: 0x206e1, return 0x10101
[    2.556237] usb usb1-port3: status 0101 change 0001
[    2.556262] xhci_hcd 0021:0d:00.0: clear port3 connect change, portsc: 0x6e1
[    2.556296] xhci_hcd 0021:0d:00.0: Get port status 1-4 read: 0x2a0, return 0x100
[    2.556357] rtc-opal opal-rtc: registered as rtc0
[    2.572203] rtc-opal opal-rtc: setting system clock to 2026-05-12T06:07:00 UTC (1778566020)
[    2.572325] i2c_dev: i2c /dev entries driver
[    2.580006] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[    2.580378] device-mapper: uevent: version 1.0.3
[    2.581109] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev
[    2.581151] powernv-cpufreq: cpufreq pstate min 0xffffffd5 nominal 0xffffffef max 0x0
[    2.581172] powernv-cpufreq: Workload Optimized Frequency is disabled in the platform
[    2.588393] Freeing initrd memory: 52928K
[    2.598700] powernv_idle_driver registered
[    2.599834] NET: Registered PF_INET6 protocol family
[    2.602893] Segment Routing with IPv6
[    2.602921] In-situ OAM (IOAM) with IPv6
[    2.602962] NET: Registered PF_PACKET protocol family
[    2.603096] Key type dns_resolver registered
[    2.610900] registered taskstats version 1
[    2.622240] Loading compiled-in X.509 certificates
[    2.624030] Loaded X.509 cert 'Build time autogenerated kernel key: 159639d2613889c7180bd55b2c4522e69deecf18'
[    2.643389] Demotion targets for Node 0: null
[    2.643403] Demotion targets for Node 8: null
[    2.643479] kmemleak: Kernel memory leak detector initialized (mem pool available: 5807)
[    2.643483] kmemleak: Automatic memory scanning thread started
[    2.644139] xhci_hcd 0021:0d:00.0: Get port status 2-1 read: 0x2a0, return 0x2a0
[    2.644178] xhci_hcd 0021:0d:00.0: Get port status 2-2 read: 0x2a0, return 0x2a0
[    2.644213] xhci_hcd 0021:0d:00.0: Get port status 2-3 read: 0x2a0, return 0x2a0
[    2.644249] xhci_hcd 0021:0d:00.0: Get port status 2-4 read: 0x2a0, return 0x2a0
[    2.644283] hub 2-0:1.0: state 7 ports 4 chg 0000 evt 0000
[    2.644318] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-1 status  = 0xe0002a0
[    2.644363] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-2 status  = 0xe0002a0
[    2.644408] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-3 status  = 0xe0002a0
[    2.644453] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-4 status  = 0xe0002a0
[    2.644487] hub 2-0:1.0: hub_suspend
[    2.644510] usb usb2: bus auto-suspend, wakeup 1
[    2.644537] usb usb2: suspend raced with wakeup event
[    2.644552] usb usb2: usb auto-resume
[    2.645217] Key type .fscrypt registered
[    2.645232] Key type fscrypt-provisioning registered
[    2.645291] Key type big_key registered
[    2.645306] trusted_key: H_PKS_WRAP_OBJECT interface not supported
[    2.656143] hub 2-0:1.0: hub_resume
[    2.664202] hub 1-0:1.0: state 7 ports 4 chg 0008 evt 0000
[    2.664233] xhci_hcd 0021:0d:00.0: Get port status 1-3 read: 0x6e1, return 0x101
[    2.664267] usb usb1-port3: status 0101, change 0000, 12 Mb/s
[    2.664302] xhci_hcd 0021:0d:00.0: // Ding dong!
[    2.664389] xhci_hcd 0021:0d:00.0: Slot 1 output ctx = 0x08000080194e0000 (dma)
[    2.664416] xhci_hcd 0021:0d:00.0: Slot 1 input ctx = 0x08000080194e1000 (dma)
[    2.664447] xhci_hcd 0021:0d:00.0: Set slot id 1 dcbaa entry 00000000c5c2b320 to 0x8000080194e0000
[    2.664573] xhci_hcd 0021:0d:00.0: set port reset, actual port 1-3 status  = 0x6f1
[    2.664759] Key type encrypted registered
[    2.664776] ima: No TPM chip found, activating TPM-bypass!
[    2.664804] ima: Allocated hash algorithm: sha256
[    2.664855] ima: No architecture policies found
[    2.664952] evm: Initialising EVM extended attributes:
[    2.664966] evm: security.selinux
[    2.664977] evm: security.SMACK64
[    2.664988] evm: security.SMACK64EXEC
[    2.664999] evm: security.SMACK64TRANSMUTE
[    2.665010] evm: security.SMACK64MMAP
[    2.665023] evm: security.apparmor
[    2.665034] evm: security.ima
[    2.665045] evm: security.capability
[    2.665057] evm: HMAC attrs: 0x1
[    2.665137] SED: plpks not available
[    2.667602] PM: genpd: Disabling unused power domains
[    2.667778] integrity: Unable to open file: /etc/keys/x509_ima.der (-2)
[    2.667791] integrity: Unable to open file: /etc/keys/x509_evm.der (-2)
[    2.671947] Freeing unused kernel image (initmem) memory: 8768K
[    2.672065] Run /init as init process
[    2.672076]   with arguments:
[    2.672087]     /init
[    2.672095]   with environment:
[    2.672104]     HOME=/
[    2.672112]     TERM=linux
[    2.672131] xhci_hcd 0021:0d:00.0: xhci_hub_status_data: stopping usb1 port polling
Loading, please wait...
+ '[' -z  ]
+ BOOT=local
+ '[' -n  ]
+ '['  '=' none ]
+ resume=
+ mount -t tmpfs -o 'nodev,noexec,nosuid,size=10%,mode=0755' tmpfs /run
+ mkdir -m 0700 /run/initramfs
[    2.684140] xhci_hcd 0021:0d:00.0: Get port status 2-1 read: 0x2a0, return 0x2a0
+ '[' -n[    2.684182] xhci_hcd 0021:0d:00.0: Get port s /run/initramfs/tatus 2-2 read: 0x2a0, return 0x2a0
initramfs.debug[    2.684221] xhci_hcd 0021:0d: ]00.0: Get port status 2-3 read: 0x2a0, return 0x2a0
[    2.697879] xhci_hcd 0021:0d:00.0: Get port status 2-4 read: 0x2a0, return 0x2a0
[    2.698410] hub 2-0:1.0: state 7 ports 4 chg 0000 evt 0000

+ exec
[    2.714881] xhci_hcd 0021:0d:00.0: Port change event, 1-3, id 3, portsc: 0x200e03
[    2.714902] xhci_hcd 0021:0d:00.0: handle_port_status: starting usb1 port polling.
[    2.728139] xhci_hcd 0021:0d:00.0: Get port status 1-3 read: 0x200e03, return 0x100503
[    2.728175] xhci_hcd 0021:0d:00.0: clear port3 reset change, portsc: 0xe03
[    2.788127] usb 1-3: new high-speed USB device number 2 using xhci_hcd
[    2.788149] xhci_hcd 0021:0d:00.0: Slot ID 1: HW portnum 2, hcd portnum 2
[    2.788163] xhci_hcd 0021:0d:00.0: udev->tt = 0000000000000000
[    2.788177] xhci_hcd 0021:0d:00.0: udev->ttport = 0x0
[    2.788190] xhci_hcd 0021:0d:00.0: // Ding dong!
[    2.788231] xhci_hcd 0021:0d:00.0: Successful setup context command
[    2.788251] xhci_hcd 0021:0d:00.0: Op regs DCBAA ptr = 0x800008001b40000
[    2.788265] xhci_hcd 0021:0d:00.0: Slot ID 1 dcbaa entry @00000000c5c2b320 = 0x8000080194e0000
[    2.788283] xhci_hcd 0021:0d:00.0: Output Context DMA address = 0x8000080194e0000
[    2.788299] xhci_hcd 0021:0d:00.0: Internal device address = 0
[    2.788470] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    2.788614] xhci_hcd 0021:0d:00.0: set port reset, actual port 1-3 status  = 0xe11
[    2.838839] xhci_hcd 0021:0d:00.0: Port change event, 1-3, id 3, portsc: 0x200e03
[    2.838861] xhci_hcd 0021:0d:00.0: handle_port_status: starting usb1 port polling.
[    2.856135] xhci_hcd 0021:0d:00.0: Get port status 1-3 read: 0x200e03, return 0x100503
[    2.856170] xhci_hcd 0021:0d:00.0: clear port3 reset change, portsc: 0xe03
[    2.900145] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-1 status  = 0xe0002a0
[    2.900185] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-2 status  = 0xe0002a0
[    2.900223] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-3 status  = 0xe0002a0
[    2.900257] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-4 status  = 0xe0002a0
[    2.900285] hub 2-0:1.0: hub_suspend
[    2.900300] usb usb2: bus auto-suspend, wakeup 1
[    2.900324] usb usb2: suspend raced with wakeup event
[    2.900335] usb usb2: usb auto-resume
[    2.912136] hub 2-0:1.0: hub_resume
[    2.916129] xhci_hcd 0021:0d:00.0: xhci_hub_status_data: stopping usb1 port polling
[    2.916148] xhci_hcd 0021:0d:00.0: Resetting device with slot ID 1
[    2.916166] xhci_hcd 0021:0d:00.0: // Ding dong!
[    2.916191] xhci_hcd 0021:0d:00.0: Completed reset device command.
[    2.916213] xhci_hcd 0021:0d:00.0: Can't reset device (slot ID 1) in default state
[    2.916229] xhci_hcd 0021:0d:00.0: Not freeing device rings.
[    2.916249] xhci_hcd 0021:0d:00.0: // Ding dong!
[    2.916355] xhci_hcd 0021:0d:00.0: Successful setup address command
[    2.916375] xhci_hcd 0021:0d:00.0: Op regs DCBAA ptr = 0x800008001b40000
[    2.916388] xhci_hcd 0021:0d:00.0: Slot ID 1 dcbaa entry @00000000c5c2b320 = 0x8000080194e0000
[    2.916406] xhci_hcd 0021:0d:00.0: Output Context DMA address = 0x8000080194e0000
[    2.916421] xhci_hcd 0021:0d:00.0: Internal device address = 1
[    2.936133] xhci_hcd 0021:0d:00.0: Get port status 2-1 read: 0x2a0, return 0x2a0
[    2.936165] xhci_hcd 0021:0d:00.0: Get port status 2-2 read: 0x2a0, return 0x2a0
[    2.936197] xhci_hcd 0021:0d:00.0: Get port status 2-3 read: 0x2a0, return 0x2a0
[    2.936226] xhci_hcd 0021:0d:00.0: Get port status 2-4 read: 0x2a0, return 0x2a0
[    2.936251] hub 2-0:1.0: state 7 ports 4 chg 0000 evt 0000
[    2.976978] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    2.977111] usb 1-3: default language 0x0009
[    2.977353] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    2.977727] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    2.978103] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    2.978237] usb 1-3: udev 2, busnum 1, minor = 1
[    2.978250] usb 1-3: New USB device found, idVendor=046b, idProduct=ff01, bcdDevice= 1.00
[    2.978267] usb 1-3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    2.978283] usb 1-3: Product: Virtual Hub
[    2.978293] usb 1-3: Manufacturer: American Megatrends Inc.
[    2.978305] usb 1-3: SerialNumber: serial
[    2.978599] usb 1-3: usb_probe_device
[    2.978610] usb 1-3: configuration #1 chosen from 1 choice
[    2.978640] xhci_hcd 0021:0d:00.0: add ep 0x81, slot id 1, new drop flags = 0x0, new add flags = 0x8
[    2.978660] xhci_hcd 0021:0d:00.0: xhci_check_bandwidth called for udev 000000005a007bef
[    2.978680] xhci_hcd 0021:0d:00.0: // Ding dong!
[    2.982354] xhci_hcd 0021:0d:00.0: Successful Endpoint Configure command
[    2.982420] xhci_hcd 0021:0d:00.0: // Ding dong!
[    2.982455] xhci_hcd 0021:0d:00.0: // Ding dong!
[    2.990724] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    2.990858] usb 1-3: adding 1-3:1.0 (config #1, interface 0)
[    2.991099] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    2.991268] hub 1-3:1.0: usb_probe_interface
[    2.991281] hub 1-3:1.0: usb_probe_interface - got id
[    2.991293] hub 1-3:1.0: USB hub found
[    2.991474] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    2.991608] hub 1-3:1.0: 5 ports detected
[    2.991620] hub 1-3:1.0: standalone hub
[    2.991629] hub 1-3:1.0: individual port power switching
[    2.991640] hub 1-3:1.0: individual port over-current protection
[    2.991654] hub 1-3:1.0: Single TT
[    2.991663] hub 1-3:1.0: TT requires at most 32 FS bit times (2664 ns)
[    2.991677] hub 1-3:1.0: power on to power good time: 100ms
[    2.992358] hub 1-3:1.0: local power source is good
[    2.992658] xhci_hcd 0021:0d:00.0: xHCI version 96 needs hub TT think time and number of ports
[    2.992677] xhci_hcd 0021:0d:00.0: Set up configure endpoint for hub device.
[    2.992694] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.028267] xhci_hcd 0021:0d:00.0: Successful Endpoint Configure command
[    3.029500] hub 1-3:1.0: enabling power on all ports
[    3.061303] ahci 0021:0e:00.0: enabling device (0141 -> 0143)
[    3.061520] ahci 0021:0e:00.0: iommu: 64-bit OK but direct DMA is limited by 0
[    3.061536] ahci 0021:0e:00.0: iommu: 64-bit OK but direct DMA is limited by 0
[    3.071633] ahci 0021:0e:00.0: AHCI vers 0001.0000, 32 command slots, 6 Gbps, SATA mode
[    3.071651] ahci 0021:0e:00.0: 4/4 ports implemented (port mask 0xf)
[    3.071665] ahci 0021:0e:00.0: flags: 64bit ncq sntf led only pmp fbs pio slum part sxs 
[    3.074588] scsi host0: ahci
[    3.075925] scsi host1: ahci
[    3.076771] scsi host2: ahci
[    3.077698] scsi host3: ahci
[    3.078079] ata1: SATA max UDMA/133 abar m2048@0x3fe882800000 port 0x3fe882800100 irq 47 lpm-pol 1 ext
[    3.078099] ata2: SATA max UDMA/133 abar m2048@0x3fe882800000 port 0x3fe882800180 irq 47 lpm-pol 1 ext
[    3.078117] ata3: SATA max UDMA/133 abar m2048@0x3fe882800000 port 0x3fe882800200 irq 47 lpm-pol 1 ext
[    3.078135] ata4: SATA max UDMA/133 abar m2048@0x3fe882800000 port 0x3fe882800280 irq 47 lpm-pol 1 ext
[    3.136492] usb 1-3-port1: status 0501 change 0001
[    3.137114] usb 1-3-port2: status 0501 change 0001
[    3.137738] usb 1-3-port3: status 0501 change 0001
[    3.138364] usb 1-3-port4: status 0301 change 0001
[    3.140144] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-1 status  = 0xe0002a0
[    3.140193] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-2 status  = 0xe0002a0
[    3.140231] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-3 status  = 0xe0002a0
[    3.140270] xhci_hcd 0021:0d:00.0: set port remote wake mask, actual port 2-4 status  = 0xe0002a0
[    3.140297] hub 2-0:1.0: hub_suspend
[    3.140314] usb usb2: bus auto-suspend, wakeup 1
[    3.140339] xhci_hcd 0021:0d:00.0: xhci_hub_status_data: stopping usb2 port polling
[    3.180351] ata3: SATA link down (SStatus 0 SControl 300)
[    3.180446] ata4: SATA link down (SStatus 0 SControl 300)
[    3.240131] usb 1-3: Driver uses different interval (2048 microframes) than xHCI (64 microframes)
[    3.240161] hub 1-3:1.0: state 7 ports 5 chg 001e evt 0000
[    3.240619] usb 1-3-port1: status 0501, change 0000, 480 Mb/s
[    3.240664] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.240697] xhci_hcd 0021:0d:00.0: Slot 2 output ctx = 0x08000080194e2000 (dma)
[    3.240716] xhci_hcd 0021:0d:00.0: Slot 2 input ctx = 0x08000080194e3000 (dma)
[    3.240736] xhci_hcd 0021:0d:00.0: Set slot id 2 dcbaa entry 00000000788ce8cc to 0x8000080194e2000
[    3.340129] usb 1-3.1: new high-speed USB device number 3 using xhci_hcd
[    3.340148] xhci_hcd 0021:0d:00.0: Slot ID 2: HW portnum 2, hcd portnum 2
[    3.340163] xhci_hcd 0021:0d:00.0: udev->tt = 0000000000000000
[    3.340177] xhci_hcd 0021:0d:00.0: udev->ttport = 0x0
[    3.340189] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.340404] xhci_hcd 0021:0d:00.0: Successful setup context command
[    3.340424] xhci_hcd 0021:0d:00.0: Op regs DCBAA ptr = 0x800008001b40000
[    3.340437] xhci_hcd 0021:0d:00.0: Slot ID 2 dcbaa entry @00000000788ce8cc = 0x8000080194e2000
[    3.340455] xhci_hcd 0021:0d:00.0: Output Context DMA address = 0x8000080194e2000
[    3.340471] xhci_hcd 0021:0d:00.0: Internal device address = 0
[    3.340988] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.352140] ata1: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    3.352183] ata2: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    3.352921] ata1.00: ATA-10: ST1000NX0313         00LY266 00LY265IBM, BE33, max UDMA/133
[    3.353074] ata1.00: 1953525168 sectors, multi 0: LBA48 NCQ (depth 32), AA
[    3.353176] ata1.00: Features: DIPM
[    3.353720] ata1.00: configured for UDMA/133
[    3.353738] ata2.00: ATA-10: ST1000NX0313         00LY266 00LY265IBM, BE33, max UDMA/133
[    3.353884] ata2.00: 1953525168 sectors, multi 0: LBA48 NCQ (depth 32), AA
[    3.353985] ata2.00: Features: DIPM
[    3.354140] scsi 0:0:0:0: Direct-Access     ATA      ST1000NX0313     BE33 PQ: 0 ANSI: 5
[    3.354566] ata2.00: configured for UDMA/133
[    3.354920] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    3.355040] sd 0:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[    3.355061] sd 0:0:0:0: [sda] 4096-byte physical blocks
[    3.355111] sd 0:0:0:0: [sda] Write Protect is off
[    3.355149] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    3.355204] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.355276] sd 0:0:0:0: [sda] Preferred minimum I/O size 4096 bytes
[    3.355291] scsi 1:0:0:0: Direct-Access     ATA      ST1000NX0313     BE33 PQ: 0 ANSI: 5
[    3.356106] sd 1:0:0:0: Attached scsi generic sg1 type 0
[    3.356194] sd 1:0:0:0: [sdb] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB)
[    3.356219] sd 1:0:0:0: [sdb] 4096-byte physical blocks
[    3.356252] sd 1:0:0:0: [sdb] Write Protect is off
[    3.356274] sd 1:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    3.356321] sd 1:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    3.356383] sd 1:0:0:0: [sdb] Preferred minimum I/O size 4096 bytes
[    3.436131] xhci_hcd 0021:0d:00.0: Resetting device with slot ID 2
[    3.436155] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.436180] xhci_hcd 0021:0d:00.0: Completed reset device command.
[    3.436199] xhci_hcd 0021:0d:00.0: Can't reset device (slot ID 2) in default state
[    3.436217] xhci_hcd 0021:0d:00.0: Not freeing device rings.
[    3.436235] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.436749] xhci_hcd 0021:0d:00.0: Successful setup address command
[    3.436770] xhci_hcd 0021:0d:00.0: Op regs DCBAA ptr = 0x800008001b40000
[    3.436784] xhci_hcd 0021:0d:00.0: Slot ID 2 dcbaa entry @00000000788ce8cc = 0x8000080194e2000
[    3.436803] xhci_hcd 0021:0d:00.0: Output Context DMA address = 0x8000080194e2000
[    3.436818] xhci_hcd 0021:0d:00.0: Internal device address = 2
[    3.458118] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.458252] usb 1-3.1: default language 0x0409
[    3.458618] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.459118] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.459618] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.459752] usb 1-3.1: udev 3, busnum 1, minor = 2
[    3.459764] usb 1-3.1: New USB device found, idVendor=046b, idProduct=ff20, bcdDevice= 1.00
[    3.459781] usb 1-3.1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    3.459797] usb 1-3.1: Product: Virtual Cdrom Device
[    3.459809] usb 1-3.1: Manufacturer: American Megatrends Inc.
[    3.459823] usb 1-3.1: SerialNumber: AAAABBBBCCCC1
[    3.460018] usb 1-3.1: usb_probe_device
[    3.460031] usb 1-3.1: configuration #1 chosen from 1 choice
[    3.460058] xhci_hcd 0021:0d:00.0: add ep 0x81, slot id 2, new drop flags = 0x0, new add flags = 0x8
[    3.460084] xhci_hcd 0021:0d:00.0: add ep 0x2, slot id 2, new drop flags = 0x0, new add flags = 0x18
[    3.460103] xhci_hcd 0021:0d:00.0: xhci_check_bandwidth called for udev 00000000f8f45ead
[    3.460135] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.460180] xhci_hcd 0021:0d:00.0: Successful Endpoint Configure command
[    3.460262] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.460296] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.460348] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.460382] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.460753] usb 1-3.1: adding 1-3.1:1.0 (config #1, interface 0)
[    3.461118] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.461878] usb 1-3-port2: status 0501, change 0000, 480 Mb/s
[    3.461898] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.461927] xhci_hcd 0021:0d:00.0: Slot 3 output ctx = 0x08000080194e4000 (dma)
[    3.461945] xhci_hcd 0021:0d:00.0: Slot 3 input ctx = 0x08000080194e5000 (dma)
[    3.461967] xhci_hcd 0021:0d:00.0: Set slot id 3 dcbaa entry 00000000ff8a403f to 0x8000080194e4000
[    3.465071] sd 1:0:0:0: [sdb] Attached SCSI disk
[    3.496608]  sda: sda1 sda2
[    3.496899] sd 0:0:0:0: [sda] Attached SCSI disk
[    3.525899] ast 0021:10:00.0: Platform has no I/O space, using MMIO
[    3.525927] ast 0021:10:00.0: Using P2A bridge for configuration
[    3.525941] ast 0021:10:00.0: AST 2400 detected
[    3.526190] ast 0021:10:00.0: [drm] Using analog VGA
[    3.560129] usb 1-3.2: new high-speed USB device number 4 using xhci_hcd
[    3.560254] xhci_hcd 0021:0d:00.0: Slot ID 3: HW portnum 2, hcd portnum 2
[    3.560269] xhci_hcd 0021:0d:00.0: udev->tt = 0000000000000000
[    3.560283] xhci_hcd 0021:0d:00.0: udev->ttport = 0x0
[    3.560295] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.560329] xhci_hcd 0021:0d:00.0: Successful setup context command
[    3.560349] xhci_hcd 0021:0d:00.0: Op regs DCBAA ptr = 0x800008001b40000
[    3.560364] xhci_hcd 0021:0d:00.0: Slot ID 3 dcbaa entry @00000000ff8a403f = 0x8000080194e4000
[    3.560382] xhci_hcd 0021:0d:00.0: Output Context DMA address = 0x8000080194e4000
[    3.560397] xhci_hcd 0021:0d:00.0: Internal device address = 0
[    3.560872] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.576132] [drm] Initialized ast 0.1.0 for 0021:10:00.0 on minor 0
[    3.656635] xhci_hcd 0021:0d:00.0: Resetting device with slot ID 3
[    3.657178] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.657454] xhci_hcd 0021:0d:00.0: Completed reset device command.
[    3.657459] xhci_hcd 0021:0d:00.0: Can't reset device (slot ID 3) in default state
[    3.657843] xhci_hcd 0021:0d:00.0: Not freeing device rings.
[    3.658856] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.660104] xhci_hcd 0021:0d:00.0: Successful setup address command
[    3.660478] xhci_hcd 0021:0d:00.0: Op regs DCBAA ptr = 0x800008001b40000
[    3.660742] xhci_hcd 0021:0d:00.0: Slot ID 3 dcbaa entry @00000000ff8a403f = 0x8000080194e4000
[    3.660811] xhci_hcd 0021:0d:00.0: Output Context DMA address = 0x8000080194e4000
[    3.660814] xhci_hcd 0021:0d:00.0: Internal device address = 3
[    3.665310] Console: switching to colour frame buffer device 128x48
[    3.683518] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.684130] usb 1-3.2: default language 0x0409
[    3.685267] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.687275] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.688892] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.689732] usb 1-3.2: udev 4, busnum 1, minor = 3
[    3.690133] usb 1-3.2: New USB device found, idVendor=046b, idProduct=ff40, bcdDevice= 1.00
[    3.690650] usb 1-3.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    3.690776] usb 1-3.2: Product: Virtual Floppy Device
[    3.690778] usb 1-3.2: Manufacturer: American Megatrends Inc.
[    3.690780] usb 1-3.2: SerialNumber: AAAABBBBCCCC2
[    3.715777] usb 1-3.2: usb_probe_device
[    3.716134] usb 1-3.2: configuration #1 chosen from 1 choice
[    3.717987] xhci_hcd 0021:0d:00.0: add ep 0x81, slot id 3, new drop flags = 0x0, new add flags = 0x8
[    3.719335] xhci_hcd 0021:0d:00.0: add ep 0x2, slot id 3, new drop flags = 0x0, new add flags = 0x18
[    3.719916] xhci_hcd 0021:0d:00.0: xhci_check_bandwidth called for udev 000000008bf27780
[    3.720462] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.720767] xhci_hcd 0021:0d:00.0: Successful Endpoint Configure command
[    3.729276] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.729565] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.731082] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.731385] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.733656] usb 1-3.2: adding 1-3.2:1.0 (config #1, interface 0)
[    3.742144] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.752144] usb 1-3-port3: status 0501, change 0000, 480 Mb/s
[    3.752158] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.752179] xhci_hcd 0021:0d:00.0: Slot 4 output ctx = 0x08000080194e6000 (dma)
[    3.752183] xhci_hcd 0021:0d:00.0: Slot 4 input ctx = 0x08000080194e7000 (dma)
[    3.752191] xhci_hcd 0021:0d:00.0: Set slot id 4 dcbaa entry 000000005d927971 to 0x8000080194e6000
[    3.768731] ast 0021:10:00.0: [drm] fb0: astdrmfb frame buffer device
[    3.852509] usb 1-3.3: new high-speed USB device number 5 using xhci_hcd
[    3.853356] xhci_hcd 0021:0d:00.0: Slot ID 4: HW portnum 2, hcd portnum 2
[    3.854049] xhci_hcd 0021:0d:00.0: udev->tt = 0000000000000000
[    3.854615] xhci_hcd 0021:0d:00.0: udev->ttport = 0x0
[    3.855034] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.856200] xhci_hcd 0021:0d:00.0: Successful setup context command
[    3.856557] xhci_hcd 0021:0d:00.0: Op regs DCBAA ptr = 0x800008001b40000
[    3.856819] xhci_hcd 0021:0d:00.0: Slot ID 4 dcbaa entry @000000005d927971 = 0x8000080194e6000
[    3.857075] xhci_hcd 0021:0d:00.0: Output Context DMA address = 0x8000080194e6000
[    3.857325] xhci_hcd 0021:0d:00.0: Internal device address = 0
[    3.858774] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.952125] xhci_hcd 0021:0d:00.0: Resetting device with slot ID 4
[    3.952130] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.952152] xhci_hcd 0021:0d:00.0: Completed reset device command.
[    3.952156] xhci_hcd 0021:0d:00.0: Can't reset device (slot ID 4) in default state
[    3.952161] xhci_hcd 0021:0d:00.0: Not freeing device rings.
[    3.952169] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.952648] xhci_hcd 0021:0d:00.0: Successful setup address command
[    3.952658] xhci_hcd 0021:0d:00.0: Op regs DCBAA ptr = 0x800008001b40000
[    3.952660] xhci_hcd 0021:0d:00.0: Slot ID 4 dcbaa entry @000000005d927971 = 0x8000080194e6000
[    3.952663] xhci_hcd 0021:0d:00.0: Output Context DMA address = 0x8000080194e6000
[    3.952665] xhci_hcd 0021:0d:00.0: Internal device address = 4
[    3.970141] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.970283] usb 1-3.3: default language 0x0409
[    3.970643] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.971142] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.971642] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.971782] usb 1-3.3: udev 5, busnum 1, minor = 4
[    3.971784] usb 1-3.3: New USB device found, idVendor=046b, idProduct=ff31, bcdDevice= 1.00
[    3.971786] usb 1-3.3: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    3.971788] usb 1-3.3: Product: Virtual HardDisk Device
[    3.971790] usb 1-3.3: Manufacturer: American Megatrends Inc.
[    3.971791] usb 1-3.3: SerialNumber: AAAABBBBCCCC3
[    3.971989] usb 1-3.3: usb_probe_device
[    3.971991] usb 1-3.3: configuration #1 chosen from 1 choice
[    3.972003] xhci_hcd 0021:0d:00.0: add ep 0x81, slot id 4, new drop flags = 0x0, new add flags = 0x8
[    3.972011] xhci_hcd 0021:0d:00.0: add ep 0x2, slot id 4, new drop flags = 0x0, new add flags = 0x18
[    3.972014] xhci_hcd 0021:0d:00.0: xhci_check_bandwidth called for udev 000000009a8d1692
[    3.972019] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.972076] xhci_hcd 0021:0d:00.0: Successful Endpoint Configure command
[    3.972179] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.972221] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.972285] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.972332] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.972784] usb 1-3.3: adding 1-3.3:1.0 (config #1, interface 0)
[    3.973142] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    3.974039] usb 1-3-port4: status 0301, change 0000, 1.5 Mb/s
[    3.974047] xhci_hcd 0021:0d:00.0: // Ding dong!
[    3.974077] xhci_hcd 0021:0d:00.0: Slot 5 output ctx = 0x08000080194e8000 (dma)
[    3.974085] xhci_hcd 0021:0d:00.0: Slot 5 input ctx = 0x08000080194e9000 (dma)
[    3.974091] xhci_hcd 0021:0d:00.0: Set slot id 5 dcbaa entry 000000005170a62d to 0x8000080194e8000
[    4.068512] usb 1-3.4: new low-speed USB device number 6 using xhci_hcd
[    4.069843] xhci_hcd 0021:0d:00.0: Slot ID 5: HW portnum 2, hcd portnum 2
[    4.070573] xhci_hcd 0021:0d:00.0: udev->tt = 0000000025649f96
[    4.070591] xhci_hcd 0021:0d:00.0: udev->ttport = 0x4
[    4.071111] xhci_hcd 0021:0d:00.0: // Ding dong!
[    4.072311] xhci_hcd 0021:0d:00.0: Successful setup context command
[    4.073546] xhci_hcd 0021:0d:00.0: Op regs DCBAA ptr = 0x800008001b40000
[    4.074811] xhci_hcd 0021:0d:00.0: Slot ID 5 dcbaa entry @000000005170a62d = 0x8000080194e8000
[    4.076675] xhci_hcd 0021:0d:00.0: Output Context DMA address = 0x8000080194e8000
[    4.077939] xhci_hcd 0021:0d:00.0: Internal device address = 0
[    4.081783] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    4.136131] raid6: vpermxor8 gen() 30046 MB/s
[    4.176126] xhci_hcd 0021:0d:00.0: Resetting device with slot ID 5
[    4.176150] xhci_hcd 0021:0d:00.0: // Ding dong!
[    4.176275] xhci_hcd 0021:0d:00.0: Completed reset device command.
[    4.176347] xhci_hcd 0021:0d:00.0: Can't reset device (slot ID 5) in default state
[    4.176367] xhci_hcd 0021:0d:00.0: Not freeing device rings.
[    4.176384] xhci_hcd 0021:0d:00.0: // Ding dong!
[    4.177404] xhci_hcd 0021:0d:00.0: Successful setup address command
[    4.177425] xhci_hcd 0021:0d:00.0: Op regs DCBAA ptr = 0x800008001b40000
[    4.177439] xhci_hcd 0021:0d:00.0: Slot ID 5 dcbaa entry @000000005170a62d = 0x8000080194e8000
[    4.177525] xhci_hcd 0021:0d:00.0: Output Context DMA address = 0x8000080194e8000
[    4.177540] xhci_hcd 0021:0d:00.0: Internal device address = 5
[    4.204142] raid6: vpermxor4 gen() 28177 MB/s
[    4.204910] usb 1-3.4: skipped 1 descriptor after interface
[    4.205046] usb 1-3.4: skipped 1 descriptor after interface
[    4.205898] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    4.206408] usb 1-3.4: default language 0x0409
[    4.210899] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    4.215148] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    4.215658] usb 1-3.4: udev 6, busnum 1, minor = 5
[    4.215773] usb 1-3.4: New USB device found, idVendor=046b, idProduct=ff10, bcdDevice= 1.00
[    4.215826] usb 1-3.4: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    4.215842] usb 1-3.4: Product: Virtual Keyboard and Mouse
[    4.215854] usb 1-3.4: Manufacturer: American Megatrends Inc.
[    4.216041] usb 1-3.4: usb_probe_device
[    4.216125] usb 1-3.4: configuration #1 chosen from 1 choice
[    4.216153] xhci_hcd 0021:0d:00.0: add ep 0x81, slot id 5, new drop flags = 0x0, new add flags = 0x8
[    4.216178] xhci_hcd 0021:0d:00.0: add ep 0x82, slot id 5, new drop flags = 0x0, new add flags = 0x28
[    4.216196] xhci_hcd 0021:0d:00.0: xhci_check_bandwidth called for udev 00000000cdf0837a
[    4.216216] xhci_hcd 0021:0d:00.0: // Ding dong!
[    4.222152] xhci_hcd 0021:0d:00.0: Successful Endpoint Configure command
[    4.222277] xhci_hcd 0021:0d:00.0: // Ding dong!
[    4.222409] xhci_hcd 0021:0d:00.0: // Ding dong!
[    4.230164] xhci_hcd 0021:0d:00.0: // Ding dong!
[    4.230209] xhci_hcd 0021:0d:00.0: // Ding dong!
[    4.238821] usb 1-3.4: adding 1-3.4:1.0 (config #1, interface 0)
[    4.242276] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    4.242840] usb 1-3.4: adding 1-3.4:1.1 (config #1, interface 1)
[    4.245775] xhci_hcd 0021:0d:00.0: Waiting for status stage event
[    4.246442] hub 1-3:1.0: state 7 ports 5 chg 0000 evt 0010

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: IBM Power S822LC: pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
  2026-05-12  6:17       ` Paul Menzel
@ 2026-05-12  8:22         ` Michal Pecio
  2026-05-12 15:32           ` Paul Menzel
  0 siblings, 1 reply; 7+ messages in thread
From: Michal Pecio @ 2026-05-12  8:22 UTC (permalink / raw)
  To: Paul Menzel
  Cc: Mathias Nyman, Greg Kroah-Hartman, linux-usb, LKML, linuxppc-dev

On Tue, 12 May 2026 08:17:08 +0200, Paul Menzel wrote:> 
> > I honestly don't know what to do with this. I think I would start with
> > looking whether xhci_shutdown() in the old kernel manages to halt it
> > successfully or if it also fails, and what's the USBSTS there.
> > 
> > It seems that you can get such information by enabling dynamic debug
> > 
> >    echo 'module xhci_hcd +p' >/proc/dynamic_debug/control
> > 
> > and capturing old kernel's log up to kexec() through a serial cable.  
> Unfortunately, nothing is logged over the serial console (BMC SOL) after 
> running `sudo kexec -e` or `sudo systemctl reboot`. I just see:
> 
>      [69530.180531343,5] OPAL: Switch to big-endian OS
>      [69538.407292205,5] OPAL: Switch to little-endian OS
> 
> Which is the OPAL firmware, so it might be involved? No idea, if it 
> touches the xHCI controller.

So some FW involvement is potentially possible.

BTW, another method of doing kexec is to setup a crash kernel and
then trigger panic with /proc/sysrq-trigger.

This probably won't run xhci_shutdown(). Not sure about OPAL FW.
Is the outcome any different?

> But strangely no xHCI messages are there –  also after booting with
> Petitboot and initialized xHCI controller? No idea, if it points to,
> that during kexec or shutdown nothing is power off?
> 
> With `sudo systemctl reboot` only the line below are logged:
>
>      [  121.811384] libvirt-guests.sh[3366]: Running guests on default URI:
>      [  121.811988] libvirt-guests.sh[3376]: no running guests.
>      [ … (systemd service stop notifications)]
>      [  136.254846] systemd-shutdown[1]: Waiting for process: watch_ldconfig
>      [  218.549684] reboot: Restarting system
>      [69760.484679183,5] OPAL: Reboot request...
>        3.55778|Ignoring boot flags, incorrect version 0x0
>        3.59881|ISTEP  6. 3

Only "reboot: Restarting system" looks like it's kernel. Maybe you need
to tweak loglevel before rebooting or kexecing? Try to get more kernel
messages showing over serial during operation, then kexec.

Regards,
Michal

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: IBM Power S822LC: pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0
  2026-05-12  8:22         ` Michal Pecio
@ 2026-05-12 15:32           ` Paul Menzel
  0 siblings, 0 replies; 7+ messages in thread
From: Paul Menzel @ 2026-05-12 15:32 UTC (permalink / raw)
  To: Michal Pecio
  Cc: Mathias Nyman, Greg Kroah-Hartman, linux-usb, LKML, linuxppc-dev,
	Benjamin Herrenschmidt

[Cc: +Benjamin]

Dear Michal,


Thank you for your reply.

Am 12.05.26 um 10:22 schrieb Michal Pecio:
> On Tue, 12 May 2026 08:17:08 +0200, Paul Menzel wrote:>
>>> I honestly don't know what to do with this. I think I would start with
>>> looking whether xhci_shutdown() in the old kernel manages to halt it
>>> successfully or if it also fails, and what's the USBSTS there.
>>>
>>> It seems that you can get such information by enabling dynamic debug
>>>
>>>     echo 'module xhci_hcd +p' >/proc/dynamic_debug/control
>>>
>>> and capturing old kernel's log up to kexec() through a serial cable.
>>
>> Unfortunately, nothing is logged over the serial console (BMC SOL) after
>> running `sudo kexec -e` or `sudo systemctl reboot`. I just see:
>>
>>       [69530.180531343,5] OPAL: Switch to big-endian OS
>>       [69538.407292205,5] OPAL: Switch to little-endian OS
>>
>> Which is the OPAL firmware, so it might be involved? No idea, if it
>> touches the xHCI controller.
> 
> So some FW involvement is potentially possible.
> 
> BTW, another method of doing kexec is to setup a crash kernel and
> then trigger panic with /proc/sysrq-trigger.
> 
> This probably won't run xhci_shutdown(). Not sure about OPAL FW.
> Is the outcome any different?
Is the motivation to try to not get the OPAL message to rule out any 
involvement.

I have to check, how to set the crash kernel up.

>> But strangely no xHCI messages are there –  also after booting with
>> Petitboot and initialized xHCI controller? No idea, if it points to,
>> that during kexec or shutdown nothing is power off?
>>
>> With `sudo systemctl reboot` only the line below are logged:
>>
>>       [  121.811384] libvirt-guests.sh[3366]: Running guests on default URI:
>>       [  121.811988] libvirt-guests.sh[3376]: no running guests.
>>       [ … (systemd service stop notifications)]
>>       [  136.254846] systemd-shutdown[1]: Waiting for process: watch_ldconfig
>>       [  218.549684] reboot: Restarting system
>>       [69760.484679183,5] OPAL: Reboot request...
>>         3.55778|Ignoring boot flags, incorrect version 0x0
>>         3.59881|ISTEP  6. 3
> 
> Only "reboot: Restarting system" looks like it's kernel. Maybe you need
> to tweak loglevel before rebooting or kexecing? Try to get more kernel
> messages showing over serial during operation, then kexec.

I actually did set the log level by adding `debug` to the Linux kernel 
command line, and with

     $ echo 9 | sudo tee /proc/sysrq-trigger
     9

and it was confirmed:

     sysrq: Changing Loglevel
     sysrq: Loglevel set to 9

Unfortunately, no more messages.

As a further data point, adding `ppc_pci_reset_phbs` to the command line 
also gets xhci_hcd to initialize the TI xHCI host controller:

     $ lspci -nn -s 0021:0d:00.0
     0021:0d:00.0 USB controller [0c03]: Texas Instruments TUSB73x0 
SuperSpeed USB 3.0 xHCI Host Controller [104c:8241] (rev 02)


     [   14.050249]   Issue PHB reset ...
     […]
     [   19.339822] ehci_hcd: block sizes: qh 144 qtd 96 itd 192 sitd 96
     [   19.339919] ohci_hcd: block sizes: ed 112 td 96
     [   19.340538] xhci_hcd 0021:0d:00.0: xHCI Host Controller

No log `xHCI HW did not halt within 32000 usec status = 0x0` (or 0x10 
with the other patch). In `arch/powerpc/platforms/powernv/pci-ioda.c`, 
reading the comment in `pnv_pci_init_ioda_phb()` suggests, that PHB 
should be reset also in the kexec case:

         /*
          * If we're running in kdump kernel, the previous kernel never
          * shutdown PCI devices correctly. We already got IODA table
          * cleaned out. So we have to issue PHB reset to stop all PCI
          * transactions from previous kernel. The ppc_pci_reset_phbs
          * kernel parameter will force this reset too. Additionally,
          * if the IODA reset above failed then use a bigger hammer.
          * This can happen if we get a PHB fatal error in very early
          * boot.
          */
         if (is_kdump_kernel() || pci_reset_phbs || rc) {
                 pr_info("  Issue PHB reset ...\n");
                 pnv_eeh_phb_reset(hose, EEH_RESET_FUNDAMENTAL);
                 pnv_eeh_phb_reset(hose, EEH_RESET_DEACTIVATE);
         }

At least, I’d assume that kdump and kexec are similar, that both do not 
shut down PCI devices? (Commit 361f2a2a1536 (powrpc/powernv: Reset PHB 
in kdump kernel) from 2024 adds (some) the code above.)


Kind regards,

Paul

^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2026-05-12 15:32 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2026-05-06 16:06 IBM Power S822LC: pci 0021:0d:00.0: xHCI HW did not halt within 32000 usec status = 0x0 Paul Menzel
2026-05-06 17:30 ` Michal Pecio
2026-05-11 21:57   ` Paul Menzel
2026-05-11 23:20     ` Michal Pecio
2026-05-12  6:17       ` Paul Menzel
2026-05-12  8:22         ` Michal Pecio
2026-05-12 15:32           ` Paul Menzel

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox