linux-pci.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* pcie hotplug driver probe is not getting called
@ 2024-09-27 15:20 Maverickk 78
  2024-09-27 17:17 ` Bjorn Helgaas
  0 siblings, 1 reply; 11+ messages in thread
From: Maverickk 78 @ 2024-09-27 15:20 UTC (permalink / raw)
  To: linux-pci

Hello

Debugging a downstream port with slot capabilities indicating hotplug
capability is advertised in pci capability(id =0x10) .

None of the hotplug driver is getting invoked.

I assume pciehp_probe should've been called because its associated
with ".port_type = PCIE_ANY_PORT," in the pcie_port_service_driver
structure.

I assumed SHPC shpc_probe function would be called because the pci_id
table has PCI_CLASS_BRIDGE_PCI_NORMAL, but nothing related to hotplug
drivers is seen in the ftrace or dmesg.

Tried "pciehp.pciehp_force=1 pciehp.pciehp_debug=1" in the command
line but no luck

As part of port initialization if the hotplug capability is indicated
in the capability register the hotplug drivers should have been
invoked, but looks like its not the case.

Am I missing something?

Any information is appreciated.

Regards
Raghu

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: pcie hotplug driver probe is not getting called
  2024-09-27 15:20 pcie hotplug driver probe is not getting called Maverickk 78
@ 2024-09-27 17:17 ` Bjorn Helgaas
  2024-09-29 13:59   ` Maverickk 78
  0 siblings, 1 reply; 11+ messages in thread
From: Bjorn Helgaas @ 2024-09-27 17:17 UTC (permalink / raw)
  To: Maverickk 78; +Cc: linux-pci

On Fri, Sep 27, 2024 at 08:50:41PM +0530, Maverickk 78 wrote:
> Hello
> 
> Debugging a downstream port with slot capabilities indicating hotplug
> capability is advertised in pci capability(id =0x10) .
> 
> None of the hotplug driver is getting invoked.
> 
> I assume pciehp_probe should've been called because its associated
> with ".port_type = PCIE_ANY_PORT," in the pcie_port_service_driver
> structure.
> 
> I assumed SHPC shpc_probe function would be called because the pci_id
> table has PCI_CLASS_BRIDGE_PCI_NORMAL, but nothing related to hotplug
> drivers is seen in the ftrace or dmesg.
> 
> Tried "pciehp.pciehp_force=1 pciehp.pciehp_debug=1" in the command
> line but no luck
> 
> As part of port initialization if the hotplug capability is indicated
> in the capability register the hotplug drivers should have been
> invoked, but looks like its not the case.

I would expect pciehp to work in this case, but there is some
negotiation between the OS and the firmware to figure out which
owns it.

I assume you have CONFIG_PCIEPORTBUS and CONFIG_HOTPLUG_PCI_PCIE
enabled?  Can you supply the dmesg log and output of "sudo lspci -vv"?

Bjorn

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: pcie hotplug driver probe is not getting called
  2024-09-27 17:17 ` Bjorn Helgaas
@ 2024-09-29 13:59   ` Maverickk 78
  2024-09-30 12:49     ` Maverickk 78
  2024-09-30 19:28     ` Bjorn Helgaas
  0 siblings, 2 replies; 11+ messages in thread
From: Maverickk 78 @ 2024-09-29 13:59 UTC (permalink / raw)
  To: Bjorn Helgaas; +Cc: linux-pci


[-- Attachment #1.1: Type: text/plain, Size: 9255 bytes --]

Hi Bjorn,

I have a switch connecting to the Host bridge, one of the downstream
port(02:1.0) on the switch has the slot enabled.

Appended pcie_ports=native along with pciehp.pciehp_force=1
pciehp.pciehp_debug=1  to the cmdline and I see the driver creating symlink
to sysfs device node.

Does this mean pciehp can handle the hotplug events? asking this because
none of the functions in pciehp_core listed in ftrace?

# uname -a

Linux qemu-01 6.11.0+ #2 SMP PREEMPT_DYNAMIC Sat Sep 28 01:32:57 EEST 2024
x86_64 x86_64 x86_64 GNU/Linux

# cat /proc/cmdline

BOOT_IMAGE=/boot/vmlinuz-6.11.0+
root=UUID=f563804b-1b93-4921-90e1-4114c8111e8f ro ftrace=function_graph
ftrace_graph_filter=*pcie* pciehp.pciehp_force=1 pciehp.pciehp_debug=1
pcie_ports=native quite splash crashkernel=512M-:192M vt.handoff=7

# ls -ltr /sys/bus/pci_express/drivers/pciehp

total 0

--w------- 1 root root 4096 Sep 29 16:46 uevent

--w------- 1 root root 4096 Sep 29 16:49 unbind

--w------- 1 root root 4096 Sep 29 16:49 bind

lrwxrwxrwx 1 root root    0 Sep 29 16:49 0000:02:01.0:pcie204 ->
../../../../devices/pci0000:00/0000:00:04.0/0000:01:00.0/0000:02:01.0/0000:02:01.0:pcie204

#


# lspci -vv -s 2:1.0

02:01.0 PCI bridge: Broadcom / LSI Device c040 (rev a0) (prog-if 00 [Normal
decode])

        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr-
Stepping- SERR+ FastB2B- DisINTx-

        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR- INTx-

        Latency: 0

        Interrupt: pin ? routed to IRQ 25

        Bus: primary=02, secondary=03, subordinate=03, sec-latency=0

        I/O behind bridge: 00001000-00001fff [size=4K]

        Memory behind bridge: f8000000-f9ffffff [size=32M]

        Prefetchable memory behind bridge:
00000000fe200000-00000000fe3fffff [size=2M]

        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- <SERR- <PERR-

        BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-

                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-

        Capabilities: [40] Power Management version 3

                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold+)

                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-

        Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+

                Address: 00000000fee03000  Data: 0020

                Masking: 000000fe  Pending: 00000000

        Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00

                DevCap: MaxPayload 512 bytes, PhantFunc 0

                        ExtTag- RBE+

                DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+

                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+

                        MaxPayload 512 bytes, MaxReadReq 128 bytes

                DevSta: CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr-
TransPend-

                LnkCap: Port #0, Speed unknown, Width x2, ASPM L1, Exit
Latency L1 <32us

                        ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+

                LnkCtl: ASPM Disabled; Disabled- CommClk-

                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-

                LnkSta: Speed 32GT/s (downgraded), Width x2 (ok)

                        TrErr- Train- SlotClk- DLActive+ BWMgmt- ABWMgmt-

                SltCap: AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug+
Surprise+

                        Slot #0, PowerLimit 0.000W; Interlock- NoCompl-

                SltCtl: Enable: AttnBtn+ PwrFlt- MRL- PresDet- CmdCplt+
HPIrq+ LinkChg+

                        Control: AttnInd Off, PwrInd Off, Power+ Interlock-

                SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet-
Interlock-

                        Changed: MRL- PresDet- LinkState-

                DevCap2: Completion Timeout: Not Supported, TimeoutDis-
NROPrPrP- LTR+

                         10BitTagComp+ 10BitTagReq- OBFF Not Supported,
ExtFmt+ EETLPPrefix+, MaxEETLPPrefixes 4

                         EmergencyPowerReduction Not Supported,
EmergencyPowerReductionInit-

                         FRS- ARIFwd+

                         AtomicOpsCap: Routing+

                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR-
OBFF Disabled, ARIFwd-

                         AtomicOpsCtl: EgressBlck-

                LnkCap2: Supported Link Speeds: RsvdP, Crosslink+ Retimer+
2Retimers+ DRS+

                LnkCtl2: Target Link Speed: Unknown, EnterCompliance-
SpeedDis-, Selectable De-emphasis: -6dB

                         Transmit Margin: Normal Operating Range,
EnterModifiedCompliance- ComplianceSOS-

                         Compliance De-emphasis: -6dB

                LnkSta2: Current De-emphasis Level: -6dB,
EqualizationComplete- EqualizationPhase1-

                         EqualizationPhase2- EqualizationPhase3-
LinkEqualizationRequest-

                         Retimer- 2Retimers- CrosslinkRes: Downstream Port,
DRS-

                         DownstreamComp: Link Up - Present

        Capabilities: [a4] Subsystem: Broadcom / LSI Device 0144

        Capabilities: [100 v1] Extended Capability ID 0x2f

        Capabilities: [294 v3] Advanced Error Reporting

                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-

                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-

                UESvrt: DLP+ SDES+ TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt-
RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-

                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout-
AdvNonFatalErr-

                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout-
AdvNonFatalErr+

                AERCap: First Error Pointer: 1f, ECRCGenCap+ ECRCGenEn-
ECRCChkCap+ ECRCChkEn-

                        MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-

                HeaderLog: 00000000 00000000 00000000 00000000

        Capabilities: [138 v1] Power Budgeting <?>

        Capabilities: [db4 v1] Secondary PCI Express

                LnkCtl3: LnkEquIntrruptEn- PerformEqu-

                LaneErrStat: 0

        Capabilities: [148 v1] Virtual Channel

                Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1

                Arb:    Fixed- WRR32- WRR64- WRR128-

                Ctrl:   ArbSelect=Fixed

                Status: InProgress-

                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-

                        Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128-
WRR256-

                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff

                        Status: NegoPending- InProgress-

        Capabilities: [af4 v1] Data Link Feature <?>

        Capabilities: [d00 v1] Physical Layer 16.0 GT/s <?>

        Capabilities: [d40 v1] Lane Margining at the Receiver <?>

        Capabilities: [e40 v1] Extended Capability ID 0x2a

        Capabilities: [e70 v1] Extended Capability ID 0x31

        Capabilities: [ec0 v1] Extended Capability ID 0x32

        Capabilities: [a80 v1] Extended Capability ID 0x34

        Capabilities: [b70 v1] Vendor Specific Information: ID=0001 Rev=0
Len=010 <?>

        Capabilities: [f24 v1] Access Control Services

                ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+
UpstreamFwd+ EgressCtrl- DirectTrans+

                ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir-
UpstreamFwd- EgressCtrl- DirectTrans-

        Capabilities: [b60 v1] Downstream Port Containment

                DpcCap: INT Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO
Log 0, DL_ActiveErr+

                DpcCtl: Trigger:0 Cmpl- INT- ErrCor- PoisonedTLP-
SwTrigger- DL_ActiveErr-

                DpcSta: Trigger- Reason:00 INT- RPBusy- TriggerExt:00 RP
PIO ErrPtr:00

                Source: 0000

        Capabilities: [b20 v1] Extended Capability ID 0x2c

        Kernel driver in use: pcieport

On Fri, 27 Sept 2024 at 22:47, Bjorn Helgaas <helgaas@kernel.org> wrote:

> On Fri, Sep 27, 2024 at 08:50:41PM +0530, Maverickk 78 wrote:
> > Hello
> >
> > Debugging a downstream port with slot capabilities indicating hotplug
> > capability is advertised in pci capability(id =0x10) .
> >
> > None of the hotplug driver is getting invoked.
> >
> > I assume pciehp_probe should've been called because its associated
> > with ".port_type = PCIE_ANY_PORT," in the pcie_port_service_driver
> > structure.
> >
> > I assumed SHPC shpc_probe function would be called because the pci_id
> > table has PCI_CLASS_BRIDGE_PCI_NORMAL, but nothing related to hotplug
> > drivers is seen in the ftrace or dmesg.
> >
> > Tried "pciehp.pciehp_force=1 pciehp.pciehp_debug=1" in the command
> > line but no luck
> >
> > As part of port initialization if the hotplug capability is indicated
> > in the capability register the hotplug drivers should have been
> > invoked, but looks like its not the case.
>
> I would expect pciehp to work in this case, but there is some
> negotiation between the OS and the firmware to figure out which
> owns it.
>
> I assume you have CONFIG_PCIEPORTBUS and CONFIG_HOTPLUG_PCI_PCIE
> enabled?  Can you supply the dmesg log and output of "sudo lspci -vv"?
>
> Bjorn
>

[-- Attachment #1.2: Type: text/html, Size: 45887 bytes --]

[-- Attachment #2: dmesg_log --]
[-- Type: application/octet-stream, Size: 69329 bytes --]

[    0.000000] Linux version 6.11.0+ (root@ky-qemu-01) (gcc (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #2 SMP PREEMPT_DYNAMIC Sat Sep 28 01:32:57 EEST 2024
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-6.11.0+ root=UUID=f563804b-1b93-4921-90e1-4114c8111e8f ro modprobe.blacklist=mpt3sas ftrace=function_graph ftrace_graph_filter=*pcie* pciehp.pciehp_force=1 pciehp.pciehp_debug=1 pcie_ports=native quite splash crashkernel=512M-:192M vt.handoff=7
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Hygon HygonGenuine
[    0.000000]   Centaur CentaurHauls
[    0.000000]   zhaoxin   Shanghai  
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009fbff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009fc00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000f0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007ffddfff] usable
[    0.000000] BIOS-e820: [mem 0x000000007ffde000-0x000000007fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000feffc000-0x00000000feffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fffc0000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] APIC: Static calls initialized
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.14.0-0-g155821a-20210629_105355-sharpie 04/01/2014
[    0.000000] DMI: Memory slots populated: 2/2
[    0.000000] Hypervisor detected: KVM
[    0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[    0.000001] kvm-clock: using sched offset of 113519824630981 cycles
[    0.000006] clocksource: kvm-clock: mask: 0xffffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns
[    0.000014] tsc: Detected 3299.998 MHz processor
[    0.000872] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000876] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000883] last_pfn = 0x880000 max_arch_pfn = 0x400000000
[    0.000918] MTRR map: 4 entries (3 fixed + 1 variable; max 19), built from 8 variable MTRRs
[    0.000925] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000969] last_pfn = 0x7ffde max_arch_pfn = 0x400000000
[    0.010184] found SMP MP-table at [mem 0x000f5bc0-0x000f5bcf]
[    0.010727] RAMDISK: [mem 0x10179000-0x37feefff]
[    0.010743] ACPI: Early table checksum verification disabled
[    0.010760] ACPI: RSDP 0x00000000000F5990 000014 (v00 BOCHS )
[    0.010770] ACPI: RSDT 0x000000007FFE285C 000038 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.010789] ACPI: FACP 0x000000007FFE25DC 0000F4 (v03 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.010810] ACPI: DSDT 0x000000007FFE0040 00259C (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.010814] ACPI: FACS 0x000000007FFE0000 000040
[    0.010819] ACPI: APIC 0x000000007FFE26D0 0000F0 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.010823] ACPI: HPET 0x000000007FFE27C0 000038 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.010827] ACPI: MCFG 0x000000007FFE27F8 00003C (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.010832] ACPI: WAET 0x000000007FFE2834 000028 (v01 BOCHS  BXPC     00000001 BXPC 00000001)
[    0.010835] ACPI: Reserving FACP table memory at [mem 0x7ffe25dc-0x7ffe26cf]
[    0.010837] ACPI: Reserving DSDT table memory at [mem 0x7ffe0040-0x7ffe25db]
[    0.010838] ACPI: Reserving FACS table memory at [mem 0x7ffe0000-0x7ffe003f]
[    0.010838] ACPI: Reserving APIC table memory at [mem 0x7ffe26d0-0x7ffe27bf]
[    0.010839] ACPI: Reserving HPET table memory at [mem 0x7ffe27c0-0x7ffe27f7]
[    0.010840] ACPI: Reserving MCFG table memory at [mem 0x7ffe27f8-0x7ffe2833]
[    0.010841] ACPI: Reserving WAET table memory at [mem 0x7ffe2834-0x7ffe285b]
[    0.014934] No NUMA configuration found
[    0.014937] Faking a node at [mem 0x0000000000000000-0x000000087fffffff]
[    0.014952] NODE_DATA(0) allocated [mem 0x87ffb8680-0x87ffe2fff]
[    0.015140] crashkernel reserved: 0x0000000073000000 - 0x000000007f000000 (192 MB)
[    0.015203] Zone ranges:
[    0.015204]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.015206]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.015208]   Normal   [mem 0x0000000100000000-0x000000087fffffff]
[    0.015209]   Device   empty
[    0.015210] Movable zone start for each node
[    0.015213] Early memory node ranges
[    0.015216]   node   0: [mem 0x0000000000001000-0x000000000009efff]
[    0.015219]   node   0: [mem 0x0000000000100000-0x000000007ffddfff]
[    0.015221]   node   0: [mem 0x0000000100000000-0x000000087fffffff]
[    0.015226] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff]
[    0.015255] On node 0, zone DMA: 1 pages in unavailable ranges
[    0.015295] On node 0, zone DMA: 97 pages in unavailable ranges
[    0.074423] On node 0, zone Normal: 34 pages in unavailable ranges
[    0.406997] ACPI: PM-Timer IO Port: 0x608
[    0.407035] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[    0.407084] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[    0.407089] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.407091] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[    0.407093] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.407097] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[    0.407098] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[    0.407105] ACPI: Using ACPI (MADT) for SMP configuration information
[    0.407107] ACPI: HPET id: 0x8086a201 base: 0xfed00000
[    0.407124] CPU topo: Max. logical packages:   1
[    0.407125] CPU topo: Max. logical dies:       1
[    0.407126] CPU topo: Max. dies per package:   1
[    0.407131] CPU topo: Max. threads per core:   1
[    0.407133] CPU topo: Num. cores per package:    16
[    0.407134] CPU topo: Num. threads per package:  16
[    0.407135] CPU topo: Allowing 16 present CPUs plus 0 hotplug CPUs
[    0.407164] kvm-guest: APIC: eoi() replaced with kvm_guest_apic_eoi_write()
[    0.407201] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.407204] PM: hibernation: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[    0.407205] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000effff]
[    0.407206] PM: hibernation: Registered nosave memory: [mem 0x000f0000-0x000fffff]
[    0.407208] PM: hibernation: Registered nosave memory: [mem 0x7ffde000-0x7fffffff]
[    0.407209] PM: hibernation: Registered nosave memory: [mem 0x80000000-0xafffffff]
[    0.407210] PM: hibernation: Registered nosave memory: [mem 0xb0000000-0xbfffffff]
[    0.407211] PM: hibernation: Registered nosave memory: [mem 0xc0000000-0xfed1bfff]
[    0.407212] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.407213] PM: hibernation: Registered nosave memory: [mem 0xfed20000-0xfeffbfff]
[    0.407214] PM: hibernation: Registered nosave memory: [mem 0xfeffc000-0xfeffffff]
[    0.407215] PM: hibernation: Registered nosave memory: [mem 0xff000000-0xfffbffff]
[    0.407216] PM: hibernation: Registered nosave memory: [mem 0xfffc0000-0xffffffff]
[    0.407218] [mem 0xc0000000-0xfed1bfff] available for PCI devices
[    0.407222] Booting paravirtualized kernel on KVM
[    0.407228] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.407262] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:16 nr_cpu_ids:16 nr_node_ids:1
[    0.408703] percpu: Embedded 88 pages/cpu s237568 r8192 d114688 u524288
[    0.408714] pcpu-alloc: s237568 r8192 d114688 u524288 alloc=1*2097152
[    0.408718] pcpu-alloc: [0] 00 01 02 03 [0] 04 05 06 07 
[    0.408722] pcpu-alloc: [0] 08 09 10 11 [0] 12 13 14 15 
[    0.408754] kvm-guest: PV spinlocks disabled, no host support
[    0.408755] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.11.0+ root=UUID=f563804b-1b93-4921-90e1-4114c8111e8f ro modprobe.blacklist=mpt3sas ftrace=function_graph ftrace_graph_filter=*pcie* pciehp.pciehp_force=1 pciehp.pciehp_debug=1 pcie_ports=native quite splash crashkernel=512M-:192M vt.handoff=7
[    0.408986] Unknown kernel command line parameters "quite splash BOOT_IMAGE=/boot/vmlinuz-6.11.0+", will be passed to user space.
[    0.413576] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear)
[    0.415951] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear)
[    0.416367] Fallback order for Node 0: 0 
[    0.416379] Built 1 zonelists, mobility grouping on.  Total pages: 8388476
[    0.416380] Policy zone: Normal
[    0.416402] mem auto-init: stack:off, heap alloc:on, heap free:off
[    0.416424] software IO TLB: area num 16.
[    0.543481] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=16, Nodes=1
[    0.543618] Kernel/User page tables isolation: enabled
[    0.543756] ftrace: allocating 56237 entries in 220 pages
[    0.559576] ftrace: allocated 220 pages with 5 groups
[    0.595332] Dynamic Preempt: voluntary
[    0.595631] rcu: Preemptible hierarchical RCU implementation.
[    0.595632] rcu: 	RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=16.
[    0.595635] 	Trampoline variant of Tasks RCU enabled.
[    0.595636] 	Rude variant of Tasks RCU enabled.
[    0.595636] 	Tracing variant of Tasks RCU enabled.
[    0.595637] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[    0.595638] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=16
[    0.595687] RCU Tasks: Setting shift to 4 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=16.
[    0.595692] RCU Tasks Rude: Setting shift to 4 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=16.
[    0.595697] RCU Tasks Trace: Setting shift to 4 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=16.
[    0.599055] NR_IRQS: 524544, nr_irqs: 552, preallocated irqs: 16
[    0.599336] rcu: srcu_init: Setting srcu_struct sizes based on contention.
[    0.636772] Console: colour VGA+ 80x25
[    0.636790] printk: legacy console [tty0] enabled
[    0.712370] ACPI: Core revision 20240827
[    0.713221] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 19112604467 ns
[    0.714198] APIC: Switch to symmetric I/O mode setup
[    0.714980] x2apic enabled
[    0.715725] APIC: Switched APIC routing to: physical x2apic
[    0.717584] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.718040] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2f914aa96b9, max_idle_ns: 440795356591 ns
[    0.718691] Calibrating delay loop (skipped) preset value.. 6599.99 BogoMIPS (lpj=3299998)
[    0.719830] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[    0.720283] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0, 1GB 0
[    0.720697] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[    0.721286] Spectre V2 : Mitigation: Retpolines
[    0.721687] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.722270] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT
[    0.722688] Speculative Store Bypass: Vulnerable
[    0.723226] MDS: Vulnerable: Clear CPU buffers attempted, no microcode
[    0.723687] MMIO Stale Data: Unknown: No mitigations
[    0.724072] x86/fpu: x87 FPU will use FXSAVE
[    0.750785] Freeing SMP alternatives memory: 48K
[    0.751249] pid_max: default: 32768 minimum: 301
[    0.752327] LSM: initializing lsm=lockdown,capability,landlock,yama,apparmor,ima,evm
[    0.752893] landlock: Up and running.
[    0.753275] Yama: becoming mindful.
[    0.753835] AppArmor: AppArmor initialized
[    0.755786] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.756460] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear)
[    0.832266] smpboot: CPU0: Intel QEMU Virtual CPU version 2.5+ (family: 0xf, model: 0x6b, stepping: 0x1)
[    0.832727] Performance Events: unsupported Netburst CPU model 107 no PMU driver, software events only.
[    0.833431] signal: max sigframe size: 1440
[    0.833758] rcu: Hierarchical SRCU implementation.
[    0.834166] rcu: 	Max phase no-delay instances is 400.
[    0.834768] Timer migration: 2 hierarchy levels; 8 children per group; 2 crossnode level
[    0.835771] NMI watchdog: Perf NMI watchdog permanently disabled
[    0.836480] smp: Bringing up secondary CPUs ...
[    0.837209] smpboot: x86: Booting SMP configuration:
[    0.837690] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7  #8  #9 #10
[    0.953698] psi: inconsistent task state! task=87:kworker/11:0 cpu=0 psi_flags=4 clear=0 set=4
[    0.954043]  #11 #12 #13 #14 #15
[    1.039843] smp: Brought up 1 node, 16 CPUs
[    1.041090] smpboot: Total of 16 processors activated (105599.93 BogoMIPS)
[    1.042910] Memory: 31964700K/33553904K available (22528K kernel code, 4571K rwdata, 8344K rodata, 5052K init, 4520K bss, 1544008K reserved, 0K cma-reserved)
[    1.046210] devtmpfs: initialized
[    1.046781] x86/mm: Memory block size: 128MB
[    1.050813] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    1.051540] futex hash table entries: 4096 (order: 6, 262144 bytes, linear)
[    1.051724] Starting tracer 'function_graph'
[    1.619635] pinctrl core: initialized pinctrl subsystem
[    1.620956] PM: RTC time: 13:46:39, date: 2024-09-29
[    1.624387] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[    1.627203] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[    1.628307] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[    1.630087] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[    1.630756] audit: initializing netlink subsys (disabled)
[    1.631765] audit: type=2000 audit(1727617599.356:1): state=initialized audit_enabled=0 res=1
[    1.632726] thermal_sys: Registered thermal governor 'fair_share'
[    1.633054] thermal_sys: Registered thermal governor 'bang_bang'
[    1.633698] thermal_sys: Registered thermal governor 'step_wise'
[    1.634363] thermal_sys: Registered thermal governor 'user_space'
[    1.634695] thermal_sys: Registered thermal governor 'power_allocator'
[    1.635739] EISA bus registered
[    1.636732] cpuidle: using governor ladder
[    1.637729] cpuidle: using governor menu
[    1.640055] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    1.641883] PCI: pci_mmcfg_early_init() pci_probe 0xf
[    1.642131] PCI: ECAM [mem 0xb0000000-0xbfffffff] (base 0xb0000000) for domain 0000 [bus 00-ff]
[    1.642733] PCI: __pci_mmcfg_init(early)
[    1.642745] PCI: ECAM [mem 0xb0000000-0xbfffffff] reserved as E820 entry
[    1.643746] PCI: Using configuration type 1 for base access
[    1.645289] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[    1.651877] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[    1.652695] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[    1.661273] ACPI: Added _OSI(Module Device)
[    1.661696] ACPI: Added _OSI(Processor Device)
[    1.662275] ACPI: Added _OSI(3.0 _SCP Extensions)
[    1.662696] ACPI: Added _OSI(Processor Aggregator Device)
[    1.686320] ACPI: 1 ACPI AML tables successfully acquired and loaded
[    1.694767] ACPI: Interpreter enabled
[    1.695420] ACPI: PM: (supports S0 S3 S4 S5)
[    1.695696] ACPI: Using IOAPIC for interrupt routing
[    1.698151] PCI: pci_mmcfg_late_init() pci_probe 0x8
[    1.698169] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    1.698694] PCI: Using E820 reservations for host bridge windows
[    1.701737] ACPI: Enabled 2 GPEs in block 00 to 3F
[    1.734158] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    1.734711] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[    1.736168] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR DPC]
[    1.738096] acpi PNP0A08:00: _OSC: OS now controls [SHPCHotplug PME AER PCIeCapability]
[    1.738729] acpi PNP0A08:00: setup_mcfg_map(0000 [bus 00-ff] ECAM 0x0000000000000000)
[    1.738744] acpi PNP0A08:00: pci_mmconfig_insert(0000 [bus 00-ff])
[    1.738813] acpi PNP0A08:00: host bridge window [mem 0x880000000-0x1087fffffff window] ([0x10000000000-0x1087fffffff] ignored, not CPU addressable)
[    1.741709] PCI host bridge to bus 0000:00
[    1.742188] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    1.742693] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    1.743256] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    1.743694] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window]
[    1.744694] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
[    1.745375] pci_bus 0000:00: root bus resource [mem 0x880000000-0xffffffffff window]
[    1.745694] pci_bus 0000:00: root bus resource [bus 00-ff]
[    1.746699] pci_bus 0000:00: scanning bus
[    1.746861] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000 conventional PCI endpoint
[    1.748729] pci 0000:00:00.0: EDR: Notify handler installed
[    1.749113] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000 conventional PCI endpoint
[    1.751461] pci 0000:00:01.0: BAR 0 [mem 0xfd000000-0xfdffffff pref]
[    1.755280] pci 0000:00:01.0: BAR 2 [mem 0xfc080000-0xfc080fff]
[    1.761727] pci 0000:00:01.0: ROM [mem 0xfc060000-0xfc06ffff pref]
[    1.762911] pci 0000:00:01.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    1.764078] pci 0000:00:01.0: EDR: Notify handler installed
[    1.765041] pci 0000:00:02.0: [8086:100e] type 00 class 0x020000 conventional PCI endpoint
[    1.766692] pci 0000:00:02.0: BAR 0 [mem 0xfc040000-0xfc05ffff]
[    1.768232] pci 0000:00:02.0: BAR 1 [io  0xc000-0xc03f]
[    1.774693] pci 0000:00:02.0: ROM [mem 0xfc000000-0xfc03ffff pref]
[    1.775943] pci 0000:00:02.0: EDR: Notify handler installed
[    1.788695] pci 0000:00:04.0: [14ab:1000] type 01 class 0x060400 PCIe Root Port
[    1.800695] pci 0000:00:04.0: BAR 0 [mem 0xfc070000-0xfc07ffff]
[    1.815456] pci 0000:00:04.0: PCI bridge to [bus 01-04]
[    1.821697] pci 0000:00:04.0:   bridge window [mem 0xf6000000-0xfbffffff]
[    1.829695] pci 0000:00:04.0:   bridge window [mem 0xfe000000-0xfe5fffff 64bit pref]
[    2.008783] pci 0000:00:04.0: EDR: Notify handler installed
[    2.080629] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300 conventional PCI endpoint
[    2.089707] pci 0000:00:1d.0: BAR 4 [io  0xc080-0xc09f]
[    2.095285] pci 0000:00:1d.0: EDR: Notify handler installed
[    2.096292] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300 conventional PCI endpoint
[    2.104706] pci 0000:00:1d.1: BAR 4 [io  0xc0a0-0xc0bf]
[    2.110376] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300 conventional PCI endpoint
[    2.118724] pci 0000:00:1d.2: BAR 4 [io  0xc0c0-0xc0df]
[    2.125084] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320 conventional PCI endpoint
[    2.128260] pci 0000:00:1d.7: BAR 0 [mem 0xfc081000-0xfc081fff]
[    2.140284] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100 conventional PCI endpoint
[    2.144807] pci 0000:00:1f.0: quirk: [io  0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO
[    2.146997] pci 0000:00:1f.0: EDR: Notify handler installed
[    2.148905] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601 conventional PCI endpoint
[    2.162706] pci 0000:00:1f.2: BAR 4 [io  0xc0e0-0xc0ff]
[    2.166707] pci 0000:00:1f.2: BAR 5 [mem 0xfc082000-0xfc082fff]
[    2.174955] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500 conventional PCI endpoint
[    2.184705] pci 0000:00:1f.3: BAR 4 [io  0x0700-0x073f]
[    2.191332] pci 0000:00:1f.3: EDR: Notify handler installed
[    2.192793] pci_bus 0000:00: fixups for bus
[    2.193706] pci 0000:00:04.0: scanning [bus 01-04] behind bridge, pass 0
[    2.212020] pci_bus 0000:01: scanning bus
[    2.225714] pci 0000:01:00.0: [1000:c040] type 01 class 0x060400 PCIe Switch Upstream Port
[    2.238706] pci 0000:01:00.0: BAR 0 [mem 0xfa000000-0xfaffffff]
[    2.254706] pci 0000:01:00.0: PCI bridge to [bus 02-04]
[    2.262707] pci 0000:01:00.0:   bridge window [mem 0xf6000000-0xf9ffffff]
[    2.272707] pci 0000:01:00.0:   bridge window [mem 0xfe000000-0xfe3fffff 64bit pref]
[    2.416698] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    2.419694] pci 0000:01:00.0: PME# disabled
[    2.641306] pci 0000:01:00.0: 126.028 Gb/s available PCIe bandwidth, limited by 32.0 GT/s PCIe x4 link at 0000:00:04.0 (capable of 256.000 Gb/s with 64.0 GT/s PCIe x4 link)
[    3.001695] pci 0000:01:00.2: [1000:c040] type 00 class 0x0c0b00 PCIe Endpoint
[    3.036697] pci 0000:01:00.2: BAR 0 [mem 0xfe400000-0xfe40ffff pref]
[    3.579696] pci 0000:01:00.4: [1000:00b2] type 00 class 0x010700 PCIe Endpoint
[    3.613695] pci 0000:01:00.4: BAR 0 [mem 0xfb000000-0xfb003fff]
[    4.152796] pci_bus 0000:01: fixups for bus
[    4.152808] pci 0000:00:04.0: PCI bridge to [bus 01-04]
[    4.164692] pci 0000:01:00.0: scanning [bus 02-04] behind bridge, pass 0
[    4.220830] pci_bus 0000:02: scanning bus
[    4.261695] pci 0000:02:01.0: [1000:c040] type 01 class 0x060400 PCIe Switch Downstream Port
[    4.342693] pci 0000:02:01.0: PCI bridge to [bus 03]
[    4.363707] pci 0000:02:01.0:   bridge window [mem 0xf8000000-0xf9ffffff]
[    4.396693] pci 0000:02:01.0:   bridge window [mem 0xfe200000-0xfe3fffff 64bit pref]
[    4.775707] pci 0000:02:01.0: PME# supported from D0 D3hot D3cold
[    4.780695] pci 0000:02:01.0: PME# disabled
[    5.625695] pci 0000:02:02.0: [1000:c040] type 01 class 0x060400 PCIe Switch Downstream Port
[    5.707706] pci 0000:02:02.0: PCI bridge to [bus 04]
[    5.730694] pci 0000:02:02.0:   bridge window [mem 0xf6000000-0xf7ffffff]
[    5.753695] pci 0000:02:02.0:   bridge window [mem 0xfe000000-0xfe1fffff 64bit pref]
[    6.131699] pci 0000:02:02.0: PME# supported from D0 D3hot D3cold
[    6.137694] pci 0000:02:02.0: PME# disabled
[    7.054885] pci_bus 0000:02: fixups for bus
[    7.054900] pci 0000:01:00.0: PCI bridge to [bus 02-04]
[    7.090693] pci 0000:02:01.0: scanning [bus 03-03] behind bridge, pass 0
[    7.156806] pci_bus 0000:03: scanning bus
[    7.209695] pci 0000:03:00.0: [abcd:0000] type 00 class 0x000000 PCIe Endpoint
[    7.271693] pci 0000:03:00.0: BAR 0 [mem 0xf8000000-0xf9ffffff]
[    7.791165] pci 0000:03:00.0: 63.014 Gb/s available PCIe bandwidth, limited by 32.0 GT/s PCIe x2 link at 0000:02:01.0 (capable of 1024.000 Gb/s with 64.0 GT/s PCIe x16 link)
[    7.941744] pci_bus 0000:03: fixups for bus
[    7.941769] pci 0000:02:01.0: PCI bridge to [bus 03]
[    7.952694] pci_bus 0000:03: bus scan returning with max=03
[    7.955692] pci 0000:02:02.0: scanning [bus 04-04] behind bridge, pass 0
[    7.977786] pci_bus 0000:04: scanning bus
[    7.992696] pci 0000:04:00.0: [abcd:1111] type 00 class 0x000000 PCIe Endpoint
[    8.006692] pci 0000:04:00.0: BAR 0 [mem 0xf6000000-0xf7ffffff]
[    8.329719] pci 0000:04:00.0: 63.014 Gb/s available PCIe bandwidth, limited by 32.0 GT/s PCIe x2 link at 0000:02:02.0 (capable of 1024.000 Gb/s with 64.0 GT/s PCIe x16 link)
[    8.481733] pci_bus 0000:04: fixups for bus
[    8.481747] pci 0000:02:02.0: PCI bridge to [bus 04]
[    8.491693] pci_bus 0000:04: bus scan returning with max=04
[    8.494692] pci 0000:02:01.0: scanning [bus 03-03] behind bridge, pass 1
[    8.499692] pci 0000:02:02.0: scanning [bus 04-04] behind bridge, pass 1
[    8.503692] pci_bus 0000:02: bus scan returning with max=04
[    8.506692] pci 0000:01:00.0: scanning [bus 02-04] behind bridge, pass 1
[    8.510692] pci_bus 0000:01: bus scan returning with max=04
[    8.513461] pci 0000:00:04.0: scanning [bus 01-04] behind bridge, pass 1
[    8.517696] pci_bus 0000:00: bus scan returning with max=04
[    8.521123] ACPI: PCI: Interrupt link LNKA configured for IRQ 10
[    8.522111] ACPI: PCI: Interrupt link LNKB configured for IRQ 10
[    8.523062] ACPI: PCI: Interrupt link LNKC configured for IRQ 11
[    8.524029] ACPI: PCI: Interrupt link LNKD configured for IRQ 11
[    8.525014] ACPI: PCI: Interrupt link LNKE configured for IRQ 10
[    8.526020] ACPI: PCI: Interrupt link LNKF configured for IRQ 10
[    8.527142] ACPI: PCI: Interrupt link LNKG configured for IRQ 11
[    8.528152] ACPI: PCI: Interrupt link LNKH configured for IRQ 11
[    8.528787] ACPI: PCI: Interrupt link GSIA configured for IRQ 16
[    8.529307] ACPI: PCI: Interrupt link GSIB configured for IRQ 17
[    8.529754] ACPI: PCI: Interrupt link GSIC configured for IRQ 18
[    8.530308] ACPI: PCI: Interrupt link GSID configured for IRQ 19
[    8.530766] ACPI: PCI: Interrupt link GSIE configured for IRQ 20
[    8.531374] ACPI: PCI: Interrupt link GSIF configured for IRQ 21
[    8.531755] ACPI: PCI: Interrupt link GSIG configured for IRQ 22
[    8.532691] ACPI: PCI: Interrupt link GSIH configured for IRQ 23
[    8.539729] iommu: Default domain type: Translated
[    8.540157] iommu: DMA domain TLB invalidation policy: lazy mode
[    8.541582] SCSI subsystem initialized
[    8.541759] libata version 3.00 loaded.
[    8.541885] ACPI: bus type USB registered
[    8.542746] usbcore: registered new interface driver usbfs
[    8.543226] usbcore: registered new interface driver hub
[    8.543727] usbcore: registered new device driver usb
[    8.544279] pps_core: LinuxPPS API ver. 1 registered
[    8.544692] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    8.545349] PTP clock support registered
[    8.545756] EDAC MC: Ver: 3.0.0
[    8.569192] NetLabel: Initializing
[    8.569586] NetLabel:  domain hash size = 128
[    8.569692] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    8.570218] NetLabel:  unlabeled traffic allowed by default
[    8.570896] mctp: management component transport protocol core
[    8.571698] NET: Registered PF_MCTP protocol family
[    8.572193] PCI: Using ACPI for IRQ routing
[    8.950527] PCI: pci_cache_line_size set to 64 bytes
[    8.950607] pci 0000:00:01.0: BAR 0: reserving [mem 0xfd000000-0xfdffffff flags 0x42208] (d=0, p=0)
[    8.950618] pci 0000:00:01.0: BAR 2: reserving [mem 0xfc080000-0xfc080fff flags 0x40200] (d=0, p=0)
[    8.950639] pci 0000:00:02.0: BAR 0: reserving [mem 0xfc040000-0xfc05ffff flags 0x40200] (d=0, p=0)
[    8.950647] pci 0000:00:02.0: BAR 1: reserving [io  0xc000-0xc03f flags 0x40101] (d=0, p=0)
[    8.950700] pci 0000:00:04.0: BAR 0: reserving [mem 0xfc070000-0xfc07ffff flags 0x40200] (d=0, p=0)
[    8.951691] pci 0000:01:00.0: BAR 0: reserving [mem 0xfa000000-0xfaffffff flags 0x40200] (d=0, p=0)
[    8.953700] pci 0000:03:00.0: BAR 0: reserving [mem 0xf8000000-0xf9ffffff flags 0x40200] (d=0, p=0)
[    8.955695] pci 0000:04:00.0: BAR 0: reserving [mem 0xf6000000-0xf7ffffff flags 0x40200] (d=0, p=0)
[    8.956692] pci 0000:01:00.2: BAR 0: reserving [mem 0xfe400000-0xfe40ffff flags 0x42208] (d=0, p=0)
[    8.957692] pci 0000:01:00.4: BAR 0: reserving [mem 0xfb000000-0xfb003fff flags 0x40200] (d=0, p=0)
[    8.958692] pci 0000:00:1d.0: BAR 4: reserving [io  0xc080-0xc09f flags 0x40101] (d=0, p=0)
[    8.958758] pci 0000:00:1d.1: BAR 4: reserving [io  0xc0a0-0xc0bf flags 0x40101] (d=0, p=0)
[    8.958792] pci 0000:00:1d.2: BAR 4: reserving [io  0xc0c0-0xc0df flags 0x40101] (d=0, p=0)
[    8.958829] pci 0000:00:1d.7: BAR 0: reserving [mem 0xfc081000-0xfc081fff flags 0x40200] (d=0, p=0)
[    8.958887] pci 0000:00:1f.2: BAR 4: reserving [io  0xc0e0-0xc0ff flags 0x40101] (d=0, p=0)
[    8.958895] pci 0000:00:1f.2: BAR 5: reserving [mem 0xfc082000-0xfc082fff flags 0x40200] (d=0, p=0)
[    8.958915] pci 0000:00:1f.3: BAR 4: reserving [io  0x0700-0x073f flags 0x40101] (d=0, p=0)
[    8.966824] e820: reserve RAM buffer [mem 0x0009fc00-0x0009ffff]
[    8.966838] e820: reserve RAM buffer [mem 0x7ffde000-0x7fffffff]
[    8.966966] pci 0000:00:01.0: vgaarb: setting as boot VGA device
[    8.967246] pci 0000:00:01.0: vgaarb: bridge control possible
[    8.967685] pci 0000:00:01.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    8.967709] vgaarb: loaded
[    8.969866] hpet: 3 channels of 0 reserved for per-cpu timers
[    8.970399] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    8.970692] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
[    8.975094] clocksource: Switched to clocksource kvm-clock
[    8.978778] VFS: Disk quotas dquot_6.6.0
[    8.979366] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    8.980610] AppArmor: AppArmor Filesystem Enabled
[    8.981139] pnp: PnP ACPI init
[    8.982546] system 00:05: [mem 0xb0000000-0xbfffffff window] has been reserved
[    8.984911] pnp: PnP ACPI: found 6 devices
[    8.998931] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    9.000044] NET: Registered PF_INET protocol family
[    9.001111] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    9.007062] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear)
[    9.007837] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)
[    9.008840] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear)
[    9.010063] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)
[    9.012228] TCP: Hash tables configured (established 262144 bind 65536)
[    9.013415] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, linear)
[    9.014260] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    9.014909] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear)
[    9.015847] NET: Registered PF_UNIX/PF_LOCAL protocol family
[    9.016615] NET: Registered PF_XDP protocol family
[    9.017084] pci 0000:02:01.0: bridge window [io  0x1000-0x0fff] to [bus 03] add_size 1000
[    9.017750] pci 0000:01:00.0: bridge window [io  0x1000-0x0fff] to [bus 02-04] add_size 1000
[    9.018455] pci 0000:00:04.0: bridge window [io  0x1000-0x0fff] to [bus 01-04] add_size 1000
[    9.019119] pci 0000:00:04.0: bridge window [io  0x1000-0x1fff]: assigned
[    9.019633] pci 0000:01:00.0: bridge window [io  0x1000-0x1fff]: assigned
[    9.020162] pci 0000:02:01.0: bridge window [io  0x1000-0x1fff]: assigned
[    9.020675] pci 0000:02:01.0: PCI bridge to [bus 03]
[    9.023764] pci 0000:02:01.0:   bridge window [io  0x1000-0x1fff]
[    9.034330] pci 0000:02:01.0:   bridge window [mem 0xf8000000-0xf9ffffff]
[    9.039744] pci 0000:02:01.0:   bridge window [mem 0xfe200000-0xfe3fffff 64bit pref]
[    9.050994] pci 0000:02:02.0: PCI bridge to [bus 04]
[    9.058604] pci 0000:02:02.0:   bridge window [mem 0xf6000000-0xf7ffffff]
[    9.063963] pci 0000:02:02.0:   bridge window [mem 0xfe000000-0xfe1fffff 64bit pref]
[    9.077415] pci 0000:01:00.0: PCI bridge to [bus 02-04]
[    9.080943] pci 0000:01:00.0:   bridge window [io  0x1000-0x1fff]
[    9.088707] pci 0000:01:00.0:   bridge window [mem 0xf6000000-0xf9ffffff]
[    9.094046] pci 0000:01:00.0:   bridge window [mem 0xfe000000-0xfe3fffff 64bit pref]
[    9.109179] pci 0000:00:04.0: PCI bridge to [bus 01-04]
[    9.110291] pci 0000:00:04.0:   bridge window [io  0x1000-0x1fff]
[    9.147956] pci 0000:00:04.0:   bridge window [mem 0xf6000000-0xfbffffff]
[    9.171132] pci 0000:00:04.0:   bridge window [mem 0xfe000000-0xfe5fffff 64bit pref]
[    9.212155] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    9.212756] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    9.213292] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    9.213855] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window]
[    9.214433] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]
[    9.215039] pci_bus 0000:00: resource 9 [mem 0x880000000-0xffffffffff window]
[    9.215610] pci_bus 0000:01: resource 0 [io  0x1000-0x1fff]
[    9.216042] pci_bus 0000:01: resource 1 [mem 0xf6000000-0xfbffffff]
[    9.216626] pci_bus 0000:01: resource 2 [mem 0xfe000000-0xfe5fffff 64bit pref]
[    9.217287] pci_bus 0000:02: resource 0 [io  0x1000-0x1fff]
[    9.217765] pci_bus 0000:02: resource 1 [mem 0xf6000000-0xf9ffffff]
[    9.218258] pci_bus 0000:02: resource 2 [mem 0xfe000000-0xfe3fffff 64bit pref]
[    9.218859] pci_bus 0000:03: resource 0 [io  0x1000-0x1fff]
[    9.219297] pci_bus 0000:03: resource 1 [mem 0xf8000000-0xf9ffffff]
[    9.219745] pci_bus 0000:03: resource 2 [mem 0xfe200000-0xfe3fffff 64bit pref]
[    9.220308] pci_bus 0000:04: resource 1 [mem 0xf6000000-0xf7ffffff]
[    9.220739] pci_bus 0000:04: resource 2 [mem 0xfe000000-0xfe1fffff 64bit pref]
[    9.224604] ACPI: \_SB_.GSIA: Enabled at IRQ 16
[    9.230777] ACPI: \_SB_.GSIB: Enabled at IRQ 17
[    9.235568] ACPI: \_SB_.GSIC: Enabled at IRQ 18
[    9.240023] ACPI: \_SB_.GSID: Enabled at IRQ 19
[    9.270003] PCI: CLS 0 bytes, default 64
[    9.270732] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    9.271006] Trying to unpack rootfs image as initramfs...
[    9.271249] software IO TLB: mapped [mem 0x000000006f000000-0x0000000073000000] (64MB)
[    9.274295] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2f914aa96b9, max_idle_ns: 440795356591 ns
[    9.281261] Initialise system trusted keyrings
[    9.281752] Key type blacklist registered
[    9.282482] workingset: timestamp_bits=36 max_order=23 bucket_order=0
[    9.283095] zbud: loaded
[    9.287143] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    9.289273] fuse: init (API version 7.41)
[    9.290720] integrity: Platform Keyring initialized
[    9.294372] integrity: Machine keyring initialized
[    9.310762] Key type asymmetric registered
[    9.311395] Asymmetric key parser 'x509' registered
[    9.312082] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[    9.313091] io scheduler mq-deadline registered
[    9.319591] ledtrig-cpu: registered to indicate activity on CPUs
[    9.320334] pciehp: pcie_hp_init 405
[    9.320878] pciehp: pcie_port_service_register = 0
[    9.320988] pcieport 0000:00:04.0: vgaarb: pci_notify
[    9.321049] pcieport 0000:00:04.0: runtime IRQ mapping not provided by arch
[    9.321082] pcie_portdrv_probe 685
[    9.379245] pcieport 0000:00:04.0: PME: Signaling with IRQ 24
[    9.393216] pcieport 0000:00:04.0: AER: enabled with IRQ 24
[    9.396322] pcieport 0000:00:04.0: save config 0x00: 0x100014ab
[    9.397052] pcieport 0000:00:04.0: save config 0x04: 0x00110507
[    9.397944] pcieport 0000:00:04.0: save config 0x08: 0x06040000
[    9.398690] pcieport 0000:00:04.0: save config 0x0c: 0x00010000
[    9.399591] pcieport 0000:00:04.0: save config 0x10: 0xfc070000
[    9.400518] pcieport 0000:00:04.0: save config 0x14: 0x00000000
[    9.401298] pcieport 0000:00:04.0: save config 0x18: 0x00040100
[    9.402286] pcieport 0000:00:04.0: save config 0x1c: 0x00001111
[    9.403125] pcieport 0000:00:04.0: save config 0x20: 0xfbf0f600
[    9.403968] pcieport 0000:00:04.0: save config 0x24: 0xfe51fe01
[    9.404770] pcieport 0000:00:04.0: save config 0x28: 0x00000000
[    9.405690] pcieport 0000:00:04.0: save config 0x2c: 0x00000000
[    9.406403] pcieport 0000:00:04.0: save config 0x30: 0x00000000
[    9.407265] pcieport 0000:00:04.0: save config 0x34: 0x00000040
[    9.408121] pcieport 0000:00:04.0: save config 0x38: 0x00000000
[    9.409042] pcieport 0000:00:04.0: save config 0x3c: 0x00000000
[    9.464453] pcie_portdrv_probe 719
[    9.465116] pcieport 0000:00:04.0: vgaarb: pci_notify
[    9.465221] pcieport 0000:01:00.0: vgaarb: pci_notify
[    9.465268] pcieport 0000:01:00.0: runtime IRQ mapping not provided by arch
[    9.465297] pcie_portdrv_probe 685
[    9.515064] pcieport 0000:01:00.0: save config 0x00: 0xc0401000
[    9.517395] pcieport 0000:01:00.0: save config 0x04: 0x00100107
[    9.519650] pcieport 0000:01:00.0: save config 0x08: 0x060400a0
[    9.521985] pcieport 0000:01:00.0: save config 0x0c: 0x00810000
[    9.524235] pcieport 0000:01:00.0: save config 0x10: 0xfa000000
[    9.531654] pcieport 0000:01:00.0: save config 0x14: 0x00000000
[    9.534654] pcieport 0000:01:00.0: save config 0x18: 0x00040201
[    9.537007] pcieport 0000:01:00.0: save config 0x1c: 0x00001111
[    9.539209] pcieport 0000:01:00.0: save config 0x20: 0xf9f0f600
[    9.541459] pcieport 0000:01:00.0: save config 0x24: 0xfe31fe01
[    9.545339] pcieport 0000:01:00.0: save config 0x28: 0x00000000
[    9.547592] pcieport 0000:01:00.0: save config 0x2c: 0x00000000
[    9.549908] pcieport 0000:01:00.0: save config 0x30: 0x00000000
[    9.552135] pcieport 0000:01:00.0: save config 0x34: 0x00000040
[    9.554529] pcieport 0000:01:00.0: save config 0x38: 0x00000000
[    9.557414] pcieport 0000:01:00.0: save config 0x3c: 0x00020000
[    9.740785] pcie_portdrv_probe 719
[    9.741308] pcieport 0000:01:00.0: vgaarb: pci_notify
[    9.741439] pcieport 0000:02:01.0: vgaarb: pci_notify
[    9.741494] pcieport 0000:02:01.0: runtime IRQ mapping not provided by arch
[    9.741522] pcie_portdrv_probe 685
[    9.874966] pciehp: pciehp_probe 188 
[    9.878492] pcieport 0000:02:01.0: pciehp: Slot Capabilities      : 0x0000007f
[    9.880769] pcieport 0000:02:01.0: pciehp: Slot Status            : 0x0030
[    9.883129] pcieport 0000:02:01.0: pciehp: Slot Control           : 0x07c0
[    9.885390] pcieport 0000:02:01.0: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+
[    9.889164] pcieport 0000:02:01.0: pciehp: pciehp_get_power_status: SLOTCTRL 80 value read 7c0
[    9.895046] pcieport 0000:02:01.0: pciehp: pciehp_check_link_active: lnk_status = 2025
[    9.951668] pci_bus 0000:03: dev 00, created physical slot 0
[    9.988027] pcieport 0000:02:01.0: pciehp: pcie_enable_notification: SLOTCTRL 80 write cmd 1031
[    9.996292] pcieport 0000:02:01.0: pciehp: pciehp_check_link_active: lnk_status = 2025
[   10.000886] pcieport 0000:02:01.0: save config 0x00: 0xc0401000
[    9.989268] pcieport 0000:02:01.0: pciehp: pending interrupts 0x0010 from Slot Status
[   10.005466] pcieport 0000:02:01.0: save config 0x04: 0x00100107
[   10.008523] pcieport 0000:02:01.0: save config 0x08: 0x060400a0
[   10.010786] pcieport 0000:02:01.0: save config 0x0c: 0x00010000
[   10.013143] pcieport 0000:02:01.0: save config 0x10: 0x00000000
[   10.015313] pcieport 0000:02:01.0: save config 0x14: 0x00000000
[   10.017704] pcieport 0000:02:01.0: save config 0x18: 0x00030302
[   10.019972] pcieport 0000:02:01.0: save config 0x1c: 0x00001111
[   10.022430] pcieport 0000:02:01.0: save config 0x20: 0xf9f0f800
[   10.025325] pcieport 0000:02:01.0: save config 0x24: 0xfe31fe21
[   10.027604] pcieport 0000:02:01.0: save config 0x28: 0x00000000
[   10.030000] pcieport 0000:02:01.0: save config 0x2c: 0x00000000
[   10.032189] pcieport 0000:02:01.0: save config 0x30: 0x00000000
[   10.034521] pcieport 0000:02:01.0: save config 0x34: 0x00000040
[   10.037025] pcieport 0000:02:01.0: save config 0x38: 0x00000000
[   10.039920] pcieport 0000:02:01.0: save config 0x3c: 0x00020000
[   10.236234] pcie_portdrv_probe 719
[   10.236762] pcieport 0000:02:01.0: vgaarb: pci_notify
[   10.236858] pcieport 0000:02:02.0: vgaarb: pci_notify
[   10.236923] pcieport 0000:02:02.0: runtime IRQ mapping not provided by arch
[   10.236953] pcie_portdrv_probe 685
[   10.332451] pcieport 0000:02:02.0: save config 0x00: 0xc0401000
[   10.334599] pcieport 0000:02:02.0: save config 0x04: 0x00100107
[   10.336964] pcieport 0000:02:02.0: save config 0x08: 0x060400a0
[   10.339231] pcieport 0000:02:02.0: save config 0x0c: 0x00010000
[   10.341390] pcieport 0000:02:02.0: save config 0x10: 0x00000000
[   10.344371] pcieport 0000:02:02.0: save config 0x14: 0x00000000
[   10.346736] pcieport 0000:02:02.0: save config 0x18: 0x00040402
[   10.349148] pcieport 0000:02:02.0: save config 0x1c: 0x000001f1
[   10.351430] pcieport 0000:02:02.0: save config 0x20: 0xf7f0f600
[   10.353699] pcieport 0000:02:02.0: save config 0x24: 0xfe11fe01
[   10.355994] pcieport 0000:02:02.0: save config 0x28: 0x00000000
[   10.358275] pcieport 0000:02:02.0: save config 0x2c: 0x00000000
[   10.361239] pcieport 0000:02:02.0: save config 0x30: 0x00000000
[   10.363717] pcieport 0000:02:02.0: save config 0x34: 0x00000040
[   10.366009] pcieport 0000:02:02.0: save config 0x38: 0x00000000
[   10.368119] pcieport 0000:02:02.0: save config 0x3c: 0x00020000
[   10.555920] pcie_portdrv_probe 719
[   10.556589] pcieport 0000:02:02.0: vgaarb: pci_notify
[   10.557033] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[   10.560253] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[   10.561195] ACPI: button: Power Button [PWRF]
[   10.567811] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[   10.597727] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[   10.609676] Linux agpgart interface v0.103
[   10.610306] agpgart-intel 0000:00:00.0: vgaarb: pci_notify
[   10.610320] agpgart-intel 0000:00:00.0: runtime IRQ mapping not provided by arch
[   10.610540] agpgart-intel 0000:00:00.0: vgaarb: pci_notify
[   10.610732] ACPI: bus type drm_connector registered
[   10.631270] loop: module loaded
[   10.633420] tun: Universal TUN/TAP device driver, 1.6
[   10.634036] PPP generic driver version 2.4.2
[   10.634714] ehci-pci 0000:00:1d.7: vgaarb: pci_notify
[   10.634736] ehci-pci 0000:00:1d.7: runtime IRQ mapping not provided by arch
[   10.634800] uhci_hcd 0000:00:1d.0: vgaarb: pci_notify
[   10.634814] uhci_hcd 0000:00:1d.0: runtime IRQ mapping not provided by arch
[   10.638735] uhci_hcd 0000:00:1d.0: enabling bus mastering
[   10.639240] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[   10.639519] ehci-pci 0000:00:1d.7: enabling bus mastering
[   10.647383] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1
[   10.648414] uhci_hcd 0000:00:1d.0: detected 2 ports
[   10.649073] uhci_hcd 0000:00:1d.0: irq 16, io port 0x0000c080
[   10.649921] usb usb1: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.11
[   10.650529] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   10.651085] usb usb1: Product: UHCI Host Controller
[   10.651508] usb usb1: Manufacturer: Linux 6.11.0+ uhci_hcd
[   10.652018] usb usb1: SerialNumber: 0000:00:1d.0
[   10.652887] hub 1-0:1.0: USB hub found
[   10.653675] hub 1-0:1.0: 2 ports detected
[   10.654729] uhci_hcd 0000:00:1d.0: vgaarb: pci_notify
[   10.654750] uhci_hcd 0000:00:1d.1: vgaarb: pci_notify
[   10.654768] uhci_hcd 0000:00:1d.1: runtime IRQ mapping not provided by arch
[   10.655194] ehci-pci 0000:00:1d.7: EHCI Host Controller
[   10.656077] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2
[   10.656885] uhci_hcd 0000:00:1d.1: enabling bus mastering
[   10.664144] ehci-pci 0000:00:1d.7: enabling Mem-Wr-Inval
[   10.664266] ehci-pci 0000:00:1d.7: irq 19, io mem 0xfc081000
[   10.671408] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[   10.672714] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.11
[   10.686435] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   10.687886] usb usb2: Product: EHCI Host Controller
[   10.692662] usb usb2: Manufacturer: Linux 6.11.0+ ehci_hcd
[   10.693360] usb usb2: SerialNumber: 0000:00:1d.7
[   10.694539] hub 2-0:1.0: USB hub found
[   10.695720] hub 2-0:1.0: 6 ports detected
[   10.719710] hub 1-0:1.0: USB hub found
[   10.721122] hub 1-0:1.0: 2 ports detected
[   10.726167] ehci-pci 0000:00:1d.7: vgaarb: pci_notify
[   10.726260] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[   10.726833] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
[   10.727473] uhci_hcd 0000:00:1d.1: detected 2 ports
[   10.728107] uhci_hcd 0000:00:1d.1: irq 17, io port 0x0000c0a0
[   10.728845] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.11
[   10.729570] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   10.730124] usb usb3: Product: UHCI Host Controller
[   10.730533] usb usb3: Manufacturer: Linux 6.11.0+ uhci_hcd
[   10.730985] usb usb3: SerialNumber: 0000:00:1d.1
[   10.731797] hub 3-0:1.0: USB hub found
[   10.732221] hub 3-0:1.0: 2 ports detected
[   10.733221] uhci_hcd 0000:00:1d.1: vgaarb: pci_notify
[   10.733242] uhci_hcd 0000:00:1d.2: vgaarb: pci_notify
[   10.733254] uhci_hcd 0000:00:1d.2: runtime IRQ mapping not provided by arch
[   10.735361] uhci_hcd 0000:00:1d.2: enabling bus mastering
[   10.735660] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[   10.736156] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
[   10.736802] uhci_hcd 0000:00:1d.2: detected 2 ports
[   10.737448] uhci_hcd 0000:00:1d.2: irq 18, io port 0x0000c0c0
[   10.738157] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001, bcdDevice= 6.11
[   10.738867] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[   10.739455] usb usb4: Product: UHCI Host Controller
[   10.739863] usb usb4: Manufacturer: Linux 6.11.0+ uhci_hcd
[   10.741896] usb usb4: SerialNumber: 0000:00:1d.2
[   10.742674] hub 4-0:1.0: USB hub found
[   10.743103] hub 4-0:1.0: 2 ports detected
[   10.743951] uhci_hcd 0000:00:1d.2: vgaarb: pci_notify
[   10.744186] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[   10.746228] serio: i8042 KBD port at 0x60,0x64 irq 1
[   10.746676] serio: i8042 AUX port at 0x60,0x64 irq 12
[   10.747597] mousedev: PS/2 mouse device common for all mice
[   10.749966] rtc_cmos 00:04: RTC can wake from S4
[   10.756274] rtc_cmos 00:04: registered as rtc0
[   10.756624] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[   10.758204] rtc_cmos 00:04: setting system clock to 2024-09-29T13:46:51 UTC (1727617611)
[   10.761294] rtc_cmos 00:04: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[   10.762001] i2c_dev: i2c /dev entries driver
[   10.762496] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[   10.763309] device-mapper: uevent: version 1.0.3
[   10.763988] device-mapper: ioctl: 4.48.0-ioctl (2023-03-01) initialised: dm-devel@lists.linux.dev
[   10.764805] platform eisa.0: Probing EISA bus 0
[   10.765480] platform eisa.0: EISA: Cannot allocate resource for mainboard
[   10.765994] platform eisa.0: Cannot allocate resource for EISA slot 1
[   10.766479] platform eisa.0: Cannot allocate resource for EISA slot 2
[   10.767147] platform eisa.0: Cannot allocate resource for EISA slot 3
[   10.767651] platform eisa.0: Cannot allocate resource for EISA slot 4
[   10.768130] platform eisa.0: Cannot allocate resource for EISA slot 5
[   10.768587] platform eisa.0: Cannot allocate resource for EISA slot 6
[   10.769047] platform eisa.0: Cannot allocate resource for EISA slot 7
[   10.769556] platform eisa.0: Cannot allocate resource for EISA slot 8
[   10.770057] platform eisa.0: EISA: Detected 0 cards
[   10.770490] intel_pstate: CPU model not supported
[   10.771171] drop_monitor: Initializing network drop monitor service
[   10.772292] NET: Registered PF_INET6 protocol family
[   15.510601] Freeing initrd memory: 653784K
[   15.536805] Segment Routing with IPv6
[   15.537429] In-situ OAM (IOAM) with IPv6
[   15.538113] NET: Registered PF_PACKET protocol family
[   15.538872] Key type dns_resolver registered
[   15.544730] IPI shorthand broadcast: enabled
[   15.554587] sched_clock: Marking stable (15439006792, 115339519)->(18768577571, -3214231260)
[   15.556272] registered taskstats version 1
[   15.559610] Loading compiled-in X.509 certificates
[   15.561874] Loaded X.509 cert 'Build time autogenerated kernel key: 3197c3f02ab608f8298d8c3bfd81580f22cd2217'
[   15.588065] Demotion targets for Node 0: null
[   15.588874] Key type .fscrypt registered
[   15.589264] Key type fscrypt-provisioning registered
[   15.642815] Key type encrypted registered
[   15.643293] AppArmor: AppArmor sha256 policy hashing enabled
[   15.643780] ima: No TPM chip found, activating TPM-bypass!
[   15.644244] Loading compiled-in module X.509 certificates
[   15.645607] Loaded X.509 cert 'Build time autogenerated kernel key: 3197c3f02ab608f8298d8c3bfd81580f22cd2217'
[   15.646313] ima: Allocated hash algorithm: sha256
[   15.646812] ima: No architecture policies found
[   15.647309] evm: Initialising EVM extended attributes:
[   15.647715] evm: security.selinux
[   15.648063] evm: security.SMACK64
[   15.648408] evm: security.SMACK64EXEC
[   15.648778] evm: security.SMACK64TRANSMUTE
[   15.649144] evm: security.SMACK64MMAP
[   15.649501] evm: security.apparmor
[   15.649906] evm: security.ima
[   15.650245] evm: security.capability
[   15.650610] evm: HMAC attrs: 0x1
[   15.651901] PM:   Magic number: 8:812:787
[   15.653103] RAS: Correctable Errors collector initialized.
[   15.653582] PCI: pci_mmcfg_late_insert_resources() pci_probe 0x8
[   15.653592] PCI: pci_mmcfg_late_insert_resources() insert [mem 0xb0000000-0xbfffffff]
[   15.653757] clk: Disabling unused clocks
[   15.654406] PM: genpd: Disabling unused power domains
[   15.659169] Freeing unused decrypted memory: 2028K
[   15.665096] Freeing unused kernel image (initmem) memory: 5052K
[   15.665988] Write protecting the kernel read-only data: 32768k
[   15.669053] Freeing unused kernel image (rodata/data gap) memory: 1896K
[   15.867248] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[   15.867826] x86/mm: Checking user space page tables
[   16.055608] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[   16.056209] Run /init as init process
[   16.056565]   with arguments:
[   16.056571]     /init
[   16.056577]     quite
[   16.056582]     splash
[   16.056586]   with environment:
[   16.056591]     HOME=/
[   16.056596]     TERM=linux
[   16.056601]     BOOT_IMAGE=/boot/vmlinuz-6.11.0+
[   16.383440] lpc_ich 0000:00:1f.0: vgaarb: pci_notify
[   16.383466] lpc_ich 0000:00:1f.0: runtime IRQ mapping not provided by arch
[   16.387726] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized
[   16.388791] lpc_ich 0000:00:1f.0: vgaarb: pci_notify
[   16.392452] e1000: Intel(R) PRO/1000 Network Driver
[   16.392967] e1000: Copyright (c) 1999-2006 Intel Corporation.
[   16.393586] e1000 0000:00:02.0: vgaarb: pci_notify
[   16.393604] e1000 0000:00:02.0: runtime IRQ mapping not provided by arch
[   16.395840] ACPI: \_SB_.GSIG: Enabled at IRQ 22
[   16.396193] ahci 0000:00:1f.2: vgaarb: pci_notify
[   16.396298] ahci 0000:00:1f.2: runtime IRQ mapping not provided by arch
[   16.396311] ahci 0000:00:1f.2: version 3.0
[   16.396565] e1000 0000:00:02.0: enabling bus mastering
[   16.396976] e1000 0000:00:02.0: save config 0x00: 0x100e8086
[   16.396995] e1000 0000:00:02.0: save config 0x04: 0x00000107
[   16.397038] e1000 0000:00:02.0: save config 0x08: 0x02000003
[   16.397055] e1000 0000:00:02.0: save config 0x0c: 0x00000000
[   16.397078] e1000 0000:00:02.0: save config 0x10: 0xfc040000
[   16.397100] e1000 0000:00:02.0: save config 0x14: 0x0000c001
[   16.397130] e1000 0000:00:02.0: save config 0x18: 0x00000000
[   16.397152] e1000 0000:00:02.0: save config 0x1c: 0x00000000
[   16.397174] e1000 0000:00:02.0: save config 0x20: 0x00000000
[   16.397196] e1000 0000:00:02.0: save config 0x24: 0x00000000
[   16.397219] e1000 0000:00:02.0: save config 0x28: 0x00000000
[   16.397241] e1000 0000:00:02.0: save config 0x2c: 0x11001af4
[   16.397263] e1000 0000:00:02.0: save config 0x30: 0xfc000000
[   16.397286] e1000 0000:00:02.0: save config 0x34: 0x00000000
[   16.397308] e1000 0000:00:02.0: save config 0x38: 0x00000000
[   16.397330] e1000 0000:00:02.0: save config 0x3c: 0x0000010b
[   16.400583] ahci 0000:00:1f.2: AHCI vers 0001.0000, 32 command slots, 1.5 Gbps, SATA mode
[   16.401224] ahci 0000:00:1f.2: 6/6 ports implemented (port mask 0x3f)
[   16.401746] ahci 0000:00:1f.2: flags: 64bit ncq only 
[   16.405491] i801_smbus 0000:00:1f.3: vgaarb: pci_notify
[   16.405933] i801_smbus 0000:00:1f.3: runtime IRQ mapping not provided by arch
[   16.408128] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[   16.411091] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input4
[   16.411442] i2c i2c-0: Memory type 0x07 not supported yet, not instantiating SPD
[   16.413631] scsi host0: ahci
[   16.415586] i801_smbus 0000:00:1f.3: save config 0x00: 0x29308086
[   16.415606] i801_smbus 0000:00:1f.3: save config 0x04: 0x00000103
[   16.415622] i801_smbus 0000:00:1f.3: save config 0x08: 0x0c050002
[   16.415642] i801_smbus 0000:00:1f.3: save config 0x0c: 0x00800000
[   16.415695] i801_smbus 0000:00:1f.3: save config 0x10: 0x00000000
[   16.415745] i801_smbus 0000:00:1f.3: save config 0x14: 0x00000000
[   16.415791] i801_smbus 0000:00:1f.3: save config 0x18: 0x00000000
[   16.415813] i801_smbus 0000:00:1f.3: save config 0x1c: 0x00000000
[   16.415859] i801_smbus 0000:00:1f.3: save config 0x20: 0x00000701
[   16.415904] i801_smbus 0000:00:1f.3: save config 0x24: 0x00000000
[   16.415948] i801_smbus 0000:00:1f.3: save config 0x28: 0x00000000
[   16.415970] i801_smbus 0000:00:1f.3: save config 0x2c: 0x11001af4
[   16.416000] i801_smbus 0000:00:1f.3: save config 0x30: 0x00000000
[   16.416033] i801_smbus 0000:00:1f.3: save config 0x34: 0x00000000
[   16.416065] i801_smbus 0000:00:1f.3: save config 0x38: 0x00000000
[   16.416096] i801_smbus 0000:00:1f.3: save config 0x3c: 0x0000010a
[   16.416125] i801_smbus 0000:00:1f.3: vgaarb: pci_notify
[   16.416895] scsi host1: ahci
[   16.418144] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
[   16.420848] scsi host2: ahci
[   16.427141] scsi host3: ahci
[   16.428405] scsi host4: ahci
[   16.429628] scsi host5: ahci
[   16.430314] ata1: SATA max UDMA/133 abar m4096@0xfc082000 port 0xfc082100 irq 27 lpm-pol 0
[   16.431113] ata2: SATA max UDMA/133 abar m4096@0xfc082000 port 0xfc082180 irq 27 lpm-pol 0
[   16.431747] ata3: SATA max UDMA/133 abar m4096@0xfc082000 port 0xfc082200 irq 27 lpm-pol 0
[   16.432288] ata4: SATA max UDMA/133 abar m4096@0xfc082000 port 0xfc082280 irq 27 lpm-pol 0
[   16.432891] ata5: SATA max UDMA/133 abar m4096@0xfc082000 port 0xfc082300 irq 27 lpm-pol 0
[   16.433535] ata6: SATA max UDMA/133 abar m4096@0xfc082000 port 0xfc082380 irq 27 lpm-pol 0
[   16.434174] ahci 0000:00:1f.2: vgaarb: pci_notify
[   16.745463] ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[   16.747322] ata6: SATA link down (SStatus 0 SControl 300)
[   16.748972] ata4: SATA link down (SStatus 0 SControl 300)
[   16.750278] ata3: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[   16.751247] ata5: SATA link down (SStatus 0 SControl 300)
[   16.752773] ata2: SATA link down (SStatus 0 SControl 300)
[   16.755895] ata1.00: ATA-7: QEMU HARDDISK, 2.5+, max UDMA/100
[   16.757826] ata1.00: 146800640 sectors, multi 16: LBA48 NCQ (depth 32)
[   16.759456] ata1.00: applying bridge limits
[   16.760816] ata3.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100
[   16.768641] ata3.00: applying bridge limits
[   16.769376] ata1.00: configured for UDMA/100
[   16.770061] ata3.00: configured for UDMA/100
[   16.770301] scsi 0:0:0:0: Direct-Access     ATA      QEMU HARDDISK    2.5+ PQ: 0 ANSI: 5
[   16.772797] sd 0:0:0:0: Attached scsi generic sg0 type 0
[   16.772874] sd 0:0:0:0: [sda] 146800640 512-byte logical blocks: (75.2 GB/70.0 GiB)
[   16.776231] scsi 2:0:0:0: CD-ROM            QEMU     QEMU DVD-ROM     2.5+ PQ: 0 ANSI: 5
[   16.776414] sd 0:0:0:0: [sda] Write Protect is off
[   16.778311] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[   16.778531] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[   16.780027] sd 0:0:0:0: [sda] Preferred minimum I/O size 512 bytes
[   16.780365] sr 2:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[   16.781323] cdrom: Uniform CD-ROM driver Revision: 3.20
[   16.783585] sr 2:0:0:0: [sr0] Hmm, seems the drive doesn't support multisession CD's
[   16.789403] sr 2:0:0:0: Attached scsi CD-ROM sr0
[   16.789606] sr 2:0:0:0: Attached scsi generic sg1 type 5
[   16.800142]  sda: sda1 sda2 sda3
[   16.801178] sd 0:0:0:0: [sda] Attached SCSI disk
[   16.900876] e1000 0000:00:02.0 eth0: (PCI:33MHz:32-bit) 52:54:00:12:34:56
[   16.901469] e1000 0000:00:02.0 eth0: Intel(R) PRO/1000 Network Connection
[   16.901974] e1000 0000:00:02.0: vgaarb: pci_notify
[   16.905301] e1000 0000:00:02.0 enp0s2: renamed from eth0
[   17.616416] EXT4-fs (sda3): mounted filesystem f563804b-1b93-4921-90e1-4114c8111e8f ro with ordered data mode. Quota mode: none.
[   18.824021] systemd[1]: Inserted module 'autofs4'
[   18.888740] systemd[1]: systemd 249.11-0ubuntu3.12 running in system mode (+PAM +AUDIT +SELINUX +APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 -PWQUALITY -P11KIT -QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD -XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[   18.891670] systemd[1]: Detected virtualization kvm.
[   18.892134] systemd[1]: Detected architecture x86-64.
[   18.896232] systemd[1]: Hostname set to <ky-qemu-01>.
[   19.062310] block sda: the capability attribute has been deprecated.
[   19.168804] systemd[1]: Configuration file /run/systemd/system/netplan-ovs-cleanup.service is marked world-inaccessible. This has no effect as configuration data is accessible via APIs without restrictions. Proceeding anyway.
[   19.324433] random: crng init done
[   19.328691] systemd[1]: Queued start job for default target Multi-User System.
[   19.345399] systemd[1]: Created slice Slice /system/modprobe.
[   19.347838] systemd[1]: Created slice Slice /system/systemd-fsck.
[   19.350033] systemd[1]: Created slice User and Session Slice.
[   19.351519] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[   19.353564] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[   19.355236] systemd[1]: Reached target Remote File Systems.
[   19.356558] systemd[1]: Reached target Slice Units.
[   19.359019] systemd[1]: Reached target Mounting snaps.
[   19.360225] systemd[1]: Reached target Local Verity Protected Volumes.
[   19.362005] systemd[1]: Listening on Syslog Socket.
[   19.363497] systemd[1]: Listening on fsck to fsckd communication Socket.
[   19.365087] systemd[1]: Listening on initctl Compatibility Named Pipe.
[   19.366979] systemd[1]: Listening on Journal Audit Socket.
[   19.368429] systemd[1]: Listening on Journal Socket (/dev/log).
[   19.370057] systemd[1]: Listening on Journal Socket.
[   19.371771] systemd[1]: Listening on udev Control Socket.
[   19.373259] systemd[1]: Listening on udev Kernel Socket.
[   19.393707] systemd[1]: Mounting Huge Pages File System...
[   19.397796] systemd[1]: Mounting POSIX Message Queue File System...
[   19.401999] systemd[1]: Mounting Kernel Debug File System...
[   19.406258] systemd[1]: Mounting Kernel Trace File System...
[   19.415270] systemd[1]: Starting Journal Service...
[   19.419711] systemd[1]: Starting Set the console keyboard layout...
[   19.424111] systemd[1]: Starting Create List of Static Device Nodes...
[   19.429089] systemd[1]: Starting Load Kernel Module configfs...
[   19.433435] systemd[1]: Starting Load Kernel Module drm...
[   19.438006] systemd[1]: Starting Load Kernel Module efi_pstore...
[   19.442478] systemd[1]: Starting Load Kernel Module fuse...
[   19.444053] systemd[1]: Condition check resulted in File System Check on Root Device being skipped.
[   19.450516] systemd[1]: Starting Load Kernel Modules...
[   19.455573] systemd[1]: Starting Remount Root and Kernel File Systems...
[   19.461177] systemd[1]: Starting Coldplug All udev Devices...
[   19.466828] systemd[1]: Mounted Huge Pages File System.
[   19.468817] systemd[1]: Mounted POSIX Message Queue File System.
[   19.470311] systemd[1]: Mounted Kernel Debug File System.
[   19.472030] systemd[1]: Mounted Kernel Trace File System.
[   19.474770] systemd[1]: Finished Create List of Static Device Nodes.
[   19.477427] systemd[1]: modprobe@configfs.service: Deactivated successfully.
[   19.479241] systemd[1]: Finished Load Kernel Module configfs.
[   19.481897] systemd[1]: modprobe@drm.service: Deactivated successfully.
[   19.483607] systemd[1]: Finished Load Kernel Module drm.
[   19.485650] systemd[1]: modprobe@efi_pstore.service: Deactivated successfully.
[   19.487472] systemd[1]: Finished Load Kernel Module efi_pstore.
[   19.494215] systemd[1]: modprobe@fuse.service: Deactivated successfully.
[   19.495867] systemd[1]: Finished Load Kernel Module fuse.
[   19.508562] EXT4-fs (sda3): re-mounted f563804b-1b93-4921-90e1-4114c8111e8f r/w. Quota mode: none.
[   19.521082] systemd[1]: Mounting FUSE Control File System...
[   19.523787] lp: driver loaded but no devices found
[   19.525848] systemd[1]: Mounting Kernel Configuration File System...
[   19.531478] systemd[1]: Finished Set the console keyboard layout.
[   19.535133] systemd[1]: Finished Remount Root and Kernel File Systems.
[   19.537181] systemd[1]: Mounted FUSE Control File System.
[   19.538042] ppdev: user-space parallel port driver
[   19.539549] systemd[1]: Mounted Kernel Configuration File System.
[   19.545003] systemd[1]: Activating swap /swapfile...
[   19.546382] systemd[1]: Condition check resulted in Platform Persistent Storage Archival being skipped.
[   19.549871] parport_pc 00:02: reported by Plug and Play ACPI
[   19.550313] systemd[1]: Starting Load/Save Random Seed...
[   19.553452] parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]
[   19.558112] Adding 2097148k swap on /swapfile.  Priority:-2 extents:6 across:2260988k 
[   19.558251] systemd[1]: Starting Create System Users...
[   19.566254] systemd[1]: Activated swap /swapfile.
[   19.578128] systemd[1]: Reached target Swaps.
[   19.586001] systemd[1]: Finished Load/Save Random Seed.
[   19.589089] systemd[1]: Condition check resulted in First Boot Complete being skipped.
[   19.597876] systemd[1]: Finished Create System Users.
[   19.629177] systemd[1]: Starting Create Static Device Nodes in /dev...
[   19.663684] lp0: using parport0 (interrupt-driven).
[   19.670282] systemd[1]: Finished Create Static Device Nodes in /dev.
[   19.672983] systemd[1]: Reached target Preparation for Local File Systems.
[   19.704946] systemd[1]: Mounting Mount unit for bare, revision 5...
[   19.711298] loop0: detected capacity change from 0 to 8
[   19.714830] systemd[1]: Mounting Mount unit for core20, revision 2318...
[   19.720993] loop1: detected capacity change from 0 to 130960
[   19.722335] systemd[1]: Mounting Mount unit for core20, revision 2379...
[   19.727640] loop2: detected capacity change from 0 to 131016
[   19.743010] systemd[1]: Mounting Mount unit for core22, revision 1612...
[   19.748555] loop3: detected capacity change from 0 to 152112
[   19.756720] systemd[1]: Mounting Mount unit for core22, revision 1621...
[   19.768296] loop4: detected capacity change from 0 to 152056
[   19.769786] systemd[1]: Mounting Mount unit for firefox, revision 4848...
[   19.777393] systemd[1]: Mounting Mount unit for firefox, revision 4955...
[   19.779835] loop5: detected capacity change from 0 to 555496
[   19.785145] systemd[1]: Mounting Mount unit for gnome-3-38-2004, revision 143...
[   19.785155] loop6: detected capacity change from 0 to 555776
[   19.791123] loop7: detected capacity change from 0 to 716176
[   19.793691] systemd[1]: Mounting Mount unit for gnome-42-2204, revision 172...
[   19.801036] systemd[1]: Mounting Mount unit for gnome-42-2204, revision 176...
[   19.801206] loop8: detected capacity change from 0 to 1032504
[   19.808504] loop9: detected capacity change from 0 to 1034424
[   19.810184] systemd[1]: Mounting Mount unit for gtk-common-themes, revision 1535...
[   19.817662] loop10: detected capacity change from 0 to 187776
[   19.824139] systemd[1]: Mounting Mount unit for snap-store, revision 1113...
[   19.832280] loop11: detected capacity change from 0 to 26472
[   19.836734] systemd[1]: Mounting Mount unit for snap-store, revision 959...
[   19.844250] loop12: detected capacity change from 0 to 25240
[   19.846065] systemd[1]: Mounting Mount unit for snapd, revision 21465...
[   19.853620] systemd[1]: Mounting Mount unit for snapd, revision 21759...
[   19.860727] loop13: detected capacity change from 0 to 79328
[   19.863109] systemd[1]: Mounting Mount unit for snapd-desktop-integration, revision 157...
[   19.870287] loop14: detected capacity change from 0 to 79520
[   19.871080] systemd[1]: Mounting Mount unit for snapd-desktop-integration, revision 178...
[   19.872730] loop15: detected capacity change from 0 to 952
[   19.879302] loop16: detected capacity change from 0 to 1000
[   19.885401] systemd[1]: Mounting Mount unit for firefox, revision 2987 via mount-control...
[   19.896947] systemd[1]: Starting Rule-based Manager for Device Events and Files...
[   19.932408] systemd[1]: Started Journal Service.
[   20.056553] systemd-journald[350]: Received client request to flush runtime journal.
[   20.158406] systemd-journald[350]: File /var/log/journal/e723f48334f34e0c92cc39fe2158fce7/system.journal corrupted or uncleanly shut down, renaming and replacing.
[   21.242001] workqueue: blk_mq_run_work_fn hogged CPU for >10000us 4 times, consider switching to WQ_UNBOUND
[   21.267994] hrtimer: interrupt took 4143542 ns
[   21.388431] workqueue: blk_mq_run_work_fn hogged CPU for >10000us 5 times, consider switching to WQ_UNBOUND
[   21.489739] workqueue: blk_mq_run_work_fn hogged CPU for >10000us 7 times, consider switching to WQ_UNBOUND
[   21.560074] bochs-drm 0000:00:01.0: vgaarb: pci_notify
[   21.560112] bochs-drm 0000:00:01.0: runtime IRQ mapping not provided by arch
[   21.560158] bochs-drm 0000:00:01.0: vgaarb: deactivate vga console
[   21.639871] Console: switching to colour dummy device 80x25
[   21.640631] [drm] Found bochs VGA, ID 0xb0c5.
[   21.640644] [drm] Framebuffer size 16384 kB @ 0xfd000000, mmio @ 0xfc080000.
[   21.650728] [drm] Found EDID data blob.
[   21.651737] [drm] Initialized bochs-drm 1.0.0 for 0000:00:01.0 on minor 0
[   21.655783] fbcon: bochs-drmdrmfb (fb0) is primary device
[   21.662202] Console: switching to colour frame buffer device 160x50
[   21.664151] bochs-drm 0000:00:01.0: [drm] fb0: bochs-drmdrmfb frame buffer device
[   21.674476] bochs-drm 0000:00:01.0: vgaarb: pci_notify
[   21.961089] audit: type=1400 audit(1727617622.702:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-oosplash" pid=804 comm="apparmor_parser"
[   21.961260] audit: type=1400 audit(1727617622.702:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-senddoc" pid=805 comm="apparmor_parser"
[   21.961537] audit: type=1400 audit(1727617622.703:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-xpdfimport" pid=807 comm="apparmor_parser"
[   21.963692] audit: type=1400 audit(1727617622.703:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=802 comm="apparmor_parser"
[   21.963708] audit: type=1400 audit(1727617622.703:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=802 comm="apparmor_parser"
[   21.963720] audit: type=1400 audit(1727617622.703:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=802 comm="apparmor_parser"
[   21.963956] audit: type=1400 audit(1727617622.705:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=797 comm="apparmor_parser"
[   21.964533] audit: type=1400 audit(1727617622.706:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine" pid=808 comm="apparmor_parser"
[   21.964548] audit: type=1400 audit(1727617622.706:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine//mount-namespace-capture-helper" pid=808 comm="apparmor_parser"
[   21.968705] audit: type=1400 audit(1727617622.710:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="tcpdump" pid=803 comm="apparmor_parser"
[   23.291476] e1000: enp0s2 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   23.427514] loop17: detected capacity change from 0 to 8
[   34.804744] kauditd_printk_skb: 40 callbacks suppressed
[   34.804751] audit: type=1400 audit(1727617635.546:52): apparmor="DENIED" operation="capable" class="cap" profile="/usr/lib/snapd/snap-confine" pid=2185 comm="snap-confine" capability=12  capname="net_admin"
[   34.804766] audit: type=1400 audit(1727617635.546:53): apparmor="DENIED" operation="capable" class="cap" profile="/usr/lib/snapd/snap-confine" pid=2185 comm="snap-confine" capability=38  capname="perfmon"

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: pcie hotplug driver probe is not getting called
  2024-09-29 13:59   ` Maverickk 78
@ 2024-09-30 12:49     ` Maverickk 78
  2024-09-30 19:28     ` Bjorn Helgaas
  1 sibling, 0 replies; 11+ messages in thread
From: Maverickk 78 @ 2024-09-30 12:49 UTC (permalink / raw)
  To: Bjorn Helgaas; +Cc: linux-pci

Update:

Hi Bjorn,

Looks like the pciehp_probe is invoked and the corresponding ISR
(pciehp_isr) is triggered if there is an event, but somehow only
pciehp_isr is traced by ftrace but not the probe function.
Maybe my assumptions of ftrace need correction.

Thanks for the response.

Regards


On Sun, 29 Sept 2024 at 19:29, Maverickk 78 <maverickk1778@gmail.com> wrote:
>
> Hi Bjorn,
>
> I have a switch connecting to the Host bridge, one of the downstream port(02:1.0) on the switch has the slot enabled.
>
> Appended pcie_ports=native along with pciehp.pciehp_force=1 pciehp.pciehp_debug=1  to the cmdline and I see the driver creating symlink to sysfs device node.
>
> Does this mean pciehp can handle the hotplug events? asking this because none of the functions in pciehp_core listed in ftrace?
>
> # uname -a
>
> Linux qemu-01 6.11.0+ #2 SMP PREEMPT_DYNAMIC Sat Sep 28 01:32:57 EEST 2024 x86_64 x86_64 x86_64 GNU/Linux
>
> # cat /proc/cmdline
>
> BOOT_IMAGE=/boot/vmlinuz-6.11.0+ root=UUID=f563804b-1b93-4921-90e1-4114c8111e8f ro ftrace=function_graph ftrace_graph_filter=*pcie* pciehp.pciehp_force=1 pciehp.pciehp_debug=1 pcie_ports=native quite splash crashkernel=512M-:192M vt.handoff=7
>
> # ls -ltr /sys/bus/pci_express/drivers/pciehp
>
> total 0
>
> --w------- 1 root root 4096 Sep 29 16:46 uevent
>
> --w------- 1 root root 4096 Sep 29 16:49 unbind
>
> --w------- 1 root root 4096 Sep 29 16:49 bind
>
> lrwxrwxrwx 1 root root    0 Sep 29 16:49 0000:02:01.0:pcie204 -> ../../../../devices/pci0000:00/0000:00:04.0/0000:01:00.0/0000:02:01.0/0000:02:01.0:pcie204
>
> #
>
>
> # lspci -vv -s 2:1.0
>
> 02:01.0 PCI bridge: Broadcom / LSI Device c040 (rev a0) (prog-if 00 [Normal decode])
>
>         Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR+ FastB2B- DisINTx-
>
>         Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
>
>         Latency: 0
>
>         Interrupt: pin ? routed to IRQ 25
>
>         Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
>
>         I/O behind bridge: 00001000-00001fff [size=4K]
>
>         Memory behind bridge: f8000000-f9ffffff [size=32M]
>
>         Prefetchable memory behind bridge: 00000000fe200000-00000000fe3fffff [size=2M]
>
>         Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
>
>         BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
>
>                 PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
>
>         Capabilities: [40] Power Management version 3
>
>                 Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
>
>                 Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
>
>         Capabilities: [48] MSI: Enable+ Count=1/8 Maskable+ 64bit+
>
>                 Address: 00000000fee03000  Data: 0020
>
>                 Masking: 000000fe  Pending: 00000000
>
>         Capabilities: [68] Express (v2) Downstream Port (Slot+), MSI 00
>
>                 DevCap: MaxPayload 512 bytes, PhantFunc 0
>
>                         ExtTag- RBE+
>
>                 DevCtl: CorrErr+ NonFatalErr+ FatalErr+ UnsupReq+
>
>                         RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>
>                         MaxPayload 512 bytes, MaxReadReq 128 bytes
>
>                 DevSta: CorrErr+ NonFatalErr- FatalErr- UnsupReq+ AuxPwr- TransPend-
>
>                 LnkCap: Port #0, Speed unknown, Width x2, ASPM L1, Exit Latency L1 <32us
>
>                         ClockPM- Surprise+ LLActRep+ BwNot+ ASPMOptComp+
>
>                 LnkCtl: ASPM Disabled; Disabled- CommClk-
>
>                         ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
>
>                 LnkSta: Speed 32GT/s (downgraded), Width x2 (ok)
>
>                         TrErr- Train- SlotClk- DLActive+ BWMgmt- ABWMgmt-
>
>                 SltCap: AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug+ Surprise+
>
>                         Slot #0, PowerLimit 0.000W; Interlock- NoCompl-
>
>                 SltCtl: Enable: AttnBtn+ PwrFlt- MRL- PresDet- CmdCplt+ HPIrq+ LinkChg+
>
>                         Control: AttnInd Off, PwrInd Off, Power+ Interlock-
>
>                 SltSta: Status: AttnBtn- PowerFlt- MRL+ CmdCplt- PresDet- Interlock-
>
>                         Changed: MRL- PresDet- LinkState-
>
>                 DevCap2: Completion Timeout: Not Supported, TimeoutDis- NROPrPrP- LTR+
>
>                          10BitTagComp+ 10BitTagReq- OBFF Not Supported, ExtFmt+ EETLPPrefix+, MaxEETLPPrefixes 4
>
>                          EmergencyPowerReduction Not Supported, EmergencyPowerReductionInit-
>
>                          FRS- ARIFwd+
>
>                          AtomicOpsCap: Routing+
>
>                 DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis- LTR- OBFF Disabled, ARIFwd-
>
>                          AtomicOpsCtl: EgressBlck-
>
>                 LnkCap2: Supported Link Speeds: RsvdP, Crosslink+ Retimer+ 2Retimers+ DRS+
>
>                 LnkCtl2: Target Link Speed: Unknown, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
>
>                          Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
>
>                          Compliance De-emphasis: -6dB
>
>                 LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete- EqualizationPhase1-
>
>                          EqualizationPhase2- EqualizationPhase3- LinkEqualizationRequest-
>
>                          Retimer- 2Retimers- CrosslinkRes: Downstream Port, DRS-
>
>                          DownstreamComp: Link Up - Present
>
>         Capabilities: [a4] Subsystem: Broadcom / LSI Device 0144
>
>         Capabilities: [100 v1] Extended Capability ID 0x2f
>
>         Capabilities: [294 v3] Advanced Error Reporting
>
>                 UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
>
>                 UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
>
>                 UESvrt: DLP+ SDES+ TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
>
>                 CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr-
>
>                 CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- AdvNonFatalErr+
>
>                 AERCap: First Error Pointer: 1f, ECRCGenCap+ ECRCGenEn- ECRCChkCap+ ECRCChkEn-
>
>                         MultHdrRecCap- MultHdrRecEn- TLPPfxPres- HdrLogCap-
>
>                 HeaderLog: 00000000 00000000 00000000 00000000
>
>         Capabilities: [138 v1] Power Budgeting <?>
>
>         Capabilities: [db4 v1] Secondary PCI Express
>
>                 LnkCtl3: LnkEquIntrruptEn- PerformEqu-
>
>                 LaneErrStat: 0
>
>         Capabilities: [148 v1] Virtual Channel
>
>                 Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
>
>                 Arb:    Fixed- WRR32- WRR64- WRR128-
>
>                 Ctrl:   ArbSelect=Fixed
>
>                 Status: InProgress-
>
>                 VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
>
>                         Arb:    Fixed+ WRR32- WRR64- WRR128- TWRR128- WRR256-
>
>                         Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
>
>                         Status: NegoPending- InProgress-
>
>         Capabilities: [af4 v1] Data Link Feature <?>
>
>         Capabilities: [d00 v1] Physical Layer 16.0 GT/s <?>
>
>         Capabilities: [d40 v1] Lane Margining at the Receiver <?>
>
>         Capabilities: [e40 v1] Extended Capability ID 0x2a
>
>         Capabilities: [e70 v1] Extended Capability ID 0x31
>
>         Capabilities: [ec0 v1] Extended Capability ID 0x32
>
>         Capabilities: [a80 v1] Extended Capability ID 0x34
>
>         Capabilities: [b70 v1] Vendor Specific Information: ID=0001 Rev=0 Len=010 <?>
>
>         Capabilities: [f24 v1] Access Control Services
>
>                 ACSCap: SrcValid+ TransBlk+ ReqRedir+ CmpltRedir+ UpstreamFwd+ EgressCtrl- DirectTrans+
>
>                 ACSCtl: SrcValid- TransBlk- ReqRedir- CmpltRedir- UpstreamFwd- EgressCtrl- DirectTrans-
>
>         Capabilities: [b60 v1] Downstream Port Containment
>
>                 DpcCap: INT Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
>
>                 DpcCtl: Trigger:0 Cmpl- INT- ErrCor- PoisonedTLP- SwTrigger- DL_ActiveErr-
>
>                 DpcSta: Trigger- Reason:00 INT- RPBusy- TriggerExt:00 RP PIO ErrPtr:00
>
>                 Source: 0000
>
>         Capabilities: [b20 v1] Extended Capability ID 0x2c
>
>         Kernel driver in use: pcieport
>
>
> On Fri, 27 Sept 2024 at 22:47, Bjorn Helgaas <helgaas@kernel.org> wrote:
>>
>> On Fri, Sep 27, 2024 at 08:50:41PM +0530, Maverickk 78 wrote:
>> > Hello
>> >
>> > Debugging a downstream port with slot capabilities indicating hotplug
>> > capability is advertised in pci capability(id =0x10) .
>> >
>> > None of the hotplug driver is getting invoked.
>> >
>> > I assume pciehp_probe should've been called because its associated
>> > with ".port_type = PCIE_ANY_PORT," in the pcie_port_service_driver
>> > structure.
>> >
>> > I assumed SHPC shpc_probe function would be called because the pci_id
>> > table has PCI_CLASS_BRIDGE_PCI_NORMAL, but nothing related to hotplug
>> > drivers is seen in the ftrace or dmesg.
>> >
>> > Tried "pciehp.pciehp_force=1 pciehp.pciehp_debug=1" in the command
>> > line but no luck
>> >
>> > As part of port initialization if the hotplug capability is indicated
>> > in the capability register the hotplug drivers should have been
>> > invoked, but looks like its not the case.
>>
>> I would expect pciehp to work in this case, but there is some
>> negotiation between the OS and the firmware to figure out which
>> owns it.
>>
>> I assume you have CONFIG_PCIEPORTBUS and CONFIG_HOTPLUG_PCI_PCIE
>> enabled?  Can you supply the dmesg log and output of "sudo lspci -vv"?
>>
>> Bjorn

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: pcie hotplug driver probe is not getting called
  2024-09-29 13:59   ` Maverickk 78
  2024-09-30 12:49     ` Maverickk 78
@ 2024-09-30 19:28     ` Bjorn Helgaas
  2024-10-01 12:48       ` Maverickk 78
  1 sibling, 1 reply; 11+ messages in thread
From: Bjorn Helgaas @ 2024-09-30 19:28 UTC (permalink / raw)
  To: Maverickk 78; +Cc: linux-pci

On Sun, Sep 29, 2024 at 07:29:32PM +0530, Maverickk 78 wrote:
> Hi Bjorn,
> 
> I have a switch connecting to the Host bridge, one of the downstream
> port(02:1.0) on the switch has the slot enabled.
> 
> Appended pcie_ports=native along with pciehp.pciehp_force=1
> pciehp.pciehp_debug=1  to the cmdline and I see the driver creating symlink
> to sysfs device node.
> 
> Does this mean pciehp can handle the hotplug events? asking this because
> none of the functions in pciehp_core listed in ftrace?

From the dmesg log you attached:

  [    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.14.0-0-g155821a-20210629_105355-sharpie 04/01/2014
  [    0.000000] Hypervisor detected: KVM
  [    0.408755] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.11.0+ root=UUID=f563804b-1b93-4921-90e1-4114c8111e8f ro modprobe.blacklist=mpt3sas ftrace=function_graph ftrace_graph_filter=*pcie* pciehp.pciehp_force=1 pciehp.pciehp_debug=1 pcie_ports=native quite splash crashkernel=512M-:192M vt.handoff=7
  [    1.640055] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
  [    1.736168] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR DPC]
  [    1.738096] acpi PNP0A08:00: _OSC: OS now controls [SHPCHotplug PME AER PCIeCapability]
  [    9.885390] pcieport 0000:02:01.0: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+

I assume this kernel is running as a KVM guest.  The firmware _OSC
says the platform (QEMU) doesn't support native PCIe hotplug, so
host->native_pcie_hotplug will be false.  But of course
"pcie_ports=native" would set pcie_ports_native, so the portdrv
get_port_device_capability() will set PCIE_PORT_SERVICE_HP, which
allows pciehp to bind to 02:01.0.

The "pcieport 0000:02:01.0: pciehp: Slot #0" line shows that
pciehp_probe() was called.

I don't know whether QEMU supports PCIe hotplug interrupts though.

When do you expect pciehp to do something?  Are you hotplugging a
physical device that is passed through to this guest?

Bjorn

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: pcie hotplug driver probe is not getting called
  2024-09-30 19:28     ` Bjorn Helgaas
@ 2024-10-01 12:48       ` Maverickk 78
  2024-10-01 18:09         ` Maverickk 78
  0 siblings, 1 reply; 11+ messages in thread
From: Maverickk 78 @ 2024-10-01 12:48 UTC (permalink / raw)
  To: Bjorn Helgaas; +Cc: linux-pci

Hi Bjorn,

Yes, it's a virtual x86 Qemu environment with rtl simulated pcie gen6
switch hooked to the host controller.

The simulation environment is 3rd party and my guess is it's a
passthrough(guessing) .

I can confirm that msi is received to the Qemu host because the USP
port has f0, f1, f2, f3, f4 and f4 is an scsi end point function and
interrupts are used for command/response.

I enabled a few more debugs, now I can see more information from
pciehp dumped into the kernel log.

Thanks for the details, I was not aware that _OSC flags need to be
built by firmware to enable native PCIe hotplug.

On Tue, 1 Oct 2024 at 00:58, Bjorn Helgaas <helgaas@kernel.org> wrote:
>
> On Sun, Sep 29, 2024 at 07:29:32PM +0530, Maverickk 78 wrote:
> > Hi Bjorn,
> >
> > I have a switch connecting to the Host bridge, one of the downstream
> > port(02:1.0) on the switch has the slot enabled.
> >
> > Appended pcie_ports=native along with pciehp.pciehp_force=1
> > pciehp.pciehp_debug=1  to the cmdline and I see the driver creating symlink
> > to sysfs device node.
> >
> > Does this mean pciehp can handle the hotplug events? asking this because
> > none of the functions in pciehp_core listed in ftrace?
>
> From the dmesg log you attached:
>
>   [    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.14.0-0-g155821a-20210629_105355-sharpie 04/01/2014
>   [    0.000000] Hypervisor detected: KVM
>   [    0.408755] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.11.0+ root=UUID=f563804b-1b93-4921-90e1-4114c8111e8f ro modprobe.blacklist=mpt3sas ftrace=function_graph ftrace_graph_filter=*pcie* pciehp.pciehp_force=1 pciehp.pciehp_debug=1 pcie_ports=native quite splash crashkernel=512M-:192M vt.handoff=7
>   [    1.640055] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
>   [    1.736168] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR DPC]
>   [    1.738096] acpi PNP0A08:00: _OSC: OS now controls [SHPCHotplug PME AER PCIeCapability]
>   [    9.885390] pcieport 0000:02:01.0: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+
>
> I assume this kernel is running as a KVM guest.  The firmware _OSC
> says the platform (QEMU) doesn't support native PCIe hotplug, so
> host->native_pcie_hotplug will be false.  But of course
> "pcie_ports=native" would set pcie_ports_native, so the portdrv
> get_port_device_capability() will set PCIE_PORT_SERVICE_HP, which
> allows pciehp to bind to 02:01.0.
>
> The "pcieport 0000:02:01.0: pciehp: Slot #0" line shows that
> pciehp_probe() was called.
>
> I don't know whether QEMU supports PCIe hotplug interrupts though.
>
> When do you expect pciehp to do something?  Are you hotplugging a
> physical device that is passed through to this guest?
>
> Bjorn

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: pcie hotplug driver probe is not getting called
  2024-10-01 12:48       ` Maverickk 78
@ 2024-10-01 18:09         ` Maverickk 78
  2024-10-01 18:19           ` Keith Busch
  0 siblings, 1 reply; 11+ messages in thread
From: Maverickk 78 @ 2024-10-01 18:09 UTC (permalink / raw)
  To: Bjorn Helgaas; +Cc: linux-pci

Hi Bjorn,

I was able to trigger an interrupt, the pciehp_isr was triggered and
there are "Timeouts" while processing the hotplug,
I suspect this is due to the slowness of the simulation platform, is
my assumption correct?

[26599.580420] pcieport 0000:02:01.0: pciehp: pending interrupts
0x0001 from Slot Status
[26599.580575] pcieport 0000:02:01.0: pciehp: Slot(0): Button press:
will power on in 5 sec
[26599.593768] pcieport 0000:02:01.0: pciehp: Timeout on hotplug
command 0x17e1 (issued 42213 msec ago)
[26599.598920] pcieport 0000:02:01.0: pciehp: pciehp_set_indicators:
SLOTCTRL 80 write cmd 2c0
[26605.104802] pcieport 0000:02:01.0: pciehp:
pciehp_check_link_active: lnk_status = 2025
[26605.104840] pcieport 0000:02:01.0: pciehp: Slot(0): Link Up
[26605.109616] pcieport 0000:02:01.0: pciehp: pciehp_get_power_status:
SLOTCTRL 80 value read 16e1
[26605.126589] pcieport 0000:02:01.0: pciehp: Timeout on hotplug
command 0x16e1 (issued 5528 msec ago)
[26606.458516] pcieport 0000:02:01.0: pciehp: Timeout on hotplug
command 0x12e1 (issued 1327 msec ago)
[26606.458554] pcieport 0000:02:01.0: pciehp: pciehp_power_on_slot:
SLOTCTRL 80 write cmd 0
[26606.475509] pcieport 0000:02:01.0: pciehp: Timeout on hotplug
command 0x12e1 (issued 1344 msec ago)
[26606.481024] pcieport 0000:02:01.0: pciehp: pciehp_set_indicators:
SLOTCTRL 80 write cmd 200
[26606.618088] pcieport 0000:02:01.0: pciehp:
pciehp_check_link_status: lnk_status = 2025
[26606.674790] pci 0000:03:00.0: [abcd:0000] type 00 class 0x000000
PCIe Endpoint
[26606.725288] pci 0000:03:00.0: BAR 0 [mem 0xf8000000-0xf9ffffff]
[26607.867503] pci 0000:03:00.0: 63.014 Gb/s available PCIe bandwidth,
limited by 32.0 GT/s PCIe x2 link at 0000:02:01.0 (capable of 1024.000
Gb/s with 64.0 GT/s PCIe x16 link)
[26608.386085] pci 0000:03:00.0: vgaarb: pci_notify
[26608.491596] pcieport 0000:02:01.0: distributing available resources
[26608.491637] pcieport 0000:02:01.0: PCI bridge to [bus 03]
[26608.495947] pcieport 0000:02:01.0:   bridge window [io  0x1000-0x1fff]
[26608.513041] pcieport 0000:02:01.0:   bridge window [mem
0xf8000000-0xf9ffffff]
[26608.521771] pcieport 0000:02:01.0:   bridge window [mem
0xfe200000-0xfe3fffff 64bit pref]
[26608.647492] pcieport 0000:02:01.0: pciehp: Timeout on hotplug
command 0x12e1 (issued 2167 msec ago)
[26608.652270] pcieport 0000:02:01.0: pciehp: pciehp_set_indicators:
SLOTCTRL 80 write cmd 1c0

On Tue, 1 Oct 2024 at 18:18, Maverickk 78 <maverickk1778@gmail.com> wrote:
>
> Hi Bjorn,
>
> Yes, it's a virtual x86 Qemu environment with rtl simulated pcie gen6
> switch hooked to the host controller.
>
> The simulation environment is 3rd party and my guess is it's a
> passthrough(guessing) .
>
> I can confirm that msi is received to the Qemu host because the USP
> port has f0, f1, f2, f3, f4 and f4 is an scsi end point function and
> interrupts are used for command/response.
>
> I enabled a few more debugs, now I can see more information from
> pciehp dumped into the kernel log.
>
> Thanks for the details, I was not aware that _OSC flags need to be
> built by firmware to enable native PCIe hotplug.
>
> On Tue, 1 Oct 2024 at 00:58, Bjorn Helgaas <helgaas@kernel.org> wrote:
> >
> > On Sun, Sep 29, 2024 at 07:29:32PM +0530, Maverickk 78 wrote:
> > > Hi Bjorn,
> > >
> > > I have a switch connecting to the Host bridge, one of the downstream
> > > port(02:1.0) on the switch has the slot enabled.
> > >
> > > Appended pcie_ports=native along with pciehp.pciehp_force=1
> > > pciehp.pciehp_debug=1  to the cmdline and I see the driver creating symlink
> > > to sysfs device node.
> > >
> > > Does this mean pciehp can handle the hotplug events? asking this because
> > > none of the functions in pciehp_core listed in ftrace?
> >
> > From the dmesg log you attached:
> >
> >   [    0.000000] DMI: QEMU Standard PC (Q35 + ICH9, 2009), BIOS rel-1.14.0-0-g155821a-20210629_105355-sharpie 04/01/2014
> >   [    0.000000] Hypervisor detected: KVM
> >   [    0.408755] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-6.11.0+ root=UUID=f563804b-1b93-4921-90e1-4114c8111e8f ro modprobe.blacklist=mpt3sas ftrace=function_graph ftrace_graph_filter=*pcie* pciehp.pciehp_force=1 pciehp.pciehp_debug=1 pcie_ports=native quite splash crashkernel=512M-:192M vt.handoff=7
> >   [    1.640055] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
> >   [    1.736168] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR DPC]
> >   [    1.738096] acpi PNP0A08:00: _OSC: OS now controls [SHPCHotplug PME AER PCIeCapability]
> >   [    9.885390] pcieport 0000:02:01.0: pciehp: Slot #0 AttnBtn+ PwrCtrl+ MRL+ AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock- NoCompl- IbPresDis- LLActRep+
> >
> > I assume this kernel is running as a KVM guest.  The firmware _OSC
> > says the platform (QEMU) doesn't support native PCIe hotplug, so
> > host->native_pcie_hotplug will be false.  But of course
> > "pcie_ports=native" would set pcie_ports_native, so the portdrv
> > get_port_device_capability() will set PCIE_PORT_SERVICE_HP, which
> > allows pciehp to bind to 02:01.0.
> >
> > The "pcieport 0000:02:01.0: pciehp: Slot #0" line shows that
> > pciehp_probe() was called.
> >
> > I don't know whether QEMU supports PCIe hotplug interrupts though.
> >
> > When do you expect pciehp to do something?  Are you hotplugging a
> > physical device that is passed through to this guest?
> >
> > Bjorn

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: pcie hotplug driver probe is not getting called
  2024-10-01 18:09         ` Maverickk 78
@ 2024-10-01 18:19           ` Keith Busch
       [not found]             ` <CALfBBTtxJB1BQkSZ=RBKCiZKNeTxsJHAZ50jdBUjNSmOf79NWw@mail.gmail.com>
  0 siblings, 1 reply; 11+ messages in thread
From: Keith Busch @ 2024-10-01 18:19 UTC (permalink / raw)
  To: Maverickk 78; +Cc: Bjorn Helgaas, linux-pci

On Tue, Oct 01, 2024 at 11:39:33PM +0530, Maverickk 78 wrote:
> I was able to trigger an interrupt, the pciehp_isr was triggered and
> there are "Timeouts" while processing the hotplug,
> I suspect this is due to the slowness of the simulation platform, is
> my assumption correct?

That usually means the slot does not generate software notification, but
for whatever reason decided not set the "No Command Completed Support"
in the slot capability structure.

> [26599.580420] pcieport 0000:02:01.0: pciehp: pending interrupts 0x0001 from Slot Status
> [26599.580575] pcieport 0000:02:01.0: pciehp: Slot(0): Button press: will power on in 5 sec
> [26599.593768] pcieport 0000:02:01.0: pciehp: Timeout on hotplug command 0x17e1 (issued 42213 msec ago)
> [26599.598920] pcieport 0000:02:01.0: pciehp: pciehp_set_indicators: SLOTCTRL 80 write cmd 2c0
> [26605.104802] pcieport 0000:02:01.0: pciehp: pciehp_check_link_active: lnk_status = 2025
> [26605.104840] pcieport 0000:02:01.0: pciehp: Slot(0): Link Up
> [26605.109616] pcieport 0000:02:01.0: pciehp: pciehp_get_power_status: SLOTCTRL 80 value read 16e1
> [26605.126589] pcieport 0000:02:01.0: pciehp: Timeout on hotplug command 0x16e1 (issued 5528 msec ago)
> [26606.458516] pcieport 0000:02:01.0: pciehp: Timeout on hotplug command 0x12e1 (issued 1327 msec ago)
> [26606.458554] pcieport 0000:02:01.0: pciehp: pciehp_power_on_slot: SLOTCTRL 80 write cmd 0
> [26606.475509] pcieport 0000:02:01.0: pciehp: Timeout on hotplug command 0x12e1 (issued 1344 msec ago)
> [26606.481024] pcieport 0000:02:01.0: pciehp: pciehp_set_indicators: SLOTCTRL 80 write cmd 200
> [26606.618088] pcieport 0000:02:01.0: pciehp: pciehp_check_link_status: lnk_status = 2025
> [26606.674790] pci 0000:03:00.0: [abcd:0000] type 00 class 0x000000 PCIe Endpoint
> [26606.725288] pci 0000:03:00.0: BAR 0 [mem 0xf8000000-0xf9ffffff]
> [26607.867503] pci 0000:03:00.0: 63.014 Gb/s available PCIe bandwidth, limited by 32.0 GT/s PCIe x2 link at 0000:02:01.0 (capable of 1024.000 Gb/s with 64.0 GT/s PCIe x16 link)
> [26608.386085] pci 0000:03:00.0: vgaarb: pci_notify
> [26608.491596] pcieport 0000:02:01.0: distributing available resources
> [26608.491637] pcieport 0000:02:01.0: PCI bridge to [bus 03]
> [26608.495947] pcieport 0000:02:01.0:   bridge window [io  0x1000-0x1fff]
> [26608.513041] pcieport 0000:02:01.0:   bridge window [mem 0xf8000000-0xf9ffffff]
> [26608.521771] pcieport 0000:02:01.0:   bridge window [mem 0xfe200000-0xfe3fffff 64bit pref]
> [26608.647492] pcieport 0000:02:01.0: pciehp: Timeout on hotplug command 0x12e1 (issued 2167 msec ago)
> [26608.652270] pcieport 0000:02:01.0: pciehp: pciehp_set_indicators: SLOTCTRL 80 write cmd 1c0

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: pcie hotplug driver probe is not getting called
       [not found]             ` <CALfBBTtxJB1BQkSZ=RBKCiZKNeTxsJHAZ50jdBUjNSmOf79NWw@mail.gmail.com>
@ 2024-10-04 18:20               ` Maverickk 78
  2024-10-04 21:56                 ` Bjorn Helgaas
  0 siblings, 1 reply; 11+ messages in thread
From: Maverickk 78 @ 2024-10-04 18:20 UTC (permalink / raw)
  To: Keith Busch; +Cc: Bjorn Helgaas, linux-pci

Hello,


The platform I am working on is rtl simulation of pcie switch(Gen6)
with a backdoor mechanism to trigger the HotPlug event.

Tried following patches independently to have both hotplug and dpc
driver register and handle respective events.

https://patchwork.ozlabs.org/project/linux-pci/patch/20231223212235.34293-2-mattc@purestorage.com/
https://patchwork.kernel.org/project/linux-pci/patch/20240108194642.30460-1-mattc@purestorage.com/#25680870

Tried following

- Trigger hot removal and add, the event is triggered and respective
msi in /proc/interrupt increments and kernel logs the event(dmesg)
- Trigger hot removal and add, the event is triggered and respective
msi in /proc/interrupt increments and kernel logs the event(dmesg)
- Trigger DPC using "DPC software trigger" in DPC control register

The kernel hangs, the console is non-responsive.

Can dpc and pciehp co-exist and handle the events?


On Thu, 3 Oct 2024 at 20:22, Maverickk 78 <maverickk1778@gmail.com> wrote:
>
> Thanks Bjorn,
>
> Enabled "No Command Completed Support" in switch firmware init, now Timeouts are not seen now.
>
> I had question about "DPC",  DPC driver probe is not invoked though down stream port advertises dpc extended capability.
>
> Does kernel expects uefi/bios to pass some _OSC flag for kernel to invoke dpc driver probe?
>
> On Tue, 1 Oct 2024, 23:49 Keith Busch, <kbusch@kernel.org> wrote:
>>
>> On Tue, Oct 01, 2024 at 11:39:33PM +0530, Maverickk 78 wrote:
>> > I was able to trigger an interrupt, the pciehp_isr was triggered and
>> > there are "Timeouts" while processing the hotplug,
>> > I suspect this is due to the slowness of the simulation platform, is
>> > my assumption correct?
>>
>> That usually means the slot does not generate software notification, but
>> for whatever reason decided not set the "No Command Completed Support"
>> in the slot capability structure.
>>
>> > [26599.580420] pcieport 0000:02:01.0: pciehp: pending interrupts 0x0001 from Slot Status
>> > [26599.580575] pcieport 0000:02:01.0: pciehp: Slot(0): Button press: will power on in 5 sec
>> > [26599.593768] pcieport 0000:02:01.0: pciehp: Timeout on hotplug command 0x17e1 (issued 42213 msec ago)
>> > [26599.598920] pcieport 0000:02:01.0: pciehp: pciehp_set_indicators: SLOTCTRL 80 write cmd 2c0
>> > [26605.104802] pcieport 0000:02:01.0: pciehp: pciehp_check_link_active: lnk_status = 2025
>> > [26605.104840] pcieport 0000:02:01.0: pciehp: Slot(0): Link Up
>> > [26605.109616] pcieport 0000:02:01.0: pciehp: pciehp_get_power_status: SLOTCTRL 80 value read 16e1
>> > [26605.126589] pcieport 0000:02:01.0: pciehp: Timeout on hotplug command 0x16e1 (issued 5528 msec ago)
>> > [26606.458516] pcieport 0000:02:01.0: pciehp: Timeout on hotplug command 0x12e1 (issued 1327 msec ago)
>> > [26606.458554] pcieport 0000:02:01.0: pciehp: pciehp_power_on_slot: SLOTCTRL 80 write cmd 0
>> > [26606.475509] pcieport 0000:02:01.0: pciehp: Timeout on hotplug command 0x12e1 (issued 1344 msec ago)
>> > [26606.481024] pcieport 0000:02:01.0: pciehp: pciehp_set_indicators: SLOTCTRL 80 write cmd 200
>> > [26606.618088] pcieport 0000:02:01.0: pciehp: pciehp_check_link_status: lnk_status = 2025
>> > [26606.674790] pci 0000:03:00.0: [abcd:0000] type 00 class 0x000000 PCIe Endpoint
>> > [26606.725288] pci 0000:03:00.0: BAR 0 [mem 0xf8000000-0xf9ffffff]
>> > [26607.867503] pci 0000:03:00.0: 63.014 Gb/s available PCIe bandwidth, limited by 32.0 GT/s PCIe x2 link at 0000:02:01.0 (capable of 1024.000 Gb/s with 64.0 GT/s PCIe x16 link)
>> > [26608.386085] pci 0000:03:00.0: vgaarb: pci_notify
>> > [26608.491596] pcieport 0000:02:01.0: distributing available resources
>> > [26608.491637] pcieport 0000:02:01.0: PCI bridge to [bus 03]
>> > [26608.495947] pcieport 0000:02:01.0:   bridge window [io  0x1000-0x1fff]
>> > [26608.513041] pcieport 0000:02:01.0:   bridge window [mem 0xf8000000-0xf9ffffff]
>> > [26608.521771] pcieport 0000:02:01.0:   bridge window [mem 0xfe200000-0xfe3fffff 64bit pref]
>> > [26608.647492] pcieport 0000:02:01.0: pciehp: Timeout on hotplug command 0x12e1 (issued 2167 msec ago)
>> > [26608.652270] pcieport 0000:02:01.0: pciehp: pciehp_set_indicators: SLOTCTRL 80 write cmd 1c0

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: pcie hotplug driver probe is not getting called
  2024-10-04 18:20               ` Maverickk 78
@ 2024-10-04 21:56                 ` Bjorn Helgaas
       [not found]                   ` <CALfBBTtjXJiZBSfFTUAPsD+G15nPQQsn-2sCrAt1UwPsrNsqNg@mail.gmail.com>
  0 siblings, 1 reply; 11+ messages in thread
From: Bjorn Helgaas @ 2024-10-04 21:56 UTC (permalink / raw)
  To: Maverickk 78; +Cc: Keith Busch, linux-pci

On Fri, Oct 04, 2024 at 11:50:28PM +0530, Maverickk 78 wrote:
> The platform I am working on is rtl simulation of pcie switch(Gen6)
> with a backdoor mechanism to trigger the HotPlug event.
> 
> Tried following patches independently to have both hotplug and dpc
> driver register and handle respective events.
> 
> https://patchwork.ozlabs.org/project/linux-pci/patch/20231223212235.34293-2-mattc@purestorage.com/
> https://patchwork.kernel.org/project/linux-pci/patch/20240108194642.30460-1-mattc@purestorage.com/#25680870
> 
> Tried following
> 
> - Trigger hot removal and add, the event is triggered and respective
> msi in /proc/interrupt increments and kernel logs the event(dmesg)
> - Trigger hot removal and add, the event is triggered and respective
> msi in /proc/interrupt increments and kernel logs the event(dmesg)
> - Trigger DPC using "DPC software trigger" in DPC control register
> 
> The kernel hangs, the console is non-responsive.
> 
> Can dpc and pciehp co-exist and handle the events?

Yes, they're intended to coexist.  Your platform firmware doesn't
advertise support for it, though:

[    1.736168] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR DPC]

I don't think there's a kernel parameter to force DPC usage if the
platform doesn't advertise it.  There should be a message like "DPC:
enabled with IRQ X" if the dpc driver is active.

Even if the dpc driver isn't active, I don't think the kernel should
hang if you trigger DPC.  Since this is a QEMU guest, you should be
able to use a debugger to figure out why it's hung.

Bjorn

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: pcie hotplug driver probe is not getting called
       [not found]                   ` <CALfBBTtjXJiZBSfFTUAPsD+G15nPQQsn-2sCrAt1UwPsrNsqNg@mail.gmail.com>
@ 2024-10-15  8:44                     ` Maverickk 78
  0 siblings, 0 replies; 11+ messages in thread
From: Maverickk 78 @ 2024-10-15  8:44 UTC (permalink / raw)
  To: Bjorn Helgaas; +Cc: Keith Busch, linux-pci, Matthew W Carlis

Hello,

The freeze was a platform issue, it's fixed and things are working as expected.

Using this patch from "Matthew W Carlis <mattc@purestorage.com>", will
this patch be merged in future ?

https://patchwork.ozlabs.org/project/linux-pci/patch/20231223212235.34293-2-mattc@purestorage.com/

diff --git a/drivers/pci/pcie/portdrv.c b/drivers/pci/pcie/portdrv.c
index 14a4b89a3b83..8e023aa97672 100644
--- a/drivers/pci/pcie/portdrv.c
+++ b/drivers/pci/pcie/portdrv.c
@@ -257,12 +257,19 @@  static int get_port_device_capability(struct
pci_dev *dev)
  }

  /*
+ * _OSC AER Control is required by the OS & requires OS to control AER,
+ * but _OSC DPC Control isn't required by the OS to control DPC; however
+ * it does require the OS to control DPC. _OSC DPC Control also requres
+ * _OSC EDR Control (Error Disconnect Recovery) (PCI Firmware - DPC ECN rev3.2)
+ * PCI_Express_Base 6.1, 6.2.11 Determination of DPC Control recommends
+ * platform fw or OS always link control of DPC to AER.
+ *
  * With dpc-native, allow Linux to use DPC even if it doesn't have
  * permission to use AER.
  */
  if (pci_find_ext_capability(dev, PCI_EXT_CAP_ID_DPC) &&
-    pci_aer_available() &&
-    (pcie_ports_dpc_native || (services & PCIE_PORT_SERVICE_AER)))
+    pci_aer_available() && (pcie_ports_dpc_native ||
+    (dev->aer_cap && host->native_aer)))
  services |= PCIE_PORT_SERVICE_DPC;

  if (pci_pcie_type(dev) == PCI_EXP_TYPE_DOWNSTREAM ||

On Mon, 7 Oct 2024 at 22:15, Maverickk 78 <maverickk1778@gmail.com> wrote:
>
> Very helpful!
>
> Yes, bios doesn't support hotplug or dpc.
>
> I used the patches listed in previous mail to enable both dpc & pciehp with command line Param "pcie_port=native"
>
> Hotplug works fine, but dpc trigger after hotplug causes complete freeze, I suspect platform issue, may be issue with backdoor mechanism of hotplug is causing it, will inspect and come back.
>
>
> On Sat, 5 Oct 2024, 03:27 Bjorn Helgaas, <helgaas@kernel.org> wrote:
>>
>> On Fri, Oct 04, 2024 at 11:50:28PM +0530, Maverickk 78 wrote:
>> > The platform I am working on is rtl simulation of pcie switch(Gen6)
>> > with a backdoor mechanism to trigger the HotPlug event.
>> >
>> > Tried following patches independently to have both hotplug and dpc
>> > driver register and handle respective events.
>> >
>> > https://patchwork.ozlabs.org/project/linux-pci/patch/20231223212235.34293-2-mattc@purestorage.com/
>> > https://patchwork.kernel.org/project/linux-pci/patch/20240108194642.30460-1-mattc@purestorage.com/#25680870
>> >
>> > Tried following
>> >
>> > - Trigger hot removal and add, the event is triggered and respective
>> > msi in /proc/interrupt increments and kernel logs the event(dmesg)
>> > - Trigger hot removal and add, the event is triggered and respective
>> > msi in /proc/interrupt increments and kernel logs the event(dmesg)
>> > - Trigger DPC using "DPC software trigger" in DPC control register
>> >
>> > The kernel hangs, the console is non-responsive.
>> >
>> > Can dpc and pciehp co-exist and handle the events?
>>
>> Yes, they're intended to coexist.  Your platform firmware doesn't
>> advertise support for it, though:
>>
>> [    1.736168] acpi PNP0A08:00: _OSC: platform does not support [PCIeHotplug LTR DPC]
>>
>> I don't think there's a kernel parameter to force DPC usage if the
>> platform doesn't advertise it.  There should be a message like "DPC:
>> enabled with IRQ X" if the dpc driver is active.
>>
>> Even if the dpc driver isn't active, I don't think the kernel should
>> hang if you trigger DPC.  Since this is a QEMU guest, you should be
>> able to use a debugger to figure out why it's hung.
>>
>> Bjorn

^ permalink raw reply related	[flat|nested] 11+ messages in thread

end of thread, other threads:[~2024-10-15  8:44 UTC | newest]

Thread overview: 11+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2024-09-27 15:20 pcie hotplug driver probe is not getting called Maverickk 78
2024-09-27 17:17 ` Bjorn Helgaas
2024-09-29 13:59   ` Maverickk 78
2024-09-30 12:49     ` Maverickk 78
2024-09-30 19:28     ` Bjorn Helgaas
2024-10-01 12:48       ` Maverickk 78
2024-10-01 18:09         ` Maverickk 78
2024-10-01 18:19           ` Keith Busch
     [not found]             ` <CALfBBTtxJB1BQkSZ=RBKCiZKNeTxsJHAZ50jdBUjNSmOf79NWw@mail.gmail.com>
2024-10-04 18:20               ` Maverickk 78
2024-10-04 21:56                 ` Bjorn Helgaas
     [not found]                   ` <CALfBBTtjXJiZBSfFTUAPsD+G15nPQQsn-2sCrAt1UwPsrNsqNg@mail.gmail.com>
2024-10-15  8:44                     ` Maverickk 78

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).