* uefi secureboot vm and IO window overlap
@ 2022-12-09 18:44 Kallol Biswas [C]
2022-12-09 20:04 ` Kallol Biswas [C]
2022-12-09 20:56 ` Bjorn Helgaas
0 siblings, 2 replies; 10+ messages in thread
From: Kallol Biswas [C] @ 2022-12-09 18:44 UTC (permalink / raw)
To: linux-pci@vger.kernel.org
We are observing an io window overlap issue in a secureboot enabled uefi vm.
Linux displays:
pci 0000:00:1d.0: can't claim BAR 4 [io 0x92a0-0x92bf]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
Eventually conflict gets resolved but we need to understand why get the conflict in the first place.
Details:
The VM is a uefi based VM and the issue shows up if secure boot is enabled. We have enabled ovmf log and uefi/ovmf programs a bridge IO window with the range 0x9000-0x91ff, but in Linux we see the same bridge is programmed with 0x9000-0x9fff. This results in an address conflict with subsequent devices.
The PCI tree(lspci -t):
-[0000:00]-+-00.0
+-01.0
+-02.0-[01]----00.0
+-02.1-[02]----00.0
+-02.2-[03]----00.0
+-02.3-[04]--
+-1d.0
+-1d.1
+-1d.2
+-1d.7
+-1f.0
+-1f.2
\-1f.3
[root@localhost ~]# lspci -vvv -s 0:02.0 | grep "I/O"
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
I/O behind bridge: 00009000-00009fff [size=4K]
lspci -vvv -s 0:1d.0 | grep "I/O"
Region 4: I/O ports at 1040 [size=32]
root@localhost ~]# lspci -vvv -s 01:00.0
01:00.0 Ethernet controller: Red Hat, Inc. Virtio network device (rev 01)
Subsystem: Red Hat, Inc. Device 1100
Physical Slot: 0
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin A routed to IRQ 22
Region 1: Memory at c1600000 (32-bit, non-prefetchable) [size=4K]
Region 4: Memory at 84000000000 (64-bit, prefetchable) [size=16K]
Expansion ROM at c1640000 [disabled] [size=256K]
Capabilities: [dc] MSI-X: Enable+ Count=3 Masked-
The uefi/ovmf log:
PciBus: HostBridge->NotifyPhase(AllocateResources) - Success
Process Option ROM: BAR Base/Length = C1800000/40000
PciBus: Resource Map for Root Bridge PciRoot(0x0)
Type = Io16; Base = 0x6000; Length = 0x4000; Alignment = 0xFFF
Base = 0x6000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|03:**]
Base = 0x7000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|02:**]
Base = 0x8000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|01:**]
Base = 0x9000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|00:**]
Base = 0x9200; Length = 0x40; Alignment = 0x3F; Owner = PCI [00|1F|03:20]
Base = 0x9240; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1F|02:20]
Base = 0x9260; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|02:20]
Base = 0x9280; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|01:20]
Base = 0x92A0; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|00:20]
Type = Mem32; Base = 0xC0000000; Length = 0x1900000; Alignment = 0xFFFFFF
Base = 0xC0000000; Length = 0x1000000; Alignment = 0xFFFFFF; Owner = PCI [00|01|00:10]; Type = PMem32
Base = 0xC1000000; Length = 0x200000; Alignment = 0x1FFFFF; Owner = PPB [00|02|03:**]
Base = 0xC1200000; Length = 0x200000; Alignment = 0x1FFFFF; Owner = PPB [00|02|02:**]
Base = 0xC1400000; Length = 0x200000; Alignment = 0x1FFFFF; Owner = PPB [00|02|01:**]
Base = 0xC1600000; Length = 0x200000; Alignment = 0x1FFFFF; Owner = PPB [00|02|00:**]
Base = 0xC1800000; Length = 0x40000; Alignment = 0x3FFFF; Owner = PCI [00|00|00:00]; Type = OpRom
Base = 0xC1840000; Length = 0x1000; Alignment = 0xFFF; Owner = PCI [00|1F|02:24]
Base = 0xC1841000; Length = 0x1000; Alignment = 0xFFF; Owner = PCI [00|1D|07:10]
Base = 0xC1842000; Length = 0x1000; Alignment = 0xFFF; Owner = PPB [00|02|03:10]
Base = 0xC1843000; Length = 0x1000; Alignment = 0xFFF; Owner = PPB [00|02|02:10]
Base = 0xC1844000; Length = 0x1000; Alignment = 0xFFF; Owner = PPB [00|02|01:10]
Base = 0xC1845000; Length = 0x1000; Alignment = 0xFFF; Owner = PPB [00|02|00:10]
Base = 0xC1846000; Length = 0x1000; Alignment = 0xFFF; Owner = PCI [00|01|00:18]
Type = Mem64; Base = 0x84000000000; Length = 0x300000; Alignment = 0xFFFFF
Base = 0x84000000000; Length = 0x100000; Alignment = 0xFFFFF; Owner = PPB [00|02|00:**]; Type = PMem64
Base = 0x84000100000; Length = 0x100000; Alignment = 0xFFFFF; Owner = PPB [00|02|01:**]; Type = PMem64
Base = 0x84000200000; Length = 0x100000; Alignment = 0xFFFFF; Owner = PPB [00|02|02:**]; Type = PMem64
PciBus: Resource Map for Bridge [00|02|00]
Type = Io16; Base = 0x9000; Length = 0x200; Alignment = 0xFFF
Base = Padding; Length = 0x200; Alignment = 0x1FF
Type = Mem32; Base = 0xC1600000; Length = 0x200000; Alignment = 0x1FFFFF
Base = Padding; Length = 0x200000; Alignment = 0x1FFFFF
Base = 0xC1600000; Length = 0x1000; Alignment = 0xFFF; Owner = PCI [01|00|00:14]
Type = Mem32; Base = 0xC1845000; Length = 0x1000; Alignment = 0xFFF
Type = PMem64; Base = 0x84000000000; Length = 0x100000; Alignment = 0xFFFFF
Base = 0x84000000000; Length = 0x4000; Alignment = 0x3FFF; Owner = PCI [01|00|00:20]
PciBus: Resource Map for Bridge [00|02|01]
Type = Io16; Base = 0x8000; Length = 0x200; Alignment = 0xFFF
Base = Padding; Length = 0x200; Alignment = 0x1FF
Type = Mem32; Base = 0xC1400000; Length = 0x200000; Alignment = 0x1FFFFF
Base = Padding; Length = 0x200000; Alignment = 0x1FFFFF
Base = 0xC1400000; Length = 0x1000; Alignment = 0xFFF; Owner = PCI [02|00|00:14]
Type = Mem32; Base = 0xC1844000; Length = 0x1000; Alignment = 0xFFF
Type = PMem64; Base = 0x84000100000; Length = 0x100000; Alignment = 0xFFFFF
Base = 0x84000100000; Length = 0x4000; Alignment = 0x3FFF; Owner = PCI [02|00|00:20]
PciBus: Resource Map for Bridge [00|02|02]
Type = Io16; Base = 0x7000; Length = 0x200; Alignment = 0xFFF
Base = Padding; Length = 0x200; Alignment = 0x1FF
Type = Mem32; Base = 0xC1200000; Length = 0x200000; Alignment = 0x1FFFFF
Base = Padding; Length = 0x200000; Alignment = 0x1FFFFF
Type = Mem32; Base = 0xC1843000; Length = 0x1000; Alignment = 0xFFF
Type = PMem64; Base = 0x84000200000; Length = 0x100000; Alignment = 0xFFFFF
Base = 0x84000200000; Length = 0x4000; Alignment = 0x3FFF; Owner = PCI [03|00|00:20]
PciBus: Resource Map for Bridge [00|02|03]
Type = Io16; Base = 0x6000; Length = 0x200; Alignment = 0xFFF
Base = Padding; Length = 0x200; Alignment = 0x1FF
Type = Mem32; Base = 0xC1000000; Length = 0x200000; Alignment = 0x1FFFFF
Base = Padding; Length = 0x200000; Alignment = 0x1FFFFF
Type = Mem32; Base = 0xC1842000; Length = 0x1000; Alignment = 0x
The bus 1 is off 02:00.0 bridge device.
IO resource for the bridge:
Base = 0x9000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|00:**]
The alignment is 0xfff, start 0x9000, and length 0x200. So 0x9000-0x91ff would be sufficient for this, there would be no conflict. Linux appears to assign 0x9000-0x9fff to the bridge, resulting in conflicts with subsequent devices.
[root@localhost ~]# dmesg | grep conflict
[ 0.426170] pci 0000:00:1d.0: can't claim BAR 4 [io 0x92a0-0x92bf]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
[ 0.426217] pci 0000:00:1d.1: can't claim BAR 4 [io 0x9280-0x929f]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
[ 0.426228] pci 0000:00:1d.2: can't claim BAR 4 [io 0x9260-0x927f]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
[ 0.426258] pci 0000:00:1f.2: can't claim BAR 4 [io 0x9240-0x925f]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
[ 0.426270] pci 0000:00:1f.3: can't claim BAR 4 [io 0x9200-0x923f]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
Dmesg output with debug=1 "dyndbg=file *pci* +pfm"
[ 0.280118] probe:pci_scan_child_bus_extend: pci_bus 0000:01: fixups for bus
[ 0.280122] pci 0000:00:02.0: PCI bridge to [bus 01]
[ 0.280141] pci 0000:00:02.0: bridge window [io 0x9000-0x9fff]
[ 0.280158] pci 0000:00:02.0: bridge window [mem 0xc1600000-0xc17fffff]
[ 0.280191] pci 0000:00:02.0: bridge window [mem 0x8000000000-0x80000fffff 64bit pref]
[ 0.280194] probe:pci_scan_child_bus_extend: pci_bus 0000:01: bus scan returning with max=01
Nucleodyne @ Nutanix
408-718-8164
^ permalink raw reply [flat|nested] 10+ messages in thread
* RE: uefi secureboot vm and IO window overlap
2022-12-09 18:44 uefi secureboot vm and IO window overlap Kallol Biswas [C]
@ 2022-12-09 20:04 ` Kallol Biswas [C]
2022-12-09 20:56 ` Bjorn Helgaas
1 sibling, 0 replies; 10+ messages in thread
From: Kallol Biswas [C] @ 2022-12-09 20:04 UTC (permalink / raw)
To: Kallol Biswas [C], linux-pci@vger.kernel.org
Reproduced the issue with Q35 machine type and turning off secureboot.
Debugging will be easier now.
-----Original Message-----
From: Kallol Biswas [C] <kallol.biswas@nutanix.com>
Sent: Friday, December 9, 2022 10:45 AM
To: linux-pci@vger.kernel.org
Subject: uefi secureboot vm and IO window overlap
We are observing an io window overlap issue in a secureboot enabled uefi vm.
Linux displays:
pci 0000:00:1d.0: can't claim BAR 4 [io 0x92a0-0x92bf]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
Eventually conflict gets resolved but we need to understand why get the conflict in the first place.
Details:
The VM is a uefi based VM and the issue shows up if secure boot is enabled. We have enabled ovmf log and uefi/ovmf programs a bridge IO window with the range 0x9000-0x91ff, but in Linux we see the same bridge is programmed with 0x9000-0x9fff. This results in an address conflict with subsequent devices.
The PCI tree(lspci -t):
-[0000:00]-+-00.0
+-01.0
+-02.0-[01]----00.0
+-02.1-[02]----00.0
+-02.2-[03]----00.0
+-02.3-[04]--
+-1d.0
+-1d.1
+-1d.2
+-1d.7
+-1f.0
+-1f.2
\-1f.3
[root@localhost ~]# lspci -vvv -s 0:02.0 | grep "I/O"
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
I/O behind bridge: 00009000-00009fff [size=4K]
lspci -vvv -s 0:1d.0 | grep "I/O"
Region 4: I/O ports at 1040 [size=32]
root@localhost ~]# lspci -vvv -s 01:00.0
01:00.0 Ethernet controller: Red Hat, Inc. Virtio network device (rev 01)
Subsystem: Red Hat, Inc. Device 1100
Physical Slot: 0
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin A routed to IRQ 22
Region 1: Memory at c1600000 (32-bit, non-prefetchable) [size=4K]
Region 4: Memory at 84000000000 (64-bit, prefetchable) [size=16K]
Expansion ROM at c1640000 [disabled] [size=256K]
Capabilities: [dc] MSI-X: Enable+ Count=3 Masked-
The uefi/ovmf log:
PciBus: HostBridge->NotifyPhase(AllocateResources) - Success Process Option ROM: BAR Base/Length = C1800000/40000
PciBus: Resource Map for Root Bridge PciRoot(0x0) Type = Io16; Base = 0x6000; Length = 0x4000; Alignment = 0xFFF
Base = 0x6000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|03:**]
Base = 0x7000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|02:**]
Base = 0x8000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|01:**]
Base = 0x9000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|00:**]
Base = 0x9200; Length = 0x40; Alignment = 0x3F; Owner = PCI [00|1F|03:20]
Base = 0x9240; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1F|02:20]
Base = 0x9260; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|02:20]
Base = 0x9280; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|01:20]
Base = 0x92A0; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|00:20] Type = Mem32; Base = 0xC0000000; Length = 0x1900000; Alignment = 0xFFFFFF
Base = 0xC0000000; Length = 0x1000000; Alignment = 0xFFFFFF; Owner = PCI [00|01|00:10]; Type = PMem32
Base = 0xC1000000; Length = 0x200000; Alignment = 0x1FFFFF; Owner = PPB [00|02|03:**]
Base = 0xC1200000; Length = 0x200000; Alignment = 0x1FFFFF; Owner = PPB [00|02|02:**]
Base = 0xC1400000; Length = 0x200000; Alignment = 0x1FFFFF; Owner = PPB [00|02|01:**]
Base = 0xC1600000; Length = 0x200000; Alignment = 0x1FFFFF; Owner = PPB [00|02|00:**]
Base = 0xC1800000; Length = 0x40000; Alignment = 0x3FFFF; Owner = PCI [00|00|00:00]; Type = OpRom
Base = 0xC1840000; Length = 0x1000; Alignment = 0xFFF; Owner = PCI [00|1F|02:24]
Base = 0xC1841000; Length = 0x1000; Alignment = 0xFFF; Owner = PCI [00|1D|07:10]
Base = 0xC1842000; Length = 0x1000; Alignment = 0xFFF; Owner = PPB [00|02|03:10]
Base = 0xC1843000; Length = 0x1000; Alignment = 0xFFF; Owner = PPB [00|02|02:10]
Base = 0xC1844000; Length = 0x1000; Alignment = 0xFFF; Owner = PPB [00|02|01:10]
Base = 0xC1845000; Length = 0x1000; Alignment = 0xFFF; Owner = PPB [00|02|00:10]
Base = 0xC1846000; Length = 0x1000; Alignment = 0xFFF; Owner = PCI [00|01|00:18] Type = Mem64; Base = 0x84000000000; Length = 0x300000; Alignment = 0xFFFFF
Base = 0x84000000000; Length = 0x100000; Alignment = 0xFFFFF; Owner = PPB [00|02|00:**]; Type = PMem64
Base = 0x84000100000; Length = 0x100000; Alignment = 0xFFFFF; Owner = PPB [00|02|01:**]; Type = PMem64
Base = 0x84000200000; Length = 0x100000; Alignment = 0xFFFFF; Owner = PPB [00|02|02:**]; Type = PMem64
PciBus: Resource Map for Bridge [00|02|00] Type = Io16; Base = 0x9000; Length = 0x200; Alignment = 0xFFF
Base = Padding; Length = 0x200; Alignment = 0x1FF Type = Mem32; Base = 0xC1600000; Length = 0x200000; Alignment = 0x1FFFFF
Base = Padding; Length = 0x200000; Alignment = 0x1FFFFF
Base = 0xC1600000; Length = 0x1000; Alignment = 0xFFF; Owner = PCI [01|00|00:14] Type = Mem32; Base = 0xC1845000; Length = 0x1000; Alignment = 0xFFF Type = PMem64; Base = 0x84000000000; Length = 0x100000; Alignment = 0xFFFFF
Base = 0x84000000000; Length = 0x4000; Alignment = 0x3FFF; Owner = PCI [01|00|00:20]
PciBus: Resource Map for Bridge [00|02|01] Type = Io16; Base = 0x8000; Length = 0x200; Alignment = 0xFFF
Base = Padding; Length = 0x200; Alignment = 0x1FF Type = Mem32; Base = 0xC1400000; Length = 0x200000; Alignment = 0x1FFFFF
Base = Padding; Length = 0x200000; Alignment = 0x1FFFFF
Base = 0xC1400000; Length = 0x1000; Alignment = 0xFFF; Owner = PCI [02|00|00:14] Type = Mem32; Base = 0xC1844000; Length = 0x1000; Alignment = 0xFFF Type = PMem64; Base = 0x84000100000; Length = 0x100000; Alignment = 0xFFFFF
Base = 0x84000100000; Length = 0x4000; Alignment = 0x3FFF; Owner = PCI [02|00|00:20]
PciBus: Resource Map for Bridge [00|02|02] Type = Io16; Base = 0x7000; Length = 0x200; Alignment = 0xFFF
Base = Padding; Length = 0x200; Alignment = 0x1FF Type = Mem32; Base = 0xC1200000; Length = 0x200000; Alignment = 0x1FFFFF
Base = Padding; Length = 0x200000; Alignment = 0x1FFFFF Type = Mem32; Base = 0xC1843000; Length = 0x1000; Alignment = 0xFFF Type = PMem64; Base = 0x84000200000; Length = 0x100000; Alignment = 0xFFFFF
Base = 0x84000200000; Length = 0x4000; Alignment = 0x3FFF; Owner = PCI [03|00|00:20]
PciBus: Resource Map for Bridge [00|02|03] Type = Io16; Base = 0x6000; Length = 0x200; Alignment = 0xFFF
Base = Padding; Length = 0x200; Alignment = 0x1FF Type = Mem32; Base = 0xC1000000; Length = 0x200000; Alignment = 0x1FFFFF
Base = Padding; Length = 0x200000; Alignment = 0x1FFFFF Type = Mem32; Base = 0xC1842000; Length = 0x1000; Alignment = 0x
The bus 1 is off 02:00.0 bridge device.
IO resource for the bridge:
Base = 0x9000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|00:**] The alignment is 0xfff, start 0x9000, and length 0x200. So 0x9000-0x91ff would be sufficient for this, there would be no conflict. Linux appears to assign 0x9000-0x9fff to the bridge, resulting in conflicts with subsequent devices.
[root@localhost ~]# dmesg | grep conflict [ 0.426170] pci 0000:00:1d.0: can't claim BAR 4 [io 0x92a0-0x92bf]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff] [ 0.426217] pci 0000:00:1d.1: can't claim BAR 4 [io 0x9280-0x929f]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff] [ 0.426228] pci 0000:00:1d.2: can't claim BAR 4 [io 0x9260-0x927f]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff] [ 0.426258] pci 0000:00:1f.2: can't claim BAR 4 [io 0x9240-0x925f]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff] [ 0.426270] pci 0000:00:1f.3: can't claim BAR 4 [io 0x9200-0x923f]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
Dmesg output with debug=1 "dyndbg=file *pci* +pfm"
[ 0.280118] probe:pci_scan_child_bus_extend: pci_bus 0000:01: fixups for bus [ 0.280122] pci 0000:00:02.0: PCI bridge to [bus 01] [ 0.280141] pci 0000:00:02.0: bridge window [io 0x9000-0x9fff] [ 0.280158] pci 0000:00:02.0: bridge window [mem 0xc1600000-0xc17fffff] [ 0.280191] pci 0000:00:02.0: bridge window [mem 0x8000000000-0x80000fffff 64bit pref] [ 0.280194] probe:pci_scan_child_bus_extend: pci_bus 0000:01: bus scan returning with max=01
Nucleodyne @ Nutanix
408-718-8164
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: uefi secureboot vm and IO window overlap
2022-12-09 18:44 uefi secureboot vm and IO window overlap Kallol Biswas [C]
2022-12-09 20:04 ` Kallol Biswas [C]
@ 2022-12-09 20:56 ` Bjorn Helgaas
2022-12-10 17:45 ` Kallol Biswas [C]
2022-12-10 17:46 ` Kallol Biswas [C]
1 sibling, 2 replies; 10+ messages in thread
From: Bjorn Helgaas @ 2022-12-09 20:56 UTC (permalink / raw)
To: Kallol Biswas [C]; +Cc: linux-pci@vger.kernel.org
Hi Kallol,
On Fri, Dec 09, 2022 at 06:44:42PM +0000, Kallol Biswas [C] wrote:
> We are observing an io window overlap issue in a secureboot enabled uefi vm.
>
> Linux displays:
> pci 0000:00:1d.0: can't claim BAR 4 [io 0x92a0-0x92bf]: address conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
>
> Eventually conflict gets resolved but we need to understand why get the conflict in the first place.
>
> Details:
>
> The VM is a uefi based VM and the issue shows up if secure boot is
> enabled. We have enabled ovmf log and uefi/ovmf programs a bridge
> IO window with the range 0x9000-0x91ff, but in Linux we see the same
> bridge is programmed with 0x9000-0x9fff. This results in an address
> conflict with subsequent devices.
Linux normally doesn't reassign bridge windows if the existing
configuration (typically from firmware) works.
Booting with "pci=earlydump" should dump the config before Linux
touches anything.
I see your response about being able to reproduce it where it's easier
to debug. If you need more help, please include the complete dmesg
log so we can see what's happening.
Bjorn
^ permalink raw reply [flat|nested] 10+ messages in thread
* RE: uefi secureboot vm and IO window overlap
2022-12-09 20:56 ` Bjorn Helgaas
@ 2022-12-10 17:45 ` Kallol Biswas [C]
2022-12-13 21:30 ` Bjorn Helgaas
2022-12-10 17:46 ` Kallol Biswas [C]
1 sibling, 1 reply; 10+ messages in thread
From: Kallol Biswas [C] @ 2022-12-10 17:45 UTC (permalink / raw)
To: Bjorn Helgaas; +Cc: linux-pci@vger.kernel.org
The part1 of the dmesg:
[ 0.000000] Initializing cgroup subsys cpuset
[ 0.000000] Initializing cgroup subsys cpu
[ 0.000000] Initializing cgroup subsys cpuacct
[ 0.000000] Linux version 3.10.0-957.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Thu Nov 8 23:39:32 UTC 2018
[ 0.000000] Command line: BOOT_IMAGE=/vmlinuz-3.10.0-957.el7.x86_64 root=/dev/mapper/centos-root ro crashkernel=auto rd.lvm.lv=centos/root rd.lvm.lv=centos/swap pci=earlydump
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000007a051fff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007a052000-0x000000007a060fff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000007a061000-0x000000007b0eefff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007b0ef000-0x000000007b36efff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000007b36f000-0x000000007b37efff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000007b37f000-0x000000007b3fefff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000007b3ff000-0x000000007ff7bfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007ff7c000-0x000000007fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000b0000000-0x00000000bfffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000037fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] pci 0000:00:00.0 config space:
00: 86 80 c0 29 07 00 00 00 00 00 00 06 00 00 00 00
10: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20: 00 00 00 00 00 00 00 00 00 00 00 00 f4 1a 00 11
30: 00 00 00 00 00 00 00 00 00 00 00 00 ff 00 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 10 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 01 00 00 b0 00 00 00 00 00 00 00 00 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 00 01 00 00 00 00 00 00 00 00 00 00 00 02 38 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:01.0 config space:
00: 34 12 11 11 07 00 00 00 02 00 00 03 00 00 00 00
10: 08 00 00 c0 00 00 00 00 00 60 64 c1 00 00 00 00
20: 00 00 00 00 00 00 00 00 00 00 00 00 f4 1a 00 11
30: 00 00 ff ff 00 00 00 00 00 00 00 00 ff 00 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:02.0 config space:
00: 36 1b 0c 00 07 00 10 00 00 00 04 06 00 00 81 00
10: 00 50 64 c1 00 00 00 00 00 01 01 00 80 80 00 00
20: 40 c1 50 c1 01 00 01 00 40 08 00 00 40 08 00 00
30: 00 00 00 00 54 00 00 00 00 00 00 00 0b 01 00 00
40: 0d 00 00 00 36 1b 00 00 11 40 00 00 00 00 00 00
50: 00 08 00 00 10 48 42 01 00 80 00 00 00 00 00 00
60: 04 06 30 10 00 00 11 20 7b 00 02 00 c0 01 40 00
70: 00 00 00 00 00 00 00 00 20 00 30 00 00 00 00 00
80: 1e 00 00 00 04 00 00 00 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:02.1 config space:
00: 36 1b 0c 00 07 00 10 00 00 00 04 06 00 00 01 00
10: 00 40 64 c1 00 00 00 00 00 02 02 00 70 70 00 00
20: 20 c1 30 c1 11 00 11 00 40 08 00 00 40 08 00 00
30: 00 00 00 00 54 00 00 00 00 00 00 00 0b 01 00 00
40: 0d 00 00 00 36 1b 00 00 11 40 00 00 00 00 00 00
50: 00 08 00 00 10 48 42 01 00 80 00 00 00 00 00 00
60: 04 06 30 11 00 00 11 20 7b 00 02 00 c0 01 40 00
70: 00 00 00 00 00 00 00 00 20 00 30 00 00 00 00 00
80: 1e 00 00 00 04 00 00 00 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:02.2 config space:
00: 36 1b 0c 00 07 00 10 00 00 00 04 06 00 00 01 00
10: 00 30 64 c1 00 00 00 00 00 03 03 00 60 60 00 00
20: 00 c1 10 c1 f1 ff 01 00 ff ff ff ff 00 00 00 00
30: 00 00 00 00 54 00 00 00 00 00 00 00 0b 01 00 00
40: 0d 00 00 00 36 1b 00 00 11 40 00 00 00 00 00 00
50: 00 08 00 00 10 48 42 01 00 80 00 00 00 00 00 00
60: 04 06 30 12 00 00 04 22 7b 00 02 00 c0 07 00 00
70: 00 00 00 00 00 00 00 00 20 00 30 00 00 00 00 00
80: 1e 00 00 00 04 00 00 00 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:03.0 config space:
00: f4 1a 00 10 07 00 10 00 00 00 00 02 00 00 00 00
10: c1 82 00 00 00 20 64 c1 00 00 00 00 00 00 00 00
20: 0c 00 20 00 40 08 00 00 00 00 00 00 f4 1a 01 00
30: 00 00 fc ff 98 00 00 00 00 00 00 00 0b 01 00 00
40: 09 00 10 01 04 00 00 00 00 00 00 00 00 10 00 00
50: 09 40 10 03 04 00 00 00 00 10 00 00 00 10 00 00
60: 09 50 10 04 04 00 00 00 00 20 00 00 00 10 00 00
70: 09 60 14 02 04 00 00 00 00 30 00 00 00 10 00 00
80: 04 00 00 00 09 70 14 05 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 11 84 02 00 01 00 00 00
a0: 01 08 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:1d.0 config space:
00: 86 80 34 29 07 00 00 00 03 00 03 0c 00 00 80 00
10: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20: a1 82 00 00 00 00 00 00 00 00 00 00 f4 1a 00 11
30: 00 00 00 00 00 00 00 00 00 00 00 00 0a 01 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 10 00 00 00 00 00 00 00 00 00 01 00 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 8f 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:1d.1 config space:
00: 86 80 35 29 07 00 00 00 03 00 03 0c 00 00 00 00
10: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20: 81 82 00 00 00 00 00 00 00 00 00 00 f4 1a 00 11
30: 00 00 00 00 00 00 00 00 00 00 00 00 0a 02 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 10 00 00 00 00 00 00 00 00 00 01 00 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 8f 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:1d.2 config space:
00: 86 80 36 29 07 00 00 00 03 00 03 0c 00 00 00 00
10: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20: 61 82 00 00 00 00 00 00 00 00 00 00 f4 1a 00 11
30: 00 00 00 00 00 00 00 00 00 00 00 00 0b 03 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 10 00 00 00 00 00 00 00 00 00 01 00 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 8f 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:1d.7 config space:
00: 86 80 3a 29 07 00 00 00 03 20 03 0c 00 00 00 00
10: 00 10 64 c1 00 00 00 00 00 00 00 00 00 00 00 00
20: 00 00 00 00 00 00 00 00 00 00 00 00 f4 1a 00 11
30: 00 00 00 00 00 00 00 00 00 00 00 00 0b 04 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 20 20 00 00 00 00 00 00 01 00 00 00 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:1f.0 config space:
00: 86 80 18 29 07 00 00 00 02 00 01 06 00 00 80 00
10: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20: 00 00 00 00 00 00 00 00 00 00 00 00 f4 1a 00 11
30: 00 00 00 00 00 00 00 00 00 00 00 00 ff 00 00 00
40: 01 06 00 00 80 00 00 00 00 00 00 00 00 00 00 00
50: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 0a 0a 0b 0b 00 00 00 00 0a 0a 0b 0b 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 02 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 01 c0 d1 fe 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:1f.2 config space:
00: 86 80 22 29 07 00 10 00 02 01 06 01 00 00 80 00
10: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20: 41 82 00 00 00 00 64 c1 00 00 00 00 f4 1a 00 11
30: 00 00 00 00 80 00 00 00 00 00 00 00 0a 01 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 05 a8 80 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 40 00 3f 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 12 00 10 00 48 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:00:1f.3 config space:
00: 86 80 30 29 07 00 00 00 02 00 05 0c 00 00 80 00
10: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20: 01 82 00 00 00 00 00 00 00 00 00 00 f4 1a 00 11
30: 00 00 00 00 00 00 00 00 00 00 00 00 0a 01 00 00
40: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
50: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
80: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
90: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
a0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
b0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
c0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:01:00.0 config space:
00: f4 1a 48 10 07 00 10 00 01 00 00 01 00 00 00 00
10: 00 00 00 00 00 00 40 c1 00 00 00 00 00 00 00 00
20: 0c 00 00 00 40 08 00 00 00 00 00 00 f4 1a 00 11
30: 00 00 00 00 dc 00 00 00 00 00 00 00 0b 01 00 00
40: 10 00 02 00 00 80 00 10 00 00 00 00 11 04 00 00
50: 00 00 11 20 00 00 00 00 00 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 30 00 00 00 00 00 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 01 40 03 00
80: 00 00 00 00 09 7c 10 01 04 00 00 00 00 00 00 00
90: 00 10 00 00 09 84 10 03 04 00 00 00 00 10 00 00
a0: 00 10 00 00 09 94 10 04 04 00 00 00 00 20 00 00
b0: 00 10 00 00 09 a4 14 02 04 00 00 00 00 30 00 00
c0: 00 10 00 00 04 00 00 00 09 b4 14 05 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 11 c8 1a 00
e0: 01
[ 0.000000] 00 00 00 01 08 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] pci 0000:02:00.0 config space:
00: f4 1a 45 10 07 00 10 00 01 00 ff 00 00 00 00 00
10: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
20: 0c 00 10 00 40 08 00 00 00 00 00 00 f4 1a 00 11
30: 00 00 00 00 c8 00 00 00 00 00 00 00 0b 01 00 00
40: 10 00 02 00 00 80 00 10 00 00 00 00 11 04 00 00
50: 00 00 11 20 00 00 00 00 00 00 00 00 00 00 00 00
60: 00 00 00 00 00 00 30 00 00 00 00 00 00 00 00 00
70: 00 00 00 00 00 00 00 00 00 00 00 00 01 40 03 00
80: 00 00 00 00 09 7c 10 01 04 00 00 00 00 00 00 00
90: 00 10 00 00 09 84 10 03 04 00 00 00 00 10 00 00
a0: 00 10 00 00 09 94 10 04 04 00 00 00 00 20 00 00
b0: 00 10 00 00 09 a4 14 02 04 00 00 00 00 30 00 00
c0: 00 10 00 00 04 00 00 00 09 b4 14 05 00 00 00 00
d0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
e0: 00
[ 0.000000] 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
f0: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
[ 0.000000] e820: update [mem 0x795e0018-0x795e9457] usable ==> usable
[ 0.000000] e820: update [mem 0x79348018-0x7936f857] usable ==> usable
[ 0.000000] extended physical RAM map:
[ 0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000009ffff] usable
[ 0.000000] reserve setup_data: [mem 0x0000000000100000-0x0000000079348017] usable
[ 0.000000] reserve setup_data: [mem 0x0000000079348018-0x000000007936f857] usable
[ 0.000000] reserve setup_data: [mem 0x000000007936f858-0x00000000795e0017] usable
[ 0.000000] reserve setup_data: [mem 0x00000000795e0018-0x00000000795e9457] usable
[ 0.000000] reserve setup_data: [mem 0x00000000795e9458-0x000000007a051fff] usable
[ 0.000000] reserve setup_data: [mem 0x000000007a052000-0x000000007a060fff] ACPI data
[ 0.000000] reserve setup_data: [mem 0x000000007a061000-0x000000007b0eefff] usable
[ 0.000000] reserve setup_data: [mem 0x000000007b0ef000-0x000000007b36efff] reserved
[ 0.000000] reserve setup_data: [mem 0x000000007b36f000-0x000000007b37efff] ACPI data
[ 0.000000] reserve setup_data: [mem 0x000000007b37f000-0x000000007b3fefff] ACPI NVS
[ 0.000000] reserve setup_data: [mem 0x000000007b3ff000-0x000000007ff7bfff] usable
[ 0.000000] reserve setup_data: [mem 0x000000007ff7c000-0x000000007fffffff] reserved
[ 0.000000] reserve setup_data: [mem 0x00000000b0000000-0x00000000bfffffff] reserved
[ 0.000000] reserve setup_data: [mem 0x0000000100000000-0x000000037fffffff] usable
[ 0.000000] efi: EFI v2.70 by EDK II
[ 0.000000] efi: SMBIOS=0x7b12e000 ACPI=0x7b37e000 ACPI 2.0=0x7b37e014
[ 0.000000] efi: mem00: type=3, attr=0xf, range=[0x0000000000000000-0x0000000000001000) (0MB)
[ 0.000000] efi: mem01: type=2, attr=0xf, range=[0x0000000000001000-0x0000000000002000) (0MB)
[ 0.000000] efi: mem02: type=7, attr=0xf, range=[0x0000000000002000-0x0000000000087000) (0MB)
[ 0.000000] efi: mem03: type=4, attr=0xf, range=[0x0000000000087000-0x0000000000088000) (0MB)
[ 0.000000] efi: mem04: type=7, attr=0xf, range=[0x0000000000088000-0x00000000000a0000) (0MB)
[ 0.000000] efi: mem05: type=7, attr=0xf, range=[0x0000000000100000-0x0000000000806000) (7MB)
[ 0.000000] efi: mem06: type=4, attr=0xf, range=[0x0000000000806000-0x0000000000807000) (0MB)
[ 0.000000] efi: mem07: type=7, attr=0xf, range=[0x0000000000807000-0x0000000000820000) (0MB)
[ 0.000000] efi: mem08: type=4, attr=0xf, range=[0x0000000000820000-0x0000000001500000) (12MB)
[ 0.000000] efi: mem09: type=7, attr=0xf, range=[0x0000000001500000-0x0000000001600000) (1MB)
[ 0.000000] efi: mem10: type=2, attr=0xf, range=[0x0000000001600000-0x0000000002c7a000) (22MB)
[ 0.000000] efi: mem11: type=7, attr=0xf, range=[0x0000000002c7a000-0x000000003cb3d000) (926MB)
[ 0.000000] efi: mem12: type=2, attr=0xf, range=[0x000000003cb3d000-0x0000000040000000) (52MB)
[ 0.000000] efi: mem13: type=7, attr=0xf, range=[0x0000000040000000-0x0000000059e2c000) (414MB)
[ 0.000000] efi: mem14: type=2, attr=0xf, range=[0x0000000059e2c000-0x0000000077fdf000) (481MB)
[ 0.000000] efi: mem15: type=4, attr=0xf, range=[0x0000000077fdf000-0x0000000077fff000) (0MB)
[ 0.000000] efi: mem16: type=7, attr=0xf, range=[0x0000000077fff000-0x0000000079346000) (19MB)
[ 0.000000] efi: mem17: type=2, attr=0xf, range=[0x0000000079346000-0x0000000079370000) (0MB)
[ 0.000000] efi: mem18: type=1, attr=0xf, range=[0x0000000079370000-0x000000007947f000) (1MB)
[ 0.000000] efi: mem19: type=4, attr=0xf, range=[0x000000007947f000-0x00000000795df000) (1MB)
[ 0.000000] efi: mem20: type=7, attr=0xf, range=[0x00000000795df000-0x00000000795e0000) (0MB)
[ 0.000000] efi: mem21: type=2, attr=0xf, range=[0x00000000795e0000-0x00000000795ea000) (0MB)
[ 0.000000] efi: mem22: type=4, attr=0xf, range=[0x00000000795ea000-0x00000000795eb000) (0MB)
[ 0.000000] efi: mem23: type=1, attr=0xf, range=[0x00000000795eb000-0x00000000796f5000) (1MB)
[ 0.000000] efi: mem24: type=2, attr=0xf, range=[0x00000000796f5000-0x0000000079800000) (1MB)
[ 0.000000] efi: mem25: type=4, attr=0xf, range=[0x0000000079800000-0x0000000079801000) (0MB)
[ 0.000000] efi: mem26: type=2, attr=0xf, range=[0x0000000079801000-0x0000000079802000) (0MB)
[ 0.000000] efi: mem27: type=4, attr=0xf, range=[0x0000000079802000-0x0000000079f83000) (7MB)
[ 0.000000] efi: mem28: type=3, attr=0xf, range=[0x0000000079f83000-0x000000007a02b000) (0MB)
[ 0.000000] efi: mem29: type=4, attr=0xf, range=[0x000000007a02b000-0x000000007a052000) (0MB)
[ 0.000000] efi: mem30: type=9, attr=0xf, range=[0x000000007a052000-0x000000007a061000) (0MB)
[ 0.000000] efi: mem31: type=4, attr=0xf, range=[0x000000007a061000-0x000000007a0a2000) (0MB)
[ 0.000000] efi: mem32: type=3, attr=0xf, range=[0x000000007a0a2000-0x000000007a0b2000) (0MB)
[ 0.000000] efi: mem33: type=4, attr=0xf, range=[0x000000007a0b2000-0x000000007a0b6000) (0MB)
[ 0.000000] efi: mem34: type=3, attr=0xf, range=[0x000000007a0b6000-0x000000007a0e4000) (0MB)
[ 0.000000] efi: mem35: type=4, attr=0xf, range=[0x000000007a0e4000-0x000000007a0e5000) (0MB)
[ 0.000000] efi: mem36: type=3, attr=0xf, range=[0x000000007a0e5000-0x000000007a0fa000) (0MB)
[ 0.000000] efi: mem37: type=4, attr=0xf, range=[0x000000007a0fa000-0x000000007a0fe000) (0MB)
[ 0.000000] efi: mem38: type=3, attr=0xf, range=[0x000000007a0fe000-0x000000007a130000) (0MB)
[ 0.000000] efi: mem39: type=4, attr=0xf, range=[0x000000007a130000-0x000000007a133000) (0MB)
[ 0.000000] efi: mem40: type=3, attr=0xf, range=[0x000000007a133000-0x000000007a168000) (0MB)
[ 0.000000] efi: mem41: type=4, attr=0xf, range=[0x000000007a168000-0x000000007a16a000) (0MB)
[ 0.000000] efi: mem42: type=3, attr=0xf, range=[0x000000007a16a000-0x000000007a19b000) (0MB)
[ 0.000000] efi: mem43: type=4, attr=0xf, range=[0x000000007a19b000-0x000000007a1a1000) (0MB)
[ 0.000000] efi: mem44: type=3, attr=0xf, range=[0x000000007a1a1000-0x000000007a1bd000) (0MB)
[ 0.000000] efi: mem45: type=4, attr=0xf, range=[0x000000007a1bd000-0x000000007a1be000) (0MB)
[ 0.000000] efi: mem46: type=3, attr=0xf, range=[0x000000007a1be000-0x000000007a1d4000) (0MB)
[ 0.000000] efi: mem47: type=4, attr=0xf, range=[0x000000007a1d4000-0x000000007a1d8000) (0MB)
[ 0.000000] efi: mem48: type=3, attr=0xf, range=[0x000000007a1d8000-0x000000007a217000) (0MB)
[ 0.000000] efi: mem49: type=4, attr=0xf, range=[0x000000007a217000-0x000000007a220000) (0MB)
[ 0.000000] efi: mem50: type=3, attr=0xf, range=[0x000000007a220000-0x000000007a232000) (0MB)
[ 0.000000] efi: mem51: type=4, attr=0xf, range=[0x000000007a232000-0x000000007a234000) (0MB)
[ 0.000000] efi: mem52: type=3, attr=0xf, range=[0x000000007a234000-0x000000007a246000) (0MB)
[ 0.000000] efi: mem53: type=4, attr=0xf, range=[0x000000007a246000-0x000000007a24d000) (0MB)
[ 0.000000] efi: mem54: type=3, attr=0xf, range=[0x000000007a24d000-0x000000007a261000) (0MB)
[ 0.000000] efi: mem55: type=4, attr=0xf, range=[0x000000007a261000-0x000000007a265000) (0MB)
[ 0.000000] efi: mem56: type=3, attr=0xf, range=[0x000000007a265000-0x000000007a27f000) (0MB)
[ 0.000000] efi: mem57: type=4, attr=0xf, range=[0x000000007a27f000-0x000000007a281000) (0MB)
[ 0.000000] efi: mem58: type=3, attr=0xf, range=[0x000000007a281000-0x000000007a285000) (0MB)
[ 0.000000] efi: mem59: type=4, attr=0xf, range=[0x000000007a285000-0x000000007a289000) (0MB)
[ 0.000000] efi: mem60: type=3, attr=0xf, range=[0x000000007a289000-0x000000007a2d3000) (0MB)
[ 0.000000] efi: mem61: type=4, attr=0xf, range=[0x000000007a2d3000-0x000000007a2d6000) (0MB)
[ 0.000000] efi: mem62: type=3, attr=0xf, range=[0x000000007a2d6000-0x000000007a387000) (0MB)
[ 0.000000] efi: mem63: type=4, attr=0xf, range=[0x000000007a387000-0x000000007a600000) (2MB)
[ 0.000000] efi: mem64: type=3, attr=0xf, range=[0x000000007a600000-0x000000007a60c000) (0MB)
[ 0.000000] efi: mem65: type=4, attr=0xf, range=[0x000000007a60c000-0x000000007a613000) (0MB)
[ 0.000000] efi: mem66: type=3, attr=0xf, range=[0x000000007a613000-0x000000007a621000) (0MB)
[ 0.000000] efi: mem67: type=4, attr=0xf, range=[0x000000007a621000-0x000000007a623000) (0MB)
[ 0.000000] efi: mem68: type=3, attr=0xf, range=[0x000000007a623000-0x000000007a629000) (0MB)
[ 0.000000] efi: mem69: type=4, attr=0xf, range=[0x000000007a629000-0x000000007a62f000) (0MB)
[ 0.000000] efi: mem70: type=3, attr=0xf, range=[0x000000007a62f000-0x000000007a637000) (0MB)
[ 0.000000] efi: mem71: type=4, attr=0xf, range=[0x000000007a637000-0x000000007a63f000) (0MB)
[ 0.000000] efi: mem72: type=3, attr=0xf, range=[0x000000007a63f000-0x000000007a64d000) (0MB)
[ 0.000000] efi: mem73: type=4, attr=0xf, range=[0x000000007a64d000-0x000000007a650000) (0MB)
[ 0.000000] efi: mem74: type=3, attr=0xf, range=[0x000000007a650000-0x000000007a69e000) (0MB)
[ 0.000000] efi: mem75: type=4, attr=0xf, range=[0x000000007a69e000-0x000000007a6a1000) (0MB)
[ 0.000000] efi: mem76: type=3, attr=0xf, range=[0x000000007a6a1000-0x000000007a6a5000) (0MB)
[ 0.000000] efi: mem77: type=4, attr=0xf, range=[0x000000007a6a5000-0x000000007a6ab000) (0MB)
[ 0.000000] efi: mem78: type=3, attr=0xf, range=[0x000000007a6ab000-0x000000007a6d2000) (0MB)
[ 0.000000] efi: mem79: type=4, attr=0xf, range=[0x000000007a6d2000-0x000000007a6d3000) (0MB)
[ 0.000000] efi: mem80: type=3, attr=0xf, range=[0x000000007a6d3000-0x000000007a6d7000) (0MB)
[ 0.000000] efi: mem81: type=4, attr=0xf, range=[0x000000007a6d7000-0x000000007a6db000) (0MB)
[ 0.000000] efi: mem82: type=3, attr=0xf, range=[0x000000007a6db000-0x000000007a6e5000) (0MB)
[ 0.000000] efi: mem83: type=4, attr=0xf, range=[0x000000007a6e5000-0x000000007a6e7000) (0MB)
[ 0.000000] efi: mem84: type=3, attr=0xf, range=[0x000000007a6e7000-0x000000007a6eb000) (0MB)
[ 0.000000] efi: mem85: type=4, attr=0xf, range=[0x000000007a6eb000-0x000000007a6ef000) (0MB)
[ 0.000000] efi: mem86: type=3, attr=0xf, range=[0x000000007a6ef000-0x000000007a6ff000) (0MB)
[ 0.000000] efi: mem87: type=4, attr=0xf, range=[0x000000007a6ff000-0x000000007a7c2000) (0MB)
[ 0.000000] efi: mem88: type=3, attr=0xf, range=[0x000000007a7c2000-0x000000007a7dc000) (0MB)
[ 0.000000] efi: mem89: type=4, attr=0xf, range=[0x000000007a7dc000-0x000000007a7e0000) (0MB)
[ 0.000000] efi: mem90: type=3, attr=0xf, range=[0x000000007a7e0000-0x000000007a7e4000) (0MB)
[ 0.000000] efi: mem91: type=4, attr=0xf, range=[0x000000007a7e4000-0x000000007a7e8000) (0MB)
[ 0.000000] efi: mem92: type=3, attr=0xf, range=[0x000000007a7e8000-0x000000007a7f6000) (0MB)
[ 0.000000] efi: mem93: type=4, attr=0xf, range=[0x000000007a7f6000-0x000000007abf6000) (4MB)
[ 0.000000] efi: mem94: type=3, attr=0xf, range=[0x000000007abf6000-0x000000007ac07000) (0MB)
[ 0.000000] efi: mem95: type=4, attr=0xf, range=[0x000000007ac07000-0x000000007ac08000) (0MB)
[ 0.000000] efi: mem96: type=3, attr=0xf, range=[0x000000007ac08000-0x000000007ac10000) (0MB)
[ 0.000000] efi: mem97: type=4, attr=0xf, range=[0x000000007ac10000-0x000000007ac11000) (0MB)
[ 0.000000] efi: mem98: type=3, attr=0xf, range=[0x000000007ac11000-0x000000007ac1f000) (0MB)
[ 0.000000] efi: mem99: type=4, attr=0xf, range=[0x000000007ac1f000-0x000000007ac20000) (0MB)
[ 0.000000] efi: mem100: type=3, attr=0xf, range=[0x000000007ac20000-0x000000007ac21000) (0MB)
[ 0.000000] efi: mem101: type=4, attr=0xf, range=[0x000000007ac21000-0x000000007b0ef000) (4MB)
[ 0.000000] efi: mem102: type=6, attr=0x800000000000000f, range=[0x000000007b0ef000-0x000000007b1ef000) (1MB)
[ 0.000000] efi: mem103: type=5, attr=0x800000000000000f, range=[0x000000007b1ef000-0x000000007b2ef000) (1MB)
[ 0.000000] efi: mem104: type=0, attr=0xf, range=[0x000000007b2ef000-0x000000007b36f000) (0MB)
[ 0.000000] efi: mem105: type=9, attr=0xf, range=[0x000000007b36f000-0x000000007b37f000) (0MB)
[ 0.000000] efi: mem106: type=10, attr=0xf, range=[0x000000007b37f000-0x000000007b3ff000) (0MB)
[ 0.000000] efi: mem107: type=4, attr=0xf, range=[0x000000007b3ff000-0x000000007f600000) (66MB)
[ 0.000000] efi: mem108: type=7, attr=0xf, range=[0x000000007f600000-0x000000007f758000) (1MB)
[ 0.000000] efi: mem109: type=4, attr=0xf, range=[0x000000007f758000-0x000000007f778000) (0MB)
[ 0.000000] efi: mem110: type=3, attr=0xf, range=[0x000000007f778000-0x000000007f7c0000) (0MB)
[ 0.000000] efi: mem111: type=4, attr=0xf, range=[0x000000007f7c0000-0x000000007ff4e000) (7MB)
[ 0.000000] efi: mem112: type=3, attr=0xf, range=[0x000000007ff4e000-0x000000007ff7c000) (0MB)
[ 0.000000] efi: mem113: type=6, attr=0x800000000000000f, range=[0x000000007ff7c000-0x0000000080000000) (0MB)
[ 0.000000] efi: mem114: type=7, attr=0xf, range=[0x0000000100000000-0x0000000380000000) (10240MB)
[ 0.000000] efi: mem115: type=0, attr=0x1, range=[0x00000000b0000000-0x00000000c0000000) (256MB)
[ 0.000000] SMBIOS 2.8 present.
[ 0.000000] DMI: Nutanix AHV/RHEL-AV, BIOS 0.0.0 02/06/2015
[ 0.000000] Hypervisor detected: KVM
[ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.000000] AGP: No AGP bridge found
[ 0.000000] e820: last_pfn = 0x380000 max_arch_pfn = 0x400000000
[ 0.000000] MTRR default type: write-back
[ 0.000000] MTRR fixed ranges enabled:
[ 0.000000] 00000-9FFFF write-back
[ 0.000000] A0000-FFFFF uncachable
[ 0.000000] MTRR variable ranges enabled:
[ 0.000000] 0 base 0000C0000000 mask 3FFFC0000000 uncachable
[ 0.000000] 1 base 0000B0000000 mask 3FFFF0000000 uncachable
[ 0.000000] 2 base 084000000000 mask 3FF800000000 uncachable
[ 0.000000] 3 disabled
[ 0.000000] 4 disabled
[ 0.000000] 5 disabled
[ 0.000000] 6 disabled
[ 0.000000] 7 disabled
[ 0.000000] PAT configuration [0-7]: WB WC UC- UC WB WP UC- UC
[ 0.000000] e820: last_pfn = 0x7ff7c max_arch_pfn = 0x400000000
[ 0.000000] Base memory trampoline at [ffff957700099000] 99000 size 24576
[ 0.000000] Using GB pages for direct mapping
[ 0.000000] BRK [0x174852000, 0x174852fff] PGTABLE
[ 0.000000] BRK [0x174853000, 0x174853fff] PGTABLE
[ 0.000000] BRK [0x174854000, 0x174854fff] PGTABLE
[ 0.000000] BRK [0x174855000, 0x174855fff] PGTABLE
[ 0.000000] BRK [0x174856000, 0x174856fff] PGTABLE
[ 0.000000] BRK [0x174857000, 0x174857fff] PGTABLE
[ 0.000000] BRK [0x174858000, 0x174858fff] PGTABLE
[ 0.000000] BRK [0x174859000, 0x174859fff] PGTABLE
[ 0.000000] BRK [0x17485a000, 0x17485afff] PGTABLE
[ 0.000000] RAMDISK: [mem 0x3cb3d000-0x3e983fff]
[ 0.000000] Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 000000007b37e014 00024 (v02 BOCHS )
[ 0.000000] ACPI: XSDT 000000007b37d0e8 00054 (v01 BOCHS BXPCFACP 00000001 01000013)
[ 0.000000] ACPI: FACP 000000007b37c000 000F4 (v03 BOCHS BXPCFACP 00000001 BXPC 00000001)
[ 0.000000] ACPI: DSDT 000000007a052000 0EBE9 (v01 BOCHS BXPCDSDT 00000001 BXPC 00000001)
[ 0.000000] ACPI: FACS 000000007b3dc000 00040
[ 0.000000] ACPI: APIC 000000007b37b000 007F0 (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001)
[ 0.000000] ACPI: SSDT 000000007b37a000 000CA (v01 BOCHS VMGENID 00000001 BXPC 00000001)
[ 0.000000] ACPI: SRAT 000000007b379000 00FD0 (v01 BOCHS BXPCSRAT 00000001 BXPC 00000001)
[ 0.000000] ACPI: MCFG 000000007b378000 0003C (v01 BOCHS BXPCMCFG 00000001 BXPC 00000001)
[ 0.000000] ACPI: BGRT 000000007b377000 00038 (v01 INTEL EDK2 00000002 01000013)
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x0c -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x0d -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x0e -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x0f -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x11 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x13 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x15 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x17 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x18 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x19 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x1a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x1b -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x1c -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x1d -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x1e -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x1f -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x20 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x21 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x22 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x23 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x24 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x25 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x26 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x27 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x28 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x29 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x2a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x2b -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x2c -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x2d -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x2e -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x2f -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x30 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x31 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x32 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x33 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x34 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x35 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x36 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x37 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x38 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x39 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x3a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x3b -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x3c -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x3d -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x3e -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x3f -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x40 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x41 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x42 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x43 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x44 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x45 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x46 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x47 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x48 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x49 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x4a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x4b -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x4c -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x4d -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x4e -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x4f -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x50 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x51 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x52 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x53 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x54 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x55 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x56 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x57 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x58 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x59 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x5a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x5b -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x5c -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x5d -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x5e -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x5f -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x60 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x61 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x62 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x63 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x64 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x65 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x66 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x67 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x68 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x69 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x6a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x6b -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x6c -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x6d -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x6e -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x6f -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x70 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x71 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x72 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x73 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x74 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x75 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x76 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x77 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x78 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x79 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x7a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x7b -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x7c -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x7d -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x7e -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x7f -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x80 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x81 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x82 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x83 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x84 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x85 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x86 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x87 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x88 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x89 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x8a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x8b -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x8c -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x8d -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x8e -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x8f -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x90 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x91 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x92 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x93 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x94 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x95 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x96 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x97 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x98 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x99 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x9a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x9b -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x9c -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x9d -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x9e -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x9f -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xa0 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xa1 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xa2 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xa3 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xa4 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xa5 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xa6 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xa7 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xa8 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xa9 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xaa -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xab -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xac -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xad -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xae -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xaf -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xb0 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xb1 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xb2 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xb3 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xb4 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xb5 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xb6 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xb7 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xb8 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xb9 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xba -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xbb -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xbc -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xbd -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xbe -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xbf -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xc0 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xc1 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xc2 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xc3 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xc4 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xc5 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xc6 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xc7 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xc8 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xc9 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xca -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xcb -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xcc -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xcd -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xce -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xcf -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xd0 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xd1 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xd2 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xd3 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xd4 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xd5 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xd6 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xd7 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xd8 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xd9 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xda -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xdb -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xdc -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xdd -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xde -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xdf -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xe0 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xe1 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xe2 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xe3 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xe4 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xe5 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xe6 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xe7 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xe8 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xe9 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xea -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xeb -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xec -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xed -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xee -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0xef -> Node 0
[ 0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0x0009ffff]
[ 0.000000] SRAT: Node 0 PXM 0 [mem 0x00100000-0x7fffffff]
[ 0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0x37fffffff]
[ 0.000000] SRAT: Node 0 PXM 0 [mem 0x380000000-0x83c7fffffff] hotplug
[ 0.000000] NUMA: Node 0 [mem 0x00000000-0x0009ffff] + [mem 0x00100000-0x7fffffff] -> [mem 0x00000000-0x7fffffff]
[ 0.000000] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x37fffffff] -> [mem 0x00000000-0x37fffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x37ffd9000-0x37fffffff]
[ 0.000000] Reserving 161MB of memory at 720MB for crashkernel (System RAM: 12283MB)
[ 0.000000] kvm-clock: cpu 0, msr 3:7ff88001, primary cpu clock
[ 0.000000] kvm-clock: Using msrs 4b564d01 and 4b564d00
[ 0.000000] kvm-clock: using sched offset of 8466389451723 cycles
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x00001000-0x00ffffff]
[ 0.000000] DMA32 [mem 0x01000000-0xffffffff]
[ 0.000000] Normal [mem 0x100000000-0x37fffffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x00001000-0x0009ffff]
[ 0.000000] node 0: [mem 0x00100000-0x7a051fff]
[ 0.000000] node 0: [mem 0x7a061000-0x7b0eefff]
[ 0.000000] node 0: [mem 0x7b3ff000-0x7ff7bfff]
[ 0.000000] node 0: [mem 0x100000000-0x37fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x00001000-0x37fffffff]
[ 0.000000] On node 0 totalpages: 3144700
[ 0.000000] DMA zone: 64 pages used for memmap
[ 0.000000] DMA zone: 2040 pages reserved
[ 0.000000] DMA zone: 3999 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 8114 pages used for memmap
[ 0.000000] DMA32 zone: 519261 pages, LIFO batch:31
[ 0.000000] Normal zone: 40960 pages used for memmap
[ 0.000000] Normal zone: 2621440 pages, LIFO batch:31
[ 0.000000] ACPI: PM-Timer IO Port: 0x608
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x0c] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x0d] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x0e] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x0f] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x10] lapic_id[0x10] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x11] lapic_id[0x11] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x12] lapic_id[0x12] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x13] lapic_id[0x13] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x14] lapic_id[0x14] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x15] lapic_id[0x15] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x16] lapic_id[0x16] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x17] lapic_id[0x17] enabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x18] lapic_id[0x18] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x19] lapic_id[0x19] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x1a] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x1b] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x1c] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x1d] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x1e] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x1f] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x20] lapic_id[0x20] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x21] lapic_id[0x21] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x22] lapic_id[0x22] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x23] lapic_id[0x23] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x24] lapic_id[0x24] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x25] lapic_id[0x25] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x26] lapic_id[0x26] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x27] lapic_id[0x27] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x28] lapic_id[0x28] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x29] lapic_id[0x29] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x2a] lapic_id[0x2a] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x2b] lapic_id[0x2b] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x2c] lapic_id[0x2c] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x2d] lapic_id[0x2d] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x2e] lapic_id[0x2e] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x2f] lapic_id[0x2f] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x30] lapic_id[0x30] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x31] lapic_id[0x31] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x32] lapic_id[0x32] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x33] lapic_id[0x33] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x34] lapic_id[0x34] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x35] lapic_id[0x35] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x36] lapic_id[0x36] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x37] lapic_id[0x37] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x38] lapic_id[0x38] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x39] lapic_id[0x39] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x3a] lapic_id[0x3a] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x3b] lapic_id[0x3b] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x3c] lapic_id[0x3c] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x3d] lapic_id[0x3d] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x3e] lapic_id[0x3e] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x3f] lapic_id[0x3f] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x40] lapic_id[0x40] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x41] lapic_id[0x41] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x42] lapic_id[0x42] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x43] lapic_id[0x43] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x44] lapic_id[0x44] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x45] lapic_id[0x45] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x46] lapic_id[0x46] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x47] lapic_id[0x47] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x48] lapic_id[0x48] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x49] lapic_id[0x49] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x4a] lapic_id[0x4a] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x4b] lapic_id[0x4b] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x4c] lapic_id[0x4c] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x4d] lapic_id[0x4d] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x4e] lapic_id[0x4e] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x4f] lapic_id[0x4f] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x50] lapic_id[0x50] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x51] lapic_id[0x51] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x52] lapic_id[0x52] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x53] lapic_id[0x53] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x54] lapic_id[0x54] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x55] lapic_id[0x55] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x56] lapic_id[0x56] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x57] lapic_id[0x57] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x58] lapic_id[0x58] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x59] lapic_id[0x59] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x5a] lapic_id[0x5a] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x5b] lapic_id[0x5b] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x5c] lapic_id[0x5c] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x5d] lapic_id[0x5d] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x5e] lapic_id[0x5e] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x5f] lapic_id[0x5f] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x60] lapic_id[0x60] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x61] lapic_id[0x61] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x62] lapic_id[0x62] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x63] lapic_id[0x63] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x64] lapic_id[0x64] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x65] lapic_id[0x65] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x66] lapic_id[0x66] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x67] lapic_id[0x67] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x68] lapic_id[0x68] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x69] lapic_id[0x69] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x6a] lapic_id[0x6a] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x6b] lapic_id[0x6b] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x6c] lapic_id[0x6c] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x6d] lapic_id[0x6d] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x6e] lapic_id[0x6e] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x6f] lapic_id[0x6f] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x70] lapic_id[0x70] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x71] lapic_id[0x71] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x72] lapic_id[0x72] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x73] lapic_id[0x73] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x74] lapic_id[0x74] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x75] lapic_id[0x75] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x76] lapic_id[0x76] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x77] lapic_id[0x77] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x78] lapic_id[0x78] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x79] lapic_id[0x79] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x7a] lapic_id[0x7a] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x7b] lapic_id[0x7b] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x7c] lapic_id[0x7c] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x7d] lapic_id[0x7d] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x7e] lapic_id[0x7e] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x7f] lapic_id[0x7f] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x80] lapic_id[0x80] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x81] lapic_id[0x81] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x82] lapic_id[0x82] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x83] lapic_id[0x83] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x84] lapic_id[0x84] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x85] lapic_id[0x85] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x86] lapic_id[0x86] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x87] lapic_id[0x87] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x88] lapic_id[0x88] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x89] lapic_id[0x89] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x8a] lapic_id[0x8a] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x8b] lapic_id[0x8b] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x8c] lapic_id[0x8c] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x8d] lapic_id[0x8d] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x8e] lapic_id[0x8e] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x8f] lapic_id[0x8f] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x90] lapic_id[0x90] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x91] lapic_id[0x91] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x92] lapic_id[0x92] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x93] lapic_id[0x93] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x94] lapic_id[0x94] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x95] lapic_id[0x95] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x96] lapic_id[0x96] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x97] lapic_id[0x97] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x98] lapic_id[0x98] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x99] lapic_id[0x99] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x9a] lapic_id[0x9a] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x9b] lapic_id[0x9b] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x9c] lapic_id[0x9c] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x9d] lapic_id[0x9d] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x9e] lapic_id[0x9e] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0x9f] lapic_id[0x9f] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xa0] lapic_id[0xa0] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xa1] lapic_id[0xa1] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xa2] lapic_id[0xa2] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xa3] lapic_id[0xa3] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xa4] lapic_id[0xa4] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xa5] lapic_id[0xa5] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xa6] lapic_id[0xa6] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xa7] lapic_id[0xa7] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xa8] lapic_id[0xa8] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xa9] lapic_id[0xa9] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xaa] lapic_id[0xaa] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xab] lapic_id[0xab] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xac] lapic_id[0xac] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xad] lapic_id[0xad] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xae] lapic_id[0xae] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xaf] lapic_id[0xaf] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xb0] lapic_id[0xb0] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xb1] lapic_id[0xb1] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xb2] lapic_id[0xb2] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xb3] lapic_id[0xb3] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xb4] lapic_id[0xb4] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xb5] lapic_id[0xb5] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xb6] lapic_id[0xb6] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xb7] lapic_id[0xb7] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xb8] lapic_id[0xb8] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xb9] lapic_id[0xb9] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xba] lapic_id[0xba] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xbb] lapic_id[0xbb] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xbc] lapic_id[0xbc] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xbd] lapic_id[0xbd] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xbe] lapic_id[0xbe] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xbf] lapic_id[0xbf] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xc0] lapic_id[0xc0] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xc1] lapic_id[0xc1] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xc2] lapic_id[0xc2] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xc3] lapic_id[0xc3] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xc4] lapic_id[0xc4] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xc5] lapic_id[0xc5] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xc6] lapic_id[0xc6] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xc7] lapic_id[0xc7] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xc8] lapic_id[0xc8] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xc9] lapic_id[0xc9] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xca] lapic_id[0xca] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xcb] lapic_id[0xcb] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xcc] lapic_id[0xcc] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xcd] lapic_id[0xcd] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xce] lapic_id[0xce] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xcf] lapic_id[0xcf] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xd0] lapic_id[0xd0] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xd1] lapic_id[0xd1] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xd2] lapic_id[0xd2] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xd3] lapic_id[0xd3] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xd4] lapic_id[0xd4] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xd5] lapic_id[0xd5] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xd6] lapic_id[0xd6] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xd7] lapic_id[0xd7] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xd8] lapic_id[0xd8] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xd9] lapic_id[0xd9] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xda] lapic_id[0xda] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xdb] lapic_id[0xdb] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xdc] lapic_id[0xdc] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xdd] lapic_id[0xdd] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xde] lapic_id[0xde] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xdf] lapic_id[0xdf] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xe0] lapic_id[0xe0] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xe1] lapic_id[0xe1] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xe2] lapic_id[0xe2] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xe3] lapic_id[0xe3] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xe4] lapic_id[0xe4] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xe5] lapic_id[0xe5] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xe6] lapic_id[0xe6] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xe7] lapic_id[0xe7] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xe8] lapic_id[0xe8] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xe9] lapic_id[0xe9] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xea] lapic_id[0xea] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xeb] lapic_id[0xeb] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xec] lapic_id[0xec] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xed] lapic_id[0xed] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xee] lapic_id[0xee] disabled)
[ 0.000000] ACPI: LAPIC (acpi_id[0xef] lapic_id[0xef] disabled)
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] dfl dfl lint[0x1])
[ 0.000000] ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0])
[ 0.000000] IOAPIC[0]: apic_id 0, version 17, address 0xfec00000, GSI 0-23
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
[ 0.000000] ACPI: IRQ0 used by override.
[ 0.000000] ACPI: IRQ5 used by override.
[ 0.000000] ACPI: IRQ9 used by override.
[ 0.000000] ACPI: IRQ10 used by override.
[ 0.000000] ACPI: IRQ11 used by override.
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] smpboot: Allowing 240 CPUs, 216 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x79348000-0x79348fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7936f000-0x7936ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x795e0000-0x795e0fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x795e9000-0x795e9fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7a052000-0x7a060fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b0ef000-0x7b36efff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b36f000-0x7b37efff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b37f000-0x7b3fefff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7ff7c000-0x7fffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x80000000-0xafffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xb0000000-0xbfffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xc0000000-0xffffffff]
[ 0.000000] e820: [mem 0xc0000000-0xffffffff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on KVM
[ 0.000000] setup_percpu: NR_CPUS:5120 nr_cpumask_bits:240 nr_cpu_ids:240 nr_node_ids:1
[ 0.000000] PERCPU: Embedded 38 pages/cpu @ffff957a6fa00000 s118784 r8192 d28672 u262144
[ 0.000000] pcpu-alloc: s118784 r8192 d28672 u262144 alloc=1*2097152
[ 0.000000] pcpu-alloc: [0] 000 001 002 003 004 005 006 007
[ 0.000000] pcpu-alloc: [0] 008 009 010 011 012 013 014 015
[ 0.000000] pcpu-alloc: [0] 016 017 018 019 020 021 022 023
[ 0.000000] pcpu-alloc: [0] 024 025 026 027 028 029 030 031
[ 0.000000] pcpu-alloc: [0] 032 033 034 035 036 037 038 039
[ 0.000000] pcpu-alloc: [0] 040 041 042 043 044 045 046 047
[ 0.000000] pcpu-alloc: [0] 048 049 050 051 052 053 054 055
[ 0.000000] pcpu-alloc: [0] 056 057 058 059 060 061 062 063
[ 0.000000] pcpu-alloc: [0] 064 065 066 067 068 069 070 071
[ 0.000000] pcpu-alloc: [0] 072 073 074 075 076 077 078 079
[ 0.000000] pcpu-alloc: [0] 080 081 082 083 084 085 086 087
[ 0.000000] pcpu-alloc: [0] 088 089 090 091 092 093 094 095
[ 0.000000] pcpu-alloc: [0] 096 097 098 099 100 101 102 103
[ 0.000000] pcpu-alloc: [0] 104 105 106 107 108 109 110 111
[ 0.000000] pcpu-alloc: [0] 112 113 114 115 116 117 118 119
[ 0.000000] pcpu-alloc: [0] 120 121 122 123 124 125 126 127
[ 0.000000] pcpu-alloc: [0] 128 129 130 131 132 133 134 135
[ 0.000000] pcpu-alloc: [0] 136 137 138 139 140 141 142 143
[ 0.000000] pcpu-alloc: [0] 144 145 146 147 148 149 150 151
[ 0.000000] pcpu-alloc: [0] 152 153 154 155 156 157 158 159
[ 0.000000] pcpu-alloc: [0] 160 161 162 163 164 165 166 167
[ 0.000000] pcpu-alloc: [0] 168 169 170 171 172 173 174 175
[ 0.000000] pcpu-alloc: [0] 176 177 178 179 180 181 182 183
[ 0.000000] pcpu-alloc: [0] 184 185 186 187 188 189 190 191
[ 0.000000] pcpu-alloc: [0] 192 193 194 195 196 197 198 199
[ 0.000000] pcpu-alloc: [0] 200 201 202 203 204 205 206 207
[ 0.000000] pcpu-alloc: [0] 208 209 210 211 212 213 214 215
[ 0.000000] pcpu-alloc: [0] 216 217 218 219 220 221 222 223
[ 0.000000] pcpu-alloc: [0] 224 225 226 227 228 229 230 231
[ 0.000000] pcpu-alloc: [0] 232 233 234 235 236 237 238 239
[ 0.000000] KVM setup async PF for cpu 0
[ 0.000000] kvm-stealtime: cpu 0, msr 36fa1c040
[ 0.000000] PV qspinlock hash table entries: 512 (order: 1, 8192 bytes)
[ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 3093522
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/vmlinuz-3.10.0-957.el7.x86_64 root=/dev/mapper/centos-root ro crashkernel=auto rd.lvm.lv=centos/root rd.lvm.lv=centos/swap pci=earlydump
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] x86/fpu: xstate_offset[2]: 0240, xstate_sizes[2]: 0100
[ 0.000000] x86/fpu: xstate_offset[3]: 0000, xstate_sizes[3]: 0000
[ 0.000000] x86/fpu: xstate_offset[4]: 0000, xstate_sizes[4]: 0000
[ 0.000000] x86/fpu: xstate_offset[5]: 0440, xstate_sizes[5]: 0040
[ 0.000000] x86/fpu: xstate_offset[6]: 0480, xstate_sizes[6]: 0200
[ 0.000000] x86/fpu: xstate_offset[7]: 0680, xstate_sizes[7]: 0400
[ 0.000000] xsave: enabled xstate_bv 0xe7, cntxt size 0xa80 using standard form
[ 0.000000] AGP: Checking aperture...
[ 0.000000] AGP: No AGP bridge found
[ 0.000000] Memory: 3793528k/14680064k available (7664k kernel code, 2101264k absent, 630984k reserved, 6055k data, 1876k init)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=240, Nodes=1
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] RCU restricting CPUs from NR_CPUS=5120 to nr_cpu_ids=240.
[ 0.000000] NR_IRQS:327936 nr_irqs:2344 0
[ 0.000000] Console: colour dummy device 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] allocated 50331648 bytes of page_cgroup
[ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups
[ 0.000000] tsc: Detected 2399.998 MHz processor
[ 0.144336] Calibrating delay loop (skipped) preset value.. 4799.99 BogoMIPS (lpj=2399998)
[ 0.144342] pid_max: default: 245760 minimum: 1920
[ 0.144900] Security Framework initialized
[ 0.144913] SELinux: Initializing.
[ 0.145003] SELinux: Starting in permissive mode
[ 0.145004] Yama: becoming mindful.
[ 0.145902] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[ 0.148534] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[ 0.149661] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.149677] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes)
[ 0.150223] Initializing cgroup subsys memory
[ 0.150247] Initializing cgroup subsys devices
[ 0.150250] Initializing cgroup subsys freezer
[ 0.150252] Initializing cgroup subsys net_cls
[ 0.150255] Initializing cgroup subsys blkio
[ 0.150258] Initializing cgroup subsys perf_event
[ 0.150274] Initializing cgroup subsys hugetlb
[ 0.150277] Initializing cgroup subsys pids
[ 0.150279] Initializing cgroup subsys net_prio
[ 0.150449] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.150697] mce: CPU supports 10 MCE banks
[ 0.150772] Last level iTLB entries: 4KB 0, 2MB 0, 4MB 0
[ 0.150775] Last level dTLB entries: 4KB 0, 2MB 0, 4MB 0
[ 0.150777] tlb_flushall_shift: 6
[ 0.150819] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[ 0.150895] FEATURE SPEC_CTRL Present
[ 0.150897] FEATURE IBPB_SUPPORT Present
[ 0.150920] Spectre V2 : Mitigation: Enhanced IBRS
[ 0.153334] Freeing SMP alternatives: 28k freed
[ 0.160332] ACPI: Core revision 20130517
[ 0.166681] ACPI: All ACPI Tables successfully acquired
[ 0.170805] ftrace: allocating 29185 entries in 115 pages
[ 0.202313] Enabling x2apic
[ 0.202321] Enabled x2apic
[ 0.202481] Switched APIC routing to physical x2apic.
[ 0.203317] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.203320] smpboot: CPU0: Intel(R) Xeon(R) Silver 4314 CPU @ 2.40GHz (fam: 0f, model: 06, stepping: 01)
[ 0.203336] TSC deadline timer enabled
[ 0.203357] Performance Events: unsupported Netburst CPU model 6 no PMU driver, software events only.
[ 0.203419] KVM setup paravirtual spinlock
[ 0.217852] kvm-clock: cpu 1, msr 3:7ff88041, secondary cpu clock
[ 0.217990] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.238401] KVM setup async PF for cpu 1
[ 0.238425] kvm-stealtime: cpu 1, msr 36fa5c040
[ 0.249514] kvm-clock: cpu 2, msr 3:7ff88081, secondary cpu clock
[ 0.249652] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.270061] KVM setup async PF for cpu 2
[ 0.270080] kvm-stealtime: cpu 2, msr 36fa9c040
[ 0.281177] kvm-clock: cpu 3, msr 3:7ff880c1, secondary cpu clock
[ 0.281308] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.301714] KVM setup async PF for cpu 3
[ 0.301732] kvm-stealtime: cpu 3, msr 36fadc040
[ 0.312825] kvm-clock: cpu 4, msr 3:7ff88101, secondary cpu clock
[ 0.312954] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.333363] KVM setup async PF for cpu 4
[ 0.333382] kvm-stealtime: cpu 4, msr 36fb1c040
[ 0.344479] kvm-clock: cpu 5, msr 3:7ff88141, secondary cpu clock
[ 0.344606] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.365014] KVM setup async PF for cpu 5
[ 0.365032] kvm-stealtime: cpu 5, msr 36fb5c040
[ 0.376119] kvm-clock: cpu 6, msr 3:7ff88181, secondary cpu clock
[ 0.376247] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.396661] KVM setup async PF for cpu 6
[ 0.396679] kvm-stealtime: cpu 6, msr 36fb9c040
[ 0.407770] kvm-clock: cpu 7, msr 3:7ff881c1, secondary cpu clock
[ 0.407900] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.428306] KVM setup async PF for cpu 7
[ 0.428325] kvm-stealtime: cpu 7, msr 36fbdc040
[ 0.439417] kvm-clock: cpu 8, msr 3:7ff88201, secondary cpu clock
[ 0.439546] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.459951] KVM setup async PF for cpu 8
[ 0.459969] kvm-stealtime: cpu 8, msr 36fc1c040
[ 0.471058] kvm-clock: cpu 9, msr 3:7ff88241, secondary cpu clock
[ 0.471188] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.491590] KVM setup async PF for cpu 9
[ 0.491608] kvm-stealtime: cpu 9, msr 36fc5c040
[ 0.502711] kvm-clock: cpu 10, msr 3:7ff88281, secondary cpu clock
[ 0.502845] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.523245] KVM setup async PF for cpu 10
[ 0.523267] kvm-stealtime: cpu 10, msr 36fc9c040
[ 0.534351] kvm-clock: cpu 11, msr 3:7ff882c1, secondary cpu clock
[ 0.534481] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.554883] KVM setup async PF for cpu 11
[ 0.554903] kvm-stealtime: cpu 11, msr 36fcdc040
[ 0.566017] kvm-clock: cpu 12, msr 3:7ff88301, secondary cpu clock
[ 0.566189] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.586645] KVM setup async PF for cpu 12
[ 0.586679] kvm-stealtime: cpu 12, msr 36fd1c040
[ 0.597745] kvm-clock: cpu 13, msr 3:7ff88341, secondary cpu clock
[ 0.597874] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.618281] KVM setup async PF for cpu 13
[ 0.618299] kvm-stealtime: cpu 13, msr 36fd5c040
[ 0.629390] kvm-clock: cpu 14, msr 3:7ff88381, secondary cpu clock
[ 0.629525] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.649931] KVM setup async PF for cpu 14
[ 0.649947] kvm-stealtime: cpu 14, msr 36fd9c040
[ 0.661050] kvm-clock: cpu 15, msr 3:7ff883c1, secondary cpu clock
[ 0.661186] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.681582] KVM setup async PF for cpu 15
[ 0.681603] kvm-stealtime: cpu 15, msr 36fddc040
[ 0.692688] kvm-clock: cpu 16, msr 3:7ff88401, secondary cpu clock
[ 0.692816] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.713223] KVM setup async PF for cpu 16
[ 0.713240] kvm-stealtime: cpu 16, msr 36fe1c040
[ 0.724350] kvm-clock: cpu 17, msr 3:7ff88441, secondary cpu clock
[ 0.724490] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.744884] KVM setup async PF for cpu 17
[ 0.744915] kvm-stealtime: cpu 17, msr 36fe5c040
[ 0.755991] kvm-clock: cpu 18, msr 3:7ff88481, secondary cpu clock
[ 0.756123] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.776529] KVM setup async PF for cpu 18
[ 0.776548] kvm-stealtime: cpu 18, msr 36fe9c040
[ 0.787644] kvm-clock: cpu 19, msr 3:7ff884c1, secondary cpu clock
[ 0.787775] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.808178] KVM setup async PF for cpu 19
[ 0.808196] kvm-stealtime: cpu 19, msr 36fedc040
[ 0.819300] kvm-clock: cpu 20, msr 3:7ff88501, secondary cpu clock
[ 0.819438] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.839839] KVM setup async PF for cpu 20
[ 0.839861] kvm-stealtime: cpu 20, msr 36ff1c040
[ 0.850941] kvm-clock: cpu 21, msr 3:7ff88541, secondary cpu clock
[ 0.851074] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.871476] KVM setup async PF for cpu 21
[ 0.871495] kvm-stealtime: cpu 21, msr 36ff5c040
[ 0.882588] kvm-clock: cpu 22, msr 3:7ff88581, secondary cpu clock
[ 0.882720] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.903128] KVM setup async PF for cpu 22
[ 0.903146] kvm-stealtime: cpu 22, msr 36ff9c040
[ 0.914236] kvm-clock: cpu 23, msr 3:7ff885c1, secondary cpu clock
[ 0.914365] x86/cpu: Activated the Intel User Mode Instruction Prevention (UMIP) CPU feature
[ 0.206770] smpboot: Booting Node 0, Processors #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21 #22 #23
[ 0.934762] Brought up 24 CPUs
[ 0.934771] smpboot: Max logical packages: 240
[ 0.934774] KVM setup async PF for cpu 23
[ 0.934775] smpboot: Total of 24 processors activated (115199.90 BogoMIPS)
[ 0.934789] kvm-stealtime: cpu 23, msr 36ffdc040
[ 0.968262] node 0 initialised, 2038568 pages in 32ms
[ 0.968662] devtmpfs: initialized
[ 0.971108] EVM: security.selinux
[ 0.971111] EVM: security.ima
[ 0.971112] EVM: security.capability
-----Original Message-----
From: Bjorn Helgaas <helgaas@kernel.org>
Sent: Friday, December 9, 2022 12:56 PM
To: Kallol Biswas [C] <kallol.biswas@nutanix.com>
Cc: linux-pci@vger.kernel.org
Subject: Re: uefi secureboot vm and IO window overlap
Hi Kallol,
On Fri, Dec 09, 2022 at 06:44:42PM +0000, Kallol Biswas [C] wrote:
> We are observing an io window overlap issue in a secureboot enabled uefi vm.
>
> Linux displays:
> pci 0000:00:1d.0: can't claim BAR 4 [io 0x92a0-0x92bf]: address
> conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
>
> Eventually conflict gets resolved but we need to understand why get the conflict in the first place.
>
> Details:
>
> The VM is a uefi based VM and the issue shows up if secure boot is
> enabled. We have enabled ovmf log and uefi/ovmf programs a bridge IO
> window with the range 0x9000-0x91ff, but in Linux we see the same
> bridge is programmed with 0x9000-0x9fff. This results in an address
> conflict with subsequent devices.
Linux normally doesn't reassign bridge windows if the existing configuration (typically from firmware) works.
Booting with "pci=earlydump" should dump the config before Linux touches anything.
I see your response about being able to reproduce it where it's easier to debug. If you need more help, please include the complete dmesg log so we can see what's happening.
Bjorn
^ permalink raw reply [flat|nested] 10+ messages in thread
* RE: uefi secureboot vm and IO window overlap
2022-12-09 20:56 ` Bjorn Helgaas
2022-12-10 17:45 ` Kallol Biswas [C]
@ 2022-12-10 17:46 ` Kallol Biswas [C]
1 sibling, 0 replies; 10+ messages in thread
From: Kallol Biswas [C] @ 2022-12-10 17:46 UTC (permalink / raw)
To: Bjorn Helgaas; +Cc: linux-pci@vger.kernel.org
Part2 of the dmesg:
[ 0.971206] PM: Registering ACPI NVS region [mem 0x7b37f000-0x7b3fefff] (524288 bytes)
[ 0.972217] atomic64 test passed for x86-64 platform with CX8 and with SSE
[ 0.972221] pinctrl core: initialized pinctrl subsystem
[ 0.972335] RTC time: 22:21:18, date: 12/09/22
[ 0.972479] NET: Registered protocol family 16
[ 0.972981] ACPI: bus type PCI registered
[ 0.972984] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 0.973212] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xb0000000-0xbfffffff] (base 0xb0000000)
[ 0.973217] PCI: MMCONFIG at [mem 0xb0000000-0xbfffffff] reserved in E820
[ 0.973225] PCI: Using configuration type 1 for base access
[ 0.979542] ACPI: Added _OSI(Module Device)
[ 0.979545] ACPI: Added _OSI(Processor Device)
[ 0.979547] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 0.979549] ACPI: Added _OSI(Processor Aggregator Device)
[ 0.979551] ACPI: Added _OSI(Linux-Dell-Video)
[ 0.982203] ACPI: EC: Look up EC in DSDT
[ 0.988952] ACPI: Interpreter enabled
[ 0.988962] ACPI: (supports S0 S5)
[ 0.988964] ACPI: Using IOAPIC for interrupt routing
[ 0.988985] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 0.989055] ACPI: Enabled 3 GPEs in block 00 to 3F
[ 1.027331] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[ 1.027337] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 1.027410] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME AER PCIeCapability]
[ 1.027532] PCI host bridge to bus 0000:00
[ 1.027535] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 1.027537] pci_bus 0000:00: root bus resource [io 0x0d00-0xffff window]
[ 1.027540] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 1.027543] pci_bus 0000:00: root bus resource [mem 0x80000000-0xafffffff window]
[ 1.027546] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xfebfffff window]
[ 1.027550] pci_bus 0000:00: root bus resource [mem 0x84000000000-0x847ffffffff window]
[ 1.027553] pci_bus 0000:00: root bus resource [bus 00-ff]
[ 1.027586] pci 0000:00:00.0: [8086:29c0] type 00 class 0x060000
[ 1.027923] pci 0000:00:01.0: [1234:1111] type 00 class 0x030000
[ 1.029771] pci 0000:00:01.0: reg 0x10: [mem 0xc0000000-0xc0ffffff pref]
[ 1.032365] pci 0000:00:01.0: reg 0x18: [mem 0xc1646000-0xc1646fff]
[ 1.037370] pci 0000:00:01.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 1.037561] pci 0000:00:02.0: [1b36:000c] type 01 class 0x060400
[ 1.038683] pci 0000:00:02.0: reg 0x10: [mem 0xc1645000-0xc1645fff]
[ 1.041333] pci 0000:00:02.1: [1b36:000c] type 01 class 0x060400
[ 1.042160] pci 0000:00:02.1: reg 0x10: [mem 0xc1644000-0xc1644fff]
[ 1.044256] pci 0000:00:02.2: [1b36:000c] type 01 class 0x060400
[ 1.045132] pci 0000:00:02.2: reg 0x10: [mem 0xc1643000-0xc1643fff]
[ 1.047264] pci 0000:00:03.0: [1af4:1000] type 00 class 0x020000
[ 1.048660] pci 0000:00:03.0: reg 0x10: [io 0x82c0-0x82df]
[ 1.050053] pci 0000:00:03.0: reg 0x14: [mem 0xc1642000-0xc1642fff]
[ 1.053606] pci 0000:00:03.0: reg 0x20: [mem 0x84000200000-0x84000203fff 64bit pref]
[ 1.054555] pci 0000:00:03.0: reg 0x30: [mem 0xfffc0000-0xffffffff pref]
[ 1.055180] pci 0000:00:1d.0: [8086:2934] type 00 class 0x0c0300
[ 1.057124] pci 0000:00:1d.0: reg 0x20: [io 0x82a0-0x82bf]
[ 1.058008] pci 0000:00:1d.1: [8086:2935] type 00 class 0x0c0300
[ 1.060291] pci 0000:00:1d.1: reg 0x20: [io 0x8280-0x829f]
[ 1.062049] pci 0000:00:1d.2: [8086:2936] type 00 class 0x0c0300
[ 1.063856] pci 0000:00:1d.2: reg 0x20: [io 0x8260-0x827f]
[ 1.064697] pci 0000:00:1d.7: [8086:293a] type 00 class 0x0c0320
[ 1.065087] pci 0000:00:1d.7: reg 0x10: [mem 0xc1641000-0xc1641fff]
[ 1.067311] pci 0000:00:1f.0: [8086:2918] type 00 class 0x060100
[ 1.067694] pci 0000:00:1f.0: quirk: [io 0x0600-0x067f] claimed by ICH6 ACPI/GPIO/TCO
[ 1.067872] pci 0000:00:1f.2: [8086:2922] type 00 class 0x010601
[ 1.071400] pci 0000:00:1f.2: reg 0x20: [io 0x8240-0x825f]
[ 1.072956] pci 0000:00:1f.2: reg 0x24: [mem 0xc1640000-0xc1640fff]
[ 1.073880] pci 0000:00:1f.3: [8086:2930] type 00 class 0x0c0500
[ 1.074144] pci 0000:00:1f.3: reg 0x20: [io 0x8200-0x823f]
[ 1.074837] pci 0000:01:00.0: [1af4:1048] type 00 class 0x010000
[ 1.076178] pci 0000:01:00.0: reg 0x14: [mem 0xc1400000-0xc1400fff]
[ 1.078151] pci 0000:01:00.0: reg 0x20: [mem 0x84000000000-0x84000003fff 64bit pref]
[ 1.079523] pci 0000:00:02.0: PCI bridge to [bus 01]
[ 1.079541] pci 0000:00:02.0: bridge window [io 0x8000-0x8fff]
[ 1.079556] pci 0000:00:02.0: bridge window [mem 0xc1400000-0xc15fffff]
[ 1.079584] pci 0000:00:02.0: bridge window [mem 0x84000000000-0x840000fffff 64bit pref]
[ 1.080227] pci 0000:02:00.0: [1af4:1045] type 00 class 0x00ff00
[ 1.082135] pci 0000:02:00.0: reg 0x20: [mem 0x84000100000-0x84000103fff 64bit pref]
[ 1.083830] pci 0000:00:02.1: PCI bridge to [bus 02]
[ 1.083847] pci 0000:00:02.1: bridge window [io 0x7000-0x7fff]
[ 1.083861] pci 0000:00:02.1: bridge window [mem 0xc1200000-0xc13fffff]
[ 1.083890] pci 0000:00:02.1: bridge window [mem 0x84000100000-0x840001fffff 64bit pref]
[ 1.084447] pci 0000:00:02.2: PCI bridge to [bus 03]
[ 1.084464] pci 0000:00:02.2: bridge window [io 0x6000-0x6fff]
[ 1.084479] pci 0000:00:02.2: bridge window [mem 0xc1000000-0xc11fffff]
[ 1.086391] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
[ 1.086452] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
[ 1.086508] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
[ 1.086563] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
[ 1.086620] ACPI: PCI Interrupt Link [LNKE] (IRQs 5 *10 11)
[ 1.086680] ACPI: PCI Interrupt Link [LNKF] (IRQs 5 *10 11)
[ 1.086733] ACPI: PCI Interrupt Link [LNKG] (IRQs 5 10 *11)
[ 1.086788] ACPI: PCI Interrupt Link [LNKH] (IRQs 5 10 *11)
[ 1.086813] ACPI: PCI Interrupt Link [GSIA] (IRQs *16)
[ 1.086821] ACPI: PCI Interrupt Link [GSIB] (IRQs *17)
[ 1.086827] ACPI: PCI Interrupt Link [GSIC] (IRQs *18)
[ 1.086834] ACPI: PCI Interrupt Link [GSID] (IRQs *19)
[ 1.086841] ACPI: PCI Interrupt Link [GSIE] (IRQs *20)
[ 1.086848] ACPI: PCI Interrupt Link [GSIF] (IRQs *21)
[ 1.086854] ACPI: PCI Interrupt Link [GSIG] (IRQs *22)
[ 1.086861] ACPI: PCI Interrupt Link [GSIH] (IRQs *23)
[ 1.096292] vgaarb: device added: PCI:0000:00:01.0,decodes=io+mem,owns=io+mem,locks=none
[ 1.096297] vgaarb: loaded
[ 1.096299] vgaarb: bridge control possible 0000:00:01.0
[ 1.096498] SCSI subsystem initialized
[ 1.096518] ACPI: bus type USB registered
[ 1.096533] usbcore: registered new interface driver usbfs
[ 1.096541] usbcore: registered new interface driver hub
[ 1.096804] usbcore: registered new device driver usb
[ 1.097217] EDAC MC: Ver: 3.0.0
[ 1.097604] PCI: Using ACPI for IRQ routing
[ 1.152296] PCI: pci_cache_line_size set to 64 bytes
[ 1.152358] pci 0000:00:03.0: can't claim BAR 0 [io 0x82c0-0x82df]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 1.152371] pci 0000:00:1d.0: can't claim BAR 4 [io 0x82a0-0x82bf]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 1.152382] pci 0000:00:1d.1: can't claim BAR 4 [io 0x8280-0x829f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 1.152393] pci 0000:00:1d.2: can't claim BAR 4 [io 0x8260-0x827f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 1.152418] pci 0000:00:1f.2: can't claim BAR 4 [io 0x8240-0x825f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 1.152429] pci 0000:00:1f.3: can't claim BAR 4 [io 0x8200-0x823f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 1.152536] e820: reserve RAM buffer [mem 0x79348018-0x7bffffff]
[ 1.152539] e820: reserve RAM buffer [mem 0x795e0018-0x7bffffff]
[ 1.152540] e820: reserve RAM buffer [mem 0x7a052000-0x7bffffff]
[ 1.152542] e820: reserve RAM buffer [mem 0x7b0ef000-0x7bffffff]
[ 1.152543] e820: reserve RAM buffer [mem 0x7ff7c000-0x7fffffff]
[ 1.152786] NetLabel: Initializing
[ 1.152788] NetLabel: domain hash size = 128
[ 1.152790] NetLabel: protocols = UNLABELED CIPSOv4
[ 1.152804] NetLabel: unlabeled traffic allowed by default
[ 1.153048] amd_nb: Cannot enumerate AMD northbridges
[ 1.153191] Switched to clocksource kvm-clock
[ 1.158706] pnp: PnP ACPI init
[ 1.158716] ACPI: bus type PNP registered
[ 1.158773] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 1.158809] pnp 00:01: Plug and Play ACPI device, IDs PNP0303 (active)
[ 1.158835] pnp 00:02: Plug and Play ACPI device, IDs PNP0f13 (active)
[ 1.159239] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[ 1.163807] pnp: PnP ACPI: found 4 devices
[ 1.163810] ACPI: bus type PNP unregistered
[ 1.170404] pci 0000:00:01.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 1.170410] pci 0000:00:03.0: can't claim BAR 6 [mem 0xfffc0000-0xffffffff pref]: no compatible bridge window
[ 1.172145] pci 0000:00:02.2: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 03] add_size 200000 add_align 100000
[ 1.172153] pci 0000:00:02.2: res[15]=[mem 0x00100000-0x000fffff 64bit pref] res_to_dev_res add_size 200000 min_align 100000
[ 1.172155] pci 0000:00:02.2: res[15]=[mem 0x00100000-0x002fffff 64bit pref] res_to_dev_res add_size 200000 min_align 100000
[ 1.172160] pci 0000:00:02.2: BAR 15: assigned [mem 0x84000300000-0x840004fffff 64bit pref]
[ 1.172165] pci 0000:00:03.0: BAR 6: assigned [mem 0x80000000-0x8003ffff pref]
[ 1.172175] pci 0000:00:01.0: BAR 6: assigned [mem 0x80040000-0x8004ffff pref]
[ 1.172179] pci 0000:00:1f.3: BAR 4: assigned [io 0x1000-0x103f]
[ 1.172199] pci 0000:00:03.0: BAR 0: assigned [io 0x1040-0x105f]
[ 1.172678] pci 0000:00:1d.0: BAR 4: assigned [io 0x1060-0x107f]
[ 1.173149] pci 0000:00:1d.1: BAR 4: assigned [io 0x1080-0x109f]
[ 1.173637] pci 0000:00:1d.2: BAR 4: assigned [io 0x10a0-0x10bf]
[ 1.174102] pci 0000:00:1f.2: BAR 4: assigned [io 0x10c0-0x10df]
[ 1.174567] pci 0000:00:02.0: PCI bridge to [bus 01]
[ 1.174577] pci 0000:00:02.0: bridge window [io 0x8000-0x8fff]
[ 1.175344] pci 0000:00:02.0: bridge window [mem 0xc1400000-0xc15fffff]
[ 1.175847] pci 0000:00:02.0: bridge window [mem 0x84000000000-0x840000fffff 64bit pref]
[ 1.176856] pci 0000:00:02.1: PCI bridge to [bus 02]
[ 1.176868] pci 0000:00:02.1: bridge window [io 0x7000-0x7fff]
[ 1.177626] pci 0000:00:02.1: bridge window [mem 0xc1200000-0xc13fffff]
[ 1.178132] pci 0000:00:02.1: bridge window [mem 0x84000100000-0x840001fffff 64bit pref]
[ 1.179179] pci 0000:00:02.2: PCI bridge to [bus 03]
[ 1.179191] pci 0000:00:02.2: bridge window [io 0x6000-0x6fff]
[ 1.179960] pci 0000:00:02.2: bridge window [mem 0xc1000000-0xc11fffff]
[ 1.180468] pci 0000:00:02.2: bridge window [mem 0x84000300000-0x840004fffff 64bit pref]
[ 1.182012] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 1.182014] pci_bus 0000:00: resource 5 [io 0x0d00-0xffff window]
[ 1.182015] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 1.182016] pci_bus 0000:00: resource 7 [mem 0x80000000-0xafffffff window]
[ 1.182017] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xfebfffff window]
[ 1.182018] pci_bus 0000:00: resource 9 [mem 0x84000000000-0x847ffffffff window]
[ 1.182019] pci_bus 0000:01: resource 0 [io 0x8000-0x8fff]
[ 1.182020] pci_bus 0000:01: resource 1 [mem 0xc1400000-0xc15fffff]
[ 1.182021] pci_bus 0000:01: resource 2 [mem 0x84000000000-0x840000fffff 64bit pref]
[ 1.182022] pci_bus 0000:02: resource 0 [io 0x7000-0x7fff]
[ 1.182023] pci_bus 0000:02: resource 1 [mem 0xc1200000-0xc13fffff]
[ 1.182024] pci_bus 0000:02: resource 2 [mem 0x84000100000-0x840001fffff 64bit pref]
[ 1.182025] pci_bus 0000:03: resource 0 [io 0x6000-0x6fff]
[ 1.182026] pci_bus 0000:03: resource 1 [mem 0xc1000000-0xc11fffff]
[ 1.182027] pci_bus 0000:03: resource 2 [mem 0x84000300000-0x840004fffff 64bit pref]
[ 1.182140] NET: Registered protocol family 2
[ 1.182885] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
[ 1.183081] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 1.183238] TCP: Hash tables configured (established 131072 bind 65536)
[ 1.183259] TCP: reno registered
[ 1.183288] UDP hash table entries: 8192 (order: 6, 262144 bytes)
[ 1.183342] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
[ 1.183813] NET: Registered protocol family 1
[ 1.183853] pci 0000:00:01.0: Boot video device
[ 1.184145] ACPI: PCI Interrupt Link [GSIA] enabled at IRQ 16
[ 1.184912] ACPI: PCI Interrupt Link [GSIB] enabled at IRQ 17
[ 1.185617] ACPI: PCI Interrupt Link [GSIC] enabled at IRQ 18
[ 1.186311] ACPI: PCI Interrupt Link [GSID] enabled at IRQ 19
[ 1.186872] PCI: CLS 0 bytes, default 64
[ 1.186909] Unpacking initramfs...
[ 1.550502] Freeing initrd memory: 31004k freed
[ 1.556219] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 1.556225] software IO TLB [mem 0x73fdf000-0x77fdf000] (64MB) mapped at [ffff957773fdf000-ffff957777fdefff]
[ 1.558423] sha1_ssse3: Using SHA-NI optimized SHA-1 implementation
[ 1.558475] sha256_ssse3: Using SHA-256-NI optimized SHA-256 implementation
[ 1.560662] futex hash table entries: 65536 (order: 10, 4194304 bytes)
[ 1.561221] Initialise system trusted keyring
[ 1.561267] audit: initializing netlink socket (disabled)
[ 1.561279] type=2000 audit(1670624479.968:1): initialized
[ 1.582873] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[ 1.582876] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 1.583943] zpool: loaded
[ 1.583947] zbud: loaded
[ 1.584207] VFS: Disk quotas dquot_6.5.2
[ 1.584323] Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 1.584710] msgmni has been set to 23622
[ 1.584804] Key type big_key registered
[ 1.584807] SELinux: Registering netfilter hooks
[ 1.587358] NET: Registered protocol family 38
[ 1.587366] Key type asymmetric registered
[ 1.587370] Asymmetric key parser 'x509' registered
[ 1.587422] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[ 1.587606] io scheduler noop registered
[ 1.587609] io scheduler deadline registered (default)
[ 1.587660] io scheduler cfq registered
[ 1.587664] io scheduler mq-deadline registered
[ 1.587668] io scheduler kyber registered
[ 1.588035] ACPI: PCI Interrupt Link [GSIG] enabled at IRQ 22
[ 1.588283] pcieport 0000:00:02.0: irq 24 for MSI/MSI-X
[ 1.589383] pcieport 0000:00:02.1: irq 25 for MSI/MSI-X
[ 1.590369] pcieport 0000:00:02.2: irq 26 for MSI/MSI-X
[ 1.591091] aer 0000:00:02.0:pcie002: service driver aer loaded
[ 1.591209] aer 0000:00:02.1:pcie002: service driver aer loaded
[ 1.591320] aer 0000:00:02.2:pcie002: service driver aer loaded
[ 1.591358] pcieport 0000:00:02.0: Signaling PME through PCIe PME interrupt
[ 1.591360] pci 0000:01:00.0: Signaling PME through PCIe PME interrupt
[ 1.591377] pcie_pme 0000:00:02.0:pcie001: service driver pcie_pme loaded
[ 1.591408] pcieport 0000:00:02.1: Signaling PME through PCIe PME interrupt
[ 1.591410] pci 0000:02:00.0: Signaling PME through PCIe PME interrupt
[ 1.591426] pcie_pme 0000:00:02.1:pcie001: service driver pcie_pme loaded
[ 1.591456] pcieport 0000:00:02.2: Signaling PME through PCIe PME interrupt
[ 1.591472] pcie_pme 0000:00:02.2:pcie001: service driver pcie_pme loaded
[ 1.591484] pci_hotplug: PCI Hot Plug PCI Core version: 0.5
[ 1.591513] pciehp 0000:00:02.0:pcie004: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[ 1.591606] pciehp 0000:00:02.0:pcie004: service driver pciehp loaded
[ 1.591636] pciehp 0000:00:02.1:pcie004: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[ 1.591716] pciehp 0000:00:02.1:pcie004: service driver pciehp loaded
[ 1.591740] pciehp 0000:00:02.2:pcie004: Slot #0 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise+ Interlock+ NoCompl- LLActRep+
[ 1.591817] pciehp 0000:00:02.2:pcie004: service driver pciehp loaded
[ 1.591820] pciehp: PCI Express Hot Plug Controller Driver version: 0.4
[ 1.591833] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 1.591893] efifb: probing for efifb
[ 1.591902] efifb: framebuffer at 0xc0000000, mapped to 0xffffa4b7c2000000, using 5120k, total 5120k
[ 1.591906] efifb: mode is 1280x1024x32, linelength=5120, pages=1
[ 1.591908] efifb: scrolling: redraw
[ 1.591910] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[ 1.595551] Console: switching to colour frame buffer device 160x64
[ 1.597550] fb0: EFI VGA frame buffer device
[ 1.597688] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 1.597709] ACPI: Power Button [PWRF]
[ 1.598249] GHES: HEST is not enabled!
[ 1.598319] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[ 1.621318] 00:03: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
[ 1.621761] Non-volatile memory driver v1.3
[ 1.621801] Linux agpgart interface v0.103
[ 1.621912] crash memory driver: version 1.1
[ 1.622034] rdac: device handler registered
[ 1.622077] hp_sw: device handler registered
[ 1.622089] emc: device handler registered
[ 1.622301] alua: device handler registered
[ 1.622338] libphy: Fixed MDIO Bus: probed
[ 1.622384] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 1.622403] ehci-pci: EHCI PCI platform driver
[ 1.623018] ehci-pci 0000:00:1d.7: EHCI Host Controller
[ 1.623074] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 1
[ 1.623259] ehci-pci 0000:00:1d.7: irq 19, io mem 0xc1641000
[ 1.629193] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[ 1.629243] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 1.629260] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 1.629278] usb usb1: Product: EHCI Host Controller
[ 1.629291] usb usb1: Manufacturer: Linux 3.10.0-957.el7.x86_64 ehci_hcd
[ 1.629307] usb usb1: SerialNumber: 0000:00:1d.7
[ 1.629412] hub 1-0:1.0: USB hub found
[ 1.629425] hub 1-0:1.0: 6 ports detected
[ 1.629572] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 1.629591] ohci-pci: OHCI PCI platform driver
[ 1.629608] uhci_hcd: USB Universal Host Controller Interface driver
[ 1.630201] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[ 1.630259] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 1.630292] uhci_hcd 0000:00:1d.0: detected 2 ports
[ 1.630372] uhci_hcd 0000:00:1d.0: irq 16, io base 0x00001060
[ 1.631072] usb usb2: New USB device found, idVendor=1d6b, idProduct=0001
[ 1.631732] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 1.632376] usb usb2: Product: UHCI Host Controller
[ 1.632997] usb usb2: Manufacturer: Linux 3.10.0-957.el7.x86_64 uhci_hcd
[ 1.633648] usb usb2: SerialNumber: 0000:00:1d.0
[ 1.634348] hub 2-0:1.0: USB hub found
[ 1.634980] hub 2-0:1.0: 2 ports detected
[ 1.636264] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[ 1.636924] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 3
[ 1.637570] uhci_hcd 0000:00:1d.1: detected 2 ports
[ 1.638243] uhci_hcd 0000:00:1d.1: irq 17, io base 0x00001080
[ 1.642738] usb usb3: New USB device found, idVendor=1d6b, idProduct=0001
[ 1.643674] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 1.644275] usb usb3: Product: UHCI Host Controller
[ 1.644857] usb usb3: Manufacturer: Linux 3.10.0-957.el7.x86_64 uhci_hcd
[ 1.645452] usb usb3: SerialNumber: 0000:00:1d.1
[ 1.646116] hub 3-0:1.0: USB hub found
[ 1.646717] hub 3-0:1.0: 2 ports detected
[ 1.647874] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[ 1.648503] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 4
[ 1.649076] uhci_hcd 0000:00:1d.2: detected 2 ports
[ 1.649731] uhci_hcd 0000:00:1d.2: irq 18, io base 0x000010a0
[ 1.650353] usb usb4: New USB device found, idVendor=1d6b, idProduct=0001
[ 1.650906] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 1.651484] usb usb4: Product: UHCI Host Controller
[ 1.652037] usb usb4: Manufacturer: Linux 3.10.0-957.el7.x86_64 uhci_hcd
[ 1.652606] usb usb4: SerialNumber: 0000:00:1d.2
[ 1.653252] hub 4-0:1.0: USB hub found
[ 1.653802] hub 4-0:1.0: 2 ports detected
[ 1.654457] usbcore: registered new interface driver usbserial_generic
[ 1.655012] usbserial: USB Serial support registered for generic
[ 1.655605] i8042: PNP: PS/2 Controller [PNP0303:KBD,PNP0f13:MOU] at 0x60,0x64 irq 1,12
[ 1.656784] serio: i8042 KBD port at 0x60,0x64 irq 1
[ 1.657358] serio: i8042 AUX port at 0x60,0x64 irq 12
[ 1.658002] mousedev: PS/2 mouse device common for all mice
[ 1.658828] input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input1
[ 1.659599] rtc_cmos 00:00: RTC can wake from S4
[ 1.659975] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input2
[ 1.660197] input: VirtualPS/2 VMware VMMouse as /devices/platform/i8042/serio1/input/input3
[ 1.661622] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[ 1.662299] rtc_cmos 00:00: alarms up to one day, y3k, 114 bytes nvram
[ 1.662935] cpuidle: using governor menu
[ 1.664025] EFI Variables Facility v0.08 2004-May-17
[ 1.664890] hidraw: raw HID events driver (C) Jiri Kosina
[ 1.665602] usbcore: registered new interface driver usbhid
[ 1.666209] usbhid: USB HID core driver
[ 1.666888] drop_monitor: Initializing network drop monitor service
[ 1.667749] TCP: cubic registered
[ 1.668351] Initializing XFRM netlink socket
[ 1.669283] NET: Registered protocol family 10
[ 1.670601] NET: Registered protocol family 17
[ 1.671250] mpls_gso: MPLS GSO support
[ 1.672388] PM: Hibernation image not present or could not be loaded.
[ 1.672391] Loading compiled-in X.509 certificates
[ 1.672997] Loaded X.509 cert 'CentOS Linux kpatch signing key: ea0413152cde1d98ebdca3fe6f0230904c9ef717'
[ 1.673644] Loaded X.509 cert 'CentOS Linux Driver update signing key: 7f421ee0ab69461574bb358861dbe77762a4201b'
[ 1.674569] Loaded X.509 cert 'CentOS Linux kernel signing key: b70dcf0df2d9b7f29159248249fd6fe87b781427'
[ 1.675209] registered taskstats version 1
[ 1.677595] Key type trusted registered
[ 1.679543] Key type encrypted registered
[ 1.680255] IMA: No TPM chip found, activating TPM-bypass! (rc=-19)
[ 1.681441] Magic number: 2:870:400
[ 1.682089] clockevents clockevent113: hash matches
[ 1.682941] rtc_cmos 00:00: setting system clock to 2022-12-09 22:21:19 UTC (1670624479)
[ 1.684430] Freeing unused kernel memory: 1876k freed
[ 1.685403] Write protecting the kernel read-only data: 12288k
[ 1.687079] Freeing unused kernel memory: 516k freed
[ 1.688745] Freeing unused kernel memory: 600k freed
[ 1.692321] random: systemd: uninitialized urandom read (16 bytes read)
[ 1.693441] random: systemd: uninitialized urandom read (16 bytes read)
[ 1.694076] random: systemd: uninitialized urandom read (16 bytes read)
[ 1.696274] systemd[1]: systemd 219 running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 -SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[ 1.697583] systemd[1]: Detected virtualization kvm.
[ 1.698232] systemd[1]: Detected architecture x86-64.
[ 1.698856] systemd[1]: Running in initial RAM disk.
[ 1.701504] systemd[1]: Set hostname to <localhost.localdomain>.
[ 1.720343] random: systemd: uninitialized urandom read (16 bytes read)
[ 1.721015] random: systemd: uninitialized urandom read (16 bytes read)
[ 1.721699] random: systemd: uninitialized urandom read (16 bytes read)
[ 1.722363] random: systemd: uninitialized urandom read (16 bytes read)
[ 1.723401] random: systemd: uninitialized urandom read (16 bytes read)
[ 1.724115] random: systemd: uninitialized urandom read (16 bytes read)
[ 1.724938] random: systemd: uninitialized urandom read (16 bytes read)
[ 1.727878] systemd[1]: Reached target Timers.
[ 1.729301] systemd[1]: Created slice Root Slice.
[ 1.730571] systemd[1]: Created slice System Slice.
[ 1.731823] systemd[1]: Reached target Slices.
[ 1.733088] systemd[1]: Listening on Journal Socket.
[ 1.734713] systemd[1]: Starting Setup Virtual Console...
[ 1.736233] systemd[1]: Starting Journal Service...
[ 1.737727] systemd[1]: Starting Create list of required static device nodes for the current kernel...
[ 1.742442] systemd[1]: Listening on udev Kernel Socket.
[ 1.744094] systemd[1]: Starting dracut cmdline hook...
[ 1.745476] systemd[1]: Reached target Swap.
[ 1.746856] systemd[1]: Listening on udev Control Socket.
[ 1.748242] systemd[1]: Reached target Sockets.
[ 1.749872] systemd[1]: Starting Apply Kernel Variables...
[ 1.751282] systemd[1]: Reached target Local File Systems.
[ 1.752915] systemd[1]: Started Create list of required static device nodes for the current kernel.
[ 1.754593] systemd[1]: Started Apply Kernel Variables.
[ 1.756652] systemd[1]: Starting Create Static Device Nodes in /dev...
[ 1.758475] systemd[1]: Started Create Static Device Nodes in /dev.
[ 1.764949] systemd[1]: Started Journal Service.
[ 1.830416] device-mapper: uevent: version 1.0.3
[ 1.831243] device-mapper: ioctl: 4.37.1-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[ 1.938664] ACPI: PCI Interrupt Link [GSIH] enabled at IRQ 23
[ 1.942364] usb 1-1: new high-speed USB device number 2 using ehci-pci
[ 1.950611] libata version 3.00 loaded.
[ 1.961061] ahci 0000:00:1f.2: version 3.0
[ 1.961929] ahci 0000:00:1f.2: irq 27 for MSI/MSI-X
[ 1.962453] ahci 0000:00:1f.2: AHCI 0001.0000 32 slots 6 ports 1.5 Gbps 0x3f impl SATA mode
[ 1.963670] ahci 0000:00:1f.2: flags: 64bit ncq only
[ 1.966521] scsi host0: ahci
[ 1.967825] scsi host1: ahci
[ 1.969345] scsi host2: ahci
[ 1.970595] scsi host3: ahci
[ 1.971952] scsi host4: ahci
[ 1.974520] scsi host5: ahci
[ 1.975402] ata1: SATA max UDMA/133 abar m4096@0xc1640000 port 0xc1640100 irq 27
[ 1.976138] ata2: SATA max UDMA/133 abar m4096@0xc1640000 port 0xc1640180 irq 27
[ 1.976851] ata3: SATA max UDMA/133 abar m4096@0xc1640000 port 0xc1640200 irq 27
[ 1.977532] ata4: SATA max UDMA/133 abar m4096@0xc1640000 port 0xc1640280 irq 27
[ 1.978193] ata5: SATA max UDMA/133 abar m4096@0xc1640000 port 0xc1640300 irq 27
[ 1.978836] ata6: SATA max UDMA/133 abar m4096@0xc1640000 port 0xc1640380 irq 27
[ 1.987484] checking generic (c0000000 500000) vs hw (c0000000 1000000)
[ 1.987487] fb: conflicting fb hw usage bochsdrmfb vs EFI VGA - removing generic driver
[ 1.988193] Console: switching to colour dummy device 80x25
[ 1.989025] [drm] Found bochs VGA, ID 0xb0c5.
[ 1.989030] [drm] Framebuffer size 16384 kB @ 0xc0000000, mmio @ 0xc1646000.
[ 1.989817] [TTM] Zone kernel: Available graphics memory: 6048982 kiB
[ 1.989820] [TTM] Zone dma32: Available graphics memory: 2097152 kiB
[ 1.989823] [TTM] Initializing pool allocator
[ 1.989828] [TTM] Initializing DMA pool allocator
[ 1.990483] fbcon: bochsdrmfb (fb0) is primary device
[ 1.992331] Console: switching to colour frame buffer device 128x48
[ 1.994571] bochs-drm 0000:00:01.0: fb0: bochsdrmfb frame buffer device
[ 2.003519] virtio-pci 0000:00:03.0: irq 28 for MSI/MSI-X
[ 2.003556] virtio-pci 0000:00:03.0: irq 29 for MSI/MSI-X
[ 2.003591] virtio-pci 0000:00:03.0: irq 30 for MSI/MSI-X
[ 2.003704] virtio-pci 0000:01:00.0: irq 31 for MSI/MSI-X
[ 2.003738] virtio-pci 0000:01:00.0: irq 32 for MSI/MSI-X
[ 2.003771] virtio-pci 0000:01:00.0: irq 33 for MSI/MSI-X
[ 2.003804] virtio-pci 0000:01:00.0: irq 34 for MSI/MSI-X
[ 2.003834] virtio-pci 0000:01:00.0: irq 35 for MSI/MSI-X
[ 2.003869] virtio-pci 0000:01:00.0: irq 36 for MSI/MSI-X
[ 2.003904] virtio-pci 0000:01:00.0: irq 37 for MSI/MSI-X
[ 2.006348] virtio-pci 0000:01:00.0: irq 38 for MSI/MSI-X
[ 2.006395] virtio-pci 0000:01:00.0: irq 39 for MSI/MSI-X
[ 2.006430] virtio-pci 0000:01:00.0: irq 40 for MSI/MSI-X
[ 2.006465] virtio-pci 0000:01:00.0: irq 41 for MSI/MSI-X
[ 2.006500] virtio-pci 0000:01:00.0: irq 42 for MSI/MSI-X
[ 2.006540] virtio-pci 0000:01:00.0: irq 43 for MSI/MSI-X
[ 2.006575] virtio-pci 0000:01:00.0: irq 44 for MSI/MSI-X
[ 2.006610] virtio-pci 0000:01:00.0: irq 45 for MSI/MSI-X
[ 2.006651] virtio-pci 0000:01:00.0: irq 46 for MSI/MSI-X
[ 2.006688] virtio-pci 0000:01:00.0: irq 47 for MSI/MSI-X
[ 2.006725] virtio-pci 0000:01:00.0: irq 48 for MSI/MSI-X
[ 2.006755] virtio-pci 0000:01:00.0: irq 49 for MSI/MSI-X
[ 2.006800] virtio-pci 0000:01:00.0: irq 50 for MSI/MSI-X
[ 2.006837] virtio-pci 0000:01:00.0: irq 51 for MSI/MSI-X
[ 2.006873] virtio-pci 0000:01:00.0: irq 52 for MSI/MSI-X
[ 2.006909] virtio-pci 0000:01:00.0: irq 53 for MSI/MSI-X
[ 2.006948] virtio-pci 0000:01:00.0: irq 54 for MSI/MSI-X
[ 2.007196] [drm] Initialized bochs-drm 1.0.0 20130925 for 0000:00:01.0 on minor 0
[ 2.007399] virtio-pci 0000:01:00.0: irq 55 for MSI/MSI-X
[ 2.007452] virtio-pci 0000:01:00.0: irq 56 for MSI/MSI-X
[ 2.007492] virtio-pci 0000:01:00.0: irq 57 for MSI/MSI-X
[ 2.010640] scsi host6: Virtio SCSI HBA
[ 2.014282] scsi 6:0:0:0: Direct-Access NUTANIX VDISK 0 PQ: 0 ANSI: 5
[ 2.059819] random: fast init done
[ 2.063697] scsi 6:0:0:0: alua: supports implicit TPGS
[ 2.063714] scsi 6:0:0:0: alua: device naa.6506b8d9a515c50c86dda140aaf608bc port group 1 rel port ffffffff
[ 2.063739] scsi 6:0:0:0: alua: Attached
[ 2.069368] scsi 6:0:0:0: alua: transition timeout set to 60 seconds
[ 2.069388] scsi 6:0:0:0: alua: port group 01 state A preferred supports tolusna
[ 2.074161] usb 1-1: New USB device found, idVendor=0627, idProduct=0001
[ 2.074186] usb 1-1: New USB device strings: Mfr=1, Product=3, SerialNumber=10
[ 2.074205] usb 1-1: Product: QEMU USB Tablet
[ 2.074217] usb 1-1: Manufacturer: QEMU
[ 2.074227] usb 1-1: SerialNumber: 28754-0000:00:1d.7-1
[ 2.075584] input: QEMU QEMU USB Tablet as /devices/pci0000:00/0000:00:1d.7/usb1/1-1/1-1:1.0/input/input4
[ 2.075727] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:1d.7-1/input0
[ 2.284269] ata1: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[ 2.284474] ata2: SATA link down (SStatus 0 SControl 300)
[ 2.284538] ata1.00: ATAPI: QEMU DVD-ROM, 2.5+, max UDMA/100
[ 2.284566] ata1.00: applying bridge limits
[ 2.285533] ata3: SATA link down (SStatus 0 SControl 300)
[ 2.286188] ata4: SATA link down (SStatus 0 SControl 300)
[ 2.286874] ata5: SATA link down (SStatus 0 SControl 300)
[ 2.287392] ata1.00: configured for UDMA/100
[ 2.288006] ata6: SATA link down (SStatus 0 SControl 300)
[ 2.288870] scsi 0:0:0:0: CD-ROM QEMU QEMU DVD-ROM 2.5+ PQ: 0 ANSI: 5
[ 2.309974] sd 6:0:0:0: [sda] 209715200 512-byte logical blocks: (107 GB/100 GiB)
[ 2.310493] sd 6:0:0:0: [sda] 4096-byte physical blocks
[ 2.311694] sd 6:0:0:0: [sda] Write Protect is off
[ 2.312194] sd 6:0:0:0: [sda] Mode Sense: 6f 00 00 00
[ 2.312412] sd 6:0:0:0: [sda] Write cache: disabled, read cache: enabled, doesn't support DPO or FUA
[ 2.316912] sda: sda1 sda2 sda3
[ 2.318465] sr 0:0:0:0: [sr0] scsi3-mmc drive: 4x/4x cd/rw xa/form2 tray
[ 2.319042] cdrom: Uniform CD-ROM driver Revision: 3.20
[ 2.319859] sr 0:0:0:0: Attached scsi CD-ROM sr0
[ 2.319869] sd 6:0:0:0: [sda] Attached SCSI disk
[ 2.558243] tsc: Refined TSC clocksource calibration: 2399.990 MHz
[ 2.560020] SGI XFS with ACLs, security attributes, no debug enabled
[ 2.566336] XFS (dm-0): Mounting V5 Filesystem
[ 2.588682] XFS (dm-0): Ending clean mount
[ 2.783340] systemd-journald[204]: Received SIGTERM from PID 1 (systemd).
[ 2.840814] type=1404 audit(1670624480.657:2): enforcing=1 old_enforcing=0 auid=4294967295 ses=4294967295
[ 2.859338] SELinux: 2048 avtab hash slots, 111767 rules.
[ 2.896099] SELinux: 2048 avtab hash slots, 111767 rules.
[ 2.914737] SELinux: 8 users, 14 roles, 5032 types, 315 bools, 1 sens, 1024 cats
[ 2.914740] SELinux: 129 classes, 111767 rules
[ 2.917198] SELinux: Class bpf not defined in policy.
[ 2.917869] SELinux: the above unknown classes and permissions will be allowed
[ 2.918286] SELinux: Completing initialization.
[ 2.918287] SELinux: Setting up existing superblocks.
[ 2.927056] type=1403 audit(1670624480.743:3): policy loaded auid=4294967295 ses=4294967295
[ 2.932468] systemd[1]: Successfully loaded SELinux policy in 91.490ms.
[ 2.961463] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 2.962079] systemd[1]: Inserted module 'ip_tables'
[ 2.975693] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 11.447ms.
[ 3.149451] systemd-journald[3611]: Received request to flush runtime journal from PID 1
[ 3.377181] input: PC Speaker as /devices/platform/pcspkr/input/input5
[ 3.383147] i801_smbus 0000:00:1f.3: Enabling SMBus device
[ 3.384270] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[ 3.390433] lpc_ich 0000:00:1f.0: I/O space for GPIO uninitialized
[ 3.398419] sd 6:0:0:0: Attached scsi generic sg0 type 0
[ 3.399408] sr 0:0:0:0: Attached scsi generic sg1 type 5
[ 3.450533] random: crng init done
[ 3.465047] iTCO_vendor_support: vendor-support=0
[ 3.467307] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[ 3.468387] iTCO_wdt: Found a ICH9 TCO device (Version=2, TCOBASE=0x0660)
[ 3.469695] ppdev: user-space parallel port driver
[ 3.469802] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[ 3.471357] cryptd: max_cpu_qlen set to 1000
[ 3.483460] AVX2 version of gcm_enc/dec engaged.
[ 3.483968] AES CTR mode by8 optimization enabled
[ 3.487473] alg: No test for __gcm-aes-aesni (__driver-gcm-aes-aesni)
[ 3.488065] alg: No test for __generic-gcm-aes-aesni (__driver-generic-gcm-aes-aesni)
[ 3.497458] Adding 6160380k swap on /dev/mapper/centos-swap. Priority:-2 extents:1 across:6160380k FS
[ 3.507568] XFS (sda2): Mounting V5 Filesystem
[ 3.514219] XFS (dm-2): Mounting V5 Filesystem
[ 3.522718] XFS (sda2): Ending clean mount
[ 3.563636] XFS (dm-2): Ending clean mount
[ 3.643722] type=1305 audit(1670624481.460:4): audit_pid=6878 old=0 auid=4294967295 ses=4294967295 subj=system_u:system_r:auditd_t:s0 res=1
[ 3.646170] RPC: Registered named UNIX socket transport module.
[ 3.646719] RPC: Registered udp transport module.
[ 3.647248] RPC: Registered tcp transport module.
[ 3.647751] RPC: Registered tcp NFSv4.1 backchannel transport module.
[ 4.237393] ip6_tables: (C) 2000-2006 Netfilter Core Team
[ 4.272117] Ebtables v2.0 registered
[ 4.314957] nf_conntrack version 0.5.0 (65536 buckets, 262144 max)
[ 4.318454] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[ 4.394439] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this.
[ 4.417046] Netfilter messages via NETLINK v0.30.
[ 4.423282] ip_set: protocol 6
[ 5.009138] tun: Universal TUN/TAP device driver, 1.6
[ 5.009142] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[ 5.010482] virbr0: port 1(virbr0-nic) entered blocking state
[ 5.010486] virbr0: port 1(virbr0-nic) entered disabled state
[ 5.010608] device virbr0-nic entered promiscuous mode
[ 5.089866] virbr0: port 1(virbr0-nic) entered blocking state
[ 5.089871] virbr0: port 1(virbr0-nic) entered listening state
[ 5.090007] IPv6: ADDRCONF(NETDEV_UP): virbr0: link is not ready
[ 5.123431] virbr0: port 1(virbr0-nic) entered disabled state
[ 15.825720] fuse init (API version 7.22)
[ 18.937582] TCP: lp registered
-----Original Message-----
From: Bjorn Helgaas <helgaas@kernel.org>
Sent: Friday, December 9, 2022 12:56 PM
To: Kallol Biswas [C] <kallol.biswas@nutanix.com>
Cc: linux-pci@vger.kernel.org
Subject: Re: uefi secureboot vm and IO window overlap
Hi Kallol,
On Fri, Dec 09, 2022 at 06:44:42PM +0000, Kallol Biswas [C] wrote:
> We are observing an io window overlap issue in a secureboot enabled uefi vm.
>
> Linux displays:
> pci 0000:00:1d.0: can't claim BAR 4 [io 0x92a0-0x92bf]: address
> conflict with PCI Bus 0000:01 [io 0x9000-0x9fff]
>
> Eventually conflict gets resolved but we need to understand why get the conflict in the first place.
>
> Details:
>
> The VM is a uefi based VM and the issue shows up if secure boot is
> enabled. We have enabled ovmf log and uefi/ovmf programs a bridge IO
> window with the range 0x9000-0x91ff, but in Linux we see the same
> bridge is programmed with 0x9000-0x9fff. This results in an address
> conflict with subsequent devices.
Linux normally doesn't reassign bridge windows if the existing configuration (typically from firmware) works.
Booting with "pci=earlydump" should dump the config before Linux touches anything.
I see your response about being able to reproduce it where it's easier to debug. If you need more help, please include the complete dmesg log so we can see what's happening.
Bjorn
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: uefi secureboot vm and IO window overlap
2022-12-10 17:45 ` Kallol Biswas [C]
@ 2022-12-13 21:30 ` Bjorn Helgaas
2023-06-07 21:41 ` Kallol Biswas [C]
0 siblings, 1 reply; 10+ messages in thread
From: Bjorn Helgaas @ 2022-12-13 21:30 UTC (permalink / raw)
To: Kallol Biswas [C]; +Cc: linux-pci@vger.kernel.org
On Sat, Dec 10, 2022 at 05:45:50PM +0000, Kallol Biswas [C] wrote:
> The part1 of the dmesg:
>
> [ 0.000000] Initializing cgroup subsys cpuset
> [ 0.000000] Initializing cgroup subsys cpu
> [ 0.000000] Initializing cgroup subsys cpuacct
> [ 0.000000] Linux version 3.10.0-957.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Thu Nov 8 23:39:32 UTC 2018
Is there any chance you can reproduce the problem on a current kernel?
If it's been fixed by now, maybe we could identify the fix and you
could backport it?
Bjorn
^ permalink raw reply [flat|nested] 10+ messages in thread
* RE: uefi secureboot vm and IO window overlap
2022-12-13 21:30 ` Bjorn Helgaas
@ 2023-06-07 21:41 ` Kallol Biswas [C]
2023-06-07 22:15 ` Bjorn Helgaas
0 siblings, 1 reply; 10+ messages in thread
From: Kallol Biswas [C] @ 2023-06-07 21:41 UTC (permalink / raw)
To: Bjorn Helgaas; +Cc: linux-pci@vger.kernel.org
Hello Bjorn,
I have reproduced the problem in the 6.3.6 kernel and debugged the source of the conflict.
Here is the OVMF log:
PciBus: Resource Map for Root Bridge PciRoot(0x0)^M
Type = Io16; Base = 0x6000; Length = 0x3000; Alignment = 0xFFF^M
Base = 0x6000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|02:**]^M
Base = 0x7000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|01:**]^M
Base = 0x8000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|00:**]^M
Base = 0x8200; Length = 0x40; Alignment = 0x3F; Owner = PCI [00|1F|03:20]^M
Base = 0x8240; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1F|02:20]^M
Base = 0x8260; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|02:20]^M
Base = 0x8280; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|01:20]^M
Base = 0x82A0; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|00:20]^M
Base = 0x82C0; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|03|00:10]^M
[nutanix@localhost ~]$ lspci -s 0:2.0 -vvv
00:02.0 PCI bridge: Red Hat, Inc. QEMU PCIe Root port (prog-if 00 [Normal decode])
Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
Latency: 0
Interrupt: pin A routed to IRQ 22
Region 0: Memory at c1645000 (32-bit, non-prefetchable) [size=4K]
Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
I/O behind bridge: 00008000-00008fff [size=4K]
Memory behind bridge: c1400000-c15fffff [size=2M]
Prefetchable memory behind bridge: 0000084000000000-00000840000fffff [size=1M]
Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
Capabilities: <access denied>
Kernel driver in use: pcieport
Dmesg log:
[ 2.232081] pci 0000:00:02.0: PCI bridge to [bus 01]
[ 2.232098] pci_read_bridge_io:base 0x8000 limit 0x8000 io_granulatiry 0x1000
[ 2.232099] pci 0000:00:02.0: bridge window [io 0x8000-0x8fff]
[ 2.233005] pci 0000:00:02.0: bridge window [mem 0xc1400000-0xc15fffff]
[ 2.233034] pci 0000:00:02.0: bridge window [mem 0x84000000000-0x840000fffff 64bit
Kernel code:
static void pci_read_bridge_io(struct pci_bus *child)
{
struct pci_dev *dev = child->self;
u8 io_base_lo, io_limit_lo;
unsigned long io_mask, io_granularity, base, limit;
struct pci_bus_region region;
struct resource *res;
io_mask = PCI_IO_RANGE_MASK;
io_granularity = 0x1000;
if (dev->io_window_1k) {
/* Support 1K I/O space granularity */
io_mask = PCI_IO_1K_RANGE_MASK;
io_granularity = 0x400;
}
printk("pci_read_bridge_io:base 0x%x limit 0x%x io_granulatiry 0x%x\n", base, limit, io_granularity); <= my print
if (base <= limit) {
res->flags = (io_base_lo & PCI_IO_RANGE_TYPE_MASK) | IORESOURCE_IO;
region.start = base;
region.end = limit + io_granularity - 1;
pcibios_bus_to_resource(dev->bus, res, ®ion);
pci_info(dev, " bridge window %pR\n", res);
}
OVMF sets the base for 0:2.0 as 0x8000 and length as 0x200 but kernel io_granularity is 0x1000
So, the bridge window becomes 0x8000 to 0x8fff, which overlaps the OVMF programmed IO base
registers for other endpoints.
[ 2.996029] pci 0000:00:03.0: can't claim BAR 0 [io 0x82c0-0x82df]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 2.996049] pci 0000:00:1d.0: can't claim BAR 4 [io 0x82a0-0x82bf]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 2.996058] pci 0000:00:1d.1: can't claim BAR 4 [io 0x8280-0x829f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 2.996068] pci 0000:00:1d.2: can't claim BAR 4 [io 0x8260-0x827f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 2.996093] pci 0000:00:1f.2: can't claim BAR 4 [io 0x8240-0x825f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
[ 2.996997] pci 0000:00:1f.3: can't claim BAR 4 [io 0x8200-0x823f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
Sorry, did not get time to debug this before.
Question, why does the kernel set IO granularity to 4k?
Kallol
-----Original Message-----
From: Bjorn Helgaas <helgaas@kernel.org>
Sent: Tuesday, December 13, 2022 1:31 PM
To: Kallol Biswas [C] <kallol.biswas@nutanix.com>
Cc: linux-pci@vger.kernel.org
Subject: Re: uefi secureboot vm and IO window overlap
On Sat, Dec 10, 2022 at 05:45:50PM +0000, Kallol Biswas [C] wrote:
> The part1 of the dmesg:
>
> [ 0.000000] Initializing cgroup subsys cpuset
> [ 0.000000] Initializing cgroup subsys cpu
> [ 0.000000] Initializing cgroup subsys cpuacct
> [ 0.000000] Linux version 3.10.0-957.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Thu Nov 8 23:39:32 UTC 2018
Is there any chance you can reproduce the problem on a current kernel?
If it's been fixed by now, maybe we could identify the fix and you could backport it?
Bjorn
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: uefi secureboot vm and IO window overlap
2023-06-07 21:41 ` Kallol Biswas [C]
@ 2023-06-07 22:15 ` Bjorn Helgaas
2023-06-12 17:46 ` Kallol Biswas [C]
0 siblings, 1 reply; 10+ messages in thread
From: Bjorn Helgaas @ 2023-06-07 22:15 UTC (permalink / raw)
To: Kallol Biswas [C]; +Cc: Bjorn Helgaas, linux-pci@vger.kernel.org
[FYI, I'm not sure why, but your email didn't seem to make it to the
list; maybe there's a clue at
http://vger.kernel.org/majordomo-info.html]
On Wed, Jun 7, 2023 at 4:42 PM Kallol Biswas [C]
<kallol.biswas@nutanix.com> wrote:
>
> Hello Bjorn,
> I have reproduced the problem in the 6.3.6 kernel and debugged the source of the conflict.
>
> Here is the OVMF log:
> PciBus: Resource Map for Root Bridge PciRoot(0x0)^M
> Type = Io16; Base = 0x6000; Length = 0x3000; Alignment = 0xFFF^M
> Base = 0x6000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|02:**]^M
> Base = 0x7000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|01:**]^M
> Base = 0x8000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|00:**]^M
> Base = 0x8200; Length = 0x40; Alignment = 0x3F; Owner = PCI [00|1F|03:20]^M
> Base = 0x8240; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1F|02:20]^M
> Base = 0x8260; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|02:20]^M
> Base = 0x8280; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|01:20]^M
> Base = 0x82A0; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|00:20]^M
> Base = 0x82C0; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|03|00:10]^M
>
> [nutanix@localhost ~]$ lspci -s 0:2.0 -vvv
> 00:02.0 PCI bridge: Red Hat, Inc. QEMU PCIe Root port (prog-if 00 [Normal decode])
> Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
> Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
> Latency: 0
> Interrupt: pin A routed to IRQ 22
> Region 0: Memory at c1645000 (32-bit, non-prefetchable) [size=4K]
> Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
> I/O behind bridge: 00008000-00008fff [size=4K]
> Memory behind bridge: c1400000-c15fffff [size=2M]
> Prefetchable memory behind bridge: 0000084000000000-00000840000fffff [size=1M]
> Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
> BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
> PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> Capabilities: <access denied>
> Kernel driver in use: pcieport
> Dmesg log:
> [ 2.232081] pci 0000:00:02.0: PCI bridge to [bus 01]
> [ 2.232098] pci_read_bridge_io:base 0x8000 limit 0x8000 io_granulatiry 0x1000
> [ 2.232099] pci 0000:00:02.0: bridge window [io 0x8000-0x8fff]
> [ 2.233005] pci 0000:00:02.0: bridge window [mem 0xc1400000-0xc15fffff]
> [ 2.233034] pci 0000:00:02.0: bridge window [mem 0x84000000000-0x840000fffff 64bit
>
> Kernel code:
> static void pci_read_bridge_io(struct pci_bus *child)
> {
> struct pci_dev *dev = child->self;
> u8 io_base_lo, io_limit_lo;
> unsigned long io_mask, io_granularity, base, limit;
> struct pci_bus_region region;
> struct resource *res;
>
> io_mask = PCI_IO_RANGE_MASK;
> io_granularity = 0x1000;
> if (dev->io_window_1k) {
> /* Support 1K I/O space granularity */
> io_mask = PCI_IO_1K_RANGE_MASK;
> io_granularity = 0x400;
> }
>
>
> printk("pci_read_bridge_io:base 0x%x limit 0x%x io_granulatiry 0x%x\n", base, limit, io_granularity); <= my print
> if (base <= limit) {
> res->flags = (io_base_lo & PCI_IO_RANGE_TYPE_MASK) | IORESOURCE_IO;
> region.start = base;
> region.end = limit + io_granularity - 1;
> pcibios_bus_to_resource(dev->bus, res, ®ion);
> pci_info(dev, " bridge window %pR\n", res);
> }
>
>
> OVMF sets the base for 0:2.0 as 0x8000 and length as 0x200 but kernel io_granularity is 0x1000
> So, the bridge window becomes 0x8000 to 0x8fff, which overlaps the OVMF programmed IO base
> registers for other endpoints.
>
> [ 2.996029] pci 0000:00:03.0: can't claim BAR 0 [io 0x82c0-0x82df]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> [ 2.996049] pci 0000:00:1d.0: can't claim BAR 4 [io 0x82a0-0x82bf]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> [ 2.996058] pci 0000:00:1d.1: can't claim BAR 4 [io 0x8280-0x829f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> [ 2.996068] pci 0000:00:1d.2: can't claim BAR 4 [io 0x8260-0x827f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> [ 2.996093] pci 0000:00:1f.2: can't claim BAR 4 [io 0x8240-0x825f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> [ 2.996997] pci 0000:00:1f.3: can't claim BAR 4 [io 0x8200-0x823f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
>
> Sorry, did not get time to debug this before.
>
> Question, why does the kernel set IO granularity to 4k?
The "io_granularity = 0x1000" in pci_read_bridge_io() comes from the
fact that PCIe r6.0, sec 7.5.1.3.6, says bridges assume the lower 12
address bits of I/O Base registers (the bridge I/O window) are zero.
Bjorn
> -----Original Message-----
> From: Bjorn Helgaas <helgaas@kernel.org>
> Sent: Tuesday, December 13, 2022 1:31 PM
> To: Kallol Biswas [C] <kallol.biswas@nutanix.com>
> Cc: linux-pci@vger.kernel.org
> Subject: Re: uefi secureboot vm and IO window overlap
>
> On Sat, Dec 10, 2022 at 05:45:50PM +0000, Kallol Biswas [C] wrote:
> > The part1 of the dmesg:
> >
> > [ 0.000000] Initializing cgroup subsys cpuset
> > [ 0.000000] Initializing cgroup subsys cpu
> > [ 0.000000] Initializing cgroup subsys cpuacct
> > [ 0.000000] Linux version 3.10.0-957.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Thu Nov 8 23:39:32 UTC 2018
>
> Is there any chance you can reproduce the problem on a current kernel?
> If it's been fixed by now, maybe we could identify the fix and you could backport it?
>
> Bjorn
^ permalink raw reply [flat|nested] 10+ messages in thread
* RE: uefi secureboot vm and IO window overlap
2023-06-07 22:15 ` Bjorn Helgaas
@ 2023-06-12 17:46 ` Kallol Biswas [C]
2023-06-12 18:00 ` Bjorn Helgaas
0 siblings, 1 reply; 10+ messages in thread
From: Kallol Biswas [C] @ 2023-06-12 17:46 UTC (permalink / raw)
To: bjorn@helgaas.com; +Cc: Bjorn Helgaas, linux-pci@vger.kernel.org
-----Original Message-----
From: Bjorn Helgaas <bjorn.helgaas@gmail.com>
Sent: Wednesday, June 7, 2023 3:15 PM
To: Kallol Biswas [C] <kallol.biswas@nutanix.com>
Cc: Bjorn Helgaas <helgaas@kernel.org>; linux-pci@vger.kernel.org
Subject: Re: uefi secureboot vm and IO window overlap
> [FYI, I'm not sure why, but your email didn't seem to make it to the list; maybe there's a clue at https://urldefense.proofpoint.com/v2/url?u=http-3A__vger.kernel.org_majordomo-2Dinfo.html&d=DwIFaQ&c=s883GpUCOChKOHiocYtGcg&r=HSy9eEcg9NrbI7YGUiURvZ2SD5_lmb_abr4v5sda9bk&m=VHASNjeAs866UrvKqCdEbB1HjTvZTYFLidSIbWc0malEoRTcGFfCjQi729H0C69-&s=irSta89Vw2NwFRSAc4FiIRvh0Dant62MNDdEvOteqP0&e= ]
On Wed, Jun 7, 2023 at 4:42 PM Kallol Biswas [C] <kallol.biswas@nutanix.com> wrote:
>
> Hello Bjorn,
> I have reproduced the problem in the 6.3.6 kernel and debugged the source of the conflict.
>
> Here is the OVMF log:
> PciBus: Resource Map for Root Bridge PciRoot(0x0)^M
> Type = Io16; Base = 0x6000; Length = 0x3000; Alignment = 0xFFF^M
> Base = 0x6000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|02:**]^M
> Base = 0x7000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|01:**]^M
> Base = 0x8000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|00:**]^M
> Base = 0x8200; Length = 0x40; Alignment = 0x3F; Owner = PCI [00|1F|03:20]^M
> Base = 0x8240; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1F|02:20]^M
> Base = 0x8260; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|02:20]^M
> Base = 0x8280; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|01:20]^M
> Base = 0x82A0; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|00:20]^M
> Base = 0x82C0; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|03|00:10]^M
>
> [nutanix@localhost ~]$ lspci -s 0:2.0 -vvv
> 00:02.0 PCI bridge: Red Hat, Inc. QEMU PCIe Root port (prog-if 00 [Normal decode])
> Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
> Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
> Latency: 0
> Interrupt: pin A routed to IRQ 22
> Region 0: Memory at c1645000 (32-bit, non-prefetchable) [size=4K]
> Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
> I/O behind bridge: 00008000-00008fff [size=4K]
> Memory behind bridge: c1400000-c15fffff [size=2M]
> Prefetchable memory behind bridge: 0000084000000000-00000840000fffff [size=1M]
> Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
> BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
> PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> Capabilities: <access denied>
> Kernel driver in use: pcieport Dmesg log:
> [ 2.232081] pci 0000:00:02.0: PCI bridge to [bus 01]
> [ 2.232098] pci_read_bridge_io:base 0x8000 limit 0x8000 io_granulatiry 0x1000
> [ 2.232099] pci 0000:00:02.0: bridge window [io 0x8000-0x8fff]
> [ 2.233005] pci 0000:00:02.0: bridge window [mem 0xc1400000-0xc15fffff]
> [ 2.233034] pci 0000:00:02.0: bridge window [mem 0x84000000000-0x840000fffff 64bit
>
> Kernel code:
> static void pci_read_bridge_io(struct pci_bus *child) {
> struct pci_dev *dev = child->self;
> u8 io_base_lo, io_limit_lo;
> unsigned long io_mask, io_granularity, base, limit;
> struct pci_bus_region region;
> struct resource *res;
>
> io_mask = PCI_IO_RANGE_MASK;
> io_granularity = 0x1000;
> if (dev->io_window_1k) {
> /* Support 1K I/O space granularity */
> io_mask = PCI_IO_1K_RANGE_MASK;
> io_granularity = 0x400;
> }
>
>
> printk("pci_read_bridge_io:base 0x%x limit 0x%x io_granulatiry 0x%x\n", base, limit, io_granularity); <= my print
> if (base <= limit) {
> res->flags = (io_base_lo & PCI_IO_RANGE_TYPE_MASK) | IORESOURCE_IO;
> region.start = base;
> region.end = limit + io_granularity - 1;
> pcibios_bus_to_resource(dev->bus, res, ®ion);
> pci_info(dev, " bridge window %pR\n", res);
> }
>
>
> OVMF sets the base for 0:2.0 as 0x8000 and length as 0x200 but kernel
> io_granularity is 0x1000 So, the bridge window becomes 0x8000 to
> 0x8fff, which overlaps the OVMF programmed IO base registers for other endpoints.
>
> [ 2.996029] pci 0000:00:03.0: can't claim BAR 0 [io 0x82c0-0x82df]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> [ 2.996049] pci 0000:00:1d.0: can't claim BAR 4 [io 0x82a0-0x82bf]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> [ 2.996058] pci 0000:00:1d.1: can't claim BAR 4 [io 0x8280-0x829f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> [ 2.996068] pci 0000:00:1d.2: can't claim BAR 4 [io 0x8260-0x827f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> [ 2.996093] pci 0000:00:1f.2: can't claim BAR 4 [io 0x8240-0x825f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> [ 2.996997] pci 0000:00:1f.3: can't claim BAR 4 [io 0x8200-0x823f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
>
> Sorry, did not get time to debug this before.
>
> Question, why does the kernel set IO granularity to 4k?
> The "io_granularity = 0x1000" in pci_read_bridge_io() comes from the fact that PCIe r6.0, sec 7.5.1.3.6, says bridges assume the lower 12 address bits of I/O Base registers (the bridge I/O window) are zero.
> Bjorn
I think you have answered my question. The lower 12 bits of the limit register are assumed to be 0xfff. Granularity is derived from this, right?
Spec:
"Thus, the bottom of the defined I/O address range will be aligned to a 4 KB boundary and the top of
the defined I/O address range will be one less than a 4 KB boundary".
> -----Original Message-----
> From: Bjorn Helgaas <helgaas@kernel.org>
> Sent: Tuesday, December 13, 2022 1:31 PM
> To: Kallol Biswas [C] <kallol.biswas@nutanix.com>
> Cc: linux-pci@vger.kernel.org
> Subject: Re: uefi secureboot vm and IO window overlap
>
> On Sat, Dec 10, 2022 at 05:45:50PM +0000, Kallol Biswas [C] wrote:
> > The part1 of the dmesg:
> >
> > [ 0.000000] Initializing cgroup subsys cpuset
> > [ 0.000000] Initializing cgroup subsys cpu
> > [ 0.000000] Initializing cgroup subsys cpuacct
> > [ 0.000000] Linux version 3.10.0-957.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Thu Nov 8 23:39:32 UTC 2018
>
> Is there any chance you can reproduce the problem on a current kernel?
> If it's been fixed by now, maybe we could identify the fix and you could backport it?
>
> Bjorn
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: uefi secureboot vm and IO window overlap
2023-06-12 17:46 ` Kallol Biswas [C]
@ 2023-06-12 18:00 ` Bjorn Helgaas
0 siblings, 0 replies; 10+ messages in thread
From: Bjorn Helgaas @ 2023-06-12 18:00 UTC (permalink / raw)
To: Kallol Biswas [C]; +Cc: bjorn@helgaas.com, linux-pci@vger.kernel.org
On Mon, Jun 12, 2023 at 05:46:44PM +0000, Kallol Biswas [C] wrote:
> -----Original Message-----
> From: Bjorn Helgaas <bjorn.helgaas@gmail.com>
> Sent: Wednesday, June 7, 2023 3:15 PM
> To: Kallol Biswas [C] <kallol.biswas@nutanix.com>
> Cc: Bjorn Helgaas <helgaas@kernel.org>; linux-pci@vger.kernel.org
> Subject: Re: uefi secureboot vm and IO window overlap
>
> > [FYI, I'm not sure why, but your email didn't seem to make it to the list; maybe there's a clue at https://urldefense.proofpoint.com/v2/url?u=http-3A__vger.kernel.org_majordomo-2Dinfo.html&d=DwIFaQ&c=s883GpUCOChKOHiocYtGcg&r=HSy9eEcg9NrbI7YGUiURvZ2SD5_lmb_abr4v5sda9bk&m=VHASNjeAs866UrvKqCdEbB1HjTvZTYFLidSIbWc0malEoRTcGFfCjQi729H0C69-&s=irSta89Vw2NwFRSAc4FiIRvh0Dant62MNDdEvOteqP0&e= ]
>
> On Wed, Jun 7, 2023 at 4:42 PM Kallol Biswas [C] <kallol.biswas@nutanix.com> wrote:
> >
> > Hello Bjorn,
> > I have reproduced the problem in the 6.3.6 kernel and debugged the source of the conflict.
> >
> > Here is the OVMF log:
> > PciBus: Resource Map for Root Bridge PciRoot(0x0)^M
> > Type = Io16; Base = 0x6000; Length = 0x3000; Alignment = 0xFFF^M
> > Base = 0x6000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|02:**]^M
> > Base = 0x7000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|01:**]^M
> > Base = 0x8000; Length = 0x200; Alignment = 0xFFF; Owner = PPB [00|02|00:**]^M
> > Base = 0x8200; Length = 0x40; Alignment = 0x3F; Owner = PCI [00|1F|03:20]^M
> > Base = 0x8240; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1F|02:20]^M
> > Base = 0x8260; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|02:20]^M
> > Base = 0x8280; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|01:20]^M
> > Base = 0x82A0; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|1D|00:20]^M
> > Base = 0x82C0; Length = 0x20; Alignment = 0x1F; Owner = PCI [00|03|00:10]^M
> >
> > [nutanix@localhost ~]$ lspci -s 0:2.0 -vvv
> > 00:02.0 PCI bridge: Red Hat, Inc. QEMU PCIe Root port (prog-if 00 [Normal decode])
> > Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
> > Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
> > Latency: 0
> > Interrupt: pin A routed to IRQ 22
> > Region 0: Memory at c1645000 (32-bit, non-prefetchable) [size=4K]
> > Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
> > I/O behind bridge: 00008000-00008fff [size=4K]
> > Memory behind bridge: c1400000-c15fffff [size=2M]
> > Prefetchable memory behind bridge: 0000084000000000-00000840000fffff [size=1M]
> > Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
> > BridgeCtl: Parity- SERR+ NoISA- VGA- VGA16- MAbort- >Reset- FastB2B-
> > PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
> > Capabilities: <access denied>
> > Kernel driver in use: pcieport Dmesg log:
> > [ 2.232081] pci 0000:00:02.0: PCI bridge to [bus 01]
> > [ 2.232098] pci_read_bridge_io:base 0x8000 limit 0x8000 io_granulatiry 0x1000
> > [ 2.232099] pci 0000:00:02.0: bridge window [io 0x8000-0x8fff]
> > [ 2.233005] pci 0000:00:02.0: bridge window [mem 0xc1400000-0xc15fffff]
> > [ 2.233034] pci 0000:00:02.0: bridge window [mem 0x84000000000-0x840000fffff 64bit
> >
> > Kernel code:
> > static void pci_read_bridge_io(struct pci_bus *child) {
> > struct pci_dev *dev = child->self;
> > u8 io_base_lo, io_limit_lo;
> > unsigned long io_mask, io_granularity, base, limit;
> > struct pci_bus_region region;
> > struct resource *res;
> >
> > io_mask = PCI_IO_RANGE_MASK;
> > io_granularity = 0x1000;
> > if (dev->io_window_1k) {
> > /* Support 1K I/O space granularity */
> > io_mask = PCI_IO_1K_RANGE_MASK;
> > io_granularity = 0x400;
> > }
> >
> >
> > printk("pci_read_bridge_io:base 0x%x limit 0x%x io_granulatiry 0x%x\n", base, limit, io_granularity); <= my print
> > if (base <= limit) {
> > res->flags = (io_base_lo & PCI_IO_RANGE_TYPE_MASK) | IORESOURCE_IO;
> > region.start = base;
> > region.end = limit + io_granularity - 1;
> > pcibios_bus_to_resource(dev->bus, res, ®ion);
> > pci_info(dev, " bridge window %pR\n", res);
> > }
> >
> >
> > OVMF sets the base for 0:2.0 as 0x8000 and length as 0x200 but kernel
> > io_granularity is 0x1000 So, the bridge window becomes 0x8000 to
> > 0x8fff, which overlaps the OVMF programmed IO base registers for other endpoints.
> >
> > [ 2.996029] pci 0000:00:03.0: can't claim BAR 0 [io 0x82c0-0x82df]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> > [ 2.996049] pci 0000:00:1d.0: can't claim BAR 4 [io 0x82a0-0x82bf]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> > [ 2.996058] pci 0000:00:1d.1: can't claim BAR 4 [io 0x8280-0x829f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> > [ 2.996068] pci 0000:00:1d.2: can't claim BAR 4 [io 0x8260-0x827f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> > [ 2.996093] pci 0000:00:1f.2: can't claim BAR 4 [io 0x8240-0x825f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> > [ 2.996997] pci 0000:00:1f.3: can't claim BAR 4 [io 0x8200-0x823f]: address conflict with PCI Bus 0000:01 [io 0x8000-0x8fff]
> >
> > Sorry, did not get time to debug this before.
> >
> > Question, why does the kernel set IO granularity to 4k?
>
> > The "io_granularity = 0x1000" in pci_read_bridge_io() comes from the fact that PCIe r6.0, sec 7.5.1.3.6, says bridges assume the lower 12 address bits of I/O Base registers (the bridge I/O window) are zero.
>
> I think you have answered my question. The lower 12 bits of the
> limit register are assumed to be 0xfff. Granularity is derived from
> this, right?
>
> Spec:
> "Thus, the bottom of the defined I/O address range will be aligned
> to a 4 KB boundary and the top of the defined I/O address range will
> be one less than a 4 KB boundary".
Right. There are few bridges that support 1K granularity instead of
4K; see dev->io_window_1k.
> > -----Original Message-----
> > From: Bjorn Helgaas <helgaas@kernel.org>
> > Sent: Tuesday, December 13, 2022 1:31 PM
> > To: Kallol Biswas [C] <kallol.biswas@nutanix.com>
> > Cc: linux-pci@vger.kernel.org
> > Subject: Re: uefi secureboot vm and IO window overlap
> >
> > On Sat, Dec 10, 2022 at 05:45:50PM +0000, Kallol Biswas [C] wrote:
> > > The part1 of the dmesg:
> > >
> > > [ 0.000000] Initializing cgroup subsys cpuset
> > > [ 0.000000] Initializing cgroup subsys cpu
> > > [ 0.000000] Initializing cgroup subsys cpuacct
> > > [ 0.000000] Linux version 3.10.0-957.el7.x86_64 (mockbuild@kbuilder.bsys.centos.org) (gcc version 4.8.5 20150623 (Red Hat 4.8.5-36) (GCC) ) #1 SMP Thu Nov 8 23:39:32 UTC 2018
> >
> > Is there any chance you can reproduce the problem on a current kernel?
> > If it's been fixed by now, maybe we could identify the fix and you could backport it?
> >
> > Bjorn
^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2023-06-12 18:00 UTC | newest]
Thread overview: 10+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2022-12-09 18:44 uefi secureboot vm and IO window overlap Kallol Biswas [C]
2022-12-09 20:04 ` Kallol Biswas [C]
2022-12-09 20:56 ` Bjorn Helgaas
2022-12-10 17:45 ` Kallol Biswas [C]
2022-12-13 21:30 ` Bjorn Helgaas
2023-06-07 21:41 ` Kallol Biswas [C]
2023-06-07 22:15 ` Bjorn Helgaas
2023-06-12 17:46 ` Kallol Biswas [C]
2023-06-12 18:00 ` Bjorn Helgaas
2022-12-10 17:46 ` Kallol Biswas [C]
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).