linux-pci.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* ryzen X370: iommu - unusable huge groups
@ 2017-07-16  5:44 Andreas Hartmann
  2017-07-16 14:53 ` Alex Williamson
  0 siblings, 1 reply; 7+ messages in thread
From: Andreas Hartmann @ 2017-07-16  5:44 UTC (permalink / raw)
  To: linux-pci@vger.kernel.org

Hello!

I've got a Asus X370-Pro motherboard with enabled iommu. Unfortunately,
the group 0 is mostly all of the system :-).

[    2.602426] iommu: Adding device 0000:00:01.0 to group 0
[    2.602440] iommu: Adding device 0000:00:01.3 to group 0
[    2.603368] iommu: Adding device 0000:03:00.0 to group 0
[    2.603377] iommu: Adding device 0000:03:00.1 to group 0
[    2.603385] iommu: Adding device 0000:03:00.2 to group 0
[    2.603396] iommu: Adding device 0000:1d:00.0 to group 0
[    2.603406] iommu: Adding device 0000:1d:02.0 to group 0
[    2.603417] iommu: Adding device 0000:1d:03.0 to group 0
[    2.603428] iommu: Adding device 0000:1d:04.0 to group 0
[    2.603439] iommu: Adding device 0000:1d:06.0 to group 0
[    2.603450] iommu: Adding device 0000:1d:07.0 to group 0
[    2.603466] iommu: Adding device 0000:24:00.0 to group 0
[    2.603481] iommu: Adding device 0000:25:00.0 to group 0
[    2.603498] iommu: Adding device 0000:26:00.0 to group 0
[    2.603513] iommu: Adding device 0000:27:00.0 to group 0


lspci -tv
-[0000:00]-+-00.0  Advanced Micro Devices, Inc. [AMD] Device 1450
           +-00.2  Advanced Micro Devices, Inc. [AMD] Device 1451
           +-01.0  Advanced Micro Devices, Inc. [AMD] Device 1452
           +-01.3-[03-27]--+-00.0  Advanced Micro Devices, Inc. [AMD] Device 43b9
           |               +-00.1  Advanced Micro Devices, Inc. [AMD] Device 43b5
           |               \-00.2-[1d-27]--+-00.0-[21]--
           |                               +-02.0-[23]--
           |                               +-03.0-[24]----00.0  Intel Corporation 82574L Gigabit Network Connection
           |                               +-04.0-[25]----00.0  ASMedia Technology Inc. Device 1343
           |                               +-06.0-[26]----00.0  Intel Corporation I211 Gigabit Network Connection
           |                               \-07.0-[27]----00.0  Qualcomm Atheros AR93xx Wireless Network Adapter
           +-02.0  Advanced Micro Devices, Inc. [AMD] Device 1452
           +-03.0  Advanced Micro Devices, Inc. [AMD] Device 1452
           +-03.1-[28]--+-00.0  Advanced Micro Devices, Inc. [AMD/ATI] Turks PRO [Radeon HD 6570/7570/8550]
           |            \-00.1  Advanced Micro Devices, Inc. [AMD/ATI] Turks HDMI Audio [Radeon HD 6500/6600 / 6700M Series]
           +-04.0  Advanced Micro Devices, Inc. [AMD] Device 1452
           +-07.0  Advanced Micro Devices, Inc. [AMD] Device 1452
           +-07.1-[29]--+-00.0  Advanced Micro Devices, Inc. [AMD] Device 145a
           |            +-00.2  Advanced Micro Devices, Inc. [AMD] Device 1456
           |            \-00.3  Advanced Micro Devices, Inc. [AMD] USB3 Host Controller
           +-08.0  Advanced Micro Devices, Inc. [AMD] Device 1452
           +-08.1-[2a]--+-00.0  Advanced Micro Devices, Inc. [AMD] Device 1455
           |            +-00.2  Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode]
           |            \-00.3  Advanced Micro Devices, Inc. [AMD] Device 1457
           +-14.0  Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller
           +-14.3  Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge
           +-18.0  Advanced Micro Devices, Inc. [AMD] Device 1460
           +-18.1  Advanced Micro Devices, Inc. [AMD] Device 1461
           +-18.2  Advanced Micro Devices, Inc. [AMD] Device 1462
           +-18.3  Advanced Micro Devices, Inc. [AMD] Device 1463
           +-18.4  Advanced Micro Devices, Inc. [AMD] Device 1464
           +-18.5  Advanced Micro Devices, Inc. [AMD] Device 1465
           +-18.6  Advanced Micro Devices, Inc. [AMD] Device 1466
           \-18.7  Advanced Micro Devices, Inc. [AMD] Device 1467



I would like to put 0000:27:00.0 to a VM and 0000:24:00.0 to another VM
- but this isn't possible, because I had to unbind the other devices,
too - which is a bad idea and not possible, because I need them in the host.

Is there any chance to put these devices to different groups (because
they don't do any peer to peer communication e.g.)?


Thanks,
kind regards,
Andreas


linux 4.12.2
Bios of Asus X370-PRO: 0511


# lspci -tv
-[0000:00]-+-00.0  Advanced Micro Devices, Inc. [AMD] Device 1450
           +-00.2  Advanced Micro Devices, Inc. [AMD] Device 1451
           +-01.0  Advanced Micro Devices, Inc. [AMD] Device 1452
           +-01.3-[03-27]--+-00.0  Advanced Micro Devices, Inc. [AMD] Device 43b9
           |               +-00.1  Advanced Micro Devices, Inc. [AMD] Device 43b5
           |               \-00.2-[1d-27]--+-00.0-[21]--
           |                               +-02.0-[23]--
           |                               +-03.0-[24]----00.0  Intel Corporation 82574L Gigabit Network Connection
           |                               +-04.0-[25]----00.0  ASMedia Technology Inc. Device 1343
           |                               +-06.0-[26]----00.0  Intel Corporation I211 Gigabit Network Connection
           |                               \-07.0-[27]----00.0  Qualcomm Atheros AR93xx Wireless Network Adapter


00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453 (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=00, secondary=03, subordinate=27, sec-latency=0
        I/O behind bridge: 0000c000-0000dfff
        Memory behind bridge: fe000000-fe4fffff
        Prefetchable memory behind bridge: 00000000f0000000-00000000f05fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [50] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [58] Express (v2) Root Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag+ RBE+
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
                LnkCap: Port #1, Speed 8GT/s, Width x4, ASPM L1, Exit Latency L0s <512ns, L1 <64us
                        ClockPM- Surprise- LLActRep+ BwNot+
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 8GT/s, Width x4, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #0, PowerLimit 0.000W; Interlock- NoCompl+
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
                        Changed: MRL- PresDet- LinkState+
                RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna- CRSVisible+
                RootCap: CRSVisible+
                RootSta: PME ReqID 0000, PMEStatus- PMEPending-
                DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported ARIFwd+
                DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete+, EqualizationPhase1+
                         EqualizationPhase2+, EqualizationPhase3+, LinkEqualizationRequest-
        Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [c0] Subsystem: ASUSTeK Computer Inc. Device 8747
        Capabilities: [c8] HyperTransport: MSI Mapping Enable+ Fixed+
        Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
        Capabilities: [270 v1] #19
        Capabilities: [370 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2- PCI-PM_L1.1+ ASPM_L1.2- ASPM_L1.1+ L1_PM_Substates+
        Kernel driver in use: pcieport
        Kernel modules: shpchp


03:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02) (prog-if 30 [XHCI])
        Subsystem: ASMedia Technology Inc. Device 1142
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 45
        Region 0: Memory at fe4a0000 (64-bit, non-prefetchable) [size=32K]
        Capabilities: [50] MSI: Enable+ Count=1/8 Maskable- 64bit+
                Address: 00000000fee00000  Data: 0000
        Capabilities: [78] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] Express (v2) Legacy Endpoint, MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <64ns, L1 <2us
                        ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
                LnkCap: Port #0, Speed 8GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <2us, L1 unlimited
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 8GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR+, OBFF Not Supported
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete+, EqualizationPhase1+
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap- ChkEn-
        Capabilities: [200 v1] #19
        Capabilities: [300 v1] Latency Tolerance Reporting
                Max snoop latency: 0ns
                Max no snoop latency: 0ns
        Capabilities: [400 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=0us PortTPowerOnTime=10us
        Kernel driver in use: xhci_hcd
        Kernel modules: xhci_pci

03:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02) (prog-if 01 [AHCI 1.0])
        Subsystem: ASMedia Technology Inc. Device 1062
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin B routed to IRQ 38
        Region 5: Memory at fe480000 (32-bit, non-prefetchable) [size=128K]
        Expansion ROM at fe400000 [disabled] [size=512K]
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee00000  Data: 0000
        Capabilities: [78] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] Express (v2) Legacy Endpoint, MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <64ns, L1 <2us
                        ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 16384 bytes
                DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
                LnkCap: Port #0, Speed 8GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <2us, L1 unlimited
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 8GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR-, OBFF Not Supported
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap- ChkEn-
        Kernel driver in use: ahci


03:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=03, secondary=1d, subordinate=27, sec-latency=0
        I/O behind bridge: 0000c000-0000dfff
        Memory behind bridge: fe000000-fe3fffff
        Prefetchable memory behind bridge: 00000000f0000000-00000000f05fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee00000  Data: 0000
        Capabilities: [78] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] Express (v2) Upstream Port, MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ SlotPowerLimit 0.000W
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
                LnkCap: Port #0, Speed 8GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <2us, L1 unlimited
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 8GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR-, OBFF Not Supported
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 0201
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap- ChkEn-
        Kernel driver in use: pcieport
        Kernel modules: shpchp


1d:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=1d, secondary=21, subordinate=21, sec-latency=0
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: fff00000-000fffff
        Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee00000  Data: 0000
        Capabilities: [78] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D3 NoSoftRst+ PME-Enable+ DSel=0 DScale=0 PME-
        Capabilities: [80] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag+ RBE+
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #0, Speed 5GT/s, Width x2, ASPM L0s L1, Exit Latency L0s unlimited, L1 unlimited
                        ClockPM- Surprise- LLActRep+ BwNot+
                LnkCtl: ASPM Disabled; Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x0, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #1, PowerLimit 26.000W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
                        Changed: MRL- PresDet- LinkState-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR+, OBFF Not Supported ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3306
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap- ChkEn-
        Capabilities: [200 v1] #19
        Capabilities: [400 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=0us PortTPowerOnTime=10us
        Kernel driver in use: pcieport
        Kernel modules: shpchp

1d:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=1d, secondary=23, subordinate=23, sec-latency=0
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: fff00000-000fffff
        Prefetchable memory behind bridge: 00000000f0000000-00000000f01fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee00000  Data: 0000
        Capabilities: [78] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag+ RBE+
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #2, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s unlimited, L1 unlimited
                        ClockPM- Surprise- LLActRep+ BwNot+
                LnkCtl: ASPM Disabled; Disabled- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                SltCap: AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise-
                        Slot #1, PowerLimit 26.000W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Off, PwrInd Off, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet- Interlock-
                        Changed: MRL- PresDet- LinkState-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR+, OBFF Not Supported ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3306
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap- ChkEn-
        Capabilities: [200 v1] #19
        Capabilities: [400 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=0us PortTPowerOnTime=10us
        Kernel driver in use: pcieport
        Kernel modules: shpchp


1d:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=1d, secondary=24, subordinate=24, sec-latency=0
        I/O behind bridge: 0000d000-0000dfff
        Memory behind bridge: fe300000-fe3fffff
        Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee00000  Data: 0000
        Capabilities: [78] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag+ RBE+
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #3, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <2us, L1 unlimited
                        ClockPM- Surprise- LLActRep+ BwNot+
                LnkCtl: ASPM Disabled; Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #1, PowerLimit 26.000W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
                        Changed: MRL- PresDet+ LinkState+
                DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR+, OBFF Not Supported ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3306
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap- ChkEn-
        Capabilities: [200 v1] #19
        Capabilities: [400 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=0us PortTPowerOnTime=10us
        Kernel driver in use: pcieport
        Kernel modules: shpchp


1d:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=1d, secondary=25, subordinate=25, sec-latency=0
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: fe200000-fe2fffff
        Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee00000  Data: 0000
        Capabilities: [78] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag+ RBE+
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #4, Speed 5GT/s, Width x2, ASPM L0s L1, Exit Latency L0s <2us, L1 unlimited
                        ClockPM- Surprise- LLActRep+ BwNot+
                LnkCtl: ASPM Disabled; Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s, Width x2, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #1, PowerLimit 26.000W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
                        Changed: MRL- PresDet+ LinkState+
                DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR+, OBFF Not Supported ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3306
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap- ChkEn-
        Capabilities: [200 v1] #19
        Capabilities: [400 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=0us PortTPowerOnTime=10us
        Kernel driver in use: pcieport
        Kernel modules: shpchp


1d:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=1d, secondary=26, subordinate=26, sec-latency=0
        I/O behind bridge: 0000c000-0000cfff
        Memory behind bridge: fe100000-fe1fffff
        Prefetchable memory behind bridge: 00000000f0200000-00000000f03fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee00000  Data: 0000
        Capabilities: [78] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag+ RBE+
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #6, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <2us, L1 unlimited
                        ClockPM- Surprise- LLActRep+ BwNot+
                LnkCtl: ASPM Disabled; Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
                SltCap: AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise-
                        Slot #1, PowerLimit 26.000W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Off, PwrInd Off, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
                        Changed: MRL- PresDet+ LinkState+
                DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR+, OBFF Not Supported ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3306
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap- ChkEn-
        Capabilities: [200 v1] #19
        Capabilities: [400 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=0us PortTPowerOnTime=10us
        Kernel driver in use: pcieport
        Kernel modules: shpchp


1d:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02) (prog-if 00 [Normal decode])
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Bus: primary=1d, secondary=27, subordinate=27, sec-latency=0
        I/O behind bridge: 0000f000-00000fff
        Memory behind bridge: fe000000-fe0fffff
        Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
        Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
        BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
                PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
        Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
                Address: 00000000fee00000  Data: 0000
        Capabilities: [78] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] Express (v2) Downstream Port (Slot+), MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0
                        ExtTag+ RBE+
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #7, Speed 5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <2us, L1 unlimited
                        ClockPM- Surprise- LLActRep+ BwNot+
                LnkCtl: ASPM Disabled; Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
                SltCap: AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
                        Slot #1, PowerLimit 26.000W; Interlock- NoCompl-
                SltCtl: Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
                        Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
                SltSta: Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
                        Changed: MRL- PresDet+ LinkState+
                DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR+, OBFF Not Supported ARIFwd-
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled ARIFwd-
                LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [c0] Subsystem: ASMedia Technology Inc. Device 3306
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap- ChkEn-
        Capabilities: [200 v1] #19
        Capabilities: [400 v1] L1 PM Substates
                L1SubCap: PCI-PM_L1.2+ PCI-PM_L1.1+ ASPM_L1.2+ ASPM_L1.1+ L1_PM_Substates+
                          PortCommonModeRestoreTime=0us PortTPowerOnTime=10us
        Kernel driver in use: pcieport
        Kernel modules: shpchp


24:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
        Subsystem: Intel Corporation Gigabit CT Desktop Adapter
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx+
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 32
        Region 0: Memory at fe3c0000 (32-bit, non-prefetchable) [size=128K]
        Region 1: Memory at fe300000 (32-bit, non-prefetchable) [size=512K]
        Region 2: I/O ports at d000 [size=32]
        Region 3: Memory at fe3e0000 (32-bit, non-prefetchable) [size=16K]
        Expansion ROM at fe380000 [disabled] [size=256K]
        Capabilities: [c8] Power Management version 2
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
        Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [e0] Express (v1) Endpoint, MSI 00
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #3, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <128ns, L1 <64us
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
        Capabilities: [a0] MSI-X: Enable+ Count=5 Masked-
                Vector table: BAR=3 offset=00000000
                PBA: BAR=3 offset=00002000
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
        Capabilities: [140 v1] Device Serial Number 00-1b-21-ff-ff-cf-8f-57
        Kernel driver in use: e1000e
        Kernel modules: e1000e


25:00.0 USB controller: ASMedia Technology Inc. Device 1343 (prog-if 30 [XHCI])
        Subsystem: ASUSTeK Computer Inc. Device 86f2
        Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 47
        Region 0: Memory at fe200000 (64-bit, non-prefetchable) [size=32K]
        Capabilities: [50] MSI: Enable+ Count=1/8 Maskable- 64bit+
                Address: 00000000fee00000  Data: 0000
        Capabilities: [78] Power Management version 3
                Flags: PMEClk- DSI- D1- D2- AuxCurrent=55mA PME(D0-,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [80] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <64ns, L1 <2us
                        ExtTag+ AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag+ PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #1, Speed 5GT/s, Width x2, ASPM L0s L1, Exit Latency L0s <2us, L1 unlimited
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 5GT/s, Width x2, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis-, LTR+, OBFF Not Supported
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkCtl2: Target Link Speed: 8GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v1] Virtual Channel
                Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
                Arb:    Fixed- WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=01
                        Status: NegoPending- InProgress-
        Capabilities: [200 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
        Capabilities: [280 v1] #19
        Capabilities: [300 v1] Latency Tolerance Reporting
                Max snoop latency: 0ns
                Max no snoop latency: 0ns
        Kernel driver in use: xhci_hcd
        Kernel modules: xhci_pci


26:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
        Subsystem: ASUSTeK Computer Inc. Device 85f0
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 24
        Region 0: Memory at fe100000 (32-bit, non-prefetchable) [size=128K]
        Region 2: I/O ports at c000 [size=32]
        Region 3: Memory at fe120000 (32-bit, non-prefetchable) [size=16K]
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=1 PME-
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable+ 64bit+
                Address: 0000000000000000  Data: 0000
                Masking: 00000000  Pending: 00000000
        Capabilities: [70] MSI-X: Enable+ Count=5 Masked-
                Vector table: BAR=3 offset=00000000
                PBA: BAR=3 offset=00002000
        Capabilities: [a0] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 512 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset+
                DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+ FLReset-
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
                LnkCap: Port #6, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <2us, L1 <16us
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v2] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
        Capabilities: [140 v1] Device Serial Number 60-45-cb-ff-ff-9e-20-d9
        Capabilities: [1a0 v1] Transaction Processing Hints
                Device specific mode supported
                Steering table in TPH capability structure
        Kernel driver in use: igb
        Kernel modules: igb


27:00.0 Network controller: Qualcomm Atheros AR93xx Wireless Network Adapter (rev 01)
        Subsystem: Qualcomm Atheros Device 3112
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 5
        Region 0: Memory at fe000000 (64-bit, non-prefetchable) [size=128K]
        Expansion ROM at fe020000 [disabled] [size=64K]
        Capabilities: [40] Power Management version 3
                Flags: PMEClk- DSI- D1+ D2- AuxCurrent=375mA PME(D0+,D1+,D2-,D3hot+,D3cold-)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
        Capabilities: [50] MSI: Enable- Count=1/4 Maskable+ 64bit+
                Address: 0000000000000000  Data: 0000
                Masking: 00000000  Pending: 00000000
        Capabilities: [70] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 128 bytes, PhantFunc 0, Latency L0s <1us, L1 <8us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
                LnkCap: Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Exit Latency L0s <2us, L1 <64us
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Not Supported, TimeoutDis+, LTR-, OBFF Not Supported
                DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
        Capabilities: [140 v1] Virtual Channel
                Caps:   LPEVC=0 RefClk=100ns PATEntryBits=1
                Arb:    Fixed- WRR32- WRR64- WRR128-
                Ctrl:   ArbSelect=Fixed
                Status: InProgress-
                VC0:    Caps:   PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
                        Arb:    Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
                        Ctrl:   Enable+ ID=0 ArbSelect=Fixed TC/VC=01
                        Status: NegoPending- InProgress-
        Capabilities: [300 v1] Device Serial Number 00-00-00-00-00-00-00-00
        Kernel modules: ath9k

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: ryzen X370: iommu - unusable huge groups
  2017-07-16  5:44 ryzen X370: iommu - unusable huge groups Andreas Hartmann
@ 2017-07-16 14:53 ` Alex Williamson
  2017-07-16 16:53   ` Andreas Hartmann
  0 siblings, 1 reply; 7+ messages in thread
From: Alex Williamson @ 2017-07-16 14:53 UTC (permalink / raw)
  To: Andreas Hartmann; +Cc: linux-pci@vger.kernel.org

On Sun, 16 Jul 2017 07:44:01 +0200
Andreas Hartmann <andihartmann@01019freenet.de> wrote:

> Hello!
> 
> I've got a Asus X370-Pro motherboard with enabled iommu. Unfortunately,
> the group 0 is mostly all of the system :-).
> 
> [    2.602426] iommu: Adding device 0000:00:01.0 to group 0
> [    2.602440] iommu: Adding device 0000:00:01.3 to group 0
> [    2.603368] iommu: Adding device 0000:03:00.0 to group 0
> [    2.603377] iommu: Adding device 0000:03:00.1 to group 0
> [    2.603385] iommu: Adding device 0000:03:00.2 to group 0
> [    2.603396] iommu: Adding device 0000:1d:00.0 to group 0
> [    2.603406] iommu: Adding device 0000:1d:02.0 to group 0
> [    2.603417] iommu: Adding device 0000:1d:03.0 to group 0
> [    2.603428] iommu: Adding device 0000:1d:04.0 to group 0
> [    2.603439] iommu: Adding device 0000:1d:06.0 to group 0
> [    2.603450] iommu: Adding device 0000:1d:07.0 to group 0
> [    2.603466] iommu: Adding device 0000:24:00.0 to group 0
> [    2.603481] iommu: Adding device 0000:25:00.0 to group 0
> [    2.603498] iommu: Adding device 0000:26:00.0 to group 0
> [    2.603513] iommu: Adding device 0000:27:00.0 to group 0


Update your motherboard BIOS, AMD AGESA 1.0.0.6 is supposed to
enable ACS in the PCIe root ports.  Thanks,

Alex

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: ryzen X370: iommu - unusable huge groups
  2017-07-16 14:53 ` Alex Williamson
@ 2017-07-16 16:53   ` Andreas Hartmann
  2017-07-16 18:56     ` Alex Williamson
  0 siblings, 1 reply; 7+ messages in thread
From: Andreas Hartmann @ 2017-07-16 16:53 UTC (permalink / raw)
  To: Alex Williamson; +Cc: linux-pci@vger.kernel.org

Hello Alex!

Nice to hear you again :-)



On 07/16/2017 at 04:53 PM Alex Williamson wrote:
> On Sun, 16 Jul 2017 07:44:01 +0200
> Andreas Hartmann <andihartmann@01019freenet.de> wrote:
> 
>> Hello!
>>
>> I've got a Asus X370-Pro motherboard with enabled iommu. Unfortunately,
>> the group 0 is mostly all of the system :-).
>>
>> [    2.602426] iommu: Adding device 0000:00:01.0 to group 0
>> [    2.602440] iommu: Adding device 0000:00:01.3 to group 0
>> [    2.603368] iommu: Adding device 0000:03:00.0 to group 0
>> [    2.603377] iommu: Adding device 0000:03:00.1 to group 0
>> [    2.603385] iommu: Adding device 0000:03:00.2 to group 0
>> [    2.603396] iommu: Adding device 0000:1d:00.0 to group 0
>> [    2.603406] iommu: Adding device 0000:1d:02.0 to group 0
>> [    2.603417] iommu: Adding device 0000:1d:03.0 to group 0
>> [    2.603428] iommu: Adding device 0000:1d:04.0 to group 0
>> [    2.603439] iommu: Adding device 0000:1d:06.0 to group 0
>> [    2.603450] iommu: Adding device 0000:1d:07.0 to group 0
>> [    2.603466] iommu: Adding device 0000:24:00.0 to group 0
>> [    2.603481] iommu: Adding device 0000:25:00.0 to group 0
>> [    2.603498] iommu: Adding device 0000:26:00.0 to group 0
>> [    2.603513] iommu: Adding device 0000:27:00.0 to group 0
> 
> 
> Update your motherboard BIOS, AMD AGESA 1.0.0.6 is supposed to
> enable ACS in the PCIe root ports.  Thanks,

Group 0 is now group 10 - that's mostly all :-( - no significant change.
(Version 805 which should contain AGESA 1.0.0.6).


[    2.600097] iommu: Adding device 0000:03:00.0 to group 10
[    2.600117] iommu: Adding device 0000:03:00.1 to group 10
[    2.600136] iommu: Adding device 0000:03:00.2 to group 10
[    2.600148] iommu: Adding device 0000:1d:00.0 to group 10
[    2.600158] iommu: Adding device 0000:1d:02.0 to group 10
[    2.600169] iommu: Adding device 0000:1d:03.0 to group 10
[    2.600180] iommu: Adding device 0000:1d:04.0 to group 10
[    2.600190] iommu: Adding device 0000:1d:06.0 to group 10
[    2.600201] iommu: Adding device 0000:1d:07.0 to group 10
[    2.600216] iommu: Adding device 0000:24:00.0 to group 10
[    2.600233] iommu: Adding device 0000:25:00.0 to group 10
[    2.600249] iommu: Adding device 0000:26:00.0 to group 10
[    2.600266] iommu: Adding device 0000:27:00.0 to group 10


All devices that are used are in the same group again.

Isn't it possible to allow them to put to VM anyway if there is no peer
to peer communication - same as it was possible with the previous
chipset (990xa)?




Thanks,
Andreas

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: ryzen X370: iommu - unusable huge groups
  2017-07-16 16:53   ` Andreas Hartmann
@ 2017-07-16 18:56     ` Alex Williamson
  2017-07-16 19:39       ` Andreas Hartmann
  0 siblings, 1 reply; 7+ messages in thread
From: Alex Williamson @ 2017-07-16 18:56 UTC (permalink / raw)
  To: Andreas Hartmann; +Cc: linux-pci@vger.kernel.org

On Sun, 16 Jul 2017 18:53:11 +0200
Andreas Hartmann <andihartmann@01019freenet.de> wrote:

> Hello Alex!
> 
> Nice to hear you again :-)
> 
> 
> 
> On 07/16/2017 at 04:53 PM Alex Williamson wrote:
> > On Sun, 16 Jul 2017 07:44:01 +0200
> > Andreas Hartmann <andihartmann@01019freenet.de> wrote:
> >   
> >> Hello!
> >>
> >> I've got a Asus X370-Pro motherboard with enabled iommu. Unfortunately,
> >> the group 0 is mostly all of the system :-).
> >>
> >> [    2.602426] iommu: Adding device 0000:00:01.0 to group 0
> >> [    2.602440] iommu: Adding device 0000:00:01.3 to group 0
> >> [    2.603368] iommu: Adding device 0000:03:00.0 to group 0
> >> [    2.603377] iommu: Adding device 0000:03:00.1 to group 0
> >> [    2.603385] iommu: Adding device 0000:03:00.2 to group 0
> >> [    2.603396] iommu: Adding device 0000:1d:00.0 to group 0
> >> [    2.603406] iommu: Adding device 0000:1d:02.0 to group 0
> >> [    2.603417] iommu: Adding device 0000:1d:03.0 to group 0
> >> [    2.603428] iommu: Adding device 0000:1d:04.0 to group 0
> >> [    2.603439] iommu: Adding device 0000:1d:06.0 to group 0
> >> [    2.603450] iommu: Adding device 0000:1d:07.0 to group 0
> >> [    2.603466] iommu: Adding device 0000:24:00.0 to group 0
> >> [    2.603481] iommu: Adding device 0000:25:00.0 to group 0
> >> [    2.603498] iommu: Adding device 0000:26:00.0 to group 0
> >> [    2.603513] iommu: Adding device 0000:27:00.0 to group 0  
> > 
> > 
> > Update your motherboard BIOS, AMD AGESA 1.0.0.6 is supposed to
> > enable ACS in the PCIe root ports.  Thanks,  
> 
> Group 0 is now group 10 - that's mostly all :-( - no significant change.
> (Version 805 which should contain AGESA 1.0.0.6).
> 
> 
> [    2.600097] iommu: Adding device 0000:03:00.0 to group 10
> [    2.600117] iommu: Adding device 0000:03:00.1 to group 10
> [    2.600136] iommu: Adding device 0000:03:00.2 to group 10
> [    2.600148] iommu: Adding device 0000:1d:00.0 to group 10
> [    2.600158] iommu: Adding device 0000:1d:02.0 to group 10
> [    2.600169] iommu: Adding device 0000:1d:03.0 to group 10
> [    2.600180] iommu: Adding device 0000:1d:04.0 to group 10
> [    2.600190] iommu: Adding device 0000:1d:06.0 to group 10
> [    2.600201] iommu: Adding device 0000:1d:07.0 to group 10
> [    2.600216] iommu: Adding device 0000:24:00.0 to group 10
> [    2.600233] iommu: Adding device 0000:25:00.0 to group 10
> [    2.600249] iommu: Adding device 0000:26:00.0 to group 10
> [    2.600266] iommu: Adding device 0000:27:00.0 to group 10
> 
> 
> All devices that are used are in the same group again.
> 
> Isn't it possible to allow them to put to VM anyway if there is no peer
> to peer communication - same as it was possible with the previous
> chipset (990xa)?

Ah, I see you have a PCIe switch with downstream ports 1d.*.0 where
the downstream switch ports don't support ACS (not surprising for
something reporting ASMedia as a subsystem capability).  So ACS was
broken at multiple levels and now that it's exposed at the root port
it's still broken by the non-ACS switch.  The endpoints downstream of
the switch are not sufficiently isolated to separate between VMs,
sorry, the hardware isn't up to the task at hand.  Thanks,

Alex

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: ryzen X370: iommu - unusable huge groups
  2017-07-16 18:56     ` Alex Williamson
@ 2017-07-16 19:39       ` Andreas Hartmann
  2017-07-17 13:52         ` Suravee Suthikulpanit
  0 siblings, 1 reply; 7+ messages in thread
From: Andreas Hartmann @ 2017-07-16 19:39 UTC (permalink / raw)
  To: Alex Williamson; +Cc: linux-pci@vger.kernel.org

On 07/16/2017 at 08:56 PM, Alex Williamson wrote:

> On Sun, 16 Jul 2017 18:53:11 +0200
> Andreas Hartmann <andihartmann@01019freenet.de> wrote:
> 
>> Hello Alex!
>>
>> Nice to hear you again :-)
>>
>>
>>
>> On 07/16/2017 at 04:53 PM Alex Williamson wrote:
>>> On Sun, 16 Jul 2017 07:44:01 +0200
>>> Andreas Hartmann <andihartmann@01019freenet.de> wrote:
>>>    
>>>> Hello!
>>>>
>>>> I've got a Asus X370-Pro motherboard with enabled iommu. Unfortunately,
>>>> the group 0 is mostly all of the system :-).
>>>>
>>>> [    2.602426] iommu: Adding device 0000:00:01.0 to group 0
>>>> [    2.602440] iommu: Adding device 0000:00:01.3 to group 0
>>>> [    2.603368] iommu: Adding device 0000:03:00.0 to group 0
>>>> [    2.603377] iommu: Adding device 0000:03:00.1 to group 0
>>>> [    2.603385] iommu: Adding device 0000:03:00.2 to group 0
>>>> [    2.603396] iommu: Adding device 0000:1d:00.0 to group 0
>>>> [    2.603406] iommu: Adding device 0000:1d:02.0 to group 0
>>>> [    2.603417] iommu: Adding device 0000:1d:03.0 to group 0
>>>> [    2.603428] iommu: Adding device 0000:1d:04.0 to group 0
>>>> [    2.603439] iommu: Adding device 0000:1d:06.0 to group 0
>>>> [    2.603450] iommu: Adding device 0000:1d:07.0 to group 0
>>>> [    2.603466] iommu: Adding device 0000:24:00.0 to group 0
>>>> [    2.603481] iommu: Adding device 0000:25:00.0 to group 0
>>>> [    2.603498] iommu: Adding device 0000:26:00.0 to group 0
>>>> [    2.603513] iommu: Adding device 0000:27:00.0 to group 0
>>>
>>>
>>> Update your motherboard BIOS, AMD AGESA 1.0.0.6 is supposed to
>>> enable ACS in the PCIe root ports.  Thanks,
>>
>> Group 0 is now group 10 - that's mostly all :-( - no significant change.
>> (Version 805 which should contain AGESA 1.0.0.6).
>>
>>
>> [    2.600097] iommu: Adding device 0000:03:00.0 to group 10
>> [    2.600117] iommu: Adding device 0000:03:00.1 to group 10
>> [    2.600136] iommu: Adding device 0000:03:00.2 to group 10
>> [    2.600148] iommu: Adding device 0000:1d:00.0 to group 10
>> [    2.600158] iommu: Adding device 0000:1d:02.0 to group 10
>> [    2.600169] iommu: Adding device 0000:1d:03.0 to group 10
>> [    2.600180] iommu: Adding device 0000:1d:04.0 to group 10
>> [    2.600190] iommu: Adding device 0000:1d:06.0 to group 10
>> [    2.600201] iommu: Adding device 0000:1d:07.0 to group 10
>> [    2.600216] iommu: Adding device 0000:24:00.0 to group 10
>> [    2.600233] iommu: Adding device 0000:25:00.0 to group 10
>> [    2.600249] iommu: Adding device 0000:26:00.0 to group 10
>> [    2.600266] iommu: Adding device 0000:27:00.0 to group 10
>>
>>
>> All devices that are used are in the same group again.
>>
>> Isn't it possible to allow them to put to VM anyway if there is no peer
>> to peer communication - same as it was possible with the previous
>> chipset (990xa)?
> 
> Ah, I see you have a PCIe switch with downstream ports 1d.*.0 where
> the downstream switch ports don't support ACS (not surprising for
> something reporting ASMedia as a subsystem capability).  So ACS was
> broken at multiple levels and now that it's exposed at the root port
> it's still broken by the non-ACS switch.  The endpoints downstream of
> the switch are not sufficiently isolated to separate between VMs,
> sorry, the hardware isn't up to the task at hand.  Thanks,

In other words, you're telling, that there can't be done anything to get 
it working? Do you know any other board, which doesn't have this problem 
and could work?

Gigabyte? Asrock?


Thanks,
Andreas

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: ryzen X370: iommu - unusable huge groups
  2017-07-16 19:39       ` Andreas Hartmann
@ 2017-07-17 13:52         ` Suravee Suthikulpanit
  2018-09-08 14:59           ` Andreas Hartmann
  0 siblings, 1 reply; 7+ messages in thread
From: Suravee Suthikulpanit @ 2017-07-17 13:52 UTC (permalink / raw)
  To: Andreas Hartmann, Alex Williamson; +Cc: linux-pci@vger.kernel.org



On 7/17/17 02:39, Andreas Hartmann wrote:
> On 07/16/2017 at 08:56 PM, Alex Williamson wrote:
>
>> On Sun, 16 Jul 2017 18:53:11 +0200
>> Andreas Hartmann <andihartmann@01019freenet.de> wrote:
>>
>>> Hello Alex!
>>>
>>> Nice to hear you again :-)
>>>
>>>
>>>
>>> On 07/16/2017 at 04:53 PM Alex Williamson wrote:
>>>> On Sun, 16 Jul 2017 07:44:01 +0200
>>>> Andreas Hartmann <andihartmann@01019freenet.de> wrote:
>>>>
>>>>> Hello!
>>>>>
>>>>> I've got a Asus X370-Pro motherboard with enabled iommu. Unfortunately,
>>>>> the group 0 is mostly all of the system :-).
>>>>>
>>>>> [    2.602426] iommu: Adding device 0000:00:01.0 to group 0
>>>>> [    2.602440] iommu: Adding device 0000:00:01.3 to group 0
>>>>> [    2.603368] iommu: Adding device 0000:03:00.0 to group 0
>>>>> [    2.603377] iommu: Adding device 0000:03:00.1 to group 0
>>>>> [    2.603385] iommu: Adding device 0000:03:00.2 to group 0
>>>>> [    2.603396] iommu: Adding device 0000:1d:00.0 to group 0
>>>>> [    2.603406] iommu: Adding device 0000:1d:02.0 to group 0
>>>>> [    2.603417] iommu: Adding device 0000:1d:03.0 to group 0
>>>>> [    2.603428] iommu: Adding device 0000:1d:04.0 to group 0
>>>>> [    2.603439] iommu: Adding device 0000:1d:06.0 to group 0
>>>>> [    2.603450] iommu: Adding device 0000:1d:07.0 to group 0
>>>>> [    2.603466] iommu: Adding device 0000:24:00.0 to group 0
>>>>> [    2.603481] iommu: Adding device 0000:25:00.0 to group 0
>>>>> [    2.603498] iommu: Adding device 0000:26:00.0 to group 0
>>>>> [    2.603513] iommu: Adding device 0000:27:00.0 to group 0
>>>>
>>>>
>>>> Update your motherboard BIOS, AMD AGESA 1.0.0.6 is supposed to
>>>> enable ACS in the PCIe root ports.  Thanks,
>>>
>>> Group 0 is now group 10 - that's mostly all :-( - no significant change.
>>> (Version 805 which should contain AGESA 1.0.0.6).
>>>
>>>
>>> [    2.600097] iommu: Adding device 0000:03:00.0 to group 10
>>> [    2.600117] iommu: Adding device 0000:03:00.1 to group 10
>>> [    2.600136] iommu: Adding device 0000:03:00.2 to group 10
>>> [    2.600148] iommu: Adding device 0000:1d:00.0 to group 10
>>> [    2.600158] iommu: Adding device 0000:1d:02.0 to group 10
>>> [    2.600169] iommu: Adding device 0000:1d:03.0 to group 10
>>> [    2.600180] iommu: Adding device 0000:1d:04.0 to group 10
>>> [    2.600190] iommu: Adding device 0000:1d:06.0 to group 10
>>> [    2.600201] iommu: Adding device 0000:1d:07.0 to group 10
>>> [    2.600216] iommu: Adding device 0000:24:00.0 to group 10
>>> [    2.600233] iommu: Adding device 0000:25:00.0 to group 10
>>> [    2.600249] iommu: Adding device 0000:26:00.0 to group 10
>>> [    2.600266] iommu: Adding device 0000:27:00.0 to group 10
>>>
>>>
>>> All devices that are used are in the same group again.
>>>
>>> Isn't it possible to allow them to put to VM anyway if there is no peer
>>> to peer communication - same as it was possible with the previous
>>> chipset (990xa)?
>>
>> Ah, I see you have a PCIe switch with downstream ports 1d.*.0 where
>> the downstream switch ports don't support ACS (not surprising for
>> something reporting ASMedia as a subsystem capability).  So ACS was
>> broken at multiple levels and now that it's exposed at the root port
>> it's still broken by the non-ACS switch.  The endpoints downstream of
>> the switch are not sufficiently isolated to separate between VMs,
>> sorry, the hardware isn't up to the task at hand.  Thanks,
>
> In other words, you're telling, that there can't be done anything to get it
> working? Do you know any other board, which doesn't have this problem and could
> work?
>
> Gigabyte? Asrock?
>
>
> Thanks,
> Andreas

I have checked with the BIOS team, and they said that this is supposed to get 
fixed in 1.0.0.7.  Sorry for inconvenience.

Suravee

^ permalink raw reply	[flat|nested] 7+ messages in thread

* ryzen X370: iommu - unusable huge groups
  2017-07-17 13:52         ` Suravee Suthikulpanit
@ 2018-09-08 14:59           ` Andreas Hartmann
  0 siblings, 0 replies; 7+ messages in thread
From: Andreas Hartmann @ 2018-09-08 14:59 UTC (permalink / raw)
  To: Suravee Suthikulpanit, Alex Williamson; +Cc: linux-pci@vger.kernel.org

Hello Suravee,

On 07/17/2017 at 03:52 PM Suravee Suthikulpanit wrote:
> 
> 
> On 7/17/17 02:39, Andreas Hartmann wrote:
>> On 07/16/2017 at 08:56 PM, Alex Williamson wrote:
>>
>>> On Sun, 16 Jul 2017 18:53:11 +0200
>>> Andreas Hartmann <andihartmann@01019freenet.de> wrote:
>>>
>>>> Hello Alex!
>>>>
>>>> Nice to hear you again :-)
>>>>
>>>>
>>>>
>>>> On 07/16/2017 at 04:53 PM Alex Williamson wrote:
>>>>> On Sun, 16 Jul 2017 07:44:01 +0200
>>>>> Andreas Hartmann <andihartmann@01019freenet.de> wrote:
>>>>>
>>>>>> Hello!
>>>>>>
>>>>>> I've got a Asus X370-Pro motherboard with enabled iommu.
>>>>>> Unfortunately,
>>>>>> the group 0 is mostly all of the system :-).
>>>>>>
>>>>>> [    2.602426] iommu: Adding device 0000:00:01.0 to group 0
>>>>>> [    2.602440] iommu: Adding device 0000:00:01.3 to group 0
>>>>>> [    2.603368] iommu: Adding device 0000:03:00.0 to group 0
>>>>>> [    2.603377] iommu: Adding device 0000:03:00.1 to group 0
>>>>>> [    2.603385] iommu: Adding device 0000:03:00.2 to group 0
>>>>>> [    2.603396] iommu: Adding device 0000:1d:00.0 to group 0
>>>>>> [    2.603406] iommu: Adding device 0000:1d:02.0 to group 0
>>>>>> [    2.603417] iommu: Adding device 0000:1d:03.0 to group 0
>>>>>> [    2.603428] iommu: Adding device 0000:1d:04.0 to group 0
>>>>>> [    2.603439] iommu: Adding device 0000:1d:06.0 to group 0
>>>>>> [    2.603450] iommu: Adding device 0000:1d:07.0 to group 0
>>>>>> [    2.603466] iommu: Adding device 0000:24:00.0 to group 0
>>>>>> [    2.603481] iommu: Adding device 0000:25:00.0 to group 0
>>>>>> [    2.603498] iommu: Adding device 0000:26:00.0 to group 0
>>>>>> [    2.603513] iommu: Adding device 0000:27:00.0 to group 0
>>>>>
>>>>>
>>>>> Update your motherboard BIOS, AMD AGESA 1.0.0.6 is supposed to
>>>>> enable ACS in the PCIe root ports.  Thanks,
>>>>
>>>> Group 0 is now group 10 - that's mostly all :-( - no significant
>>>> change.
>>>> (Version 805 which should contain AGESA 1.0.0.6).
>>>>
>>>>
>>>> [    2.600097] iommu: Adding device 0000:03:00.0 to group 10
>>>> [    2.600117] iommu: Adding device 0000:03:00.1 to group 10
>>>> [    2.600136] iommu: Adding device 0000:03:00.2 to group 10
>>>> [    2.600148] iommu: Adding device 0000:1d:00.0 to group 10
>>>> [    2.600158] iommu: Adding device 0000:1d:02.0 to group 10
>>>> [    2.600169] iommu: Adding device 0000:1d:03.0 to group 10
>>>> [    2.600180] iommu: Adding device 0000:1d:04.0 to group 10
>>>> [    2.600190] iommu: Adding device 0000:1d:06.0 to group 10
>>>> [    2.600201] iommu: Adding device 0000:1d:07.0 to group 10
>>>> [    2.600216] iommu: Adding device 0000:24:00.0 to group 10
>>>> [    2.600233] iommu: Adding device 0000:25:00.0 to group 10
>>>> [    2.600249] iommu: Adding device 0000:26:00.0 to group 10
>>>> [    2.600266] iommu: Adding device 0000:27:00.0 to group 10
>>>>
>>>>
>>>> All devices that are used are in the same group again.
>>>>
>>>> Isn't it possible to allow them to put to VM anyway if there is no peer
>>>> to peer communication - same as it was possible with the previous
>>>> chipset (990xa)?
>>>
>>> Ah, I see you have a PCIe switch with downstream ports 1d.*.0 where
>>> the downstream switch ports don't support ACS (not surprising for
>>> something reporting ASMedia as a subsystem capability).  So ACS was
>>> broken at multiple levels and now that it's exposed at the root port
>>> it's still broken by the non-ACS switch.  The endpoints downstream of
>>> the switch are not sufficiently isolated to separate between VMs,
>>> sorry, the hardware isn't up to the task at hand.  Thanks,
>>
>> In other words, you're telling, that there can't be done anything to
>> get it
>> working? Do you know any other board, which doesn't have this problem
>> and could
>> work?
>>
>> Gigabyte? Asrock?
>>
>>
>> Thanks,
>> Andreas
> 
> I have checked with the BIOS team, and they said that this is supposed
> to get fixed in 1.0.0.7.  Sorry for inconvenience.

We are now more than one year later now and there isn't any usable fix
out there. I'm using BIOS 4011 04/19/2018 on my Asus Prime X370Pro and
it's still impossible to put two pcie cards each to a different VM.

There is a small fix, but it's still unusable:



[    1.913322] iommu: Adding device 0000:00:01.0 to group 0         00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
[    1.913464] iommu: Adding device 0000:00:01.3 to group 1         00:01.3 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
[    1.913587] iommu: Adding device 0000:00:02.0 to group 2         00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
[    1.913721] iommu: Adding device 0000:00:03.0 to group 3         00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
[    1.913855] iommu: Adding device 0000:00:03.1 to group 4         00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1453
[    1.913974] iommu: Adding device 0000:00:04.0 to group 5         00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
[    1.914106] iommu: Adding device 0000:00:07.0 to group 6         00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
[    1.914228] iommu: Adding device 0000:00:07.1 to group 7         00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1454
[    1.914355] iommu: Adding device 0000:00:08.0 to group 8         00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1452
[    1.914475] iommu: Adding device 0000:00:08.1 to group 9         00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 1454

[    1.914599] iommu: Adding device 0000:00:14.0 to group 10        00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 59)
[    1.914609] iommu: Adding device 0000:00:14.3 to group 10        00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)

[    1.914739] iommu: Adding device 0000:00:18.0 to group 11        00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1460
[    1.914749] iommu: Adding device 0000:00:18.1 to group 11        00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1461
[    1.914760] iommu: Adding device 0000:00:18.2 to group 11        00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1462
[    1.914768] iommu: Adding device 0000:00:18.3 to group 11        00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1463
[    1.914776] iommu: Adding device 0000:00:18.4 to group 11        00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1464
[    1.914786] iommu: Adding device 0000:00:18.5 to group 11        00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1465
[    1.914795] iommu: Adding device 0000:00:18.6 to group 11        00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1466
[    1.914803] iommu: Adding device 0000:00:18.7 to group 11        00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Device 1467

[    1.914945] iommu: Adding device 0000:01:00.0 to group 12        01:00.0 USB controller: Advanced Micro Devices, Inc. [AMD] Device 43b9 (rev 02)
[    1.914967] iommu: Adding device 0000:01:00.1 to group 12        01:00.1 SATA controller: Advanced Micro Devices, Inc. [AMD] Device 43b5 (rev 02)
[    1.914990] iommu: Adding device 0000:01:00.2 to group 12        01:00.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b0 (rev 02)
[    1.915000] iommu: Adding device 0000:02:00.0 to group 12        02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
[    1.915010] iommu: Adding device 0000:02:02.0 to group 12        02:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
[    1.915020] iommu: Adding device 0000:02:03.0 to group 12        02:03.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
[    1.915029] iommu: Adding device 0000:02:04.0 to group 12        02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
[    1.915040] iommu: Adding device 0000:02:06.0 to group 12        02:06.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
[    1.915049] iommu: Adding device 0000:02:07.0 to group 12        02:07.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Device 43b4 (rev 02)
[    1.915065] iommu: Adding device 0000:05:00.0 to group 12            05:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
[    1.915082] iommu: Adding device 0000:06:00.0 to group 12        06:00.0 USB controller: ASMedia Technology Inc. Device 1343
[    1.915099] iommu: Adding device 0000:07:00.0 to group 12            07:00.0 Ethernet controller: Intel Corporation I211 Gigabit Network Connection (rev 03)
[    1.915116] iommu: Adding device 0000:08:00.0 to group 12            08:00.0 Network controller: Qualcomm Atheros AR93xx Wireless Network Adapter (rev 01)

[    1.915256] iommu: Adding device 0000:09:00.0 to group 13        09:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Turks PRO [Radeon HD 6570/7570/8550]
[    1.915282] iommu: Adding device 0000:09:00.1 to group 13        09:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Turks/Whistler HDMI Audio [Radeon HD 6000 Series]

[    1.915410] iommu: Adding device 0000:0a:00.0 to group 14        0a:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 145a
[    1.915539] iommu: Adding device 0000:0a:00.2 to group 15        0a:00.2 Encryption controller: Advanced Micro Devices, Inc. [AMD] Device 1456
[    1.915664] iommu: Adding device 0000:0a:00.3 to group 16        0a:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] USB3 Host Controller
[    1.915792] iommu: Adding device 0000:0b:00.0 to group 17        0b:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Device 1455
[    1.915916] iommu: Adding device 0000:0b:00.2 to group 18        0b:00.2 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
[    1.916071] iommu: Adding device 0000:0b:00.3 to group 19        0b:00.3 Audio device: Advanced Micro Devices, Inc. [AMD] Device 1457


For me, device 0000:07:00.0 and 0000:08:00.0 is relevant - now they are both belonging to group 12.

Since more than a year I'm using the PCIe ACS overrides patch (pcie_acs_override=multifunction) to put those devices to two different VMs
and it always worked like a charme - I didn't had any problem so far (now using linux 4.18.6).

Could you please provide official pci quirks for this chipset?


Thanks,
Andreas

^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2018-09-08 19:54 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2017-07-16  5:44 ryzen X370: iommu - unusable huge groups Andreas Hartmann
2017-07-16 14:53 ` Alex Williamson
2017-07-16 16:53   ` Andreas Hartmann
2017-07-16 18:56     ` Alex Williamson
2017-07-16 19:39       ` Andreas Hartmann
2017-07-17 13:52         ` Suravee Suthikulpanit
2018-09-08 14:59           ` Andreas Hartmann

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).