From: Dana Goyette <DanaGoyette@gmail.com>
To: kvm@vger.kernel.org
Subject: Re: IOMMU groups ... PEX8606 switch?
Date: Sat, 04 Jan 2014 11:26:54 -0800 [thread overview]
Message-ID: <la9n9k$g63$1@ger.gmane.org> (raw)
In-Reply-To: <1388793837.3169.73.camel@bling.home>
On 01/03/2014 04:03 PM, Alex Williamson wrote:
> On Mon, 2013-12-30 at 16:13 -0800, Dana Goyette wrote:
>> On 12/29/2013 08:16 PM, Alex Williamson wrote:
>>> On Sat, 2013-12-28 at 23:32 -0800, Dana Goyette wrote:
>>>> On 12/28/2013 7:23 PM, Alex Williamson wrote:
>>>>> On Sat, 2013-12-28 at 18:31 -0800, Dana Goyette wrote:
>>>>>> I have purchased both a SuperMicro X10SAE and an X10SAT, and I need to
>>>>>> soon decide which one to keep.
>>>>>>
>>>>>> The SuperMicro X10SAT has all the PCIe x1 slots hidden behind a PLX
>>>>>> PEX8066 switch, which claims to support ACS. I'd expect the devices
>>>>>> downstream of the PLX switch to be in separate groups.
>>>>>>
>>>>>> With Linux 3.13-rc5 and "enable overrides for missing ACS capabilities"
>>>>>> applied and set for the Intel root ports, the devices behind the switch
>>>>>> remain stuck in the same group.
>>>>>>
>>>>>> In terms of passing devices to different VMs, which is better: all
>>>>>> devices on different root ports, or all devices behind the one
>>>>>> ACS-supporting switch?
>>>>> Can you provide lspci -vvv info? If you're getting that for groups
>>>>> either the switch has ACS capabilities, but doesn't support the features
>>>>> we need or we're doing something wrong. Thanks,
>>>>>
>>>> I initially tried attaching the output as a .txt file, but it's too
>>>> large. Anyway, here's the output of lspci -nnvvv (you may notice that I
>>>> moved the Radeon to a different slot).
>>> Well, something seems amiss since the downstream switch ports all seem
>>> to support and enable the correct set of ACS capabilities. I'm tending
>>> to suspect something wrong with the ACS override patch or how it's being
>>> used since your IOMMU group is still based at the root port. Each root
>>> port is isolated from the other root ports though, so something is
>>> happening with the override patch. Can you provide the kernel command
>>> line you use to enable ACS overrides and the override patch you're
>>> using, as it applies to 3.13-rc5? Thanks,
>>>
>>> Alex
>>>
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe kvm" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>>
>> I'm using the original acs-override patch from this post:
>> https://lkml.org/lkml/2013/5/30/513
>>
>> Kernel parameter is:
>> pcie_acs_override=id:8086:8c10,id:8086:8c12,id:8086:8c16,id:8086:8c18
>>
>> When booting a kernel without the override patch, the following devices
>> are all in the same group: Intel Root Ports 1, 2, 4, 5; ASMedia SATA
>> controller; PLX PEX8606 switch; Renesas USB controller; TI Firewire
>> controller; Intel I210 Ethernet controller.
> Could you please try the patch below and send dmesg for the system once
> booted. This applies directly to upstream and includes the acs override
> patch. Thanks,
(removed patch from quote.)
Here's the complete dmesg, with pcie_acs_override still set:
http://pastebin.com/YHuKnrTb
Most relevant section:
[ 0.524362] DMAR: No ATSR found
[ 0.524386] IOMMU 1 0xfed91000: using Queued invalidation
[ 0.524389] IOMMU: Setting RMRR:
[ 0.524398] IOMMU: Setting identity map for device 0000:00:1d.0
[0x7bea1000 - 0x7beaffff]
[ 0.524423] IOMMU: Setting identity map for device 0000:00:1a.0
[0x7bea1000 - 0x7beaffff]
[ 0.524441] IOMMU: Setting identity map for device 0000:00:14.0
[0x7bea1000 - 0x7beaffff]
[ 0.524454] IOMMU: Prepare 0-16MiB unity mapping for LPC
[ 0.524461] IOMMU: Setting identity map for device 0000:00:1f.0 [0x0
- 0xffffff]
[ 0.524548] PCI-DMA: Intel(R) Virtualization Technology for Directed I/O
[ 0.524551] intel_iommu_add_device(0000:00:00.0)
[ 0.524552] dma_pdev #1: 0000:00:00.0
[ 0.524553] dma_pdev #2: 0000:00:00.0
[ 0.524554] dma_pdev #3: 0000:00:00.0
[ 0.524554] dma_pdev #4: 0000:00:00.0
[ 0.524565] intel_iommu_add_device(0000:00:01.0)
[ 0.524566] dma_pdev #1: 0000:00:01.0
[ 0.524567] dma_pdev #2: 0000:00:01.0
[ 0.524569] pci_acs_enabled(0000:00:01.0, 001d)
[ 0.524572] pci_acs_flags_enabled no ACS capability on 0000:00:01.0
[ 0.524573] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false
[ 0.524574] -> false
[ 0.524575] pci_acs_enabled(0000:00:01.0, 001d)
[ 0.524577] pci_acs_flags_enabled no ACS capability on 0000:00:01.0
[ 0.524578] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false
[ 0.524579] -> false
[ 0.524580] dma_pdev #3: 0000:00:01.0
[ 0.524581] dma_pdev #4: 0000:00:01.0
[ 0.524584] intel_iommu_add_device(0000:00:01.1)
[ 0.524586] dma_pdev #1: 0000:00:01.1
[ 0.524586] dma_pdev #2: 0000:00:01.1
[ 0.524587] pci_acs_enabled(0000:00:01.1, 001d)
[ 0.524589] pci_acs_flags_enabled no ACS capability on 0000:00:01.1
[ 0.524590] pci_acs_flags_enabled(0000:00:01.1, 001d) -> false
[ 0.524591] -> false
[ 0.524592] pci_acs_enabled(0000:00:01.0, 001d)
[ 0.524593] pci_acs_flags_enabled no ACS capability on 0000:00:01.0
[ 0.524595] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false
[ 0.524596] -> false
[ 0.524596] dma_pdev #3: 0000:00:01.0
[ 0.524597] dma_pdev #4: 0000:00:01.0
[ 0.524599] intel_iommu_add_device(0000:00:02.0)
[ 0.524601] dma_pdev #1: 0000:00:02.0
[ 0.524601] dma_pdev #2: 0000:00:02.0
[ 0.524602] dma_pdev #3: 0000:00:02.0
[ 0.524603] dma_pdev #4: 0000:00:02.0
[ 0.524606] intel_iommu_add_device(0000:00:03.0)
[ 0.524607] dma_pdev #1: 0000:00:03.0
[ 0.524608] dma_pdev #2: 0000:00:03.0
[ 0.524609] dma_pdev #3: 0000:00:03.0
[ 0.524610] dma_pdev #4: 0000:00:03.0
[ 0.524613] intel_iommu_add_device(0000:00:14.0)
[ 0.524614] dma_pdev #1: 0000:00:14.0
[ 0.524615] dma_pdev #2: 0000:00:14.0
[ 0.524616] dma_pdev #3: 0000:00:14.0
[ 0.524617] dma_pdev #4: 0000:00:14.0
[ 0.524620] intel_iommu_add_device(0000:00:16.0)
[ 0.524621] dma_pdev #1: 0000:00:16.0
[ 0.524622] dma_pdev #2: 0000:00:16.0
[ 0.524623] pci_acs_enabled(0000:00:16.0, 001d)
[ 0.524624] -> false
[ 0.524625] pci_acs_enabled(0000:00:16.0, 001d)
[ 0.524626] -> false
[ 0.524626] dma_pdev #3: 0000:00:16.0
[ 0.524627] dma_pdev #4: 0000:00:16.0
[ 0.524630] intel_iommu_add_device(0000:00:16.3)
[ 0.524631] dma_pdev #1: 0000:00:16.3
[ 0.524632] dma_pdev #2: 0000:00:16.3
[ 0.524633] pci_acs_enabled(0000:00:16.3, 001d)
[ 0.524634] -> false
[ 0.524635] pci_acs_enabled(0000:00:16.0, 001d)
[ 0.524636] -> false
[ 0.524637] dma_pdev #3: 0000:00:16.0
[ 0.524638] dma_pdev #4: 0000:00:16.0
[ 0.524640] intel_iommu_add_device(0000:00:19.0)
[ 0.524641] dma_pdev #1: 0000:00:19.0
[ 0.524642] dma_pdev #2: 0000:00:19.0
[ 0.524643] dma_pdev #3: 0000:00:19.0
[ 0.524643] dma_pdev #4: 0000:00:19.0
[ 0.524646] intel_iommu_add_device(0000:00:1a.0)
[ 0.524647] dma_pdev #1: 0000:00:1a.0
[ 0.524648] dma_pdev #2: 0000:00:1a.0
[ 0.524649] dma_pdev #3: 0000:00:1a.0
[ 0.524650] dma_pdev #4: 0000:00:1a.0
[ 0.524654] intel_iommu_add_device(0000:00:1b.0)
[ 0.524655] dma_pdev #1: 0000:00:1b.0
[ 0.524656] dma_pdev #2: 0000:00:1b.0
[ 0.524657] dma_pdev #3: 0000:00:1b.0
[ 0.524658] dma_pdev #4: 0000:00:1b.0
[ 0.524661] intel_iommu_add_device(0000:00:1c.0)
[ 0.524662] dma_pdev #1: 0000:00:1c.0
[ 0.524663] dma_pdev #2: 0000:00:1c.0
[ 0.524664] pci_acs_enabled(0000:00:1c.0, 001d)
[ 0.524665] PCIe ACS override match for 0000:00:1c.0
[ 0.524666] -> true
[ 0.524667] dma_pdev #3: 0000:00:1c.0
[ 0.524668] dma_pdev #4: 0000:00:1c.0
[ 0.524671] intel_iommu_add_device(0000:00:1c.1)
[ 0.524672] dma_pdev #1: 0000:00:1c.1
[ 0.524673] dma_pdev #2: 0000:00:1c.1
[ 0.524674] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524681] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524682] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524683] -> false
[ 0.524684] pci_acs_enabled(0000:00:1c.0, 001d)
[ 0.524685] PCIe ACS override match for 0000:00:1c.0
[ 0.524686] -> true
[ 0.524687] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524694] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524695] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524696] -> false
[ 0.524697] dma_pdev #3: 0000:00:1c.1
[ 0.524698] dma_pdev #4: 0000:00:1c.1
[ 0.524700] intel_iommu_add_device(0000:00:1c.3)
[ 0.524701] dma_pdev #1: 0000:00:1c.3
[ 0.524702] dma_pdev #2: 0000:00:1c.3
[ 0.524703] pci_acs_enabled(0000:00:1c.3, 001d)
[ 0.524704] PCIe ACS override match for 0000:00:1c.3
[ 0.524705] -> true
[ 0.524706] dma_pdev #3: 0000:00:1c.3
[ 0.524707] dma_pdev #4: 0000:00:1c.3
[ 0.524710] intel_iommu_add_device(0000:00:1c.4)
[ 0.524711] dma_pdev #1: 0000:00:1c.4
[ 0.524712] dma_pdev #2: 0000:00:1c.4
[ 0.524713] pci_acs_enabled(0000:00:1c.4, 001d)
[ 0.524714] PCIe ACS override match for 0000:00:1c.4
[ 0.524715] -> true
[ 0.524715] dma_pdev #3: 0000:00:1c.4
[ 0.524716] dma_pdev #4: 0000:00:1c.4
[ 0.524719] intel_iommu_add_device(0000:00:1d.0)
[ 0.524720] dma_pdev #1: 0000:00:1d.0
[ 0.524721] dma_pdev #2: 0000:00:1d.0
[ 0.524722] dma_pdev #3: 0000:00:1d.0
[ 0.524723] dma_pdev #4: 0000:00:1d.0
[ 0.524726] intel_iommu_add_device(0000:00:1f.0)
[ 0.524727] dma_pdev #1: 0000:00:1f.0
[ 0.524728] dma_pdev #2: 0000:00:1f.0
[ 0.524728] pci_acs_enabled(0000:00:1f.0, 001d)
[ 0.524729] -> false
[ 0.524730] pci_acs_enabled(0000:00:1f.0, 001d)
[ 0.524731] -> false
[ 0.524732] dma_pdev #3: 0000:00:1f.0
[ 0.524733] dma_pdev #4: 0000:00:1f.0
[ 0.524736] intel_iommu_add_device(0000:00:1f.2)
[ 0.524737] dma_pdev #1: 0000:00:1f.2
[ 0.524738] dma_pdev #2: 0000:00:1f.2
[ 0.524739] pci_acs_enabled(0000:00:1f.2, 001d)
[ 0.524740] -> false
[ 0.524741] pci_acs_enabled(0000:00:1f.0, 001d)
[ 0.524741] -> false
[ 0.524742] dma_pdev #3: 0000:00:1f.0
[ 0.524743] dma_pdev #4: 0000:00:1f.0
[ 0.524745] intel_iommu_add_device(0000:00:1f.3)
[ 0.524746] dma_pdev #1: 0000:00:1f.3
[ 0.524747] dma_pdev #2: 0000:00:1f.3
[ 0.524748] pci_acs_enabled(0000:00:1f.3, 001d)
[ 0.524749] -> false
[ 0.524750] pci_acs_enabled(0000:00:1f.0, 001d)
[ 0.524751] -> false
[ 0.524752] dma_pdev #3: 0000:00:1f.0
[ 0.524752] dma_pdev #4: 0000:00:1f.0
[ 0.524754] intel_iommu_add_device(0000:00:1f.6)
[ 0.524755] dma_pdev #1: 0000:00:1f.6
[ 0.524756] dma_pdev #2: 0000:00:1f.6
[ 0.524757] pci_acs_enabled(0000:00:1f.6, 001d)
[ 0.524758] -> false
[ 0.524759] pci_acs_enabled(0000:00:1f.0, 001d)
[ 0.524760] -> false
[ 0.524761] dma_pdev #3: 0000:00:1f.0
[ 0.524762] dma_pdev #4: 0000:00:1f.0
[ 0.524765] intel_iommu_add_device(0000:01:00.0)
[ 0.524766] dma_pdev #1: 0000:01:00.0
[ 0.524767] dma_pdev #2: 0000:01:00.0
[ 0.524768] pci_acs_enabled(0000:01:00.0, 001d)
[ 0.524771] pci_acs_flags_enabled no ACS capability on 0000:01:00.0
[ 0.524772] pci_acs_flags_enabled(0000:01:00.0, 001d) -> false
[ 0.524773] -> false
[ 0.524774] pci_acs_enabled(0000:01:00.0, 001d)
[ 0.524776] pci_acs_flags_enabled no ACS capability on 0000:01:00.0
[ 0.524777] pci_acs_flags_enabled(0000:01:00.0, 001d) -> false
[ 0.524778] -> false
[ 0.524779] dma_pdev #3: 0000:01:00.0
[ 0.524780] pci_acs_path_enabled(0000:00:01.0, NULL, 001d)
[ 0.524781] pci_acs_enabled(0000:00:01.0, 001d)
[ 0.524783] pci_acs_flags_enabled no ACS capability on 0000:00:01.0
[ 0.524784] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false
[ 0.524785] -> false
[ 0.524786] -> false
[ 0.524787] dma_pdev #4: 0000:00:01.0
[ 0.524789] intel_iommu_add_device(0000:01:00.1)
[ 0.524790] dma_pdev #1: 0000:01:00.1
[ 0.524791] dma_pdev #2: 0000:01:00.1
[ 0.524792] pci_acs_enabled(0000:01:00.1, 001d)
[ 0.524794] pci_acs_flags_enabled no ACS capability on 0000:01:00.1
[ 0.524795] pci_acs_flags_enabled(0000:01:00.1, 001d) -> false
[ 0.524796] -> false
[ 0.524797] pci_acs_enabled(0000:01:00.0, 001d)
[ 0.524799] pci_acs_flags_enabled no ACS capability on 0000:01:00.0
[ 0.524800] pci_acs_flags_enabled(0000:01:00.0, 001d) -> false
[ 0.524801] -> false
[ 0.524802] dma_pdev #3: 0000:01:00.0
[ 0.524803] pci_acs_path_enabled(0000:00:01.0, NULL, 001d)
[ 0.524804] pci_acs_enabled(0000:00:01.0, 001d)
[ 0.524806] pci_acs_flags_enabled no ACS capability on 0000:00:01.0
[ 0.524807] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false
[ 0.524808] -> false
[ 0.524809] -> false
[ 0.524809] dma_pdev #4: 0000:00:01.0
[ 0.524811] intel_iommu_add_device(0000:02:00.0)
[ 0.524813] dma_pdev #1: 0000:02:00.0
[ 0.524813] dma_pdev #2: 0000:02:00.0
[ 0.524814] dma_pdev #3: 0000:02:00.0
[ 0.524815] pci_acs_path_enabled(0000:00:01.1, NULL, 001d)
[ 0.524816] pci_acs_enabled(0000:00:01.1, 001d)
[ 0.524818] pci_acs_flags_enabled no ACS capability on 0000:00:01.1
[ 0.524819] pci_acs_flags_enabled(0000:00:01.1, 001d) -> false
[ 0.524820] -> false
[ 0.524821] -> false
[ 0.524822] dma_pdev #4: 0000:00:01.1
[ 0.524824] intel_iommu_add_device(0000:03:04.0)
[ 0.524825] Upstream bridge 0000:02:00.0
[ 0.524830] dma_pdev #1: 0000:02:00.0
[ 0.524831] dma_pdev #2: 0000:02:00.0
[ 0.524832] dma_pdev #3: 0000:02:00.0
[ 0.524833] pci_acs_path_enabled(0000:00:01.1, NULL, 001d)
[ 0.524834] pci_acs_enabled(0000:00:01.1, 001d)
[ 0.524835] pci_acs_flags_enabled no ACS capability on 0000:00:01.1
[ 0.524837] pci_acs_flags_enabled(0000:00:01.1, 001d) -> false
[ 0.524837] -> false
[ 0.524838] -> false
[ 0.524839] dma_pdev #4: 0000:00:01.1
[ 0.524841] intel_iommu_add_device(0000:04:00.0)
[ 0.524842] dma_pdev #1: 0000:04:00.0
[ 0.524843] dma_pdev #2: 0000:04:00.0
[ 0.524844] dma_pdev #3: 0000:04:00.0
[ 0.524845] pci_acs_path_enabled(0000:00:1c.0, NULL, 001d)
[ 0.524846] pci_acs_enabled(0000:00:1c.0, 001d)
[ 0.524847] PCIe ACS override match for 0000:00:1c.0
[ 0.524848] -> true
[ 0.524849] -> true
[ 0.524849] dma_pdev #4: 0000:04:00.0
[ 0.524852] intel_iommu_add_device(0000:05:00.0)
[ 0.524853] dma_pdev #1: 0000:05:00.0
[ 0.524854] dma_pdev #2: 0000:05:00.0
[ 0.524855] dma_pdev #3: 0000:05:00.0
[ 0.524856] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.524857] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524865] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524866] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524867] -> false
[ 0.524868] -> false
[ 0.524869] dma_pdev #4: 0000:00:1c.1
[ 0.524871] intel_iommu_add_device(0000:06:01.0)
[ 0.524872] dma_pdev #1: 0000:06:01.0
[ 0.524872] dma_pdev #2: 0000:06:01.0
[ 0.524873] dma_pdev #3: 0000:06:01.0
[ 0.524874] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.524875] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.524876] PCIe ACS override match for 0000:05:00.0
[ 0.524877] -> true
[ 0.524878] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524886] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524887] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524888] -> false
[ 0.524888] -> false
[ 0.524889] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.524891] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524898] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524899] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524900] -> false
[ 0.524901] -> false
[ 0.524901] dma_pdev #4: 0000:00:1c.1
[ 0.524903] intel_iommu_add_device(0000:06:04.0)
[ 0.524904] dma_pdev #1: 0000:06:04.0
[ 0.524905] dma_pdev #2: 0000:06:04.0
[ 0.524906] dma_pdev #3: 0000:06:04.0
[ 0.524907] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.524908] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.524909] PCIe ACS override match for 0000:05:00.0
[ 0.524910] -> true
[ 0.524911] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524913] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524914] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524915] -> false
[ 0.524916] -> false
[ 0.524917] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.524918] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524925] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524926] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524927] -> false
[ 0.524928] -> false
[ 0.524929] dma_pdev #4: 0000:00:1c.1
[ 0.524949] intel_iommu_add_device(0000:06:05.0)
[ 0.524951] dma_pdev #1: 0000:06:05.0
[ 0.524951] dma_pdev #2: 0000:06:05.0
[ 0.524952] dma_pdev #3: 0000:06:05.0
[ 0.524953] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.524954] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.524955] PCIe ACS override match for 0000:05:00.0
[ 0.524957] -> true
[ 0.524958] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524964] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524965] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524966] -> false
[ 0.524967] -> false
[ 0.524968] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.524969] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524976] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524977] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524978] -> false
[ 0.524979] -> false
[ 0.524979] dma_pdev #4: 0000:00:1c.1
[ 0.524983] intel_iommu_add_device(0000:06:07.0)
[ 0.524984] dma_pdev #1: 0000:06:07.0
[ 0.524985] dma_pdev #2: 0000:06:07.0
[ 0.524986] dma_pdev #3: 0000:06:07.0
[ 0.524987] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.524988] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.524989] PCIe ACS override match for 0000:05:00.0
[ 0.524990] -> true
[ 0.524991] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524997] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524998] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524999] -> false
[ 0.525000] -> false
[ 0.525001] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.525002] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525004] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525006] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525007] -> false
[ 0.525007] -> false
[ 0.525008] dma_pdev #4: 0000:00:1c.1
[ 0.525010] intel_iommu_add_device(0000:06:09.0)
[ 0.525011] dma_pdev #1: 0000:06:09.0
[ 0.525012] dma_pdev #2: 0000:06:09.0
[ 0.525013] dma_pdev #3: 0000:06:09.0
[ 0.525014] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.525015] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525016] PCIe ACS override match for 0000:05:00.0
[ 0.525017] -> true
[ 0.525018] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525025] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525026] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525027] -> false
[ 0.525028] -> false
[ 0.525029] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.525030] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525037] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525038] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525039] -> false
[ 0.525040] -> false
[ 0.525041] dma_pdev #4: 0000:00:1c.1
[ 0.525043] intel_iommu_add_device(0000:0a:00.0)
[ 0.525044] dma_pdev #1: 0000:0a:00.0
[ 0.525044] dma_pdev #2: 0000:0a:00.0
[ 0.525045] dma_pdev #3: 0000:0a:00.0
[ 0.525046] pci_acs_path_enabled(0000:06:07.0, NULL, 001d)
[ 0.525048] pci_acs_enabled(0000:06:07.0, 001d)
[ 0.525048] PCIe ACS override match for 0000:06:07.0
[ 0.525049] -> true
[ 0.525050] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525051] PCIe ACS override match for 0000:05:00.0
[ 0.525052] -> true
[ 0.525053] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525060] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525062] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525062] -> false
[ 0.525063] -> false
[ 0.525064] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.525065] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525066] PCIe ACS override match for 0000:05:00.0
[ 0.525067] -> true
[ 0.525068] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525075] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525076] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525077] -> false
[ 0.525078] -> false
[ 0.525079] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.525080] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525087] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525088] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525089] -> false
[ 0.525090] -> false
[ 0.525091] dma_pdev #4: 0000:00:1c.1
[ 0.525093] intel_iommu_add_device(0000:0b:00.0)
[ 0.525094] dma_pdev #1: 0000:0b:00.0
[ 0.525095] dma_pdev #2: 0000:0b:00.0
[ 0.525096] dma_pdev #3: 0000:0b:00.0
[ 0.525097] pci_acs_path_enabled(0000:06:09.0, NULL, 001d)
[ 0.525098] pci_acs_enabled(0000:06:09.0, 001d)
[ 0.525099] PCIe ACS override match for 0000:06:09.0
[ 0.525100] -> true
[ 0.525101] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525102] PCIe ACS override match for 0000:05:00.0
[ 0.525103] -> true
[ 0.525103] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525111] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525112] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525113] -> false
[ 0.525114] -> false
[ 0.525115] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.525116] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525117] PCIe ACS override match for 0000:05:00.0
[ 0.525118] -> true
[ 0.525118] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525125] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525126] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525127] -> false
[ 0.525128] -> false
[ 0.525129] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.525130] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525137] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525138] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525139] -> false
[ 0.525140] -> false
[ 0.525141] dma_pdev #4: 0000:00:1c.1
[ 0.525143] intel_iommu_add_device(0000:0c:00.0)
[ 0.525144] Upstream bridge 0000:0b:00.0
[ 0.525148] dma_pdev #1: 0000:0c:00.0
[ 0.525149] dma_pdev #2: 0000:0c:00.0
[ 0.525150] dma_pdev #3: 0000:0c:00.0
[ 0.525151] pci_acs_path_enabled(0000:0b:00.0, NULL, 001d)
[ 0.525152] pci_acs_enabled(0000:0b:00.0, 001d)
[ 0.525153] -> false
[ 0.525154] -> false
[ 0.525155] pci_acs_path_enabled(0000:06:09.0, NULL, 001d)
[ 0.525156] pci_acs_enabled(0000:06:09.0, 001d)
[ 0.525157] PCIe ACS override match for 0000:06:09.0
[ 0.525158] -> true
[ 0.525158] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525159] PCIe ACS override match for 0000:05:00.0
[ 0.525160] -> true
[ 0.525161] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525168] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525169] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525170] -> false
[ 0.525171] -> false
[ 0.525172] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.525173] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525174] PCIe ACS override match for 0000:05:00.0
[ 0.525175] -> true
[ 0.525175] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525178] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525179] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525180] -> false
[ 0.525181] -> false
[ 0.525182] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.525183] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525190] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525191] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525192] -> false
[ 0.525193] -> false
[ 0.525193] dma_pdev #4: 0000:00:1c.1
[ 0.525195] intel_iommu_add_device(0000:0d:00.0)
[ 0.525196] dma_pdev #1: 0000:0d:00.0
[ 0.525197] dma_pdev #2: 0000:0d:00.0
[ 0.525198] dma_pdev #3: 0000:0d:00.0
[ 0.525199] pci_acs_path_enabled(0000:00:1c.3, NULL, 001d)
[ 0.525200] pci_acs_enabled(0000:00:1c.3, 001d)
[ 0.525201] PCIe ACS override match for 0000:00:1c.3
[ 0.525202] -> true
[ 0.525203] -> true
[ 0.525204] dma_pdev #4: 0000:0d:00.0
lspci as slots are now (since Radeon is back in first x16 slot):
00:00.0 Host bridge [0600]: Intel Corporation Xeon E3-1200 v3 Processor
DRAM Controller [8086:0c08] (rev 06)
00:01.0 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen
Core Processor PCI Express x16 Controller [8086:0c01] (rev 06)
00:01.1 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen
Core Processor PCI Express x8 Controller [8086:0c05] (rev 06)
00:02.0 VGA compatible controller [0300]: Intel Corporation Xeon E3-1200
v3 Processor Integrated Graphics Controller [8086:041a] (rev 06)
00:03.0 Audio device [0403]: Intel Corporation Xeon E3-1200 v3/4th Gen
Core Processor HD Audio Controller [8086:0c0c] (rev 06)
00:14.0 USB controller [0c03]: Intel Corporation 8 Series/C220 Series
Chipset Family USB xHCI [8086:8c31] (rev 05)
00:16.0 Communication controller [0780]: Intel Corporation 8 Series/C220
Series Chipset Family MEI Controller #1 [8086:8c3a] (rev 04)
00:16.3 Serial controller [0700]: Intel Corporation 8 Series/C220 Series
Chipset Family KT Controller [8086:8c3d] (rev 04)
00:19.0 Ethernet controller [0200]: Intel Corporation Ethernet
Connection I217-LM [8086:153a] (rev 05)
00:1b.0 Audio device [0403]: Intel Corporation 8 Series/C220 Series
Chipset High Definition Audio Controller [8086:8c20] (rev 05)
00:1c.0 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series
Chipset Family PCI Express Root Port #1 [8086:8c10] (rev d5)
00:1c.1 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series
Chipset Family PCI Express Root Port #2 [8086:8c12] (rev d5)
00:1c.3 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series
Chipset Family PCI Express Root Port #4 [8086:8c16] (rev d5)
00:1c.4 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series
Chipset Family PCI Express Root Port #5 [8086:8c18] (rev d5)
00:1d.0 USB controller [0c03]: Intel Corporation 8 Series/C220 Series
Chipset Family USB EHCI #1 [8086:8c26] (rev 05)
00:1f.0 ISA bridge [0601]: Intel Corporation C226 Series Chipset Family
Server Advanced SKU LPC Controller [8086:8c56] (rev 05)
00:1f.2 SATA controller [0106]: Intel Corporation 8 Series/C220 Series
Chipset Family 6-port SATA Controller 1 [AHCI mode] [8086:8c02] (rev 05)
00:1f.3 SMBus [0c05]: Intel Corporation 8 Series/C220 Series Chipset
Family SMBus Controller [8086:8c22] (rev 05)
00:1f.6 Signal processing controller [1180]: Intel Corporation 8 Series
Chipset Family Thermal Management Controller [8086:8c24] (rev 05)
01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc.
[AMD/ATI] Juniper PRO [Radeon HD 5750] [1002:68be]
01:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI]
Juniper HDMI Audio [Radeon HD 5700 Series] [1002:aa58]
02:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX8112 x1 Lane PCI
Express-to-PCI Bridge [10b5:8112] (rev aa)
03:04.0 Multimedia audio controller [0401]: C-Media Electronics Inc
CMI8788 [Oxygen HD Audio] [13f6:8788]
04:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062 Serial
ATA Controller [1b21:0612] (rev 01)
05:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
06:01.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
06:04.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
06:05.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
06:07.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
06:09.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
0a:00.0 USB controller [0c03]: Renesas Technology Corp. uPD720201 USB
3.0 Host Controller [1912:0014] (rev 03)
0b:00.0 PCI bridge [0604]: Texas Instruments XIO2213A/B/XIO2221 PCI
Express to PCI Bridge [Cheetah Express] [104c:823e] (rev 01)
0c:00.0 FireWire (IEEE 1394) [0c00]: Texas Instruments
XIO2213A/B/XIO2221 IEEE-1394b OHCI Controller [Cheetah Express]
[104c:823f] (rev 01)
0d:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit
Network Connection [8086:1533] (rev 03)
next prev parent reply other threads:[~2014-01-04 19:27 UTC|newest]
Thread overview: 15+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-12-29 2:31 IOMMU groups: better with Intel root ports, or with PEX8606 switch? Dana Goyette
2013-12-29 3:23 ` Alex Williamson
2013-12-29 7:32 ` Dana Goyette
2013-12-30 4:16 ` Alex Williamson
2013-12-31 0:13 ` IOMMU groups ... " Dana Goyette
2014-01-02 19:36 ` Alex Williamson
2014-01-02 21:01 ` Dana Goyette
2014-01-02 21:14 ` Alex Williamson
2014-01-02 21:15 ` Dana Goyette
2014-01-02 21:22 ` Alex Williamson
2014-01-02 21:25 ` Dana Goyette
2014-01-04 0:03 ` Alex Williamson
2014-01-04 19:26 ` Dana Goyette [this message]
2014-01-04 20:22 ` Alex Williamson
2014-01-04 21:11 ` Dana Goyette
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='la9n9k$g63$1@ger.gmane.org' \
--to=danagoyette@gmail.com \
--cc=kvm@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox