From: Dana Goyette <DanaGoyette@gmail.com>
To: kvm@vger.kernel.org
Subject: Re: IOMMU groups ... PEX8606 switch?
Date: Sat, 04 Jan 2014 11:26:54 -0800 [thread overview]
Message-ID: <la9n9k$g63$1@ger.gmane.org> (raw)
In-Reply-To: <1388793837.3169.73.camel@bling.home>
On 01/03/2014 04:03 PM, Alex Williamson wrote:
> On Mon, 2013-12-30 at 16:13 -0800, Dana Goyette wrote:
>> On 12/29/2013 08:16 PM, Alex Williamson wrote:
>>> On Sat, 2013-12-28 at 23:32 -0800, Dana Goyette wrote:
>>>> On 12/28/2013 7:23 PM, Alex Williamson wrote:
>>>>> On Sat, 2013-12-28 at 18:31 -0800, Dana Goyette wrote:
>>>>>> I have purchased both a SuperMicro X10SAE and an X10SAT, and I need to
>>>>>> soon decide which one to keep.
>>>>>>
>>>>>> The SuperMicro X10SAT has all the PCIe x1 slots hidden behind a PLX
>>>>>> PEX8066 switch, which claims to support ACS. I'd expect the devices
>>>>>> downstream of the PLX switch to be in separate groups.
>>>>>>
>>>>>> With Linux 3.13-rc5 and "enable overrides for missing ACS capabilities"
>>>>>> applied and set for the Intel root ports, the devices behind the switch
>>>>>> remain stuck in the same group.
>>>>>>
>>>>>> In terms of passing devices to different VMs, which is better: all
>>>>>> devices on different root ports, or all devices behind the one
>>>>>> ACS-supporting switch?
>>>>> Can you provide lspci -vvv info? If you're getting that for groups
>>>>> either the switch has ACS capabilities, but doesn't support the features
>>>>> we need or we're doing something wrong. Thanks,
>>>>>
>>>> I initially tried attaching the output as a .txt file, but it's too
>>>> large. Anyway, here's the output of lspci -nnvvv (you may notice that I
>>>> moved the Radeon to a different slot).
>>> Well, something seems amiss since the downstream switch ports all seem
>>> to support and enable the correct set of ACS capabilities. I'm tending
>>> to suspect something wrong with the ACS override patch or how it's being
>>> used since your IOMMU group is still based at the root port. Each root
>>> port is isolated from the other root ports though, so something is
>>> happening with the override patch. Can you provide the kernel command
>>> line you use to enable ACS overrides and the override patch you're
>>> using, as it applies to 3.13-rc5? Thanks,
>>>
>>> Alex
>>>
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe kvm" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at http://vger.kernel.org/majordomo-info.html
>>>
>> I'm using the original acs-override patch from this post:
>> https://lkml.org/lkml/2013/5/30/513
>>
>> Kernel parameter is:
>> pcie_acs_override=id:8086:8c10,id:8086:8c12,id:8086:8c16,id:8086:8c18
>>
>> When booting a kernel without the override patch, the following devices
>> are all in the same group: Intel Root Ports 1, 2, 4, 5; ASMedia SATA
>> controller; PLX PEX8606 switch; Renesas USB controller; TI Firewire
>> controller; Intel I210 Ethernet controller.
> Could you please try the patch below and send dmesg for the system once
> booted. This applies directly to upstream and includes the acs override
> patch. Thanks,
(removed patch from quote.)
Here's the complete dmesg, with pcie_acs_override still set:
http://pastebin.com/YHuKnrTb
Most relevant section:
[ 0.524362] DMAR: No ATSR found
[ 0.524386] IOMMU 1 0xfed91000: using Queued invalidation
[ 0.524389] IOMMU: Setting RMRR:
[ 0.524398] IOMMU: Setting identity map for device 0000:00:1d.0
[0x7bea1000 - 0x7beaffff]
[ 0.524423] IOMMU: Setting identity map for device 0000:00:1a.0
[0x7bea1000 - 0x7beaffff]
[ 0.524441] IOMMU: Setting identity map for device 0000:00:14.0
[0x7bea1000 - 0x7beaffff]
[ 0.524454] IOMMU: Prepare 0-16MiB unity mapping for LPC
[ 0.524461] IOMMU: Setting identity map for device 0000:00:1f.0 [0x0
- 0xffffff]
[ 0.524548] PCI-DMA: Intel(R) Virtualization Technology for Directed I/O
[ 0.524551] intel_iommu_add_device(0000:00:00.0)
[ 0.524552] dma_pdev #1: 0000:00:00.0
[ 0.524553] dma_pdev #2: 0000:00:00.0
[ 0.524554] dma_pdev #3: 0000:00:00.0
[ 0.524554] dma_pdev #4: 0000:00:00.0
[ 0.524565] intel_iommu_add_device(0000:00:01.0)
[ 0.524566] dma_pdev #1: 0000:00:01.0
[ 0.524567] dma_pdev #2: 0000:00:01.0
[ 0.524569] pci_acs_enabled(0000:00:01.0, 001d)
[ 0.524572] pci_acs_flags_enabled no ACS capability on 0000:00:01.0
[ 0.524573] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false
[ 0.524574] -> false
[ 0.524575] pci_acs_enabled(0000:00:01.0, 001d)
[ 0.524577] pci_acs_flags_enabled no ACS capability on 0000:00:01.0
[ 0.524578] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false
[ 0.524579] -> false
[ 0.524580] dma_pdev #3: 0000:00:01.0
[ 0.524581] dma_pdev #4: 0000:00:01.0
[ 0.524584] intel_iommu_add_device(0000:00:01.1)
[ 0.524586] dma_pdev #1: 0000:00:01.1
[ 0.524586] dma_pdev #2: 0000:00:01.1
[ 0.524587] pci_acs_enabled(0000:00:01.1, 001d)
[ 0.524589] pci_acs_flags_enabled no ACS capability on 0000:00:01.1
[ 0.524590] pci_acs_flags_enabled(0000:00:01.1, 001d) -> false
[ 0.524591] -> false
[ 0.524592] pci_acs_enabled(0000:00:01.0, 001d)
[ 0.524593] pci_acs_flags_enabled no ACS capability on 0000:00:01.0
[ 0.524595] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false
[ 0.524596] -> false
[ 0.524596] dma_pdev #3: 0000:00:01.0
[ 0.524597] dma_pdev #4: 0000:00:01.0
[ 0.524599] intel_iommu_add_device(0000:00:02.0)
[ 0.524601] dma_pdev #1: 0000:00:02.0
[ 0.524601] dma_pdev #2: 0000:00:02.0
[ 0.524602] dma_pdev #3: 0000:00:02.0
[ 0.524603] dma_pdev #4: 0000:00:02.0
[ 0.524606] intel_iommu_add_device(0000:00:03.0)
[ 0.524607] dma_pdev #1: 0000:00:03.0
[ 0.524608] dma_pdev #2: 0000:00:03.0
[ 0.524609] dma_pdev #3: 0000:00:03.0
[ 0.524610] dma_pdev #4: 0000:00:03.0
[ 0.524613] intel_iommu_add_device(0000:00:14.0)
[ 0.524614] dma_pdev #1: 0000:00:14.0
[ 0.524615] dma_pdev #2: 0000:00:14.0
[ 0.524616] dma_pdev #3: 0000:00:14.0
[ 0.524617] dma_pdev #4: 0000:00:14.0
[ 0.524620] intel_iommu_add_device(0000:00:16.0)
[ 0.524621] dma_pdev #1: 0000:00:16.0
[ 0.524622] dma_pdev #2: 0000:00:16.0
[ 0.524623] pci_acs_enabled(0000:00:16.0, 001d)
[ 0.524624] -> false
[ 0.524625] pci_acs_enabled(0000:00:16.0, 001d)
[ 0.524626] -> false
[ 0.524626] dma_pdev #3: 0000:00:16.0
[ 0.524627] dma_pdev #4: 0000:00:16.0
[ 0.524630] intel_iommu_add_device(0000:00:16.3)
[ 0.524631] dma_pdev #1: 0000:00:16.3
[ 0.524632] dma_pdev #2: 0000:00:16.3
[ 0.524633] pci_acs_enabled(0000:00:16.3, 001d)
[ 0.524634] -> false
[ 0.524635] pci_acs_enabled(0000:00:16.0, 001d)
[ 0.524636] -> false
[ 0.524637] dma_pdev #3: 0000:00:16.0
[ 0.524638] dma_pdev #4: 0000:00:16.0
[ 0.524640] intel_iommu_add_device(0000:00:19.0)
[ 0.524641] dma_pdev #1: 0000:00:19.0
[ 0.524642] dma_pdev #2: 0000:00:19.0
[ 0.524643] dma_pdev #3: 0000:00:19.0
[ 0.524643] dma_pdev #4: 0000:00:19.0
[ 0.524646] intel_iommu_add_device(0000:00:1a.0)
[ 0.524647] dma_pdev #1: 0000:00:1a.0
[ 0.524648] dma_pdev #2: 0000:00:1a.0
[ 0.524649] dma_pdev #3: 0000:00:1a.0
[ 0.524650] dma_pdev #4: 0000:00:1a.0
[ 0.524654] intel_iommu_add_device(0000:00:1b.0)
[ 0.524655] dma_pdev #1: 0000:00:1b.0
[ 0.524656] dma_pdev #2: 0000:00:1b.0
[ 0.524657] dma_pdev #3: 0000:00:1b.0
[ 0.524658] dma_pdev #4: 0000:00:1b.0
[ 0.524661] intel_iommu_add_device(0000:00:1c.0)
[ 0.524662] dma_pdev #1: 0000:00:1c.0
[ 0.524663] dma_pdev #2: 0000:00:1c.0
[ 0.524664] pci_acs_enabled(0000:00:1c.0, 001d)
[ 0.524665] PCIe ACS override match for 0000:00:1c.0
[ 0.524666] -> true
[ 0.524667] dma_pdev #3: 0000:00:1c.0
[ 0.524668] dma_pdev #4: 0000:00:1c.0
[ 0.524671] intel_iommu_add_device(0000:00:1c.1)
[ 0.524672] dma_pdev #1: 0000:00:1c.1
[ 0.524673] dma_pdev #2: 0000:00:1c.1
[ 0.524674] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524681] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524682] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524683] -> false
[ 0.524684] pci_acs_enabled(0000:00:1c.0, 001d)
[ 0.524685] PCIe ACS override match for 0000:00:1c.0
[ 0.524686] -> true
[ 0.524687] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524694] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524695] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524696] -> false
[ 0.524697] dma_pdev #3: 0000:00:1c.1
[ 0.524698] dma_pdev #4: 0000:00:1c.1
[ 0.524700] intel_iommu_add_device(0000:00:1c.3)
[ 0.524701] dma_pdev #1: 0000:00:1c.3
[ 0.524702] dma_pdev #2: 0000:00:1c.3
[ 0.524703] pci_acs_enabled(0000:00:1c.3, 001d)
[ 0.524704] PCIe ACS override match for 0000:00:1c.3
[ 0.524705] -> true
[ 0.524706] dma_pdev #3: 0000:00:1c.3
[ 0.524707] dma_pdev #4: 0000:00:1c.3
[ 0.524710] intel_iommu_add_device(0000:00:1c.4)
[ 0.524711] dma_pdev #1: 0000:00:1c.4
[ 0.524712] dma_pdev #2: 0000:00:1c.4
[ 0.524713] pci_acs_enabled(0000:00:1c.4, 001d)
[ 0.524714] PCIe ACS override match for 0000:00:1c.4
[ 0.524715] -> true
[ 0.524715] dma_pdev #3: 0000:00:1c.4
[ 0.524716] dma_pdev #4: 0000:00:1c.4
[ 0.524719] intel_iommu_add_device(0000:00:1d.0)
[ 0.524720] dma_pdev #1: 0000:00:1d.0
[ 0.524721] dma_pdev #2: 0000:00:1d.0
[ 0.524722] dma_pdev #3: 0000:00:1d.0
[ 0.524723] dma_pdev #4: 0000:00:1d.0
[ 0.524726] intel_iommu_add_device(0000:00:1f.0)
[ 0.524727] dma_pdev #1: 0000:00:1f.0
[ 0.524728] dma_pdev #2: 0000:00:1f.0
[ 0.524728] pci_acs_enabled(0000:00:1f.0, 001d)
[ 0.524729] -> false
[ 0.524730] pci_acs_enabled(0000:00:1f.0, 001d)
[ 0.524731] -> false
[ 0.524732] dma_pdev #3: 0000:00:1f.0
[ 0.524733] dma_pdev #4: 0000:00:1f.0
[ 0.524736] intel_iommu_add_device(0000:00:1f.2)
[ 0.524737] dma_pdev #1: 0000:00:1f.2
[ 0.524738] dma_pdev #2: 0000:00:1f.2
[ 0.524739] pci_acs_enabled(0000:00:1f.2, 001d)
[ 0.524740] -> false
[ 0.524741] pci_acs_enabled(0000:00:1f.0, 001d)
[ 0.524741] -> false
[ 0.524742] dma_pdev #3: 0000:00:1f.0
[ 0.524743] dma_pdev #4: 0000:00:1f.0
[ 0.524745] intel_iommu_add_device(0000:00:1f.3)
[ 0.524746] dma_pdev #1: 0000:00:1f.3
[ 0.524747] dma_pdev #2: 0000:00:1f.3
[ 0.524748] pci_acs_enabled(0000:00:1f.3, 001d)
[ 0.524749] -> false
[ 0.524750] pci_acs_enabled(0000:00:1f.0, 001d)
[ 0.524751] -> false
[ 0.524752] dma_pdev #3: 0000:00:1f.0
[ 0.524752] dma_pdev #4: 0000:00:1f.0
[ 0.524754] intel_iommu_add_device(0000:00:1f.6)
[ 0.524755] dma_pdev #1: 0000:00:1f.6
[ 0.524756] dma_pdev #2: 0000:00:1f.6
[ 0.524757] pci_acs_enabled(0000:00:1f.6, 001d)
[ 0.524758] -> false
[ 0.524759] pci_acs_enabled(0000:00:1f.0, 001d)
[ 0.524760] -> false
[ 0.524761] dma_pdev #3: 0000:00:1f.0
[ 0.524762] dma_pdev #4: 0000:00:1f.0
[ 0.524765] intel_iommu_add_device(0000:01:00.0)
[ 0.524766] dma_pdev #1: 0000:01:00.0
[ 0.524767] dma_pdev #2: 0000:01:00.0
[ 0.524768] pci_acs_enabled(0000:01:00.0, 001d)
[ 0.524771] pci_acs_flags_enabled no ACS capability on 0000:01:00.0
[ 0.524772] pci_acs_flags_enabled(0000:01:00.0, 001d) -> false
[ 0.524773] -> false
[ 0.524774] pci_acs_enabled(0000:01:00.0, 001d)
[ 0.524776] pci_acs_flags_enabled no ACS capability on 0000:01:00.0
[ 0.524777] pci_acs_flags_enabled(0000:01:00.0, 001d) -> false
[ 0.524778] -> false
[ 0.524779] dma_pdev #3: 0000:01:00.0
[ 0.524780] pci_acs_path_enabled(0000:00:01.0, NULL, 001d)
[ 0.524781] pci_acs_enabled(0000:00:01.0, 001d)
[ 0.524783] pci_acs_flags_enabled no ACS capability on 0000:00:01.0
[ 0.524784] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false
[ 0.524785] -> false
[ 0.524786] -> false
[ 0.524787] dma_pdev #4: 0000:00:01.0
[ 0.524789] intel_iommu_add_device(0000:01:00.1)
[ 0.524790] dma_pdev #1: 0000:01:00.1
[ 0.524791] dma_pdev #2: 0000:01:00.1
[ 0.524792] pci_acs_enabled(0000:01:00.1, 001d)
[ 0.524794] pci_acs_flags_enabled no ACS capability on 0000:01:00.1
[ 0.524795] pci_acs_flags_enabled(0000:01:00.1, 001d) -> false
[ 0.524796] -> false
[ 0.524797] pci_acs_enabled(0000:01:00.0, 001d)
[ 0.524799] pci_acs_flags_enabled no ACS capability on 0000:01:00.0
[ 0.524800] pci_acs_flags_enabled(0000:01:00.0, 001d) -> false
[ 0.524801] -> false
[ 0.524802] dma_pdev #3: 0000:01:00.0
[ 0.524803] pci_acs_path_enabled(0000:00:01.0, NULL, 001d)
[ 0.524804] pci_acs_enabled(0000:00:01.0, 001d)
[ 0.524806] pci_acs_flags_enabled no ACS capability on 0000:00:01.0
[ 0.524807] pci_acs_flags_enabled(0000:00:01.0, 001d) -> false
[ 0.524808] -> false
[ 0.524809] -> false
[ 0.524809] dma_pdev #4: 0000:00:01.0
[ 0.524811] intel_iommu_add_device(0000:02:00.0)
[ 0.524813] dma_pdev #1: 0000:02:00.0
[ 0.524813] dma_pdev #2: 0000:02:00.0
[ 0.524814] dma_pdev #3: 0000:02:00.0
[ 0.524815] pci_acs_path_enabled(0000:00:01.1, NULL, 001d)
[ 0.524816] pci_acs_enabled(0000:00:01.1, 001d)
[ 0.524818] pci_acs_flags_enabled no ACS capability on 0000:00:01.1
[ 0.524819] pci_acs_flags_enabled(0000:00:01.1, 001d) -> false
[ 0.524820] -> false
[ 0.524821] -> false
[ 0.524822] dma_pdev #4: 0000:00:01.1
[ 0.524824] intel_iommu_add_device(0000:03:04.0)
[ 0.524825] Upstream bridge 0000:02:00.0
[ 0.524830] dma_pdev #1: 0000:02:00.0
[ 0.524831] dma_pdev #2: 0000:02:00.0
[ 0.524832] dma_pdev #3: 0000:02:00.0
[ 0.524833] pci_acs_path_enabled(0000:00:01.1, NULL, 001d)
[ 0.524834] pci_acs_enabled(0000:00:01.1, 001d)
[ 0.524835] pci_acs_flags_enabled no ACS capability on 0000:00:01.1
[ 0.524837] pci_acs_flags_enabled(0000:00:01.1, 001d) -> false
[ 0.524837] -> false
[ 0.524838] -> false
[ 0.524839] dma_pdev #4: 0000:00:01.1
[ 0.524841] intel_iommu_add_device(0000:04:00.0)
[ 0.524842] dma_pdev #1: 0000:04:00.0
[ 0.524843] dma_pdev #2: 0000:04:00.0
[ 0.524844] dma_pdev #3: 0000:04:00.0
[ 0.524845] pci_acs_path_enabled(0000:00:1c.0, NULL, 001d)
[ 0.524846] pci_acs_enabled(0000:00:1c.0, 001d)
[ 0.524847] PCIe ACS override match for 0000:00:1c.0
[ 0.524848] -> true
[ 0.524849] -> true
[ 0.524849] dma_pdev #4: 0000:04:00.0
[ 0.524852] intel_iommu_add_device(0000:05:00.0)
[ 0.524853] dma_pdev #1: 0000:05:00.0
[ 0.524854] dma_pdev #2: 0000:05:00.0
[ 0.524855] dma_pdev #3: 0000:05:00.0
[ 0.524856] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.524857] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524865] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524866] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524867] -> false
[ 0.524868] -> false
[ 0.524869] dma_pdev #4: 0000:00:1c.1
[ 0.524871] intel_iommu_add_device(0000:06:01.0)
[ 0.524872] dma_pdev #1: 0000:06:01.0
[ 0.524872] dma_pdev #2: 0000:06:01.0
[ 0.524873] dma_pdev #3: 0000:06:01.0
[ 0.524874] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.524875] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.524876] PCIe ACS override match for 0000:05:00.0
[ 0.524877] -> true
[ 0.524878] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524886] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524887] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524888] -> false
[ 0.524888] -> false
[ 0.524889] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.524891] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524898] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524899] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524900] -> false
[ 0.524901] -> false
[ 0.524901] dma_pdev #4: 0000:00:1c.1
[ 0.524903] intel_iommu_add_device(0000:06:04.0)
[ 0.524904] dma_pdev #1: 0000:06:04.0
[ 0.524905] dma_pdev #2: 0000:06:04.0
[ 0.524906] dma_pdev #3: 0000:06:04.0
[ 0.524907] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.524908] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.524909] PCIe ACS override match for 0000:05:00.0
[ 0.524910] -> true
[ 0.524911] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524913] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524914] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524915] -> false
[ 0.524916] -> false
[ 0.524917] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.524918] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524925] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524926] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524927] -> false
[ 0.524928] -> false
[ 0.524929] dma_pdev #4: 0000:00:1c.1
[ 0.524949] intel_iommu_add_device(0000:06:05.0)
[ 0.524951] dma_pdev #1: 0000:06:05.0
[ 0.524951] dma_pdev #2: 0000:06:05.0
[ 0.524952] dma_pdev #3: 0000:06:05.0
[ 0.524953] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.524954] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.524955] PCIe ACS override match for 0000:05:00.0
[ 0.524957] -> true
[ 0.524958] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524964] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524965] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524966] -> false
[ 0.524967] -> false
[ 0.524968] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.524969] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524976] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524977] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524978] -> false
[ 0.524979] -> false
[ 0.524979] dma_pdev #4: 0000:00:1c.1
[ 0.524983] intel_iommu_add_device(0000:06:07.0)
[ 0.524984] dma_pdev #1: 0000:06:07.0
[ 0.524985] dma_pdev #2: 0000:06:07.0
[ 0.524986] dma_pdev #3: 0000:06:07.0
[ 0.524987] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.524988] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.524989] PCIe ACS override match for 0000:05:00.0
[ 0.524990] -> true
[ 0.524991] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.524997] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.524998] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.524999] -> false
[ 0.525000] -> false
[ 0.525001] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.525002] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525004] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525006] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525007] -> false
[ 0.525007] -> false
[ 0.525008] dma_pdev #4: 0000:00:1c.1
[ 0.525010] intel_iommu_add_device(0000:06:09.0)
[ 0.525011] dma_pdev #1: 0000:06:09.0
[ 0.525012] dma_pdev #2: 0000:06:09.0
[ 0.525013] dma_pdev #3: 0000:06:09.0
[ 0.525014] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.525015] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525016] PCIe ACS override match for 0000:05:00.0
[ 0.525017] -> true
[ 0.525018] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525025] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525026] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525027] -> false
[ 0.525028] -> false
[ 0.525029] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.525030] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525037] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525038] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525039] -> false
[ 0.525040] -> false
[ 0.525041] dma_pdev #4: 0000:00:1c.1
[ 0.525043] intel_iommu_add_device(0000:0a:00.0)
[ 0.525044] dma_pdev #1: 0000:0a:00.0
[ 0.525044] dma_pdev #2: 0000:0a:00.0
[ 0.525045] dma_pdev #3: 0000:0a:00.0
[ 0.525046] pci_acs_path_enabled(0000:06:07.0, NULL, 001d)
[ 0.525048] pci_acs_enabled(0000:06:07.0, 001d)
[ 0.525048] PCIe ACS override match for 0000:06:07.0
[ 0.525049] -> true
[ 0.525050] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525051] PCIe ACS override match for 0000:05:00.0
[ 0.525052] -> true
[ 0.525053] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525060] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525062] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525062] -> false
[ 0.525063] -> false
[ 0.525064] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.525065] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525066] PCIe ACS override match for 0000:05:00.0
[ 0.525067] -> true
[ 0.525068] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525075] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525076] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525077] -> false
[ 0.525078] -> false
[ 0.525079] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.525080] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525087] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525088] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525089] -> false
[ 0.525090] -> false
[ 0.525091] dma_pdev #4: 0000:00:1c.1
[ 0.525093] intel_iommu_add_device(0000:0b:00.0)
[ 0.525094] dma_pdev #1: 0000:0b:00.0
[ 0.525095] dma_pdev #2: 0000:0b:00.0
[ 0.525096] dma_pdev #3: 0000:0b:00.0
[ 0.525097] pci_acs_path_enabled(0000:06:09.0, NULL, 001d)
[ 0.525098] pci_acs_enabled(0000:06:09.0, 001d)
[ 0.525099] PCIe ACS override match for 0000:06:09.0
[ 0.525100] -> true
[ 0.525101] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525102] PCIe ACS override match for 0000:05:00.0
[ 0.525103] -> true
[ 0.525103] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525111] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525112] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525113] -> false
[ 0.525114] -> false
[ 0.525115] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.525116] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525117] PCIe ACS override match for 0000:05:00.0
[ 0.525118] -> true
[ 0.525118] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525125] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525126] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525127] -> false
[ 0.525128] -> false
[ 0.525129] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.525130] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525137] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525138] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525139] -> false
[ 0.525140] -> false
[ 0.525141] dma_pdev #4: 0000:00:1c.1
[ 0.525143] intel_iommu_add_device(0000:0c:00.0)
[ 0.525144] Upstream bridge 0000:0b:00.0
[ 0.525148] dma_pdev #1: 0000:0c:00.0
[ 0.525149] dma_pdev #2: 0000:0c:00.0
[ 0.525150] dma_pdev #3: 0000:0c:00.0
[ 0.525151] pci_acs_path_enabled(0000:0b:00.0, NULL, 001d)
[ 0.525152] pci_acs_enabled(0000:0b:00.0, 001d)
[ 0.525153] -> false
[ 0.525154] -> false
[ 0.525155] pci_acs_path_enabled(0000:06:09.0, NULL, 001d)
[ 0.525156] pci_acs_enabled(0000:06:09.0, 001d)
[ 0.525157] PCIe ACS override match for 0000:06:09.0
[ 0.525158] -> true
[ 0.525158] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525159] PCIe ACS override match for 0000:05:00.0
[ 0.525160] -> true
[ 0.525161] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525168] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525169] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525170] -> false
[ 0.525171] -> false
[ 0.525172] pci_acs_path_enabled(0000:05:00.0, NULL, 001d)
[ 0.525173] pci_acs_enabled(0000:05:00.0, 001d)
[ 0.525174] PCIe ACS override match for 0000:05:00.0
[ 0.525175] -> true
[ 0.525175] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525178] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525179] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525180] -> false
[ 0.525181] -> false
[ 0.525182] pci_acs_path_enabled(0000:00:1c.1, NULL, 001d)
[ 0.525183] pci_acs_enabled(0000:00:1c.1, 001d)
[ 0.525190] pci_acs_flags_enabled no ACS capability on 0000:00:1c.1
[ 0.525191] pci_acs_flags_enabled(0000:00:1c.1, 001d) -> false
[ 0.525192] -> false
[ 0.525193] -> false
[ 0.525193] dma_pdev #4: 0000:00:1c.1
[ 0.525195] intel_iommu_add_device(0000:0d:00.0)
[ 0.525196] dma_pdev #1: 0000:0d:00.0
[ 0.525197] dma_pdev #2: 0000:0d:00.0
[ 0.525198] dma_pdev #3: 0000:0d:00.0
[ 0.525199] pci_acs_path_enabled(0000:00:1c.3, NULL, 001d)
[ 0.525200] pci_acs_enabled(0000:00:1c.3, 001d)
[ 0.525201] PCIe ACS override match for 0000:00:1c.3
[ 0.525202] -> true
[ 0.525203] -> true
[ 0.525204] dma_pdev #4: 0000:0d:00.0
lspci as slots are now (since Radeon is back in first x16 slot):
00:00.0 Host bridge [0600]: Intel Corporation Xeon E3-1200 v3 Processor
DRAM Controller [8086:0c08] (rev 06)
00:01.0 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen
Core Processor PCI Express x16 Controller [8086:0c01] (rev 06)
00:01.1 PCI bridge [0604]: Intel Corporation Xeon E3-1200 v3/4th Gen
Core Processor PCI Express x8 Controller [8086:0c05] (rev 06)
00:02.0 VGA compatible controller [0300]: Intel Corporation Xeon E3-1200
v3 Processor Integrated Graphics Controller [8086:041a] (rev 06)
00:03.0 Audio device [0403]: Intel Corporation Xeon E3-1200 v3/4th Gen
Core Processor HD Audio Controller [8086:0c0c] (rev 06)
00:14.0 USB controller [0c03]: Intel Corporation 8 Series/C220 Series
Chipset Family USB xHCI [8086:8c31] (rev 05)
00:16.0 Communication controller [0780]: Intel Corporation 8 Series/C220
Series Chipset Family MEI Controller #1 [8086:8c3a] (rev 04)
00:16.3 Serial controller [0700]: Intel Corporation 8 Series/C220 Series
Chipset Family KT Controller [8086:8c3d] (rev 04)
00:19.0 Ethernet controller [0200]: Intel Corporation Ethernet
Connection I217-LM [8086:153a] (rev 05)
00:1b.0 Audio device [0403]: Intel Corporation 8 Series/C220 Series
Chipset High Definition Audio Controller [8086:8c20] (rev 05)
00:1c.0 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series
Chipset Family PCI Express Root Port #1 [8086:8c10] (rev d5)
00:1c.1 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series
Chipset Family PCI Express Root Port #2 [8086:8c12] (rev d5)
00:1c.3 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series
Chipset Family PCI Express Root Port #4 [8086:8c16] (rev d5)
00:1c.4 PCI bridge [0604]: Intel Corporation 8 Series/C220 Series
Chipset Family PCI Express Root Port #5 [8086:8c18] (rev d5)
00:1d.0 USB controller [0c03]: Intel Corporation 8 Series/C220 Series
Chipset Family USB EHCI #1 [8086:8c26] (rev 05)
00:1f.0 ISA bridge [0601]: Intel Corporation C226 Series Chipset Family
Server Advanced SKU LPC Controller [8086:8c56] (rev 05)
00:1f.2 SATA controller [0106]: Intel Corporation 8 Series/C220 Series
Chipset Family 6-port SATA Controller 1 [AHCI mode] [8086:8c02] (rev 05)
00:1f.3 SMBus [0c05]: Intel Corporation 8 Series/C220 Series Chipset
Family SMBus Controller [8086:8c22] (rev 05)
00:1f.6 Signal processing controller [1180]: Intel Corporation 8 Series
Chipset Family Thermal Management Controller [8086:8c24] (rev 05)
01:00.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc.
[AMD/ATI] Juniper PRO [Radeon HD 5750] [1002:68be]
01:00.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI]
Juniper HDMI Audio [Radeon HD 5700 Series] [1002:aa58]
02:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX8112 x1 Lane PCI
Express-to-PCI Bridge [10b5:8112] (rev aa)
03:04.0 Multimedia audio controller [0401]: C-Media Electronics Inc
CMI8788 [Oxygen HD Audio] [13f6:8788]
04:00.0 SATA controller [0106]: ASMedia Technology Inc. ASM1062 Serial
ATA Controller [1b21:0612] (rev 01)
05:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
06:01.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
06:04.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
06:05.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
06:07.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
06:09.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8606 6 Lane, 6 Port
PCI Express Gen 2 (5.0 GT/s) Switch [10b5:8606] (rev ba)
0a:00.0 USB controller [0c03]: Renesas Technology Corp. uPD720201 USB
3.0 Host Controller [1912:0014] (rev 03)
0b:00.0 PCI bridge [0604]: Texas Instruments XIO2213A/B/XIO2221 PCI
Express to PCI Bridge [Cheetah Express] [104c:823e] (rev 01)
0c:00.0 FireWire (IEEE 1394) [0c00]: Texas Instruments
XIO2213A/B/XIO2221 IEEE-1394b OHCI Controller [Cheetah Express]
[104c:823f] (rev 01)
0d:00.0 Ethernet controller [0200]: Intel Corporation I210 Gigabit
Network Connection [8086:1533] (rev 03)
next prev parent reply other threads:[~2014-01-04 19:27 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-12-29 2:31 IOMMU groups: better with Intel root ports, or with PEX8606 switch? Dana Goyette
2013-12-29 3:23 ` Alex Williamson
2013-12-29 7:32 ` Dana Goyette
2013-12-30 4:16 ` Alex Williamson
2013-12-31 0:13 ` IOMMU groups ... " Dana Goyette
2014-01-02 19:36 ` Alex Williamson
2014-01-02 21:01 ` Dana Goyette
2014-01-02 21:01 ` Dana Goyette
2014-01-02 21:14 ` Alex Williamson
2014-01-02 21:15 ` Dana Goyette
2014-01-02 21:22 ` Alex Williamson
2014-01-02 21:25 ` Dana Goyette
2014-01-04 0:03 ` Alex Williamson
2014-01-04 19:26 ` Dana Goyette [this message]
2014-01-04 20:22 ` Alex Williamson
2014-01-04 21:11 ` Dana Goyette
2014-01-05 7:57 ` Dana Goyette
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='la9n9k$g63$1@ger.gmane.org' \
--to=danagoyette@gmail.com \
--cc=kvm@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.