From mboxrd@z Thu Jan 1 00:00:00 1970 From: Gordan Bobic Subject: Re: Multi-bridged PCIe devices (Was: Re: iommuu/vt-d issues with LSI MegaSAS (PERC5i)) Date: Wed, 11 Sep 2013 14:23:22 +0100 Message-ID: <2e6cc621048e1b3eb4253b8ca4b85dec@mail.shatteredsilicon.net> References: <523075C502000078000F2617@nat28.tlf.novell.com> <9bd7c39084e6b264dda5b6ac256ea97b@mail.shatteredsilicon.net> <52307EAA02000078000F26B1@nat28.tlf.novell.com> <3f1e678224a3f94125b5050b794882a8@mail.shatteredsilicon.net> <5230863202000078000F2712@nat28.tlf.novell.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; Format="flowed" Content-Transfer-Encoding: 7bit Return-path: Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VJkOC-0000Ax-KZ for xen-devel@lists.xenproject.org; Wed, 11 Sep 2013 13:23:24 +0000 Received: from mail.shatteredsilicon.net (localhost [127.0.0.1]) by external.sentinel2 (Postfix) with ESMTP id 70A482202F2 for ; Wed, 11 Sep 2013 14:23:22 +0100 (BST) In-Reply-To: <5230863202000078000F2712@nat28.tlf.novell.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: xen-devel@lists.xenproject.org List-Id: xen-devel@lists.xenproject.org On Wed, 11 Sep 2013 14:03:14 +0100, "Jan Beulich" wrote: >>>> On 11.09.13 at 14:45, Gordan Bobic wrote: >> dmesg, xl dmesg, lspci -vvvnn and lspci -tvnn output is attached. >> >> I'll try adding one of my LSI cards and see the comparative >> behaviour. Right now I don't even know if the phantom device >> is on the SAS card or the motherboard. > > The Adaptec card being the only thing on bus 0f makes it pretty > likely that this other device also is on that card. That's plausible, but given there are Nvidia NF200 bridges between the Intel 5520 PCIe hubs and each of the slots on my motherboard, it is not a 100% certainty. > I guess the issue is mainly because the device itself is a PCI one, > while the immediately upstream bridge (where I mean only the > visible one) is PCIe. There _must_ be a PCIe-PCI bridge between > them. And as long as firmware doesn't know about that bridge > and the bridge doesn't properly handle config space accesses to > it, such a device just can't be used with an IOMMU (without some > yet to be invented workaround). You don't think Konrad's patch on the old thread would work for getting it working in dom0? Gordan