From mboxrd@z Thu Jan  1 00:00:00 1970
From: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Subject: Re: AMD_IOV: IO_PAGE_FALT trying to pass through
	Mellanox ConnectX HCA (debian testing)
Date: Mon, 31 Jan 2011 15:03:22 -0500
Message-ID: <20110131200322.GA30160@dumpdata.com>
References: <20110128185809.GA24465@countzero.vandewege.net>
	<20110128192742.GB23494@dumpdata.com>
	<20110128203858.GA26814@countzero.vandewege.net>
	<20110131184503.GB11939@dumpdata.com>
	<20110131195154.GA19572@countzero.vandewege.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Return-path: <xen-devel-bounces@lists.xensource.com>
Content-Disposition: inline
In-Reply-To: <20110131195154.GA19572@countzero.vandewege.net>
List-Unsubscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>,
	<mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
List-Post: <mailto:xen-devel@lists.xensource.com>
List-Help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-Subscribe: <http://lists.xensource.com/mailman/listinfo/xen-devel>,
	<mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
Sender: xen-devel-bounces@lists.xensource.com
Errors-To: xen-devel-bounces@lists.xensource.com
To: Ward Vandewege <ward@gnu.org>
Cc: xen-devel@lists.xensource.com
List-Id: xen-devel@lists.xenproject.org

On Mon, Jan 31, 2011 at 02:51:54PM -0500, Ward Vandewege wrote:
> Hi Konrad,
> 
> On Mon, Jan 31, 2011 at 01:45:03PM -0500, Konrad Rzeszutek Wilk wrote:
> > > Hmm, I do have it:
> > 
> > Indeed you do. Good!
> > 
> > > 
> > >   # xm dmesg |grep iommu
> > >   (XEN) Command line: placeholder iommu=pv,verbose,amd_iommu_debug
> > > 
> > > But maybe it's not being picked up?
> > 
> > You should see something passthrough in the log.. thought that might
> > be only if you are using Intel VT-d? Not sure.
> 
> This seems related:
> 
> (XEN) HVM: ASIDs enabled.
> (XEN) HVM: SVM enabled
> (XEN) HVM: Hardware Assisted Paging detected.
> (XEN) AMD-Vi: IOMMU 0 Enabled.
> (XEN) I/O virtualisation enabled
> (XEN)  - Dom0 mode: Relaxed
> (XEN) Total of 16 processors activated.
> (XEN) ENABLING IO-APIC IRQs
> (XEN)  -> Using new ACK method
> 
> I've attached the full xm dmesg output.
> 
> > > > you might need to make sure your driver is using the VM_IO flag.
> > > > 
> > > > There was some discussion on LKML about this and they proposed
> > > > a patch that wasn't neccessary. Don't remember the details but I can
> > > > look that up next week.
> > 
> > Found it.. it was from Vivien but in another thread:
> > http://www.mail-archive.com/linux-rdma@vger.kernel.org/msg06980.html
> 
> Ah. Is your 
> 
>   devel/p2m-identity.v4.5
> 
> still the one I should test with to see if it fixes this problem? I see
> you've got newer versions (up to v4.7) now too. 

It has a bug that I am working on. I would just look for the VM_IO flag
and see if it has been applied somewhere. Or vice-versa - look for where
it has _not_ been applied.
> 
> Or has this patch meanwhile been pushed into the kernel?

Not yet.