From mboxrd@z Thu Jan 1 00:00:00 1970 From: Konrad Rzeszutek Wilk Subject: Re: Re: ATI radeon fails with "iommu=soft swiotlb=force" (seen on RV730/RV740 and RS780/RS800) Date: Mon, 5 Oct 2009 10:01:52 -0400 Message-ID: <20091005140152.GA3127@phenom.dumpdata.com> References: <41093.83224.qm@web56108.mail.re3.yahoo.com> <4AC649B0.5090700@goop.org> <4AC9E75F0200007800017F61@vpn.id2.novell.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Content-Disposition: inline In-Reply-To: <4AC9E75F0200007800017F61@vpn.id2.novell.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xensource.com Errors-To: xen-devel-bounces@lists.xensource.com To: Jan Beulich Cc: Jeremy Fitzhardinge , dri-devel@lists.sourceforge.net, xen-devel@lists.xensource.com List-Id: xen-devel@lists.xenproject.org On Mon, Oct 05, 2009 at 11:32:31AM +0100, Jan Beulich wrote: > >>> Jeremy Fitzhardinge 02.10.09 20:42 >>> > >On 10/02/09 10:23, Boris Derzhavets wrote: > >> Jeremy, > >> Please, be aware of bugzilla.xensource.com [1519] the most recent > >> entries :- > >> > >> http://bugzilla.xensource.com/bugzilla/show_bug.cgi?id=1519 > >> > > > >Ah, OK. I pushed a variant of Konrad's patches. Could you try them out? > > Are you really convinced fixing this in DRM is the right thing to do? To > me, the use of vmalloc_32() in drivers/ieee1394/ seems to make similar > assumptions (pci_map_sg() not modifying the buffer addresses), and > who knows where else such assumptions exist. After all, vmalloc_32() > is *defined* to have the property assumed by both of the users, and > other than for most kmalloc() cases using GFP_DMA{,32} we're talking > about double buffering generally large amounts of data here even in > the cases where the DMA API is being used properly. I was chatting with Jeremy about this, and I realized that in some sense the radeon driver assumes that physical != bus addresses. Which is OK on x86, but if this card was ever moved to a Sun box it would fail. The patch here thwarts this by allocating memory from the IOMMU, so that even if bus != physical address from pci_map_page, that is OK. Another way to make this work right is to modify the drivers that use vmalloc_32, with pci_map_[sg|page], is for them to check if the physical != bus address, and if so, remap the virtual address (page_to_vmalloc) to point to the new bus addresses (and free the "old" page). Obviously this requires some book-keeping, but it does fix those drivers if they were to move to non-x86 architecture. Or on machines where the IOMMU hands out non-physical addresses.