From: Jason Gunthorpe <jgg@nvidia.com>
To: "Thomas Hellström" <thomas.hellstrom@linux.intel.com>
Cc: bhelgaas@google.com, iommu@lists.linux.dev,
linux-pci@vger.kernel.org, leonro@nvidia.com, hch@lst.de
Subject: Re: PCI_P2PDMA_MAP_BUS_ADDR and PCIe ATS?
Date: Wed, 19 Aug 2026 10:04:37 -0300 [thread overview]
Message-ID: <20260819130437.GB200680@nvidia.com> (raw)
In-Reply-To: <60d8bce9d63f7c14a39c49b3c7c4975a4d3eea62.camel@linux.intel.com>
On Wed, Aug 19, 2026 at 08:42:10AM +0200, Thomas Hellström wrote:
> > Probably what you want to do is add a flag that the device is going
> > to
> > use ATS for the P2P DMA. Then we can force setup an IOVA and check
> > the
> > fabric path for translated request routing to make sure it will work.
>
> Yes, sounds like a way forward. To be honest, we don't have an existing
> use-case yet, but taking the union of how we want to configure our GPUs
> moving forward and the support requests we see from p2pdma users, this
> is probably something we are going to hit sooner than later.
I will say we've had to deploy alot of experts to design our systems
and it is really hard to get something that actually works :|
> > And yes, there is an existing issue with DMABUF not being able to
> > negotiate these little pathing details with the importer when the
> > exporter forms the scatterlist..
>
> Yes, it was when looking into that I actually stumbled upon the ATS
> issue as well. I recall you and Christian have touched upon this in the
> past. What is an acceptable way forward here? A dma_map_resource_p2p()
> interface that takes into account the mapping type?
IDK, it is painful. There is alot of stuff coming that the importer
will need to customize when performing the mapping. Locking the DMA
mapping process in the exporter is not helpful. For example your
device might need to say 'I will always use ATS', while mlx5 would
prefer 'Should I disable ATS for this mapping'.
Christian seems unrelenting on this point so I don't really have a
good solution beyond some endless list of single user flags.
I wanted to rebase and revise the mapping type series but I've been
just buried in security things, patch reviews and travel lately. Maybe
I will get there after this merge window
Jason
prev parent reply other threads:[~2026-08-19 13:04 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-08-18 9:33 PCI_P2PDMA_MAP_BUS_ADDR and PCIe ATS? Thomas Hellström
2026-08-18 12:43 ` Jason Gunthorpe
2026-08-18 15:20 ` Thomas Hellström
2026-08-18 19:03 ` Jason Gunthorpe
2026-08-19 6:42 ` Thomas Hellström
2026-08-19 13:04 ` Jason Gunthorpe [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260819130437.GB200680@nvidia.com \
--to=jgg@nvidia.com \
--cc=bhelgaas@google.com \
--cc=hch@lst.de \
--cc=iommu@lists.linux.dev \
--cc=leonro@nvidia.com \
--cc=linux-pci@vger.kernel.org \
--cc=thomas.hellstrom@linux.intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox