From: Bjorn Helgaas <helgaas@kernel.org>
To: Leon Romanovsky <leon@kernel.org>
Cc: Pavel Popov <pavel.e.popov@intel.com>,
Bjorn Helgaas <bhelgaas@google.com>,
Logan Gunthorpe <logang@deltatee.com>,
Lukas Wunner <lukas@wunner.de>, Jim Chow <jim.chow@broadcom.com>,
Radu Rugina <radu.rugina@broadcom.com>,
Alexey Makhalov <alexey.makhalov@broadcom.com>,
Wei Liu <wei.liu@kernel.org>,
Michael Kelley <mhklinux@outlook.com>,
Nathan Ciobanu <nathan.d.ciobanu@linux.intel.com>,
bcm-kernel-feedback-list@broadcom.com,
virtualization@lists.linux.dev, linux-hyperv@vger.kernel.org,
linux-pci@vger.kernel.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH v3] PCI/P2PDMA: Allow P2PDMA on Intel Xeon server CPUs
Date: Tue, 20 Oct 2026 11:37:58 -0500 [thread overview]
Message-ID: <20261020163758.GA2342476@bhelgaas> (raw)
In-Reply-To: <20261020161447.GN64621@unreal>
On Tue, Oct 20, 2026 at 07:14:47PM +0300, Leon Romanovsky wrote:
> On Tue, Oct 20, 2026 at 08:13:05AM -0700, Pavel Popov wrote:
> > Peer-to-Peer DMA (P2PDMA) between two devices requires either a shared
> > upstream bridge or a host bridge matching pci_p2pdma_whitelist[]. In
> > VMware guests, passthrough devices appear directly on virtual root
> > buses without host bridge devices. In Hyper-V guests, each passthrough
> > device appears in a PCI domain of its own without a host bridge
> > device. Consequently, P2PDMA checks evaluate endpoint Device IDs
> > against the host bridge whitelist, causing P2PDMA requests to fail
> > regardless of host support.
> >
> > This affects discrete devices such as GPUs, NICs and NVMe drives.
> >
> > Add an explicit list of the Intel Xeon server generations from
> > Skylake-SP to Diamond Rapids to cpu_supports_p2pdma(). These are the
> > CPUs whose host bridges are in pci_p2pdma_whitelist[] without
> > restrictions. AMD Zen and newer are already covered by
> > cpu_supports_p2pdma(), so only Intel entries are needed.
> >
> > Tested with the Intel Level Zero P2P benchmark (ze_peer) on Arc Pro B60
> > cards in a Linux guest on VMware ESXi 9.0 (Emerald Rapids host).
> >
> > Signed-off-by: Pavel Popov <pavel.e.popov@intel.com>
> > ---
> > Changes in v3:
> > - Drop the hypervisor check and move the Xeon list into
> > cpu_supports_p2pdma(), next to the AMD check, as suggested by Logan
> > Gunthorpe and Leon Romanovsky [1]
> > - Fold the VMware and Hyper-V patches into one, as the check no longer
> > depends on the hypervisor
> >
> > Changes in v2:
> > - Replace the Skylake-and-newer threshold with an explicit list of Intel
> > Xeon server generations, from Skylake-SP to Diamond Rapids (Logan
> > Gunthorpe)
> > - Move the CONFIG_X86 #ifdef out of hypervisor_supports_p2pdma()
> > (Logan Gunthorpe)
> > - Rebased on current mainline
> >
> > [1] https://lore.kernel.org/r/20261016153147.GC219304@unreal
> >
> > v2: https://lore.kernel.org/r/20261016223402.19991-1-pavel.e.popov@intel.com
> > v1: https://lore.kernel.org/r/20261009154034.82321-1-pavel.e.popov@intel.com
> >
> > drivers/pci/p2pdma.c | 26 ++++++++++++++++++++++++++
> > 1 file changed, 26 insertions(+)
> >
> > diff --git a/drivers/pci/p2pdma.c b/drivers/pci/p2pdma.c
> > index 9334eb314663..2650d605d87d 100644
> > --- a/drivers/pci/p2pdma.c
> > +++ b/drivers/pci/p2pdma.c
> > @@ -21,6 +21,11 @@
> > #include <linux/seq_buf.h>
> > #include <linux/xarray.h>
> >
> > +#ifdef CONFIG_X86
> > +#include <asm/cpu_device_id.h>
> > +#include <asm/intel-family.h>
> > +#endif
> > +
> > struct pci_p2pdma {
> > struct gen_pool *pool;
> > bool p2pmem_published;
> > @@ -519,6 +524,23 @@ static void seq_buf_print_bus_devfn(struct seq_buf *buf, struct pci_dev *pdev)
> > seq_buf_printf(buf, "%s;", pci_name(pdev));
> > }
> >
> > +#ifdef CONFIG_X86
>
> Do we really need all these #ifdefs? I'm pretty sure they're not
> needed for the includes.
Apparently we do. I experimentally removed them and cross-compiled
for arm64:
drivers/pci/p2pdma.c:24:10: fatal error: asm/cpu_device_id.h: No such file or directory
24 | #include <asm/cpu_device_id.h>
| ^~~~~~~~~~~~~~~~~~~~~
next prev parent reply other threads:[~2026-10-20 16:38 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-10-20 15:13 [PATCH v3] PCI/P2PDMA: Allow P2PDMA on Intel Xeon server CPUs Pavel Popov
2026-10-20 15:16 ` sashiko-bot
2026-10-20 16:08 ` Logan Gunthorpe
2026-10-20 16:14 ` Leon Romanovsky
2026-10-20 16:37 ` Bjorn Helgaas [this message]
2026-10-20 16:47 ` Popov, Pavel E
2026-10-20 16:54 ` Logan Gunthorpe
2026-10-20 17:16 ` Leon Romanovsky
2026-10-20 17:19 ` Leon Romanovsky
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20261020163758.GA2342476@bhelgaas \
--to=helgaas@kernel.org \
--cc=alexey.makhalov@broadcom.com \
--cc=bcm-kernel-feedback-list@broadcom.com \
--cc=bhelgaas@google.com \
--cc=jim.chow@broadcom.com \
--cc=leon@kernel.org \
--cc=linux-hyperv@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-pci@vger.kernel.org \
--cc=logang@deltatee.com \
--cc=lukas@wunner.de \
--cc=mhklinux@outlook.com \
--cc=nathan.d.ciobanu@linux.intel.com \
--cc=pavel.e.popov@intel.com \
--cc=radu.rugina@broadcom.com \
--cc=virtualization@lists.linux.dev \
--cc=wei.liu@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox