public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Jason Gunthorpe <jgg@nvidia.com>
To: Matt Evans <mattev@meta.com>
Cc: "Alex Williamson" <alex@shazbot.org>,
	"Leon Romanovsky" <leon@kernel.org>,
	"Alex Mastro" <amastro@fb.com>,
	"Christian König" <christian.koenig@amd.com>,
	"Mahmoud Adam" <mngyadam@amazon.de>,
	"David Matlack" <dmatlack@google.com>,
	"Björn Töpel" <bjorn@kernel.org>,
	"Sumit Semwal" <sumit.semwal@linaro.org>,
	"Kevin Tian" <kevin.tian@intel.com>,
	"Ankit Agrawal" <ankita@nvidia.com>,
	"Pranjal Shrivastava" <praan@google.com>,
	"Alistair Popple" <apopple@nvidia.com>,
	"Vivek Kasireddy" <vivek.kasireddy@intel.com>,
	linux-kernel@vger.kernel.org, linux-media@vger.kernel.org,
	dri-devel@lists.freedesktop.org, linaro-mm-sig@lists.linaro.org,
	kvm@vger.kernel.org
Subject: Re: [PATCH 3/9] vfio/pci: Add a helper to create a DMABUF for a BAR-map VMA
Date: Thu, 30 Apr 2026 14:11:06 -0300	[thread overview]
Message-ID: <20260430171106.GA6829@nvidia.com> (raw)
In-Reply-To: <c598a21e-ee50-42d9-98dc-2959e84ace50@meta.com>

On Thu, Apr 30, 2026 at 05:47:49PM +0100, Matt Evans wrote:
> > On Thu, Apr 16, 2026 at 06:17:46AM -0700, Matt Evans wrote:
> > > +int vfio_pci_core_mmap_prep_dmabuf(struct vfio_pci_core_device *vdev,
> > > +				   struct vm_area_struct *vma,
> > > +				   u64 phys_start, u64 req_len,
> > > +				   unsigned int res_index)
> > > +{
> > > +	struct vfio_pci_dma_buf *priv;
> > > +	const unsigned int nr_ranges = 1;
> > > +	int ret;
> > > +
> > > +	priv = kzalloc_obj(*priv);
> > > +	if (!priv)
> > > +		return -ENOMEM;
> > > +
> > > +	priv->phys_vec = kzalloc_obj(*priv->phys_vec);
> > > +	if (!priv->phys_vec) {
> > > +		ret = -ENOMEM;
> > > +		goto err_free_priv;
> > > +	}
> > > +
> > > +	/*
> > > +	 * The mmap() request's vma->vm_offs might be non-zero, but
> > > +	 * the DMABUF is created from _offset zero_ of the BAR.  The
> > > +	 * portion between zero and the vm_offs is inaccessible
> > > +	 * through this VMA, but this approach keeps the
> > > +	 * /proc/<pid>/maps offset somewhat consistent with the
> > > +	 * pre-DMABUF code.  Size includes the offset portion.
> > 
> > I'm not sure I understand this comment?
> > 
> > For the old path vm_pgoff for byte 0 of the bar starts at some large
> > offset
> > 
> > For the new path vm_pgoff for byte 0 of the first range starts at 0
> 
> Glad you asked.  :)
> 
> This is trying to achieve keeping /proc/<pid>/maps (or similar) somewhat
> as informative as pre-DMABUF BAR mmap, in terms of keeping the VMA
> vm_offs column useful.  Before this patch, say you mmap() two slices A
> and B of the same BAR:
> 
>  struct vfio_region_info bar_region;
> 
>  vm_a = mmap(0, 0x1000, ..., device_fd, bar_region.offset + 0);
>  vm_b = mmap(0, 0x1000, ..., device_fd, bar_region.offset + 0x4000);
> 
> ...you'd see something like this in /proc/blah/maps:
> 
> fffff4000000-fffff4001000 rw-s 10000000000 00:07 148     /dev/vfio/devices/vfio0
> fffff5000000-fffff5001000 rw-s 10000004000 00:07 148     /dev/vfio/devices/vfio0


> then the VMA's vm_offs would need to be thunked back down to 0 (since
> the fault handler then treats vm_b + 0 as the first byte of the DMABUF).
> That works/adds up, but then the vm_offs of both VMAs A & B both have
> offset 0, and it's harder to differentiate in /proc/blah/maps.

Yes, and that would be correct.

The VMA output of lspci should show the exact pgoff passed to mmap and
nothing else. Do not mangle it for "debugging".

pgoff is not to be used to show random internal FD details..

> We could possibly stash the original offset somewhere and then render it
> in the name string, but the name's already about the max size and using
> the existing vm_offs column is nicer IMO, doesn't need a new field, etc.

> I need to work on this comment then!  What this is trying to say is that
> the DMABUF is made artificially larger than the part that is visible
> through the VMA.

Yuk, that's another reason not to do this.

Jason

  reply	other threads:[~2026-04-30 17:11 UTC|newest]

Thread overview: 20+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-04-16 13:17 [PATCH 0/9] vfio/pci: Add mmap() for DMABUFs Matt Evans
2026-04-16 13:17 ` [PATCH 1/9] vfio/pci: Fix vfio_pci_dma_buf_cleanup() double-put Matt Evans
2026-04-24 18:05   ` Jason Gunthorpe
2026-04-16 13:17 ` [PATCH 2/9] vfio/pci: Add a helper to look up PFNs for DMABUFs Matt Evans
2026-04-24 18:15   ` Jason Gunthorpe
2026-04-16 13:17 ` [PATCH 3/9] vfio/pci: Add a helper to create a DMABUF for a BAR-map VMA Matt Evans
2026-04-24 18:24   ` Jason Gunthorpe
2026-04-30 16:47     ` Matt Evans
2026-04-30 17:11       ` Jason Gunthorpe [this message]
2026-04-16 13:17 ` [PATCH 4/9] vfio/pci: Convert BAR mmap() to use a DMABUF Matt Evans
2026-04-16 13:17 ` [PATCH 5/9] vfio/pci: Provide a user-facing name for BAR mappings Matt Evans
2026-04-24 18:26   ` Jason Gunthorpe
2026-04-16 13:17 ` [PATCH 6/9] vfio/pci: Clean up BAR zap and revocation Matt Evans
2026-04-16 13:17 ` [PATCH 7/9] vfio/pci: Support mmap() of a VFIO DMABUF Matt Evans
2026-04-24 18:30   ` Jason Gunthorpe
2026-04-16 13:17 ` [PATCH 8/9] vfio/pci: Permanently revoke a DMABUF on request Matt Evans
2026-04-16 13:17 ` [PATCH 9/9] vfio/pci: Add mmap() attributes to DMABUF feature Matt Evans
2026-04-24 18:31   ` Jason Gunthorpe
2026-04-26 10:52     ` Leon Romanovsky
2026-04-27 14:36       ` Alex Williamson

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260430171106.GA6829@nvidia.com \
    --to=jgg@nvidia.com \
    --cc=alex@shazbot.org \
    --cc=amastro@fb.com \
    --cc=ankita@nvidia.com \
    --cc=apopple@nvidia.com \
    --cc=bjorn@kernel.org \
    --cc=christian.koenig@amd.com \
    --cc=dmatlack@google.com \
    --cc=dri-devel@lists.freedesktop.org \
    --cc=kevin.tian@intel.com \
    --cc=kvm@vger.kernel.org \
    --cc=leon@kernel.org \
    --cc=linaro-mm-sig@lists.linaro.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-media@vger.kernel.org \
    --cc=mattev@meta.com \
    --cc=mngyadam@amazon.de \
    --cc=praan@google.com \
    --cc=sumit.semwal@linaro.org \
    --cc=vivek.kasireddy@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox