All of lore.kernel.org
 help / color / mirror / Atom feed
From: Jason Gunthorpe <jgg@nvidia.com>
To: Alex Williamson <alex.williamson@redhat.com>
Cc: michel@lespinasse.org, joelaf@google.com, songliubraving@fb.com,
	mhocko@suse.com, leewalsh@google.com, david@redhat.com,
	peterz@infradead.org, bigeasy@linutronix.de,
	"Cédric Le Goater" <clg@redhat.com>,
	peterx@redhat.com, dhowells@redhat.com, linux-mm@kvack.org,
	edumazet@google.com, jglisse@google.com,
	punit.agrawal@bytedance.com, will@kernel.org,
	arjunroy@google.com, dave@stgolabs.net, minchan@google.com,
	x86@kernel.org, hughd@google.com, willy@infradead.org,
	gurua@google.com, mingo@redhat.com,
	linux-arm-kernel@lists.infradead.org, rientjes@google.com,
	axelrasmussen@google.com, kernel-team@android.com,
	"Jason Wang" <jasowang@redhat.com>,
	soheil@google.com, paulmck@kernel.org, jannh@google.com,
	liam.howlett@oracle.com, shakeelb@google.com, luto@kernel.org,
	gthelen@google.com, ldufour@linux.ibm.com,
	"Suren Baghdasaryan" <surenb@google.com>,
	vbabka@suse.cz, dimitri.sivanich@hpe.com, posk@google.com,
	lstoakes@gmail.com, peterjung1337@gmail.com,
	linuxppc-dev@lists.ozlabs.o
Subject: Re: [PATCH v4 0/7] introduce vm_flags modifier functions
Date: Wed, 22 Mar 2023 10:48:00 -0300	[thread overview]
Message-ID: <ZBsHENhAFsBYN4HI@nvidia.com> (raw)
In-Reply-To: <20230314141144.6a0892e6.alex.williamson@redhat.com>

On Tue, Mar 14, 2023 at 02:11:44PM -0600, Alex Williamson wrote:
> On Thu, 26 Jan 2023 11:37:45 -0800
> Suren Baghdasaryan <surenb@google.com> wrote:
> 
> > This patchset was originally published as a part of per-VMA locking [1] and
> > was split after suggestion that it's viable on its own and to facilitate
> > the review process. It is now a preprequisite for the next version of per-VMA
> > lock patchset, which reuses vm_flags modifier functions to lock the VMA when
> > vm_flags are being updated.
> > 
> > VMA vm_flags modifications are usually done under exclusive mmap_lock
> > protection because this attrubute affects other decisions like VMA merging
> > or splitting and races should be prevented. Introduce vm_flags modifier
> > functions to enforce correct locking.
> > 
> > The patchset applies cleanly over mm-unstable branch of mm tree.
> 
> With this series, vfio-pci developed a bunch of warnings around not
> holding the mmap_lock write semaphore while calling
> io_remap_pfn_range() from our fault handler, vfio_pci_mmap_fault().
> 
> I suspect vdpa has the same issue for their use of remap_pfn_range()
> from their fault handler, JasonW, MST, FYI.

Yeah, IMHO this whole approach has always been a bit sketchy, it was
never intended that remap_pfn would be called from a fault handler,
you are supposed to use a vmf_insert_pfn() type API from fault
handlers.

> The reason for using remap_pfn_range() on fault in vfio-pci is that
> we're mapping device MMIO to userspace, where that MMIO can be disabled
> and we'd rather zap the mapping when that occurs so that we can sigbus
> the user rather than allow the user to trigger potentially fatal bus
> errors on the host.
 
> Peter Xu has suggested offline that a non-lazy approach to reinsert the
> mappings might be more inline with mm expectations relative to touching
> vm_flags during fault.  

Yes, I feel the same - along with completing the address_space
conversion you had started. IIRC that was part of the reason we needed
this design in vfio.

Jason

WARNING: multiple messages have this Message-ID (diff)
From: Jason Gunthorpe <jgg@nvidia.com>
To: Alex Williamson <alex.williamson@redhat.com>
Cc: "Suren Baghdasaryan" <surenb@google.com>,
	akpm@linux-foundation.org, michel@lespinasse.org,
	jglisse@google.com, mhocko@suse.com, vbabka@suse.cz,
	hannes@cmpxchg.org, mgorman@techsingularity.net,
	dave@stgolabs.net, willy@infradead.org, liam.howlett@oracle.com,
	peterz@infradead.org, ldufour@linux.ibm.com, paulmck@kernel.org,
	mingo@redhat.com, will@kernel.org, luto@kernel.org,
	songliubraving@fb.com, peterx@redhat.com, david@redhat.com,
	dhowells@redhat.com, hughd@google.com, bigeasy@linutronix.de,
	kent.overstreet@linux.dev, punit.agrawal@bytedance.com,
	lstoakes@gmail.com, peterjung1337@gmail.com, rientjes@google.com,
	axelrasmussen@google.com, joelaf@google.com, minchan@google.com,
	rppt@kernel.org, jannh@google.com, shakeelb@google.com,
	tatashin@google.com, edumazet@google.com, gthelen@google.com,
	gurua@google.com, arjunroy@google.com, soheil@google.com,
	leewalsh@google.com, posk@google.com, linux-mm@kvack.org,
	linux-arm-kernel@lists.infradead.org,
	linuxppc-dev@lists.ozlabs.org, x86@kernel.org,
	linux-kernel@vger.kernel.org, kernel-team@android.com,
	"Michael S. Tsirkin" <mst@redhat.com>,
	"Jason Wang" <jasowang@redhat.com>,
	"Cédric Le Goater" <clg@redhat.com>,
	dimitri.sivanich@hpe.com
Subject: Re: [PATCH v4 0/7] introduce vm_flags modifier functions
Date: Wed, 22 Mar 2023 10:48:00 -0300	[thread overview]
Message-ID: <ZBsHENhAFsBYN4HI@nvidia.com> (raw)
In-Reply-To: <20230314141144.6a0892e6.alex.williamson@redhat.com>

On Tue, Mar 14, 2023 at 02:11:44PM -0600, Alex Williamson wrote:
> On Thu, 26 Jan 2023 11:37:45 -0800
> Suren Baghdasaryan <surenb@google.com> wrote:
> 
> > This patchset was originally published as a part of per-VMA locking [1] and
> > was split after suggestion that it's viable on its own and to facilitate
> > the review process. It is now a preprequisite for the next version of per-VMA
> > lock patchset, which reuses vm_flags modifier functions to lock the VMA when
> > vm_flags are being updated.
> > 
> > VMA vm_flags modifications are usually done under exclusive mmap_lock
> > protection because this attrubute affects other decisions like VMA merging
> > or splitting and races should be prevented. Introduce vm_flags modifier
> > functions to enforce correct locking.
> > 
> > The patchset applies cleanly over mm-unstable branch of mm tree.
> 
> With this series, vfio-pci developed a bunch of warnings around not
> holding the mmap_lock write semaphore while calling
> io_remap_pfn_range() from our fault handler, vfio_pci_mmap_fault().
> 
> I suspect vdpa has the same issue for their use of remap_pfn_range()
> from their fault handler, JasonW, MST, FYI.

Yeah, IMHO this whole approach has always been a bit sketchy, it was
never intended that remap_pfn would be called from a fault handler,
you are supposed to use a vmf_insert_pfn() type API from fault
handlers.

> The reason for using remap_pfn_range() on fault in vfio-pci is that
> we're mapping device MMIO to userspace, where that MMIO can be disabled
> and we'd rather zap the mapping when that occurs so that we can sigbus
> the user rather than allow the user to trigger potentially fatal bus
> errors on the host.
 
> Peter Xu has suggested offline that a non-lazy approach to reinsert the
> mappings might be more inline with mm expectations relative to touching
> vm_flags during fault.  

Yes, I feel the same - along with completing the address_space
conversion you had started. IIRC that was part of the reason we needed
this design in vfio.

Jason


  parent reply	other threads:[~2023-03-22 13:49 UTC|newest]

Thread overview: 79+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-01-26 19:37 [PATCH v4 0/7] introduce vm_flags modifier functions Suren Baghdasaryan
2023-01-26 19:37 ` Suren Baghdasaryan
2023-01-26 19:37 ` Suren Baghdasaryan
2023-01-26 19:37 ` [PATCH v4 1/7] kernel/fork: convert vma assignment to a memcpy Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 19:40   ` Mike Rapoport
2023-01-26 19:40     ` Mike Rapoport
2023-01-26 19:40     ` Mike Rapoport
2023-01-26 19:37 ` [PATCH v4 2/7] mm: introduce vma->vm_flags wrapper functions Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 19:42   ` Mike Rapoport
2023-01-26 19:42     ` Mike Rapoport
2023-01-26 19:42     ` Mike Rapoport
2023-02-08  1:48   ` Hyeonggon Yoo
2023-02-08  1:48     ` Hyeonggon Yoo
2023-01-26 19:37 ` [PATCH v4 3/7] mm: replace VM_LOCKED_CLEAR_MASK with VM_LOCKED_MASK Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-27 17:45   ` Davidlohr Bueso
2023-01-27 17:45     ` Davidlohr Bueso
2023-01-27 17:45     ` Davidlohr Bueso
2023-01-27 20:56     ` Suren Baghdasaryan
2023-01-27 20:56       ` Suren Baghdasaryan
2023-01-26 19:37 ` [PATCH v4 4/7] mm: replace vma->vm_flags direct modifications with modifier calls Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-27 14:23   ` Liam R. Howlett
2023-01-27 14:23     ` Liam R. Howlett
2023-01-27 14:23     ` Liam R. Howlett
2023-01-31  8:32   ` Hyeonggon Yoo
2023-01-31  8:32     ` Hyeonggon Yoo
2023-01-31  8:32     ` Hyeonggon Yoo
2023-01-31 18:54     ` Suren Baghdasaryan
2023-01-31 18:54       ` Suren Baghdasaryan
2023-01-31 18:54       ` Suren Baghdasaryan
2023-01-31 20:53       ` Andrew Morton
2023-01-31 20:53         ` Andrew Morton
2023-01-31 20:53         ` Andrew Morton
2023-01-31 21:08         ` Suren Baghdasaryan
2023-01-31 21:08           ` Suren Baghdasaryan
2023-01-31 21:08           ` Suren Baghdasaryan
2023-01-31 23:12           ` Andrew Morton
2023-01-31 23:12             ` Andrew Morton
2023-01-31 23:12             ` Andrew Morton
2023-02-01  0:03             ` Suren Baghdasaryan
2023-02-01  0:03               ` Suren Baghdasaryan
2023-02-01  0:03               ` Suren Baghdasaryan
2023-02-01 12:23       ` Hyeonggon Yoo
2023-02-01 12:23         ` Hyeonggon Yoo
2023-02-01 12:23         ` Hyeonggon Yoo
2023-01-26 19:37 ` [PATCH v4 5/7] mm: replace vma->vm_flags indirect modification in ksm_madvise Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 22:45   ` Michael Ellerman
2023-01-26 22:45     ` Michael Ellerman
2023-01-26 22:45     ` Michael Ellerman
2023-02-08  1:54   ` Hyeonggon Yoo
2023-02-08  1:54     ` Hyeonggon Yoo
2023-01-26 19:37 ` [PATCH v4 6/7] mm: introduce __vm_flags_mod and use it in untrack_pfn Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 19:44   ` Mike Rapoport
2023-01-26 19:44     ` Mike Rapoport
2023-01-26 19:44     ` Mike Rapoport
2023-01-26 19:37 ` [PATCH v4 7/7] mm: export dump_mm() Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-01-26 19:37   ` Suren Baghdasaryan
2023-03-14 20:11 ` [PATCH v4 0/7] introduce vm_flags modifier functions Alex Williamson
2023-03-14 20:11   ` Alex Williamson
2023-03-17 19:08   ` Suren Baghdasaryan
2023-03-17 19:08     ` Suren Baghdasaryan
2023-03-17 22:40     ` Alex Williamson
2023-03-17 22:40       ` Alex Williamson
2023-03-17 23:04       ` Suren Baghdasaryan
2023-03-17 23:04         ` Suren Baghdasaryan
2023-03-22 13:48   ` Jason Gunthorpe [this message]
2023-03-22 13:48     ` Jason Gunthorpe

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ZBsHENhAFsBYN4HI@nvidia.com \
    --to=jgg@nvidia.com \
    --cc=alex.williamson@redhat.com \
    --cc=arjunroy@google.com \
    --cc=axelrasmussen@google.com \
    --cc=bigeasy@linutronix.de \
    --cc=clg@redhat.com \
    --cc=dave@stgolabs.net \
    --cc=david@redhat.com \
    --cc=dhowells@redhat.com \
    --cc=dimitri.sivanich@hpe.com \
    --cc=edumazet@google.com \
    --cc=gthelen@google.com \
    --cc=gurua@google.com \
    --cc=hughd@google.com \
    --cc=jannh@google.com \
    --cc=jasowang@redhat.com \
    --cc=jglisse@google.com \
    --cc=joelaf@google.com \
    --cc=kernel-team@android.com \
    --cc=ldufour@linux.ibm.com \
    --cc=leewalsh@google.com \
    --cc=liam.howlett@oracle.com \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-mm@kvack.org \
    --cc=linuxppc-dev@lists.ozlabs.o \
    --cc=lstoakes@gmail.com \
    --cc=luto@kernel.org \
    --cc=mhocko@suse.com \
    --cc=michel@lespinasse.org \
    --cc=minchan@google.com \
    --cc=mingo@redhat.com \
    --cc=paulmck@kernel.org \
    --cc=peterjung1337@gmail.com \
    --cc=peterx@redhat.com \
    --cc=peterz@infradead.org \
    --cc=posk@google.com \
    --cc=punit.agrawal@bytedance.com \
    --cc=rientjes@google.com \
    --cc=shakeelb@google.com \
    --cc=soheil@google.com \
    --cc=songliubraving@fb.com \
    --cc=surenb@google.com \
    --cc=vbabka@suse.cz \
    --cc=will@kernel.org \
    --cc=willy@infradead.org \
    --cc=x86@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.