From: Lorenzo Stoakes <lstoakes@gmail.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-fsdevel@vger.kernel.org, linux-kernel@vger.kernel.org,
linux-mm@kvack.org, "Liam R . Howlett" <Liam.Howlett@oracle.com>,
Vlastimil Babka <vbabka@suse.cz>,
Matthew Wilcox <willy@infradead.org>,
Alexander Viro <viro@zeniv.linux.org.uk>,
Christian Brauner <brauner@kernel.org>, Jan Kara <jack@suse.cz>,
Eric Biederman <ebiederm@xmission.com>,
Kees Cook <kees@kernel.org>,
Suren Baghdasaryan <surenb@google.com>,
Lorenzo Stoakes <lstoakes@gmail.com>
Subject: [RFC PATCH 0/7] Make core VMA operations internal and testable
Date: Thu, 27 Jun 2024 11:39:25 +0100 [thread overview]
Message-ID: <cover.1719481836.git.lstoakes@gmail.com> (raw)
There are a number of "core" VMA manipulation functions implemented in
mm/mmap.c, notably those concerning VMA merging, splitting, modifying,
expanding and shrinking, which logically don't belong there.
More importantly this functionality represents an internal implementation
detail of memory management and should not be exposed outside of mm/
itself.
This patch series isolates core VMA manipulation functionality into its own
file, mm/vma.c, and provides an API to the rest of the mm code in mm/vma.h.
Importantly, it also carefully implements mm/vma_internal.h, which
specifies which headers need to be imported by vma.c, leading to the very
useful property that vma.c depends only on mm/vma.h and mm/vma_internal.h.
This is useful, because we can then re-implement vma_internal.h in
userland, stubbing out and adding shims for kernel mechanisms as required,
and then can directly and very easily unit test internal VMA functionality.
This patch series takes advantage of existing shim logic and full userland
maple tree support contained in tools/testing/radix-tree/ and
tools/include/linux/, separating out shared components of the radix tree
implementation to provide this testing.
Kernel functionality is stubbed and shimmed as needed in tools/testing/vma/
which contains a fully functional userland vma_internal.h file and which
imports mm/vma.c and mm/vma.h to be directly tested from userland.
A simple, skeleton testing implementation is provided in
tools/testing/vma/main.c as a proof-of-concept, asserting that simple VMA
merge, modify (testing split), expand and shrink functionality works
correctly.
Lorenzo Stoakes (7):
userfaultfd: move core VMA manipulation logic to mm/userfaultfd.c
mm: move vma_modify() and helpers to internal header
mm: unexport vma_expand() / vma_shrink()
mm: move internal core VMA manipulation functions to own file
MAINTAINERS: Add entry for new VMA files
tools: separate out shared radix-tree components
tools: add skeleton code for userland testing of VMA logic
MAINTAINERS | 14 +
fs/exec.c | 26 +-
fs/userfaultfd.c | 160 +-
include/linux/mm.h | 104 +-
include/linux/userfaultfd_k.h | 19 +
mm/Makefile | 2 +-
mm/gup.c | 1 +
mm/huge_memory.c | 1 +
mm/internal.h | 160 +-
mm/madvise.c | 1 +
mm/memory.c | 1 +
mm/mempolicy.c | 1 +
mm/mlock.c | 1 +
mm/mmap.c | 1808 +----------------
mm/mmu_notifier.c | 2 +
mm/mprotect.c | 1 +
mm/mremap.c | 1 +
mm/mseal.c | 2 +
mm/rmap.c | 1 +
mm/userfaultfd.c | 170 ++
mm/vma.c | 1766 ++++++++++++++++
mm/vma.h | 356 ++++
mm/vma_internal.h | 143 ++
tools/testing/radix-tree/Makefile | 68 +-
tools/testing/radix-tree/maple.c | 14 +-
tools/testing/radix-tree/xarray.c | 9 +-
tools/testing/shared/autoconf.h | 2 +
tools/testing/{radix-tree => shared}/bitmap.c | 0
tools/testing/{radix-tree => shared}/linux.c | 0
.../{radix-tree => shared}/linux/bug.h | 0
.../{radix-tree => shared}/linux/cpu.h | 0
.../{radix-tree => shared}/linux/idr.h | 0
.../{radix-tree => shared}/linux/init.h | 0
.../{radix-tree => shared}/linux/kconfig.h | 0
.../{radix-tree => shared}/linux/kernel.h | 0
.../{radix-tree => shared}/linux/kmemleak.h | 0
.../{radix-tree => shared}/linux/local_lock.h | 0
.../{radix-tree => shared}/linux/lockdep.h | 0
.../{radix-tree => shared}/linux/maple_tree.h | 0
.../{radix-tree => shared}/linux/percpu.h | 0
.../{radix-tree => shared}/linux/preempt.h | 0
.../{radix-tree => shared}/linux/radix-tree.h | 0
.../{radix-tree => shared}/linux/rcupdate.h | 0
.../{radix-tree => shared}/linux/xarray.h | 0
tools/testing/shared/maple-shared.h | 9 +
tools/testing/shared/maple-shim.c | 7 +
tools/testing/shared/shared.h | 34 +
tools/testing/shared/shared.mk | 68 +
.../testing/shared/trace/events/maple_tree.h | 5 +
tools/testing/shared/xarray-shared.c | 5 +
tools/testing/shared/xarray-shared.h | 4 +
tools/testing/vma/.gitignore | 7 +
tools/testing/vma/Makefile | 18 +
tools/testing/vma/errors.txt | 0
tools/testing/vma/generated/autoconf.h | 2 +
tools/testing/vma/linux/atomic.h | 19 +
tools/testing/vma/linux/mmzone.h | 37 +
tools/testing/vma/main.c | 161 ++
tools/testing/vma/vma.h | 3 +
tools/testing/vma/vma_internal.h | 843 ++++++++
tools/testing/vma/vma_stub.c | 6 +
61 files changed, 3800 insertions(+), 2262 deletions(-)
create mode 100644 mm/vma.c
create mode 100644 mm/vma.h
create mode 100644 mm/vma_internal.h
create mode 100644 tools/testing/shared/autoconf.h
rename tools/testing/{radix-tree => shared}/bitmap.c (100%)
rename tools/testing/{radix-tree => shared}/linux.c (100%)
rename tools/testing/{radix-tree => shared}/linux/bug.h (100%)
rename tools/testing/{radix-tree => shared}/linux/cpu.h (100%)
rename tools/testing/{radix-tree => shared}/linux/idr.h (100%)
rename tools/testing/{radix-tree => shared}/linux/init.h (100%)
rename tools/testing/{radix-tree => shared}/linux/kconfig.h (100%)
rename tools/testing/{radix-tree => shared}/linux/kernel.h (100%)
rename tools/testing/{radix-tree => shared}/linux/kmemleak.h (100%)
rename tools/testing/{radix-tree => shared}/linux/local_lock.h (100%)
rename tools/testing/{radix-tree => shared}/linux/lockdep.h (100%)
rename tools/testing/{radix-tree => shared}/linux/maple_tree.h (100%)
rename tools/testing/{radix-tree => shared}/linux/percpu.h (100%)
rename tools/testing/{radix-tree => shared}/linux/preempt.h (100%)
rename tools/testing/{radix-tree => shared}/linux/radix-tree.h (100%)
rename tools/testing/{radix-tree => shared}/linux/rcupdate.h (100%)
rename tools/testing/{radix-tree => shared}/linux/xarray.h (100%)
create mode 100644 tools/testing/shared/maple-shared.h
create mode 100644 tools/testing/shared/maple-shim.c
create mode 100644 tools/testing/shared/shared.h
create mode 100644 tools/testing/shared/shared.mk
create mode 100644 tools/testing/shared/trace/events/maple_tree.h
create mode 100644 tools/testing/shared/xarray-shared.c
create mode 100644 tools/testing/shared/xarray-shared.h
create mode 100644 tools/testing/vma/.gitignore
create mode 100644 tools/testing/vma/Makefile
create mode 100644 tools/testing/vma/errors.txt
create mode 100644 tools/testing/vma/generated/autoconf.h
create mode 100644 tools/testing/vma/linux/atomic.h
create mode 100644 tools/testing/vma/linux/mmzone.h
create mode 100644 tools/testing/vma/main.c
create mode 100644 tools/testing/vma/vma.h
create mode 100644 tools/testing/vma/vma_internal.h
create mode 100644 tools/testing/vma/vma_stub.c
--
2.45.1
next reply other threads:[~2024-06-27 10:39 UTC|newest]
Thread overview: 26+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-06-27 10:39 Lorenzo Stoakes [this message]
2024-06-27 10:39 ` [RFC PATCH 1/7] userfaultfd: move core VMA manipulation logic to mm/userfaultfd.c Lorenzo Stoakes
2024-06-27 10:39 ` [RFC PATCH 2/7] mm: move vma_modify() and helpers to internal header Lorenzo Stoakes
2024-06-27 17:25 ` Liam R. Howlett
2024-06-27 19:33 ` Lorenzo Stoakes
2024-06-27 10:39 ` [RFC PATCH 3/7] mm: unexport vma_expand() / vma_shrink() Lorenzo Stoakes
2024-06-27 17:45 ` Liam R. Howlett
2024-06-27 19:38 ` Lorenzo Stoakes
2024-06-27 10:39 ` [RFC PATCH 4/7] mm: move internal core VMA manipulation functions to own file Lorenzo Stoakes
2024-06-27 17:56 ` Liam R. Howlett
2024-06-27 19:41 ` Lorenzo Stoakes
2024-06-27 19:46 ` Liam R. Howlett
2024-06-27 10:39 ` [RFC PATCH 5/7] MAINTAINERS: Add entry for new VMA files Lorenzo Stoakes
2024-06-27 10:39 ` [RFC PATCH 6/7] tools: separate out shared radix-tree components Lorenzo Stoakes
2024-06-27 17:59 ` Liam R. Howlett
2024-06-27 19:46 ` Lorenzo Stoakes
2024-06-27 20:03 ` Liam R. Howlett
2024-06-27 20:39 ` Lorenzo Stoakes
2024-06-27 10:39 ` [RFC PATCH 7/7] tools: add skeleton code for userland testing of VMA logic Lorenzo Stoakes
2024-06-27 16:58 ` Kees Cook
2024-06-27 18:25 ` Liam R. Howlett
2024-06-27 19:31 ` Lorenzo Stoakes
2024-06-27 19:46 ` Kees Cook
2024-06-27 17:20 ` Liam R. Howlett
2024-06-27 19:25 ` Lorenzo Stoakes
2024-06-27 19:42 ` Liam R. Howlett
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1719481836.git.lstoakes@gmail.com \
--to=lstoakes@gmail.com \
--cc=Liam.Howlett@oracle.com \
--cc=akpm@linux-foundation.org \
--cc=brauner@kernel.org \
--cc=ebiederm@xmission.com \
--cc=jack@suse.cz \
--cc=kees@kernel.org \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=surenb@google.com \
--cc=vbabka@suse.cz \
--cc=viro@zeniv.linux.org.uk \
--cc=willy@infradead.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).