public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Mike Rapoport <rppt@kernel.org>
To: Luiz Capitulino <luizcap@redhat.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	David Hildenbrand <david@kernel.org>,
	Baolin Wang <baolin.wang@linux.alibaba.com>,
	Barry Song <baohua@kernel.org>, Dev Jain <dev.jain@arm.com>,
	Donet Tom <donettom@linux.ibm.com>,
	Jason Gunthorpe <jgg@ziepe.ca>,
	John Hubbard <jhubbard@nvidia.com>,
	"Liam R. Howlett" <Liam.Howlett@oracle.com>,
	Lance Yang <lance.yang@linux.dev>,
	Leon Romanovsky <leon@kernel.org>,
	Lorenzo Stoakes <ljs@kernel.org>, Mark Brown <broonie@kernel.org>,
	Michal Hocko <mhocko@suse.com>, Nico Pache <npache@redhat.com>,
	Peter Xu <peterx@redhat.com>, Ryan Roberts <ryan.roberts@arm.com>,
	Sarthak Sharma <sarthak.sharma@arm.com>,
	Shuah Khan <shuah@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	Vlastimil Babka <vbabka@kernel.org>, Zi Yan <ziy@nvidia.com>,
	linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org,
	linux-mm@kvack.org
Subject: Re: [PATCH v3 27/54] selftests/mm: hugepage_settings: add APIs for HugeTLB setup and teardown
Date: Fri, 1 May 2026 17:25:41 +0200	[thread overview]
Message-ID: <afTF9RCy8eBoWYaj@kernel.org> (raw)
In-Reply-To: <2f443474-4448-462e-bc1e-55bc657d70ba@redhat.com>

On Thu, Apr 30, 2026 at 02:31:48PM -0400, Luiz Capitulino wrote:
> On 2026-04-28 16:42, Mike Rapoport wrote:
> > From: "Mike Rapoport (Microsoft)" <rppt@kernel.org>
> > 
> > A lot of tests require free HugeTLB pages. Some need just a few default
> > huge pages, some need a certain amount of memory available as HugeTLB, and
> > some just skip lots of tests if huge pages of all supported sizes are not
> > available.
> > 
> > This all resulted in a huge mess in run_vmtests.sh that sets up some huge
> > pages, adjusts them later and restores some of the settings if the stars
> > align.
> > 
> > Add APIs that allow saving the state of HugeTLB and setting up the desired
> > amount of HugeTLB pages.
> > 
> > Saving the state also registers atexit() callback and signal handler that
> > will ensure restoration of HugeTLB state.
> > 
> > Since many tests use both HugeTLB and THP, the atexit() callbacks and
> > signal handler are restoring both.
> > 
> > For kselftest_harness tests that run fixture setups and test in child
> > processes add a constructor that will save and restore settings in the main
> > process.
> > 
> > Signed-off-by: Mike Rapoport (Microsoft) <rppt@kernel.org>
> > ---
> >   .../testing/selftests/mm/hugepage_settings.c  | 178 +++++++++++++++---
> >   .../testing/selftests/mm/hugepage_settings.h  |  30 ++-
> >   2 files changed, 183 insertions(+), 25 deletions(-)
> > 
> > diff --git a/tools/testing/selftests/mm/hugepage_settings.c b/tools/testing/selftests/mm/hugepage_settings.c
> > index 4ae7332b5e1b..9d31b53dbc67 100644
> > --- a/tools/testing/selftests/mm/hugepage_settings.c
> > +++ b/tools/testing/selftests/mm/hugepage_settings.c
> > @@ -306,31 +306,12 @@ void thp_restore_settings(void)
> >   		thp_write_settings(&saved_settings);
> >   }
> > -static void thp_restore_settings_atexit(void)
> > +static void __thp_save_settings(void)
> >   {
> > -	thp_restore_settings();
> > -}
> > -
> > -static void thp_restore_settings_sighandler(int sig)
> > -{
> > -	/* exit() will invoke the thp_restore_settings_atexit handler. */
> > -	exit(KSFT_FAIL);
> > -}
> > +	if (!thp_available())
> > +		return;
> > -void thp_save_settings(void)
> > -{
> >   	thp_read_settings(&saved_settings);
> > -
> > -	/*
> > -	 * setup exit hooks to make sure THP settings are restored on graceful
> > -	 * and error exits and signals
> > -	 */
> > -	atexit(thp_restore_settings_atexit);
> > -	signal(SIGTERM, thp_restore_settings_sighandler);
> > -	signal(SIGINT, thp_restore_settings_sighandler);
> > -	signal(SIGHUP, thp_restore_settings_sighandler);
> > -	signal(SIGQUIT, thp_restore_settings_sighandler);
> > -
> >   	thp_settings_saved = true;
> >   }
> > @@ -399,11 +380,31 @@ bool thp_is_enabled(void)
> >   	return mode == 1 || mode == 3;
> >   }
> > +#define HUGETLB_MAX_NR_PAGESIZES 10
> > +struct hugetlb_settings {
> > +	unsigned long free_hugepages[HUGETLB_MAX_NR_PAGESIZES];
> 
> It looks like we don't actually use this in the API or maybe I'm missing
> something?

Yes, it's used only in later patches.
I felt it would be too churny to add users in this patch.
 
> Otherwise, the API looks great to me. But if you allow me to bikeshed :)
> 
> I think I'd do:
> 
> struct hugetlb_state {
> 	unsigned long nr_hugepages;
> 	unsigned long size;
> };
> 
> struct hugetlb_settings {
> 	struct hugetlb_state hstate[HUGETLB_MAX_PAGESIZES];
> 	unsigned long default_size;
> 	int nr_sizes;
> };

It might be slightly nicer abstraction but ...
 
> > +static void __hugetlb_save_settings(void)
> > +{
> > +	struct hugetlb_settings *settings = &hugetlb_saved_settings;
> > +	int nr_sizes;
> > +
> > +	settings->default_size = default_huge_page_size();
> > +	if (!settings->default_size)
> > +		return;
> > +
> > +	nr_sizes = detect_hugetlb_page_sizes(settings->sizes,
> > +					     HUGETLB_MAX_NR_PAGESIZES);

... this immediately becomes more complex.

> > +	if (!nr_sizes) {
> > +		settings->default_size = 0;
> > +		return;
> > +	}
> > +
> > +	for (int i = 0; i < nr_sizes; i++) {
> > +		unsigned long sz = settings->sizes[i];
> > +
> > +		if (!sz)
> > +			continue;
> > +
> > +		settings->free_hugepages[i] = hugetlb_free_pages(sz);
> > +		settings->nr_hugepages[i] = hugetlb_nr_pages(sz);

And this as well.

-- 
Sincerely yours,
Mike.

  reply	other threads:[~2026-05-01 15:25 UTC|newest]

Thread overview: 80+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-04-28 20:41 [PATCH v3 00/54] make MM selftests more CI friendly Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 01/54] selftests/mm: hugetlb-read-hwpoison: add SIGBUS handler Mike Rapoport
2026-04-30 13:04   ` Li Wang
2026-04-28 20:41 ` [PATCH v3 02/54] selftests/mm: migration: don't assume hupe page is TWOMEG Mike Rapoport
2026-04-30 13:19   ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 03/54] selftests/mm: migration: make nthreads represent number of working threads Mike Rapoport
2026-04-30 13:21   ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 04/54] selftests/mm: migration: properly cleanup fork()ed processes Mike Rapoport
2026-04-30 13:37   ` Luiz Capitulino
2026-04-30 14:40     ` Mike Rapoport
2026-04-30 14:54       ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 05/54] selftests/mm: run_vmtests.sh: don't gate THP and KSM tests on HAVE_HUGEPAGES Mike Rapoport
2026-05-01  8:35   ` Li Wang
2026-04-28 20:41 ` [PATCH v3 06/54] selftests/mm: merge map_hugetlb into hugepage-mmap Mike Rapoport
2026-04-30  9:33   ` Donet Tom
2026-04-30 15:26   ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 07/54] selftests/mm: rename hugepage-* tests to hugetlb-* Mike Rapoport
2026-05-01  8:18   ` Li Wang
2026-05-01 14:59     ` Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 08/54] selftests/mm: hugetlb-shm: use kselftest framework Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 09/54] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 10/54] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 11/54] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 12/54] selftests/mm: hugetlb-read-hwpoison: " Mike Rapoport
2026-04-30 13:09   ` Li Wang
2026-04-28 20:41 ` [PATCH v3 13/54] selftests/mm: khugepaged: group tests in an array Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 14/54] selftests/mm: khugepaged: use ksefltest framework Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 15/54] selftests/mm: ksm_tests: use kselftest framework Mike Rapoport
2026-04-29 11:59   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 16/54] selftests/mm: protection_keys: use descriptive test names in TAP output Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 17/54] selftests/mm: protection_keys: use kselftest framework Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 18/54] selftests/mm: uffd-stress: " Mike Rapoport
2026-04-29 12:10   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 19/54] selftests/mm: uffd-unit-tests: " Mike Rapoport
2026-04-29 13:13   ` Sarthak Sharma
2026-04-30 14:36     ` Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 20/54] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-04-30 15:42   ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 21/54] selftests/mm: add atexit() and signal handlers to thp_settings Mike Rapoport
2026-04-30  7:57   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 22/54] selftests/mm: rename thp_settings.[ch] to hugepage_settings.[ch] Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 23/54] selftests/mm: move HugeTLB helpers to hugepage_settings Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 24/54] selftests/mm: hugepage_settings: use unsigned long in detect_hugetlb_page_size Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 25/54] selftests/mm: hugepage_settings: add APIs to get and set nr_hugepages Mike Rapoport
2026-04-30 17:33   ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 26/54] selftests/mm: hugepage_settings: rename get_free_hugepages() Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 27/54] selftests/mm: hugepage_settings: add APIs for HugeTLB setup and teardown Mike Rapoport
2026-04-30 18:31   ` Luiz Capitulino
2026-05-01 15:25     ` Mike Rapoport [this message]
2026-04-28 20:42 ` [PATCH v3 28/54] selftests/mm: move read_file(), read_num() and write_num() to vm_util Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 29/54] selftests/mm: vm_util: add helpers to set and restore shm limits Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 30/54] selftests/mm: compaction_test: use HugeTLB helpers Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 31/54] selftests/mm: cow: add setup of HugeTLB pages Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 32/54] selftests/mm: gup_longterm: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 33/54] selftests/mm: gup_test: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 34/54] selftests/mm: hmm-tests: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 35/54] selftests/mm: hugepage_dio: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 36/54] selftests/mm: hugetlb_fault_after_madv: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 37/54] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 38/54] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 39/54] selftests/mm: hugetlb-mmap: " Mike Rapoport
2026-04-30 18:39   ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 40/54] selftests/mm: hugetlb-mremap: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 41/54] selftests/mm: hugetlb-shm: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 42/54] selftests/mm: hugetlb-soft-online: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 43/54] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 44/54] selftests/mm: migration: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 45/54] selftests/mm: pagemap_ioctl: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 46/54] selftests/mm: protection_keys: use library code for HugeTLB setup Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 47/54] selftests/mm: thuge-gen: add setup of HugeTLB pages Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 48/54] selftests/mm: uffd-stress: use hugetlb_save and alloc huge pages Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 49/54] selftests/mm: uffd-unit-tests: add setup of HugeTLB pages Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 50/54] selftests/mm: uffd-wp-mremap: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 51/54] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-04-30 18:44   ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 52/54] selftests/mm: va_high_addr_switch.sh: drop huge pages setup Mike Rapoport
2026-04-30 18:49   ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 53/54] selftests/mm: run_vmtests.sh: free memory if available memory is low Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 54/54] selftests/mm: run_vmtests.sh: drop detection and setup of HugeTLB Mike Rapoport
2026-04-30 12:56 ` [PATCH v3 00/54] make MM selftests more CI friendly Luiz Capitulino

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=afTF9RCy8eBoWYaj@kernel.org \
    --to=rppt@kernel.org \
    --cc=Liam.Howlett@oracle.com \
    --cc=akpm@linux-foundation.org \
    --cc=baohua@kernel.org \
    --cc=baolin.wang@linux.alibaba.com \
    --cc=broonie@kernel.org \
    --cc=david@kernel.org \
    --cc=dev.jain@arm.com \
    --cc=donettom@linux.ibm.com \
    --cc=jgg@ziepe.ca \
    --cc=jhubbard@nvidia.com \
    --cc=lance.yang@linux.dev \
    --cc=leon@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-kselftest@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=luizcap@redhat.com \
    --cc=mhocko@suse.com \
    --cc=npache@redhat.com \
    --cc=peterx@redhat.com \
    --cc=ryan.roberts@arm.com \
    --cc=sarthak.sharma@arm.com \
    --cc=shuah@kernel.org \
    --cc=surenb@google.com \
    --cc=vbabka@kernel.org \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox