All of lore.kernel.org
 help / color / mirror / Atom feed
From: Luiz Capitulino <luizcap@redhat.com>
To: Mike Rapoport <rppt@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	David Hildenbrand <david@kernel.org>,
	Baolin Wang <baolin.wang@linux.alibaba.com>,
	Barry Song <baohua@kernel.org>, Dev Jain <dev.jain@arm.com>,
	Donet Tom <donettom@linux.ibm.com>,
	Jason Gunthorpe <jgg@ziepe.ca>,
	John Hubbard <jhubbard@nvidia.com>,
	"Liam R. Howlett" <Liam.Howlett@oracle.com>,
	Lance Yang <lance.yang@linux.dev>,
	Leon Romanovsky <leon@kernel.org>,
	Lorenzo Stoakes <ljs@kernel.org>, Mark Brown <broonie@kernel.org>,
	Michal Hocko <mhocko@suse.com>, Nico Pache <npache@redhat.com>,
	Peter Xu <peterx@redhat.com>, Ryan Roberts <ryan.roberts@arm.com>,
	Sarthak Sharma <sarthak.sharma@arm.com>,
	Shuah Khan <shuah@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	Vlastimil Babka <vbabka@kernel.org>, Zi Yan <ziy@nvidia.com>,
	linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org,
	linux-mm@kvack.org
Subject: Re: [PATCH v3 27/54] selftests/mm: hugepage_settings: add APIs for HugeTLB setup and teardown
Date: Fri, 1 May 2026 15:30:18 -0400	[thread overview]
Message-ID: <22b1cadc-4b0d-4e2a-987c-e7a7bc2265eb@redhat.com> (raw)
In-Reply-To: <afTF9RCy8eBoWYaj@kernel.org>

On 2026-05-01 11:25, Mike Rapoport wrote:
> On Thu, Apr 30, 2026 at 02:31:48PM -0400, Luiz Capitulino wrote:
>> On 2026-04-28 16:42, Mike Rapoport wrote:
>>> From: "Mike Rapoport (Microsoft)" <rppt@kernel.org>
>>>
>>> A lot of tests require free HugeTLB pages. Some need just a few default
>>> huge pages, some need a certain amount of memory available as HugeTLB, and
>>> some just skip lots of tests if huge pages of all supported sizes are not
>>> available.
>>>
>>> This all resulted in a huge mess in run_vmtests.sh that sets up some huge
>>> pages, adjusts them later and restores some of the settings if the stars
>>> align.
>>>
>>> Add APIs that allow saving the state of HugeTLB and setting up the desired
>>> amount of HugeTLB pages.
>>>
>>> Saving the state also registers atexit() callback and signal handler that
>>> will ensure restoration of HugeTLB state.
>>>
>>> Since many tests use both HugeTLB and THP, the atexit() callbacks and
>>> signal handler are restoring both.
>>>
>>> For kselftest_harness tests that run fixture setups and test in child
>>> processes add a constructor that will save and restore settings in the main
>>> process.
>>>
>>> Signed-off-by: Mike Rapoport (Microsoft) <rppt@kernel.org>
>>> ---
>>>    .../testing/selftests/mm/hugepage_settings.c  | 178 +++++++++++++++---
>>>    .../testing/selftests/mm/hugepage_settings.h  |  30 ++-
>>>    2 files changed, 183 insertions(+), 25 deletions(-)
>>>
>>> diff --git a/tools/testing/selftests/mm/hugepage_settings.c b/tools/testing/selftests/mm/hugepage_settings.c
>>> index 4ae7332b5e1b..9d31b53dbc67 100644
>>> --- a/tools/testing/selftests/mm/hugepage_settings.c
>>> +++ b/tools/testing/selftests/mm/hugepage_settings.c
>>> @@ -306,31 +306,12 @@ void thp_restore_settings(void)
>>>    		thp_write_settings(&saved_settings);
>>>    }
>>> -static void thp_restore_settings_atexit(void)
>>> +static void __thp_save_settings(void)
>>>    {
>>> -	thp_restore_settings();
>>> -}
>>> -
>>> -static void thp_restore_settings_sighandler(int sig)
>>> -{
>>> -	/* exit() will invoke the thp_restore_settings_atexit handler. */
>>> -	exit(KSFT_FAIL);
>>> -}
>>> +	if (!thp_available())
>>> +		return;
>>> -void thp_save_settings(void)
>>> -{
>>>    	thp_read_settings(&saved_settings);
>>> -
>>> -	/*
>>> -	 * setup exit hooks to make sure THP settings are restored on graceful
>>> -	 * and error exits and signals
>>> -	 */
>>> -	atexit(thp_restore_settings_atexit);
>>> -	signal(SIGTERM, thp_restore_settings_sighandler);
>>> -	signal(SIGINT, thp_restore_settings_sighandler);
>>> -	signal(SIGHUP, thp_restore_settings_sighandler);
>>> -	signal(SIGQUIT, thp_restore_settings_sighandler);
>>> -
>>>    	thp_settings_saved = true;
>>>    }
>>> @@ -399,11 +380,31 @@ bool thp_is_enabled(void)
>>>    	return mode == 1 || mode == 3;
>>>    }
>>> +#define HUGETLB_MAX_NR_PAGESIZES 10
>>> +struct hugetlb_settings {
>>> +	unsigned long free_hugepages[HUGETLB_MAX_NR_PAGESIZES];
>>
>> It looks like we don't actually use this in the API or maybe I'm missing
>> something?
> 
> Yes, it's used only in later patches.

I don't see it, the patch below builds fine (again, sorry in advance if
I'm missing something obvious):

diff --git a/tools/testing/selftests/mm/hugepage_settings.c b/tools/testing/selftests/mm/hugepage_settings.c
index 097ba085f423..a023cfeb69c5 100644
--- a/tools/testing/selftests/mm/hugepage_settings.c
+++ b/tools/testing/selftests/mm/hugepage_settings.c
@@ -341,7 +341,6 @@ bool thp_is_enabled(void)
  
  #define HUGETLB_MAX_NR_PAGESIZES 10
  struct hugetlb_settings {
-	unsigned long free_hugepages[HUGETLB_MAX_NR_PAGESIZES];
  	unsigned long nr_hugepages[HUGETLB_MAX_NR_PAGESIZES];
  	unsigned long sizes[HUGETLB_MAX_NR_PAGESIZES];
  	unsigned long default_size;
@@ -509,7 +508,6 @@ static void __hugetlb_save_settings(void)
  		if (!sz)
  			continue;
  
-		settings->free_hugepages[i] = hugetlb_free_pages(sz);
  		settings->nr_hugepages[i] = hugetlb_nr_pages(sz);
  	}
  

> I felt it would be too churny to add users in this patch.
>   
>> Otherwise, the API looks great to me. But if you allow me to bikeshed :)
>>
>> I think I'd do:
>>
>> struct hugetlb_state {
>> 	unsigned long nr_hugepages;
>> 	unsigned long size;
>> };
>>
>> struct hugetlb_settings {
>> 	struct hugetlb_state hstate[HUGETLB_MAX_PAGESIZES];
>> 	unsigned long default_size;
>> 	int nr_sizes;
>> };
> 
> It might be slightly nicer abstraction but ...
>   
>>> +static void __hugetlb_save_settings(void)
>>> +{
>>> +	struct hugetlb_settings *settings = &hugetlb_saved_settings;
>>> +	int nr_sizes;
>>> +
>>> +	settings->default_size = default_huge_page_size();
>>> +	if (!settings->default_size)
>>> +		return;
>>> +
>>> +	nr_sizes = detect_hugetlb_page_sizes(settings->sizes,
>>> +					     HUGETLB_MAX_NR_PAGESIZES);
> 
> ... this immediately becomes more complex.
> 
>>> +	if (!nr_sizes) {
>>> +		settings->default_size = 0;
>>> +		return;
>>> +	}
>>> +
>>> +	for (int i = 0; i < nr_sizes; i++) {
>>> +		unsigned long sz = settings->sizes[i];
>>> +
>>> +		if (!sz)
>>> +			continue;
>>> +
>>> +		settings->free_hugepages[i] = hugetlb_free_pages(sz);
>>> +		settings->nr_hugepages[i] = hugetlb_nr_pages(sz);
> 
> And this as well.

We'd need a little more code to handle those cases, may or may not be
worth it. But enough bikesheding from my side :) the series is great as
is.


  reply	other threads:[~2026-05-01 19:30 UTC|newest]

Thread overview: 119+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-04-28 20:41 [PATCH v3 00/54] make MM selftests more CI friendly Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 01/54] selftests/mm: hugetlb-read-hwpoison: add SIGBUS handler Mike Rapoport
2026-04-30 13:04   ` Li Wang
2026-04-28 20:41 ` [PATCH v3 02/54] selftests/mm: migration: don't assume hupe page is TWOMEG Mike Rapoport
2026-04-30 13:19   ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 03/54] selftests/mm: migration: make nthreads represent number of working threads Mike Rapoport
2026-04-30 13:21   ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 04/54] selftests/mm: migration: properly cleanup fork()ed processes Mike Rapoport
2026-04-30 13:37   ` Luiz Capitulino
2026-04-30 14:40     ` Mike Rapoport
2026-04-30 14:54       ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 05/54] selftests/mm: run_vmtests.sh: don't gate THP and KSM tests on HAVE_HUGEPAGES Mike Rapoport
2026-05-01  8:35   ` Li Wang
2026-04-28 20:41 ` [PATCH v3 06/54] selftests/mm: merge map_hugetlb into hugepage-mmap Mike Rapoport
2026-04-30  9:33   ` Donet Tom
2026-04-30 15:26   ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 07/54] selftests/mm: rename hugepage-* tests to hugetlb-* Mike Rapoport
2026-05-01  8:18   ` Li Wang
2026-05-01 14:59     ` Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 08/54] selftests/mm: hugetlb-shm: use kselftest framework Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 09/54] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 10/54] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 11/54] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 12/54] selftests/mm: hugetlb-read-hwpoison: " Mike Rapoport
2026-04-30 13:09   ` Li Wang
2026-04-28 20:41 ` [PATCH v3 13/54] selftests/mm: khugepaged: group tests in an array Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 14/54] selftests/mm: khugepaged: use ksefltest framework Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 15/54] selftests/mm: ksm_tests: use kselftest framework Mike Rapoport
2026-04-29 11:59   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 16/54] selftests/mm: protection_keys: use descriptive test names in TAP output Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 17/54] selftests/mm: protection_keys: use kselftest framework Mike Rapoport
2026-05-06  8:57   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 18/54] selftests/mm: uffd-stress: " Mike Rapoport
2026-04-29 12:10   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 19/54] selftests/mm: uffd-unit-tests: " Mike Rapoport
2026-04-29 13:13   ` Sarthak Sharma
2026-04-30 14:36     ` Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 20/54] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-04-30 15:42   ` Luiz Capitulino
2026-05-06  9:02   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 21/54] selftests/mm: add atexit() and signal handlers to thp_settings Mike Rapoport
2026-04-30  7:57   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 22/54] selftests/mm: rename thp_settings.[ch] to hugepage_settings.[ch] Mike Rapoport
2026-05-06  9:12   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 23/54] selftests/mm: move HugeTLB helpers to hugepage_settings Mike Rapoport
2026-05-06  9:14   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 24/54] selftests/mm: hugepage_settings: use unsigned long in detect_hugetlb_page_size Mike Rapoport
2026-05-06  9:23   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 25/54] selftests/mm: hugepage_settings: add APIs to get and set nr_hugepages Mike Rapoport
2026-04-30 17:33   ` Luiz Capitulino
2026-05-06 10:12   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 26/54] selftests/mm: hugepage_settings: rename get_free_hugepages() Mike Rapoport
2026-05-06 11:03   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 27/54] selftests/mm: hugepage_settings: add APIs for HugeTLB setup and teardown Mike Rapoport
2026-04-30 18:31   ` Luiz Capitulino
2026-05-01 15:25     ` Mike Rapoport
2026-05-01 19:30       ` Luiz Capitulino [this message]
2026-05-02  4:36         ` Mike Rapoport
2026-05-04 13:04           ` Luiz Capitulino
2026-05-06 11:17   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 28/54] selftests/mm: move read_file(), read_num() and write_num() to vm_util Mike Rapoport
2026-05-06 11:36   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 29/54] selftests/mm: vm_util: add helpers to set and restore shm limits Mike Rapoport
2026-05-06 12:01   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 30/54] selftests/mm: compaction_test: use HugeTLB helpers Mike Rapoport
2026-05-04 10:07   ` Sarthak Sharma
2026-05-05 15:26     ` Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 31/54] selftests/mm: cow: add setup of HugeTLB pages Mike Rapoport
2026-05-04  6:52   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 32/54] selftests/mm: gup_longterm: " Mike Rapoport
2026-05-06 12:14   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 33/54] selftests/mm: gup_test: " Mike Rapoport
2026-05-06 12:29   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 34/54] selftests/mm: hmm-tests: " Mike Rapoport
2026-05-04 11:46   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 35/54] selftests/mm: hugepage_dio: " Mike Rapoport
2026-05-04 12:20   ` Sarthak Sharma
2026-05-11  8:25     ` Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 36/54] selftests/mm: hugetlb_fault_after_madv: " Mike Rapoport
2026-05-07  9:53   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 37/54] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-05-07 10:28   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 38/54] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-05-07 10:32   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 39/54] selftests/mm: hugetlb-mmap: " Mike Rapoport
2026-04-30 18:39   ` Luiz Capitulino
2026-05-07 10:38   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 40/54] selftests/mm: hugetlb-mremap: " Mike Rapoport
2026-05-05  6:51   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 41/54] selftests/mm: hugetlb-shm: " Mike Rapoport
2026-05-05 11:33   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 42/54] selftests/mm: hugetlb-soft-online: " Mike Rapoport
2026-05-05  7:15   ` Sarthak Sharma
2026-05-11  8:25     ` Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 43/54] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-05-07 11:27   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 44/54] selftests/mm: migration: " Mike Rapoport
2026-05-07 11:36   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 45/54] selftests/mm: pagemap_ioctl: " Mike Rapoport
2026-05-07 11:41   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 46/54] selftests/mm: protection_keys: use library code for HugeTLB setup Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 47/54] selftests/mm: thuge-gen: add setup of HugeTLB pages Mike Rapoport
2026-05-07 11:50   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 48/54] selftests/mm: uffd-stress: use hugetlb_save and alloc huge pages Mike Rapoport
2026-05-07 11:58   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 49/54] selftests/mm: uffd-unit-tests: add setup of HugeTLB pages Mike Rapoport
2026-05-05 11:48   ` Sarthak Sharma
2026-05-11  8:28     ` Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 50/54] selftests/mm: uffd-wp-mremap: " Mike Rapoport
2026-05-05 11:27   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 51/54] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-04-30 18:44   ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 52/54] selftests/mm: va_high_addr_switch.sh: drop huge pages setup Mike Rapoport
2026-04-30 18:49   ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 53/54] selftests/mm: run_vmtests.sh: free memory if available memory is low Mike Rapoport
2026-05-07 12:07   ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 54/54] selftests/mm: run_vmtests.sh: drop detection and setup of HugeTLB Mike Rapoport
2026-05-07 12:10   ` Sarthak Sharma
2026-04-30 12:56 ` [PATCH v3 00/54] make MM selftests more CI friendly Luiz Capitulino

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=22b1cadc-4b0d-4e2a-987c-e7a7bc2265eb@redhat.com \
    --to=luizcap@redhat.com \
    --cc=Liam.Howlett@oracle.com \
    --cc=akpm@linux-foundation.org \
    --cc=baohua@kernel.org \
    --cc=baolin.wang@linux.alibaba.com \
    --cc=broonie@kernel.org \
    --cc=david@kernel.org \
    --cc=dev.jain@arm.com \
    --cc=donettom@linux.ibm.com \
    --cc=jgg@ziepe.ca \
    --cc=jhubbard@nvidia.com \
    --cc=lance.yang@linux.dev \
    --cc=leon@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-kselftest@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=mhocko@suse.com \
    --cc=npache@redhat.com \
    --cc=peterx@redhat.com \
    --cc=rppt@kernel.org \
    --cc=ryan.roberts@arm.com \
    --cc=sarthak.sharma@arm.com \
    --cc=shuah@kernel.org \
    --cc=surenb@google.com \
    --cc=vbabka@kernel.org \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.