From: Luiz Capitulino <luizcap@redhat.com>
To: Mike Rapoport <rppt@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
David Hildenbrand <david@kernel.org>,
Baolin Wang <baolin.wang@linux.alibaba.com>,
Barry Song <baohua@kernel.org>, Dev Jain <dev.jain@arm.com>,
Donet Tom <donettom@linux.ibm.com>,
Jason Gunthorpe <jgg@ziepe.ca>,
John Hubbard <jhubbard@nvidia.com>,
"Liam R. Howlett" <Liam.Howlett@oracle.com>,
Lance Yang <lance.yang@linux.dev>,
Leon Romanovsky <leon@kernel.org>,
Lorenzo Stoakes <ljs@kernel.org>, Mark Brown <broonie@kernel.org>,
Michal Hocko <mhocko@suse.com>, Nico Pache <npache@redhat.com>,
Peter Xu <peterx@redhat.com>, Ryan Roberts <ryan.roberts@arm.com>,
Sarthak Sharma <sarthak.sharma@arm.com>,
Shuah Khan <shuah@kernel.org>,
Suren Baghdasaryan <surenb@google.com>,
Vlastimil Babka <vbabka@kernel.org>, Zi Yan <ziy@nvidia.com>,
linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org,
linux-mm@kvack.org
Subject: Re: [PATCH v3 27/54] selftests/mm: hugepage_settings: add APIs for HugeTLB setup and teardown
Date: Fri, 1 May 2026 15:30:18 -0400 [thread overview]
Message-ID: <22b1cadc-4b0d-4e2a-987c-e7a7bc2265eb@redhat.com> (raw)
In-Reply-To: <afTF9RCy8eBoWYaj@kernel.org>
On 2026-05-01 11:25, Mike Rapoport wrote:
> On Thu, Apr 30, 2026 at 02:31:48PM -0400, Luiz Capitulino wrote:
>> On 2026-04-28 16:42, Mike Rapoport wrote:
>>> From: "Mike Rapoport (Microsoft)" <rppt@kernel.org>
>>>
>>> A lot of tests require free HugeTLB pages. Some need just a few default
>>> huge pages, some need a certain amount of memory available as HugeTLB, and
>>> some just skip lots of tests if huge pages of all supported sizes are not
>>> available.
>>>
>>> This all resulted in a huge mess in run_vmtests.sh that sets up some huge
>>> pages, adjusts them later and restores some of the settings if the stars
>>> align.
>>>
>>> Add APIs that allow saving the state of HugeTLB and setting up the desired
>>> amount of HugeTLB pages.
>>>
>>> Saving the state also registers atexit() callback and signal handler that
>>> will ensure restoration of HugeTLB state.
>>>
>>> Since many tests use both HugeTLB and THP, the atexit() callbacks and
>>> signal handler are restoring both.
>>>
>>> For kselftest_harness tests that run fixture setups and test in child
>>> processes add a constructor that will save and restore settings in the main
>>> process.
>>>
>>> Signed-off-by: Mike Rapoport (Microsoft) <rppt@kernel.org>
>>> ---
>>> .../testing/selftests/mm/hugepage_settings.c | 178 +++++++++++++++---
>>> .../testing/selftests/mm/hugepage_settings.h | 30 ++-
>>> 2 files changed, 183 insertions(+), 25 deletions(-)
>>>
>>> diff --git a/tools/testing/selftests/mm/hugepage_settings.c b/tools/testing/selftests/mm/hugepage_settings.c
>>> index 4ae7332b5e1b..9d31b53dbc67 100644
>>> --- a/tools/testing/selftests/mm/hugepage_settings.c
>>> +++ b/tools/testing/selftests/mm/hugepage_settings.c
>>> @@ -306,31 +306,12 @@ void thp_restore_settings(void)
>>> thp_write_settings(&saved_settings);
>>> }
>>> -static void thp_restore_settings_atexit(void)
>>> +static void __thp_save_settings(void)
>>> {
>>> - thp_restore_settings();
>>> -}
>>> -
>>> -static void thp_restore_settings_sighandler(int sig)
>>> -{
>>> - /* exit() will invoke the thp_restore_settings_atexit handler. */
>>> - exit(KSFT_FAIL);
>>> -}
>>> + if (!thp_available())
>>> + return;
>>> -void thp_save_settings(void)
>>> -{
>>> thp_read_settings(&saved_settings);
>>> -
>>> - /*
>>> - * setup exit hooks to make sure THP settings are restored on graceful
>>> - * and error exits and signals
>>> - */
>>> - atexit(thp_restore_settings_atexit);
>>> - signal(SIGTERM, thp_restore_settings_sighandler);
>>> - signal(SIGINT, thp_restore_settings_sighandler);
>>> - signal(SIGHUP, thp_restore_settings_sighandler);
>>> - signal(SIGQUIT, thp_restore_settings_sighandler);
>>> -
>>> thp_settings_saved = true;
>>> }
>>> @@ -399,11 +380,31 @@ bool thp_is_enabled(void)
>>> return mode == 1 || mode == 3;
>>> }
>>> +#define HUGETLB_MAX_NR_PAGESIZES 10
>>> +struct hugetlb_settings {
>>> + unsigned long free_hugepages[HUGETLB_MAX_NR_PAGESIZES];
>>
>> It looks like we don't actually use this in the API or maybe I'm missing
>> something?
>
> Yes, it's used only in later patches.
I don't see it, the patch below builds fine (again, sorry in advance if
I'm missing something obvious):
diff --git a/tools/testing/selftests/mm/hugepage_settings.c b/tools/testing/selftests/mm/hugepage_settings.c
index 097ba085f423..a023cfeb69c5 100644
--- a/tools/testing/selftests/mm/hugepage_settings.c
+++ b/tools/testing/selftests/mm/hugepage_settings.c
@@ -341,7 +341,6 @@ bool thp_is_enabled(void)
#define HUGETLB_MAX_NR_PAGESIZES 10
struct hugetlb_settings {
- unsigned long free_hugepages[HUGETLB_MAX_NR_PAGESIZES];
unsigned long nr_hugepages[HUGETLB_MAX_NR_PAGESIZES];
unsigned long sizes[HUGETLB_MAX_NR_PAGESIZES];
unsigned long default_size;
@@ -509,7 +508,6 @@ static void __hugetlb_save_settings(void)
if (!sz)
continue;
- settings->free_hugepages[i] = hugetlb_free_pages(sz);
settings->nr_hugepages[i] = hugetlb_nr_pages(sz);
}
> I felt it would be too churny to add users in this patch.
>
>> Otherwise, the API looks great to me. But if you allow me to bikeshed :)
>>
>> I think I'd do:
>>
>> struct hugetlb_state {
>> unsigned long nr_hugepages;
>> unsigned long size;
>> };
>>
>> struct hugetlb_settings {
>> struct hugetlb_state hstate[HUGETLB_MAX_PAGESIZES];
>> unsigned long default_size;
>> int nr_sizes;
>> };
>
> It might be slightly nicer abstraction but ...
>
>>> +static void __hugetlb_save_settings(void)
>>> +{
>>> + struct hugetlb_settings *settings = &hugetlb_saved_settings;
>>> + int nr_sizes;
>>> +
>>> + settings->default_size = default_huge_page_size();
>>> + if (!settings->default_size)
>>> + return;
>>> +
>>> + nr_sizes = detect_hugetlb_page_sizes(settings->sizes,
>>> + HUGETLB_MAX_NR_PAGESIZES);
>
> ... this immediately becomes more complex.
>
>>> + if (!nr_sizes) {
>>> + settings->default_size = 0;
>>> + return;
>>> + }
>>> +
>>> + for (int i = 0; i < nr_sizes; i++) {
>>> + unsigned long sz = settings->sizes[i];
>>> +
>>> + if (!sz)
>>> + continue;
>>> +
>>> + settings->free_hugepages[i] = hugetlb_free_pages(sz);
>>> + settings->nr_hugepages[i] = hugetlb_nr_pages(sz);
>
> And this as well.
We'd need a little more code to handle those cases, may or may not be
worth it. But enough bikesheding from my side :) the series is great as
is.
next prev parent reply other threads:[~2026-05-01 19:30 UTC|newest]
Thread overview: 81+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-04-28 20:41 [PATCH v3 00/54] make MM selftests more CI friendly Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 01/54] selftests/mm: hugetlb-read-hwpoison: add SIGBUS handler Mike Rapoport
2026-04-30 13:04 ` Li Wang
2026-04-28 20:41 ` [PATCH v3 02/54] selftests/mm: migration: don't assume hupe page is TWOMEG Mike Rapoport
2026-04-30 13:19 ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 03/54] selftests/mm: migration: make nthreads represent number of working threads Mike Rapoport
2026-04-30 13:21 ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 04/54] selftests/mm: migration: properly cleanup fork()ed processes Mike Rapoport
2026-04-30 13:37 ` Luiz Capitulino
2026-04-30 14:40 ` Mike Rapoport
2026-04-30 14:54 ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 05/54] selftests/mm: run_vmtests.sh: don't gate THP and KSM tests on HAVE_HUGEPAGES Mike Rapoport
2026-05-01 8:35 ` Li Wang
2026-04-28 20:41 ` [PATCH v3 06/54] selftests/mm: merge map_hugetlb into hugepage-mmap Mike Rapoport
2026-04-30 9:33 ` Donet Tom
2026-04-30 15:26 ` Luiz Capitulino
2026-04-28 20:41 ` [PATCH v3 07/54] selftests/mm: rename hugepage-* tests to hugetlb-* Mike Rapoport
2026-05-01 8:18 ` Li Wang
2026-05-01 14:59 ` Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 08/54] selftests/mm: hugetlb-shm: use kselftest framework Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 09/54] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 10/54] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 11/54] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-04-28 20:41 ` [PATCH v3 12/54] selftests/mm: hugetlb-read-hwpoison: " Mike Rapoport
2026-04-30 13:09 ` Li Wang
2026-04-28 20:41 ` [PATCH v3 13/54] selftests/mm: khugepaged: group tests in an array Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 14/54] selftests/mm: khugepaged: use ksefltest framework Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 15/54] selftests/mm: ksm_tests: use kselftest framework Mike Rapoport
2026-04-29 11:59 ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 16/54] selftests/mm: protection_keys: use descriptive test names in TAP output Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 17/54] selftests/mm: protection_keys: use kselftest framework Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 18/54] selftests/mm: uffd-stress: " Mike Rapoport
2026-04-29 12:10 ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 19/54] selftests/mm: uffd-unit-tests: " Mike Rapoport
2026-04-29 13:13 ` Sarthak Sharma
2026-04-30 14:36 ` Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 20/54] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-04-30 15:42 ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 21/54] selftests/mm: add atexit() and signal handlers to thp_settings Mike Rapoport
2026-04-30 7:57 ` Sarthak Sharma
2026-04-28 20:42 ` [PATCH v3 22/54] selftests/mm: rename thp_settings.[ch] to hugepage_settings.[ch] Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 23/54] selftests/mm: move HugeTLB helpers to hugepage_settings Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 24/54] selftests/mm: hugepage_settings: use unsigned long in detect_hugetlb_page_size Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 25/54] selftests/mm: hugepage_settings: add APIs to get and set nr_hugepages Mike Rapoport
2026-04-30 17:33 ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 26/54] selftests/mm: hugepage_settings: rename get_free_hugepages() Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 27/54] selftests/mm: hugepage_settings: add APIs for HugeTLB setup and teardown Mike Rapoport
2026-04-30 18:31 ` Luiz Capitulino
2026-05-01 15:25 ` Mike Rapoport
2026-05-01 19:30 ` Luiz Capitulino [this message]
2026-04-28 20:42 ` [PATCH v3 28/54] selftests/mm: move read_file(), read_num() and write_num() to vm_util Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 29/54] selftests/mm: vm_util: add helpers to set and restore shm limits Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 30/54] selftests/mm: compaction_test: use HugeTLB helpers Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 31/54] selftests/mm: cow: add setup of HugeTLB pages Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 32/54] selftests/mm: gup_longterm: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 33/54] selftests/mm: gup_test: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 34/54] selftests/mm: hmm-tests: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 35/54] selftests/mm: hugepage_dio: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 36/54] selftests/mm: hugetlb_fault_after_madv: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 37/54] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 38/54] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 39/54] selftests/mm: hugetlb-mmap: " Mike Rapoport
2026-04-30 18:39 ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 40/54] selftests/mm: hugetlb-mremap: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 41/54] selftests/mm: hugetlb-shm: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 42/54] selftests/mm: hugetlb-soft-online: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 43/54] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 44/54] selftests/mm: migration: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 45/54] selftests/mm: pagemap_ioctl: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 46/54] selftests/mm: protection_keys: use library code for HugeTLB setup Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 47/54] selftests/mm: thuge-gen: add setup of HugeTLB pages Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 48/54] selftests/mm: uffd-stress: use hugetlb_save and alloc huge pages Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 49/54] selftests/mm: uffd-unit-tests: add setup of HugeTLB pages Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 50/54] selftests/mm: uffd-wp-mremap: " Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 51/54] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-04-30 18:44 ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 52/54] selftests/mm: va_high_addr_switch.sh: drop huge pages setup Mike Rapoport
2026-04-30 18:49 ` Luiz Capitulino
2026-04-28 20:42 ` [PATCH v3 53/54] selftests/mm: run_vmtests.sh: free memory if available memory is low Mike Rapoport
2026-04-28 20:42 ` [PATCH v3 54/54] selftests/mm: run_vmtests.sh: drop detection and setup of HugeTLB Mike Rapoport
2026-04-30 12:56 ` [PATCH v3 00/54] make MM selftests more CI friendly Luiz Capitulino
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=22b1cadc-4b0d-4e2a-987c-e7a7bc2265eb@redhat.com \
--to=luizcap@redhat.com \
--cc=Liam.Howlett@oracle.com \
--cc=akpm@linux-foundation.org \
--cc=baohua@kernel.org \
--cc=baolin.wang@linux.alibaba.com \
--cc=broonie@kernel.org \
--cc=david@kernel.org \
--cc=dev.jain@arm.com \
--cc=donettom@linux.ibm.com \
--cc=jgg@ziepe.ca \
--cc=jhubbard@nvidia.com \
--cc=lance.yang@linux.dev \
--cc=leon@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-kselftest@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=ljs@kernel.org \
--cc=mhocko@suse.com \
--cc=npache@redhat.com \
--cc=peterx@redhat.com \
--cc=rppt@kernel.org \
--cc=ryan.roberts@arm.com \
--cc=sarthak.sharma@arm.com \
--cc=shuah@kernel.org \
--cc=surenb@google.com \
--cc=vbabka@kernel.org \
--cc=ziy@nvidia.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox