public inbox for linux-mm@kvack.org
 help / color / mirror / Atom feed
From: Mike Rapoport <rppt@kernel.org>
To: Luiz Capitulino <luizcap@redhat.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	David Hildenbrand <david@kernel.org>,
	Baolin Wang <baolin.wang@linux.alibaba.com>,
	Barry Song <baohua@kernel.org>, Dev Jain <dev.jain@arm.com>,
	Donet Tom <donettom@linux.ibm.com>,
	Jason Gunthorpe <jgg@ziepe.ca>,
	John Hubbard <jhubbard@nvidia.com>,
	"Liam R. Howlett" <Liam.Howlett@oracle.com>,
	Lance Yang <lance.yang@linux.dev>,
	Leon Romanovsky <leon@kernel.org>,
	Lorenzo Stoakes <ljs@kernel.org>, Mark Brown <broonie@kernel.org>,
	Michal Hocko <mhocko@suse.com>, Nico Pache <npache@redhat.com>,
	Peter Xu <peterx@redhat.com>, Ryan Roberts <ryan.roberts@arm.com>,
	Sarthak Sharma <sarthak.sharma@arm.com>,
	Shuah Khan <shuah@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	Vlastimil Babka <vbabka@kernel.org>, Zi Yan <ziy@nvidia.com>,
	linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org,
	linux-mm@kvack.org
Subject: Re: [PATCH v2 43/53] selftests/mm: migration: add setup of HugeTLB pages
Date: Sun, 26 Apr 2026 12:58:29 +0200	[thread overview]
Message-ID: <ae3v1cyMLbcvJtYW@kernel.org> (raw)
In-Reply-To: <a8510cbd-4a30-460c-b870-a250ceb8a522@redhat.com>

On Fri, Apr 24, 2026 at 01:11:45PM -0400, Luiz Capitulino wrote:
> On 2026-04-18 06:55, Mike Rapoport wrote:
> > From: "Mike Rapoport (Microsoft)" <rppt@kernel.org>
> > 
> > migration skips HugeTLB tests if there are no free huge pages
> > prepared by a wrapper script.
> > 
> > Add setup of HugeTLB pages to the test and make sure that the original
> > settings are restored on the test exit.
> > 
> > Since kselftest_harness runs fixture setup and the tests in child
> > processes, use HUGETLB_SETUP_DEFAULT_PAGES() that defines a constructor
> > that runs in the main process and add verification that there are enough
> > free huge pages to the tests that use them.
> > 
> > Signed-off-by: Mike Rapoport (Microsoft) <rppt@kernel.org>
> > ---
> >   tools/testing/selftests/mm/migration.c | 8 ++++++++
> >   1 file changed, 8 insertions(+)
> > 
> > diff --git a/tools/testing/selftests/mm/migration.c b/tools/testing/selftests/mm/migration.c
> > index ccf42002ce86..61fb00953f83 100644
> > --- a/tools/testing/selftests/mm/migration.c
> > +++ b/tools/testing/selftests/mm/migration.c
> > @@ -23,6 +23,8 @@
> >   #define MAX_RETRIES	100
> >   #define ALIGN(x, a)	(((x) + (a - 1)) & (~((a) - 1)))
> > +HUGETLB_SETUP_DEFAULT_PAGES(1)
> 
> Hey Mike,
> 
> I've been reviewing and testing this series and got a reproducible issue
> with this test when running it on a x86 KVM guest with 88 vCPUs.
> 
> The issue is that, when executing the full MM suite with
> sudo ./run_vmtests.sh -d -a, all 6 migration test pass but it doesn't exit.
> Instead, it gets stuck after this output:
> 
> """
> # # PASSED: 6 / 6 tests passed.
> # # Totals: pass:6 fail:0 xfail:0 xpass:0 skip:0 error:0
> """
> 
> Getting a backtrace from gdb I see:
> 
> """
> #0  0x00007efd2f2c247b in __lll_lock_wait_private () from /lib64/libc.so.6
> #1  0x00007efd2f26fa88 in __run_exit_handlers () from /lib64/libc.so.6
> #2  0x00007efd2f26fabe in exit () from /lib64/libc.so.6
> #3  0x0000000000404f2e in hugepage_restore_settings_sighandler ()
> #4  <signal handler called>
> #5  0x00007efd2f32f416 in __unregister_atfork () from /lib64/libc.so.6
> #6  0x00007efd2f26f338 in __cxa_finalize () from /lib64/libc.so.6
> #7  0x00007efd2f4548c7 in __do_global_dtors_aux () from /lib64/libm.so.6
> #8  0x00007ffd66ae0320 in ?? ()
> #9  0x00007efd2f55b2d2 in _dl_call_fini (closure_map=0x7efd2f5500c0) at dl-call_fini.c:43
> """
> 
> Could we be messing with libc internal state somehow? I also get systemd
> services hung when I try to reboot.

I don't think we are messing with libc internal state, but we surely leave
zombies around.
All the tests that fork() terminate the children with kill() but they never
call wait*() to collect the exit status.
 
> Some of the migration tests fork() and then kill() their children
> processes. Won't those all restore the hugetlb state concurrently
> from hugepage_restore_settings_atexit()?

Yeah, I missed the kill()s :/
 
> Also, for shared_anon_htlb, don't we need to reserve a HugeTLB page per
> children?

We only mmap() a single huge page in the parent, the children don't create
new mappings.
 
> And there's another issue: when running the migration test individually,
> private_anon_htlb gets skipped. I guess it's because the previous test
> is restoring the HugeTLB state:

It could be.

I pushed the updated version that has the fixes for both zombie and
signal issues:

https://git.kernel.org/pub/scm/linux/kernel/git/rppt/linux.git/log/?h=mm-selftest/v3

Would be great if you can test it in your setup.

-- 
Sincerely yours,
Mike.


  reply	other threads:[~2026-04-26 10:58 UTC|newest]

Thread overview: 81+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-04-18 10:54 [PATCH v2 00/53] make MM selftests more CI friendly Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 01/53] selftests/mm: hugetlb-read-hwpoison: add SIGBUS handler Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 02/53] selftests/mm: khugepaged: enable collapse_single_pte_entry_compound for shmem Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 03/53] selftests/mm: migration: don't assume hupe page is TWOMEG Mike Rapoport
2026-04-24 17:14   ` Luiz Capitulino
2026-04-25  9:19     ` Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 04/53] selftests/mm: run_vmtests.sh: don't gate THP and KSM tests on HAVE_HUGEPAGES Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 05/53] selftests/mm: merge map_hugetlb into hugepage-mmap Mike Rapoport
2026-04-20  9:20   ` Donet Tom
2026-04-21  7:25     ` Mike Rapoport
2026-04-24 17:16   ` Luiz Capitulino
2026-04-25  9:29     ` Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 06/53] selftests/mm: rename hugepage-* tests to hugetlb-* Mike Rapoport
2026-04-22  9:38   ` Sarthak Sharma
2026-04-24 17:20   ` Luiz Capitulino
2026-04-24 17:36     ` Mark Brown
2026-04-24 17:41       ` Luiz Capitulino
2026-04-18 10:54 ` [PATCH v2 07/53] selftests/mm: hugetlb-shm: use kselftest framework Mike Rapoport
2026-04-22 11:20   ` Sarthak Sharma
2026-04-24  9:13     ` Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 08/53] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-04-22 12:28   ` Sarthak Sharma
2026-04-18 10:54 ` [PATCH v2 09/53] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-04-23  8:25   ` Sarthak Sharma
2026-04-18 10:54 ` [PATCH v2 10/53] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-04-20  9:32   ` Donet Tom
2026-04-18 10:54 ` [PATCH v2 11/53] selftests/mm: hugetlb-read-hwpoison: " Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 12/53] selftests/mm: khugepaged: group tests in an array Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 13/53] selftests/mm: khugepaged: use ksefltest framework Mike Rapoport
2026-04-18 10:54 ` [PATCH v2 14/53] selftests/mm: ksm_tests: use kselftest framework Mike Rapoport
2026-04-20 17:51   ` Mark Brown
2026-04-18 10:55 ` [PATCH v2 15/53] selftests/mm: protection_keys: use descriptive test names in TAP output Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 16/53] selftests/mm: protection_keys: use kselftest framework Mike Rapoport
2026-04-20 17:54   ` Mark Brown
2026-04-21  8:19     ` Mike Rapoport
2026-04-21 12:59       ` Mark Brown
2026-04-24  9:11         ` Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 17/53] selftests/mm: uffd-stress: " Mike Rapoport
2026-04-20 17:57   ` Mark Brown
2026-04-18 10:55 ` [PATCH v2 18/53] selftests/mm: uffd-unit-tests: " Mike Rapoport
2026-04-20 18:09   ` Mark Brown
2026-04-18 10:55 ` [PATCH v2 19/53] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-04-20 18:11   ` Mark Brown
2026-04-21  8:33     ` Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 20/53] selftests/mm: add atexit() and signal handlers to thp_settings Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 21/53] selftests/mm: rename thp_settings.[ch] to hugepage_settings.[ch] Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 22/53] selftests/mm: move HugeTLB helpers to hugepage_settings Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 23/53] selftests/mm: hugepage_settings: use unsigned long in detect_hugetlb_page_size Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 24/53] selftests/mm: hugepage_settings: add APIs to get and set nr_hugepages Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 25/53] selftests/mm: hugepage_settings: rename get_free_hugepages() Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 26/53] selftests/mm: hugepage_settings: add APIs for HugeTLB setup and teardown Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 27/53] selftests/mm: move read_file(), read_num() and write_num() to vm_util Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 28/53] selftests/mm: vm_util: add helpers to set and restore shm limits Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 29/53] selftests/mm: compaction_test: use HugeTLB helpers Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 30/53] selftests/mm: cow: add setup of HugeTLB pages Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 31/53] selftests/mm: gup_longterm: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 32/53] selftests/mm: gup_test: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 33/53] selftests/mm: hmm-tests: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 34/53] selftests/mm: hugepage_dio: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 35/53] selftests/mm: hugetlb_fault_after_madv: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 36/53] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 37/53] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 38/53] selftests/mm: hugetlb-mmap: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 39/53] selftests/mm: hugetlb-mremap: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 40/53] selftests/mm: hugetlb-shm: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 41/53] selftests/mm: hugetlb-soft-online: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 42/53] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 43/53] selftests/mm: migration: " Mike Rapoport
2026-04-24 17:11   ` Luiz Capitulino
2026-04-26 10:58     ` Mike Rapoport [this message]
2026-04-18 10:55 ` [PATCH v2 44/53] selftests/mm: pagemap_ioctl: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 45/53] selftests/mm: protection_keys: use library code for HugeTLB setup Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 46/53] selftests/mm: thuge-gen: add setup of HugeTLB pages Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 47/53] selftests/mm: uffd-stress: use hugetlb_save and alloc huge pages Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 48/53] selftests/mm: uffd-unit-tests: add setup of HugeTLB pages Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 49/53] selftests/mm: uffd-wp-mremap: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 50/53] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 51/53] selftests/mm: va_high_addr_switch.sh: drop huge pages setup Mike Rapoport
2026-04-24 17:21   ` Luiz Capitulino
2026-04-18 10:55 ` [PATCH v2 52/53] selftests/mm: run_vmtests.sh: free memory if available memory is low Mike Rapoport
2026-04-18 10:55 ` [PATCH v2 53/53] selftests/mm: run_vmtests.sh: drop detection and setup of HugeTLB Mike Rapoport

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=ae3v1cyMLbcvJtYW@kernel.org \
    --to=rppt@kernel.org \
    --cc=Liam.Howlett@oracle.com \
    --cc=akpm@linux-foundation.org \
    --cc=baohua@kernel.org \
    --cc=baolin.wang@linux.alibaba.com \
    --cc=broonie@kernel.org \
    --cc=david@kernel.org \
    --cc=dev.jain@arm.com \
    --cc=donettom@linux.ibm.com \
    --cc=jgg@ziepe.ca \
    --cc=jhubbard@nvidia.com \
    --cc=lance.yang@linux.dev \
    --cc=leon@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-kselftest@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=luizcap@redhat.com \
    --cc=mhocko@suse.com \
    --cc=npache@redhat.com \
    --cc=peterx@redhat.com \
    --cc=ryan.roberts@arm.com \
    --cc=sarthak.sharma@arm.com \
    --cc=shuah@kernel.org \
    --cc=surenb@google.com \
    --cc=vbabka@kernel.org \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox