All of lore.kernel.org
 help / color / mirror / Atom feed
From: Mike Rapoport <rppt@kernel.org>
To: Andrew Morton <akpm@linux-foundation.org>,
	David Hildenbrand <david@kernel.org>
Cc: Baolin Wang <baolin.wang@linux.alibaba.com>,
	Barry Song <baohua@kernel.org>, Dev Jain <dev.jain@arm.com>,
	Donet Tom <donettom@linux.ibm.com>,
	Jason Gunthorpe <jgg@ziepe.ca>,
	John Hubbard <jhubbard@nvidia.com>,
	"Liam R. Howlett" <Liam.Howlett@oracle.com>,
	Lance Yang <lance.yang@linux.dev>, Li Wang <li.wang@linux.dev>,
	Leon Romanovsky <leon@kernel.org>,
	Lorenzo Stoakes <ljs@kernel.org>,
	Luiz Capitulino <luizcap@redhat.com>,
	Mark Brown <broonie@kernel.org>, Michal Hocko <mhocko@suse.com>,
	Mike Rapoport <rppt@kernel.org>, Nico Pache <npache@redhat.com>,
	Peter Xu <peterx@redhat.com>, Ryan Roberts <ryan.roberts@arm.com>,
	Sarthak Sharma <sarthak.sharma@arm.com>,
	Shuah Khan <shuah@kernel.org>,
	Suren Baghdasaryan <surenb@google.com>,
	Vlastimil Babka <vbabka@kernel.org>, Zi Yan <ziy@nvidia.com>,
	linux-kernel@vger.kernel.org, linux-kselftest@vger.kernel.org,
	linux-mm@kvack.org
Subject: [PATCH v4 55/55] selftests/mm: run_vmtests.sh: drop detection and setup of HugeTLB
Date: Mon, 11 May 2026 19:28:39 +0300	[thread overview]
Message-ID: <20260511162840.375890-56-rppt@kernel.org> (raw)
In-Reply-To: <20260511162840.375890-1-rppt@kernel.org>

From: "Mike Rapoport (Microsoft)" <rppt@kernel.org>

All the tests that use HugeTLB can detect and setup HugeTLB pages on
their own.

Drop detection and setup of HugeTLB from run_vmtests.sh.

Tested-by: Luiz Capitulino <luizcap@redhat.com>
Tested-by: Sarthak Sharma <sarthak.sharma@arm.com>
Signed-off-by: Mike Rapoport (Microsoft) <rppt@kernel.org>
---
 tools/testing/selftests/mm/run_vmtests.sh | 125 ++--------------------
 1 file changed, 7 insertions(+), 118 deletions(-)

diff --git a/tools/testing/selftests/mm/run_vmtests.sh b/tools/testing/selftests/mm/run_vmtests.sh
index 45298157b155..73f14894790a 100755
--- a/tools/testing/selftests/mm/run_vmtests.sh
+++ b/tools/testing/selftests/mm/run_vmtests.sh
@@ -132,7 +132,7 @@ test_selected() {
 
 run_gup_matrix() {
     # -t: thp=on, -T: thp=off, -H: hugetlb=on
-    local hugetlb_mb=$(( needmem_KB / 1024 ))
+    local hugetlb_mb=256
 
     for huge in -t -T "-H -m $hugetlb_mb"; do
         # -u: gup-fast, -U: gup-basic, -a: pin-fast, -b: pin-basic, -L: pin-longterm
@@ -154,60 +154,6 @@ run_gup_matrix() {
     done
 }
 
-# get huge pagesize and freepages from /proc/meminfo
-while read -r name size unit; do
-	if [ "$name" = "HugePages_Free:" ]; then
-		freepgs="$size"
-	fi
-	if [ "$name" = "Hugepagesize:" ]; then
-		hpgsize_KB="$size"
-	fi
-done < /proc/meminfo
-
-# Simple hugetlbfs tests have a hardcoded minimum requirement of
-# huge pages totaling 256MB (262144KB) in size.  The userfaultfd
-# hugetlb test requires a minimum of 2 * nr_cpus huge pages.  Take
-# both of these requirements into account and attempt to increase
-# number of huge pages available.
-nr_cpus=$(nproc)
-uffd_min_KB=$((hpgsize_KB * nr_cpus * 2))
-hugetlb_min_KB=$((256 * 1024))
-if [[ $uffd_min_KB -gt $hugetlb_min_KB ]]; then
-	needmem_KB=$uffd_min_KB
-else
-	needmem_KB=$hugetlb_min_KB
-fi
-
-# set proper nr_hugepages
-if [ -n "$freepgs" ] && [ -n "$hpgsize_KB" ]; then
-	orig_nr_hugepgs=$(cat /proc/sys/vm/nr_hugepages)
-	needpgs=$((needmem_KB / hpgsize_KB))
-	tries=2
-	while [ "$tries" -gt 0 ] && [ "$freepgs" -lt "$needpgs" ]; do
-		lackpgs=$((needpgs - freepgs))
-		echo 3 > /proc/sys/vm/drop_caches
-		if ! echo $((lackpgs + orig_nr_hugepgs)) > /proc/sys/vm/nr_hugepages; then
-			echo "Please run this test as root"
-			exit $ksft_skip
-		fi
-		while read -r name size unit; do
-			if [ "$name" = "HugePages_Free:" ]; then
-				freepgs=$size
-			fi
-		done < /proc/meminfo
-		tries=$((tries - 1))
-	done
-	nr_hugepgs=$(cat /proc/sys/vm/nr_hugepages)
-	if [ "$freepgs" -lt "$needpgs" ]; then
-		printf "Not enough huge pages available (%d < %d)\n" \
-		       "$freepgs" "$needpgs"
-	fi
-	HAVE_HUGEPAGES=1
-else
-	echo "no hugetlbfs support in kernel?"
-	HAVE_HUGEPAGES=0
-fi
-
 # filter 64bit architectures
 ARCH64STR="arm64 mips64 parisc64 ppc64 ppc64le riscv64 s390x sparc64 x86_64"
 if [ -z "$ARCH" ]; then
@@ -277,29 +223,13 @@ run_test() {
 echo "TAP version 13" | tap_output
 
 CATEGORY="hugetlb" run_test ./hugetlb-mmap
-
-shmmax=$(cat /proc/sys/kernel/shmmax)
-shmall=$(cat /proc/sys/kernel/shmall)
-echo 268435456 > /proc/sys/kernel/shmmax
-echo 4194304 > /proc/sys/kernel/shmall
 CATEGORY="hugetlb" run_test ./hugetlb-shm
-echo "$shmmax" > /proc/sys/kernel/shmmax
-echo "$shmall" > /proc/sys/kernel/shmall
-
 CATEGORY="hugetlb" run_test ./hugetlb-mremap
 CATEGORY="hugetlb" run_test ./hugetlb-vmemmap
 CATEGORY="hugetlb" run_test ./hugetlb-madvise
 CATEGORY="hugetlb" run_test ./hugetlb_dio
-
-if [ "${HAVE_HUGEPAGES}" = "1" ]; then
-	nr_hugepages_tmp=$(cat /proc/sys/vm/nr_hugepages)
-	# For this test, we need one and just one huge page
-	echo 1 > /proc/sys/vm/nr_hugepages
-	CATEGORY="hugetlb" run_test ./hugetlb_fault_after_madv
-	CATEGORY="hugetlb" run_test ./hugetlb_madv_vs_map
-	# Restore the previous number of huge pages, since further tests rely on it
-	echo "$nr_hugepages_tmp" > /proc/sys/vm/nr_hugepages
-fi
+CATEGORY="hugetlb" run_test ./hugetlb_fault_after_madv
+CATEGORY="hugetlb" run_test ./hugetlb_madv_vs_map
 
 if test_selected "hugetlb"; then
 	echo "NOTE: These hugetlb tests provide minimal coverage.  Use"	  | tap_prefix
@@ -326,44 +256,11 @@ CATEGORY="gup_test" run_test ./gup_longterm
 CATEGORY="userfaultfd" run_test ./uffd-unit-tests
 uffd_stress_bin=./uffd-stress
 CATEGORY="userfaultfd" run_test ${uffd_stress_bin} anon 20 16
-# Hugetlb tests require source and destination huge pages. Pass in almost half
-# the size of the free pages we have, which is used for *each*. An adjustment
-# of (nr_parallel - 1) is done (see nr_parallel in uffd-stress.c) to have some
-# extra hugepages - this is done to prevent the test from failing by racily
-# reserving more hugepages than strictly required.
-# uffd-stress expects a region expressed in MiB, so we adjust
-# half_ufd_size_MB accordingly.
-adjustment=$(( (31 < (nr_cpus - 1)) ? 31 : (nr_cpus - 1) ))
-half_ufd_size_MB=$((((freepgs - adjustment) * hpgsize_KB) / 1024 / 2))
-CATEGORY="userfaultfd" run_test ${uffd_stress_bin} hugetlb "$half_ufd_size_MB" 32
-CATEGORY="userfaultfd" run_test ${uffd_stress_bin} hugetlb-private "$half_ufd_size_MB" 32
+CATEGORY="userfaultfd" run_test ${uffd_stress_bin} hugetlb 128 32
+CATEGORY="userfaultfd" run_test ${uffd_stress_bin} hugetlb-private 128 32
 CATEGORY="userfaultfd" run_test ${uffd_stress_bin} shmem 20 16
 CATEGORY="userfaultfd" run_test ${uffd_stress_bin} shmem-private 20 16
-# uffd-wp-mremap requires at least one page of each size.
-have_all_size_hugepgs=true
-declare -A nr_size_hugepgs
-for f in /sys/kernel/mm/hugepages/**/nr_hugepages; do
-	old=$(cat $f)
-	nr_size_hugepgs["$f"]="$old"
-	if [ "$old" == 0 ]; then
-		echo 1 > "$f"
-	fi
-	if [ $(cat "$f") == 0 ]; then
-		have_all_size_hugepgs=false
-		break
-	fi
-done
-if $have_all_size_hugepgs; then
-	CATEGORY="userfaultfd" run_test ./uffd-wp-mremap
-else
-	echo "# SKIP ./uffd-wp-mremap"
-fi
-
-#cleanup
-for f in "${!nr_size_hugepgs[@]}"; do
-	echo "${nr_size_hugepgs["$f"]}" > "$f"
-done
-echo "$nr_hugepgs" > /proc/sys/vm/nr_hugepages
+CATEGORY="userfaultfd" run_test ./uffd-wp-mremap
 
 CATEGORY="compaction" run_test ./compaction_test
 
@@ -387,12 +284,10 @@ CATEGORY="mremap" run_test ./mremap_test
 CATEGORY="hugetlb" run_test ./thuge-gen
 CATEGORY="hugetlb" run_test ./charge_reserved_hugetlb.sh -cgroup-v2
 CATEGORY="hugetlb" run_test ./hugetlb_reparenting_test.sh -cgroup-v2
+
 if $RUN_DESTRUCTIVE; then
-nr_hugepages_tmp=$(cat /proc/sys/vm/nr_hugepages)
 enable_soft_offline=$(cat /proc/sys/vm/enable_soft_offline)
-echo 8 > /proc/sys/vm/nr_hugepages
 CATEGORY="hugetlb" run_test ./hugetlb-soft-offline
-echo "$nr_hugepages_tmp" > /proc/sys/vm/nr_hugepages
 echo "$enable_soft_offline" > /proc/sys/vm/enable_soft_offline
 CATEGORY="hugetlb" run_test ./hugetlb-read-hwpoison
 fi
@@ -448,7 +343,6 @@ CATEGORY="ksm_numa" run_test ./ksm_tests -N -m 0
 CATEGORY="ksm" run_test ./ksm_functional_tests
 
 # protection_keys tests
-nr_hugepgs=$(cat /proc/sys/vm/nr_hugepages)
 if [ -x ./protection_keys_32 ]
 then
 	CATEGORY="pkey" run_test ./protection_keys_32
@@ -458,7 +352,6 @@ if [ -x ./protection_keys_64 ]
 then
 	CATEGORY="pkey" run_test ./protection_keys_64
 fi
-echo "$nr_hugepgs" > /proc/sys/vm/nr_hugepages
 
 if [ -x ./soft-dirty ]
 then
@@ -539,10 +432,6 @@ if [ -n "${LOADED_MOD}" ]; then
 	modprobe -r hwpoison_inject > /dev/null 2>&1
 fi
 
-if [ "${HAVE_HUGEPAGES}" = 1 ]; then
-	echo "$orig_nr_hugepgs" > /proc/sys/vm/nr_hugepages
-fi
-
 echo "SUMMARY: PASS=${count_pass} SKIP=${count_skip} FAIL=${count_fail}" | tap_prefix
 echo "1..${count_total}" | tap_output
 
-- 
2.53.0


  parent reply	other threads:[~2026-05-11 16:34 UTC|newest]

Thread overview: 61+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-05-11 16:27 [PATCH v4 00/55] make MM selftests more CI friendly Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 01/55] selftests/mm: hugetlb-read-hwpoison: add SIGBUS handler Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 02/55] selftests/mm: migration: don't assume huge page is TWOMEG Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 03/55] selftests/mm: migration: make nthreads represent number of working threads Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 04/55] selftests/mm: migration: properly cleanup fork()ed processes Mike Rapoport
2026-05-13 14:18   ` Luiz Capitulino
2026-05-11 16:27 ` [PATCH v4 05/55] selftests/mm: run_vmtests.sh: don't gate THP and KSM tests on HAVE_HUGEPAGES Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 06/55] selftests/mm: merge map_hugetlb into hugepage-mmap Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 07/55] selftests/mm: rename hugepage-* tests to hugetlb-* Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 08/55] selftests/mm: hugetlb-shm: use kselftest framework Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 09/55] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 10/55] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 11/55] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 12/55] selftests/mm: hugetlb-read-hwpoison: " Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 13/55] selftests/mm: khugepaged: group tests in an array Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 14/55] selftests/mm: khugepaged: use ksefltest framework Mike Rapoport
2026-05-11 16:27 ` [PATCH v4 15/55] selftests/mm: ksm_tests: use kselftest framework Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 16/55] selftests/mm: protection_keys: use descriptive test names in the output Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 17/55] selftests/mm: protection_keys: use kselftest framework Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 18/55] selftests/mm: uffd-common: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 19/55] selftests/mm: uffd-stress: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 20/55] selftests/mm: uffd-unit-tests: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 21/55] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 22/55] selftests/mm: add atexit() and signal handlers to thp_settings Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 23/55] selftests/mm: rename thp_settings.[ch] to hugepage_settings.[ch] Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 24/55] selftests/mm: move HugeTLB helpers to hugepage_settings Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 25/55] selftests/mm: hugepage_settings: use unsigned long in detect_hugetlb_page_size Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 26/55] selftests/mm: hugepage_settings: add APIs to get and set nr_hugepages Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 27/55] selftests/mm: hugepage_settings: rename and rework get_free_hugepages() Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 28/55] selftests/mm: hugepage_settings: add APIs for HugeTLB setup and teardown Mike Rapoport
2026-05-13 19:50   ` Luiz Capitulino
2026-05-14 10:26     ` Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 29/55] selftests/mm: move read_file(), read_num() and write_num() to vm_util Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 30/55] selftests/mm: vm_util: add helpers to set and restore shm limits Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 31/55] selftests/mm: compaction_test: use HugeTLB helpers Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 32/55] selftests/mm: cow: add setup of HugeTLB pages Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 33/55] selftests/mm: gup_longterm: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 34/55] selftests/mm: gup_test: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 35/55] selftests/mm: hmm-tests: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 36/55] selftests/mm: hugepage_dio: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 37/55] selftests/mm: hugetlb_fault_after_madv: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 38/55] selftests/mm: hugetlb-madvise: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 39/55] selftests/mm: hugetlb_madv_vs_map: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 40/55] selftests/mm: hugetlb-mmap: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 41/55] selftests/mm: hugetlb-mremap: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 42/55] selftests/mm: hugetlb-shm: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 43/55] selftests/mm: hugetlb-soft-offline: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 44/55] selftests/mm: hugetlb-vmemmap: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 45/55] selftests/mm: migration: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 46/55] selftests/mm: pagemap_ioctl: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 47/55] selftests/mm: protection_keys: use library code for HugeTLB setup Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 48/55] selftests/mm: thuge-gen: add setup of HugeTLB pages Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 49/55] selftests/mm: uffd-stress: use hugetlb_save and alloc huge pages Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 50/55] selftests/mm: uffd-unit-tests: add setup of HugeTLB pages Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 51/55] selftests/mm: uffd-wp-mremap: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 52/55] selftests/mm: va_high_addr_switch: " Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 53/55] selftests/mm: va_high_addr_switch.sh: drop huge pages setup Mike Rapoport
2026-05-11 16:28 ` [PATCH v4 54/55] selftests/mm: run_vmtests.sh: free memory if available memory is low Mike Rapoport
2026-05-11 16:28 ` Mike Rapoport [this message]
2026-05-11 21:34 ` [PATCH v4 00/55] make MM selftests more CI friendly Andrew Morton
2026-05-13 19:53 ` Luiz Capitulino

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260511162840.375890-56-rppt@kernel.org \
    --to=rppt@kernel.org \
    --cc=Liam.Howlett@oracle.com \
    --cc=akpm@linux-foundation.org \
    --cc=baohua@kernel.org \
    --cc=baolin.wang@linux.alibaba.com \
    --cc=broonie@kernel.org \
    --cc=david@kernel.org \
    --cc=dev.jain@arm.com \
    --cc=donettom@linux.ibm.com \
    --cc=jgg@ziepe.ca \
    --cc=jhubbard@nvidia.com \
    --cc=lance.yang@linux.dev \
    --cc=leon@kernel.org \
    --cc=li.wang@linux.dev \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-kselftest@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=ljs@kernel.org \
    --cc=luizcap@redhat.com \
    --cc=mhocko@suse.com \
    --cc=npache@redhat.com \
    --cc=peterx@redhat.com \
    --cc=ryan.roberts@arm.com \
    --cc=sarthak.sharma@arm.com \
    --cc=shuah@kernel.org \
    --cc=surenb@google.com \
    --cc=vbabka@kernel.org \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.