From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id F15E1C3ABD8 for ; Thu, 15 May 2025 03:07:00 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id C808D6B00D0; Wed, 14 May 2025 23:06:59 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id C30FD6B00F6; Wed, 14 May 2025 23:06:59 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id AAAB46B00F5; Wed, 14 May 2025 23:06:59 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0012.hostedemail.com [216.40.44.12]) by kanga.kvack.org (Postfix) with ESMTP id 8A9336B00A8 for ; Wed, 14 May 2025 23:06:59 -0400 (EDT) Received: from smtpin19.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay04.hostedemail.com (Postfix) with ESMTP id 009511A146D for ; Thu, 15 May 2025 03:06:59 +0000 (UTC) X-FDA: 83443655358.19.55C7943 Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by imf19.hostedemail.com (Postfix) with ESMTP id 015E31A0008 for ; Thu, 15 May 2025 03:06:57 +0000 (UTC) Authentication-Results: imf19.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=IVEKqQpR; dmarc=pass (policy=quarantine) header.from=redhat.com; spf=pass (imf19.hostedemail.com: domain of npache@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=npache@redhat.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1747278418; a=rsa-sha256; cv=none; b=ys02+aE1GAoVFthRWRipN68WMBVbuuVS6ErNnhNA2lVY8mw2IUM4JGJJQEjLT4f+yvEEEV fRRKh6Nos4k4DqC+AN9G/2sMtU0/abWhO5gDKDbt8L7oTcWGndWW5+2Q4Ow0zg0YLR7LD3 XuN88A0SrppocaQJ4l7JjyPzQoCvb1U= ARC-Authentication-Results: i=1; imf19.hostedemail.com; dkim=pass header.d=redhat.com header.s=mimecast20190719 header.b=IVEKqQpR; dmarc=pass (policy=quarantine) header.from=redhat.com; spf=pass (imf19.hostedemail.com: domain of npache@redhat.com designates 170.10.129.124 as permitted sender) smtp.mailfrom=npache@redhat.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1747278418; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=ahT4btz576S69wvUnfwsCRHjbpr8W2QT0Gxup0BuO2U=; b=TBU6Vp4RyL+fnIyq7OQHE2QRHAEirn4qxrzhS4vxq3ElsCPAb8VoA/CZ+o812+bqNBSElS C8135taZl7RsfaK7l3U4tr6yi2lut/eEfOOsHexZfbrZc7tciAhRxEtie6QpWmUYrblG4U nkWp91/weOgapp1DZlS/f7Mw+k0ts40= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1747278417; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ahT4btz576S69wvUnfwsCRHjbpr8W2QT0Gxup0BuO2U=; b=IVEKqQpRV0YycZj1ZKV4Y3QEGkdGmsUno5aUHm1AGVBHZujtZAIuqT+6a3i4I8Mnv+Swgw 45eTJBwbXiy1IcQUlvTG6smxs9QaE1SD+UD9nK91WNS9Nn/V7hBGBXzwqBVfGGQ6ocjLgC MaUKFMfE/48RbFzVt6VO4r/VAI9fo+o= Received: from mx-prod-mc-05.mail-002.prod.us-west-2.aws.redhat.com (ec2-54-186-198-63.us-west-2.compute.amazonaws.com [54.186.198.63]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-679-bX-FPPx_ONuDI6-6gD90Tw-1; Wed, 14 May 2025 23:06:52 -0400 X-MC-Unique: bX-FPPx_ONuDI6-6gD90Tw-1 X-Mimecast-MFC-AGG-ID: bX-FPPx_ONuDI6-6gD90Tw_1747278408 Received: from mx-prod-int-06.mail-002.prod.us-west-2.aws.redhat.com (mx-prod-int-06.mail-002.prod.us-west-2.aws.redhat.com [10.30.177.93]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx-prod-mc-05.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id 395281956080; Thu, 15 May 2025 03:06:48 +0000 (UTC) Received: from h1.redhat.com (unknown [10.22.88.116]) by mx-prod-int-06.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id 859631800359; Thu, 15 May 2025 03:06:31 +0000 (UTC) From: Nico Pache To: linux-mm@kvack.org, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org Cc: david@redhat.com, ziy@nvidia.com, baolin.wang@linux.alibaba.com, lorenzo.stoakes@oracle.com, Liam.Howlett@oracle.com, ryan.roberts@arm.com, dev.jain@arm.com, corbet@lwn.net, rostedt@goodmis.org, mhiramat@kernel.org, mathieu.desnoyers@efficios.com, akpm@linux-foundation.org, baohua@kernel.org, willy@infradead.org, peterx@redhat.com, wangkefeng.wang@huawei.com, usamaarif642@gmail.com, sunnanyong@huawei.com, vishal.moola@gmail.com, thomas.hellstrom@linux.intel.com, yang@os.amperecomputing.com, kirill.shutemov@linux.intel.com, aarcange@redhat.com, raquini@redhat.com, anshuman.khandual@arm.com, catalin.marinas@arm.com, tiwai@suse.de, will@kernel.org, dave.hansen@linux.intel.com, jack@suse.cz, cl@gentwo.org, jglisse@google.com, surenb@google.com, zokeefe@google.com, hannes@cmpxchg.org, rientjes@google.com, mhocko@suse.com, rdunlap@infradead.org, Bagas Sanjaya Subject: [PATCH v6 12/12] Documentation: mm: update the admin guide for mTHP collapse Date: Wed, 14 May 2025 21:03:12 -0600 Message-ID: <20250515030312.125567-13-npache@redhat.com> In-Reply-To: <20250515030312.125567-12-npache@redhat.com> References: <20250515030312.125567-1-npache@redhat.com> <20250515030312.125567-2-npache@redhat.com> <20250515030312.125567-3-npache@redhat.com> <20250515030312.125567-4-npache@redhat.com> <20250515030312.125567-5-npache@redhat.com> <20250515030312.125567-6-npache@redhat.com> <20250515030312.125567-7-npache@redhat.com> <20250515030312.125567-8-npache@redhat.com> <20250515030312.125567-9-npache@redhat.com> <20250515030312.125567-10-npache@redhat.com> <20250515030312.125567-11-npache@redhat.com> <20250515030312.125567-12-npache@redhat.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 3.4.1 on 10.30.177.93 X-Rspamd-Server: rspam12 X-Rspamd-Queue-Id: 015E31A0008 X-Rspam-User: X-Stat-Signature: 5fyom1pkwwotjbbw3ipgnz8t3jboiau4 X-HE-Tag: 1747278417-879521 X-HE-Meta: U2FsdGVkX1/cyfxQA8ThNqDuU1YZVkp2tHe+GOmTsV6ZJjmQhfpmTwaRiy8BsAfQE6OB4dCFN9Ncebdx0BpFF7dle1CymvNZUKWCqsH5s0l39/HBj0jz5aP+BTgapj+zP4BVt7H9Pbqf24hJz/7oeEEn0bxI9a5L0LfwbPcR07LVAeAFumOpaHXq9DE5TzJWqe1wWJlpG5SVBLP6jJtX6/AZGyzHmvPPV8AomWqmEBTo53rg9J2eMoNyzmHH/JiXWbamxWlD+S2BzdwEYPUBzpU+MuLMwNA6zxliID6Ymauia+dAWsMbTUVsCKkwYb3mL4boclD/elJ7vxrVUFglqooenzZYrsOVHMPGZYKPQjELCdFoeDn3ZWJlh/9IKNW/qPOyiKfqCljoGiR2KsEhj/w1gFFNB0vU2+/76pr5rkf02TcH8tdgKIR7WKROVcpV+fymzOE5BlGlxCdTFI94+mBKzRkRdBBRziDE3ykdUPlXKKDkUws8bMo43NL6K1ujS2MkCntCUFuJcJX8XczZg975umXD+2XyOgpAKmckiCJjWAASDmJY/qwKCpxxaParPCxFj+lfqdT/cm43QcWu2FL7FpdHXLdZZ/pQEY0WD81skcXmsjLpCxsPF7SeFz1AEAyKeUCYP+IS30uh6UzTAxJzar1DWW/9IseKd5bKurXllmZQZfTKuEWN2NVNtNfHzaQ3pKt0CfZNXHtglTzwwLUz9Z3cCZKgPX1Kg/Qymfn8TOBFvs423PFDMzZFYOEwQl4I4xTHpMN792eLFs6HvkqiR02gz/J9lkf43fKs7w8/12VJU0TXqzymTMDX+8d+eAszXvj/Xayo4DwzrtGMNeZFgulxJDJM5it0HlLe2fHxrKJE9nbmrR/iNETtFvOtzBkZGIAY7uxXRBw/n/Z7JmnuON9kx5j0iRLZZYXKJudFVi+/cvkM9hglNsKIv3ElY812IQj4NM0XXvtJ6sQ L0ZkrQQz T3WgAPx9UiJMdXdjKzwTB1VK1VQJwfWfcI3Px8Zc202mkbbHoiPn6jOsIQPG2y38AmWZ+e3Q4OS7//iT1UAuDH3wdqKTzsJcU7Ph2x9VFBxuDZh8wutn0p5ic1+bfUgPAcXtTx9q8l1tcsvyoRehHeCn3UmIPs+v18j1DGWZ5FV1M18unhmtAuwwgHTYNWYrq12uQ8dV1BrDOElpdb8dI56XmRczrzlIJ9/DDedp4fmdkiK9FZFwJOUenC4wCJW16g58TiSIQ0d1CJZLzJP01DYetjtKsR7LJebHjyRB+Xt0lOYPSKfJ3DkWKhgJ9wFmhOookwqNOX5WW0z1RBs7CT2dqvqIQ6U1HXNGdNR3vBMc2pd9PqJWUh6F4exacylG5z4zihd8+tCKOAAO9qACsy4bQCa91NLDp1l1sHSe2ukWLQDo= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Now that we can collapse to mTHPs lets update the admin guide to reflect these changes and provide proper guidence on how to utilize it. Reviewed-by: Bagas Sanjaya Signed-off-by: Nico Pache --- Documentation/admin-guide/mm/transhuge.rst | 14 +++++++++++++- 1 file changed, 13 insertions(+), 1 deletion(-) diff --git a/Documentation/admin-guide/mm/transhuge.rst b/Documentation/admin-guide/mm/transhuge.rst index dff8d5985f0f..5c63fe51b3ad 100644 --- a/Documentation/admin-guide/mm/transhuge.rst +++ b/Documentation/admin-guide/mm/transhuge.rst @@ -63,7 +63,7 @@ often. THP can be enabled system wide or restricted to certain tasks or even memory ranges inside task's address space. Unless THP is completely disabled, there is ``khugepaged`` daemon that scans memory and -collapses sequences of basic pages into PMD-sized huge pages. +collapses sequences of basic pages into huge pages. The THP behaviour is controlled via :ref:`sysfs ` interface and using madvise(2) and prctl(2) system calls. @@ -144,6 +144,18 @@ hugepage sizes have enabled="never". If enabling multiple hugepage sizes, the kernel will select the most appropriate enabled size for a given allocation. +khugepaged uses max_ptes_none scaled to the order of the enabled mTHP size +to determine collapses. When using mTHPs it's recommended to set +max_ptes_none low-- ideally less than HPAGE_PMD_NR / 2 (255 on 4k page +size). This will prevent undesired "creep" behavior that leads to +continuously collapsing to a larger mTHP size; When we collapse, we are +bringing in new non-zero pages that will, on a subsequent scan, cause the +max_ptes_none check of the +1 order to always be satisfied. By limiting +this to less than half the current order, we make sure we don't cause this +feedback loop. max_ptes_shared and max_ptes_swap have no effect when +collapsing to a mTHP, and mTHP collapse will fail on shared or swapped out +pages. + It's also possible to limit defrag efforts in the VM to generate anonymous hugepages in case they're not immediately free to madvise regions or to never try to defrag memory and simply fallback to regular -- 2.49.0