From: Baolin Wang <baolin.wang@linux.alibaba.com>
To: akpm@linux-foundation.org, david@kernel.org,
catalin.marinas@arm.com, will@kernel.org
Cc: lorenzo.stoakes@oracle.com, ryan.roberts@arm.com,
Liam.Howlett@oracle.com, vbabka@suse.cz, rppt@kernel.org,
surenb@google.com, mhocko@suse.com, riel@surriel.com,
harry.yoo@oracle.com, jannh@google.com, willy@infradead.org,
baohua@kernel.org, baolin.wang@linux.alibaba.com,
linux-mm@kvack.org, linux-arm-kernel@lists.infradead.org,
linux-kernel@vger.kernel.org
Subject: [PATCH v2 0/3] support batch checking of references and unmapping for large folios
Date: Thu, 11 Dec 2025 16:16:53 +0800 [thread overview]
Message-ID: <cover.1765439380.git.baolin.wang@linux.alibaba.com> (raw)
Currently, folio_referenced_one() always checks the young flag for each PTE
sequentially, which is inefficient for large folios. This inefficiency is
especially noticeable when reclaiming clean file-backed large folios, where
folio_referenced() is observed as a significant performance hotspot.
Moreover, on Arm architecture, which supports contiguous PTEs, there is already
an optimization to clear the young flags for PTEs within a contiguous range.
However, this is not sufficient. We can extend this to perform batched operations
for the entire large folio (which might exceed the contiguous range: CONT_PTE_SIZE).
Similar to folio_referenced_one(), we can also apply batched unmapping for large
file folios to optimize the performance of file folio reclamation. By supporting
batched checking of the young flags, flushing TLB entries, and unmapping, I can
observed a significant performance improvements in my performance tests for file
folios reclamation. Please check the performance data in the commit message of
each patch.
Run stress-ng and mm selftests, no issues were found.
Changes from v1:
- Add a new patch to support batched unmapping for file large folios.
- Update the cover letter.
Baolin Wang (3):
arm64: mm: support batch clearing of the young flag for large folios
mm: rmap: support batched checks of the references for large folios
mm: rmap: support batched unmapping for file large folios
arch/arm64/include/asm/pgtable.h | 23 ++++++++++++-----
arch/arm64/mm/contpte.c | 44 ++++++++++++++++++++++----------
include/linux/mmu_notifier.h | 9 ++++---
include/linux/pgtable.h | 19 ++++++++++++++
mm/rmap.c | 29 +++++++++++++++++----
5 files changed, 96 insertions(+), 28 deletions(-)
--
2.47.3
next reply other threads:[~2025-12-11 8:17 UTC|newest]
Thread overview: 35+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-12-11 8:16 Baolin Wang [this message]
2025-12-11 8:16 ` [PATCH v2 1/3] arm64: mm: support batch clearing of the young flag for large folios Baolin Wang
2025-12-15 11:36 ` Lorenzo Stoakes
2025-12-16 3:32 ` Baolin Wang
2025-12-16 11:11 ` Lorenzo Stoakes
2025-12-17 3:53 ` Baolin Wang
2025-12-17 14:50 ` Lorenzo Stoakes
2025-12-17 16:06 ` Ryan Roberts
2025-12-18 7:56 ` Baolin Wang
2025-12-17 15:43 ` Ryan Roberts
2025-12-18 7:15 ` Baolin Wang
2025-12-18 12:20 ` Ryan Roberts
2025-12-19 1:00 ` Baolin Wang
2025-12-11 8:16 ` [PATCH v2 2/3] mm: rmap: support batched checks of the references " Baolin Wang
2025-12-15 12:22 ` Lorenzo Stoakes
2025-12-16 3:47 ` Baolin Wang
2025-12-17 6:23 ` Dev Jain
2025-12-17 6:44 ` Baolin Wang
2025-12-17 6:49 ` Dev Jain
2025-12-17 7:09 ` Baolin Wang
2025-12-17 7:23 ` Dev Jain
2025-12-17 16:39 ` Ryan Roberts
2025-12-18 7:47 ` Baolin Wang
2025-12-18 12:08 ` Ryan Roberts
2025-12-19 0:56 ` Baolin Wang
2025-12-11 8:16 ` [PATCH v2 3/3] mm: rmap: support batched unmapping for file " Baolin Wang
2025-12-11 12:36 ` Barry Song
2025-12-15 12:38 ` Lorenzo Stoakes
2025-12-16 5:48 ` Baolin Wang
2025-12-16 6:13 ` Barry Song
2025-12-16 6:22 ` Baolin Wang
2025-12-16 10:54 ` Lorenzo Stoakes
2025-12-17 3:11 ` Baolin Wang
2025-12-17 14:28 ` Lorenzo Stoakes
2025-12-16 10:53 ` Lorenzo Stoakes
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1765439380.git.baolin.wang@linux.alibaba.com \
--to=baolin.wang@linux.alibaba.com \
--cc=Liam.Howlett@oracle.com \
--cc=akpm@linux-foundation.org \
--cc=baohua@kernel.org \
--cc=catalin.marinas@arm.com \
--cc=david@kernel.org \
--cc=harry.yoo@oracle.com \
--cc=jannh@google.com \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=lorenzo.stoakes@oracle.com \
--cc=mhocko@suse.com \
--cc=riel@surriel.com \
--cc=rppt@kernel.org \
--cc=ryan.roberts@arm.com \
--cc=surenb@google.com \
--cc=vbabka@suse.cz \
--cc=will@kernel.org \
--cc=willy@infradead.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.