* [PATCH] mm/ksm: do not inherit ksm_zero_pages counter or PTE markers on fork
@ 2026-11-17 8:18 xu.xin
2026-11-17 9:51 ` David Hildenbrand (Arm)
0 siblings, 1 reply; 2+ messages in thread
From: xu.xin @ 2026-11-17 8:18 UTC (permalink / raw)
To: David Hildenbrand
Cc: Donet Tom, Chengming Zhou, Andrew Morton, linux-mm, linux-kernel,
Xu Xin, stable
From: "Xu Xin (vivo)" <xu.xin@linux.dev>
As documented in Documentation/admin-guide/mm/ksm.rst, ksm_zero_pages
accounts only for zero pages actually placed by KSM. However, the
current implementation wrongly accounts for forked zero-page PTEs as
KSM's contribution, inflating both the child's per-mm counter and the
global ksm_zero_pages counter.
Originally, commit e2942062e01d ("ksm: count all zero pages placed by
KSM") marked KSM-placed zero-page PTEs with the dirty bit for unmap
accounting, but forgot to clear this marker during fork(). Later, to
prevent ksm_might_unmap_zero_page() from underflowing the counters on
child exit[1], commit 4d6fc29f3634 ("mm/ksm: fix incorrect KSM counter
handling in mm_struct during fork") kept the child's inherited per-mm
counter and added it to the global counter.
Instead of inflating the counters, fix the root cause by resetting the
child's mm->ksm_zero_pages to 0 in ksm_fork() and clearing the dirty
bit marker via pte_mkclean() when copying a KSM zero PTE in
__copy_present_ptes(). With the marker cleared,
ksm_might_unmap_zero_page() will not decrement the counters on child
exit, MADV_UNMERGEABLE in the child will not unnecessarily unshare
inherited zero pages, and the global counter remains untouched.
[1] https://lore.kernel.org/all/53a7bf3d-843d-4e19-b0a3-cc6852fe72c1@redhat.com/
Fixes: 4d6fc29f3634 ("mm/ksm: fix incorrect KSM counter handling in mm_struct during fork")
Cc: stable@vger.kernel.org
Signed-off-by: Xu Xin (vivo) <xu.xin@linux.dev>
---
include/linux/ksm.h | 8 +++++---
mm/memory.c | 8 ++++++++
2 files changed, 13 insertions(+), 3 deletions(-)
diff --git a/include/linux/ksm.h b/include/linux/ksm.h
index 93793ca6bcc4..3c6db19d825e 100644
--- a/include/linux/ksm.h
+++ b/include/linux/ksm.h
@@ -56,11 +56,13 @@ static inline void ksm_fork(struct mm_struct *mm, struct mm_struct *oldmm)
{
/* Adding mm to ksm is best effort on fork. */
if (mm_flags_test(MMF_VM_MERGEABLE, oldmm)) {
- long nr_ksm_zero_pages = atomic_long_read(&mm->ksm_zero_pages);
-
+ /*
+ * Child's inherited zero-page PTEs are unmarked on copy and
+ * were not placed by KSM in the child, so reset its counter.
+ */
mm->ksm_merging_pages = 0;
mm->ksm_rmap_items = 0;
- atomic_long_add(nr_ksm_zero_pages, &ksm_zero_pages);
+ atomic_long_set(&mm->ksm_zero_pages, 0);
__ksm_enter(mm);
}
}
diff --git a/mm/memory.c b/mm/memory.c
index cf075fcec3c5..7dce96af2a51 100644
--- a/mm/memory.c
+++ b/mm/memory.c
@@ -1160,6 +1160,14 @@ static __always_inline void __copy_present_ptes(struct vm_area_struct *dst_vma,
pte = pte_mkclean(pte);
pte = pte_mkold(pte);
+ /*
+ * Clear the dirty-bit marker on KSM-placed zero-page PTEs in the
+ * child so inherited mappings are not accounted against the child or
+ * unshared by MADV_UNMERGEABLE. Special PTEs always have nr == 1.
+ */
+ if (is_ksm_zero_pte(pte))
+ pte = pte_mkclean(pte);
+
set_ptes(dst_vma->vm_mm, addr, dst_pte, pte, nr);
}
--
2.34.1
^ permalink raw reply related [flat|nested] 2+ messages in thread* Re: [PATCH] mm/ksm: do not inherit ksm_zero_pages counter or PTE markers on fork
2026-11-17 8:18 [PATCH] mm/ksm: do not inherit ksm_zero_pages counter or PTE markers on fork xu.xin
@ 2026-11-17 9:51 ` David Hildenbrand (Arm)
0 siblings, 0 replies; 2+ messages in thread
From: David Hildenbrand (Arm) @ 2026-11-17 9:51 UTC (permalink / raw)
To: xu.xin
Cc: Donet Tom, Chengming Zhou, Andrew Morton, linux-mm, linux-kernel,
stable
On 11/17/26 09:18, xu.xin@linux.dev wrote:
> From: "Xu Xin (vivo)" <xu.xin@linux.dev>
Hi,
thanks for the report.
>
> As documented in Documentation/admin-guide/mm/ksm.rst, ksm_zero_pages
> accounts only for zero pages actually placed by KSM. However, the
> current implementation wrongly accounts for forked zero-page PTEs as
> KSM's contribution, inflating both the child's per-mm counter and the
> global ksm_zero_pages counter.
But ... they were placed by KSM?
Just like any other KSM folios deduplicated before fork and then shared with the
child?
So won't there be an inconsistency when MADV_UNMERGEABLE?
>
> Originally, commit e2942062e01d ("ksm: count all zero pages placed by
> KSM") marked KSM-placed zero-page PTEs with the dirty bit for unmap
> accounting, but forgot to clear this marker during fork(). Later, to
> prevent ksm_might_unmap_zero_page() from underflowing the counters on
> child exit[1], commit 4d6fc29f3634 ("mm/ksm: fix incorrect KSM counter
> handling in mm_struct during fork") kept the child's inherited per-mm
> counter and added it to the global counter.
>
> Instead of inflating the counters, fix the root cause by resetting the
> child's mm->ksm_zero_pages to 0 in ksm_fork() and clearing the dirty
> bit marker via pte_mkclean() when copying a KSM zero PTE in
> __copy_present_ptes(). With the marker cleared,
> ksm_might_unmap_zero_page() will not decrement the counters on child
> exit, MADV_UNMERGEABLE in the child will not unnecessarily unshare
> inherited zero pages, and the global counter remains untouched.
>
> [1] https://lore.kernel.org/all/53a7bf3d-843d-4e19-b0a3-cc6852fe72c1@redhat.com/
>
> Fixes: 4d6fc29f3634 ("mm/ksm: fix incorrect KSM counter handling in mm_struct during fork")
> Cc: stable@vger.kernel.org
> Signed-off-by: Xu Xin (vivo) <xu.xin@linux.dev>
> ---
> include/linux/ksm.h | 8 +++++---
> mm/memory.c | 8 ++++++++
> 2 files changed, 13 insertions(+), 3 deletions(-)
>
> diff --git a/include/linux/ksm.h b/include/linux/ksm.h
> index 93793ca6bcc4..3c6db19d825e 100644
> --- a/include/linux/ksm.h
> +++ b/include/linux/ksm.h
> @@ -56,11 +56,13 @@ static inline void ksm_fork(struct mm_struct *mm, struct mm_struct *oldmm)
> {
> /* Adding mm to ksm is best effort on fork. */
> if (mm_flags_test(MMF_VM_MERGEABLE, oldmm)) {
> - long nr_ksm_zero_pages = atomic_long_read(&mm->ksm_zero_pages);
> -
> + /*
> + * Child's inherited zero-page PTEs are unmarked on copy and
> + * were not placed by KSM in the child, so reset its counter.
> + */
> mm->ksm_merging_pages = 0;
> mm->ksm_rmap_items = 0;
> - atomic_long_add(nr_ksm_zero_pages, &ksm_zero_pages);
So I think there is definitely a BUG int he existing code when we skip copying
some VMAs during fork. We should have instead adjusted the counter as we
duplicate them into the child process.
> + atomic_long_set(&mm->ksm_zero_pages, 0);
> __ksm_enter(mm);
> }
> }
> diff --git a/mm/memory.c b/mm/memory.c
> index cf075fcec3c5..7dce96af2a51 100644
> --- a/mm/memory.c
> +++ b/mm/memory.c
> @@ -1160,6 +1160,14 @@ static __always_inline void __copy_present_ptes(struct vm_area_struct *dst_vma,
> pte = pte_mkclean(pte);
> pte = pte_mkold(pte);
>
> + /*
> + * Clear the dirty-bit marker on KSM-placed zero-page PTEs in the
> + * child so inherited mappings are not accounted against the child or
> + * unshared by MADV_UNMERGEABLE. Special PTEs always have nr == 1.
> + */
> + if (is_ksm_zero_pte(pte))
> + pte = pte_mkclean(pte);
> +
> set_ptes(dst_vma->vm_mm, addr, dst_pte, pte, nr);
> }
>
--
Cheers,
David
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2026-11-17 9:51 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2026-11-17 8:18 [PATCH] mm/ksm: do not inherit ksm_zero_pages counter or PTE markers on fork xu.xin
2026-11-17 9:51 ` David Hildenbrand (Arm)
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox