public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Michal Hocko <mhocko@suse.com>
To: Minchan Kim <minchan@kernel.org>
Cc: Suren Baghdasaryan <surenb@google.com>,
	"David Hildenbrand (Arm)" <david@kernel.org>,
	akpm@linux-foundation.org, hca@linux.ibm.com,
	linux-s390@vger.kernel.org, brauner@kernel.org,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org,
	timmurray@google.com
Subject: Re: [PATCH v1 2/3] mm: process_mrelease: skip LRU movement for exclusive file folios
Date: Tue, 28 Apr 2026 08:56:36 +0200	[thread overview]
Message-ID: <afBaJLLFigkdszov@tiehlicka> (raw)
In-Reply-To: <ae_roPR64e6sY_fN@google.com>

On Mon 27-04-26 16:05:04, Minchan Kim wrote:
> On Mon, Apr 27, 2026 at 07:15:39PM +0200, Michal Hocko wrote:
> > On Mon 27-04-26 09:48:28, Suren Baghdasaryan wrote:
> > > On Mon, Apr 27, 2026 at 12:16 AM Michal Hocko <mhocko@suse.com> wrote:
> > > >
> > > > On Fri 24-04-26 12:15:18, Minchan Kim wrote:
> > > > > On Fri, Apr 24, 2026 at 09:57:16AM +0200, David Hildenbrand (Arm) wrote:
> > > > > > On 4/24/26 09:51, Michal Hocko wrote:
> > > > > > > On Tue 21-04-26 16:02:38, Minchan Kim wrote:
> > > > > > >> For the process_mrelease reclaim, skip LRU handling for exclusive
> > > > > > >> file-backed folios since they will be freed soon so pointless
> > > > > > >> to move around in the LRU.
> > > > > > >>
> > > > > > >> This avoids costly LRU movement which accounts for a significant portion
> > > > > > >> of the time during unmap_page_range.
> > > > > > >>
> > > > > > >> -   91.31%     0.00%  mmap_exit_test   [kernel.kallsyms]  [.] exit_mm
> > > > > > >>      exit_mm
> > > > > > >>      __mmput
> > > > > > >>      exit_mmap
> > > > > > >>      unmap_vmas
> > > > > > >>    - unmap_page_range
> > > > > > >>       - 55.75% folio_mark_accessed
> > > > > > >>          + 48.79% __folio_batch_add_and_move
> > > > > > >>            4.23% workingset_activation
> > > > > > >>       + 12.94% folio_remove_rmap_ptes
> > > > > > >>       + 9.86% page_table_check_clear
> > > > > > >>       + 3.34% tlb_flush_mmu
> > > > > > >>         1.06% __page_table_check_pte_clear
> > > > > > >>
> > > > > > >> Signed-off-by: Minchan Kim <minchan@kernel.org>
> > > > > > >
> > > > > > > As pointed out in the previous version of the patch. I really dislike
> > > > > > > this to be mrelease or OOM specific. Behavior. You do not explain why
> > > > > > > this needs to be this way, except for the performance reasons. My main
> > > > > > > question is still unanswered (and NAK before this is sorted out). Why
> > > > > > > this cannot be applied in general for _any_ exiting task. As you argue
> > > > > > > the memory will just likely go away so why to bother?
> > > > > >
> > > > > > I think there was a lengthy discussion involving Johannes from a previous series.
> > > > > >
> > > > > > That should be linked here indeed.
> > > > >
> > > > > How about this?
> > > > >
> > > > >     mm: process_mrelease: skip LRU movement for exclusive file folios
> > > > >
> > > > >     During process_mrelease() or OOM reaping, unmapping file-backed folios
> > > > >     spends a significant portion of CPU time in folio_mark_accessed() to
> > > > >     maintain accurate LRU state (~55% of unmap time as shown in the profile
> > > > >     below).
> > > > >
> > > > >     This patch skips LRU handling for exclusive file-backed folios during
> > > > >     such emergency memory reclaim.
> > > > >
> > > > >     One might ask why this optimization shouldn't be applied to any exiting
> > > > >     task in general. The reason is that for a normal, orderly exit or just
> > > > >     pure kill, it is worth paying the CPU cost to preserve the active state
> > > > >     of clean file folios in case they are reused soon. Preserving cache hits
> > > > >     is beneficial for overall system performance.
> > > >
> > > > This is a statement rather than an explanation. Why is it worth paying
> > > > the cost? What is different here?
> > > >
> > > > >     However, process_mrelease() and OOM reaping are emergency operations
> > > > >     triggered under extreme memory pressure. In these scenarios, the highest
> > > > >     priority is to recover memory as quickly as possible to avoid further
> > > > >     kills or system jank. Spending half of the unmap time on LRU maintenance
> > > > >     for pages belonging to a victim process is a bad trade-off. If speeding up
> > > > >     the victim's reclaim by avoiding LRU movement and evicting cache negatively
> > > > >     affects the workflow (due to immediate restart), it implies a sub-optimal
> > > > >     kill target selection by the userspace policy (e.g., LMKD), rather than
> > > > >     a problem in this expedited APIs.
> > > >
> > > > Your change effectively boils down to break aging for exclusively mapped
> > > > file pages when those pages should have been activated. All that because
> > > > the activation has some (batched) overhead. You argue that the overhead
> > > > is not a good trade-off for OOM path because those pages are exclusive
> > > > to the process and therefore they will go away after the task exits.
> > > 
> > > I think Minchan's argument is that mm reaping occurs only in special
> > > conditions (under high memory pressure) and for a very specific reason
> > > (to free up memory and prevent system memory starvation). Therefore
> > > priority in such conditions should shift towards more aggressive
> > > memory reclaim instead of normal aging. I can see both his point and a
> > > counter-argument that this might cause more refaults in some cases.
> > 
> > The way I see this is that the standard memory reclaim under a heavy
> > memory pressure would likely encounter those pages and aged them
> > accordingly already. So this is effectivelly racing with that process
> > and makes a potentially opposite decision.
> > I suspect that a lack of memory reclaim, as implied by the other patch
> > (to deal with clean page cache), is the reason why this one makes a
> > difference in these Android deployments.
> 
> The claim that kswapd would have already aged these pages is just an
> assumption; it is ultimately a matter of timing. We cannot reliably
> predict whether kswapd has processed them, nor can we know the future
> access patterns of a dying process.
> 
> Global system policies are not always optimal for every specific use case.
> That is precisely why we have hinting APIs like madvise and fadvise.
> 
> While hinting APIs can indeed conflict with global policies, a negative
> performance impact would imply that userspace is misusing the API, not
> that the optimization itself shouldn't exist.
> 
> We should view process_mrelease() (and this flag) as a similar hinting
> mechanism where userspace explicitly requests expedited, aggressive reclaim
> for a specific target under memory pressure.

This is you bending definition of what process_mrelease is. And I
disagree. There is nothing about aggressiveness for process_mrelease.
There are no aging assumptions. We do not have an official man page but
this is from the initial comment introducing the syscall
        DESCRIPTION
          The process_mrelease() system call is used to free the memory of
          an exiting process.

          The pidfd selects the process referred to by the PID file
          descriptor.
          (See pidfd_open(2) for further information)

          The flags argument is reserved for future use; currently, this
          argument must be specified as 0.

Userspace oom killers are one obvious users of the interface.

> > Unless I am completely wrong and misreading the whole situation this
> > might be very Android specific change. The question is whether these
> > side effects are generally useful for other worklods. So we really need
> > much more explanation of the actual behavior after this change for wider
> > variety of workloads.
> 
> While the primary motivation comes from Android's LMKD, this optimization
> is not active for normal workloads. It only applies to tasks that are
> already being reaped by the OOM reaper or by process_mrelease() with the
> special flag (via MMF_UNSTABLE).
> 
> Therefore, it is an opt-in or emergency-only behavior that will not hurt
> a wider variety of general workloads unless they explicitly use this
> targeted reclaim API. Any system with a userspace killer needing fast,
> targeted reclaim can benefit from this.

But any user of this interface will see side effects of your
implementation.

Look, you haven't convinced me that you are fully aware of all the
consequences. Your arguments are weak and you seem to be uninterested
about usecases beyond your specific Android LMK implementation.

So I am not in support of this change, same as with the page cache one.
Again, I am NOT NAKing this patch but I do insist a) the patch
description is damn clear about side effects and b) there is a support
from other non-Android people using this syscall.
-- 
Michal Hocko
SUSE Labs

  reply	other threads:[~2026-04-28  6:56 UTC|newest]

Thread overview: 28+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-04-21 23:02 [PATCH v1 0/3] mm: process_mrelease: expedite clean file folio reclaim and add auto-kill Minchan Kim
2026-04-21 23:02 ` [PATCH v1 1/3] mm: process_mrelease: expedite clean file folio reclaim via mmu_gather Minchan Kim
2026-04-24  7:56   ` David Hildenbrand (Arm)
2026-04-24 21:24     ` Minchan Kim
2026-04-27  9:29       ` David Hildenbrand (Arm)
2026-04-27 22:04         ` Minchan Kim
2026-04-24 19:33   ` Matthew Wilcox
2026-04-24 21:56     ` Minchan Kim
2026-04-21 23:02 ` [PATCH v1 2/3] mm: process_mrelease: skip LRU movement for exclusive file folios Minchan Kim
2026-04-22  7:22   ` Baolin Wang
2026-04-23 23:38     ` Minchan Kim
2026-04-24  7:51   ` Michal Hocko
2026-04-24  7:57     ` David Hildenbrand (Arm)
2026-04-24 19:15       ` Minchan Kim
2026-04-27  7:16         ` Michal Hocko
2026-04-27 16:48           ` Suren Baghdasaryan
2026-04-27 17:15             ` Michal Hocko
2026-04-27 23:05               ` Minchan Kim
2026-04-28  6:56                 ` Michal Hocko [this message]
2026-04-24 19:26     ` Minchan Kim
2026-04-21 23:02 ` [PATCH v1 3/3] mm: process_mrelease: introduce PROCESS_MRELEASE_REAP_KILL flag Minchan Kim
2026-04-24  7:57   ` Michal Hocko
2026-04-24 22:49     ` Minchan Kim
2026-04-27  7:02       ` Michal Hocko
2026-04-27 22:03         ` Minchan Kim
2026-04-28  7:01           ` Michal Hocko
2026-04-27 20:34   ` Suren Baghdasaryan
2026-04-27 22:52     ` Minchan Kim

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=afBaJLLFigkdszov@tiehlicka \
    --to=mhocko@suse.com \
    --cc=akpm@linux-foundation.org \
    --cc=brauner@kernel.org \
    --cc=david@kernel.org \
    --cc=hca@linux.ibm.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=linux-s390@vger.kernel.org \
    --cc=minchan@kernel.org \
    --cc=surenb@google.com \
    --cc=timmurray@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox