All of lore.kernel.org
 help / color / mirror / Atom feed
From: SJ Park <sj@kernel.org>
To: David Rientjes <rientjes@google.com>
Cc: SJ Park <sj@kernel.org>, Davidlohr Bueso <dave@stgolabs.net>,
	Fan Ni <nifan.cxl@gmail.com>,
	Frank van der Linden <fvdl@google.com>,
	Gregory Price <gourry@gourry.net>,
	Jonathan Cameron <jic23@kernel.org>,
	Joshua Hahn <joshua.hahnjy@gmail.com>,
	Raghavendra K T <rkodsara@amd.com>,
	"Rao, Bharata Bhasker" <bharata@amd.com>,
	Wei Xu <weixugc@google.com>,
	Xuezheng Chu <xuezhengchu@huawei.com>,
	Yiannis Nikolakopoulos <yiannis@zptcorp.com>,
	Zi Yan <ziy@nvidia.com>,
	linux-mm@kvack.org
Subject: Re: [Linux Memory Hotness and Promotion] Notes from October 22, 2026
Date: Sat, 24 Oct 2026 10:58:54 -0700	[thread overview]
Message-ID: <20261024175855.81607-1-sj@kernel.org> (raw)
In-Reply-To: <a4676b13-ffca-636f-4590-640a1adbe422@google.com>

Hi David,


Thank you for sharing these nice notes!  I unforunately keep being unable to
join the meeting, so these notes are very helpful.

On Fri, 23 Oct 2026 20:14:53 -0700 (PDT) David Rientjes <rientjes@google.com> wrote:

> Hi everybody,
> 
> Here are the notes from the last Linux Memory Hotness and Promotion call
> that happened on Thursday, October 22.  Thanks to everybody who was 
> involved!
> 
> These notes are intended to bring people up to speed who could not attend 
> the call as well as keep the conversation going in between meetings.
[...]
> Davidlohr noted that this matched his expectation and that he is working 
> on upstreaming the CHMU support as a CXL driver, currently using DAMON as 
> its backend.  He'll then wait to see the outcome of the other patch series 
> in parallel.  Jonathan questioned how integration with DAMON would be done 
> to eventually support the asynchronous promotion stuff.  Davidlohr said 
> this would be done in the most generic way as possible.  CHMU has a 
> natural interface with ranges and large continguous chunks of memory that 
> can be passed to any interface.  If pghot is confined to the NUMA 
> Balancing aspects, then CHMU wouldn't be integrated with it.  Jonathan 
> asked if we're really getting large contiguous chunks of memory from the 
> CHMU and Davidlohr said this is what he is seeing in his evaluation.

Makes sense to me.  If CHMU can find address ranges of hot memory, it could
directly ask DAMOS to migrate those to a specific node.  DAMOS does not provide
such interface for now.  We could implement new API like damos_add_folios(),
which I proposed at LSFMMBPF'25.  For CHMU, I think it could be easier if the
API receives address ranges instead of folios.

Yet another idea is let users ask DAMON to do everything.  That is, DAMON will
turn on CHMU, get the hot memory information from it, and do the migration all
by itself.  DAMON sysfs ABI would need to be extended for CHMU configuration.

Both look doable to me.  Davidlohr may have a much better idea.  In any case, I
will be happy to help as always.  Please don't hesitate to reach out even if it
is only for internal prototyping that doesn't pursue upstreaming.

> 
> Bharata suggested it may be difficult to get the configuration of DAMON 
> correct, this is a complex undertaking.  If the only way to use CHMU is 
> through DAMON, this may be challenging.  Davidlohr agreed the 
> configuration was more complex but if you're going to go out and buy a 
> CHMU supported device then you can likely configure this correctly.

We (DAMON community) provide and support a auto-tuning based DAMON
configuration for general memory tiering on 2 nodes setup [1].  The support
means that if a user tried it and find it doesn't work as expected, they can
reach out to DAMON community for help.  In the case, we will help investigating
the issue and provide solutions.  We also merge back the solution to the
configuration and DAMON itself.

Of course our support is not constrained to only the auto-tuning based
configuration.  We samely help for any custom configuration usages.

Some people indeed trying the auto-tuning based config and reaching out to us
in the way.  We are helping them and improve DAMON.  I believe it will be
similar for CHMU case.

DAMON is an open source project that is actively maintained, supported and open
to changes.  Please feel free to ask questions and changes.

[1] https://github.com/damonitor/damo/blob/next/scripts/mem_tier.sh


Thanks,
SJ

[...]


      reply	other threads:[~2026-10-24 17:59 UTC|newest]

Thread overview: 2+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-10-24  3:14 [Linux Memory Hotness and Promotion] Notes from October 22, 2026 David Rientjes
2026-10-24 17:58 ` SJ Park [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20261024175855.81607-1-sj@kernel.org \
    --to=sj@kernel.org \
    --cc=bharata@amd.com \
    --cc=dave@stgolabs.net \
    --cc=fvdl@google.com \
    --cc=gourry@gourry.net \
    --cc=jic23@kernel.org \
    --cc=joshua.hahnjy@gmail.com \
    --cc=linux-mm@kvack.org \
    --cc=nifan.cxl@gmail.com \
    --cc=rientjes@google.com \
    --cc=rkodsara@amd.com \
    --cc=weixugc@google.com \
    --cc=xuezhengchu@huawei.com \
    --cc=yiannis@zptcorp.com \
    --cc=ziy@nvidia.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.