From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 18723E77188 for ; Thu, 2 Jan 2025 22:23:26 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 77ECB6B009B; Thu, 2 Jan 2025 17:23:26 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id 72DE16B00AE; Thu, 2 Jan 2025 17:23:26 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 61C416B00B2; Thu, 2 Jan 2025 17:23:26 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0010.hostedemail.com [216.40.44.10]) by kanga.kvack.org (Postfix) with ESMTP id 44B256B009B for ; Thu, 2 Jan 2025 17:23:26 -0500 (EST) Received: from smtpin29.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay05.hostedemail.com (Postfix) with ESMTP id EFF474371C for ; Thu, 2 Jan 2025 22:23:25 +0000 (UTC) X-FDA: 82963938708.29.927557D Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by imf29.hostedemail.com (Postfix) with ESMTP id 5F548120011 for ; Thu, 2 Jan 2025 22:22:12 +0000 (UTC) Authentication-Results: imf29.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=rfGnQxA9; spf=pass (imf29.hostedemail.com: domain of sj@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=sj@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1735856569; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:references:dkim-signature; bh=hiCDXJ/09PnCjFcEX2R4EE/qeN6FFIJgyTTmZyqt5cQ=; b=7YJvkvaHlHE5ltxSYjBxOiAecc1BkTQ8TfGPH9MUSGcHpVkcdxvZ/dsgihuzXPkc1srQCR dkWQE3krqdWzU6GURAVkM/XGX2g2Nn8zQjksP3yB0PRiwF80/I8KFkg2pM9lLRcpZMChRU maGz5tuMarGPcbLDntoBE2BWdZjxRRk= ARC-Authentication-Results: i=1; imf29.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=rfGnQxA9; spf=pass (imf29.hostedemail.com: domain of sj@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=sj@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1735856569; a=rsa-sha256; cv=none; b=w6pbIcLNnRw0TnrFM8JDUsXpXA8Nf68ny52QAehROIRXwhT6VsyIxps95CrvuW+szmVKR1 AF8fqd/M3JKgb+YrAz5Q/hsK0xKc7ClR2na6uHpAeEfVFNF5ZCRorwz5nPGC8NnpGRt3++ 3LWFP22z3gnK1b29bgeeFDti1+bYCEg= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by dfw.source.kernel.org (Postfix) with ESMTP id 3B1B95C59B8; Thu, 2 Jan 2025 22:22:42 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 243F0C4CED0; Thu, 2 Jan 2025 22:23:23 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1735856603; bh=5dpatxo75bVUWHkvAOwBL+wDSKuB6MEXFYZ5+4svAE8=; h=From:To:Cc:Subject:Date:From; b=rfGnQxA9KTzxjb3iyIw6nES0qCOC2/iFxwlcQPqNZvzpSaCCpH+mPDhDWKMRZ4c4/ /MOTE521MNGSbLL+W19SaAVGNQqMUhyhmxEFVcTgsi0UkTKRgwP7QKVu8opIb3SA1u s1ouwpm9BwlaLu7h4nBZO/qNWcH5XOF4XP8JR64tEB6OUadlkM8uzUjIwmhNc5hJIv onEajrqwz+iDFNDdN0O36pMTBLqhNXvHYor4reb56nW4TQTcR4ZMDlBrOR0cPv6d+c +shRqeOUbnqwXr/0zrQfWDiC9jjWZcTmCh0y540jwV77kiKCEa1eTm/EIDE/uorDB0 WmtHFLTVzqAOg== From: SeongJae Park To: lsf-pc@lists.linux-foundation.org Cc: SeongJae Park , damon@lists.linux.dev, linux-mm@kvack.org, linux-kernel@vger.kernel.org, kernel-team@meta.com Subject: [LSF/MM/BPF TOPIC] DAMON Updates and Plans: Monitoring Parameters Auot-tuning and Memory Tiering Date: Thu, 2 Jan 2025 14:23:17 -0800 Message-Id: <20250102222317.48760-1-sj@kernel.org> X-Mailer: git-send-email 2.39.5 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspamd-Server: rspam05 X-Stat-Signature: 9tjaiz14d53jucx5zqi1sson7w9gqiwp X-Rspamd-Queue-Id: 5F548120011 X-Rspam-User: X-HE-Tag: 1735856532-786747 X-HE-Meta: U2FsdGVkX18DnKwV2gtrAEY22boqrCpDt7ynvOA05TGiYFsfs+58vT7jOcPeF7uKA9OnaIsSpzMBIgoAkad9XSw37kHypfmO8uFSNM2WLf+AGEMO6q9g2crkGba+vEpARvOvmnUd6pzuMXH4DB08HBBUGj0ngZx9FRU5MIUHBV6H4cI6Z0OxjsZz0SoGBcxuvhIQX/xVBzVdwdmIqIoGHojW2/F3cOK6k4NJU1lbiKV1z8dalBDMs6IYuk1uZv/GgWl0m9cK3SsgzHsYEN/bTgBLTFWu+F2Hv95PBCY32p5nashd1CXYD/Om6tAXdaOTwGAVDad5Wqpk/sfZUhfJG8rWRulC9ZGD8IweqlYuVsozyM8aCmU8USdRgXCzZHJQYqEPjVNVTQHXLubom7/VPG307JnuAz+MOmoOv0el2WaiZrQANgVgb/JYeC76V9VuXrKvTiVYc2f8S0sNPyuHQTpzMlNMC3+XpA8yEh2lS5GhFHrHR62ecSlh05+6UGsszAb4eVgKc4VCS079Uysy7O4sDohfw29P2ObTGnpb0r5Kxv6OXVs8am8oSOAVQ0iDEM/IEFzaTGaM6gcjV/l+ZbvveteA6PAmM71sUy5j+h0lStRziwocUZ4RCDLP53hlhYIfztuDIDUbWUyaLXwlGeCakHRKnPc2WNTQyOYPJqyTON0HRr763Yt7geF9cPtLOGCBa9vKHlv3kwxt26NuNaqxIASSwxoMNFM7rdjMscPjwgPiFaWd+/qGPxeKXAb9PiIJJuKqWrsjaCytAibXWSKL5OpDkK9GgNmNw5H6wXWrnUbmtFEjTer60PtzQ1E1sR1AN2zXkiEbBqtD+bS7OjUC7N/m8jYOaAUOEduPJWKWMTXD9NZuqu+FgsbMFuXF8zViJx6+K7TcflIzNZgXy3GHgb0iIDvVansL18RLQk7BNcpnqwZkw4EOxZniJhk0zncXnoYEY4C6DEmHd0H E3e+wH0x 1f8VrUuSQkB+4canlvZgJx5gVuhFSgDXr2E1Kf5YcH55Jids5HDtydwK/gNKYJBf1z+hrrW3hGhNDUzG8Fq0YbUSBlFQGulK5marVicocUgkNaf0BMR3B/sF7LGlt/kiFyHvznoCII4zbQka+9yWtHIxwBu9b9fcfeu1r7itzYOZoM5inJVTKQjKP/1fW/rB1mz7jVV08u54r7gsHdso64n7cWDU6ZBeZxlyH2CDcZFfi7kKpUvDsAzWq7O5dGRG2YQBBYKsx8m86D6POQHlTZGNwokdeF9IsI7iiBWc6t8sf+FksHlypiIYMnw== X-Bogosity: Ham, tests=bogofilter, spamicity=0.001269, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Hi all, We started sharing and discussing DAMON's current status and future plans from LSF/MM/BPF 2023. Thanks to the constructive feedbacks from the discussions, I believe DAMON is continuing the evolution in right or at least not controversial directions. To continue getting the benefit and avoid it becomes an unexpected "demon" in early stage, I'd like to share and discuss followup updates and new plans for DAMON once again on LSF/MM/BPF 2025. Major topics and currently expected materials to share on the session include below. Of course, some changes could happen. First, followups on work items that we discussed on last LSF/MM/BPF. DAMOS auto-tuning based tiered memory manamgent. No many progress has made so far. But I recently gained an access to a tiered memory system, and setting up test environment. Hopefully I will be able to share early RFC implementation and evaluation results by the session. Access/Contiguity-aware Memory Auto-scalging. No progress has made so far, too. I'm pivoting this into reliable huge contig memory occupation mechanism, though, since it is smaller scope that we can make faster. It can also be used for not only memory hotplugging based auto-scaling but also contiguous memory allocation. Hopefully early evaluation of a part of the work, probably access-aware partial compaction, will be shared by the session. Please refer to last year LSF/MM/BPF slides[1] for details of the above two projects. And new projects that currently in their early stages. Page level properties-based access monitoring. We are extending DAMOS filters that works in page level properties to further be useful for monitoring purpose. RFC patch series for the essential part[1] is already available, and user-space tool support[2] is made. By the session, hopefully the patch series will be merged in mm tree, and I will be able to share followup plans for making it more lightweight and useful. Extending DAMON for memory bandwidth monitoring. We aim to extend DAMON to support not only access pattern snapshot generation, but more general access pattern information, like memory bandwidth usage. I expect only rough idea will be shared on the session, to make early alignemnt of the future shape, or abortion. Please let me know if you have interest in status of other projects that I shared on last LSF/MM/BPF session or somewhere else. Depending on that, the topics and time portions can be changed. Note that I proposed[3] yet another LSF/MM/BPF topic for DAMON. If both are accepted, please schedule this one before the other one. I believe this session can make the other session deduplicated and faster. [1] https://github.com/damonitor/talks/blob/master/2024/lsfmmbpf/damon_lsfmmbpf_2024.pdf [2] https://damonitor.github.io/posts/damon_sz_filter_passed/ [3] https://lore.kernel.org/20250101222039.74565-1-sj@kernel.org Thanks, SJ