From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8CE3BC25B4F for ; Sun, 12 May 2024 19:44:09 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 13DD66B01FE; Sun, 12 May 2024 15:44:09 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 0C6DD6B01FF; Sun, 12 May 2024 15:44:09 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id ECF616B0200; Sun, 12 May 2024 15:44:08 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id CECB86B01FE for ; Sun, 12 May 2024 15:44:08 -0400 (EDT) Received: from smtpin10.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 8613880526 for ; Sun, 12 May 2024 19:44:08 +0000 (UTC) X-FDA: 82110769776.10.03EDFEE Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by imf19.hostedemail.com (Postfix) with ESMTP id F009E1A0016 for ; Sun, 12 May 2024 19:44:06 +0000 (UTC) Authentication-Results: imf19.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=rffXAPYk; spf=pass (imf19.hostedemail.com: domain of sj@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=sj@kernel.org; dmarc=pass (policy=none) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1715543047; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=UG7RWInDLHlSDm55Qv4A9iOFsH6YsVgnlq1aUPqgG8c=; b=kGBwtF7uqsdtksum77zIn0EUl0y8MhRJpXwYm7G0tB93pjstzQppy4PCrzEx9VuecYGlAj LAqUGDP1WTVz8JRh6e0X0rElBv/dKsRuo4BdHMhXGIKgVhhXppisxQBlf5NdXtoFMqj6D5 IwrpsVm7VCf4uOb3gO28JKehOsXc7lQ= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1715543047; a=rsa-sha256; cv=none; b=pP438E0g/ZJlU/6O/AZZJ9D0CBXkQfn5WVfJr2l62957Pzk5GcqlnA6WavuOLROnTysX+6 8u7A58aBSRZoQMGH/RbJhT7ezRaR6GJKcHzj7JTpVVAAqW4FvSnuiop8ddkRQeyUSVqPq1 7KlSWW+UExVjTmZba1td29SYKZ+RLCE= ARC-Authentication-Results: i=1; imf19.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=rffXAPYk; spf=pass (imf19.hostedemail.com: domain of sj@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=sj@kernel.org; dmarc=pass (policy=none) header.from=kernel.org Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by dfw.source.kernel.org (Postfix) with ESMTP id 03F6B60AFD; Sun, 12 May 2024 19:44:06 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 45316C116B1; Sun, 12 May 2024 19:44:05 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1715543045; bh=8DZqDhFgKbpGvB+c60lvPF2j608LiGdXKkx2a2gA8ZI=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=rffXAPYkvmKwRHy8bNAJjwdI3hx23etZb8xBObuihpiCOKiDl4TmJ/IbNgBX8zw+s 3I7WHApi1weEHdI5j3N3nAc1Evs+AyqiECF8MHTWiok1a0kzE+LAmlkPgJ5CrZGGwa /H3X+AnsDSjyzzUf323162S6lBlrzvMgrjzqvzANkyTt6y5TEnbmg/f5JA7pbSBdpC vi0RbnoonPWkYuiMJxn8q+VGs2i8/FGoDIntlL6Qq+e9zrxQwMMUt+gcvGL9lWOqge qA7McimJYjeI0VOcaqJsxYrZLan4Fy3c29ALce/sPa9Al/gUlXimmAlIeyfD1orOMX 5G+CuvvYYGyXQ== From: SeongJae Park To: SeongJae Park Cc: lsf-pc@lists.linux-foundation.org, damon@lists.linux.dev, linux-mm@kvack.org, linux-kernel@vger.kernel.org Subject: Re: [LSF/MM/BPF TOPIC] DAMON Updates and Plans: Automation of DAMON tuning, tiering, and VM guest scaling Date: Sun, 12 May 2024 12:44:01 -0700 Message-Id: <20240512194401.79396-1-sj@kernel.org> X-Mailer: git-send-email 2.39.2 In-Reply-To: <20240129204749.68549-1-sj@kernel.org> References: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Rspam-User: X-Stat-Signature: mo1qh6wcm8a4o9gifbjmkoqwg4xadbnf X-Rspamd-Server: rspam07 X-Rspamd-Queue-Id: F009E1A0016 X-HE-Tag: 1715543046-148708 X-HE-Meta: U2FsdGVkX19jcSIxxhVszKY04XW39tlGcnBHe/6uRxVZ6WtGgSJ3WA+975pgAat93lM9+NtfIAnjQJPhEBFt1q/axYcZt0X+ZAe/HUF9RZZ0T1KwDPOAvp80ZYzWdjb4MEMZLwyN6yPL1g7mjA41J3KbSgqm3DaVWItdnn3jnBE9cwjAu9BNdcwkwrj1XElifo+mgFQlzuX6Z1g+/jm2mB2/5qPY55+eD/cZOfINc/mHFdjh3e94nU1DSkGGlCWPgJWbY/uMt+vwHDYcqWC9cUAf/F9zxMauzYpMEzqyW4Zf6/ZTt8HbT6OomAAVZgKiIibYxWBjs6Q2nUv+utZBKC9/UDMMrH2aadN+YCJ3Ws7+QaaklgZj9X0xJ19686Hbx/Mh/139MCRTlbsgSd8fTY+9px75LH9ARipEvv7rAtIQEl6fa1nxiX++bQIxliBRNGY/G38urK56ubOjbQaWMYwTGRJBku/iTLVhgaScCpcbvJbCwUp9HOjP5mMnLqy8p2nsEu2t+/h9l87SzjGIN6uzsNDUlupLfRP0v6dYkMmPeQ7bYJpyi3ZetiIULw+xW/c/0Czp4nI16b31uD7BYUOox2yc7rwfEJbTr9n+JwzyYAj4nRHWKIKXbb3oPQOMymRJN2o/HEG2Ea/O8gWQj4ZY2kb1Os7PW9UvcJeGe/iQkjX2ZAp8uqBt4JG1iQD8+xfBSIyMJABa70wxa59fTeTNq/96ZHguPGyYbFukY0S2OlLbnkRILZx11/9ETmURsmfzNqb53NmzzP1Y0GgjebTDGU6VL4w/90YwizIAz/X/4sRzqv4bblSj8S9OYtA/Xu+p8JskTJArjirKV7E0a1xZB5NTIyC4KpAjn/s9IU2TCf28SQ/6TWKb1QKdT7owoArYr+XOiU4b/rUcAWygnc/FQZeBzhttdOSQBqhUsdFLYI/CvA9PQ1049OxWjhL2ZvCyQDAe8TUFmKwI/Ok XU/T8I4A Eb6GZ+uz6Wn6/T7geU6pKA8ABvb4nVLh5acx5zK9LrzO1J98ui7UHu8mMGlKo9p2CRWEp7rJNocBbbp4te6otp3akem+3YQ2iZm7Rqjl6K5v+pMrGIYSOKH6q87GrectAe3Mphepl3ua4goA7z/7PPRxeXPzzUU62aQMom6y83B0uWZYEH+RjXvXsLQblEVTWGxW3Zf9G+OqY7D5vyq9Wv1k2+cZOBn/0pCk5vyjC6SLB68JIAxMlNnjwnQ== X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Mon, 29 Jan 2024 12:47:49 -0800 SeongJae Park wrote: > Hi all, > > > Thanks to the discussions and feedback that we received last year from the > LSF/MM/BPF 2023's DAMON updates and future plans session[1], DAMON made many > advances and yet more future plans. I'd like to again share/discuss the > followup changes and status we made so far after the last year's session, and > the future development plans on LSF/MM/BPF 2024. > > A few topics would be shared, including below. > [...] > > Access/Contiguity-aware Memory Auto-scaling > ------------------------------------------- > > This is a new idea which was not discussed in last year's LSF/MM/BPF. The main > purpose is to implement an access-aware, efficient, reliable, and simple to use > memory over-subscribed VM guest kernels. Specifically, it will steal guest > memory based on access patterns in a contiguity-aware manner and report those > to the host as free to use. The PSI-based stealing aggressiveness auto-tuning > may be used. It will also apply a 'struct page' overhead reduction mechanism > to the stolen memory. We're currently thinking about memory hotplugging and > vmemmap remapping as candidate mechanisms. For simple usage, the interface > will be similar to that of virtio-balloon, which is widely adopted. The first > version of the more detailed idea[7] has been shared before. > > Because it is still at a pure idea level, not much progress until LSF/MM/BPF is > expected. This item would be primarily for the future plans part. That said, > at least a second version of the design will be shared before. Also hopefully > early proof-of-concepts level implementation or some test results will be > shared. Since this is expected to be more for future plans than status update, > I hope to have more discussions for getting design level concerns and possible > collaboration chances. I just posted the RFC IDEA v2 of this with pseudo-code level implementation example: https://lore.kernel.org/all/20240512193657.79298-1-sj@kernel.org/ Hopefully it will help the idea success or fail faster :) Thanks, SJ [...]