From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id DFA73C54E66 for ; Wed, 13 Mar 2024 22:09:23 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 661A580068; Wed, 13 Mar 2024 18:09:23 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 6100380063; Wed, 13 Mar 2024 18:09:23 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 4D92280068; Wed, 13 Mar 2024 18:09:23 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id 3A37980063 for ; Wed, 13 Mar 2024 18:09:23 -0400 (EDT) Received: from smtpin01.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay01.hostedemail.com (Postfix) with ESMTP id DEB581C0DD8 for ; Wed, 13 Mar 2024 22:09:22 +0000 (UTC) X-FDA: 81893407764.01.95DF4B5 Received: from mail-oi1-f176.google.com (mail-oi1-f176.google.com [209.85.167.176]) by imf21.hostedemail.com (Postfix) with ESMTP id F038B1C0010 for ; Wed, 13 Mar 2024 22:09:20 +0000 (UTC) Authentication-Results: imf21.hostedemail.com; dkim=pass header.d=cs.cmu.edu header.s=google-2021 header.b=K0UtAyPU; spf=pass (imf21.hostedemail.com: domain of kaiyang2@andrew.cmu.edu designates 209.85.167.176 as permitted sender) smtp.mailfrom=kaiyang2@andrew.cmu.edu; dmarc=pass (policy=none) header.from=cs.cmu.edu ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1710367761; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:dkim-signature; bh=1nqfqubjBLJUTToVEymRt2+TmF4O0mtvhV2IGYnNFZA=; b=wf1kdwaQbTscYr/uh+Wd9FvbFKRePDADfagnchegHuwdgNYTrNFXDkWYcn9sg3/XTMgwZL PLRqZDxEmZ5xKmoqoHM148BvBwoFczVBYzImgk2mr+mDiNBluvI2o9DRH8gndswK4iB5pb fy2QzFJEfa49SN/kFoEothjnxFFoIn0= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1710367761; a=rsa-sha256; cv=none; b=yoMPUk41vExfyN+JfTtPWA+j+JLLOjD3f3hYB7uSMXgrF1Rh7iZr1j5jCZUoQT/SvPB0IC LuXUA8GH0497QXeh7Jdr/1oqdl4W2C5gVWFmRGGpzkCSsp6pVOj1bGmc4wAp4jOaJFl1Re 4IH663xr59qcS465H2IWjvBgllLyGjg= ARC-Authentication-Results: i=1; imf21.hostedemail.com; dkim=pass header.d=cs.cmu.edu header.s=google-2021 header.b=K0UtAyPU; spf=pass (imf21.hostedemail.com: domain of kaiyang2@andrew.cmu.edu designates 209.85.167.176 as permitted sender) smtp.mailfrom=kaiyang2@andrew.cmu.edu; dmarc=pass (policy=none) header.from=cs.cmu.edu Received: by mail-oi1-f176.google.com with SMTP id 5614622812f47-3c1ea5b42e7so227661b6e.2 for ; Wed, 13 Mar 2024 15:09:20 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cs.cmu.edu; s=google-2021; t=1710367760; x=1710972560; darn=kvack.org; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:message-id:subject:cc:to:from:date:from:to:cc:subject :date:message-id:reply-to; bh=1nqfqubjBLJUTToVEymRt2+TmF4O0mtvhV2IGYnNFZA=; b=K0UtAyPUOcKQspGMdrwZ44HXSgRF9KbeP/4N+tpsUp/4WdKyv2YPMucVubplNSpMPe 3Hby4QyzarTxRBkNjXIt9vFNHt4DjdofKf7OlLIgUMSK2QbwQvgKkHcC+48sB0aQt/L9 O+xdcTrGib/BF/Qfx+DpumDXA2FPPQ2i+lPY2wkhmU6KakMvt0EZS2nffFXlKj2wQ2k5 SDtC2BhL9K4dsL/4r8otyNtOL/fLYuHsTct9ZLOaCVPpNjTaTqI+IzlcwFqK4CJMTUPX 24hnJblyFx8jhYmW6CcQasFRBQaespEiZ/FxEMrljXPNrAw46SCIMt60AmYtSrkxu5CY j+VQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1710367760; x=1710972560; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:message-id:subject:cc:to:from:date:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=1nqfqubjBLJUTToVEymRt2+TmF4O0mtvhV2IGYnNFZA=; b=LRQcISZYCowaQw23WuTIkxawx56BgK8HF4FABQIMcLwl4F7/v0/GXsaBgDErIelLA4 h5ob555r+CkF9g0WrgnnWXxEk3NTeVU0AYOM/A2//7iEgqwqlh1qgDzAKVaO96hYAs6M roIWD3HguMHsWWWB5kkjEA9fcixH1MMrTMozxD0P7AnieGtKf5nUqogEe9wec9iSpopr Gkl5btKrr/pJ41l2cRPm/LIrEhQzX0dZ9f68RQOYgjSheQCqhKahuC1J+lAbTMNW6nc6 QR66ty1/hsmx3hvT+NYgdAvWAPmDWxRTIV9yxEyfmqW0emXeu+oOZqtUHEwQXtnUXRvm gB7A== X-Forwarded-Encrypted: i=1; AJvYcCX/O+kdqLzKnrt6bIB2UgShIU5K9dNLzm4YKfoDvWmiRSroBcTeWZtjxURvb38VCYGf8+BP3eRUAHWUmDxFGVcxD/o= X-Gm-Message-State: AOJu0YwMVeaqb9WtlikiQ74gT9sNlDWnnUUlFdcNOjhfXWua14OztWeX hV1oj2dwg3ROtnouSuJjRuEHcA8bT2YuRGXZo/g+lwEjKC0EkuZ4nlSQ3aBltw== X-Google-Smtp-Source: AGHT+IGGdOWi+jrcbbVw0yGBKw977fGdpIDAGQ23jNn5cu6rmtKuztVrGbk6lMvWxsWTBfDoZzYLqw== X-Received: by 2002:a05:6808:1b2c:b0:3c2:1441:f06 with SMTP id bx44-20020a0568081b2c00b003c214410f06mr53637oib.29.1710367760031; Wed, 13 Mar 2024 15:09:20 -0700 (PDT) Received: from box (pool-74-98-221-57.pitbpa.fios.verizon.net. [74.98.221.57]) by smtp.gmail.com with ESMTPSA id b19-20020a05620a0cd300b0078870fdb4c0sm65040qkj.116.2024.03.13.15.09.19 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 13 Mar 2024 15:09:19 -0700 (PDT) Date: Wed, 13 Mar 2024 22:09:17 +0000 From: Kaiyang Zhao To: Johannes Weiner Cc: Yu Zhao , lsf-pc@lists.linux-foundation.org, linux-mm@kvack.org, Jonathan Corbet , kaiyang2@cs.cmu.edu, dskarlat@cs.cmu.edu Subject: Re: [LSF/MM/BPF TOPIC] TAO: THP Allocator Optimizations Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <20240306155110.GB891917@cmpxchg.org> X-Rspamd-Queue-Id: F038B1C0010 X-Rspam-User: X-Stat-Signature: qtt1dw15bw8i6nkdxdb319eqy8a415mn X-Rspamd-Server: rspam03 X-HE-Tag: 1710367760-329924 X-HE-Meta: U2FsdGVkX1+oF9JyLTDeMzsdtg5FQsSQQrId94LzVIJ4gJN6nqzC4zBDqaXGjdBb14M0NRaJNfoKijAeGrgyreBFJoaNpajJ56/l3/DIZGzUWcbhRX/U6GHEb44oaJF4DpjGuGRYH9pZ8jpw/KCDMS2GNi+z4Y6kOWdwxj8rLFcCX+jSkjsWxGjantth5HYcf5lr7gZ++auu6XsE5w4yno2w6Qy89HQXynqWa91/kjZab27tB0bUbjHhnNwHWio/lfufHF4cG5OrO83VION9NDGCl1oQ7M/+5ZSq85siKDs7mDe09xdRiMtmMonG+Zop3dPF7K9gJpUeTmsGQHKdkMC6LDV6B4flYSPFHfnEVSu8SlZJNrICBB8RjqGMh8Zq23nTEI+mu4UIKQly6JUiZkda3nsm6SHkTD6YWHY8S2QFw7PqRC2tNKZqY8A75xCIhYZDLrFymjyhKlWVSezEaK6JzGJ47vR5yXLPLBQXzUeVPr4oXy3CSyW8Zb+fp5uEOBu/JHog59yZGaDVs2qxEVCxMYma4ZxSfssJH3zQcBi7pySiNTHWEi7ZlHDa7hxvhZD+bsHn20j8OUNTs/CJPnIZqrMQpyN9LxgacC6N1kpPy4bspW5KAyVIsjJFG9Ga96GzMJDOyuekw+VT+mXQ8x80sJBLFIVoXGvHT9UVLLIyTmU8DznzC1JDVme9gvTNElenV0EbXe7KXkzJak6+Zo30dGhCJfXi0yNJGVYWxWCubpDatc4RT73m2kMmCWVQmMAgztnU05VBNW9RodBVPckVFiKyHsJAyDYKJMswe9oPALlyzHrdAMJGAbhPeIJ0FxUgHLSzpBYpF+QA7Szk8XHlXTFfU+8ziWAuFtUYxM9kxrhwgb7XlWuZMfaR691dg0C880JrWWLu4NnjGUAsevOIectFbNwTEovOEHT2iTlbwqWlQ9G7yAl/zWj14WiDuKSlI+18V4ioprUuW2f /own6clI vibREdknia2fu+Go4U1JIy1S0iRxJX0GhCenikWlnnRdyGSl6yD2mCocNTKDW+PDEnq8XhxjhTX7VPwSOxHA7dJxaBTHvRAZRuOArjPXyDbMXZUAXtxdsveB1v2MBKkcdzEzUkFxv9k2ltEOczL6K+mIwwIGvSDi3IARhGmlREcisw2GSRKnGmwiAhGuSltI4ftm4WPuY5xAdMODrgto1ho75HSnSIh7f9LEV X-Bogosity: Ham, tests=bogofilter, spamicity=0.158728, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: On Wed, Mar 06, 2024 at 10:51:10AM -0500, Johannes Weiner wrote: > This is a very interesting topic to me. Meta has collaborated with CMU > to research this as well, the results of which are typed up here: > https://dl.acm.org/doi/pdf/10.1145/3579371.3589079 > > > I would like to be part of it, and would also suggest to have Kaiyang > (CC'd) in the room, who is the primary researcher on the Contiguitas > paper referenced above. Thanks for bringing up Contiguitas, Johannes. Providing a large amount of physical memory contiguity and managing it as a first-class resource is very important for bringing a lot of research in virtual memory into reality. Johannes has already touched upon many parts of the kernel changes we made in the Contiguitas project. To summarize, we want to confine the unmovable allocations in a separate region in the physical address space so that later memory contiguity can be obtained by successfully doing compaction, and provide the ability to dynamically size the unmovable region to adapt to changing workload characteristics and avoid static sizing. I will send an RFC with patches soon. Dimitrios (cc’d) and I are interested in joining this effort and finding the best approach to achieve our shared goal of more and easier-to-manage physical contiguity.