From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 0427FC88E41 for ; Thu, 10 Sep 2026 23:55:41 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id E04876B0095; Thu, 10 Sep 2026 19:55:40 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id DB33E6B00AE; Thu, 10 Sep 2026 19:55:40 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id CA49C6B00AF; Thu, 10 Sep 2026 19:55:40 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id 94F766B0095 for ; Thu, 10 Sep 2026 19:55:40 -0400 (EDT) Received: from smtpin22.hostedemail.com (lb01a-stub [10.200.18.249]) by unirelay08.hostedemail.com (Postfix) with ESMTP id B36601404E1 for ; Thu, 10 Sep 2026 23:55:39 +0000 (UTC) X-FDA: 85199512398.22.2ADA27F Received: from tor.source.kernel.org (tor.source.kernel.org [172.105.4.254]) by imf16.hostedemail.com (Postfix) with ESMTP id C0F4B180003 for ; Thu, 10 Sep 2026 23:55:37 +0000 (UTC) Authentication-Results: imf16.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=aRJyfS+I; spf=pass (imf16.hostedemail.com: domain of devnull+ackerleytng.google.com@kernel.org designates 172.105.4.254 as permitted sender) smtp.mailfrom=devnull+ackerleytng.google.com@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1789084537; h=from:from:sender:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:in-reply-to: references:dkim-signature; bh=++ivv7HN60tWZlNPCgHch1tbo7hBfnJGr8wGNKhUbSc=; b=liT17OdEF6g6kbhSKRplR9b6I6ViafnZK3MJJN4d0vc9EJrpx1RwCvJI0AG60XJSsp8tBQ NF4crvA0diAqJR91ozx8o0+0d9nY18AzBYXzdLlxmbou0fs6PG84B0vlUbdmsVD38Nvohf AUsZu+HYRemImgXfSgRM2Nib1zt0Xz4= ARC-Authentication-Results: i=1; imf16.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=aRJyfS+I; spf=pass (imf16.hostedemail.com: domain of devnull+ackerleytng.google.com@kernel.org designates 172.105.4.254 as permitted sender) smtp.mailfrom=devnull+ackerleytng.google.com@kernel.org; dmarc=pass (policy=quarantine) header.from=kernel.org ARC-Seal: i=1; a=rsa-sha256; d=hostedemail.com; s=arc-20220608; cv=none; t=1789084537; b=FhZCBPgKB05MVm6wh6JZsaR+VypIqNtdUVD1mu9Uh6i5p0ozBJ+Dm5a6T7Xd2xOVH0MNvS MD1UPBue/7lxkbVhMK7UP74W6xNauWGN4Qdo756IA+OXMn8GDT6JxVB0uUj4n5aFfsx22U BjVBk2u1pPrkT40QTBns3eNWdDFGEY4= Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by tor.source.kernel.org (Postfix) with ESMTP id C87E3601F1; Thu, 10 Sep 2026 23:55:36 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPS id 6B620C2BCC7; Thu, 10 Sep 2026 23:55:36 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1789084536; bh=3xAm8x8BxRzgrAQrSXJX3gnFRneXWjklDL9ZXrCM6gA=; h=From:Subject:Date:To:Cc:Reply-To:From; b=aRJyfS+I/6oQ7NgCYNS5fmaQR+KsYLywWvIOhh67twUSNtYkyOUbNPbVUUIIrpi51 6GP9p4pbnVML0vJ2nd8LWSfjo+PnrGERiWFu0eRqSLwZ9UqNVjplFT0CRm9Phg4C2w oAKM4jE9zC9smkbSe0E4fDbbdhYc3jAZGKRoVOLytlKI76wYKWHNu/D8+0Qo/N+x2w AhCL13x6FpPQSPkNeUWTLHDPUwzeRe5sZ2tzwcShlzKvdPbhL/0KmtpFn0jfjmMYG/ ehWoEaMOC7YdTLGP8Rbontj1HibTUE3fuYSJWwKpFAMyksKL0ANtyQLSDn74/zZqIt sC2rzmYHMxyIQ== Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3E354C88E45; Thu, 10 Sep 2026 23:55:36 +0000 (UTC) From: Ackerley Tng via B4 Relay Subject: [PATCH v13 00/44] guest_memfd: In-place conversion support Date: Thu, 10 Sep 2026 16:55:26 -0700 Message-Id: <20260910-gmem-inplace-conversion-v13-0-dd6fbf94f4e1@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit X-B4-Tracking: v=1; b=H4sIAG9Do2oC/33T226cMBAG4FdBXNepPcYnrvoeVS8Ge7yLGmBrC EoU5d1jdhVBREFcGXk+jw//ezlSamks6+K9TDS3Yzv0eSDkj6L0V+wvxNqQf5TAQXMAxS4ddaz tb8/oifmhnyktRawJPDRBOqMklrn6lii2r3f69588bnAk1iTs/XXx/s7dz55ep2XqtR2nIb3dm 5jlUvBYTgp5uNwsGWcqegFoOHnrfl2G4fJMT37oymW9udpAoI+hKkOUp0VyiscYdpBaoQrsMaQ yFKzm1vvoEWAH6RVS3BxDOkNOYKPQNsJhtYPMBgI4hkyGIPKIVDmtJN9BdoW0ONmaXToK4JSTy lgld5BbIXN2Ri5DUkWH5AEp7M9I8FWyZ4ck+H1zXlgiHWSDe0psqLMXIESmOAoVLBrn8D8UbCj JTyjIlFWkYgCVv+/UxyMXif695KRNj3CUHY0j3oNWFxys0Z6QKQOGgceKNYSBGamVI9SR/Lfns I1pXTz6+7rIfmCJppfUs9vCa1E5MAguOlPndHxlMjNdO9XFbJ4kSx5ymx+fPyXVBRgEAAA= X-Change-ID: 20260225-gmem-inplace-conversion-bd0dbd39753a To: aik@amd.com, andrew.jones@linux.dev, binbin.wu@linux.intel.com, brauner@kernel.org, chao.p.peng@linux.intel.com, david@kernel.org, jmattson@google.com, jthoughton@google.com, michael.roth@amd.com, oupton@kernel.org, pankaj.gupta@amd.com, qperret@google.com, rick.p.edgecombe@intel.com, rientjes@google.com, shivankg@amd.com, steven.price@arm.com, willy@infradead.org, wyihan@google.com, yan.y.zhao@intel.com, forkloop@google.com, pratyush@kernel.org, suzuki.poulose@arm.com, aneesh.kumar@kernel.org, liam@infradead.org, Paolo Bonzini , Sean Christopherson , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , x86@kernel.org, "H. Peter Anvin" , Steven Rostedt , Masami Hiramatsu , Mathieu Desnoyers , Jonathan Corbet , Shuah Khan , Shuah Khan , Vishal Annapurve , Andrew Morton , Chris Li , Kairui Song , Kemeng Shi , Nhat Pham , Barry Song , Axel Rasmussen , Yuanchu Xie , Wei Xu , Youngjun Park , Qi Zheng , Shakeel Butt , Kiryl Shutsemau , Baoquan He , Jason Gunthorpe , John Hubbard , Peter Xu , tarunsahu@google.com, Randy Dunlap , Lorenzo Stoakes , Vlastimil Babka , Mike Rapoport , Suren Baghdasaryan , Michal Hocko , Jason Gunthorpe , Fuad Tabba , Vlastimil Babka , Baoquan He Cc: kvm@vger.kernel.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org, linux-doc@vger.kernel.org, linux-kselftest@vger.kernel.org, linux-mm@kvack.org, linux-coco@lists.linux.dev, Ackerley Tng , Fuad Tabba , Xiaoyao Li X-Mailer: b4 0.14.3 X-Developer-Signature: v=1; a=ed25519-sha256; t=1789084533; l=8646; i=ackerleytng@google.com; s=20260225; h=from:subject:message-id; bh=3xAm8x8BxRzgrAQrSXJX3gnFRneXWjklDL9ZXrCM6gA=; b=tBwALuhzAg1A20WwgjQXyyFKIY1ex8U5p5pDeeO9K/+7xIvJd7mdEmNUHHn+JEMBtMbo+WCcs /jqpzD96MFVDmtkwsJhys5mJeDZWb0Xhotl8vQrEiE9Jea5+I28Sxwc X-Developer-Key: i=ackerleytng@google.com; a=ed25519; pk=sAZDYXdm6Iz8FHitpHeFlCMXwabodTm7p8/3/8xUxuU= X-Endpoint-Received: by B4 Relay for ackerleytng@google.com/20260225 with auth_id=649 X-Original-From: Ackerley Tng Reply-To: ackerleytng@google.com X-Rspamd-Server: rspam11 X-Rspamd-Queue-Id: C0F4B180003 X-Stat-Signature: y8d4kkt3jysk43ufuudxc4afcaphrg9w X-Rspam-User: X-HE-Tag: 1789084537-257585 X-HE-Meta: U2FsdGVkX1+3oA2TiL3qsEyNf1JxIegtkAr3N6kjalD1xdoqz820C92YWqU3mmv43DVcjN1WzvTaQZ6IV74hjpIHoEOdg0B36AAZSOjW1Ux/OzQJ5Qv58I/ZeUqUQoNftp2EqvoiX6pB9mWEvxwuJ5Qcrr9Yh3/qgsss0iRKyMZtGx1Z07XAAUxuwx426EALSX/EwxabNAx0b71lmGKCKcTBKpw14hVthbXo7N06GatmQ1SUlw37Ma7Jy8XAfsmGURLlXzGC7ked0NX7f/e52boI3B1g9keGSrKoqtEKxgLFSuqL3OwJXfI7b2JPZknCCfR44VU5WcoK0gqdMujov4aO3M0M3HBxQk9jw9K8nkd4B934xxMZ85g/e4xUQ8J0z2+RXeGNwHmQuKkEEi7PvuIzqxbqEIJafNq7YizdaIj5tU8hXpga12OQHvK7kLbacpVW+jr57/YBwmb7Az0LWslOicph168rEVbsbFE8qEelpqWXkODU9uhtB/+Y+dvAfVNxjcML8232GbV2vtOb+q+kfHkoFyV4JFdTRmCV8OpYPUXeKD6uD2rkVpIPaU5qplcwtRcysmJVsTaadMrXIZuXt3OalIVtNdG9CrahD2VzZFwEYKbrHSpJ675K7dGiMMQ8hyiFMW7c2Y8EGj3o8sBPhyu6cOriaJAwqjQJK8XC4Dyqz7wtvk+oFznPB+aPH5uZOvhWE93Htwb6IiqRu7UoPwoQy/yjLsJkFD78MMsvhdFqm/brDk2KA9IWQYCTR3KBEu5HevTdMlSzeFnnt6/3n74ioWPRK+39XyUhsb+sbn9Y5RZVEUyRiRVldGLyrCuof5uCU4rEncuyBFefv8D1KVKBhEBtzbkoeqrrJJNk8SkhFZbEyKcFjHk9JKSlxj1zmTFqc220HM/KEYG7NW6RCRJYzpVcQ66Jq2NoTHvxIV5O5zYGichmv5k8lY6T5MLnxDGb1yv2OF7PDMv 95+h0+yA y6bRKfyfqmgnfzsXCJlL8m/CTbdp8SSkzR7YgO+lIi6/CQBBRpEwGz8E60jE/ncGAxGtZHjp0GghDK19tXxtkzlOmWI4M7Y9ft5dl5Xtb6LaY2iJgKOpzExgxwrggSKH/lOT/ZnjGl1LtEtLwS2nxAWsLJRyB+D8PLJaY1a6RczzuRCmyHoBrtBY6GIpYonRByxXg0OijexK4V4Uzl+sXjr3zlPzQ7L2rLMM8cDhTutw1kIGkhW3bvXmt/f2yN4fqoMjGL7sL2qx4bBVCF4DG9A1GKrrg5rfK5BT3mLnj43Zyr0C75lnu4G8/zh7BFB2/ED9mTobsc2I3olZJp3/fh9dWyln9gIUjRnw/MTJs/PAz7MwXiEC1h7JoqoaNxN7Yp1izKQOyZ88nd7votguk+d4HKtqhxlOGk8YJJxiF0JL0Ep1gL38N1/XxqRDwxOtN7VrnWXGMS+or7B0B8U46LbnjaPxI8yWGgrjOjaA3VyA5ppjVKfdOlnUuPnVI+rbhOxlT Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: Here's v13. Thanks everyone for the comments and fast responses! We're now at ~3 weeks to soft-close at 7.3-rc5. v13 is based on 7.3-rc2 and: + Hugh's patch to export lru_cache_drain_for_folio() + Another series [1], which makes kvm_gmem_get_pfn() NOT return a refcounted page to KVM. Here's everything stitched together for your convenience: https://github.com/googleprodkernel/linux-cc/commits/guest_memfd-inplace-conversion-v13 Changes in v13: + Picked up Reviewed-bys + Fixed bug Fuad pointed out in "Ensure pages are not in use before conversion", and squashed the lru draining in, adopted Sean's suggestion. + Fixed documentation bug that Fuad pointed out in kernel-parameters.txt. Here's v13 with tests: https://github.com/googleprodkernel/linux-cc/commits/guest_memfd-inplace-conversion-coco-selftests-v13 Tested with both CONFIG_KVM_VM_MEMORY_ATTRIBUTES enabled and disabled: + tools/testing/selftests/kvm/guest_memfd_test.c + tools/testing/selftests/kvm/pre_fault_memory_test.c + tools/testing/selftests/kvm/x86/guest_memfd_conversions_test.c + tools/testing/selftests/kvm/x86/private_mem_conversions_test.c + tools/testing/selftests/kvm/x86/private_mem_kvm_exits_test.c [1] https://lore.kernel.org/all/20260826-gmem-no-return-page-v4-0-3bb9c1ddb4e3@google.com/ v12: https://lore.kernel.org/r/20260830-gmem-inplace-conversion-v12-0-85e5fd25252a@google.com v11: https://lore.kernel.org/r/20260826-gmem-inplace-conversion-v11-0-0a15d8a799aa@google.com v10: https://lore.kernel.org/r/20260807-gmem-inplace-conversion-v10-0-2fc18ee6d3ba@google.com v9: https://lore.kernel.org/r/20260728-gmem-inplace-conversion-v9-0-35f9aec2aed2@google.com v8: https://lore.kernel.org/r/20260618-gmem-inplace-conversion-v8-0-9d2959357853@google.com v7: https://lore.kernel.org/r/20260522-gmem-inplace-conversion-v7-0-2f0fae496530@google.com v6: https://lore.kernel.org/r/20260507-gmem-inplace-conversion-v6-0-91ab5a8b19a4@google.com RFC v5: https://lore.kernel.org/r/20260428-gmem-inplace-conversion-v5-0-d8608ccfca22@google.com RFC v4: https://lore.kernel.org/r/20260326-gmem-inplace-conversion-v4-0-e202fe950ffd@google.com RFC v3: https://lore.kernel.org/r/20260313-gmem-inplace-conversion-v3-0-5fc12a70ec89@google.com RFC v2: https://lore.kernel.org/r/cover.1770071243.git.ackerleytng@google.com RFC v1: https://lore.kernel.org/r/cover.1760731772.git.ackerleytng@google.com Previous versions of this feature, part of other series, are available at: + https://lore.kernel.org/all/bd163de3118b626d1005aa88e71ef2fb72f0be0f.1726009989.git.ackerleytng@google.com/ + https://lore.kernel.org/all/20250117163001.2326672-6-tabba@google.com/ + https://lore.kernel.org/all/b784326e9ccae6a08388f1bf39db70a2204bdc51.1747264138.git.ackerleytng@google.com/ Signed-off-by: Ackerley Tng --- Ackerley Tng (22): KVM: Rename kvm_mem_is_private() to kvm_is_private_gfn() KVM: guest_memfd: Always fault from guest_memfd if in-place conversion is enabled KVM: guest_memfd: Pass mapping type filter to invalidation helper KVM: guest_memfd: Add base support for KVM_SET_MEMORY_ATTRIBUTES2 KVM: guest_memfd: Ensure pages are not in use before conversion KVM: guest_memfd: Call arch make_shared callback for to-shared conversion KVM: guest_memfd: Return early if range already has requested attributes KVM: guest_memfd: Zero page while getting pfn KVM: TDX: Make source page optional for KVM_TDX_INIT_MEM_REGION KVM: selftests: Test basic single-page conversion flow KVM: selftests: Test conversion flow when INIT_SHARED KVM: selftests: Test conversion precision in guest_memfd KVM: selftests: Test conversion before allocation KVM: selftests: Convert with allocated folios in different layouts KVM: selftests: Test that truncation does not change shared/private status KVM: selftests: Add helpers to pin pages with CONFIG_GUP_TEST KVM: selftests: Test conversion with elevated page refcount KVM: selftests: Reset shared memory after hole-punching KVM: selftests: Provide function to look up guest_memfd details from gpa KVM: selftests: Make TEST_EXPECT_SIGBUS thread-safe KVM: selftests: Set up page size and alignment independently for guest_memfd KVM: selftests: Update private_mem_conversions_test for in-place conversions Michael Roth (1): KVM: SEV: Make 'uaddr' parameter optional for KVM_SEV_SNP_LAUNCH_UPDATE Sean Christopherson (21): KVM: guest_memfd: Optimize away conversion overheads via dead-code elimination KVM: guest_memfd: Use kvm_mem_is_private() when populating guest_memfd memory KVM: guest_memfd: Introduce per-gmem attributes, use to guard user mappings KVM: Rename KVM_GENERIC_MEMORY_ATTRIBUTES to KVM_VM_MEMORY_ATTRIBUTES KVM: Enumerate support for PRIVATE memory iff kvm_arch_has_private_mem is defined KVM: Rename memory attribute APIs to prepare for in-place gmem conversion KVM: Provide generic interface for checking memory private/shared status KVM: guest_memfd: Stub in ability to enable in-place shared<=>private conversion KVM: Consolidate private memory and guest_memfd ifdeffery in kvm_host.h KVM: guest_memfd: Invalidate both SHARED and PRIVATE mappings for in-place conversions KVM: Move KVM_VM_MEMORY_ATTRIBUTES config definition to x86 KVM: Let userspace disable per-VM mem attributes, enable per-gmem attributes KVM: guest_memfd: Enable INIT_SHARED on guest_memfd for x86 Coco VMs KVM: selftests: Create gmem fd before "regular" fd when adding memslot KVM: selftests: Rename guest_memfd{,_offset} to gmem_{fd,offset} KVM: selftests: Add support for mmap() on guest_memfd in core library KVM: selftests: Add selftests global for guest memory attributes capability KVM: selftests: Add helpers for calling ioctls on guest_memfd KVM: selftests: Test that shared/private status is consistent across processes KVM: selftests: Provide common function to set memory attributes KVM: selftests: Update private memory exits test to work with per-gmem attributes Documentation/admin-guide/kernel-parameters.txt | 25 + Documentation/virt/kvm/api.rst | 110 ++++- .../virt/kvm/x86/amd-memory-encryption.rst | 14 +- Documentation/virt/kvm/x86/intel-tdx.rst | 4 + arch/x86/include/asm/kvm-x86-ops.h | 2 +- arch/x86/include/asm/kvm_host.h | 9 +- arch/x86/kvm/Kconfig | 15 +- arch/x86/kvm/mmu/mmu.c | 28 +- arch/x86/kvm/svm/sev.c | 13 +- arch/x86/kvm/vmx/tdx.c | 8 +- arch/x86/kvm/x86.c | 20 +- include/linux/kvm_host.h | 83 ++-- include/trace/events/kvm.h | 6 +- include/uapi/linux/kvm.h | 16 + tools/testing/selftests/kvm/Makefile.kvm | 1 + tools/testing/selftests/kvm/include/kvm_util.h | 139 +++++- tools/testing/selftests/kvm/include/test_util.h | 34 +- tools/testing/selftests/kvm/lib/kvm_util.c | 222 +++++---- tools/testing/selftests/kvm/lib/test_util.c | 7 - .../kvm/x86/guest_memfd_conversions_test.c | 512 +++++++++++++++++++++ .../kvm/x86/private_mem_conversions_test.c | 66 ++- .../selftests/kvm/x86/private_mem_kvm_exits_test.c | 36 +- virt/kvm/Kconfig | 3 - virt/kvm/guest_memfd.c | 468 +++++++++++++++++-- virt/kvm/kvm_main.c | 92 ++-- 25 files changed, 1642 insertions(+), 291 deletions(-) --- base-commit: 5e036ce12de91c6fd674dad33b169c6150be2a7a change-id: 20260225-gmem-inplace-conversion-bd0dbd39753a prerequisite-message-id: 02876cea-5727-2ca4-bead-73659ea6fec4@google.com prerequisite-patch-id: 28922a76dee80792da6e445a55cdbb4bedc85374 prerequisite-change-id: 20260818-gmem-no-return-page-614927a29f97:v4 prerequisite-patch-id: 38553271bcb80c17dbae29cef5c20bcf95e804f9 prerequisite-patch-id: 0d4b50926073ba4f5e5d8b2c0cdae8869a278863 prerequisite-patch-id: bf39277ddc12818fe562a006f31d7992e5c7d42a prerequisite-patch-id: 74fe849c04c187074bd380e664e536a07076292d prerequisite-patch-id: f92bdb4870dd7c1a2026fca1083e4400c2be11d8 Best regards, -- Ackerley Tng