From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 990F8606A32A for ; Wed, 11 Nov 2026 14:59:24 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=lists.infradead.org header.i=@lists.infradead.org header.a=rsa-sha256 header.s=bombadil.20210309 header.b=0DdXWbli; dkim=pass (1024-bit key) header.d=arm.com header.i=@arm.com header.a=rsa-sha256 header.s=foss header.b=az1q8nPg DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:Content-Transfer-Encoding: MIME-Version:References:In-Reply-To:Message-ID:Date:Subject:Cc:To:From: Reply-To:Content-Type:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Unsubscribe-Post: List-Owner; bh=h/au/usfZE/TfBBMZivfikC70G+5kRYRhls8qJotySE=; b=0DdXWbliEQ/Xwp PRJ3WNq0CYFlFzeiMb/jWznzETKOrC6Fr5zYDhkzgrX7ARqDBsSz1JP11n7e1hFbaUoEk1ZySc/FQ 3RAnroaENQVxIniIPhUHfd92+boGbIffUJPz9lcz4yjOeVvOwdWxYQCwuDF59LZP0PEpo8l8WDzAT lMyxnPzYFoiI00FNXJGbbSsEkNAV4/D42Sv4F/CyaPKZOLPuAcuURnvs7FZ8oEibL/EVYym6TXBSW HUS6KNP9JwKbKAi9CW+xnOd3Nwp/q5yhxARYBASKt56xABn1e/fViN05QE5VoXOMMa5C1rYnb3U8p maxKOoL5qVlE/FytbQeQ==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.100.1 #2 (Red Hat Linux)) id 1xR9nC-000000071vy-1R0P; Wed, 11 Nov 2026 14:59:18 +0000 Received: from foss.arm.com ([217.140.110.172]) by bombadil.infradead.org with esmtp (Exim 4.100.1 #2 (Red Hat Linux)) id 1xR9n5-000000071o8-0lNa for linux-arm-kernel@lists.infradead.org; Wed, 11 Nov 2026 14:59:15 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id 0DFCB1576; Wed, 11 Nov 2026 06:59:07 -0800 (PST) Received: from e122027.arm.com (unknown [10.57.58.72]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id E5F2E3F632; Wed, 11 Nov 2026 06:59:05 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=arm.com; s=foss; t=1794409150; bh=DrbIuSnaXWHO+3/nsY1BLqsSk0ZejQGKrsYqRy9iELs=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=az1q8nPgnHHODRc74qEHNPtIoSNwdKhF1Z16xfod8gPHw7ZIc29fxuDGNYmm68uhD PGuPpQLJtnuI94KrsCOCVC4UT+HMrs1qhCKUoFYEoLdvyP338dx8beCL4YHkfDvFEF pmXQ8G0Is2am36g1cLzbnyGpY61g3otIyQMl9PSs= From: Steven Price To: kvm@vger.kernel.org, kvmarm@lists.linux.dev Cc: Suzuki K Poulose , Catalin Marinas , Marc Zyngier , Will Deacon , James Morse , Oliver Upton , Zenghui Yu , linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, Joey Gouly , Alexandru Elisei , Christoffer Dall , Fuad Tabba , linux-coco@lists.linux.dev, Ganapatrao Kulkarni , Gavin Shan , Shanker Donthineni , Alper Gun , "Aneesh Kumar K . V" , Emi Kisanuki , Vishal Annapurve , WeiLin.Chang@arm.com, Lorenzo Pieralisi , Kohei Enju , Steven Price Subject: [PATCH v2 12/12] KVM: arm64: CCA: Add Realm stage-2 MMU operations Date: Wed, 11 Nov 2026 14:57:56 +0000 Message-ID: <20261111145758.217946-13-steven.price@arm.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20261111145758.217946-1-steven.price@arm.com> References: <20261111145758.217946-1-steven.price@arm.com> X-Archived-By: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.9.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20261111_065912_147657_25095302 X-CRM114-Status: GOOD ( 17.42 ) X-Spam-Score: -4.4 (----) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" X-Spam-Status: No, score=-18.9 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,USER_AGENT_GIT autolearn=ham autolearn_force=no version=4.0.1 X-Spam-Checker-Version: SpamAssassin 4.0.1 (2024-03-26) on aws-us-west-2-korg-listserv-alma10-1 From: Suzuki K Poulose Register the Realm stage-2 MMU operations now that the RMM mapping and unmapping helpers are available. Route unmapping through the RMM, and use the existing fault handler for Realm memory faults. The RMM handles TLB invalidation when stage-2 mappings change, so the host has no separate TLB flush to perform. Realm stage-2 does not support access flags, including for shared IPAs. Dispatch stage-2 destruction according to the VM flavor. Realm teardown destroys non-root RTTs through RMI, so the host frees only the root RTT pages. Signed-off-by: Suzuki K Poulose Signed-off-by: Steven Price --- Changes since v1: - Dispatch stage-2 destruction by VM flavor. Free only the Realm root RTT pages after RMI teardown while preserving the native and pKVM destruction paths. --- arch/arm64/include/asm/kvm_host.h | 1 + arch/arm64/kvm/mmu.c | 72 ++++++++++++++++++++++++++----- 2 files changed, 62 insertions(+), 11 deletions(-) diff --git a/arch/arm64/include/asm/kvm_host.h b/arch/arm64/include/asm/kvm_host.h index a82b18a3e4e5..33b1bd2740d3 100644 --- a/arch/arm64/include/asm/kvm_host.h +++ b/arch/arm64/include/asm/kvm_host.h @@ -243,6 +243,7 @@ struct kvm_vm_s2_ops { int (*vm_flush_remote_tlbs)(struct kvm *kvm); int (*vm_flush_remote_tlbs_range)(struct kvm *kvm, gfn_t gfn, u64 nr_pages); + void (*vm_stage2_destroy)(struct kvm_pgtable *pgt); void (*vm_stage2_unmap_range)(struct kvm_s2_mmu *mmu, phys_addr_t start, u64 size, bool may_block, diff --git a/arch/arm64/kvm/mmu.c b/arch/arm64/kvm/mmu.c index b6c61d7890c8..b416bc2ff69c 100644 --- a/arch/arm64/kvm/mmu.c +++ b/arch/arm64/kvm/mmu.c @@ -191,6 +191,12 @@ static int kvm_vm_flush_remote_tlbs(struct kvm *kvm) return 0; } +static int realm_flush_remote_tlbs(struct kvm *kvm) +{ + /* Nothing to do here, RMM does the job */ + return 0; +} + /** * kvm_arch_flush_remote_tlbs() - flush all VM TLB entries for v7/8 * @kvm: pointer to kvm structure. @@ -218,6 +224,13 @@ static int kvm_vm_flush_remote_tlbs_range(struct kvm *kvm, return 0; } +static int realm_flush_remote_tlbs_range(struct kvm *kvm, + gfn_t gfn, u64 nr_pages) +{ + /* Nothing to do here, RMM does the job */ + return 0; +} + int kvm_arch_flush_remote_tlbs_range(struct kvm *kvm, gfn_t gfn, u64 nr_pages) { @@ -353,6 +366,15 @@ static void no_stage2_unmap_range(struct kvm_s2_mmu *mmu, { } +static void realm_stage2_unmap_range(struct kvm_s2_mmu *mmu, + phys_addr_t start, u64 size, bool may_block, + enum kvm_gfn_range_filter filter) +{ + struct kvm *kvm = kvm_s2_mmu_to_kvm(mmu); + + kvm_realm_unmap_range_filter(kvm, start, size, may_block, filter); +} + /* * Unmapping vs dcache management: * @@ -1026,35 +1048,50 @@ static int kvm_init_ipa_range(struct kvm_s2_mmu *mmu, unsigned long type) * cond_resched() periodically to prevent hogging the CPU for a long time * and schedule something else, if required. */ -static void stage2_destroy_range(struct kvm_pgtable *pgt, phys_addr_t addr, - phys_addr_t end) +static void stage2_destroy_range(struct kvm_pgtable *pgt, + void (*destroy_range)(struct kvm_pgtable *pgt, + u64 addr, u64 size)) { + u64 addr = 0; + u64 end = BIT(VTCR_EL2_IPA(pgt->mmu->vtcr)); u64 next; do { next = stage2_range_addr_end(addr, end); - KVM_PGT_FN(kvm_pgtable_stage2_destroy_range)(pgt, addr, - next - addr); + destroy_range(pgt, addr, next - addr); if (next != end) cond_resched(); } while (addr = next, addr != end); } -static void kvm_stage2_destroy(struct kvm_pgtable *pgt) +static void kvm_vm_stage2_destroy(struct kvm_pgtable *pgt) { - struct kvm *kvm = kvm_s2_mmu_to_kvm(pgt->mmu); - unsigned int ia_bits = VTCR_EL2_IPA(pgt->mmu->vtcr); + stage2_destroy_range(pgt, kvm_pgtable_stage2_destroy_range); + kvm_pgtable_stage2_destroy_pgd(pgt); +} + +static void pkvm_stage2_destroy(struct kvm_pgtable *pgt) +{ + stage2_destroy_range(pgt, pkvm_pgtable_stage2_destroy_range); + pkvm_pgtable_stage2_destroy_pgd(pgt); +} +static void realm_stage2_destroy(struct kvm_pgtable *pgt) +{ /* * Realm RTTs are inaccessible to the host and may contain stale data * after the RMM has released them. The non-root RTTs are explicitly * destroyed through RMI before the RD is destroyed; only the root PGD * pages remain to be freed here. */ - if (!kvm_vm_is_realm(kvm)) - stage2_destroy_range(pgt, 0, BIT(ia_bits)); + kvm_pgtable_stage2_destroy_pgd(pgt); +} - KVM_PGT_FN(kvm_pgtable_stage2_destroy_pgd)(pgt); +static void kvm_stage2_destroy(struct kvm_pgtable *pgt) +{ + struct kvm *kvm = kvm_s2_mmu_to_kvm(pgt->mmu); + + kvm->arch.vm_s2_ops->vm_stage2_destroy(pgt); } /** @@ -3285,6 +3322,7 @@ long kvm_arch_vcpu_pre_fault_memory(struct kvm_vcpu *vcpu, } static const struct kvm_vm_s2_ops protected_pkvm_vm_s2_ops = { + .vm_stage2_destroy = pkvm_stage2_destroy, .vm_flush_remote_tlbs = pkvm_flush_remote_tlbs, .vm_flush_remote_tlbs_range = pkvm_flush_remote_tlbs_range, .vm_age_gfn = no_age_gfn, @@ -3294,6 +3332,7 @@ static const struct kvm_vm_s2_ops protected_pkvm_vm_s2_ops = { }; static const struct kvm_vm_s2_ops pkvm_vm_s2_ops = { + .vm_stage2_destroy = pkvm_stage2_destroy, .vm_flush_remote_tlbs = pkvm_flush_remote_tlbs, .vm_flush_remote_tlbs_range = pkvm_flush_remote_tlbs_range, .vm_age_gfn = pkvm_age_gfn, @@ -3303,6 +3342,7 @@ static const struct kvm_vm_s2_ops pkvm_vm_s2_ops = { }; static const struct kvm_vm_s2_ops kvm_default_vm_s2_ops = { + .vm_stage2_destroy = kvm_vm_stage2_destroy, .vm_flush_remote_tlbs = kvm_vm_flush_remote_tlbs, .vm_flush_remote_tlbs_range = kvm_vm_flush_remote_tlbs_range, .vm_age_gfn = kvm_vm_age_gfn, @@ -3311,6 +3351,16 @@ static const struct kvm_vm_s2_ops kvm_default_vm_s2_ops = { .vm_mem_abort = kvm_vm_mem_abort, }; +static const struct kvm_vm_s2_ops realm_vm_s2_ops = { + .vm_stage2_destroy = realm_stage2_destroy, + .vm_flush_remote_tlbs = realm_flush_remote_tlbs, + .vm_flush_remote_tlbs_range = realm_flush_remote_tlbs_range, + .vm_age_gfn = no_age_gfn, + .vm_test_age_gfn = no_age_gfn, + .vm_stage2_unmap_range = realm_stage2_unmap_range, + .vm_mem_abort = kvm_vm_mem_abort, +}; + #define KVM_VM_S2_OPS(flavor, ops) \ [(flavor)] = &(ops) @@ -3319,7 +3369,7 @@ static const struct kvm_vm_s2_ops *arm64_vm_s2_ops[] = { KVM_VM_S2_OPS(VM_NVHE, kvm_default_vm_s2_ops), KVM_VM_S2_OPS(VM_PKVM, pkvm_vm_s2_ops), KVM_VM_S2_OPS(VM_PROTECTED_PKVM, protected_pkvm_vm_s2_ops), - [VM_REALM] = NULL, + KVM_VM_S2_OPS(VM_REALM, realm_vm_s2_ops), }; static int kvm_vm_init_vm_s2_ops(struct kvm *kvm) -- 2.43.0