From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 28E96C44529 for ; Mon, 20 Jul 2026 18:13:49 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:Content-Type:Cc:To:From: Subject:Message-ID:References:Mime-Version:In-Reply-To:Date:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=Fw4ZA8x5ACkBJ3sYI9cji8pSsNwuL7QiGGeoCyBIeSs=; b=TMVxuMS2pJNZBM6VhozSiuF5x7 mL/eN0qbri9m+IiBXB8myahSGpPHU9zD2jqjIvvdx8Rim5Hu7Ma8PGYKJdjG3dbG2PCttio9AOpVq DliD14y9xeA1VJv1RPoTPYkN7Gn3/AojV3put/ptenZ6uIJIXrJSrz4M/KSJdp8ZWXgbsGE1BjEiT n7fTdqlhLNfpdp4tU8WRHuOABGzojeA89pW3H+1phmofbanMKu+Drv5/gjg/WaHomCNIwQ33S9aUe JU9lzCzGti7A6BQzb/+dLSZENHOFQ3/ne7MtXIV4syZo++sdwd5Fqw0V/YFNyz49SrtakA/icGXMP LJZCST4w==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.99.1 #2 (Red Hat Linux)) id 1wlrad-00000007UxJ-2APT; Mon, 20 Jul 2026 17:15:39 +0000 Received: from mail-ej1-x647.google.com ([2a00:1450:4864:20::647]) by bombadil.infradead.org with esmtps (Exim 4.99.1 #2 (Red Hat Linux)) id 1wlraW-00000007UoD-34Mc for linux-arm-kernel@lists.infradead.org; Mon, 20 Jul 2026 17:15:34 +0000 Received: by mail-ej1-x647.google.com with SMTP id a640c23a62f3a-c15c32294e1so1164957166b.3 for ; Mon, 20 Jul 2026 10:15:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20251104; t=1784567730; x=1785172530; darn=lists.infradead.org; h=content-type:cc:to:from:subject:message-id:references:mime-version :in-reply-to:date:from:to:cc:subject:date:message-id:reply-to :content-type; bh=Fw4ZA8x5ACkBJ3sYI9cji8pSsNwuL7QiGGeoCyBIeSs=; b=qqh4lMVNXaFhQL1/CX5KXxjc5iRJ6oOqeCJvDGZOCHkVV0P7mn6oBhO6kWQfjOid3C yo9qbb+yQC715cKz64gyV682bl9eb/TiWlJ9YbqMQLPht5Lgw7JB1XUiy7NseGxKVOA3 qx3AUsUt/VeMHdF3I8Zs49iwxlqDWl5JX+AyYNcesloCZVbWSP6glw7GSuVZvfWHS3u5 LF5XoGT7oPLk79HOlbIrC7+negl4/MgS0X+lWJRB323o83z0c4ENXOhC/GtobegCWaPb CFTAv7xZm7kh5c5560ZYA5/KWeUCT2t+jQZvjN5/nlUgGM2gRDNKEEkFi7ASLuPyM+VI W9fA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1784567730; x=1785172530; h=content-type:cc:to:from:subject:message-id:references:mime-version :in-reply-to:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to:content-type; bh=Fw4ZA8x5ACkBJ3sYI9cji8pSsNwuL7QiGGeoCyBIeSs=; b=gHaYEotJ6HytfERcEc9RPxuaxL6q0o2/vEAOIfrTbXari4SGAFEmv4WKpZ8cv0Rtmk txxE0Q+fod5Fzn8PD9Neg5Jhztvh8Elw0I4pTFC7BB+e3TyQW0neuVQPI+wVU469xhjn FMp+e60vwdNfz4LHBizY3u5DEKHFA6XzyExD/Q9j9msAwto963wKJ2gPYNZy4OzpfvRR Mi4tVgmUdiaxhn6S+uUF56IICvKUjQnnGe8XhZ0lZqbAzfmYxBMSy3qPdxxlR+1AUVEz GOlRUodfw6DYqMmrCzv8iSFQQuryWPO8mVo1S1L2GkTgsQBn/DWAkNeSDxECWkv26gne CdUA== X-Forwarded-Encrypted: i=1; AHgh+RqT6SZlo5y11UF4nwPL7h8o+mM0WpazOAudeOylDh+kuIqyX7IUM3kTaDh4fRoif30wYNb6EhqKddWaC+vleKLo@lists.infradead.org X-Gm-Message-State: AOJu0YwlRuXQqQc6x2jZ9iofIcbaXZMDlpIBQIm8ckJmRoccsSqxWbeg gWs/9rdjfhKDwZKq6BymJ4AHp2TKYOum1J1NcmfhwUEqybdg3mB9I8rH49FYNIxlX/2YvQTWBLt dWtyjQMb78h7ppbGW7cIeCQ== X-Received: from ejbkh13.prod.google.com ([2002:a17:906:f80d:b0:c15:c6f3:51d5]) (user=vdonnefort job=prod-delivery.src-stubby-dispatcher) by 2002:a17:907:e84a:b0:c16:e3b:7d6 with SMTP id a640c23a62f3a-c16b4807dfbmr599793166b.54.1784567729511; Mon, 20 Jul 2026 10:15:29 -0700 (PDT) Date: Mon, 20 Jul 2026 18:15:05 +0100 In-Reply-To: <20260720171513.1415357-1-vdonnefort@google.com> Mime-Version: 1.0 References: <20260720171513.1415357-1-vdonnefort@google.com> X-Mailer: git-send-email 2.55.0.229.g6434b31f56-goog Message-ID: <20260720171513.1415357-10-vdonnefort@google.com> Subject: [PATCH v3 09/17] KVM: arm64: Add selftests for the pKVM heap allocator From: Vincent Donnefort To: maz@kernel.org, oupton@kernel.org, kvmarm@lists.linux.dev, linux-arm-kernel@lists.infradead.org Cc: joey.gouly@arm.com, seiden@linux.ibm.com, suzuki.poulose@arm.com, yuzenghui@huawei.com, catalin.marinas@arm.com, will@kernel.org, kernel-team@android.com, tabba@google.com, qperret@google.com, Vincent Donnefort , Fuad Tabba Content-Type: text/plain; charset="UTF-8" X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.9.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20260720_101532_830977_AA9E417D X-CRM114-Status: GOOD ( 16.76 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Introduce a comprehensive runtime selftest for the pKVM hypervisor heap allocator, executed during init when CONFIG_NVHE_EL2_DEBUG is enabled. The selftest runs entirely at EL2 and exercises allocator's core mechanisms: * over-sized allocations * basic allocation and alignment * chunk recycling, splitting, merging * memory reclaiming * memory topup Signed-off-by: Vincent Donnefort Reviewed-by: Fuad Tabba diff --git a/arch/arm64/include/asm/kvm_asm.h b/arch/arm64/include/asm/kvm_asm.h index 0c3126179704..08466f608d1f 100644 --- a/arch/arm64/include/asm/kvm_asm.h +++ b/arch/arm64/include/asm/kvm_asm.h @@ -92,6 +92,7 @@ enum __kvm_host_smccc_func { __KVM_HOST_SMCCC_FUNC___pkvm_hyp_topup, __KVM_HOST_SMCCC_FUNC___pkvm_hyp_reclaim, __KVM_HOST_SMCCC_FUNC___pkvm_hyp_reclaimable, + __KVM_HOST_SMCCC_FUNC___pkvm_hyp_alloc_selftest, MARKER(__KVM_HOST_SMCCC_FUNC_PKVM_ONLY), diff --git a/arch/arm64/include/asm/kvm_pkvm.h b/arch/arm64/include/asm/kvm_pkvm.h index 99daa985856f..73c8881e14ec 100644 --- a/arch/arm64/include/asm/kvm_pkvm.h +++ b/arch/arm64/include/asm/kvm_pkvm.h @@ -19,8 +19,10 @@ enum pkvm_topup_id { PKVM_TOPUP_HYP_ALLOC, + PKVM_TOPUP_HYP_ALLOC_SELFTEST, }; +void pkvm_selftests(void); int pkvm_init_host_vm(struct kvm *kvm, unsigned long type); int pkvm_create_hyp_vm(struct kvm *kvm); bool pkvm_hyp_vm_is_created(struct kvm *kvm); @@ -206,6 +208,7 @@ struct pkvm_mapping { enum pkvm_hyp_req_type { PKVM_HYP_NO_REQ = 0, PKVM_HYP_REQ_HYP_ALLOC, + PKVM_HYP_REQ_HYP_ALLOC_SELFTEST, __PKVM_HYP_REQ_TYPE_MAX, }; @@ -233,6 +236,7 @@ static inline size_t pkvm_hyp_req_arg_size(u8 type) case PKVM_HYP_NO_REQ: return 0; case PKVM_HYP_REQ_HYP_ALLOC: + case PKVM_HYP_REQ_HYP_ALLOC_SELFTEST: return sizeof(req->mem); default: WARN_ON(1); diff --git a/arch/arm64/kvm/arm.c b/arch/arm64/kvm/arm.c index 50adfff75be8..750862705a70 100644 --- a/arch/arm64/kvm/arm.c +++ b/arch/arm64/kvm/arm.c @@ -2883,6 +2883,8 @@ static int __init init_hyp_mode(void) kvm_err("Failed to init hyp memory protection\n"); goto out_err; } + + pkvm_selftests(); } return 0; diff --git a/arch/arm64/kvm/hyp/include/nvhe/alloc.h b/arch/arm64/kvm/hyp/include/nvhe/alloc.h index 8f87a63f8946..329250dad6f6 100644 --- a/arch/arm64/kvm/hyp/include/nvhe/alloc.h +++ b/arch/arm64/kvm/hyp/include/nvhe/alloc.h @@ -14,4 +14,11 @@ int hyp_alloc_init(size_t size); int hyp_alloc_topup(struct kvm_hyp_memcache *host_mc); unsigned long hyp_alloc_reclaimable(void); void hyp_alloc_reclaim(struct kvm_hyp_memcache *host_mc, unsigned long target); + +#ifdef CONFIG_NVHE_EL2_DEBUG +int hyp_allocator_selftest(void); +u32 hyp_alloc_selftest_topup_needed(void); +int hyp_alloc_selftest_topup(struct kvm_hyp_memcache *host_mc); +void hyp_alloc_selftest_reclaim(struct kvm_hyp_memcache *host_mc, unsigned long target); +#endif #endif diff --git a/arch/arm64/kvm/hyp/nvhe/alloc.c b/arch/arm64/kvm/hyp/nvhe/alloc.c index 32c923d83f78..49d7560ad150 100644 --- a/arch/arm64/kvm/hyp/nvhe/alloc.c +++ b/arch/arm64/kvm/hyp/nvhe/alloc.c @@ -1013,9 +1013,17 @@ int hyp_alloc_errno(void) return hyp_allocator_errno(&hyp_allocator); } +static int selftest_init(void); + int hyp_alloc_init(size_t size) { - return hyp_allocator_init(&hyp_allocator, size); + int ret; + + ret = hyp_allocator_init(&hyp_allocator, size); + if (ret) + return ret; + + return selftest_init(); } void hyp_alloc_reclaim(struct kvm_hyp_memcache *mc, unsigned long target) @@ -1037,3 +1045,179 @@ u32 hyp_alloc_topup_needed(void) { return hyp_allocator_topup_needed(&hyp_allocator); } + +#ifdef CONFIG_NVHE_EL2_DEBUG +#define SELFTEST_MAX_PAGES 6 +#define SELFTEST_MAX_SIZE (PAGE_SIZE * SELFTEST_MAX_PAGES) + +static DEFINE_PER_CPU(int, __selftest_errno); +static DEFINE_PER_CPU(u32, __selftest_topup_needed); + +static struct hyp_allocator selftest_allocator = { + .errno = &__selftest_errno, + .topup_needed = &__selftest_topup_needed, + .lock = __HYP_SPIN_LOCK_UNLOCKED, +}; + +int hyp_alloc_selftest_topup(struct kvm_hyp_memcache *host_mc) +{ + return hyp_allocator_topup(&selftest_allocator, host_mc); +} + +void hyp_alloc_selftest_reclaim(struct kvm_hyp_memcache *host_mc, unsigned long target) +{ + hyp_allocator_reclaim(&selftest_allocator, host_mc, target); +} + +u32 hyp_alloc_selftest_topup_needed(void) +{ + return hyp_allocator_topup_needed(&selftest_allocator); +} + +static int selftest_init(void) +{ + return hyp_allocator_init(&selftest_allocator, SELFTEST_MAX_SIZE); +} + +static void *selftest_alloc(size_t size) +{ + return hyp_allocator_alloc(&selftest_allocator, size); +} + +static void selftest_free(void *addr) +{ + hyp_allocator_free(&selftest_allocator, addr); +} + +static int selftest_errno(void) +{ + return hyp_allocator_errno(&selftest_allocator); +} + +int hyp_allocator_selftest(void) +{ + struct hyp_allocator *allocator = &selftest_allocator; + static DEFINE_HYP_SPINLOCK(selftest_lock); + struct kvm_hyp_memcache host_mc = { }; + void *addr1, *addr2, *addr3, *addr4; + int ret; + + guard(hyp_spinlock)(&selftest_lock); + + if (allocator->mc.nr_pages < SELFTEST_MAX_PAGES) { + *this_cpu_ptr(allocator->topup_needed) = SELFTEST_MAX_PAGES - + allocator->mc.nr_pages; + return -ENOMEM; + } + + selftest_alloc(SELFTEST_MAX_SIZE); + if (selftest_errno() != -E2BIG) + return -EINVAL; + + selftest_alloc(SIZE_MAX); + if (selftest_errno() != -E2BIG) + return -EINVAL; + + /* Test first chunk */ + addr1 = selftest_alloc(0); + if (!addr1 || addr1 != (void *)allocator->start + chunk_hdr_size()) + return -EINVAL; + + /* Test second contiguous chunk with unaligned size */ + addr2 = selftest_alloc(MIN_ALLOC_SIZE + 1); + if (!addr2) + return -EINVAL; + addr3 = selftest_alloc(0); + if (!addr3 || + addr3 != addr2 + (2 * MIN_ALLOC_SIZE) + chunk_hdr_size()) + return -EINVAL; + + selftest_free(addr3); + + /* Test chunk recycling */ + selftest_free(addr1); + if (addr1 != selftest_alloc(0)) + return -EINVAL; + + /* Test chunk forward merging */ + addr3 = selftest_alloc(0); + selftest_free(addr2); + selftest_free(addr1); + if (addr1 != selftest_alloc(MIN_ALLOC_SIZE * 2)) + return -EINVAL; + + selftest_free(addr1); + + /* Test chunk splitting */ + if (addr1 != selftest_alloc(0)) + return -EINVAL; + if (addr2 != selftest_alloc(0)) + return -EINVAL; + + /* Test chunk backward merging */ + selftest_free(addr1); + selftest_free(addr2); + if (addr1 != selftest_alloc(MIN_ALLOC_SIZE * 2)) + return -EINVAL; + + selftest_free(addr1); + + /* Test chunk 3-way merging */ + addr1 = selftest_alloc(0); + addr2 = selftest_alloc(0); + addr4 = selftest_alloc(0); + selftest_free(addr1); + selftest_free(addr3); + selftest_free(addr2); + if (addr1 != selftest_alloc(MIN_ALLOC_SIZE * 3)) + return -EINVAL; + + selftest_free(addr4); + selftest_free(addr1); + + /* Test reclaiming */ + if (addr1 != selftest_alloc(0)) + return -EINVAL; + if (addr2 != selftest_alloc(PAGE_SIZE * 2)) + return -EINVAL; + addr3 = selftest_alloc(0); + addr4 = selftest_alloc(PAGE_SIZE); + + /* Test reclaiming the last chunk of the list */ + selftest_free(addr4); + hyp_allocator_reclaim(allocator, &host_mc, SELFTEST_MAX_PAGES); + if (host_mc.nr_pages != SELFTEST_MAX_PAGES - 3) + return -EINVAL; + + /* Test punching a hole in the middle of a free chunk ... */ + selftest_free(addr2); + hyp_allocator_reclaim(allocator, &host_mc, SELFTEST_MAX_PAGES); + if (host_mc.nr_pages != SELFTEST_MAX_PAGES - 2) + return -EINVAL; + + if (selftest_alloc(PAGE_SIZE)) + return -EINVAL; + if (selftest_errno() != -ENOMEM) + return -EINVAL; + + /* ... and to refill this hole */ + ret = hyp_allocator_topup(allocator, &host_mc); + if (ret) + return ret; + /* Chunk at addr2 was made smaller by the reclaim */ + if (addr2 != selftest_alloc(PAGE_SIZE)) + return -EINVAL; + + /* Test reclaiming the entire allocator from the host */ + selftest_free(addr3); + selftest_free(addr2); + selftest_free(addr1); + if (addr1 != selftest_alloc(SELFTEST_MAX_PAGES * PAGE_SIZE - chunk_hdr_size())) + return -EINVAL; + selftest_free(addr1); + + return 0; +} +#else +static int selftest_init(void) { return 0; } +#endif diff --git a/arch/arm64/kvm/hyp/nvhe/hyp-main.c b/arch/arm64/kvm/hyp/nvhe/hyp-main.c index 346365e76ef2..d99c9b1b0c82 100644 --- a/arch/arm64/kvm/hyp/nvhe/hyp-main.c +++ b/arch/arm64/kvm/hyp/nvhe/hyp-main.c @@ -633,6 +633,28 @@ static void handle___pkvm_finalize_teardown_vm(struct kvm_cpu_context *host_ctxt cpu_reg(host_ctxt, 1) = __pkvm_finalize_teardown_vm(handle); } +#ifdef CONFIG_NVHE_EL2_DEBUG +static void handle___pkvm_hyp_alloc_selftest(struct kvm_cpu_context *host_ctxt) +{ + struct pkvm_hyp_req req = { .type = PKVM_HYP_NO_REQ }; + int ret; + + ret = hyp_allocator_selftest(); + if (ret == -ENOMEM) { + req.type = PKVM_HYP_REQ_HYP_ALLOC_SELFTEST; + req.mem.nr_pages = hyp_alloc_selftest_topup_needed(); + } + + cpu_reg(host_ctxt, 1) = ret; + pkvm_hyp_req_to_smccc(host_ctxt, &req); +} +#else +static void handle___pkvm_hyp_alloc_selftest(struct kvm_cpu_context *host_ctxt) +{ + cpu_reg(host_ctxt, 1) = -EPERM; +} +#endif + static void handle___pkvm_hyp_topup(struct kvm_cpu_context *host_ctxt) { DECLARE_REG(enum pkvm_topup_id, id, host_ctxt, 1); @@ -648,6 +670,11 @@ static void handle___pkvm_hyp_topup(struct kvm_cpu_context *host_ctxt) case PKVM_TOPUP_HYP_ALLOC: ret = hyp_alloc_topup(&host_mc); break; +#ifdef CONFIG_NVHE_EL2_DEBUG + case PKVM_TOPUP_HYP_ALLOC_SELFTEST: + ret = hyp_alloc_selftest_topup(&host_mc); + break; +#endif default: ret = -EINVAL; } @@ -668,6 +695,11 @@ static void handle___pkvm_hyp_reclaim(struct kvm_cpu_context *host_ctxt) case PKVM_TOPUP_HYP_ALLOC: hyp_alloc_reclaim(&host_mc, target); break; +#ifdef CONFIG_NVHE_EL2_DEBUG + case PKVM_TOPUP_HYP_ALLOC_SELFTEST: + hyp_alloc_selftest_reclaim(&host_mc, target); + break; +#endif default: ret = -EINVAL; } @@ -804,6 +836,7 @@ static const hcall_t host_hcall[] = { HANDLE_FUNC(__pkvm_hyp_topup), HANDLE_FUNC(__pkvm_hyp_reclaim), HANDLE_FUNC(__pkvm_hyp_reclaimable), + HANDLE_FUNC(__pkvm_hyp_alloc_selftest), HANDLE_FUNC(__pkvm_host_share_hyp), HANDLE_FUNC(__pkvm_host_unshare_hyp), diff --git a/arch/arm64/kvm/pkvm.c b/arch/arm64/kvm/pkvm.c index a82e773a1c2d..d28422f5c3d6 100644 --- a/arch/arm64/kvm/pkvm.c +++ b/arch/arm64/kvm/pkvm.c @@ -326,6 +326,22 @@ static int __init pkvm_drop_host_privileges(void) return ret; } +void __init pkvm_selftests(void) +{ +#ifdef CONFIG_NVHE_EL2_DEBUG + int ret = pkvm_call_hyp_req(__pkvm_hyp_alloc_selftest); + unsigned long reclaimed; + + reclaimed = pkvm_hyp_reclaim(PKVM_TOPUP_HYP_ALLOC_SELFTEST, ULONG_MAX); + + /* On failure, not all the pages may be reclaimable */ + if (!ret) + WARN_ON(reclaimed != 6 /* SELFTEST_MAX_PAGES */); + else + kvm_err("pKVM hyp allocator selftest failed (%d)\n", ret); +#endif +} + static int __init finalize_pkvm(void) { int ret; @@ -652,6 +668,9 @@ static int pkvm_handle_hyp_req(struct pkvm_hyp_req *req) case PKVM_HYP_REQ_HYP_ALLOC: ret = pkvm_hyp_topup(PKVM_TOPUP_HYP_ALLOC, req->mem.nr_pages); break; + case PKVM_HYP_REQ_HYP_ALLOC_SELFTEST: + ret = pkvm_hyp_topup(PKVM_TOPUP_HYP_ALLOC_SELFTEST, req->mem.nr_pages); + break; } trace_kvm_handle_pkvm_hyp_req(req, ret); -- 2.55.0.229.g6434b31f56-goog