From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 1ADC5C43458 for ; Thu, 9 Jul 2026 00:54:14 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:Cc:To:In-Reply-To:References :Message-Id:Content-Transfer-Encoding:Content-Type:MIME-Version:Subject:Date: From:Reply-To:Content-ID:Content-Description:Resent-Date:Resent-From: Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=uWFRDM+Io32xW+VhypJpKi1NlK0gVsSgLCMgEKdC5HI=; b=VEMKOFl4kXBR0XlfGfHxLmJxXd sJJQFJJdmSHx+MVEuLweTGduVjX2OxFSVEaPt5m4bF7WVjKeYk140c2s54Db9b7vJHg5qBidmU8pc GsQaRlrzehn1w0nn9KGH+fbtIKR4oDXqOcebCm/B4KPtOlXCdpK+8AA8u8zmUDK79O71yVMsKJeWf ywWr0pDF5MWxlIe0MVJh5JGoT4d2FjUnHE6Zs1breQG/OD+ncqi/T46yvcnbhRu4e8c45xi//ZYXw 9PePc3c2ZU0tJ7DTuu1NEhHnMgzU1F0Vm/RHIpm4jecy9NRNyKMxwCJOjEXjeCc6jhHHrtlolzx0v hVrh643Q==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.99.1 #2 (Red Hat Linux)) id 1whd1i-00000000hkd-2vch; Thu, 09 Jul 2026 00:54:06 +0000 Received: from sea.source.kernel.org ([172.234.252.31]) by bombadil.infradead.org with esmtps (Exim 4.99.1 #2 (Red Hat Linux)) id 1whd1h-00000000his-0tJh for linux-arm-kernel@lists.infradead.org; Thu, 09 Jul 2026 00:54:05 +0000 Received: from smtp.kernel.org (quasi.space.kernel.org [100.103.45.18]) by sea.source.kernel.org (Postfix) with ESMTP id DFB02403BD; Thu, 9 Jul 2026 00:54:04 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id D32F81F00A3D; Thu, 9 Jul 2026 00:54:00 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel.org; s=k20260515; t=1783558444; bh=uWFRDM+Io32xW+VhypJpKi1NlK0gVsSgLCMgEKdC5HI=; h=From:Date:Subject:References:In-Reply-To:To:Cc; b=S3NDh/V5Xt9/RD43W+lsXyz92m2CF2+oRKB7AFJWLWoFc16R1DjD/ARaUOsYMrjul dChBW2oJ/whMA7YPpDQiyx0qVEpsFp8XtxWprBpjLpq62KYS8NL9w/dcbXmY1kfMiF gaBA7RbmjVwBDzSxAdszCxXeijSGcPX87qYwoSfN+bMG34YV6Ke21fV9EHeNW7ivlD 7d5tyM802+pFrD2NaNaZdTryPnutCcUVSx9V9aXO2hL9y5QKiWt7iCzubiL2nk4Qmk LMBUIfoqIlzHPbHSuBWCNyW2Syiu4//x4ATWb4yf30H+rsSyIvWZKEnoohWcBSJWoY Z66+uRqAyM1MA== From: Mark Brown Date: Thu, 09 Jul 2026 01:51:57 +0100 Subject: [PATCH v11 20/29] KVM: arm64: Flush register state on writes to SVCR.SM and SVCR.ZA MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Message-Id: <20260709-kvm-arm64-sme-v11-20-32799f66db9d@kernel.org> References: <20260709-kvm-arm64-sme-v11-0-32799f66db9d@kernel.org> In-Reply-To: <20260709-kvm-arm64-sme-v11-0-32799f66db9d@kernel.org> To: Marc Zyngier , Joey Gouly , Catalin Marinas , Suzuki K Poulose , Will Deacon , Paolo Bonzini , Jonathan Corbet , Shuah Khan , Oliver Upton Cc: Dave Martin , Fuad Tabba , Mark Rutland , Ben Horgan , Jean-Philippe Brucker , linux-arm-kernel@lists.infradead.org, kvmarm@lists.linux.dev, linux-kernel@vger.kernel.org, kvm@vger.kernel.org, linux-doc@vger.kernel.org, linux-kselftest@vger.kernel.org, Peter Maydell , Eric Auger , Mark Brown X-Mailer: b4 0.16-dev X-Developer-Signature: v=1; a=openpgp-sha256; l=5358; i=broonie@kernel.org; h=from:subject:message-id; bh=xLxlJPLqDSuT3BzgbokMn0PxDYZwCK7AxD2XRKqXdeI=; b=owEBbQGS/pANAwAKASTWi3JdVIfQAcsmYgBqTvDJNcBkbG2LwtqGarq0uhUFOMwxTdD2OS7la ePviY/8416JATMEAAEKAB0WIQSt5miqZ1cYtZ/in+ok1otyXVSH0AUCak7wyQAKCRAk1otyXVSH 0EhBB/4kC32SypBJtbJxCrpOc1ubpH3hg0+Emum3assAbKWc9tofRD4vPMi+UwW/XzCEHYLECJD XO4eU86plO/pAmsbFFIECJgr1c35G30P5F4v8v5ydS9zkNru4QZBDTzUsBpXztNW7bH1l0MHvbR 2vt5wAFXDxsC/gDPVFL6MkZ0Btk8stnYPHU/M8TuvhVERgOEgHqvMBHNzvifhwYTDNvyXCrJNcT TqQ7W4rR7i+v24MY+D3J23HhjhQIdtisyrYQELjI5RUoaARci7im+H9ga/Aebq8p9d5Mwhsnknm hqY/xWO4Sq+E11zQcgPa7HEhTSitWjeQ9pxLpR27Hfnbu7zX X-Developer-Key: i=broonie@kernel.org; a=openpgp; fpr=3F2568AAC26998F9E813A1C5C3F436CA30F5D8EB X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Writes to the physical SVCR.SM and SVCR.ZA change the state of PSTATE.SM and PSTATE.ZA, causing other floating point state to reset. Emulate this behaviour for writes done via the KVM userspace ABI. Setting PSTATE.ZA to 1 causes ZA and ZT0 to be reset to 0, these are stored in sme_state. Setting PSTATE.ZA to 0 causes ZA and ZT0 to become inaccessible so no reset is needed. Any change in PSTATE.SM causes the V, Z, P, FFR and FPMR registers to be reset to 0 and FPSR to be reset to 0x800009f. Rather than introduce a requirement that the vector configuration be finalised before writing to SVCR we check for this before updating the SVE and SME specific state, when finalisation happens they will be allocated with an initial state of 0. Similarly in order to avoid ordering requirements between finalisation and writes to the ID registers we always allocate space for ZT0 if the hardware supports it, this is 512 bytes per vCPU. The overwhelming majority of practical systems with SME are expected to want use SME2, there is very little practical reason to disable it other than for feature testing, and the additional complexity seems more likely to lead to bugs than deliver practical benefits. Signed-off-by: Mark Brown --- arch/arm64/include/asm/kvm_host.h | 28 ++++++++++++++++++++++++++++ arch/arm64/include/asm/sysreg.h | 2 ++ arch/arm64/kvm/sys_regs.c | 30 +++++++++++++++++++++++++++++- 3 files changed, 59 insertions(+), 1 deletion(-) diff --git a/arch/arm64/include/asm/kvm_host.h b/arch/arm64/include/asm/kvm_host.h index 35339cbf23f9..b78c039cb5ec 100644 --- a/arch/arm64/include/asm/kvm_host.h +++ b/arch/arm64/include/asm/kvm_host.h @@ -1142,6 +1142,34 @@ struct kvm_vcpu_arch { #define vcpu_sve_state_size(vcpu) sve_state_size_from_vl(vcpu_sve_max_vl(vcpu)) +#define vcpu_sme_state(vcpu) (kern_hyp_va((vcpu)->arch.sme_state)) + +#define sme_state_size_from_vl(vl, sme2) ({ \ + size_t __size_ret; \ + unsigned int __vq; \ + \ + if (WARN_ON(!sve_vl_valid(vl))) { \ + __size_ret = 0; \ + } else { \ + __vq = sve_vq_from_vl(vl); \ + __size_ret = ZA_SIG_REGS_SIZE(__vq); \ + if (sme2) \ + __size_ret += ZT_SIG_REG_BYTES; \ + } \ + \ + __size_ret; \ +}) + +/* + * Always provide space for ZT0 to avoid ordering requirements with ID + * register writes and vector finalization. + */ +#define vcpu_sme_state_size(vcpu) ({ \ + unsigned long __vl; \ + __vl = (vcpu)->arch.max_vl[ARM64_VEC_SME]; \ + sme_state_size_from_vl(__vl, system_supports_sme2()); \ +}) + #define KVM_GUESTDBG_VALID_MASK (KVM_GUESTDBG_ENABLE | \ KVM_GUESTDBG_USE_SW_BP | \ KVM_GUESTDBG_USE_HW | \ diff --git a/arch/arm64/include/asm/sysreg.h b/arch/arm64/include/asm/sysreg.h index 4b96449e0ffa..b434320de1a7 100644 --- a/arch/arm64/include/asm/sysreg.h +++ b/arch/arm64/include/asm/sysreg.h @@ -1108,6 +1108,8 @@ #define gicr_insn(insn) read_sysreg_s(GICV5_OP_GICR_##insn) #define gic_insn(v, insn) write_sysreg_s(v, GICV5_OP_GIC_##insn) +#define FPSR_RESET_VALUE 0x800009f + #ifdef __ASSEMBLER__ .macro mrs_s, rt, sreg diff --git a/arch/arm64/kvm/sys_regs.c b/arch/arm64/kvm/sys_regs.c index c43cb1b8fb68..e8d3eceb0124 100644 --- a/arch/arm64/kvm/sys_regs.c +++ b/arch/arm64/kvm/sys_regs.c @@ -1015,6 +1015,34 @@ static unsigned int hidden_visibility(const struct kvm_vcpu *vcpu, return REG_HIDDEN; } +static int set_svcr(struct kvm_vcpu *vcpu, const struct sys_reg_desc *rd, + u64 val) +{ + u64 old = __vcpu_sys_reg(vcpu, rd->reg); + + if (val & SVCR_RES0) + return -EINVAL; + + if ((val & SVCR_ZA) && !(old & SVCR_ZA) && + kvm_arm_vcpu_vec_finalized(vcpu)) + memset(vcpu->arch.sme_state, 0, vcpu_sme_state_size(vcpu)); + + if ((val & SVCR_SM) != (old & SVCR_SM)) { + memset(vcpu->arch.ctxt.fp_regs.vregs, 0, + sizeof(vcpu->arch.ctxt.fp_regs.vregs)); + + if (kvm_arm_vcpu_vec_finalized(vcpu)) + memset(vcpu->arch.sve_state, 0, + vcpu_sve_state_size(vcpu)); + + __vcpu_assign_sys_reg(vcpu, FPMR, 0); + vcpu->arch.ctxt.fp_regs.fpsr = FPSR_RESET_VALUE; + } + + __vcpu_assign_sys_reg(vcpu, rd->reg, val); + return 0; +} + static unsigned int pmu_visibility(const struct kvm_vcpu *vcpu, const struct sys_reg_desc *r) { @@ -3612,7 +3640,7 @@ static const struct sys_reg_desc sys_reg_descs[] = { CTR_EL0_DminLine_MASK | CTR_EL0_L1Ip_MASK | CTR_EL0_IminLine_MASK), - { SYS_DESC(SYS_SVCR), undef_access, reset_val, SVCR, 0, .visibility = sme_visibility }, + { SYS_DESC(SYS_SVCR), undef_access, reset_val, SVCR, 0, .visibility = sme_visibility, .set_user = set_svcr }, { SYS_DESC(SYS_FPMR), undef_access, reset_val, FPMR, 0, .visibility = fp8_visibility }, { PMU_SYS_REG(PMCR_EL0), .access = access_pmcr, .reset = reset_pmcr, -- 2.47.3