From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail.zytor.com (terminus.zytor.com [198.137.202.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 7EBD9218584; Wed, 23 Jul 2025 17:54:16 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=198.137.202.136 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753293259; cv=none; b=rA0V8REuji2nWIFRrVxNd8ejOtpzBmeu/WgjTRmyzoe1joS0tQUIXtPR3deO5T6E+60DBIvBgsNASAehCDX4HxLFzWWvWxqzhDR8zYM3qxMDELFVHE0dTmWgPHJCUIthjpvidN8/D7y9QlDkJ33iBJuvHVnzq6lqxd+A2ph4/Wg= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1753293259; c=relaxed/simple; bh=yQkEfxoenUmhxgI7VLYtzPw3odwMvv56S7bLfBNUK6k=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version; b=WRWTyWTzOCsK4JSbqe/ob+ITTJLHXgZOp6+gsJ4dn/NKyxfga7KppC3wirh3phZxaAKqO719KYCOOlXHKkUmgnQSsiF3R2msTIInbsgbwzqn+WtyisFCTe+g2N2395jWmdTAJhkLmRyyDRddZAJ57MBqlHKAY4UKHOgG2E/86o4= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=zytor.com; spf=pass smtp.mailfrom=zytor.com; dkim=pass (2048-bit key) header.d=zytor.com header.i=@zytor.com header.b=V0OFeYK7; arc=none smtp.client-ip=198.137.202.136 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=zytor.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=zytor.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=zytor.com header.i=@zytor.com header.b="V0OFeYK7" Received: from terminus.zytor.com (terminus.zytor.com [IPv6:2607:7c80:54:3:0:0:0:136]) (authenticated bits=0) by mail.zytor.com (8.18.1/8.17.1) with ESMTPSA id 56NHrfxo1284522 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Wed, 23 Jul 2025 10:53:45 -0700 DKIM-Filter: OpenDKIM Filter v2.11.0 mail.zytor.com 56NHrfxo1284522 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zytor.com; s=2025072201; t=1753293226; bh=RBpu9UxYIY7sFXZkWWL+W3qlrNiXhPBrNrbgAfhMyE0=; h=From:To:Cc:Subject:Date:From; b=V0OFeYK7rzBeqaeT6RSxr6U0E9HoBELhIDDGsQv3PLdvvvcPKu0diCyLn0DLO1XG8 1JDNocrCikUD2GLkTiGuPwARrhBShMmVq3UJ4dPw16dQnTynUfb7eMFnPp7jTU1OC5 q5uSXNggajupLbn8QCowIJ2cbhZsIm8+oFsJgnP1AFh6gut5FUUY3Ak9U0jh8+i3no YxSMznelQbz5du7zSc8vE6mj5hUkuMOgf2roECdjt3Ix/24FtHwFttlPmt2maliS5O 2jiMW7jcGEql7ONK6D8oCeEvgMv6wqsuJ6M5Tn7+PXkFsCssr/QXf/LgGrgsrtLu6c lZfus7o/aQuNQ== From: "Xin Li (Intel)" To: linux-kernel@vger.kernel.org, kvm@vger.kernel.org, linux-doc@vger.kernel.org Cc: pbonzini@redhat.com, seanjc@google.com, corbet@lwn.net, tglx@linutronix.de, mingo@redhat.com, bp@alien8.de, dave.hansen@linux.intel.com, x86@kernel.org, hpa@zytor.com, xin@zytor.com, luto@kernel.org, peterz@infradead.org, andrew.cooper3@citrix.com, chao.gao@intel.com, hch@infradead.org Subject: [PATCH v5 00/23] Enable FRED with KVM VMX Date: Wed, 23 Jul 2025 10:53:18 -0700 Message-ID: <20250723175341.1284463-1-xin@zytor.com> X-Mailer: git-send-email 2.50.1 Precedence: bulk X-Mailing-List: linux-doc@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit This patch set enables the Intel flexible return and event delivery (FRED) architecture with KVM VMX to allow guests to utilize FRED. The FRED architecture defines simple new transitions that change privilege level (ring transitions). The FRED architecture was designed with the following goals: 1) Improve overall performance and response time by replacing event delivery through the interrupt descriptor table (IDT event delivery) and event return by the IRET instruction with lower latency transitions. 2) Improve software robustness by ensuring that event delivery establishes the full supervisor context and that event return establishes the full user context. The new transitions defined by the FRED architecture are FRED event delivery and, for returning from events, two FRED return instructions. FRED event delivery can effect a transition from ring 3 to ring 0, but it is used also to deliver events incident to ring 0. One FRED instruction (ERETU) effects a return from ring 0 to ring 3, while the other (ERETS) returns while remaining in ring 0. Collectively, FRED event delivery and the FRED return instructions are FRED transitions. Intel VMX architecture is extended to run FRED guests, and the major changes are: 1) New VMCS fields for FRED context management, which includes two new event data VMCS fields, eight new guest FRED context VMCS fields and eight new host FRED context VMCS fields. 2) VMX nested-exception support for proper virtualization of stack levels introduced with FRED architecture. Search for the latest FRED spec in most search engines with this search pattern: site:intel.com FRED (flexible return and event delivery) specification Following is the link to the v4 of this patch set: https://lore.kernel.org/lkml/20250328171205.2029296-1-xin@zytor.com/ Although FRED and CET supervisor shadow stacks are independent CPU features, FRED unconditionally includes FRED shadow stack pointer MSRs IA32_FRED_SSP[0123], and IA32_FRED_SSP0 is just an alias of the CET MSR IA32_PL0_SSP. IOW, the state management of MSR IA32_PL0_SSP becomes an overlap area, and Sean requested that FRED virtualization to land after CET virtualization [1]. With the native CET patches now merged into the tip tree, the KVM CET patch set is approaching maturity and is expected to be merged soon. This v5 patch set is based on the kvm-x86-next-2025.07.21 tag of the kvm-x86 repo. Note that a few changes related to IA32_PL0_SSP are still pending and are not included in this version. Changes in v5: 1) Addressed review comments/feedbacks from Chao Gao, Christoph Hellwig, Dave Hansen, and Sean. 2) Added back a patch that checks before accessing VMCS fields via SHADOW_FIELD_R[OW] macros to avoid VMREAD/VMWRITE warnings, as some fields may not be supported on all CPUs. 3) Added "Tested-by: Xuelian Guo " to all patches. [1]: https://lore.kernel.org/kvm/ZvQaNRhrsSJTYji3@google.com/ Sean Christopherson (1): KVM: VMX: Add host MSR read/write helpers to streamline preemption logic Xin Li (18): KVM: VMX: Add support for the secondary VM exit controls KVM: VMX: Initialize VM entry/exit FRED controls in vmcs_config KVM: VMX: Disable FRED if FRED consistency checks fail KVM: VMX: Initialize VMCS FRED fields KVM: VMX: Set FRED MSR intercepts KVM: VMX: Save/restore guest FRED RSP0 KVM: VMX: Add support for FRED context save/restore KVM: x86: Add a helper to detect if FRED is enabled for a vCPU KVM: VMX: Virtualize FRED event_data KVM: VMX: Virtualize FRED nested exception tracking KVM: x86: Mark CR4.FRED as not reserved KVM: VMX: Dump FRED context in dump_vmcs() KVM: x86: Advertise support for FRED KVM: nVMX: Add support for the secondary VM exit controls KVM: nVMX: Add FRED VMCS fields to nested VMX context handling KVM: nVMX: Add FRED-related VMCS field checks KVM: nVMX: Allow VMX FRED controls KVM: nVMX: Add prerequisites to SHADOW_FIELD_R[OW] macros Xin Li (Intel) (4): x86/cea: Export an API to get per CPU exception stacks for KVM to use KVM: VMX: Fix an indentation Documentation: kvm: Fix a section number typo KVM: x86: Save/restore the nested flag of an exception Documentation/virt/kvm/api.rst | 21 +- Documentation/virt/kvm/x86/nested-vmx.rst | 19 ++ arch/x86/coco/sev/sev-nmi.c | 4 +- arch/x86/coco/sev/vc-handle.c | 2 +- arch/x86/include/asm/cpu_entry_area.h | 17 +- arch/x86/include/asm/kvm_host.h | 8 +- arch/x86/include/asm/msr-index.h | 1 + arch/x86/include/asm/vmx.h | 48 +++- arch/x86/include/uapi/asm/kvm.h | 4 +- arch/x86/kernel/cpu/common.c | 10 +- arch/x86/kernel/fred.c | 6 +- arch/x86/kernel/traps.c | 2 +- arch/x86/kvm/cpuid.c | 1 + arch/x86/kvm/kvm_cache_regs.h | 15 ++ arch/x86/kvm/svm/svm.c | 2 +- arch/x86/kvm/vmx/capabilities.h | 25 +- arch/x86/kvm/vmx/nested.c | 271 +++++++++++++++++++--- arch/x86/kvm/vmx/nested.h | 22 ++ arch/x86/kvm/vmx/vmcs.h | 1 + arch/x86/kvm/vmx/vmcs12.c | 19 ++ arch/x86/kvm/vmx/vmcs12.h | 38 +++ arch/x86/kvm/vmx/vmcs_shadow_fields.h | 37 ++- arch/x86/kvm/vmx/vmx.c | 263 +++++++++++++++++++-- arch/x86/kvm/vmx/vmx.h | 13 +- arch/x86/kvm/x86.c | 88 ++++++- arch/x86/kvm/x86.h | 8 +- arch/x86/mm/cpu_entry_area.c | 21 ++ arch/x86/mm/fault.c | 2 +- include/uapi/linux/kvm.h | 1 + 29 files changed, 872 insertions(+), 97 deletions(-) base-commit: 33f843444e28920d6e624c6c24637b4bb5d3c8de -- 2.50.1