From: Sean Christopherson <seanjc@google.com>
To: Paolo Bonzini <pbonzini@redhat.com>
Cc: Borislav Petkov <bp@alien8.de>,
"Kernel Mailing List, Linux" <linux-kernel@vger.kernel.org>,
kvm <kvm@vger.kernel.org>,
"the arch/x86 maintainers" <x86@kernel.org>
Subject: Re: [PATCH v2 0/4] x86, fpu/kvm: fix crash with AMX
Date: Thu, 15 Jan 2026 08:39:51 -0800 [thread overview]
Message-ID: <aWkYVwTyOPxnRgzN@google.com> (raw)
In-Reply-To: <CABgObfYk-PxxGOj3az26=tt-p7_qu=eFhgdjKFqva7Stui9HYA@mail.gmail.com>
On Thu, Jan 15, 2026, Paolo Bonzini wrote:
> Il gio 15 gen 2026, 13:22 Borislav Petkov <bp@alien8.de> ha scritto:
> >
> > On Thu, Jan 01, 2026 at 10:05:12AM +0100, Paolo Bonzini wrote:
> > > Fix a possible host panic, due to an unexpected #NM, when a KVM guest
> > > is using AMX features.
> > >
> > > The guest's XFD value, which is stored in fpstate->xfd, is used for both
> > > guest execution and host XSAVE operations.
> >
> > This already sounds weird. Why?
>
> Because the state of disabled components is undefined anyway. There's
> no point in making all host XSAVEs more expensive, even when the TMM
> registers aren't in use by the guest (which is going to be most of the
> time, likely).
>
> > Why don't we carry separate XFD copies - guest and host - which we use for the
> > guest and the host, respectively?
>
> That was exactly what I did in v1, but it's more code and less efficient too.
And creates a weird ABI for KVM:
: This also creates a nasty, subtle asymmetry in KVM's ABI. Notably, the comment
: above is wrong. XSAVE does NOT run with fpstate->xfd, it runs with whatever
: happens to be in hardware. For non-guest tasks, fpstate->xfd is guaranteed to
: be resident in hardware when save_fpregs_to_fpstate() runs, but for guest tasks,
: it will usually be the _guest's_ value. So in the common case, KVM_GET_XSAVE2
: would not return the same data set by KVM_SET_XSAVE.
:
: In theory we could ensure KVM saved exactly what is resident in hardware, but
: that's quite tricky (and costly!) as it would require doing xfd_update_state()
: before _every_ save_fpregs_to_fpstate(), e.g. not just in fpu_swap_kvm_fpstate().
: E.g. if the host kernel used the FPU from IRQ context (spoiler alert!), then KVM
: wouldn't have a chance to swap in the maximal XFD[18]=0 value (i.e. the userspace
: task's XFD).
And IMO papered over the true bug, which is that the xstate snapshot can become
inconsistent relative to KVM's tracking of guest XFD:
: Lastly, the fix is effectively papering over another bug, which I'm pretty sure
: is the underlying issue that was originally encountered. Assuming QEMU doesn't
: intercept MSR_IA32_XFD for its own purposes, the only sequence I've come up with
: that would result in KVM trying to load XTILE data with XFD[18]=1, without a
: colluding userspace VMM (Paolo's selftest) is:
:
: 1. vCPU loads non-init XTILE data without ever setting XFD to a non-zero value
: (KVM only disables XFD interception on writes with a non-zero value).
: 2. Guest executes WRMSR(MSR_IA32_XFD) to set XFD[18] = 1
: 3. VM-Exit due to the WRMSR
: 4. Host IRQ arrives and triggers kernel_fpu_begin()
: 5. save_fpregs_to_fpstate() saves guest FPU with XFD[18]=0
: 6. fpu_update_guest_xfd() stuffs guest_fpu->fpstate->xfd = XFD[18]=1
: 7. vcpu_enter_guest() attempts to load XTILE data with XFD[18]=1
:
: Note! There's no KVM_SET_XSAVE2 in the above, i.e. this doesn't require userspace
: to trigger save/restore for live migration or whatever, the only timing condition
: is the arrival of an IRQ that uses kernel FPU during the XFD 0=>1 VM-Exit.
https://lore.kernel.org/all/aVMEcaZD_SzKzRvr@google.com
next prev parent reply other threads:[~2026-01-15 16:39 UTC|newest]
Thread overview: 37+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-01-01 9:05 [PATCH v2 0/4] x86, fpu/kvm: fix crash with AMX Paolo Bonzini
2026-01-01 9:05 ` [PATCH 1/4] x86/fpu: Clear XSTATE_BV[i] in save state whenever XFD[i]=1 Paolo Bonzini
2026-01-03 2:06 ` Yao Yuan
2026-01-05 17:31 ` Sean Christopherson
2026-01-06 5:25 ` Yao Yuan
2026-01-06 0:54 ` Jim Mattson
2026-01-06 1:17 ` Sean Christopherson
2026-01-06 17:56 ` Jim Mattson
2026-01-15 16:07 ` Dave Hansen
2026-01-15 16:12 ` Paolo Bonzini
2026-01-15 16:27 ` Dave Hansen
2026-01-07 0:28 ` Chang S. Bae
2026-01-07 22:33 ` Paolo Bonzini
2026-01-08 3:06 ` Binbin Wu
2026-01-08 16:26 ` Paolo Bonzini
2026-01-15 15:54 ` Dave Hansen
2026-01-15 16:22 ` Paolo Bonzini
2026-01-15 18:19 ` Dave Hansen
2026-01-15 18:26 ` Paolo Bonzini
2026-01-15 23:43 ` Chang S. Bae
2026-01-01 9:05 ` [PATCH 2/4] selftests: kvm: replace numbered sync points with actions Paolo Bonzini
2026-01-06 0:02 ` Sean Christopherson
2026-01-07 22:28 ` Paolo Bonzini
2026-01-08 20:26 ` Sean Christopherson
2026-01-01 9:05 ` [PATCH 3/4] selftests: kvm: try getting XFD and XSAVE state out of sync Paolo Bonzini
2026-01-01 9:05 ` [PATCH 4/4] selftests: kvm: Verify TILELOADD actually #NM faults when XFD[18]=1 Paolo Bonzini
2026-01-06 1:18 ` [PATCH v2 0/4] x86, fpu/kvm: fix crash with AMX Sean Christopherson
2026-01-15 12:22 ` Borislav Petkov
2026-01-15 13:49 ` Paolo Bonzini
2026-01-15 16:39 ` Sean Christopherson [this message]
2026-01-15 17:05 ` Borislav Petkov
2026-01-15 17:12 ` Sean Christopherson
2026-01-16 12:22 ` Borislav Petkov
2026-01-21 11:35 ` Paolo Bonzini
2026-01-22 11:12 ` Borislav Petkov
2026-01-22 12:00 ` Paolo Bonzini
2026-01-23 13:23 ` Borislav Petkov
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=aWkYVwTyOPxnRgzN@google.com \
--to=seanjc@google.com \
--cc=bp@alien8.de \
--cc=kvm@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=pbonzini@redhat.com \
--cc=x86@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox