From: Paolo Bonzini <pbonzini@redhat.com>
To: Gleb Natapov <gleb@redhat.com>
Cc: qemu-devel@nongnu.org, ehabkost@redhat.com, kvm@vger.kernel.org
Subject: Re: [PATCH uq/master 1/2] x86: fix migration from pre-version 12
Date: Mon, 09 Sep 2013 11:53:45 +0200 [thread overview]
Message-ID: <522D9AA9.6060303@redhat.com> (raw)
In-Reply-To: <20130909090315.GM17294@redhat.com>
Il 09/09/2013 11:03, Gleb Natapov ha scritto:
> On Mon, Sep 09, 2013 at 10:31:15AM +0200, Paolo Bonzini wrote:
>> Il 08/09/2013 13:40, Gleb Natapov ha scritto:
>>> On Thu, Sep 05, 2013 at 03:06:21PM +0200, Paolo Bonzini wrote:
>>>> On KVM, the KVM_SET_XSAVE would be executed with a 0 xstate_bv,
>>>> and not restore anything.
>>>>
>>> XRSTOR restores FP/SSE state to reset state if no bits are set in
>>> xstate_bv. This is what should happen on reset, no?
>>
>> Yes. The problem happens on the migration destination when XSAVE data is
>> not transmitted. FP/SSE data is transmitted and must be restored, but
>> xstate_bv is zero and KVM_SET_XSAVE restores FP/SSE state to reset
>> state. The vcpu then loses the values that were set in the migration data.
>>
>>>> Since FP and SSE data are always valid, set them in xstate_bv at reset
>>>> time. In fact, that value is the same that KVM_GET_XSAVE returns on
>>>> pre-XSAVE hosts.
>>> It is needed for migration between non xsave host to xsave host.
>>
>> Yes, and this patch does the same for migration between non-XSAVE QEMU
>> and XSAVE QEMU.
>>
> Can such migration happen? The commit that added xsave support
> (f1665b21f16c5dc0ac37de60233a4975aff31193) changed vmstate version id.
Yes, old->new migration can happen. New->old of course cannot.
>> In fact, another bug is that kvm_vcpu_ioctl_x86_set_xsave ignores
>> xstate_bv when XSAVE is not available. Instead, it should reset the
>> FXSAVE data to processor-reset values (except for MXCSR which always
>> comes from XRSTOR data), i.e. to all-zeros except for the x87 control
>> and tag words. It should also check reserved bits of MXCSR.
>
> I do not see why.
Because otherwise it behaves in a subtly different manner for XSAVE and
non-XSAVE hosts.
>> Yes. QEMU unmarshals information from the XSAVE region and back, so it
>> cannot support MPX or AVX-512 yet (even if KVM were). Separate bug, though.
>>
> IMO this is the main issue here, not separate bug. If we gonna let guest
> use CPU state QEMU does not support we gonna have a bad time.
We cannot force the guest not to use a feature; all we can do is hide
the CPUID bits so that a well-behaved guest will not use it. QEMU does
hide CPUID bits for non-supported XSAVE states, except for "-cpu host".
So this will not be a problem except with "-cpu host".
Paolo
WARNING: multiple messages have this Message-ID (diff)
From: Paolo Bonzini <pbonzini@redhat.com>
To: Gleb Natapov <gleb@redhat.com>
Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org, ehabkost@redhat.com
Subject: Re: [Qemu-devel] [PATCH uq/master 1/2] x86: fix migration from pre-version 12
Date: Mon, 09 Sep 2013 11:53:45 +0200 [thread overview]
Message-ID: <522D9AA9.6060303@redhat.com> (raw)
In-Reply-To: <20130909090315.GM17294@redhat.com>
Il 09/09/2013 11:03, Gleb Natapov ha scritto:
> On Mon, Sep 09, 2013 at 10:31:15AM +0200, Paolo Bonzini wrote:
>> Il 08/09/2013 13:40, Gleb Natapov ha scritto:
>>> On Thu, Sep 05, 2013 at 03:06:21PM +0200, Paolo Bonzini wrote:
>>>> On KVM, the KVM_SET_XSAVE would be executed with a 0 xstate_bv,
>>>> and not restore anything.
>>>>
>>> XRSTOR restores FP/SSE state to reset state if no bits are set in
>>> xstate_bv. This is what should happen on reset, no?
>>
>> Yes. The problem happens on the migration destination when XSAVE data is
>> not transmitted. FP/SSE data is transmitted and must be restored, but
>> xstate_bv is zero and KVM_SET_XSAVE restores FP/SSE state to reset
>> state. The vcpu then loses the values that were set in the migration data.
>>
>>>> Since FP and SSE data are always valid, set them in xstate_bv at reset
>>>> time. In fact, that value is the same that KVM_GET_XSAVE returns on
>>>> pre-XSAVE hosts.
>>> It is needed for migration between non xsave host to xsave host.
>>
>> Yes, and this patch does the same for migration between non-XSAVE QEMU
>> and XSAVE QEMU.
>>
> Can such migration happen? The commit that added xsave support
> (f1665b21f16c5dc0ac37de60233a4975aff31193) changed vmstate version id.
Yes, old->new migration can happen. New->old of course cannot.
>> In fact, another bug is that kvm_vcpu_ioctl_x86_set_xsave ignores
>> xstate_bv when XSAVE is not available. Instead, it should reset the
>> FXSAVE data to processor-reset values (except for MXCSR which always
>> comes from XRSTOR data), i.e. to all-zeros except for the x87 control
>> and tag words. It should also check reserved bits of MXCSR.
>
> I do not see why.
Because otherwise it behaves in a subtly different manner for XSAVE and
non-XSAVE hosts.
>> Yes. QEMU unmarshals information from the XSAVE region and back, so it
>> cannot support MPX or AVX-512 yet (even if KVM were). Separate bug, though.
>>
> IMO this is the main issue here, not separate bug. If we gonna let guest
> use CPU state QEMU does not support we gonna have a bad time.
We cannot force the guest not to use a feature; all we can do is hide
the CPUID bits so that a well-behaved guest will not use it. QEMU does
hide CPUID bits for non-supported XSAVE states, except for "-cpu host".
So this will not be a problem except with "-cpu host".
Paolo
next prev parent reply other threads:[~2013-09-09 9:53 UTC|newest]
Thread overview: 38+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-09-05 13:06 [PATCH uq/master 0/2] KVM: issues with XSAVE support Paolo Bonzini
2013-09-05 13:06 ` [Qemu-devel] " Paolo Bonzini
2013-09-05 13:06 ` [PATCH uq/master 1/2] x86: fix migration from pre-version 12 Paolo Bonzini
2013-09-05 13:06 ` [Qemu-devel] " Paolo Bonzini
2013-09-08 11:40 ` Gleb Natapov
2013-09-08 11:40 ` [Qemu-devel] " Gleb Natapov
2013-09-09 8:31 ` Paolo Bonzini
2013-09-09 8:31 ` [Qemu-devel] " Paolo Bonzini
2013-09-09 9:03 ` Gleb Natapov
2013-09-09 9:03 ` [Qemu-devel] " Gleb Natapov
2013-09-09 9:53 ` Paolo Bonzini [this message]
2013-09-09 9:53 ` Paolo Bonzini
2013-09-09 10:54 ` Gleb Natapov
2013-09-09 10:54 ` [Qemu-devel] " Gleb Natapov
2013-09-09 10:58 ` Gleb Natapov
2013-09-09 10:58 ` [Qemu-devel] " Gleb Natapov
2013-09-09 11:07 ` Paolo Bonzini
2013-09-09 11:07 ` [Qemu-devel] " Paolo Bonzini
2013-09-09 11:28 ` Gleb Natapov
2013-09-09 11:28 ` [Qemu-devel] " Gleb Natapov
2013-09-09 11:46 ` Paolo Bonzini
2013-09-09 11:46 ` [Qemu-devel] " Paolo Bonzini
2013-09-09 12:00 ` Gleb Natapov
2013-09-09 12:00 ` [Qemu-devel] " Gleb Natapov
2013-09-05 13:06 ` [PATCH uq/master 2/2] KVM: make XSAVE support more robust Paolo Bonzini
2013-09-05 13:06 ` [Qemu-devel] " Paolo Bonzini
2013-09-08 11:52 ` Gleb Natapov
2013-09-08 11:52 ` [Qemu-devel] " Gleb Natapov
2013-09-09 8:51 ` Paolo Bonzini
2013-09-09 8:51 ` [Qemu-devel] " Paolo Bonzini
2013-09-09 9:18 ` Gleb Natapov
2013-09-09 9:18 ` [Qemu-devel] " Gleb Natapov
2013-09-09 9:50 ` Paolo Bonzini
2013-09-09 9:50 ` [Qemu-devel] " Paolo Bonzini
2013-09-09 10:41 ` Gleb Natapov
2013-09-09 10:41 ` [Qemu-devel] " Gleb Natapov
2013-09-09 12:00 ` Paolo Bonzini
2013-09-09 12:00 ` [Qemu-devel] " Paolo Bonzini
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=522D9AA9.6060303@redhat.com \
--to=pbonzini@redhat.com \
--cc=ehabkost@redhat.com \
--cc=gleb@redhat.com \
--cc=kvm@vger.kernel.org \
--cc=qemu-devel@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.