All of lore.kernel.org
 help / color / mirror / Atom feed
From: Fernando Luis Vazquez Cao <fernando_b1@lab.ntt.co.jp>
To: Paolo Bonzini <pbonzini@redhat.com>
Cc: Gleb Natapov <gleb@kernel.org>, Will Auld <will.auld@intel.com>,
	qemu-devel@nongnu.org, kvm@vger.kernel.org,
	Marcelo Tosatti <mtosatti@redhat.com>
Subject: Re: [PATCH] target-i386: clear guest TSC on reset
Date: Fri, 06 Dec 2013 00:42:44 +0900	[thread overview]
Message-ID: <52A09EF4.5080800@lab.ntt.co.jp> (raw)
In-Reply-To: <52A08541.6090702@redhat.com>

(2013/12/05 22:53), Paolo Bonzini wrote:
> Il 05/12/2013 14:15, Fernando Luis Vazquez Cao ha scritto:
>>          /*
>>           * KVM is yet unable to synchronize TSC values of multiple VCPUs on
>>           * writeback. Until this is fixed, we only write the offset to SMP
>>           * guests after migration, desynchronizing the VCPUs, but avoiding
>>           * huge jump-backs that would occur without any writeback at all.
>>           */
>> -        if (smp_cpus == 1 || env->tsc != 0) {
>> +        if (smp_cpus == 1 || env->tsc != 0 || level == KVM_PUT_RESET_STATE) {
>>              kvm_msr_entry_set(&msrs[n++], MSR_IA32_TSC, env->tsc);
>>          }
> This is still a bit ugly, and desynchronizes the VCPUs on reset.

I agree it is a bit ugly, but in my testing QEMU seemed to loop over all
the VCPUS fast enough for the kernel side kvm_write_tsc() to do a
reasonable job of matching the offsets (the Linux guest did not mark
the TSC unstable due to the TSCs being unsynchronized). Am I missing
something?


> The main point of my outlined solution is that you only have one value
> that is tracked, not one per VCPU (which in the case of migration adds
> unpredictable latencies---for example due to emptying the migration
> buffers).  We already save that value; all that's left is to use it
> instead of env->tsc.

I understand the benefits of what you are proposing but, since it is
wider is scope and it would be more difficult to backport, I would
prefer to implement it as a follow-up patch, unless you think that
the current patch as a standalone fix does more harm than good.

- Fernando

WARNING: multiple messages have this Message-ID (diff)
From: Fernando Luis Vazquez Cao <fernando_b1@lab.ntt.co.jp>
To: Paolo Bonzini <pbonzini@redhat.com>
Cc: Gleb Natapov <gleb@kernel.org>, Will Auld <will.auld@intel.com>,
	Marcelo Tosatti <mtosatti@redhat.com>,
	qemu-devel@nongnu.org, kvm@vger.kernel.org
Subject: Re: [Qemu-devel] [PATCH] target-i386: clear guest TSC on reset
Date: Fri, 06 Dec 2013 00:42:44 +0900	[thread overview]
Message-ID: <52A09EF4.5080800@lab.ntt.co.jp> (raw)
In-Reply-To: <52A08541.6090702@redhat.com>

(2013/12/05 22:53), Paolo Bonzini wrote:
> Il 05/12/2013 14:15, Fernando Luis Vazquez Cao ha scritto:
>>          /*
>>           * KVM is yet unable to synchronize TSC values of multiple VCPUs on
>>           * writeback. Until this is fixed, we only write the offset to SMP
>>           * guests after migration, desynchronizing the VCPUs, but avoiding
>>           * huge jump-backs that would occur without any writeback at all.
>>           */
>> -        if (smp_cpus == 1 || env->tsc != 0) {
>> +        if (smp_cpus == 1 || env->tsc != 0 || level == KVM_PUT_RESET_STATE) {
>>              kvm_msr_entry_set(&msrs[n++], MSR_IA32_TSC, env->tsc);
>>          }
> This is still a bit ugly, and desynchronizes the VCPUs on reset.

I agree it is a bit ugly, but in my testing QEMU seemed to loop over all
the VCPUS fast enough for the kernel side kvm_write_tsc() to do a
reasonable job of matching the offsets (the Linux guest did not mark
the TSC unstable due to the TSCs being unsynchronized). Am I missing
something?


> The main point of my outlined solution is that you only have one value
> that is tracked, not one per VCPU (which in the case of migration adds
> unpredictable latencies---for example due to emptying the migration
> buffers).  We already save that value; all that's left is to use it
> instead of env->tsc.

I understand the benefits of what you are proposing but, since it is
wider is scope and it would be more difficult to backport, I would
prefer to implement it as a follow-up patch, unless you think that
the current patch as a standalone fix does more harm than good.

- Fernando

  reply	other threads:[~2013-12-05 15:43 UTC|newest]

Thread overview: 50+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-12-03  7:08 [PATCH] kvm: clear guest TSC on reset Fernando Luis Vázquez Cao
2013-12-03  8:04 ` Fernando Luis Vázquez Cao
2013-12-05  6:08   ` Fernando Luis Vázquez Cao
2013-12-05  6:08     ` [Qemu-devel] " Fernando Luis Vázquez Cao
2013-12-05  6:15     ` [PATCH] target-i386: " Fernando Luis Vázquez Cao
2013-12-05  6:15       ` [Qemu-devel] " Fernando Luis Vázquez Cao
2013-12-05  9:28       ` Paolo Bonzini
2013-12-05  9:28         ` [Qemu-devel] " Paolo Bonzini
2013-12-05 13:15         ` Fernando Luis Vazquez Cao
2013-12-05 13:15           ` [Qemu-devel] " Fernando Luis Vazquez Cao
2013-12-05 13:53           ` Paolo Bonzini
2013-12-05 13:53             ` [Qemu-devel] " Paolo Bonzini
2013-12-05 15:42             ` Fernando Luis Vazquez Cao [this message]
2013-12-05 15:42               ` Fernando Luis Vazquez Cao
2013-12-05 16:02               ` Paolo Bonzini
2013-12-05 16:02                 ` [Qemu-devel] " Paolo Bonzini
2013-12-05 16:40                 ` Marcelo Tosatti
2013-12-05 16:40                   ` [Qemu-devel] " Marcelo Tosatti
2013-12-05 17:06                   ` Marcelo Tosatti
2013-12-05 17:06                     ` [Qemu-devel] " Marcelo Tosatti
2013-12-05 16:17               ` Marcelo Tosatti
2013-12-05 16:17                 ` [Qemu-devel] " Marcelo Tosatti
2013-12-05 16:38                 ` Paolo Bonzini
2013-12-05 16:38                   ` [Qemu-devel] " Paolo Bonzini
2013-12-06  8:24                   ` Fernando Luis Vázquez Cao
2013-12-06  8:24                     ` [Qemu-devel] " Fernando Luis Vázquez Cao
2013-12-06  8:33                     ` [PATCH 1//2 v3] " Fernando Luis Vázquez Cao
2013-12-06  8:33                       ` [Qemu-devel] " Fernando Luis Vázquez Cao
2013-12-06  8:38                       ` [PATCH 2/2] target-i386: do not special case TSC writeback Fernando Luis Vázquez Cao
2013-12-06  8:38                         ` [Qemu-devel] " Fernando Luis Vázquez Cao
2013-12-06  8:36                     ` [PATCH] target-i386: clear guest TSC on reset Paolo Bonzini
2013-12-06  8:36                       ` [Qemu-devel] " Paolo Bonzini
2013-12-06  8:56                       ` Fernando Luis Vázquez Cao
2013-12-06  8:56                         ` [Qemu-devel] " Fernando Luis Vázquez Cao
2013-12-06  9:08                         ` Paolo Bonzini
2013-12-06  9:08                           ` [Qemu-devel] " Paolo Bonzini
2013-12-06  9:20                           ` Fernando Luis Vazquez Cao
2013-12-06  9:20                             ` [Qemu-devel] " Fernando Luis Vazquez Cao
2013-12-06 14:22                     ` Marcelo Tosatti
2013-12-06 14:22                       ` [Qemu-devel] " Marcelo Tosatti
2013-12-09  8:50                       ` Fernando Luis Vázquez Cao
2013-12-09  8:50                         ` [Qemu-devel] " Fernando Luis Vázquez Cao
2013-12-12  2:52                         ` Fernando Luis Vázquez Cao
2013-12-12  2:52                           ` [Qemu-devel] " Fernando Luis Vázquez Cao
2013-12-12 12:18                           ` Paolo Bonzini
2013-12-12 12:18                             ` [Qemu-devel] " Paolo Bonzini
2013-12-05 16:12         ` Marcelo Tosatti
2013-12-05 16:12           ` [Qemu-devel] " Marcelo Tosatti
2013-12-05 16:32           ` Paolo Bonzini
2013-12-05 16:32             ` [Qemu-devel] " Paolo Bonzini

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=52A09EF4.5080800@lab.ntt.co.jp \
    --to=fernando_b1@lab.ntt.co.jp \
    --cc=gleb@kernel.org \
    --cc=kvm@vger.kernel.org \
    --cc=mtosatti@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=qemu-devel@nongnu.org \
    --cc=will.auld@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.