From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:35803) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1WYIyU-0007bb-Fe for qemu-devel@nongnu.org; Thu, 10 Apr 2014 13:41:25 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1WYIyN-0000W3-34 for qemu-devel@nongnu.org; Thu, 10 Apr 2014 13:41:18 -0400 Received: from e06smtp11.uk.ibm.com ([195.75.94.107]:40586) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1WYIyM-0000Vl-Qp for qemu-devel@nongnu.org; Thu, 10 Apr 2014 13:41:11 -0400 Received: from /spool/local by e06smtp11.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Thu, 10 Apr 2014 18:41:09 +0100 Date: Thu, 10 Apr 2014 19:41:04 +0200 From: Michael Mueller Message-ID: <20140410194104.492ac67e@bee> In-Reply-To: <5346C0D1.7010404@ozlabs.ru> References: <1395638892-24481-1-git-send-email-aik@ozlabs.ru> <533E4050.3030705@ozlabs.ru> <533EA582.4090206@suse.de> <53421B2E.2060301@ozlabs.ru> <5342F446.6040303@suse.de> <53434F82.80703@ozlabs.ru> <20140408114716.2893645e@bee> <5343C9BA.2030806@ozlabs.ru> <20140408123252.67fc7ce3@bee> <5346C0D1.7010404@ozlabs.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Subject: Re: [Qemu-devel] [RFC PATCH] target-ppc: enable migration within the same CPU family List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Alexey Kardashevskiy Cc: qemu-devel@nongnu.org, Alexander Graf , qemu-ppc@nongnu.org, Andreas =?UTF-8?B?RsOkcmJlcg==?= , Bharata B Rao On Fri, 11 Apr 2014 02:03:29 +1000 Alexey Kardashevskiy wrote: > On 04/08/2014 08:32 PM, Michael Mueller wrote: > > On Tue, 08 Apr 2014 20:04:42 +1000 > > Alexey Kardashevskiy wrote: > >=20 > >> On 04/08/2014 07:47 PM, Michael Mueller wrote: > >>> On Tue, 08 Apr 2014 11:23:14 +1000 > >>> Alexey Kardashevskiy wrote: > >>> > >>>> On 04/08/2014 04:53 AM, Andreas F=C3=A4rber wrote: > >>>>> Am 07.04.2014 05:27, schrieb Alexey Kardashevskiy: > >>>>>> On 04/04/2014 11:28 PM, Alexander Graf wrote: > >>>>>>> On 04/04/2014 07:17 AM, Alexey Kardashevskiy wrote: > >>>>>>>> On 03/24/2014 04:28 PM, Alexey Kardashevskiy wrote: > >>>>>>>>> Currently only migration fails if CPU version is different even= a bit. > >>>>>>>>> For example, migration from POWER7 v2.0 to POWER7 v2.1 fails be= cause of > >>>>>>>>> that. Since there is no difference between CPU versions which c= ould > >>>>>>>>> affect migration stream, we can safely enable it. > >>>>>>>>> > >>>>>>>>> This adds a helper to find the closest POWERPC family class (i.= e. first > >>>>>>>>> abstract class in hierarchy). > >>>>>>>>> > >>>>>>>>> This replaces VMSTATE_UINTTL_EQUAL statement with a custom hand= ler which > >>>>>>>>> checks if the source and destination CPUs belong to the same fa= mily and > >>>>>>>>> fails if they are not. > >>>>>>>>> > >>>>>>>>> This adds a PVR reset to the default value as it will be overwr= itten > >>>>>>>>> by VMSTATE_UINTTL_ARRAY(env.spr, PowerPCCPU, 1024). > >>>>>>>>> > >>>>>>>>> Since the actual migration format is not changed by this patch, > >>>>>>>>> @version_id of vmstate_ppc_cpu does not have to be changed eith= er. > >>>>>>>>> > >>>>>>>>> Signed-off-by: Bharata B Rao > >>>>>>>>> Signed-off-by: Alexey Kardashevskiy > >>>>>>>> > >>>>>>>> Ping? > >>>>>>> > >>>>>>> Can't we just always allow migration to succeed? It's a problem o= f the tool > >>>>>>> stack above if it allows migration to an incompatible host, no? > >>>>>> > >>>>>> This is not how libvirt works. It simply sends the source XML, rec= onstructs > >>>>>> a guest on the destination side and then migrates. hoping that the > >>>>>> migration will fail is something (which only QEMU has knowledge of= ) is > >>>>>> incompatible. The new guest will start with "-cpu host" (as the so= urce) but > >>>>>> it will create diffrent CPU class and do different things. If we d= o not > >>>>>> check PVR (and cpu_dt_id and chip_id - the latter is coming soon) = and > >>>>>> migrate power8->power7, we can easily get a broken guest. > >>>>> > >>>>> The response is very simple: -cpu host is not supported for migrati= on. > >>>>> Same as for x86 hosts. > >>>> > >>>> Is there any good reason to limit ourselves on POWERPC? > >>>> > >>>>> As you say, the domain config is transferred by libvirt: > >>>>> If you use -cpu POWER7, you can migrate from POWER7 to POWER8 and b= ack; > >>>>> if you use -cpu POWER8, you can only migrate on POWER8. > >>>> > >>>> -cpu other that "host" is not supported by HV KVM, only "compat" whi= ch > >>>> upstream QEMU does not have yet. So you are saying that the migratio= n is > >>>> not supported by upstream QEMU for at least SPAPR. Well, ok, it is d= ead > >>>> anyway so I am fine :) > >>>> > >>> > >>> With s390x we have a similar situation. Thus we came up with a mechan= ism to limit > >>> the CPU functionality of a possible target system. Our patch implemen= ts CPU models > >>> based on TYPE and GA like 2817-ga1, etc. (GA represents a CPU facilit= y set and an IBC > >>> value (Instruction Blocking Control, reduces the instruction set to t= he requested > >>> level)) When a guest is started, it receives its CPU model by means o= f option -cpu. > >>> "host" equates the configuration of the current system. We implemente= d "query-cpu-model" > >>> returning the actual model, here maybe { name: "2817-ga1" }. To find = a suitable > >>> migration target in a remote CEC, libvirt has to "query-cpu-definitio= ns" returning a > >>> list of models supported by the target system "{{name: "2827-ga2"}, {= name: "2827-ga1"}, > >>> {name: "2817-ga2"},...]. A match means the system is suitable and can= be used > >>> as migration target. > >> > >> Sorry, I do not follow you. You hacked libvirt to run the destination = QEMU > >> with a specific CPU model? Or it is in QEMU? Where? What I see now is = this: > >> > >> static const VMStateDescription vmstate_s390_cpu =3D { > >> .name =3D "cpu", > >> .unmigratable =3D 1, > >> }; > >> > >> Does not look like it supports migration :) Thanks! > >> > >=20 > > The code you're missing is not upstream yet.=20 >=20 >=20 > Is it in some maillist or git (IBM internal?)? I just want to look at some > details. Thanks! I had sent out an very early version of the user space patch already: http://lists.nongnu.org/archive/html/qemu-devel/2013-10/msg00262.html It does not contain the IBC part because it wasn't legally cleared up to th= en. But as you are with IBM I think we can give you access to our internal GIT.= I have to check with Christian Borntraeger tomorrow on how we can most easily handle = it. =20 >=20 >=20 > > The s390x guest can be migrated in the meantime. > > Yes, libvirt currently gets an extension to be able to identify and sta= rtup suitable migration > > targets for s390x on behalf of the mentioned qemu cpu model. BTW can yo= u point me to the above > > mentioned SPAPR stuff... > >=20 > > Michael > >=20 >=20 >=20