From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ryan Harper Subject: Re: Live migration of x86-64 kvm guests broken? Date: Wed, 2 Dec 2009 12:35:33 -0600 Message-ID: <20091202183533.GT27346@us.ibm.com> References: <4B1686AB.4020206@siemens.com> <20091202164408.GQ27346@us.ibm.com> <4B16AC68.2090304@siemens.com> <20091202181028.GS27346@us.ibm.com> <4B16AF11.1010703@siemens.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: Ryan Harper , qemu-devel , kvm , Juan Quintela , Pierre Riteau , Liran Schour To: Jan Kiszka Return-path: Received: from e36.co.us.ibm.com ([32.97.110.154]:58981 "EHLO e36.co.us.ibm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752839AbZLBSfs (ORCPT ); Wed, 2 Dec 2009 13:35:48 -0500 Received: from d03relay01.boulder.ibm.com (d03relay01.boulder.ibm.com [9.17.195.226]) by e36.co.us.ibm.com (8.14.3/8.13.1) with ESMTP id nB2IXWt9012201 for ; Wed, 2 Dec 2009 11:33:32 -0700 Received: from d03av04.boulder.ibm.com (d03av04.boulder.ibm.com [9.17.195.170]) by d03relay01.boulder.ibm.com (8.13.8/8.13.8/NCO v10.0) with ESMTP id nB2IZcwk181060 for ; Wed, 2 Dec 2009 11:35:41 -0700 Received: from d03av04.boulder.ibm.com (loopback [127.0.0.1]) by d03av04.boulder.ibm.com (8.14.3/8.13.1/NCO v10.0 AVout) with ESMTP id nB2CQOEg015255 for ; Wed, 2 Dec 2009 05:26:25 -0700 Content-Disposition: inline In-Reply-To: <4B16AF11.1010703@siemens.com> Sender: kvm-owner@vger.kernel.org List-ID: * Jan Kiszka [2009-12-02 12:18]: > Ryan Harper wrote: > > * Jan Kiszka [2009-12-02 12:07]: > >> Ryan Harper wrote: > >>> * Jan Kiszka [2009-12-02 09:28]: > >>>> Hi, > >>>> > >>>> I'm facing stalled x86-64 guests after live migration when using kvm > >>>> (share disk images). This does not happen with x86-32 guests or when > >>>> disabling kvm. Both qemu and qemu-kvm git heads are affected (recent > >>>> vmstate fixes applied). Running I/O load during the migration (e.g. a > >>>> simple "ls -R /") seems to trigger it reliably. > >>>> > >>>> Can anyone confirm / comment on this? Do we fail to restore some magic > >>>> state that only long mode cares about? > >>> Just tested upstream qemu.git (with vmstate fixes) and I could migrate > >>> RHEL 5.3 64-bit guest with your light io load over localhost. I'll try > >>> remote hosts next. > >> Hell, too many variables. It looks like the kernel modules have some if > >> not the ultimate impact: kvm-mod-2.6.31.6b on my 2.6.27 host works fine, > >> kvm-kmod stable-2.6.32 as well as master cause troubles. > >> > >> What is your host kernel and/or kvm module version? > > > > Stock 64-bit Ubuntu Karmic: > > % uname -a > > Linux symmetry 2.6.31-15-generic #50-Ubuntu SMP Tue Nov 10 14:53:52 UTC 2009 x86_64 GNU/Linux > > > > % modinfo kvm > > filename: > > /lib/modules/2.6.31-15-generic/kernel/arch/x86/kvm/kvm.ko > > license: GPL > > author: Qumranet > > srcversion: 82D6B673524596F9CF3E84C > > depends: > > vermagic: 2.6.31-15-generic SMP mod_unload modversions > > parm: oos_shadow:bool > > > > % modinfo kvm-intel > > filename: /lib/modules/2.6.31-15-generic/kernel/arch/x86/kvm/kvm-intel.ko > > license: GPL > > author: Qumranet > > srcversion: 8FEA479DFCD7F174DA7864E > > depends: kvm > > vermagic: 2.6.31-15-generic SMP mod_unload modversions > > parm: bypass_guest_pf:bool > > parm: vpid:bool > > parm: flexpriority:bool > > parm: ept:bool > > parm: emulate_invalid_guest_state:bool > > > > So far, so consistent. Could you try kvm-kmod-2.6.32-rc7 on top of that? > Sure, can you remind me of the kvm-kmod build magic for building that branch? > Jan > > -- > Siemens AG, Corporate Technology, CT T DE IT 1 > Corporate Competence Center Embedded Linux -- Ryan Harper Software Engineer; Linux Technology Center IBM Corp., Austin, Tx ryanh@us.ibm.com