From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:35900) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1X7kHB-0006A1-Ps for qemu-devel@nongnu.org; Thu, 17 Jul 2014 07:55:13 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1X7kH4-000583-8O for qemu-devel@nongnu.org; Thu, 17 Jul 2014 07:55:05 -0400 Received: from mx.beyond.pl ([92.43.117.49]:60120) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1X7kH4-00057l-0V for qemu-devel@nongnu.org; Thu, 17 Jul 2014 07:54:58 -0400 Message-ID: <53C7B989.9000203@beyond.pl> Date: Thu, 17 Jul 2014 13:54:49 +0200 From: =?UTF-8?B?TWFyY2luIEdpYnXFgmE=?= MIME-Version: 1.0 References: <20140715050318.GD26186@grmbl.mre> <20140715210948.GA20036@amt.cnet> <53C5A4C9.80609@redhat.com> <20140716011634.GA30717@amt.cnet> <20140716115229.GA7741@amt.cnet> <53C6EE7C.60702@beyond.pl> <53C79C41.4000800@beyond.pl> In-Reply-To: <53C79C41.4000800@beyond.pl> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [Qemu-devel] latest rc: virtio-blk hangs forever after migration List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Andrey Korolyov Cc: Amit Shah , Paolo Bonzini , Marcelo Tosatti , Fam Zheng , "qemu-devel@nongnu.org" >> Yes, exactly. ISCSI-based setup can take some minutes to deploy, given >> prepared image, and I have one hundred percent hit rate for the >> original issue with it. > > I've reproduced your IO hang with 2.0 and both > 9b1786829aefb83f37a8f3135e3ea91c56001b56 and > a096b3a6732f846ec57dc28b47ee9435aa0609bf applied. > > Reverting 9b1786829aefb83f37a8f3135e3ea91c56001b56 indeed fixes the > problem (but reintroduces block-migration hang). It's seems like qemu > bug rather than guest problem, as no-kvmclock parameters makes no > difference. IO just stops, all qemu IO threads die off. Almost like it > forgets to migrate them:-) > > I'm attaching backtrace from guest kernel and qemu and qemu command line. > > Going to compile 2.1-rc. 2.1-rc2 behaves exactly the same. Interestingly enough, reseting guest system causes I/O to work again. So it's not qemu that hangs on IO, rather it fails to notify guest about completed operations that were issued during migration. And its somehow caused by calling cpu_synchronize_all_states() inside kvmclock_vm_state_change(). As for testing with cache=writeback, I'll try to setup some iscsi to test it. -- mg