* [Qemu-devel] Block Migration and xbzrle @ 2012-09-16 10:39 Peter Lieven 2012-09-17 18:03 ` Orit Wasserman 2012-10-02 9:38 ` Paolo Bonzini 0 siblings, 2 replies; 10+ messages in thread From: Peter Lieven @ 2012-09-16 10:39 UTC (permalink / raw) To: qemu-devel@nongnu.org, kvm@vger.kernel.org Hi, I remember that this was broken some time ago and currently with qemu-kvm 1.2.0 I am still not able to use block migration plus xbzrle. The migration fails if both are used together. XBZRLE without block migration works. Can someone please advise what is the current expected behaviour? Thanks, Peter ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Qemu-devel] Block Migration and xbzrle 2012-09-16 10:39 [Qemu-devel] Block Migration and xbzrle Peter Lieven @ 2012-09-17 18:03 ` Orit Wasserman 2012-10-02 8:33 ` lieven-lists 2012-10-02 9:38 ` Paolo Bonzini 1 sibling, 1 reply; 10+ messages in thread From: Orit Wasserman @ 2012-09-17 18:03 UTC (permalink / raw) To: Peter Lieven; +Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org On 09/16/2012 01:39 PM, Peter Lieven wrote: > Hi, > > I remember that this was broken some time ago and currently with qemu-kvm 1.2.0 I am still not able to use > block migration plus xbzrle. The migration fails if both are used together. XBZRLE without block migration works. > > Can someone please advise what is the current expected behaviour? XBZRLE only work on guest memory so it shouldn't be effected by block migration. What is the error you are getting? What command line ? Regards, Orit > > Thanks, > Peter > > ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Qemu-devel] Block Migration and xbzrle 2012-09-17 18:03 ` Orit Wasserman @ 2012-10-02 8:33 ` lieven-lists 2012-10-02 9:28 ` Orit Wasserman 0 siblings, 1 reply; 10+ messages in thread From: lieven-lists @ 2012-10-02 8:33 UTC (permalink / raw) To: Orit Wasserman; +Cc: Peter Lieven, qemu-devel@nongnu.org, kvm@vger.kernel.org Orit Wasserman wrote: > On 09/16/2012 01:39 PM, Peter Lieven wrote: >> Hi, >> >> I remember that this was broken some time ago and currently with >> qemu-kvm 1.2.0 I am still not able to use >> block migration plus xbzrle. The migration fails if both are used >> together. XBZRLE without block migration works. >> >> Can someone please advise what is the current expected behaviour? > XBZRLE only work on guest memory so it shouldn't be effected by block > migration. > What is the error you are getting? > What command line ? Meanwhile I can confirm that it happens with and without block migration. I I observe 2 errors: a) qemu: warning: error while loading state section id 2 load of migration failed b) the vm does not enter running state after migration. The command-line: /usr/bin/qemu-kvm-1.2.0 -net tap,vlan=798,script=no,downscript=no,ifname=tap1 -net nic,vlan=798,model=e1000,macaddr=52:54:00:ff:01:15 -drive format=host_device,file=/dev/mapper/iqn.2001-05.com.equallogic:0-8a0906-d85f4e007-3f30017ce11505df-ubuntu-tools-hd0,if=virtio,cache=none,aio=native -m 4096 -smp 2,sockets=1,cores=2,threads=1 -monitor tcp:0:4002,server,nowait -vnc :2 -qmp tcp:0:3002,server,nowait -name 'Ubuntu-Tools' -boot order=dc,menu=off -k de -incoming tcp:172.21.55.34:5002 -pidfile /var/run/qemu/vm-250.pid -mem-path /hugepages -mem-prealloc -rtc base=utc -usb -usbdevice tablet -no-hpet -vga cirrus -cpu host,+x2apic,model_id='Intel(R) Xeon(R) CPU L5640 @ 2.27GHz',-tsc Thanks, Peter > > Regards, > Orit >> >> Thanks, >> Peter >> >> > > > ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Qemu-devel] Block Migration and xbzrle 2012-10-02 8:33 ` lieven-lists @ 2012-10-02 9:28 ` Orit Wasserman 2012-10-02 9:30 ` Peter Lieven 0 siblings, 1 reply; 10+ messages in thread From: Orit Wasserman @ 2012-10-02 9:28 UTC (permalink / raw) To: lieven-lists; +Cc: Peter Lieven, qemu-devel@nongnu.org, kvm@vger.kernel.org On 10/02/2012 10:33 AM, lieven-lists@dlh.net wrote: > Orit Wasserman wrote: >> On 09/16/2012 01:39 PM, Peter Lieven wrote: >>> Hi, >>> >>> I remember that this was broken some time ago and currently with >>> qemu-kvm 1.2.0 I am still not able to use >>> block migration plus xbzrle. The migration fails if both are used >>> together. XBZRLE without block migration works. >>> >>> Can someone please advise what is the current expected behaviour? >> XBZRLE only work on guest memory so it shouldn't be effected by block >> migration. >> What is the error you are getting? >> What command line ? > > Meanwhile I can confirm that it happens with and without block migration. > I I observe 2 errors: > a) > qemu: warning: error while loading state section id 2 > load of migration failed > b) > the vm does not enter running state after migration. > > The command-line: > /usr/bin/qemu-kvm-1.2.0 -net > tap,vlan=798,script=no,downscript=no,ifname=tap1 -net > nic,vlan=798,model=e1000,macaddr=52:54:00:ff:01:15 -drive > format=host_device,file=/dev/mapper/iqn.2001-05.com.equallogic:0-8a0906-d85f4e007-3f30017ce11505df-ubuntu-tools-hd0,if=virtio,cache=none,aio=native > -m 4096 -smp 2,sockets=1,cores=2,threads=1 -monitor > tcp:0:4002,server,nowait -vnc :2 -qmp tcp:0:3002,server,nowait -name > 'Ubuntu-Tools' -boot order=dc,menu=off -k de -incoming > tcp:172.21.55.34:5002 -pidfile /var/run/qemu/vm-250.pid -mem-path > /hugepages -mem-prealloc -rtc base=utc -usb -usbdevice tablet -no-hpet > -vga cirrus -cpu host,+x2apic,model_id='Intel(R) Xeon(R) CPU Migration with -cpu host is very problemtic, because the source and destination can have different cpu resulting in different cpu features. Does regular migration works with this setup? Can you try with a different cpu type? What are the source and destination /proc/cpuinfo output ? Cheers, Orit > L5640 @ 2.27GHz',-tsc > > Thanks, > Peter > >> >> Regards, >> Orit >>> >>> Thanks, >>> Peter >>> >>> >> >> >> > > > -- > To unsubscribe from this list: send the line "unsubscribe kvm" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Qemu-devel] Block Migration and xbzrle 2012-10-02 9:28 ` Orit Wasserman @ 2012-10-02 9:30 ` Peter Lieven 2012-10-02 10:40 ` Orit Wasserman 0 siblings, 1 reply; 10+ messages in thread From: Peter Lieven @ 2012-10-02 9:30 UTC (permalink / raw) To: Orit Wasserman; +Cc: qemu-devel@nongnu.org, lieven-lists, kvm@vger.kernel.org Am 02.10.2012 um 11:28 schrieb Orit Wasserman: > On 10/02/2012 10:33 AM, lieven-lists@dlh.net wrote: >> Orit Wasserman wrote: >>> On 09/16/2012 01:39 PM, Peter Lieven wrote: >>>> Hi, >>>> >>>> I remember that this was broken some time ago and currently with >>>> qemu-kvm 1.2.0 I am still not able to use >>>> block migration plus xbzrle. The migration fails if both are used >>>> together. XBZRLE without block migration works. >>>> >>>> Can someone please advise what is the current expected behaviour? >>> XBZRLE only work on guest memory so it shouldn't be effected by block >>> migration. >>> What is the error you are getting? >>> What command line ? >> >> Meanwhile I can confirm that it happens with and without block migration. >> I I observe 2 errors: >> a) >> qemu: warning: error while loading state section id 2 >> load of migration failed >> b) >> the vm does not enter running state after migration. >> >> The command-line: >> /usr/bin/qemu-kvm-1.2.0 -net >> tap,vlan=798,script=no,downscript=no,ifname=tap1 -net >> nic,vlan=798,model=e1000,macaddr=52:54:00:ff:01:15 -drive >> format=host_device,file=/dev/mapper/iqn.2001-05.com.equallogic:0-8a0906-d85f4e007-3f30017ce11505df-ubuntu-tools-hd0,if=virtio,cache=none,aio=native >> -m 4096 -smp 2,sockets=1,cores=2,threads=1 -monitor >> tcp:0:4002,server,nowait -vnc :2 -qmp tcp:0:3002,server,nowait -name >> 'Ubuntu-Tools' -boot order=dc,menu=off -k de -incoming >> tcp:172.21.55.34:5002 -pidfile /var/run/qemu/vm-250.pid -mem-path >> /hugepages -mem-prealloc -rtc base=utc -usb -usbdevice tablet -no-hpet >> -vga cirrus -cpu host,+x2apic,model_id='Intel(R) Xeon(R) CPU > Migration with -cpu host is very problemtic, because the source and destination can > have different cpu resulting in different cpu features. > Does regular migration works with this setup? > Can you try with a different cpu type? > What are the source and destination /proc/cpuinfo output ? The CPUs are identical, we also check if flags and cpu types match if cpu type is set to host. Regular migration does work. BR, Peter > > Cheers, > Orit > >> L5640 @ 2.27GHz',-tsc >> >> Thanks, >> Peter >> >>> >>> Regards, >>> Orit >>>> >>>> Thanks, >>>> Peter >>>> >>>> >>> >>> >>> >> >> >> -- >> To unsubscribe from this list: send the line "unsubscribe kvm" in >> the body of a message to majordomo@vger.kernel.org >> More majordomo info at http://vger.kernel.org/majordomo-info.html >> > ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Qemu-devel] Block Migration and xbzrle 2012-10-02 9:30 ` Peter Lieven @ 2012-10-02 10:40 ` Orit Wasserman 2012-10-04 6:31 ` Peter Lieven 0 siblings, 1 reply; 10+ messages in thread From: Orit Wasserman @ 2012-10-02 10:40 UTC (permalink / raw) To: Peter Lieven; +Cc: qemu-devel@nongnu.org, lieven-lists, kvm@vger.kernel.org On 10/02/2012 11:30 AM, Peter Lieven wrote: > > Am 02.10.2012 um 11:28 schrieb Orit Wasserman: > >> On 10/02/2012 10:33 AM, lieven-lists@dlh.net wrote: >>> Orit Wasserman wrote: >>>> On 09/16/2012 01:39 PM, Peter Lieven wrote: >>>>> Hi, >>>>> >>>>> I remember that this was broken some time ago and currently with >>>>> qemu-kvm 1.2.0 I am still not able to use >>>>> block migration plus xbzrle. The migration fails if both are used >>>>> together. XBZRLE without block migration works. >>>>> >>>>> Can someone please advise what is the current expected behaviour? >>>> XBZRLE only work on guest memory so it shouldn't be effected by block >>>> migration. >>>> What is the error you are getting? >>>> What command line ? >>> >>> Meanwhile I can confirm that it happens with and without block migration. >>> I I observe 2 errors: >>> a) >>> qemu: warning: error while loading state section id 2 >>> load of migration failed Did you enabled XBZRLE on the destination also? (migrate_set_capability xbzrle on) Orit >>> b) >>> the vm does not enter running state after migration. >>> >>> The command-line: >>> /usr/bin/qemu-kvm-1.2.0 -net >>> tap,vlan=798,script=no,downscript=no,ifname=tap1 -net >>> nic,vlan=798,model=e1000,macaddr=52:54:00:ff:01:15 -drive >>> format=host_device,file=/dev/mapper/iqn.2001-05.com.equallogic:0-8a0906-d85f4e007-3f30017ce11505df-ubuntu-tools-hd0,if=virtio,cache=none,aio=native >>> -m 4096 -smp 2,sockets=1,cores=2,threads=1 -monitor >>> tcp:0:4002,server,nowait -vnc :2 -qmp tcp:0:3002,server,nowait -name >>> 'Ubuntu-Tools' -boot order=dc,menu=off -k de -incoming >>> tcp:172.21.55.34:5002 -pidfile /var/run/qemu/vm-250.pid -mem-path >>> /hugepages -mem-prealloc -rtc base=utc -usb -usbdevice tablet -no-hpet >>> -vga cirrus -cpu host,+x2apic,model_id='Intel(R) Xeon(R) CPU >> Migration with -cpu host is very problemtic, because the source and destination can >> have different cpu resulting in different cpu features. >> Does regular migration works with this setup? >> Can you try with a different cpu type? >> What are the source and destination /proc/cpuinfo output ? > > The CPUs are identical, we also check if flags and cpu types match if cpu type is set to host. > Regular migration does work. > > BR, > Peter > >> >> Cheers, >> Orit >> >>> L5640 @ 2.27GHz',-tsc >>> >>> Thanks, >>> Peter >>> >>>> >>>> Regards, >>>> Orit >>>>> >>>>> Thanks, >>>>> Peter >>>>> >>>>> >>>> >>>> >>>> >>> >>> >>> -- >>> To unsubscribe from this list: send the line "unsubscribe kvm" in >>> the body of a message to majordomo@vger.kernel.org >>> More majordomo info at http://vger.kernel.org/majordomo-info.html >>> >> > ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Qemu-devel] Block Migration and xbzrle 2012-10-02 10:40 ` Orit Wasserman @ 2012-10-04 6:31 ` Peter Lieven 0 siblings, 0 replies; 10+ messages in thread From: Peter Lieven @ 2012-10-04 6:31 UTC (permalink / raw) To: Orit Wasserman; +Cc: qemu-devel@nongnu.org, lieven-lists, kvm@vger.kernel.org Am 02.10.2012 um 12:40 schrieb Orit Wasserman: > On 10/02/2012 11:30 AM, Peter Lieven wrote: >> >> Am 02.10.2012 um 11:28 schrieb Orit Wasserman: >> >>> On 10/02/2012 10:33 AM, lieven-lists@dlh.net wrote: >>>> Orit Wasserman wrote: >>>>> On 09/16/2012 01:39 PM, Peter Lieven wrote: >>>>>> Hi, >>>>>> >>>>>> I remember that this was broken some time ago and currently with >>>>>> qemu-kvm 1.2.0 I am still not able to use >>>>>> block migration plus xbzrle. The migration fails if both are used >>>>>> together. XBZRLE without block migration works. >>>>>> >>>>>> Can someone please advise what is the current expected behaviour? >>>>> XBZRLE only work on guest memory so it shouldn't be effected by block >>>>> migration. >>>>> What is the error you are getting? >>>>> What command line ? >>>> >>>> Meanwhile I can confirm that it happens with and without block migration. >>>> I I observe 2 errors: >>>> a) >>>> qemu: warning: error while loading state section id 2 >>>> load of migration failed > Did you enabled XBZRLE on the destination also? > (migrate_set_capability xbzrle on) I was not aware that I have to enable it on both sides. I thought it had to be enabled only on the source side. However, it seems that it is enabled by default in 1.2.0?! I will retry with enabling it with the above command on both sides. Peter > > Orit >>>> b) >>>> the vm does not enter running state after migration. >>>> >>>> The command-line: >>>> /usr/bin/qemu-kvm-1.2.0 -net >>>> tap,vlan=798,script=no,downscript=no,ifname=tap1 -net >>>> nic,vlan=798,model=e1000,macaddr=52:54:00:ff:01:15 -drive >>>> format=host_device,file=/dev/mapper/iqn.2001-05.com.equallogic:0-8a0906-d85f4e007-3f30017ce11505df-ubuntu-tools-hd0,if=virtio,cache=none,aio=native >>>> -m 4096 -smp 2,sockets=1,cores=2,threads=1 -monitor >>>> tcp:0:4002,server,nowait -vnc :2 -qmp tcp:0:3002,server,nowait -name >>>> 'Ubuntu-Tools' -boot order=dc,menu=off -k de -incoming >>>> tcp:172.21.55.34:5002 -pidfile /var/run/qemu/vm-250.pid -mem-path >>>> /hugepages -mem-prealloc -rtc base=utc -usb -usbdevice tablet -no-hpet >>>> -vga cirrus -cpu host,+x2apic,model_id='Intel(R) Xeon(R) CPU >>> Migration with -cpu host is very problemtic, because the source and destination can >>> have different cpu resulting in different cpu features. >>> Does regular migration works with this setup? >>> Can you try with a different cpu type? >>> What are the source and destination /proc/cpuinfo output ? > >> >> The CPUs are identical, we also check if flags and cpu types match if cpu type is set to host. >> Regular migration does work. > > > >> >> BR, >> Peter >> >>> >>> Cheers, >>> Orit >>> >>>> L5640 @ 2.27GHz',-tsc >>>> >>>> Thanks, >>>> Peter >>>> >>>>> >>>>> Regards, >>>>> Orit >>>>>> >>>>>> Thanks, >>>>>> Peter >>>>>> >>>>>> >>>>> >>>>> >>>>> >>>> >>>> >>>> -- >>>> To unsubscribe from this list: send the line "unsubscribe kvm" in >>>> the body of a message to majordomo@vger.kernel.org >>>> More majordomo info at http://vger.kernel.org/majordomo-info.html >>>> >>> >> > ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Qemu-devel] Block Migration and xbzrle 2012-09-16 10:39 [Qemu-devel] Block Migration and xbzrle Peter Lieven 2012-09-17 18:03 ` Orit Wasserman @ 2012-10-02 9:38 ` Paolo Bonzini 2012-10-02 9:44 ` Peter Lieven 1 sibling, 1 reply; 10+ messages in thread From: Paolo Bonzini @ 2012-10-02 9:38 UTC (permalink / raw) To: Peter Lieven; +Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org Il 16/09/2012 12:39, Peter Lieven ha scritto: > > I remember that this was broken some time ago and currently with > qemu-kvm 1.2.0 I am still not able to use > block migration plus xbzrle. The migration fails if both are used > together. XBZRLE without block migration works. > > Can someone please advise what is the current expected behaviour? Block migration is broken by design. It will converge really slowly as soon as you have real load in the VMs, and it will hamper the convergence of RAM as well. Hopefully a real alternative will be in 1.3 (based on drive-mirror on the source + an embedded NBD server running on the destination), then in 1.4 we can reimplement the block migration monitor commands using the alternative. Paolo ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Qemu-devel] Block Migration and xbzrle 2012-10-02 9:38 ` Paolo Bonzini @ 2012-10-02 9:44 ` Peter Lieven 2012-10-02 10:09 ` Paolo Bonzini 0 siblings, 1 reply; 10+ messages in thread From: Peter Lieven @ 2012-10-02 9:44 UTC (permalink / raw) To: Paolo Bonzini; +Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org Am 02.10.2012 um 11:38 schrieb Paolo Bonzini: > Il 16/09/2012 12:39, Peter Lieven ha scritto: >> >> I remember that this was broken some time ago and currently with >> qemu-kvm 1.2.0 I am still not able to use >> block migration plus xbzrle. The migration fails if both are used >> together. XBZRLE without block migration works. >> >> Can someone please advise what is the current expected behaviour? > > Block migration is broken by design. It will converge really slowly as > soon as you have real load in the VMs, and it will hamper the > convergence of RAM as well. > > Hopefully a real alternative will be in 1.3 (based on drive-mirror on > the source + an embedded NBD server running on the destination), then in > 1.4 we can reimplement the block migration monitor commands using the > alternative. Hi Paolo, i know that block migration is not that good, but it seems that there is a bug in XBZRLE that is independent of block migration. Peter > > Paolo ^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [Qemu-devel] Block Migration and xbzrle 2012-10-02 9:44 ` Peter Lieven @ 2012-10-02 10:09 ` Paolo Bonzini 0 siblings, 0 replies; 10+ messages in thread From: Paolo Bonzini @ 2012-10-02 10:09 UTC (permalink / raw) To: Peter Lieven; +Cc: qemu-devel@nongnu.org, kvm@vger.kernel.org Il 02/10/2012 11:44, Peter Lieven ha scritto: > > Am 02.10.2012 um 11:38 schrieb Paolo Bonzini: > >> Il 16/09/2012 12:39, Peter Lieven ha scritto: >>> >>> I remember that this was broken some time ago and currently with >>> qemu-kvm 1.2.0 I am still not able to use >>> block migration plus xbzrle. The migration fails if both are used >>> together. XBZRLE without block migration works. >>> >>> Can someone please advise what is the current expected behaviour? >> >> Block migration is broken by design. It will converge really slowly as >> soon as you have real load in the VMs, and it will hamper the >> convergence of RAM as well. >> >> Hopefully a real alternative will be in 1.3 (based on drive-mirror on >> the source + an embedded NBD server running on the destination), then in >> 1.4 we can reimplement the block migration monitor commands using the >> alternative. > > Hi Paolo, i know that block migration is not that good, but it seems that > there is a bug in XBZRLE that is independent of block migration. Understood---but hopefully you can stop using it with 1.3, which would also work around the bug. :) Paolo ^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2012-10-04 6:31 UTC | newest] Thread overview: 10+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2012-09-16 10:39 [Qemu-devel] Block Migration and xbzrle Peter Lieven 2012-09-17 18:03 ` Orit Wasserman 2012-10-02 8:33 ` lieven-lists 2012-10-02 9:28 ` Orit Wasserman 2012-10-02 9:30 ` Peter Lieven 2012-10-02 10:40 ` Orit Wasserman 2012-10-04 6:31 ` Peter Lieven 2012-10-02 9:38 ` Paolo Bonzini 2012-10-02 9:44 ` Peter Lieven 2012-10-02 10:09 ` Paolo Bonzini
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).