From mboxrd@z Thu Jan  1 00:00:00 1970
From: Cristian Zamfir <zamf@dcs.gla.ac.uk>
Subject: blkif migration problem
Date: Mon, 04 Dec 2006 19:09:52 +0000
Message-ID: <45747280.1020002@dcs.gla.ac.uk>
Mime-Version: 1.0
Content-Type: multipart/mixed; boundary="------------030108090401060705050002"
Return-path: <xen-devel-bounces@lists.xensource.com>
List-Unsubscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>,
	<mailto:xen-devel-request@lists.xensource.com?subject=unsubscribe>
List-Post: <mailto:xen-devel@lists.xensource.com>
List-Help: <mailto:xen-devel-request@lists.xensource.com?subject=help>
List-Subscribe: <http://lists.xensource.com/cgi-bin/mailman/listinfo/xen-devel>,
	<mailto:xen-devel-request@lists.xensource.com?subject=subscribe>
Sender: xen-devel-bounces@lists.xensource.com
Errors-To: xen-devel-bounces@lists.xensource.com
To: xen-devel@lists.xensource.com
List-Id: xen-devel@lists.xenproject.org

This is a multi-part message in MIME format.
--------------030108090401060705050002
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit


Hi,

We are attempting to migrate blkif devices backed by drbd devices. We 
have used a similar approach to the vTPM migration. Complete migration 
seems to go without errors on both source and destination. The migrated 
machine responds to external network queries like ping, arping, nmap but 
I cannot ssh into it. Also, when using xm console, I get get these 
messages before the login prompt:

vbd vbd-769: 16 Device in use; refusing to close
netfront: device eth0 has flipping receive path.

... then the  machine hangs after inputing the login username.

My guess is that even though the hotplug scripts returned successfully 
for the vbd device (according to the xend.log bellow), the vbd did not 
migrate successfully and the dom0 machine cannot read anything from the 
disk.

Do you have any suggestion on what the problem might be and where and 
how to look for more debugging information?

Attached are the xend.logs for the source and the destination.

Thank you.

Cristian




--------------030108090401060705050002
Content-Type: text/plain;
 name="xend.log.dst"
Content-Transfer-Encoding: quoted-printable
Content-Disposition: inline;
 filename="xend.log.dst"

[2006-12-04 17:22:53 xend 2674] INFO (SrvDaemon:283) Xend Daemon started
[2006-12-04 17:22:53 xend 2674] INFO (SrvDaemon:287) Xend changeset: unav=
ailable .
[2006-12-04 17:22:53 xend.XendDomainInfo 2674] DEBUG (XendDomainInfo:212)=
 XendDomainInfo.recreate({'paused': 0, 'cpu_time': 8725777156L, 'ssidref'=
: 0, 'handle': [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], 'shutdow=
n_reason': 0, 'dying': 0, 'dom': 0, 'mem_kb': 254720, 'maxmem_kb': -4, 'm=
ax_vcpu_id': 0, 'crashed': 0, 'running': 1, 'shutdown': 0, 'online_vcpus'=
: 1, 'blocked': 0})
[2006-12-04 17:22:53 xend.XendDomainInfo 2674] INFO (XendDomainInfo:224) =
Recreating domain 0, UUID 00000000-0000-0000-0000-000000000000.
[2006-12-04 17:22:53 xend.XendDomainInfo 2674] WARNING (XendDomainInfo:24=
6) No vm path in store for existing domain 0
[2006-12-04 17:22:53 xend.XendDomainInfo 2674] DEBUG (XendDomainInfo:712)=
 Storing VM details: {'shadow_memory': '0', 'uuid': '00000000-0000-0000-0=
000-000000000000', 'on_reboot': 'restart', 'on_poweroff': 'destroy', 'nam=
e': 'Domain-0', 'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1=
', 'memory': '249', 'on_crash': 'restart', 'maxmem': '249'}
[2006-12-04 17:22:53 xend.XendDomainInfo 2674] DEBUG (XendDomainInfo:747)=
 Storing domain details: {'cpu/0/availability': 'online', 'memory/target'=
: '254976', 'name': 'Domain-0', 'console/limit': '1048576', 'vm': '/vm/00=
000000-0000-0000-0000-000000000000', 'domid': '0'}
[2006-12-04 17:22:53 xend 2674] DEBUG (XendDomain:153) number of vcpus to=
 use is 0
[2006-12-04 17:22:53 xend.XendDomainInfo 2684] DEBUG (XendDomainInfo:933)=
 XendDomainInfo.handleShutdownWatch
[2006-12-04 17:35:26 xend.XendDomainInfo 3030] DEBUG (XendDomainInfo:265)=
 XendDomainInfo.restore(['domain', ['domid', '3'], ['uuid', '3be156ff-629=
8-0d86-0b94-27c58262f4c0'], ['vcpus', '1'], ['vcpu_avail', '1'], ['cpu_we=
ight', '1.0'], ['memory', '232'], ['shadow_memory', '0'], ['maxmem', '232=
'], ['features'], ['name', 'vm01'], ['on_poweroff', 'destroy'], ['on_rebo=
ot', 'restart'], ['on_crash', 'restart'], ['image', ['linux', ['kernel', =
'/boot/vmlinuz-2.6-xenU'], ['ip', '130.209.253.132:1.2.3.4:130.209.240.48=
:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'], ['root', '/dev/hda1']]], [=
'device', ['vif', ['backend', '0'], ['script', 'vif-bridge'], ['mac', '00=
:16:3E:F6:BB:01']]], ['device', ['vbd', ['backend', '0'], ['dev', 'hda1:d=
isk'], ['uname', 'phy:drbd1'], ['mode', 'w']]], ['state', '------'], ['sh=
utdown_reason', 'poweroff'], ['cpu_time', '0.891476194'], ['online_vcpus'=
, '1'], ['up_time', '85.1114499569'], ['start_time', '1165253683.61'], ['=
store_mfn', '4781'], ['console_mfn', '4780']])
[2006-12-04 17:35:26 xend.XendDomainInfo 3030] DEBUG (XendDomainInfo:296)=
 parseConfig: config is ['domain', ['domid', '3'], ['uuid', '3be156ff-629=
8-0d86-0b94-27c58262f4c0'], ['vcpus', '1'], ['vcpu_avail', '1'], ['cpu_we=
ight', '1.0'], ['memory', '232'], ['shadow_memory', '0'], ['maxmem', '232=
'], ['features'], ['name', 'vm01'], ['on_poweroff', 'destroy'], ['on_rebo=
ot', 'restart'], ['on_crash', 'restart'], ['image', ['linux', ['kernel', =
'/boot/vmlinuz-2.6-xenU'], ['ip', '130.209.253.132:1.2.3.4:130.209.240.48=
:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'], ['root', '/dev/hda1']]], [=
'device', ['vif', ['backend', '0'], ['script', 'vif-bridge'], ['mac', '00=
:16:3E:F6:BB:01']]], ['device', ['vbd', ['backend', '0'], ['dev', 'hda1:d=
isk'], ['uname', 'phy:drbd1'], ['mode', 'w']]], ['state', '------'], ['sh=
utdown_reason', 'poweroff'], ['cpu_time', '0.891476194'], ['online_vcpus'=
, '1'], ['up_time', '85.1114499569'], ['start_time', '1165253683.61'], ['=
store_mfn', '4781'], ['console_mfn', '4780']]
[2006-12-04 17:35:26 xend.XendDomainInfo 3030] DEBUG (XendDomainInfo:395)=
 parseConfig: result is {'shadow_memory': 0, 'uuid': '3be156ff-6298-0d86-=
0b94-27c58262f4c0', 'on_crash': 'restart', 'on_reboot': 'restart', 'local=
time': None, 'image': ['linux', ['kernel', '/boot/vmlinuz-2.6-xenU'], ['i=
p', '130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.a=
c.uk:eth0:off'], ['root', '/dev/hda1']], 'on_poweroff': 'destroy', 'bootl=
oader_args': None, 'cpus': None, 'name': 'vm01', 'backend': [], 'vcpus': =
1, 'cpu_weight': 1.0, 'features': None, 'vcpu_avail': 1, 'memory': 232, '=
device': [('vif', ['vif', ['backend', '0'], ['script', 'vif-bridge'], ['m=
ac', '00:16:3E:F6:BB:01']]), ('vbd', ['vbd', ['backend', '0'], ['dev', 'h=
da1:disk'], ['uname', 'phy:drbd1'], ['mode', 'w']])], 'bootloader': None,=
 'cpu': None, 'maxmem': 232}
[2006-12-04 17:35:26 xend.XendDomainInfo 3030] DEBUG (XendDomainInfo:1253=
) XendDomainInfo.construct: None
[2006-12-04 17:35:26 xend.XendDomainInfo 3030] DEBUG (XendDomainInfo:712)=
 Storing VM details: {'shadow_memory': '0', 'uuid': '3be156ff-6298-0d86-0=
b94-27c58262f4c0', 'on_reboot': 'restart', 'image': '(linux (kernel /boot=
/vmlinuz-2.6-xenU) (ip 130.209.253.132:1.2.3.4:130.209.240.48:255.255.240=
=2E0:raoul.dcs.gla.ac.uk:eth0:off) (root /dev/hda1))', 'on_poweroff': 'de=
stroy', 'name': 'vm01', 'xend/restart_count': '0', 'vcpus': '1', 'vcpu_av=
ail': '1', 'memory': '232', 'on_crash': 'restart', 'maxmem': '232'}
[2006-12-04 17:35:26 xend 3030] DEBUG (DevController:110) DevController: =
writing {'backend-id': '0', 'mac': '00:16:3E:F6:BB:01', 'handle': '0', 's=
tate': '1', 'backend': '/local/domain/0/backend/vif/1/0'} to /local/domai=
n/1/device/vif/0.
[2006-12-04 17:35:26 xend 3030] DEBUG (DevController:112) DevController: =
writing {'domain': 'vm01', 'handle': '0', 'script': '/etc/xen/scripts/vif=
-bridge', 'state': '1', 'frontend': '/local/domain/1/device/vif/0', 'mac'=
: '00:16:3E:F6:BB:01', 'online': '1', 'frontend-id': '1'} to /local/domai=
n/0/backend/vif/1/0.
[2006-12-04 17:35:26 xend 3030] DEBUG (DevController:110) DevController: =
writing {'backend-id': '0', 'virtual-device': '769', 'device-type': 'disk=
', 'state': '1', 'backend': '/local/domain/0/backend/vbd/1/769'} to /loca=
l/domain/1/device/vbd/769.
[2006-12-04 17:35:26 xend 3030] DEBUG (DevController:112) DevController: =
writing {'domain': 'vm01', 'frontend': '/local/domain/1/device/vbd/769', =
'dev': 'hda1', 'state': '1', 'params': 'drbd1', 'mode': 'w', 'online': '1=
', 'frontend-id': '1', 'type': 'phy'} to /local/domain/0/backend/vbd/1/76=
9.
[2006-12-04 17:35:26 xend.XendDomainInfo 3030] DEBUG (XendDomainInfo:747)=
 Storing domain details: {'console/port': '2', 'name': 'vm01', 'console/l=
imit': '1048576', 'vm': '/vm/3be156ff-6298-0d86-0b94-27c58262f4c0', 'domi=
d': '1', 'cpu/0/availability': 'online', 'memory/target': '237568', 'stor=
e/port': '1'}
[2006-12-04 17:35:26 xend 3030] DEBUG (balloon:127) Balloon: 770752 KiB f=
ree; need 245760; done.
[2006-12-04 17:35:26 xend 3030] DEBUG (XendCheckpoint:155) [xc_restore]: =
/usr/lib/xen/bin/xc_restore 4 1 61440 1 2
[2006-12-04 17:35:27 xend 3039] ERROR (XendCheckpoint:236) xc_linux_resto=
re start: max_pfn =3D f000
[2006-12-04 17:35:27 xend 3039] ERROR (XendCheckpoint:236) Increased doma=
in reservation by 3c000 KB
[2006-12-04 17:35:27 xend 3039] ERROR (XendCheckpoint:236) Reloading memo=
ry pages:   0%
[2006-12-04 17:35:48 xend 3030] DEBUG (XendCheckpoint:209) store-mfn 4781=

[2006-12-04 17:35:48 xend 3030] DEBUG (XendCheckpoint:209) console-mfn 47=
80
[2006-12-04 17:35:48 xend 3039] ERROR (XendCheckpoint:236) Received all p=
ages (0 races)
[2006-12-04 17:35:48 xend 3039] ERROR (XendCheckpoint:236) =08=08=08=0810=
0%
[2006-12-04 17:35:48 xend 3039] ERROR (XendCheckpoint:236) Memory reloade=
d.
[2006-12-04 17:35:48 xend 3039] ERROR (XendCheckpoint:236) Decreased rese=
rvation by 2094 pages
[2006-12-04 17:35:48 xend 3039] ERROR (XendCheckpoint:236) Domain ready t=
o be built.
[2006-12-04 17:35:48 xend 3039] ERROR (XendCheckpoint:236) Restore exit w=
ith rc=3D0
[2006-12-04 17:35:48 xend 3030] DEBUG (DevController:143) Waiting for dev=
ices vif.
[2006-12-04 17:35:48 xend 3030] DEBUG (DevController:149) Waiting for 0.
[2006-12-04 17:35:48 xend 2684] DEBUG (DevController:464) hotplugStatusCa=
llback /local/domain/0/backend/vif/1/0/hotplug-status.
[2006-12-04 17:35:48 xend 2684] DEBUG (DevController:479) hotplugStatusCa=
llback 1.
[2006-12-04 17:35:48 xend 3030] DEBUG (DevController:143) Waiting for dev=
ices usb.
[2006-12-04 17:35:48 xend 3030] DEBUG (DevController:143) Waiting for dev=
ices vbd.
[2006-12-04 17:35:48 xend 3030] DEBUG (DevController:149) Waiting for 769=
=2E
[2006-12-04 17:35:48 xend 2684] DEBUG (DevController:464) hotplugStatusCa=
llback /local/domain/0/backend/vbd/1/769/hotplug-status.
[2006-12-04 17:35:48 xend 2684] DEBUG (DevController:479) hotplugStatusCa=
llback 1.
[2006-12-04 17:35:48 xend 3030] DEBUG (DevController:143) Waiting for dev=
ices irq.
[2006-12-04 17:35:48 xend 3030] DEBUG (DevController:143) Waiting for dev=
ices pci.
[2006-12-04 17:35:48 xend 3030] DEBUG (DevController:143) Waiting for dev=
ices ioports.
[2006-12-04 17:35:48 xend 3030] DEBUG (DevController:143) Waiting for dev=
ices tap.
[2006-12-04 17:35:48 xend 3030] DEBUG (DevController:143) Waiting for dev=
ices vtpm.
[2006-12-04 17:35:48 xend.XendDomainInfo 3030] DEBUG (XendDomainInfo:672)=
 XendDomainInfo.completeRestore
[2006-12-04 17:35:48 xend.XendDomainInfo 3030] DEBUG (XendDomainInfo:747)=
 Storing domain details: {'console/ring-ref': '4780', 'console/port': '2'=
, 'name': 'vm01', 'console/limit': '1048576', 'vm': '/vm/3be156ff-6298-0d=
86-0b94-27c58262f4c0', 'domid': '1', 'cpu/0/availability': 'online', 'mem=
ory/target': '237568', 'store/ring-ref': '4781', 'store/port': '1'}
[2006-12-04 17:35:48 xend.XendDomainInfo 3030] DEBUG (XendDomainInfo:682)=
 XendDomainInfo.completeRestore done
[2006-12-04 17:35:48 xend.XendDomainInfo 2684] DEBUG (XendDomainInfo:933)=
 XendDomainInfo.handleShutdownWatch
--------------030108090401060705050002
Content-Type: application/x-wais-source;
 name="xend.log.src"
Content-Transfer-Encoding: 7bit
Content-Disposition: inline;
 filename="xend.log.src"

[2006-12-04 17:27:26 xend 2922] INFO (SrvDaemon:283) Xend Daemon started
[2006-12-04 17:27:26 xend 2922] INFO (SrvDaemon:287) Xend changeset: unavailable .
[2006-12-04 17:27:26 xend.XendDomainInfo 2922] DEBUG (XendDomainInfo:212) XendDomainInfo.recreate({'paused': 0, 'cpu_time': 10309251070L, 'ssidref': 0, 'handle': [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], 'shutdown_reason': 0, 'dying': 0, 'dom': 0, 'mem_kb': 254720, 'maxmem_kb': -4, 'max_vcpu_id': 0, 'crashed': 0, 'running': 1, 'shutdown': 0, 'online_vcpus': 1, 'blocked': 0})
[2006-12-04 17:27:26 xend.XendDomainInfo 2922] INFO (XendDomainInfo:224) Recreating domain 0, UUID 00000000-0000-0000-0000-000000000000.
[2006-12-04 17:27:26 xend 2922] DEBUG (XendDomain:153) number of vcpus to use is 0
[2006-12-04 17:27:26 xend.XendDomainInfo 2925] DEBUG (XendDomainInfo:933) XendDomainInfo.handleShutdownWatch
[2006-12-04 17:34:43 xend.XendDomainInfo 3046] DEBUG (XendDomainInfo:190) XendDomainInfo.create(['vm', ['name', 'vm01'], ['memory', 232], ['vcpus', 1], ['image', ['linux', ['kernel', '/boot/vmlinuz-2.6-xenU'], ['ip', '130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'], ['root', '/dev/hda1']]], ['device', ['vbd', ['uname', 'phy:drbd1'], ['dev', 'hda1'], ['mode', 'w']]], ['device', ['vif', ['mac', '00:16:3E:F6:BB:01']]]])
[2006-12-04 17:34:43 xend.XendDomainInfo 3046] DEBUG (XendDomainInfo:296) parseConfig: config is ['vm', ['name', 'vm01'], ['memory', 232], ['vcpus', 1], ['image', ['linux', ['kernel', '/boot/vmlinuz-2.6-xenU'], ['ip', '130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'], ['root', '/dev/hda1']]], ['device', ['vbd', ['uname', 'phy:drbd1'], ['dev', 'hda1'], ['mode', 'w']]], ['device', ['vif', ['mac', '00:16:3E:F6:BB:01']]]]
[2006-12-04 17:34:43 xend.XendDomainInfo 3046] DEBUG (XendDomainInfo:395) parseConfig: result is {'shadow_memory': None, 'uuid': None, 'on_crash': None, 'on_reboot': None, 'localtime': None, 'image': ['linux', ['kernel', '/boot/vmlinuz-2.6-xenU'], ['ip', '130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off'], ['root', '/dev/hda1']], 'on_poweroff': None, 'bootloader_args': None, 'cpus': None, 'name': 'vm01', 'backend': [], 'vcpus': 1, 'cpu_weight': None, 'features': None, 'vcpu_avail': None, 'memory': 232, 'device': [('vbd', ['vbd', ['uname', 'phy:drbd1'], ['dev', 'hda1'], ['mode', 'w']]), ('vif', ['vif', ['mac', '00:16:3E:F6:BB:01']])], 'bootloader': None, 'cpu': None, 'maxmem': None}
[2006-12-04 17:34:43 xend.XendDomainInfo 3046] DEBUG (XendDomainInfo:1253) XendDomainInfo.construct: None
[2006-12-04 17:34:43 xend.XendDomainInfo 3046] DEBUG (XendDomainInfo:1285) XendDomainInfo.initDomain: 3 1.0
[2006-12-04 17:34:43 xend 3046] DEBUG (balloon:127) Balloon: 770752 KiB free; need 237568; done.
[2006-12-04 17:34:43 xend 3046] INFO (image:136) buildDomain os=linux dom=3 vcpus=1
[2006-12-04 17:34:43 xend 3046] DEBUG (image:191) dom            = 3
[2006-12-04 17:34:43 xend 3046] DEBUG (image:192) image          = /boot/vmlinuz-2.6-xenU
[2006-12-04 17:34:43 xend 3046] DEBUG (image:193) store_evtchn   = 1
[2006-12-04 17:34:43 xend 3046] DEBUG (image:194) console_evtchn = 2
[2006-12-04 17:34:43 xend 3046] DEBUG (image:195) cmdline        =  ip=130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off root=/dev/hda1
[2006-12-04 17:34:43 xend 3046] DEBUG (image:196) ramdisk        = 
[2006-12-04 17:34:43 xend 3046] DEBUG (image:197) vcpus          = 1
[2006-12-04 17:34:43 xend 3046] DEBUG (image:198) features       = 
[2006-12-04 17:34:43 xend 3046] DEBUG (DevController:110) DevController: writing {'backend-id': '0', 'virtual-device': '769', 'device-type': 'disk', 'state': '1', 'backend': '/local/domain/0/backend/vbd/3/769'} to /local/domain/3/device/vbd/769.
[2006-12-04 17:34:43 xend 3046] DEBUG (DevController:112) DevController: writing {'domain': 'vm01', 'frontend': '/local/domain/3/device/vbd/769', 'dev': 'hda1', 'state': '1', 'params': 'drbd1', 'mode': 'w', 'online': '1', 'frontend-id': '3', 'type': 'phy'} to /local/domain/0/backend/vbd/3/769.
[2006-12-04 17:34:43 xend 3046] DEBUG (DevController:110) DevController: writing {'backend-id': '0', 'mac': '00:16:3E:F6:BB:01', 'handle': '0', 'state': '1', 'backend': '/local/domain/0/backend/vif/3/0'} to /local/domain/3/device/vif/0.
[2006-12-04 17:34:43 xend 3046] DEBUG (DevController:112) DevController: writing {'domain': 'vm01', 'handle': '0', 'script': '/etc/xen/scripts/vif-bridge', 'state': '1', 'frontend': '/local/domain/3/device/vif/0', 'mac': '00:16:3E:F6:BB:01', 'online': '1', 'frontend-id': '3'} to /local/domain/0/backend/vif/3/0.
[2006-12-04 17:34:43 xend.XendDomainInfo 3046] DEBUG (XendDomainInfo:712) Storing VM details: {'shadow_memory': '0', 'uuid': '3be156ff-6298-0d86-0b94-27c58262f4c0', 'on_reboot': 'restart', 'start_time': '1165253683.61', 'on_poweroff': 'destroy', 'name': 'vm01', 'xend/restart_count': '0', 'vcpus': '1', 'vcpu_avail': '1', 'memory': '232', 'on_crash': 'restart', 'image': '(linux (kernel /boot/vmlinuz-2.6-xenU) (ip 130.209.253.132:1.2.3.4:130.209.240.48:255.255.240.0:raoul.dcs.gla.ac.uk:eth0:off) (root /dev/hda1))', 'maxmem': '232'}
[2006-12-04 17:34:43 xend.XendDomainInfo 3046] DEBUG (XendDomainInfo:747) Storing domain details: {'console/ring-ref': '4780', 'console/port': '2', 'name': 'vm01', 'console/limit': '1048576', 'vm': '/vm/3be156ff-6298-0d86-0b94-27c58262f4c0', 'domid': '3', 'cpu/0/availability': 'online', 'memory/target': '237568', 'store/ring-ref': '4781', 'store/port': '1'}
[2006-12-04 17:34:43 xend.XendDomainInfo 2925] DEBUG (XendDomainInfo:933) XendDomainInfo.handleShutdownWatch
[2006-12-04 17:34:43 xend 3054] DEBUG (DevController:143) Waiting for devices vif.
[2006-12-04 17:34:43 xend 3054] DEBUG (DevController:149) Waiting for 0.
[2006-12-04 17:34:43 xend 2925] DEBUG (DevController:464) hotplugStatusCallback /local/domain/0/backend/vif/3/0/hotplug-status.
[2006-12-04 17:34:45 xend 2925] DEBUG (DevController:464) hotplugStatusCallback /local/domain/0/backend/vif/3/0/hotplug-status.
[2006-12-04 17:34:45 xend 2925] DEBUG (DevController:479) hotplugStatusCallback 1.
[2006-12-04 17:34:45 xend 3054] DEBUG (DevController:143) Waiting for devices usb.
[2006-12-04 17:34:45 xend 3054] DEBUG (DevController:143) Waiting for devices vbd.
[2006-12-04 17:34:45 xend 3054] DEBUG (DevController:149) Waiting for 769.
[2006-12-04 17:34:45 xend 2925] DEBUG (DevController:464) hotplugStatusCallback /local/domain/0/backend/vbd/3/769/hotplug-status.
[2006-12-04 17:34:45 xend 2925] DEBUG (DevController:479) hotplugStatusCallback 1.
[2006-12-04 17:34:45 xend 3054] DEBUG (DevController:143) Waiting for devices irq.
[2006-12-04 17:34:45 xend 3054] DEBUG (DevController:143) Waiting for devices pci.
[2006-12-04 17:34:45 xend 3054] DEBUG (DevController:143) Waiting for devices ioports.
[2006-12-04 17:34:45 xend 3054] DEBUG (DevController:143) Waiting for devices tap.
[2006-12-04 17:34:45 xend 3054] DEBUG (DevController:143) Waiting for devices vtpm.
[2006-12-04 17:34:45 xend 3244] INFO (XendDomain:370) Domain vm01 (3) unpaused.
[2006-12-04 17:36:08 xend 3252] INFO (blkif:168) Request to network-migrate device to rangatira. step=0.
[2006-12-04 17:36:08 xend 3252] DEBUG (balloon:127) Balloon: 533328 KiB free; need 2048; done.
[2006-12-04 17:36:08 xend 3252] INFO (blkif:168) Request to network-migrate device to rangatira. step=1.
[2006-12-04 17:36:08 xend 3252] DEBUG (XendCheckpoint:83) [xc_save]: /usr/lib/xen/bin/xc_save 19 3 0 0 1
[2006-12-04 17:36:08 xend 3261] ERROR (XendCheckpoint:250) Had 0 unexplained entries in p2m table
[2006-12-04 17:36:10 xend 3261] ERROR (XendCheckpoint:250) Saving memory pages: iter 1   0%  5%PT Race: [10000000,0] pte=1d8063, mfn=000001d8
[2006-12-04 17:36:10 xend 3261] ERROR (XendCheckpoint:250) PT Race: [10000000,1] pte=1d9063, mfn=000001d9
[2006-12-04 17:36:10 xend 3261] ERROR (XendCheckpoint:250) PT Race: [10000000,2] pte=1da063, mfn=000001da
[2006-12-04 17:36:10 xend 3261] ERROR (XendCheckpoint:250) PT Race: [10000000,3] pte=1db063, mfn=000001db
[2006-12-04 17:36:10 xend 3261] ERROR (XendCheckpoint:250) PT Race: [10000000,909] pte=bed063, mfn=00000bed
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250)  10% 15% 20% 25% 31% 36% 41% 46% 51% 56% 62% 67% 72% 77% 82% 88% 93% 98%
 1: sent 59207, skipped 179, delta 20897ms, dom0 10%, target 0%, sent 92Mb/s, dirtied 0Mb/s 211 pages
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) Saving memory pages: iter 2   0%netbuf race: iter 2, pfn e432. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 3e1. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 7e1. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e45d. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 13e2. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e4e4. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn fe. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e542. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e560. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e5b3. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e5b4. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e5b5. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e5bc. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e5df. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e5e7. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 13e8. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e60c. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 615. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 636. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 63f. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e651. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e65b. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 7da. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 13ea. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e692. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 695. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 6be. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 6e6. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 713. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 716. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 735. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 736. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 1341. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 75d. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 75f. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn e365. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 1388. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 1389. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 78d. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 78e. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 796. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 797. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 7b9. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 13ba. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 7bb. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 2, pfn 13bc. mfn ffffffff
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) 2: sent 165, skipped 0, delta 51ms, dom0 33%, target 0%, sent 106Mb/s, dirtied 0Mb/s 0 pages
[2006-12-04 17:36:29 xend 3261] ERROR (XendCheckpoint:250) Saving memory pages: iter 3   0%
 3: sent 0, skipped 0, Start last iteration
[2006-12-04 17:36:29 xend 3252] DEBUG (XendCheckpoint:223) suspend
[2006-12-04 17:36:29 xend 3252] DEBUG (XendCheckpoint:86) In saveInputHandler suspend
[2006-12-04 17:36:29 xend 3252] DEBUG (XendCheckpoint:88) Suspending 3 ...
[2006-12-04 17:36:29 xend.XendDomainInfo 2925] DEBUG (XendDomainInfo:933) XendDomainInfo.handleShutdownWatch
[2006-12-04 17:36:29 xend.XendDomainInfo 2925] DEBUG (XendDomainInfo:933) XendDomainInfo.handleShutdownWatch
[2006-12-04 17:36:29 xend.XendDomainInfo 2925] INFO (XendDomainInfo:892) Domain has shutdown: name=migrating-vm01 id=3 reason=suspend.
[2006-12-04 17:36:29 xend 3252] INFO (blkif:168) Request to network-migrate device to rangatira. step=2.
[2006-12-04 17:36:29 xend 3252] INFO (XendCheckpoint:93) Domain 3 suspended.
[2006-12-04 17:36:29 xend 3252] INFO (blkif:168) Request to network-migrate device to rangatira. step=3.
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) SUSPEND shinfo 00000bed eip c01013a7 edx 000012ae
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) delta 264ms, dom0 76%, target 0%, sent 0Mb/s, dirtied 9Mb/s 79 pages
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) Saving memory pages: iter 4   0%netbuf race: iter 4, pfn e432. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 3e1. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 7e1. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e45d. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 13e2. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e4e4. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn fe. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e542. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e560. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e5b3. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e5b4. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e5b5. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e5bc. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e5df. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e5e7. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 13e8. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e60c. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 615. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 636. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 63f. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e651. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e65b. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 7da. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 13ea. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e692. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 695. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 6be. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 6e6. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 713. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 716. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 735. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 736. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 1341. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 75d. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 75f. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn e365. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 1388. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 1389. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 78d. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 78e. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 796. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 797. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 7b9. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 13ba. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 7bb. mfn ffffffff
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) netbuf race: iter 4, pfn 13bc. mfn ffffffff
[2006-12-04 17:36:30 xend 3252] DEBUG (XendCheckpoint:98) Written done
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) 4: sent 79, skipped 0, delta 19ms, dom0 78%, target 0%, sent 136Mb/s, dirtied 136Mb/s 79 pages
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) Total pages sent= 59451 (0.97x)
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) (of which 0 were fixups)
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) All memory is saved
[2006-12-04 17:36:30 xend 3261] ERROR (XendCheckpoint:250) Save exit rc=0
[2006-12-04 17:36:30 xend.XendDomainInfo 3252] DEBUG (XendDomainInfo:1457) XendDomainInfo.destroyDomain(3)
[2006-12-04 17:36:30 xend.XendDomainInfo 3252] INFO (XendDomainInfo:1555) Dev 769 still active, looping...
[2006-12-04 17:36:30 xend.XendDomainInfo 3252] INFO (XendDomainInfo:1555) Dev 769 still active, looping...
[2006-12-04 17:36:30 xend.XendDomainInfo 3252] INFO (XendDomainInfo:1555) Dev 769 still active, looping...
[2006-12-04 17:36:30 xend.XendDomainInfo 3252] INFO (XendDomainInfo:1555) Dev 769 still active, looping...
[2006-12-04 17:36:30 xend.XendDomainInfo 3252] INFO (XendDomainInfo:1555) Dev 769 still active, looping...

--------------030108090401060705050002
Content-Type: text/plain; charset="us-ascii"
MIME-Version: 1.0
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel

--------------030108090401060705050002--