From mboxrd@z Thu Jan 1 00:00:00 1970 From: Stefan Bader Subject: Re: Xen-4.4-rc6 problems launching a PV guest Date: Fri, 07 Mar 2014 15:07:38 +0100 Message-ID: <5319D2AA.8040500@canonical.com> References: <5319CAFC.7050304@canonical.com> <5319CBFF.7070203@citrix.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="===============3822265129683386794==" Return-path: In-Reply-To: <5319CBFF.7070203@citrix.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: Andrew Cooper Cc: "xen-devel@lists.xensource.com" , Ian Jackson , Ian Campbell List-Id: xen-devel@lists.xenproject.org This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --===============3822265129683386794== Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="WmQKeRmBfOA5tWqE8uJfPIWG5KMlmx5AH" This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --WmQKeRmBfOA5tWqE8uJfPIWG5KMlmx5AH Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 07.03.2014 14:39, Andrew Cooper wrote: > On 07/03/14 13:34, Stefan Bader wrote: >> Playing around with the release candidate of Xen-4.4 I seems to have p= roblems >> launching a PV guest with a config that used to work with Xen-4.3. The= normal >> logging would hint problems with the NIC setup (witch the slightly con= fusing >> origin of vtpm). >> >> Comparing the output to one produced by xen-4.3 I found a weird deregi= ster of a >> watch never registered (see below) instead of a call to the hotplug sc= ript. >> Am I doing something wrong? >> >> -Stefan >=20 > CC'ing IanJ - this looks related to the recent libxl events/forking wor= k. Oh... maybe pebkac... Looks like several binaries can move to ../sbin ins= tead of =2E./bin with the same packaging. But as packaging does not name things individually I missed them missing. Let me fix this and see whether that solves all issues... -Stefan >=20 >> >> --- cfg --- >> name =3D "arg-saucy6401-pv" >> kernel =3D "/root/boot/pv-grub-hd0--x86_64.gz" >> memory =3D 4096 >> vcpus =3D 4 >> disk =3D [ >> 'file:/home/ec2/amis/saucy-server-uec/arg-saucy6401-pv.img,xvda1,w'= >> ] >> vif =3D ['mac=3D02:e1:9c:43:ef:af,bridge=3Dbr0'] >> on_crash =3D "coredump-destroy" >> #device_model_version =3D "qemu-xen-traditional" >> >> --- log --- >> libxl: debug: libxl_create.c:1342:do_domain_create: ao 0x9cba30: creat= e: >> how=3D(nil) callback=3D(nil) poller=3D0x9c0fa0 >> libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk = vdev=3Dxvda1 >> spec.backend=3Dunknown >> libxl: debug: libxl_device.c:197:disk_try_backend: Disk vdev=3Dxvda1, = backend phy >> unsuitable as phys path not a block device >> libxl: debug: libxl_device.c:286:libxl__device_disk_set_backend: Disk >> vdev=3Dxvda1, using backend qdisk >> libxl: debug: libxl_create.c:797:initiate_domain_create: running bootl= oader >> libxl: debug: libxl_bootloader.c:327:libxl__bootloader_run: no bootloa= der >> configured, using user supplied kernel >> libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=3D= 0x9c13d8: >> deregister unregistered >> libxl: debug: libxl_numa.c:475:libxl__get_numa_candidate: New best NUM= A >> placement candidate found: nr_nodes=3D1, nr_cpus=3D4, nr_vcpus=3D12, f= ree_memkb=3D15612 >> libxl: debug: libxl_numa.c:475:libxl__get_numa_candidate: New best NUM= A >> placement candidate found: nr_nodes=3D1, nr_cpus=3D4, nr_vcpus=3D12, f= ree_memkb=3D15769 >> libxl: detail: libxl_dom.c:195:numa_place_domain: NUMA placement candi= date with >> 1 nodes, 4 cpus and 15769 KB free selected >> domainbuilder: detail: xc_dom_allocate: cmdline=3D"", features=3D"(nul= l)" >> libxl: debug: libxl_dom.c:357:libxl__build_pv: pv kernel mapped 0 path= >> /root/boot/pv-grub-hd0--x86_64.gz >> domainbuilder: detail: xc_dom_kernel_file: >> filename=3D"/root/boot/pv-grub-hd0--x86_64.gz" >> domainbuilder: detail: xc_dom_malloc_filemap : 769 kB >> domainbuilder: detail: xc_dom_malloc : 4384 kB >> domainbuilder: detail: xc_dom_do_gunzip: unzip ok, 0xc050e -> 0x448085= >> domainbuilder: detail: xc_dom_boot_xen_init: ver 4.4, caps xen-3.0-x86= _64 >> xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 >> domainbuilder: detail: xc_dom_parse_image: called >> domainbuilder: detail: xc_dom_find_loader: trying multiboot-binary loa= der ... >> domainbuilder: detail: loader probe failed >> domainbuilder: detail: xc_dom_find_loader: trying Linux bzImage loader= ... >> domainbuilder: detail: xc_dom_probe_bzimage_kernel: kernel is not a bz= Image >> domainbuilder: detail: loader probe failed >> domainbuilder: detail: xc_dom_find_loader: trying ELF-generic loader .= =2E. >> domainbuilder: detail: loader probe OK >> xc: detail: elf_parse_binary: phdr: paddr=3D0x0 memsz=3D0x98fe68 >> xc: detail: elf_parse_binary: memory: 0x0 -> 0x98fe68 >> xc: detail: elf_xen_parse: __xen_guest: >> "GUEST_OS=3DMini-OS,XEN_VER=3Dxen-3.0,VIRT_BASE=3D0x0,ELF_PADDR_OFFSET= =3D0x0,HYPERCALL_PAGE=3D0x2,LOADER=3Dgeneric" >> xc: detail: elf_xen_parse_guest_info: GUEST_OS=3D"Mini-OS" >> xc: detail: elf_xen_parse_guest_info: XEN_VER=3D"xen-3.0" >> xc: detail: elf_xen_parse_guest_info: VIRT_BASE=3D"0x0" >> xc: detail: elf_xen_parse_guest_info: ELF_PADDR_OFFSET=3D"0x0" >> xc: detail: elf_xen_parse_guest_info: HYPERCALL_PAGE=3D"0x2" >> xc: detail: elf_xen_parse_guest_info: LOADER=3D"generic" >> xc: detail: elf_xen_addr_calc_check: addresses: >> xc: detail: virt_base =3D 0x0 >> xc: detail: elf_paddr_offset =3D 0x0 >> xc: detail: virt_offset =3D 0x0 >> xc: detail: virt_kstart =3D 0x0 >> xc: detail: virt_kend =3D 0x98fe68 >> xc: detail: virt_entry =3D 0x0 >> xc: detail: p2m_base =3D 0xffffffffffffffff >> domainbuilder: detail: xc_dom_parse_elf_kernel: xen-3.0-x86_64: 0x0 ->= 0x98fe68 >> domainbuilder: detail: xc_dom_mem_init: mem 4096 MB, pages 0x100000 pa= ges, 4k each >> domainbuilder: detail: xc_dom_mem_init: 0x100000 pages >> domainbuilder: detail: xc_dom_boot_mem_init: called >> domainbuilder: detail: x86_compat: guest xen-3.0-x86_64, address size = 64 >> domainbuilder: detail: xc_dom_malloc : 8192 kB >> domainbuilder: detail: xc_dom_build_image: called >> domainbuilder: detail: xc_dom_alloc_segment: kernel : 0x0 -> 0= x990000 >> (pfn 0x0 + 0x990 pages) >> domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0= x0+0x990 >> at 0x7f2f34eca000 >> xc: detail: elf_load_binary: phdr 0 at 0x7f2f34eca000 -> 0x7f2f34f4ab0= 0 >> domainbuilder: detail: xc_dom_alloc_segment: phys2mach : 0x990000= -> >> 0x1190000 (pfn 0x990 + 0x800 pages) >> domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0= x990+0x800 >> at 0x7f2f346ca000 >> domainbuilder: detail: xc_dom_alloc_page : start info : 0x119000= 0 (pfn 0x1190) >> domainbuilder: detail: xc_dom_alloc_page : xenstore : 0x119100= 0 (pfn 0x1191) >> domainbuilder: detail: xc_dom_alloc_page : console : 0x119200= 0 (pfn 0x1192) >> domainbuilder: detail: nr_page_tables: 0x0000ffffffffffff/48: 0x000000= 0000000000 >> -> 0x0000ffffffffffff, 1 table(s) >> domainbuilder: detail: nr_page_tables: 0x0000007fffffffff/39: 0x000000= 0000000000 >> -> 0x0000007fffffffff, 1 table(s) >> domainbuilder: detail: nr_page_tables: 0x000000003fffffff/30: 0x000000= 0000000000 >> -> 0x000000003fffffff, 1 table(s) >> domainbuilder: detail: nr_page_tables: 0x00000000001fffff/21: 0x000000= 0000000000 >> -> 0x00000000013fffff, 10 table(s) >> domainbuilder: detail: xc_dom_alloc_segment: page tables : 0x119300= 0 -> >> 0x11a0000 (pfn 0x1193 + 0xd pages) >> domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0= x1193+0xd >> at 0x7f2f382ea000 >> domainbuilder: detail: xc_dom_alloc_page : boot stack : 0x11a000= 0 (pfn 0x11a0) >> domainbuilder: detail: xc_dom_build_image : virt_alloc_end : 0x11a100= 0 >> domainbuilder: detail: xc_dom_build_image : virt_pgtab_end : 0x140000= 0 >> domainbuilder: detail: xc_dom_boot_image: called >> domainbuilder: detail: arch_setup_bootearly: doing nothing >> domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-= 3.0-x86_64 >> <=3D matches >> domainbuilder: detail: xc_dom_compat_check: supported guest type: xen-= 3.0-x86_32p >> domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-= 3.0-x86_32 >> domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-= 3.0-x86_32p >> domainbuilder: detail: xc_dom_compat_check: supported guest type: hvm-= 3.0-x86_64 >> domainbuilder: detail: xc_dom_update_guest_p2m: dst 64bit, pages 0x100= 000 >> domainbuilder: detail: clear_page: pfn 0x1192, mfn 0x81e765 >> domainbuilder: detail: clear_page: pfn 0x1191, mfn 0x81e766 >> domainbuilder: detail: xc_dom_pfn_to_ptr_retcount: domU mapping: pfn 0= x1190+0x1 >> at 0x7f2f382e9000 >> domainbuilder: detail: start_info_x86_64: called >> domainbuilder: detail: setup_hypercall_page: vaddr=3D0x2000 pfn=3D0x2 >> domainbuilder: detail: domain builder memory footprint >> domainbuilder: detail: allocated >> domainbuilder: detail: malloc : 12684 kB >> domainbuilder: detail: anon mmap : 0 bytes >> domainbuilder: detail: mapped >> domainbuilder: detail: file mmap : 769 kB >> domainbuilder: detail: domU mmap : 18040 kB >> domainbuilder: detail: arch_setup_bootlate: shared_info: pfn 0x0, mfn = 0xdfaf5 >> domainbuilder: detail: shared_info_x86_64: called >> domainbuilder: detail: vcpu_x86_64: called >> domainbuilder: detail: vcpu_x86_64: cr3: pfn 0x1193 mfn 0x81e764 >> domainbuilder: detail: launch_vm: called, ctxt=3D0x7f2f383c0004 >> domainbuilder: detail: xc_dom_release: called >> libxl: debug: libxl_device.c:251:libxl__device_disk_set_backend: Disk = vdev=3Dxvda1 >> spec.backend=3Dqdisk >> libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=3D= 0x9c27a0: >> deregister unregistered >> libxl: debug: libxl_dm.c:1303:libxl__spawn_local_dm: Spawning device-m= odel >> /usr/bin/qemu-system-i386 with arguments: >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: /usr/bin/qemu-s= ystem-i386 >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: -xen-domid >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: 7 >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: -chardev >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: >> socket,id=3Dlibxl-cmd,path=3D/var/run/xen/qmp-libxl-7,server,nowait >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: -mon >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: >> chardev=3Dlibxl-cmd,mode=3Dcontrol >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: -nodefaults >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: -xen-attach >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: -name >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: arg-saucy6401-p= v >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: -nographic >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: -machine >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: xenpv >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: -m >> libxl: debug: libxl_dm.c:1305:libxl__spawn_local_dm: 4097 >> libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=3D= 0x9c1610 >> wpath=3D/local/domain/0/device-model/7/state token=3D3/0: register slo= tnum=3D3 >> libxl: debug: libxl_create.c:1356:do_domain_create: ao 0x9cba30: inpro= gress: >> poller=3D0x9c0fa0, flags=3Di >> libxl: debug: libxl_event.c:514:watchfd_callback: watch w=3D0x9c1610 >> wpath=3D/local/domain/0/device-model/7/state token=3D3/0: event >> epath=3D/local/domain/0/device-model/7/state >> libxl: debug: libxl_event.c:514:watchfd_callback: watch w=3D0x9c1610 >> wpath=3D/local/domain/0/device-model/7/state token=3D3/0: event >> epath=3D/local/domain/0/device-model/7/state >> libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=3D= 0x9c1610 >> wpath=3D/local/domain/0/device-model/7/state token=3D3/0: deregister s= lotnum=3D3 >> libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=3D= 0x9c1610: >> deregister unregistered >> libxl: debug: libxl_qmp.c:696:libxl__qmp_initialize: connected to >> /var/run/xen/qmp-libxl-7 >> libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: qmp >> libxl: debug: libxl_qmp.c:546:qmp_send_prepare: next qmp command: '{ >> "execute": "qmp_capabilities", >> "id": 1 >> } >> ' >> libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: retur= n >> libxl: debug: libxl_qmp.c:546:qmp_send_prepare: next qmp command: '{ >> "execute": "query-chardev", >> "id": 2 >> } >> ' >> libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: retur= n >> libxl: debug: libxl_qmp.c:546:qmp_send_prepare: next qmp command: '{ >> "execute": "query-vnc", >> "id": 3 >> } >> ' >> libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: retur= n >> libxl: debug: libxl_event.c:570:libxl__ev_xswatch_register: watch w=3D= 0x9c4bd8 >> wpath=3D/local/domain/0/backend/vif/7/0/state token=3D3/1: register sl= otnum=3D3 >> libxl: debug: libxl_event.c:514:watchfd_callback: watch w=3D0x9c4bd8 >> wpath=3D/local/domain/0/backend/vif/7/0/state token=3D3/1: event >> epath=3D/local/domain/0/backend/vif/7/0/state >> libxl: debug: libxl_event.c:657:devstate_watch_callback: backend >> /local/domain/0/backend/vif/7/0/state wanted state 2 still waiting sta= te 1 >> libxl: debug: libxl_event.c:514:watchfd_callback: watch w=3D0x9c4bd8 >> wpath=3D/local/domain/0/backend/vif/7/0/state token=3D3/1: event >> epath=3D/local/domain/0/backend/vif/7/0/state >> libxl: debug: libxl_event.c:653:devstate_watch_callback: backend >> /local/domain/0/backend/vif/7/0/state wanted state 2 ok >> libxl: debug: libxl_event.c:606:libxl__ev_xswatch_deregister: watch w=3D= 0x9c4bd8 >> wpath=3D/local/domain/0/backend/vif/7/0/state token=3D3/1: deregister = slotnum=3D3 >> >> libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=3D= 0x9c4bd8: >> deregister unregistered >> libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=3D= 0x9c4c60: >> deregister unregistered >> --- >> >> This second watch getting unregistered, I do not get in xen-4.3. Also = there >> never seems to be a register with that handle. In 4.3 at this point th= e hotplug >> script gets called. >> >> --- >> libxl: error: libxl_create.c:1226:domcreate_attach_vtpms: unable to ad= d nic devices >> libxl: debug: libxl_dm.c:1478:kill_device_model: Device Model signaled= >> libxl: error: libxl_device.c:780:libxl__initiate_device_remove: unable= to get my >> domid >> libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=3D= 0x9c5700: >> deregister unregistered >> libxl: error: libxl_device.c:780:libxl__initiate_device_remove: unable= to get my >> domid >> libxl: debug: libxl_event.c:618:libxl__ev_xswatch_deregister: watch w=3D= 0x9c5a10: >> deregister unregistered >> libxl: error: libxl.c:1457:devices_destroy_cb: libxl__devices_destroy = failed for 7 >> libxl: debug: libxl_event.c:1591:libxl__ao_complete: ao 0x9cba30: comp= lete, rc=3D-3 >> libxl: debug: libxl_event.c:1563:libxl__ao__destroy: ao 0x9cba30: dest= roy >> xc: debug: hypercall buffer: total allocations:782 total releases:782 >> xc: debug: hypercall buffer: current allocations:0 maximum allocations= :4 >> xc: debug: hypercall buffer: cache current size:4 >> xc: debug: hypercall buffer: cache hits:771 misses:4 toobig:7 >> Parsing config from arg-saucy6401-pv.cfg >> >> >> >> _______________________________________________ >> Xen-devel mailing list >> Xen-devel@lists.xen.org >> http://lists.xen.org/xen-devel >=20 >=20 --WmQKeRmBfOA5tWqE8uJfPIWG5KMlmx5AH Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iQIcBAEBCgAGBQJTGdKqAAoJEOhnXe7L7s6j2ocQAMhVtdR5IZflxp7WXcLnE/r9 HSKVg0Cx6Zfq1rwEdtix6fm6ZX1LPI5flGz0GO0+EtwJVEtYslzANdVim3Nlzm35 QaFWqAGxprad8wpgHjfr8KWoleQPKREb8hnfEH8bJHnz0S3zrp4Qan4tAXU9KZ+N oSvtJzbRakE8tiHN3SEq28W0HiCSuFd8GBBFkbP2JXvbvmemKM5A+YDt+9fpSZ/e U5RzS1qMkrj7vxT4IAcqHu4D2RLTDGGVQCYF/IKxyH5fOXZYRgfTia/y6D1xRhe3 NZ+0P6PnGuef78GWTAjDnR39Gz22PFGuMWaN82eOrXwBBFxM+/MGuacX+C44veC3 22xTWPSjVaRIaGWfzfZGqu4HH/JEtKZrDz+OEwUXQF6FZYveaLMx3OILJPVGCyhx PQFISP01A78UiNeD12frsYa24a15rPBIMfRjQB/VyTfH9c8JPJBdVW9tsT+cmlrB ndspCLn2FvvvI0izdBM5BcOKVw+TU0XqgBTL8xH4rgo5s0JgdJjI5QjFAiTmAPX2 3RoSYoSbOA/eHcWBMeLEpxDHfBKC2IoY5nEzghaOLh3sioaK8c9o+eIn4WspwyIU l4v2k2cpuTbY8Z5TDcynQj+n1q/KEjLEREsndS/IOCbkt240OLyBrTbtCik9RANc OaVtse1wU26UtbPcxgn7 =+kXL -----END PGP SIGNATURE----- --WmQKeRmBfOA5tWqE8uJfPIWG5KMlmx5AH-- --===============3822265129683386794== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --===============3822265129683386794==--