From mboxrd@z Thu Jan 1 00:00:00 1970 From: Himanshu Raj Subject: Can't create DomU, vbd could not be connected .... Date: Fri, 11 Nov 2005 16:54:23 -0500 Message-ID: <20051111215423.GA14700@cc.gatech.edu> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="2fHTh5uZTiUOsy+g" Return-path: Content-Disposition: inline List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xensource.com Errors-To: xen-devel-bounces@lists.xensource.com To: xen-devel@lists.xensource.com List-Id: xen-devel@lists.xenproject.org --2fHTh5uZTiUOsy+g Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hi Guys, I cannot create and DomUs. It hangs for a while and comes back as: Error: Device 2049 (vbd) could not be connected. Hotplug scripts not working. This is a Fedora Core 4 system, and udev is still at version 058 (Xen requires 59 or else defaults to hotplug). I changed /proc/sys/kernel/hotplug to use /sbin/hotplug instead of /sbin/udevsend, but that didn't work either. I also upgraded udev to 59, no help there either. I am attaching the xend.log and xend-debug.log. xend-debug.log seems to be hinting towards memory allocation problem, but xm info shows some 300 MB free: system : Linux host : pc3 release : 2.6.12.6-xen0 version : #1 Fri Nov 11 15:08:13 EST 2005 machine : i686 nr_cpus : 4 nr_nodes : 1 sockets_per_node : 2 cores_per_socket : 1 threads_per_core : 2 cpu_mhz : 2791 hw_caps : bfebfbff:00000000:00000000:00000080:00004400 memory : 511 free_memory : 300 xen_major : 3 xen_minor : 0 xen_extra : -devel xen_caps : xen-3.0-x86_32 xen_params : virt_start=0xfc000000 xen_changeset : Fri Nov 11 11:04:17 2005 +0100 7769:1444adb1c407 cc_compiler : gcc version 4.0.1 20050727 (Red Hat 4.0.1-5) cc_compile_by : root cc_compile_domain : netlab.cc.gatech.edu cc_compile_date : Fri Nov 11 14:56:51 EST 2005 Thanks, -Himanshu -- ------------------------------------------------------------------------- Himanshu Raj PhD Student, GaTech (www.cc.gatech.edu/~rhim) I prefer to receive attachments in an open, non-proprietary format. ------------------------------------------------------------------------- --2fHTh5uZTiUOsy+g Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="xend-debug.log" Nothing to flush. sing. This may be because you have reached the limit of the number of interfaces that the loopback driver supports. If the loopback driver is a module, you may raise this limit by passing it as a parameter (nloopbacks=); if the driver is compiled statically into the kernel, then you may set the parameter using loopback.nloopbacks= on the domain 0 kernel command line. ist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 153, in create vm = XendDomainInfo(parseConfig(config)) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 365, in __init__ self.validateInfo() File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 453, in validateInfo self.check_name(self.info['name']) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 996, in check_name raise VmError("VM name '%s' already in use by domain %d" % VmError: VM name 'ExampleDomain' already in use by domain 2 Traceback (most recent call last): File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/server/SrvDomainDir.py", line 77, in op_create dominfo = self.xd.domain_create(config) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomain.py", line 215, in domain_create dominfo = XendDomainInfo.create(config) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 153, in create vm = XendDomainInfo(parseConfig(config)) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 365, in __init__ self.validateInfo() File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 453, in validateInfo self.check_name(self.info['name']) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 996, in check_name raise VmError("VM name '%s' already in use by domain %d" % VmError: VM name 'ExampleDomain' already in use by domain 3 n for dom 9: 16384 pages order 0 addr_bits 0 Traceback (most recent call last): File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Traceback (most recent call last): File "/usr/lib/python/xen/xend/server/SrvDomainDir.py", line 78, in op_create dominfo = self.xd.domain_create(config) File "/usr/lib/python/xen/xend/XendDomain.py", line 219, in domain_create dominfo = XendDomainInfo.create(config) File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 167, in create vm.construct() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Failed allocation for dom 10: 16384 pages order 0 addr_bits 0 Traceback (most recent call last): File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Traceback (most recent call last): File "/usr/lib/python/xen/xend/server/SrvDomainDir.py", line 78, in op_create dominfo = self.xd.domain_create(config) File "/usr/lib/python/xen/xend/XendDomain.py", line 219, in domain_create dominfo = XendDomainInfo.create(config) File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 167, in create vm.construct() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Failed allocation for dom 11: 16384 pages order 0 addr_bits 0 Traceback (most recent call last): File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Traceback (most recent call last): File "/usr/lib/python/xen/xend/server/SrvDomainDir.py", line 78, in op_create dominfo = self.xd.domain_create(config) File "/usr/lib/python/xen/xend/XendDomain.py", line 219, in domain_create dominfo = XendDomainInfo.create(config) File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 167, in create vm.construct() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Failed allocation for dom 12: 16384 pages order 0 addr_bits 0 Traceback (most recent call last): File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Traceback (most recent call last): File "/usr/lib/python/xen/xend/server/SrvDomainDir.py", line 78, in op_create dominfo = self.xd.domain_create(config) File "/usr/lib/python/xen/xend/XendDomain.py", line 219, in domain_create dominfo = XendDomainInfo.create(config) File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 167, in create vm.construct() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Failed allocation for dom 13: 16384 pages order 0 addr_bits 0 Traceback (most recent call last): File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Traceback (most recent call last): File "/usr/lib/python/xen/xend/server/SrvDomainDir.py", line 78, in op_create dominfo = self.xd.domain_create(config) File "/usr/lib/python/xen/xend/XendDomain.py", line 219, in domain_create dominfo = XendDomainInfo.create(config) File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 167, in create vm.construct() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Failed allocation for dom 14: 32768 pages order 0 addr_bits 0 Traceback (most recent call last): File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Traceback (most recent call last): File "/usr/lib/python/xen/xend/server/SrvDomainDir.py", line 78, in op_create dominfo = self.xd.domain_create(config) File "/usr/lib/python/xen/xend/XendDomain.py", line 219, in domain_create dominfo = XendDomainInfo.create(config) File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 167, in create vm.construct() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Failed allocation for dom 15: 32768 pages order 0 addr_bits 0 Traceback (most recent call last): File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') Traceback (most recent call last): File "/usr/lib/python/xen/xend/server/SrvDomainDir.py", line 78, in op_create dominfo = self.xd.domain_create(config) File "/usr/lib/python/xen/xend/XendDomain.py", line 219, in domain_create dominfo = XendDomainInfo.create(config) File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 167, in create vm.construct() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 876, in construct self.initDomain() File "/usr/lib/python/xen/xend/XendDomainInfo.py", line 909, in initDomain xc.domain_memory_increase_reservation(self.domid, m, 0, 0) error: (12, 'Cannot allocate memory') --2fHTh5uZTiUOsy+g Content-Type: text/plain; charset=us-ascii Content-Disposition: attachment; filename="xend.log" [2005-11-11 16:28:56 xend] INFO (SrvDaemon:268) Xend Daemon started [2005-11-11 16:28:56 xend] INFO (SrvDaemon:272) Xend changeset: Fri Nov 11 11:04:17 2005 +0100 7769:1444adb1c407. [2005-11-11 16:28:57 xend.XendDomainInfo] DEBUG (XendDomainInfo:172) XendDomainInfo.recreate({'paused': 0, 'cpu_time': 17417911513L, 'ssidref': 0, 'handle': [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], 'shutdown_reason': 0, 'dying': 0, 'dom': 0, 'mem_kb': 131072, 'maxmem_kb': -4, 'max_vcpu_id': 3, 'crashed': 0, 'running': 1, 'shutdown': 0, 'online_vcpus': 1, 'blocked': 0}) [2005-11-11 16:28:57 xend.XendDomainInfo] INFO (XendDomainInfo:184) Recreating domain 0, UUID 00000000-0000-0000-0000-000000000000. [2005-11-11 16:28:57 xend.XendDomainInfo] ERROR (XendDomainInfo:410) Store corrupted at /vm/00000000-0000-0000-0000-000000000000! Domain 0's configuration may be affected. Traceback (most recent call last): File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 402, in augmentInfo from_store = self.gatherVm(*params) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 490, in gatherVm return xstransact.Gather(self.vmpath, *args) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/xenstore/xstransact.py", line 310, in Gather v = t.gather(*args) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/xenstore/xstransact.py", line 189, in gather val = fn(val) ValueError: invalid literal for int(): [2005-11-11 16:28:57 xend] DEBUG (XendDomain:140) number of vcpus to use is 0 [2005-11-11 16:28:57 xend] INFO (SrvServer:112) unix path=/var/lib/xend/xend-socket [2005-11-11 16:29:25 xend.XendDomainInfo] DEBUG (XendDomainInfo:151) XendDomainInfo.create(['vm', ['name', 'fc4'], ['memory', '64'], ['image', ['linux', ['kernel', '/boot/vmlinuz-2.6-xenU'], ['root', '/dev/sda1 ro'], ['args', 'selinux=0'], ['vcpus', '1'], ['vcpus', '1'], ['boot', 'c']]], ['device', ['vbd', ['uname', 'file:root_fc4_base'], ['dev', 'sda1'], ['mode', 'w']]], ['device', ['vif', ['mac', 'aa:00:00:00:00:11'], ['bridge', 'xenbr0']]]]) [2005-11-11 16:29:25 xend.XendDomainInfo] DEBUG (XendDomainInfo:254) parseConfig: config is ['vm', ['name', 'fc4'], ['memory', '64'], ['image', ['linux', ['kernel', '/boot/vmlinuz-2.6-xenU'], ['root', '/dev/sda1 ro'], ['args', 'selinux=0'], ['vcpus', '1'], ['vcpus', '1'], ['boot', 'c']]], ['device', ['vbd', ['uname', 'file:root_fc4_base'], ['dev', 'sda1'], ['mode', 'w']]], ['device', ['vif', ['mac', 'aa:00:00:00:00:11'], ['bridge', 'xenbr0']]]] [2005-11-11 16:29:25 xend.XendDomainInfo] DEBUG (XendDomainInfo:308) parseConfig: result is {'ssidref': None, 'name': 'fc4', 'bootloader': None, 'on_reboot': None, 'image': ['linux', ['kernel', '/boot/vmlinuz-2.6-xenU'], ['root', '/dev/sda1 ro'], ['args', 'selinux=0'], ['vcpus', '1'], ['vcpus', '1'], ['boot', 'c']], 'on_poweroff': None, 'on_crash': None, 'backend': [], 'vcpus': 1, 'cpu_weight': None, 'vcpu_avail': None, 'memory': 64, 'device': [('vbd', ['vbd', ['uname', 'file:root_fc4_base'], ['dev', 'sda1'], ['mode', 'w']]), ('vif', ['vif', ['mac', 'aa:00:00:00:00:11'], ['bridge', 'xenbr0']])], 'maxmem': None, 'cpu': None, 'uuid': None} [2005-11-11 16:29:25 xend.XendDomainInfo] DEBUG (XendDomainInfo:1011) XendDomainInfo.construct: None 0 [2005-11-11 16:29:25 xend.XendDomainInfo] DEBUG (XendDomainInfo:1043) XendDomainInfo.initDomain: 1 1.0 [2005-11-11 16:29:25 xend] INFO (image:132) buildDomain os=linux dom=1 vcpus=1 [2005-11-11 16:29:25 xend] DEBUG (image:170) dom = 1 [2005-11-11 16:29:25 xend] DEBUG (image:171) image = /boot/vmlinuz-2.6-xenU [2005-11-11 16:29:25 xend] DEBUG (image:172) store_evtchn = 1 [2005-11-11 16:29:25 xend] DEBUG (image:173) console_evtchn = 2 [2005-11-11 16:29:25 xend] DEBUG (image:174) cmdline = root=/dev/sda1 ro selinux=0 [2005-11-11 16:29:25 xend] DEBUG (image:175) ramdisk = [2005-11-11 16:29:25 xend] DEBUG (image:176) vcpus = 1 [2005-11-11 16:29:25 xend] DEBUG (DevController:275) DevController: writing {'virtual-device': '2049', 'backend-id': '0', 'backend': '/local/domain/0/backend/vbd/1/2049'} to /local/domain/1/device/vbd/2049. [2005-11-11 16:29:25 xend] DEBUG (DevController:277) DevController: writing {'domain': 'fc4', 'params': 'root_fc4_base', 'frontend-id': '1', 'type': 'file', 'dev': 'sda1', 'frontend': '/local/domain/1/device/vbd/2049'} to /local/domain/0/backend/vbd/1/2049. [2005-11-11 16:29:25 xend] DEBUG (DevController:275) DevController: writing {'backend-id': '0', 'mac': 'aa:00:00:00:00:11', 'handle': '0', 'backend': '/local/domain/0/backend/vif/1/0'} to /local/domain/1/device/vif/0. [2005-11-11 16:29:25 xend] DEBUG (DevController:277) DevController: writing {'bridge': 'xenbr0', 'mac': 'aa:00:00:00:00:11', 'handle': '0', 'script': '/etc/xen/scripts/vif-bridge', 'frontend-id': '1', 'domain': 'fc4', 'frontend': '/local/domain/1/device/vif/0'} to /local/domain/0/backend/vif/1/0. [2005-11-11 16:29:25 xend.XendDomainInfo] DEBUG (XendDomainInfo:549) Storing VM details: {'ssidref': '0', 'uuid': '18ddf123-4b94-ced1-043c-3eb810c98e73', 'on_reboot': 'restart', 'image': "(linux (kernel /boot/vmlinuz-2.6-xenU) (root '/dev/sda1 ro') (args 'selinux=0') (vcpus 1) (vcpus 1) (boot c))", 'on_poweroff': 'destroy', 'name': 'fc4', 'vcpus': '1', 'vcpu_avail': '1', 'memory': '64', 'on_crash': 'restart', 'maxmem': '64'} [2005-11-11 16:29:25 xend.XendDomainInfo] DEBUG (XendDomainInfo:574) Storing domain details: {'console/ring-ref': '117573', 'console/port': '2', 'name': 'fc4', 'console/limit': '1048576', 'vm': '/vm/18ddf123-4b94-ced1-043c-3eb810c98e73', 'domid': '1', 'cpu/0/availability': 'online', 'memory/target': '65536', 'store/ring-ref': '117574', 'store/port': '1'} [2005-11-11 16:29:25 xend] DEBUG (DevController:69) Waiting for devices vif. [2005-11-11 16:29:25 xend] DEBUG (DevController:75) Waiting for 0. [2005-11-11 16:29:25 xend] DEBUG (DevController:69) Waiting for devices usb. [2005-11-11 16:29:25 xend] DEBUG (DevController:69) Waiting for devices vbd. [2005-11-11 16:29:25 xend] DEBUG (DevController:75) Waiting for 2049. [2005-11-11 16:31:25 xend] ERROR (SrvBase:87) Request wait_for_devices failed. Traceback (most recent call last): File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/web/SrvBase.py", line 85, in perform return op_method(op, req) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/server/SrvDomain.py", line 68, in op_wait_for_devices return self.dom.waitForDevices() File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 1200, in waitForDevices self.waitForDevices_(c) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/XendDomainInfo.py", line 856, in waitForDevices_ return self.getDeviceController(deviceClass).waitForDevices() File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/server/DevController.py", line 71, in waitForDevices return map(self.waitForDevice, self.deviceIDs()) File "/root/xen-unstable.hg/dist/install/usr/lib/python/xen/xend/server/DevController.py", line 80, in waitForDevice raise VmError( ("Device %s (%s) could not be connected. " VmError: Device 2049 (vbd) could not be connected. Hotplug scripts not working --2fHTh5uZTiUOsy+g Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel --2fHTh5uZTiUOsy+g--