* VM hangs during boot on 3.0.4 dom0 kernel, works on alternative hardware @ 2011-09-05 10:31 Anthony Wright 2011-09-06 16:16 ` Konrad Rzeszutek Wilk 0 siblings, 1 reply; 6+ messages in thread From: Anthony Wright @ 2011-09-05 10:31 UTC (permalink / raw) To: xen-devel@lists.xensource.com [-- Attachment #1: Type: text/plain, Size: 675 bytes --] I have two machines with identical Dom0's and DomUs, but different hardware. The Dom0 has a patch which I produced myself based on the "Re: [Xen-devel] Kernel bug from 3.0 (was phy disks and vifs timing out in DomU)" thread. The patch calls vmalloc_sync_all after every alloc_vm_area, and I realise this isn't the best solution, but it allowed me to move forward. The patch fixes the problem I had on one machine, so that now the VMs boot correctly, but I have another system with an identical setup (identical Dom0 & DomU kernels, identical startup for DomU) and the VM fails to start. I have attached a copy of the console log from the good VM and the bad VM. Anthony. [-- Attachment #2: bad.log --] [-- Type: text/plain, Size: 4725 bytes --] [ 3.226308] Reserving virtual address space above 0xf5800000 [ 3.226308] Linux version 2.6.30.1 (root@deb-builder) (gcc version 4.3.2 (GCC) ) #2 SMP Mon Jul 18 12:06:12 GMT 2011 [ 3.226308] KERNEL supported cpus: [ 3.226308] Intel GenuineIntel [ 3.226308] AMD AuthenticAMD [ 3.226308] NSC Geode by NSC [ 3.226308] Cyrix CyrixInstead [ 3.226308] Centaur CentaurHauls [ 3.226308] Transmeta GenuineTMx86 [ 3.226308] Transmeta TransmetaCPU [ 3.226308] UMC UMC UMC UMC [ 3.226308] BIOS-provided physical RAM map: [ 3.226308] Xen: 0000000000000000 - 00000000000a0000 (usable) [ 3.226308] Xen: 00000000000a0000 - 0000000000100000 (reserved) [ 3.226308] Xen: 0000000000100000 - 000000000065c000 (usable) [ 3.226308] Xen: 000000000065c000 - 0000000000759000 (reserved) [ 3.226308] Xen: 0000000000759000 - 000000003e800000 (usable) [ 3.226308] DMI not present or invalid. [ 3.226308] last_pfn = 0x3e800 max_arch_pfn = 0x1000000 [ 3.226308] init_memory_mapping: 0000000000000000-00000000229fe000 [ 3.226308] NX (Execute Disable) protection: active [ 3.226308] 446MB HIGHMEM available. [ 3.226308] 553MB LOWMEM available. [ 3.226308] mapped low ram: 0 - 229fe000 [ 3.226308] low ram: 0 - 229fe000 [ 3.226308] node 0 low ram: 00000000 - 229fe000 [ 3.226308] node 0 bootmap 00007000 - 0000b540 [ 3.226308] (7 early reservations) ==> bootmem [0000000000 - 00229fe000] [ 3.226308] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] [ 3.226308] #1 [0000759000 - 000075f000] XEN PAGETABLES ==> [0000759000 - 000075f000] [ 3.226308] #2 [0000001000 - 0000002000] EX TRAMPOLINE ==> [0000001000 - 0000002000] [ 3.226308] #3 [0000006000 - 0000007000] TRAMPOLINE ==> [0000006000 - 0000007000] [ 3.226308] #4 [0000100000 - 00005366f4] TEXT DATA BSS ==> [0000100000 - 00005366f4] [ 3.226308] #5 [0000537000 - 0000645000] PGTABLE ==> [0000537000 - 0000645000] [ 3.226308] #6 [0000007000 - 000000c000] BOOTMAP ==> [0000007000 - 000000c000] [ 3.226308] Zone PFN ranges: [ 3.226308] DMA 0x00000000 -> 0x00001000 [ 3.226308] Normal 0x00001000 -> 0x000229fe [ 3.226308] HighMem 0x000229fe -> 0x0003e800 [ 3.226308] Movable zone start PFN for each node [ 3.226308] early_node_map[3] active PFN ranges [ 3.226308] 0: 0x00000000 -> 0x000000a0 [ 3.226308] 0: 0x00000100 -> 0x0000065c [ 3.226308] 0: 0x00000759 -> 0x0003e800 [ 3.226308] Using APIC driver default [ 3.226308] SMP: Allowing 1 CPUs, 0 hotplug CPUs [ 3.226308] Local APIC disabled by BIOS -- you can enable it with "lapic" [ 3.226308] Allocating PCI resources starting at 40000000 (gap: 3e800000:c1800000) [ 3.226308] NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:1 nr_node_ids:1 [ 3.226308] PERCPU: Allocated 6 4k pages, static data 22940 bytes [ 3.810521] Xen: using vcpu_info placement [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 253650 [ 0.000000] Kernel command line: root=/dev/xvda1 [ 0.000000] Enabling fast FPU save and restore... done. [ 0.000000] Enabling unmasked SIMD FPU exception support... done. [ 0.000000] Initializing CPU#0 [ 0.000000] NR_IRQS:512 [ 0.000000] PID hash table entries: 4096 (order: 12, 16384 bytes) [ 0.000000] Detected 2533.458 MHz processor. [ 0.010000] Console: colour dummy device 80x25 [ 0.010000] console [tty0] enabled [ 0.010000] console [hvc0] enabled [ 0.010000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) [ 0.010000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) [ 0.010000] Initializing HighMem for node 0 (000229fe:0003e800) [ 0.010000] Memory: 1007448k/1024000k available (2539k kernel code, 14292k reserved, 1067k data, 244k init, 456712k highmem) [ 0.010000] virtual kernel memory layout: [ 0.010000] fixmap : 0xf574f000 - 0xf57ff000 ( 704 kB) [ 0.010000] pkmap : 0xf5200000 - 0xf5400000 (2048 kB) [ 0.010000] vmalloc : 0xe31fe000 - 0xf51fe000 ( 288 MB) [ 0.010000] lowmem : 0xc0000000 - 0xe29fe000 ( 553 MB) [ 0.010000] .init : 0xc0490000 - 0xc04cd000 ( 244 kB) [ 0.010000] .data : 0xc037ae1d - 0xc0485e18 (1067 kB) [ 0.010000] .text : 0xc0100000 - 0xc037ae1d (2539 kB) [ 0.010000] Checking if this processor honours the WP bit even in supervisor mode...Ok. [ 0.010000] installing Xen timer for CPU 0 [ 0.010000] Calibrating delay loop (skipped), value calculated using timer frequency.. 5066.91 BogoMIPS (lpj=25334580) [ 0.010000] Mount-cache hash table entries: 512 [-- Attachment #3: good.log --] [-- Type: text/plain, Size: 8879 bytes --] [ 3.226308] Reserving virtual address space above 0xf5800000 [ 3.226308] Linux version 2.6.30.1 (root@deb-builder) (gcc version 4.3.2 (GCC) ) #2 SMP Mon Jul 18 12:06:12 GMT 2011 [ 3.226308] KERNEL supported cpus: [ 3.226308] Intel GenuineIntel [ 3.226308] AMD AuthenticAMD [ 3.226308] NSC Geode by NSC [ 3.226308] Cyrix CyrixInstead [ 3.226308] Centaur CentaurHauls [ 3.226308] Transmeta GenuineTMx86 [ 3.226308] Transmeta TransmetaCPU [ 3.226308] UMC UMC UMC UMC [ 3.226308] BIOS-provided physical RAM map: [ 3.226308] Xen: 0000000000000000 - 00000000000a0000 (usable) [ 3.226308] Xen: 00000000000a0000 - 0000000000100000 (reserved) [ 3.226308] Xen: 0000000000100000 - 000000000065c000 (usable) [ 3.226308] Xen: 000000000065c000 - 0000000000759000 (reserved) [ 3.226308] Xen: 0000000000759000 - 000000003e800000 (usable) [ 3.226308] DMI not present or invalid. [ 3.226308] last_pfn = 0x3e800 max_arch_pfn = 0x1000000 [ 3.226308] init_memory_mapping: 0000000000000000-00000000229fe000 [ 3.226308] NX (Execute Disable) protection: active [ 3.226308] 446MB HIGHMEM available. [ 3.226308] 553MB LOWMEM available. [ 3.226308] mapped low ram: 0 - 229fe000 [ 3.226308] low ram: 0 - 229fe000 [ 3.226308] node 0 low ram: 00000000 - 229fe000 [ 3.226308] node 0 bootmap 00007000 - 0000b540 [ 3.226308] (7 early reservations) ==> bootmem [0000000000 - 00229fe000] [ 3.226308] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] [ 3.226308] #1 [0000759000 - 000075f000] XEN PAGETABLES ==> [0000759000 - 000075f000] [ 3.226308] #2 [0000001000 - 0000002000] EX TRAMPOLINE ==> [0000001000 - 0000002000] [ 3.226308] #3 [0000006000 - 0000007000] TRAMPOLINE ==> [0000006000 - 0000007000] [ 3.226308] #4 [0000100000 - 00005366f4] TEXT DATA BSS ==> [0000100000 - 00005366f4] [ 3.226308] #5 [0000537000 - 0000645000] PGTABLE ==> [0000537000 - 000 default [ 3.226308] SMP: Allowing 1 CPUs, 0 hotplug CPUs [ 3.226308] Local APIC disabled by BIOS -- you can enable it with "lapic" [ 3.226308] Allocating PCI resources starting at 40000000 (gap: 3e800000:c1800000) [ 3.226308] NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:1 nr_node_ids:1 [ 3.226308] PERCPU: Allocated 6 4k pages, static data 22940 bytes [ 3.810521] Xen: using vcpu_info placement [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 253650 [ 0.000000] Kernel command line: root=/dev/xvda1 [ 0.000000] Enabling fast FPU save and restore... done. [ 0.000000] Enabling unmasked SIMD FPU exception support... done. [ 0.000000] Initializing CPU#0 [ 0.000000] NR_IRQS:512 [ 0.000000] PID hash table entries: 4096 (order: 12, 16384 bytes) [ 0.000000] Detected 3013.788 MHz processor. [ 0.010000] Console: colour dummy device 80x25 [ 0.010000] console [tty0] enabled [ 0.010000] console [hvc0] enabled [ 0.010000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) [ 0.010000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) [ 0.010000] Initializing HighMem for node 0 (000229fe:0003e800) [ 0.010000] Memory: 1007448k/1024000k available (2539k kernel code, 14292k reserved, 1067k data, 244k init, 456712k highmem) [ 0.010000] virtual kernel memory layout: [ 0.010000] fixmap : 0xf574f000 - 0xf57ff000 ( 704 kB) [ 0.010000] pkmap : 0xf5200000 - 0xf5400000 (2048 kB) [ 0.010000] vmalloc : 0xe31fe000 - 0xf51fe000 ( 288 MB) [ 0.010000] lowmem : 0xc0000000 - 0xe29fe000 ( 553 MB) [ 0.010000] .init : 0xc0490000 - 0xc04cd000 ( 244 kB) [ 0.010000] .data : 0xc037ae1d - 0xc0485e18 (1067 kB) [ 0.010000] .text : 0xc0100000 - 0xc037ae1d (2539 kB) [ 0.010000] Checking if this processor honours the WP bit even in supervisor mode...Ok. [ 0.010000] installing Xen timer for CPU 0 [ 0.010000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6027.57 BogoMIPS (lpj=30137880) [ 0.010000] Mount-cache hash table entries: 512 [ 0.010000] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line) [ 0.010000] CPU: L2 Cache: 1024K (64 bytes/line) [ 0.010000] CPU: Physical Processor ID: 0 [ 0.010000] CPU: Processor Core ID: 0 [ 0.010000] SMP alternatives: switching to UP code [ 0.010000] Freeing SMP alternatives: 28k freed [ 0.010180] Brought up 1 CPUs [ 0.010394] net_namespace: 452 bytes [ 0.010403] Booting paravirtualized kernel on Xen [ 0.010408] Xen version: 4.1.1 (preserve-AD) [ 0.010445] xor: automatically using best checksumming function: pIII_sse [ 0.060003] pIII_sse : 2499.200 MB/sec [ 0.060011] xor: using function: pIII_sse (2499.200 MB/sec) [ 0.060054] Grant table initialized [ 0.060094] NET: Registered protocol family 16 [ 0.062835] bio: create slab <bio-0> at 0 [ 0.063164] xen_balloon: Initialising balloon driver. [ 0.230016] raid6: int32x1 774 MB/s [ 0.400011] raid6: int32x2 1342 MB/s [ 0.570087] raid6: int32x4 649 MB/s [ 0.740008] raid6: int32x8 802 MB/s [ 0.910011] raid6: mmxx1 2348 MB/s [ 1.080015] raid6: mmxx2 4362 MB/s [ 1.250030] raid6: sse1x1 1907 MB/s [ 1.420018] raid6: sse1x2 2746 MB/s [ 1.590025] raid6: sse2x1 3313 MB/s [ 1.760017] raid6: sse2x2 4325 MB/s [ 1.760033] raid6: using algorithm sse2x2 (4325 MB/s) [ 1.760643] NET: Registered protocol family 2 [ 1.760683] IP route cache hash table entries: 32768 (order: 5, 131072 bytes) [ 1.760767] TCP established hash table entries: 131072 (order: 8, 1048576 bytes) [ 1.761182] TCP bind hash table entries: 65536 (order: 7, 524288 bytes) [ 1.761437] TCP: Hash tables configured (established 131072 bind 65536) [ 1.761445] TCP reno registered [ 1.761513] NET: Registered protocol family 1 [ 1.761732] platform rtc_cmos: registered platform RTC device (no PNP device found) [ 1.762311] highmem bounce pool size: 64 pages [ 1.762325] HugeTLB registered 2 MB page size, pre-allocated 0 pages [ 1.762389] VFS: Disk quotas dquot_6.5.2 [ 1.762401] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes) [ 1.762499] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 1.762596] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). [ 1.762940] msgmni has been set to 1107 [ 1.763134] alg: No test for stdrng (krng) [ 1.763146] async_tx: api initialized (sync-only) [ 1.763155] io scheduler noop registered [ 1.763160] io scheduler anticipatory registered (default) [ 1.763165] io scheduler deadline registered [ 1.763180] io scheduler cfq registered [ 1.766472] loop: module loaded [ 1.783564] Initialising Xen virtual ethernet driver. [ 1.785475] blkfront: xvda1: barriers enabled [ 1.788158] blkfront: xvda2: barriers enabled [ 1.789731] i8042.c: No controller found. [ 1.790197] mice: PS/2 mouse device common for all mice [ 1.790238] md: linear personality registered for level -1 [ 1.790244] md: raid0 personality registered for level 0 [ 1.790249] md: raid1 personality registered for level 1 [ 1.790254] md: raid10 personality registered for level 10 [ 1.790259] md: raid6 personality registered for level 6 [ 1.790264] md: raid5 personality registered for level 5 [ 1.790268] md: raid4 personality registered for level 4 [ 1.790273] md: multipath personality registered for level -4 [ 1.790278] md: faulty personality registered for level -5 [ 1.790305] device-mapper: uevent: version 1.0.3 [ 1.790378] device-mapper: ioctl: 4.14.0-ioctl (2008-04-23) initialised: dm-devel@redhat.com [ 1.790454] device-mapper: multipath: version 1.0.5 loaded [ 1.790460] device-mapper: multipath round-robin: version 1.0.0 loaded [ 1.790554] oprofile: using timer interrupt. [ 1.790565] Netfilter messages via NETLINK v0.30. [ 1.790604] xt_time: kernel timezone is -0000 [ 1.790625] ip_tables: (C) 2000-2006 Netfilter Core Team [ 1.790646] arp_tables: (C) 2002 David S. Miller [ 1.790656] TCP cubic registered [ 1.790661] NET: Registered protocol family 17 [ 1.790680] Bridge firewalling registered [ 1.790742] RPC: Registered udp transport module. [ 1.790747] RPC: Registered tcp transport module. [ 1.790766] Using IPI No-Shortcut mode [ 1.890171] md: Waiting for all devices to be available before autodetect [ 1.890188] md: If you don't use raid, use raid=noautodetect [ 1.890361] md: Autodetecting RAID arrays. [ 1.890367] md: Scanned 0 and added 0 devices. [ 1.890371] md: autorun ... [ 1.890374] md: ... autorun DONE. [ 1.892999] VFS: Mounted root (squashfs filesystem) readonly on device 202:1. [ 1.893048] Freeing unused kernel memory: 244k freed [-- Attachment #4: Type: text/plain, Size: 138 bytes --] _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: VM hangs during boot on 3.0.4 dom0 kernel, works on alternative hardware 2011-09-05 10:31 VM hangs during boot on 3.0.4 dom0 kernel, works on alternative hardware Anthony Wright @ 2011-09-06 16:16 ` Konrad Rzeszutek Wilk 2011-09-07 12:29 ` Anthony Wright 2011-09-10 20:50 ` Anthony Wright 0 siblings, 2 replies; 6+ messages in thread From: Konrad Rzeszutek Wilk @ 2011-09-06 16:16 UTC (permalink / raw) To: Anthony Wright; +Cc: xen-devel@lists.xensource.com On Mon, Sep 05, 2011 at 11:31:16AM +0100, Anthony Wright wrote: > I have two machines with identical Dom0's and DomUs, but different > hardware. The Dom0 has a patch which I produced myself based on the "Re: > [Xen-devel] Kernel bug from 3.0 (was phy disks and vifs timing out in > DomU)" thread. The patch calls vmalloc_sync_all after every > alloc_vm_area, and I realise this isn't the best solution, but it > allowed me to move forward. <nods> > > The patch fixes the problem I had on one machine, so that now the VMs > boot correctly, but I have another system with an identical setup > (identical Dom0 & DomU kernels, identical startup for DomU) and the VM > fails to start. I have attached a copy of the console log from the good > VM and the bad VM. And what does the dom0 and xen hypervisor log give you? It looks to be hanging at identifying the CPU - is the hardware quite different from one setup to another? Have you toyed with using the cpuid flag in the guest to mimic the lowest CPU type? > > Anthony. > > > [ 3.226308] Reserving virtual address space above 0xf5800000 > [ 3.226308] Linux version 2.6.30.1 (root@deb-builder) (gcc version 4.3.2 (GCC) ) #2 SMP Mon Jul 18 12:06:12 GMT 2011 > [ 3.226308] KERNEL supported cpus: > [ 3.226308] Intel GenuineIntel > [ 3.226308] AMD AuthenticAMD > [ 3.226308] NSC Geode by NSC > [ 3.226308] Cyrix CyrixInstead > [ 3.226308] Centaur CentaurHauls > [ 3.226308] Transmeta GenuineTMx86 > [ 3.226308] Transmeta TransmetaCPU > [ 3.226308] UMC UMC UMC UMC > [ 3.226308] BIOS-provided physical RAM map: > [ 3.226308] Xen: 0000000000000000 - 00000000000a0000 (usable) > [ 3.226308] Xen: 00000000000a0000 - 0000000000100000 (reserved) > [ 3.226308] Xen: 0000000000100000 - 000000000065c000 (usable) > [ 3.226308] Xen: 000000000065c000 - 0000000000759000 (reserved) > [ 3.226308] Xen: 0000000000759000 - 000000003e800000 (usable) > [ 3.226308] DMI not present or invalid. > [ 3.226308] last_pfn = 0x3e800 max_arch_pfn = 0x1000000 > [ 3.226308] init_memory_mapping: 0000000000000000-00000000229fe000 > [ 3.226308] NX (Execute Disable) protection: active > [ 3.226308] 446MB HIGHMEM available. > [ 3.226308] 553MB LOWMEM available. > [ 3.226308] mapped low ram: 0 - 229fe000 > [ 3.226308] low ram: 0 - 229fe000 > [ 3.226308] node 0 low ram: 00000000 - 229fe000 > [ 3.226308] node 0 bootmap 00007000 - 0000b540 > [ 3.226308] (7 early reservations) ==> bootmem [0000000000 - 00229fe000] > [ 3.226308] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] > [ 3.226308] #1 [0000759000 - 000075f000] XEN PAGETABLES ==> [0000759000 - 000075f000] > [ 3.226308] #2 [0000001000 - 0000002000] EX TRAMPOLINE ==> [0000001000 - 0000002000] > [ 3.226308] #3 [0000006000 - 0000007000] TRAMPOLINE ==> [0000006000 - 0000007000] > [ 3.226308] #4 [0000100000 - 00005366f4] TEXT DATA BSS ==> [0000100000 - 00005366f4] > [ 3.226308] #5 [0000537000 - 0000645000] PGTABLE ==> [0000537000 - 0000645000] > [ 3.226308] #6 [0000007000 - 000000c000] BOOTMAP ==> [0000007000 - 000000c000] > [ 3.226308] Zone PFN ranges: > [ 3.226308] DMA 0x00000000 -> 0x00001000 > [ 3.226308] Normal 0x00001000 -> 0x000229fe > [ 3.226308] HighMem 0x000229fe -> 0x0003e800 > [ 3.226308] Movable zone start PFN for each node > [ 3.226308] early_node_map[3] active PFN ranges > [ 3.226308] 0: 0x00000000 -> 0x000000a0 > [ 3.226308] 0: 0x00000100 -> 0x0000065c > [ 3.226308] 0: 0x00000759 -> 0x0003e800 > [ 3.226308] Using APIC driver default > [ 3.226308] SMP: Allowing 1 CPUs, 0 hotplug CPUs > [ 3.226308] Local APIC disabled by BIOS -- you can enable it with "lapic" > [ 3.226308] Allocating PCI resources starting at 40000000 (gap: 3e800000:c1800000) > [ 3.226308] NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:1 nr_node_ids:1 > [ 3.226308] PERCPU: Allocated 6 4k pages, static data 22940 bytes > [ 3.810521] Xen: using vcpu_info placement > [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 253650 > [ 0.000000] Kernel command line: root=/dev/xvda1 > [ 0.000000] Enabling fast FPU save and restore... done. > [ 0.000000] Enabling unmasked SIMD FPU exception support... done. > [ 0.000000] Initializing CPU#0 > [ 0.000000] NR_IRQS:512 > [ 0.000000] PID hash table entries: 4096 (order: 12, 16384 bytes) > [ 0.000000] Detected 2533.458 MHz processor. > [ 0.010000] Console: colour dummy device 80x25 > [ 0.010000] console [tty0] enabled > [ 0.010000] console [hvc0] enabled > [ 0.010000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) > [ 0.010000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) > [ 0.010000] Initializing HighMem for node 0 (000229fe:0003e800) > [ 0.010000] Memory: 1007448k/1024000k available (2539k kernel code, 14292k reserved, 1067k data, 244k init, 456712k highmem) > [ 0.010000] virtual kernel memory layout: > [ 0.010000] fixmap : 0xf574f000 - 0xf57ff000 ( 704 kB) > [ 0.010000] pkmap : 0xf5200000 - 0xf5400000 (2048 kB) > [ 0.010000] vmalloc : 0xe31fe000 - 0xf51fe000 ( 288 MB) > [ 0.010000] lowmem : 0xc0000000 - 0xe29fe000 ( 553 MB) > [ 0.010000] .init : 0xc0490000 - 0xc04cd000 ( 244 kB) > [ 0.010000] .data : 0xc037ae1d - 0xc0485e18 (1067 kB) > [ 0.010000] .text : 0xc0100000 - 0xc037ae1d (2539 kB) > [ 0.010000] Checking if this processor honours the WP bit even in supervisor mode...Ok. > [ 0.010000] installing Xen timer for CPU 0 > [ 0.010000] Calibrating delay loop (skipped), value calculated using timer frequency.. 5066.91 BogoMIPS (lpj=25334580) > [ 0.010000] Mount-cache hash table entries: 512 > [ 3.226308] Reserving virtual address space above 0xf5800000 > [ 3.226308] Linux version 2.6.30.1 (root@deb-builder) (gcc version 4.3.2 (GCC) ) #2 SMP Mon Jul 18 12:06:12 GMT 2011 > [ 3.226308] KERNEL supported cpus: > [ 3.226308] Intel GenuineIntel > [ 3.226308] AMD AuthenticAMD > [ 3.226308] NSC Geode by NSC > [ 3.226308] Cyrix CyrixInstead > [ 3.226308] Centaur CentaurHauls > [ 3.226308] Transmeta GenuineTMx86 > [ 3.226308] Transmeta TransmetaCPU > [ 3.226308] UMC UMC UMC UMC > [ 3.226308] BIOS-provided physical RAM map: > [ 3.226308] Xen: 0000000000000000 - 00000000000a0000 (usable) > [ 3.226308] Xen: 00000000000a0000 - 0000000000100000 (reserved) > [ 3.226308] Xen: 0000000000100000 - 000000000065c000 (usable) > [ 3.226308] Xen: 000000000065c000 - 0000000000759000 (reserved) > [ 3.226308] Xen: 0000000000759000 - 000000003e800000 (usable) > [ 3.226308] DMI not present or invalid. > [ 3.226308] last_pfn = 0x3e800 max_arch_pfn = 0x1000000 > [ 3.226308] init_memory_mapping: 0000000000000000-00000000229fe000 > [ 3.226308] NX (Execute Disable) protection: active > [ 3.226308] 446MB HIGHMEM available. > [ 3.226308] 553MB LOWMEM available. > [ 3.226308] mapped low ram: 0 - 229fe000 > [ 3.226308] low ram: 0 - 229fe000 > [ 3.226308] node 0 low ram: 00000000 - 229fe000 > [ 3.226308] node 0 bootmap 00007000 - 0000b540 > [ 3.226308] (7 early reservations) ==> bootmem [0000000000 - 00229fe000] > [ 3.226308] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] > [ 3.226308] #1 [0000759000 - 000075f000] XEN PAGETABLES ==> [0000759000 - 000075f000] > [ 3.226308] #2 [0000001000 - 0000002000] EX TRAMPOLINE ==> [0000001000 - 0000002000] > [ 3.226308] #3 [0000006000 - 0000007000] TRAMPOLINE ==> [0000006000 - 0000007000] > [ 3.226308] #4 [0000100000 - 00005366f4] TEXT DATA BSS ==> [0000100000 - 00005366f4] > [ 3.226308] #5 [0000537000 - 0000645000] PGTABLE ==> [0000537000 - 000 default > [ 3.226308] SMP: Allowing 1 CPUs, 0 hotplug CPUs > [ 3.226308] Local APIC disabled by BIOS -- you can enable it with "lapic" > [ 3.226308] Allocating PCI resources starting at 40000000 (gap: 3e800000:c1800000) > [ 3.226308] NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:1 nr_node_ids:1 > [ 3.226308] PERCPU: Allocated 6 4k pages, static data 22940 bytes > [ 3.810521] Xen: using vcpu_info placement > [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 253650 > [ 0.000000] Kernel command line: root=/dev/xvda1 > [ 0.000000] Enabling fast FPU save and restore... done. > [ 0.000000] Enabling unmasked SIMD FPU exception support... done. > [ 0.000000] Initializing CPU#0 > [ 0.000000] NR_IRQS:512 > [ 0.000000] PID hash table entries: 4096 (order: 12, 16384 bytes) > [ 0.000000] Detected 3013.788 MHz processor. > [ 0.010000] Console: colour dummy device 80x25 > [ 0.010000] console [tty0] enabled > [ 0.010000] console [hvc0] enabled > [ 0.010000] Dentry cache hash table entries: 131072 (order: 7, 524288 bytes) > [ 0.010000] Inode-cache hash table entries: 65536 (order: 6, 262144 bytes) > [ 0.010000] Initializing HighMem for node 0 (000229fe:0003e800) > [ 0.010000] Memory: 1007448k/1024000k available (2539k kernel code, 14292k reserved, 1067k data, 244k init, 456712k highmem) > [ 0.010000] virtual kernel memory layout: > [ 0.010000] fixmap : 0xf574f000 - 0xf57ff000 ( 704 kB) > [ 0.010000] pkmap : 0xf5200000 - 0xf5400000 (2048 kB) > [ 0.010000] vmalloc : 0xe31fe000 - 0xf51fe000 ( 288 MB) > [ 0.010000] lowmem : 0xc0000000 - 0xe29fe000 ( 553 MB) > [ 0.010000] .init : 0xc0490000 - 0xc04cd000 ( 244 kB) > [ 0.010000] .data : 0xc037ae1d - 0xc0485e18 (1067 kB) > [ 0.010000] .text : 0xc0100000 - 0xc037ae1d (2539 kB) > [ 0.010000] Checking if this processor honours the WP bit even in supervisor mode...Ok. > [ 0.010000] installing Xen timer for CPU 0 > [ 0.010000] Calibrating delay loop (skipped), value calculated using timer frequency.. 6027.57 BogoMIPS (lpj=30137880) > [ 0.010000] Mount-cache hash table entries: 512 > [ 0.010000] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line) > [ 0.010000] CPU: L2 Cache: 1024K (64 bytes/line) > [ 0.010000] CPU: Physical Processor ID: 0 > [ 0.010000] CPU: Processor Core ID: 0 > [ 0.010000] SMP alternatives: switching to UP code > [ 0.010000] Freeing SMP alternatives: 28k freed > [ 0.010180] Brought up 1 CPUs > [ 0.010394] net_namespace: 452 bytes > [ 0.010403] Booting paravirtualized kernel on Xen > [ 0.010408] Xen version: 4.1.1 (preserve-AD) > [ 0.010445] xor: automatically using best checksumming function: pIII_sse > [ 0.060003] pIII_sse : 2499.200 MB/sec > [ 0.060011] xor: using function: pIII_sse (2499.200 MB/sec) > [ 0.060054] Grant table initialized > [ 0.060094] NET: Registered protocol family 16 > [ 0.062835] bio: create slab <bio-0> at 0 > [ 0.063164] xen_balloon: Initialising balloon driver. > [ 0.230016] raid6: int32x1 774 MB/s > [ 0.400011] raid6: int32x2 1342 MB/s > [ 0.570087] raid6: int32x4 649 MB/s > [ 0.740008] raid6: int32x8 802 MB/s > [ 0.910011] raid6: mmxx1 2348 MB/s > [ 1.080015] raid6: mmxx2 4362 MB/s > [ 1.250030] raid6: sse1x1 1907 MB/s > [ 1.420018] raid6: sse1x2 2746 MB/s > [ 1.590025] raid6: sse2x1 3313 MB/s > [ 1.760017] raid6: sse2x2 4325 MB/s > [ 1.760033] raid6: using algorithm sse2x2 (4325 MB/s) > [ 1.760643] NET: Registered protocol family 2 > [ 1.760683] IP route cache hash table entries: 32768 (order: 5, 131072 bytes) > [ 1.760767] TCP established hash table entries: 131072 (order: 8, 1048576 bytes) > [ 1.761182] TCP bind hash table entries: 65536 (order: 7, 524288 bytes) > [ 1.761437] TCP: Hash tables configured (established 131072 bind 65536) > [ 1.761445] TCP reno registered > [ 1.761513] NET: Registered protocol family 1 > [ 1.761732] platform rtc_cmos: registered platform RTC device (no PNP device found) > [ 1.762311] highmem bounce pool size: 64 pages > [ 1.762325] HugeTLB registered 2 MB page size, pre-allocated 0 pages > [ 1.762389] VFS: Disk quotas dquot_6.5.2 > [ 1.762401] Dquot-cache hash table entries: 1024 (order 0, 4096 bytes) > [ 1.762499] squashfs: version 4.0 (2009/01/31) Phillip Lougher > [ 1.762596] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). > [ 1.762940] msgmni has been set to 1107 > [ 1.763134] alg: No test for stdrng (krng) > [ 1.763146] async_tx: api initialized (sync-only) > [ 1.763155] io scheduler noop registered > [ 1.763160] io scheduler anticipatory registered (default) > [ 1.763165] io scheduler deadline registered > [ 1.763180] io scheduler cfq registered > [ 1.766472] loop: module loaded > [ 1.783564] Initialising Xen virtual ethernet driver. > [ 1.785475] blkfront: xvda1: barriers enabled > [ 1.788158] blkfront: xvda2: barriers enabled > [ 1.789731] i8042.c: No controller found. > [ 1.790197] mice: PS/2 mouse device common for all mice > [ 1.790238] md: linear personality registered for level -1 > [ 1.790244] md: raid0 personality registered for level 0 > [ 1.790249] md: raid1 personality registered for level 1 > [ 1.790254] md: raid10 personality registered for level 10 > [ 1.790259] md: raid6 personality registered for level 6 > [ 1.790264] md: raid5 personality registered for level 5 > [ 1.790268] md: raid4 personality registered for level 4 > [ 1.790273] md: multipath personality registered for level -4 > [ 1.790278] md: faulty personality registered for level -5 > [ 1.790305] device-mapper: uevent: version 1.0.3 > [ 1.790378] device-mapper: ioctl: 4.14.0-ioctl (2008-04-23) initialised: dm-devel@redhat.com > [ 1.790454] device-mapper: multipath: version 1.0.5 loaded > [ 1.790460] device-mapper: multipath round-robin: version 1.0.0 loaded > [ 1.790554] oprofile: using timer interrupt. > [ 1.790565] Netfilter messages via NETLINK v0.30. > [ 1.790604] xt_time: kernel timezone is -0000 > [ 1.790625] ip_tables: (C) 2000-2006 Netfilter Core Team > [ 1.790646] arp_tables: (C) 2002 David S. Miller > [ 1.790656] TCP cubic registered > [ 1.790661] NET: Registered protocol family 17 > [ 1.790680] Bridge firewalling registered > [ 1.790742] RPC: Registered udp transport module. > [ 1.790747] RPC: Registered tcp transport module. > [ 1.790766] Using IPI No-Shortcut mode > [ 1.890171] md: Waiting for all devices to be available before autodetect > [ 1.890188] md: If you don't use raid, use raid=noautodetect > [ 1.890361] md: Autodetecting RAID arrays. > [ 1.890367] md: Scanned 0 and added 0 devices. > [ 1.890371] md: autorun ... > [ 1.890374] md: ... autorun DONE. > [ 1.892999] VFS: Mounted root (squashfs filesystem) readonly on device 202:1. > [ 1.893048] Freeing unused kernel memory: 244k freed > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xensource.com > http://lists.xensource.com/xen-devel ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: VM hangs during boot on 3.0.4 dom0 kernel, works on alternative hardware 2011-09-06 16:16 ` Konrad Rzeszutek Wilk @ 2011-09-07 12:29 ` Anthony Wright 2011-09-10 20:50 ` Anthony Wright 1 sibling, 0 replies; 6+ messages in thread From: Anthony Wright @ 2011-09-07 12:29 UTC (permalink / raw) To: Konrad Rzeszutek Wilk; +Cc: xen-devel@lists.xensource.com [-- Attachment #1: Type: text/plain, Size: 1943 bytes --] On 06/09/2011 17:16, Konrad Rzeszutek Wilk wrote: > On Mon, Sep 05, 2011 at 11:31:16AM +0100, Anthony Wright wrote: >> I have two machines with identical Dom0's and DomUs, but different >> hardware. The Dom0 has a patch which I produced myself based on the "Re: >> [Xen-devel] Kernel bug from 3.0 (was phy disks and vifs timing out in >> DomU)" thread. The patch calls vmalloc_sync_all after every >> alloc_vm_area, and I realise this isn't the best solution, but it >> allowed me to move forward. > <nods> >> The patch fixes the problem I had on one machine, so that now the VMs >> boot correctly, but I have another system with an identical setup >> (identical Dom0 & DomU kernels, identical startup for DomU) and the VM >> fails to start. I have attached a copy of the console log from the good >> VM and the bad VM. > And what does the dom0 and xen hypervisor log give you? Not a lot, I've attached good/bad dmesg & xend.logs, but I can't see much indicative in them, other than some errors about L1 entries in the good dmesg log which I believe are related to the bug with I patched (I'll report in other thread). > It looks to be hanging at identifying the CPU - is the hardware > quite different from one setup to another? Have you toyed with > using the cpuid flag in the guest to mimic the lowest CPU type? Yes the hardware is quite a lot different. I've had a good look at the cpuid flag, found the cpuid utility & wikipedia page, but I can't find much documentation on the xen cpuid parameter other than some fairly arcane entries in xmexample.hvm. The cpuid utility produces output in hex, while the cpuid flag wants input in binary (with extra controls). Is there any formal documentation that describes cpuid, or an easy way to generate cpuid parameter values? Also my DomU is PV rather than HVM and I see that cpuid is only in HVM xmexample files. Is this just a coincidence or is cpuid a HVM only feature? thanks, Anthony. [-- Attachment #2: bad-dmesg.log --] [-- Type: text/plain, Size: 6242 bytes --] __ __ _ _ _ _ \ \/ /___ _ __ | || | / | / | \ // _ \ '_ \ | || |_ | | | | / \ __/ | | | |__ _|| |_| | /_/\_\___|_| |_| |_|(_)_(_)_| (XEN) Xen version 4.1.1 (@[unknown]) (gcc version 4.4.3 (GCC) ) Tue Aug 30 19:32:56 GMT 2011 (XEN) Latest ChangeSet: unavailable (XEN) Bootloader: GNU GRUB 0.97 (XEN) Command line: dom0_mem=700M sched=credit (XEN) Video information: (XEN) VGA is text mode 80x25, font 8x16 (XEN) VBE/DDC methods: none; EDID transfer time: 2 seconds (XEN) EDID info not retrieved because no DDC retrieval method detected (XEN) Disc information: (XEN) Found 1 MBR signatures (XEN) Found 1 EDD information structures (XEN) WARNING: Only the first 16 GB of the physical memory map can be accessed by Xen in 32-bit mode. (XEN) Truncating RAM from 17301500kB to 16777216kB (XEN) Xen-e820 RAM map: (XEN) 0000000000000000 - 000000000009f400 (usable) (XEN) 000000000009f400 - 00000000000a0000 (reserved) (XEN) 00000000000f0000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000df62f000 (usable) (XEN) 00000000df62f000 - 00000000df63c000 (ACPI data) (XEN) 00000000df63c000 - 00000000df63d000 (usable) (XEN) 00000000df63d000 - 00000000e4000000 (reserved) (XEN) 00000000fec00000 - 00000000fee10000 (reserved) (XEN) 00000000ff800000 - 0000000100000000 (reserved) (XEN) 0000000100000000 - 0000000400000000 (usable) (XEN) 0000000400000000 - 000000041ffff000 (unusable) (XEN) System RAM: 15861MB (16242492kB) (XEN) ACPI: RSDP 000F4F00, 0024 (r2 HP ) (XEN) ACPI: XSDT DF630140, 00B4 (r1 HP ProLiant 2 � 162E) (XEN) ACPI: FACP DF630240, 00F4 (r3 HP ProLiant 2 � 162E) (XEN) ACPI: DSDT DF630340, 20BD (r1 HP DSDT 1 INTL 20030228) (XEN) ACPI: FACS DF62F100, 0040 (XEN) ACPI: SPCR DF62F140, 0050 (r1 HP SPCRRBSU 1 � 162E) (XEN) ACPI: MCFG DF62F1C0, 003C (r1 HP ProLiant 1 0) (XEN) ACPI: HPET DF62F200, 0038 (r1 HP ProLiant 2 � 162E) (XEN) ACPI: FFFF DF62F240, 0064 (r2 HP ProLiant 2 � 162E) (XEN) ACPI: SPMI DF62F2C0, 0040 (r5 HP ProLiant 1 � 162E) (XEN) ACPI: ERST DF62F300, 01D0 (r1 HP ProLiant 1 � 162E) (XEN) ACPI: APIC DF62F500, 015E (r1 HP ProLiant 2 0) (XEN) ACPI: SRAT DF62F680, 0570 (r1 HP Proliant 1 � 162E) (XEN) ACPI: FFFF DF62FC00, 0176 (r1 HP ProLiant 1 � 162E) (XEN) ACPI: BERT DF62FD80, 0030 (r1 HP ProLiant 1 � 162E) (XEN) ACPI: HEST DF62FDC0, 00BC (r1 HP ProLiant 1 � 162E) (XEN) ACPI: DMAR DF62FE80, 013C (r1 HP ProLiant 1 � 162E) (XEN) ACPI: SSDT DF632400, 0125 (r3 HP CRSPCI0 2 HP 1) (XEN) ACPI: SSDT DF632540, 01CF (r3 HP riser1a 2 INTL 20061109) (XEN) ACPI: SSDT DF632740, 03BB (r1 HP pcc 1 INTL 20090625) (XEN) ACPI: SSDT DF632B00, 0377 (r1 HP pmab 1 INTL 20090625) (XEN) ACPI: SSDT DF632E80, 2B64 (r1 INTEL PPM RCM 1 INTL 20061109) (XEN) Xen heap: 9MB (9788kB) (XEN) Domain heap initialised DMA width 31 bits (XEN) Processor #0 6:12 APIC version 21 (XEN) Processor #32 6:12 APIC version 21 (XEN) Processor #20 6:12 APIC version 21 (XEN) Processor #52 6:12 APIC version 21 (XEN) Processor #2 6:12 APIC version 21 (XEN) Processor #34 6:12 APIC version 21 (XEN) Processor #18 6:12 APIC version 21 (XEN) Processor #50 6:12 APIC version 21 (XEN) Processor #1 6:12 APIC version 21 (XEN) Processor #33 6:12 APIC version 21 (XEN) Processor #21 6:12 APIC version 21 (XEN) Processor #53 6:12 APIC version 21 (XEN) Processor #3 6:12 APIC version 21 (XEN) Processor #35 6:12 APIC version 21 (XEN) Processor #19 6:12 APIC version 21 (XEN) Processor #51 6:12 APIC version 21 (XEN) IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23 (XEN) IOAPIC[1]: apic_id 0, version 32, address 0xfec80000, GSI 24-47 (XEN) Enabling APIC mode: Phys. Using 2 I/O APICs (XEN) ERST table is invalid (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 2533.500 MHz processor. (XEN) Intel VT-d Snoop Control not enabled. (XEN) Intel VT-d Dom0 DMA Passthrough not enabled. (XEN) Intel VT-d Queued Invalidation enabled. (XEN) Intel VT-d Interrupt Remapping enabled. (XEN) Intel VT-d Shared EPT tables not enabled. (XEN) I/O virtualisation enabled (XEN) - Dom0 mode: Relaxed (XEN) Enabled directed EOI with ioapic_ack_old on! (XEN) ENABLING IO-APIC IRQs (XEN) -> Using old ACK method (XEN) Platform timer is 14.318MHz HPET (XEN) Allocated console ring of 32 KiB. (XEN) VMX: Supported advanced features: (XEN) - APIC MMIO access virtualisation (XEN) - APIC TPR shadow (XEN) - Extended Page Tables (EPT) (XEN) - Virtual-Processor Identifiers (VPID) (XEN) - Virtual NMI (XEN) - MSR direct-access bitmap (XEN) - Unrestricted Guest (XEN) EPT supports 1GB super page. (XEN) EPT supports 2MB super page. (XEN) HVM: ASIDs enabled. (XEN) HVM: VMX enabled (XEN) HVM: Hardware Assisted Paging detected. (XEN) Brought up 16 CPUs (XEN) *** LOADING DOMAIN 0 *** (XEN) Xen kernel: 32-bit, PAE, lsb (XEN) Dom0 kernel: 32-bit, PAE, lsb, paddr 0x400000 -> 0x1780000 (XEN) PHYSICAL MEMORY ARRANGEMENT: (XEN) Dom0 alloc.: 00000003f6000000->00000003f8000000 (170025 pages to be allocated) (XEN) Init. ramdisk: 00000003ffc29000->00000003fffff600 (XEN) VIRTUAL MEMORY ARRANGEMENT: (XEN) Loaded kernel: c0400000->c1780000 (XEN) Init. ramdisk: c1780000->c1b56600 (XEN) Phys-Mach map: c1b57000->c1c06000 (XEN) Start info: c1c06000->c1c0647c (XEN) Page tables: c1c07000->c1c1c000 (XEN) Boot stack: c1c1c000->c1c1d000 (XEN) TOTAL: c0000000->c2000000 (XEN) ENTRY ADDRESS: c13d9000 (XEN) Dom0 has maximum 16 VCPUs (XEN) Scrubbing Free RAM: .....................................................................................................................................................done. (XEN) Xen trace buffers: disabled (XEN) Std. Loglevel: Errors and warnings (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings) (XEN) Xen is relinquishing VGA console. (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen) (XEN) Freed 188kB init memory. [-- Attachment #3: bad-xend.log --] [-- Type: text/plain, Size: 3982 bytes --] [2011-09-07 11:15:10 3517] INFO (SrvDaemon:332) Xend Daemon started [2011-09-07 11:15:10 3517] INFO (SrvDaemon:336) Xend changeset: unavailable. [2011-09-07 11:15:10 3517] DEBUG (tcp:96) Listening on :8002 [2011-09-07 11:15:11 3517] DEBUG (XendNode:332) pscsi record count: 8 [2011-09-07 11:15:11 3517] DEBUG (XendCPUPool:747) recreate_active_pools [2011-09-07 11:15:12 3517] DEBUG (XendDomainInfo:151) XendDomainInfo.recreate({'max_vcpu_id': 15, 'cpu_time': 9593074214L, 'ssidref': 0, 'hvm': 0, 'shutdown_reason': 255, 'dying': 0, 'online_vcpus': 8, 'domid': 0, 'paused': 0, 'crashed': 0, 'running': 1, 'maxmem_kb': 4294967292L, 'shutdown': 0, 'mem_kb': 716800L, 'blocked': 0, 'handle': [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], 'cpupool': 0, 'name': 'Domain-0'}) [2011-09-07 11:15:12 3517] INFO (XendDomainInfo:168) Recreating domain 0, UUID 00000000-0000-0000-0000-000000000000. at /local/domain/0 [2011-09-07 11:15:12 3517] DEBUG (XendDomainInfo:3420) Storing VM details: {'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'shadow_memory': '0', 'uuid': '00000000-0000-0000-0000-000000000000', 'on_reboot': 'restart', 'image': "(linux (kernel '') (superpages 0) (tsc_mode 0) (nomigrate 0))", 'on_poweroff': 'destroy', 'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '8', 'vcpu_avail': '255', 'bootloader': '', 'name': 'Domain-0'} [2011-09-07 11:15:12 3517] DEBUG (XendDomainInfo:1794) Storing domain details: {'cpu/3/availability': 'online', 'description': '', 'console/limit': '1048576', 'memory/target': '716800', 'cpu/2/availability': 'online', 'vm': '/vm/00000000-0000-0000-0000-000000000000', 'domid': '0', 'cpu/7/availability': 'online', 'cpu/0/availability': 'online', 'cpu/1/availability': 'online', 'cpu/5/availability': 'online', 'control/platform-feature-multiprocessor-suspend': '1', 'cpu/6/availability': 'online', 'console/type': 'xenconsoled', 'cpu/4/availability': 'online', 'name': 'Domain-0'} [2011-09-07 11:15:12 3517] DEBUG (XendDomain:476) Adding Domain: 0 [2011-09-07 11:15:12 3517] DEBUG (XendDomain:410) number of vcpus to use is 0 [2011-09-07 11:15:12 3517] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch [2011-09-07 11:15:12 3517] WARNING (XendAPI:708) API call: VBD.set_device not found [2011-09-07 11:15:12 3517] WARNING (XendAPI:708) API call: VBD.set_type not found [2011-09-07 11:15:12 3517] WARNING (XendAPI:708) API call: session.get_all_records not found [2011-09-07 11:15:12 3517] WARNING (XendAPI:708) API call: event.get_record not found [2011-09-07 11:15:12 3517] WARNING (XendAPI:708) API call: event.get_all not found [2011-09-07 11:15:12 3517] WARNING (XendAPI:708) API call: VIF.set_device not found [2011-09-07 11:15:12 3517] WARNING (XendAPI:708) API call: VIF.set_MAC not found [2011-09-07 11:15:12 3517] WARNING (XendAPI:708) API call: VIF.set_MTU not found [2011-09-07 11:15:12 3517] WARNING (XendAPI:708) API call: debug.get_all not found [2011-09-07 11:15:12 3517] INFO (XMLRPCServer:161) Opening Unix domain socket XML-RPC server on /var/run/xend/xen-api.sock; authentication has been disabled for this server. [2011-09-07 11:15:12 3517] INFO (XMLRPCServer:161) Opening Unix domain socket XML-RPC server on /var/run/xend/xmlrpc.sock. [2011-09-07 11:15:27 3517] DEBUG (XendDomainInfo:151) XendDomainInfo.recreate({'max_vcpu_id': 0, 'cpu_time': 0L, 'ssidref': 0, 'hvm': 0, 'shutdown_reason': 255, 'dying': 0, 'online_vcpus': 1, 'domid': 1, 'paused': 1, 'crashed': 0, 'running': 0, 'maxmem_kb': 1025024L, 'shutdown': 0, 'mem_kb': 1024000L, 'handle': [234, 214, 244, 133, 57, 196, 77, 174, 191, 128, 243, 52, 17, 90, 250, 59], 'blocked': 0, 'cpupool': 0}) [2011-09-07 11:15:27 3517] INFO (XendDomainInfo:168) Recreating domain 1, UUID ead6f485-39c4-4dae-bf80-f334115afa3b. at /local/domain/1 [2011-09-07 11:15:27 3517] DEBUG (XendDomain:476) Adding Domain: 1 [2011-09-07 11:15:27 3517] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch [-- Attachment #4: good-dmesg.log --] [-- Type: text/plain, Size: 4293 bytes --] __ __ _ _ _ _ \ \/ /___ _ __ | || | / | / | \ // _ \ '_ \ | || |_ | | | | / \ __/ | | | |__ _|| |_| | /_/\_\___|_| |_| |_|(_)_(_)_| (XEN) Xen version 4.1.1 (@[unknown]) (gcc version 4.4.3 (GCC) ) Tue Aug 30 19:32:56 GMT 2011 (XEN) Latest ChangeSet: unavailable (XEN) Bootloader: GNU GRUB 0.97 (XEN) Command line: dom0_mem=400M sched=credit (XEN) Video information: (XEN) VGA is text mode 80x25, font 8x16 (XEN) VBE/DDC methods: none; EDID transfer time: 0 seconds (XEN) EDID info not retrieved because no DDC retrieval method detected (XEN) Disc information: (XEN) Found 2 MBR signatures (XEN) Found 2 EDD information structures (XEN) Xen-e820 RAM map: (XEN) 0000000000000000 - 000000000009b400 (usable) (XEN) 000000000009b400 - 00000000000a0000 (reserved) (XEN) 00000000000e2000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000aff90000 (usable) (XEN) 00000000aff90000 - 00000000aff9e000 (ACPI data) (XEN) 00000000aff9e000 - 00000000affe0000 (ACPI NVS) (XEN) 00000000affe0000 - 00000000affee000 (reserved) (XEN) 00000000afff0000 - 00000000b0000000 (reserved) (XEN) 00000000fec00000 - 00000000fec01000 (reserved) (XEN) 00000000fee00000 - 00000000fef00000 (reserved) (XEN) 00000000fff00000 - 0000000100000000 (reserved) (XEN) 0000000100000000 - 0000000140000000 (usable) (XEN) System RAM: 3839MB (3931308kB) (XEN) ACPI: RSDP 000FB5D0, 0014 (r0 ACPIAM) (XEN) ACPI: RSDT AFF90000, 0038 (r1 032210 RSDT1037 20100322 MSFT 97) (XEN) ACPI: FACP AFF90200, 0084 (r2 032210 FACP1037 20100322 MSFT 97) (XEN) ACPI: DSDT AFF90460, 7307 (r1 A1270 A1270000 0 INTL 20060113) (XEN) ACPI: FACS AFF9E000, 0040 (XEN) ACPI: APIC AFF90390, 0090 (r1 032210 APIC1037 20100322 MSFT 97) (XEN) ACPI: MCFG AFF90420, 003C (r1 032210 OEMMCFG 20100322 MSFT 97) (XEN) ACPI: OEMB AFF9E040, 0071 (r1 032210 OEMB1037 20100322 MSFT 97) (XEN) ACPI: HPET AFF97770, 0038 (r1 032210 OEMHPET0 20100322 MSFT 97) (XEN) Xen heap: 9MB (9788kB) (XEN) Domain heap initialised (XEN) Processor #0 0:6 APIC version 16 (XEN) Processor #1 0:6 APIC version 16 (XEN) IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23 (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs (XEN) Table is not found! (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 3013.752 MHz processor. (XEN) AMD-Vi: IOMMU not found! (XEN) I/O virtualisation disabled (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) Platform timer is 25.000MHz HPET (XEN) Allocated console ring of 16 KiB. (XEN) CPU0: AMD SVM Extension is disabled in BIOS. (XEN) SVM: failed to initialise. (XEN) Brought up 2 CPUs (XEN) *** LOADING DOMAIN 0 *** (XEN) Xen kernel: 32-bit, PAE, lsb (XEN) Dom0 kernel: 32-bit, PAE, lsb, paddr 0x400000 -> 0x1780000 (XEN) PHYSICAL MEMORY ARRANGEMENT: (XEN) Dom0 alloc.: 000000013a000000->000000013c000000 (93225 pages to be allocated) (XEN) Init. ramdisk: 000000013fc29000->000000013ffff600 (XEN) VIRTUAL MEMORY ARRANGEMENT: (XEN) Loaded kernel: c0400000->c1780000 (XEN) Init. ramdisk: c1780000->c1b56600 (XEN) Phys-Mach map: c1b57000->c1bbb000 (XEN) Start info: c1bbb000->c1bbb47c (XEN) Page tables: c1bbc000->c1bd1000 (XEN) Boot stack: c1bd1000->c1bd2000 (XEN) TOTAL: c0000000->c2000000 (XEN) ENTRY ADDRESS: c13d9000 (XEN) Dom0 has maximum 2 VCPUs (XEN) Scrubbing Free RAM: ..................................done. (XEN) Xen trace buffers: disabled (XEN) Std. Loglevel: Errors and warnings (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings) (XEN) Xen is relinquishing VGA console. (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input to Xen) (XEN) Freed 188kB init memory. (XEN) mm.c:907:d0 Error getting mfn 3a09c (pfn 55555555) from L1 entry 000000003a09c023 for l1e_owner=0, pg_owner=0 (XEN) mm.c:907:d0 Error getting mfn 3a09d (pfn 55555555) from L1 entry 000000003a09d023 for l1e_owner=0, pg_owner=0 (XEN) mm.c:907:d0 Error getting mfn 3a09e (pfn 55555555) from L1 entry 000000003a09e023 for l1e_owner=0, pg_owner=0 (XEN) mm.c:907:d0 Error getting mfn 3a09f (pfn 55555555) from L1 entry 000000003a09f023 for l1e_owner=0, pg_owner=0 (XEN) traps.c:2388:d0 Domain attempted WRMSR c0010004 from 0x0000ab23d6d622da to 0x000000000000abcd. [-- Attachment #5: good-xend.log --] [-- Type: text/plain, Size: 3787 bytes --] [2011-09-07 11:08:19 3021] INFO (SrvDaemon:332) Xend Daemon started [2011-09-07 11:08:19 3021] INFO (SrvDaemon:336) Xend changeset: unavailable. [2011-09-07 11:08:19 3021] DEBUG (tcp:96) Listening on :8002 [2011-09-07 11:08:20 3021] DEBUG (XendNode:332) pscsi record count: 11 [2011-09-07 11:08:20 3021] DEBUG (XendCPUPool:747) recreate_active_pools [2011-09-07 11:08:20 3021] DEBUG (XendDomainInfo:151) XendDomainInfo.recreate({'max_vcpu_id': 1, 'cpu_time': 5738793830L, 'ssidref': 0, 'hvm': 0, 'shutdown_reason': 255, 'dying': 0, 'online_vcpus': 2, 'domid': 0, 'paused': 0, 'crashed': 0, 'running': 1, 'maxmem_kb': 4294967292L, 'shutdown': 0, 'mem_kb': 409600L, 'blocked': 0, 'handle': [0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0], 'cpupool': 0, 'name': 'Domain-0'}) [2011-09-07 11:08:20 3021] INFO (XendDomainInfo:168) Recreating domain 0, UUID 00000000-0000-0000-0000-000000000000. at /local/domain/0 [2011-09-07 11:08:20 3021] DEBUG (XendDomainInfo:3420) Storing VM details: {'on_xend_stop': 'ignore', 'pool_name': 'Pool-0', 'shadow_memory': '0', 'uuid': '00000000-0000-0000-0000-000000000000', 'on_reboot': 'restart', 'image': "(linux (kernel '') (superpages 0) (tsc_mode 0) (nomigrate 0))", 'on_poweroff': 'destroy', 'bootloader_args': '', 'on_xend_start': 'ignore', 'on_crash': 'restart', 'xend/restart_count': '0', 'vcpus': '2', 'vcpu_avail': '3', 'bootloader': '', 'name': 'Domain-0'} [2011-09-07 11:08:20 3021] DEBUG (XendDomainInfo:1794) Storing domain details: {'description': '', 'console/limit': '1048576', 'memory/target': '409600', 'vm': '/vm/00000000-0000-0000-0000-000000000000', 'domid': '0', 'cpu/0/availability': 'online', 'cpu/1/availability': 'online', 'control/platform-feature-multiprocessor-suspend': '1', 'console/type': 'xenconsoled', 'name': 'Domain-0'} [2011-09-07 11:08:20 3021] DEBUG (XendDomain:476) Adding Domain: 0 [2011-09-07 11:08:20 3021] DEBUG (XendDomain:410) number of vcpus to use is 0 [2011-09-07 11:08:20 3021] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch [2011-09-07 11:08:20 3021] WARNING (XendAPI:708) API call: VBD.set_device not found [2011-09-07 11:08:20 3021] WARNING (XendAPI:708) API call: VBD.set_type not found [2011-09-07 11:08:20 3021] WARNING (XendAPI:708) API call: session.get_all_records not found [2011-09-07 11:08:20 3021] WARNING (XendAPI:708) API call: event.get_record not found [2011-09-07 11:08:20 3021] WARNING (XendAPI:708) API call: event.get_all not found [2011-09-07 11:08:20 3021] WARNING (XendAPI:708) API call: VIF.set_device not found [2011-09-07 11:08:20 3021] WARNING (XendAPI:708) API call: VIF.set_MAC not found [2011-09-07 11:08:20 3021] WARNING (XendAPI:708) API call: VIF.set_MTU not found [2011-09-07 11:08:20 3021] WARNING (XendAPI:708) API call: debug.get_all not found [2011-09-07 11:08:20 3021] INFO (XMLRPCServer:161) Opening Unix domain socket XML-RPC server on /var/run/xend/xen-api.sock; authentication has been disabled for this server. [2011-09-07 11:08:20 3021] INFO (XMLRPCServer:161) Opening Unix domain socket XML-RPC server on /var/run/xend/xmlrpc.sock. [2011-09-07 11:08:31 3021] DEBUG (XendDomainInfo:151) XendDomainInfo.recreate({'max_vcpu_id': 0, 'cpu_time': 0L, 'ssidref': 0, 'hvm': 0, 'shutdown_reason': 255, 'dying': 0, 'online_vcpus': 1, 'domid': 1, 'paused': 1, 'crashed': 0, 'running': 0, 'maxmem_kb': 1025024L, 'shutdown': 0, 'mem_kb': 1024000L, 'handle': [113, 167, 96, 104, 228, 231, 74, 230, 145, 8, 130, 229, 153, 66, 37, 27], 'blocked': 0, 'cpupool': 0}) [2011-09-07 11:08:31 3021] INFO (XendDomainInfo:168) Recreating domain 1, UUID 71a76068-e4e7-4ae6-9108-82e59942251b. at /local/domain/1 [2011-09-07 11:08:31 3021] DEBUG (XendDomain:476) Adding Domain: 1 [2011-09-07 11:08:31 3021] DEBUG (XendDomainInfo:1881) XendDomainInfo.handleShutdownWatch [-- Attachment #6: Type: text/plain, Size: 138 bytes --] _______________________________________________ Xen-devel mailing list Xen-devel@lists.xensource.com http://lists.xensource.com/xen-devel ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: VM hangs during boot on 3.0.4 dom0 kernel, works on alternative hardware 2011-09-06 16:16 ` Konrad Rzeszutek Wilk 2011-09-07 12:29 ` Anthony Wright @ 2011-09-10 20:50 ` Anthony Wright 2011-09-13 9:52 ` Anthony Wright 1 sibling, 1 reply; 6+ messages in thread From: Anthony Wright @ 2011-09-10 20:50 UTC (permalink / raw) To: Konrad Rzeszutek Wilk; +Cc: xen-devel@lists.xensource.com On 06/09/2011 17:16, Konrad Rzeszutek Wilk wrote: > On Mon, Sep 05, 2011 at 11:31:16AM +0100, Anthony Wright wrote: >> I have two machines with identical Dom0's and DomUs, but different >> hardware. The Dom0 has a patch which I produced myself based on the "Re: >> [Xen-devel] Kernel bug from 3.0 (was phy disks and vifs timing out in >> DomU)" thread. The patch calls vmalloc_sync_all after every >> alloc_vm_area, and I realise this isn't the best solution, but it >> allowed me to move forward. > <nods> >> The patch fixes the problem I had on one machine, so that now the VMs >> boot correctly, but I have another system with an identical setup >> (identical Dom0 & DomU kernels, identical startup for DomU) and the VM >> fails to start. I have attached a copy of the console log from the good >> VM and the bad VM. > And what does the dom0 and xen hypervisor log give you? > > It looks to be hanging at identifying the CPU - is the hardware > quite different from one setup to another? Have you toyed with > using the cpuid flag in the guest to mimic the lowest CPU type? I've found a solution to my problem. The PV DomU was running a 32 bit linux kernel version 2.6.30.1. I hoped that a new kernel would be able to handle to CPU more effectively, and so I upgraded my DomU kernel to 3.0.4, and now the DomU boots. This solves the problem for me, but I'm slightly concerned that my original kernel wouldn't work with this CPU (the CPU type for the kernel builds is set to Pentium Pro). I'll try the 2.6.30.1 kernel on bare metal on monday to try to see if this is a xen/Dom0 kernel issue or a CPU/DomU issue. Anthony ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: VM hangs during boot on 3.0.4 dom0 kernel, works on alternative hardware 2011-09-10 20:50 ` Anthony Wright @ 2011-09-13 9:52 ` Anthony Wright 2011-09-14 22:28 ` Konrad Rzeszutek Wilk 0 siblings, 1 reply; 6+ messages in thread From: Anthony Wright @ 2011-09-13 9:52 UTC (permalink / raw) To: Konrad Rzeszutek Wilk; +Cc: xen-devel ----- Original Message ----- > On 06/09/2011 17:16, Konrad Rzeszutek Wilk wrote: > > On Mon, Sep 05, 2011 at 11:31:16AM +0100, Anthony Wright wrote: > >> I have two machines with identical Dom0's and DomUs, but different > >> hardware. The Dom0 has a patch which I produced myself based on the > >> "Re: > >> [Xen-devel] Kernel bug from 3.0 (was phy disks and vifs timing out > >> in > >> DomU)" thread. The patch calls vmalloc_sync_all after every > >> alloc_vm_area, and I realise this isn't the best solution, but it > >> allowed me to move forward. > > <nods> > >> The patch fixes the problem I had on one machine, so that now the > >> VMs > >> boot correctly, but I have another system with an identical setup > >> (identical Dom0 & DomU kernels, identical startup for DomU) and the > >> VM > >> fails to start. I have attached a copy of the console log from the > >> good > >> VM and the bad VM. > > And what does the dom0 and xen hypervisor log give you? > > > > It looks to be hanging at identifying the CPU - is the hardware > > quite different from one setup to another? Have you toyed with > > using the cpuid flag in the guest to mimic the lowest CPU type? > I've found a solution to my problem. The PV DomU was running a 32 bit > linux kernel version 2.6.30.1. I hoped that a new kernel would be able > to handle to CPU more effectively, and so I upgraded my DomU kernel to > 3.0.4, and now the DomU boots. > > This solves the problem for me, but I'm slightly concerned that my > original kernel wouldn't work with this CPU (the CPU type for the > kernel > builds is set to Pentium Pro). I'll try the 2.6.30.1 kernel on bare > metal on monday to try to see if this is a xen/Dom0 kernel issue or a > CPU/DomU issue. > > Anthony I've tried the 2.6.30.1 kernel on bare metal and it boots correctly, so it looks like some xen/Dom0 interaction is causing it to fail when run as a DomU. I have a work around (upgrading to 3.0.4 kernel), so it's not affecting me but I'm happy to do any diagnostics to help identify the cause of the problem. ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: VM hangs during boot on 3.0.4 dom0 kernel, works on alternative hardware 2011-09-13 9:52 ` Anthony Wright @ 2011-09-14 22:28 ` Konrad Rzeszutek Wilk 0 siblings, 0 replies; 6+ messages in thread From: Konrad Rzeszutek Wilk @ 2011-09-14 22:28 UTC (permalink / raw) To: Anthony Wright; +Cc: xen-devel On Tue, Sep 13, 2011 at 10:52:40AM +0100, Anthony Wright wrote: > > > ----- Original Message ----- > > On 06/09/2011 17:16, Konrad Rzeszutek Wilk wrote: > > > On Mon, Sep 05, 2011 at 11:31:16AM +0100, Anthony Wright wrote: > > >> I have two machines with identical Dom0's and DomUs, but different > > >> hardware. The Dom0 has a patch which I produced myself based on the > > >> "Re: > > >> [Xen-devel] Kernel bug from 3.0 (was phy disks and vifs timing out > > >> in > > >> DomU)" thread. The patch calls vmalloc_sync_all after every > > >> alloc_vm_area, and I realise this isn't the best solution, but it > > >> allowed me to move forward. > > > <nods> > > >> The patch fixes the problem I had on one machine, so that now the > > >> VMs > > >> boot correctly, but I have another system with an identical setup > > >> (identical Dom0 & DomU kernels, identical startup for DomU) and the > > >> VM > > >> fails to start. I have attached a copy of the console log from the > > >> good > > >> VM and the bad VM. > > > And what does the dom0 and xen hypervisor log give you? > > > > > > It looks to be hanging at identifying the CPU - is the hardware > > > quite different from one setup to another? Have you toyed with > > > using the cpuid flag in the guest to mimic the lowest CPU type? > > I've found a solution to my problem. The PV DomU was running a 32 bit > > linux kernel version 2.6.30.1. I hoped that a new kernel would be able > > to handle to CPU more effectively, and so I upgraded my DomU kernel to > > 3.0.4, and now the DomU boots. > > > > This solves the problem for me, but I'm slightly concerned that my > > original kernel wouldn't work with this CPU (the CPU type for the > > kernel > > builds is set to Pentium Pro). I'll try the 2.6.30.1 kernel on bare > > metal on monday to try to see if this is a xen/Dom0 kernel issue or a > > CPU/DomU issue. > > > > Anthony > I've tried the 2.6.30.1 kernel on bare metal and it boots correctly, so it looks like some xen/Dom0 interaction is causing it to fail when run as a DomU. I have a work around (upgrading to 3.0.4 kernel), so it's not affecting me but I'm happy to do any diagnostics to help identify the cause of the problem. > That is OK. I don't we would have the time to actually figure out such and old kernel, or to backport the patch. ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2011-09-14 22:28 UTC | newest] Thread overview: 6+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2011-09-05 10:31 VM hangs during boot on 3.0.4 dom0 kernel, works on alternative hardware Anthony Wright 2011-09-06 16:16 ` Konrad Rzeszutek Wilk 2011-09-07 12:29 ` Anthony Wright 2011-09-10 20:50 ` Anthony Wright 2011-09-13 9:52 ` Anthony Wright 2011-09-14 22:28 ` Konrad Rzeszutek Wilk
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).