* Failure to boot HVM guest with more than 32 VCPUS
@ 2015-08-12 9:02 Hao, Xudong
2015-08-12 9:39 ` Vitaly Kuznetsov
0 siblings, 1 reply; 8+ messages in thread
From: Hao, Xudong @ 2015-08-12 9:02 UTC (permalink / raw)
To: xen-devel@lists.xen.org
[-- Attachment #1: Type: text/plain, Size: 3670 bytes --]
Hi,
In X86_64 platform, we noticed an issue that Xen boot a RHEL6u6 or Fedora22 guest, when configure the VCPU more than 32, the guest will fail to boot up.
Guest config:
====================================================
memory = 2173
vcpus=33
vif = [ 'type=ioemu, mac=00:16:3e:7c:87:72, bridge=xenbr0' ]
disk = [ '/root/tao/test/rhel6u6.qcow,qcow2,xvda,rw' ]
device_model_override = '/usr/local/lib/xen/bin/qemu-system-i386'
device_model_version = 'qemu-xen'
sdl=0
vnc=1
stdvga=1
acpi=1
hpet=1
Paste the partial guest log here.(whole log attached)
=====================================================
...
Disabled fast string operations
#31
Disabled fast string operations
#32
Disabled fast string operations
CPU32: Stuck ??
Brought up 32 CPUs
Total of 32 processors activated (178772.22 BogoMIPS).
BUG: soft lockup - CPU#0 stuck for 67s! [swapper:1]
Modules linked in:
CPU 0
Modules linked in:
Pid: 1, comm: swapper Not tainted 2.6.32-504.el6.x86_64 #1 Xen HVM domU
RIP: 0010:[<ffffffff810b7438>] [<ffffffff810b7438>] smp_call_function_many+0x1e8/0x260
RSP: 0018:ffff88010cc1fca0 EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff88010cc1fce0 RCX: 0000000000000020
RDX: 0000000000000020 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffffffff8100bb8e R08: ffff88010eeb0c10 R09: 0000000000000080
R10: 00000000000001c8 R11: 0000000000000000 R12: ffff88010eee0600
R13: ffff88010ecb02c0 R14: ffff88010eee0600 R15: ffffffff81324619
FS: 0000000000000000(0000) GS:ffff88002c000000(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 0000000000000000 CR3: 0000000001a85000 CR4: 00000000001406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 1, threadinfo ffff88010cc1e000, task ffff88010cc1d500)
Stack:
01ff88010cc1fcd0 ffff88010df10000 0000000000000246 ffffffff81172f60
<d> ffff88010df10000 00000000ffffffff ffff88010caa1300 000000000000fbac
<d> ffff88010cc1fcf0 ffffffff810b74d2 ffff88010cc1fd20 ffffffff8107d594
Call Trace:
[<ffffffff81172f60>] ? do_ccupdate_local+0x0/0x40
[<ffffffff810b74d2>] ? smp_call_function+0x22/0x30
[<ffffffff8107d594>] ? on_each_cpu+0x24/0x50
[<ffffffff81176080>] ? do_tune_cpucache+0x110/0x550
[<ffffffff8117668b>] ? enable_cpucache+0x3b/0xf0
[<ffffffff81512aee>] ? setup_cpu_cache+0x21e/0x270
[<ffffffff8117733a>] ? kmem_cache_create+0x41a/0x5a0
[<ffffffff81142620>] ? shmem_init_inode+0x0/0x20
[<ffffffff81c51434>] ? shmem_init+0x3c/0xd7
[<ffffffff81c2a8b4>] ? kernel_init+0x26b/0x2f7
[<ffffffff8100c20a>] ? child_rip+0xa/0x20
[<ffffffff81c2a649>] ? kernel_init+0x0/0x2f7
[<ffffffff8100c200>] ? child_rip+0x0/0x20
Code: e8 8e 5a 47 00 0f ae f0 48 8b 7b 30 ff 15 49 1f 9e 00 80 7d c7 00 0f 84 9f fe ff ff f6 43 20 01 0f 84 95 fe ff ff 0f 1f 44 00 00 <f3> 90 f6 43 20 01 75 f8 e9 83 fe ff ff 0f 1f 00 4c 89 ea 4c 89
Call Trace:
[<ffffffff81172f60>] ? do_ccupdate_local+0x0/0x40
[<ffffffff810b74d2>] ? smp_call_function+0x22/0x30
[<ffffffff8107d594>] ? on_each_cpu+0x24/0x50
[<ffffffff81176080>] ? do_tune_cpucache+0x110/0x550
[<ffffffff8117668b>] ? enable_cpucache+0x3b/0xf0
[<ffffffff81512aee>] ? setup_cpu_cache+0x21e/0x270
[<ffffffff8117733a>] ? kmem_cache_create+0x41a/0x5a0
[<ffffffff81142620>] ? shmem_init_inode+0x0/0x20
[<ffffffff81c51434>] ? shmem_init+0x3c/0xd7
[<ffffffff81c2a8b4>] ? kernel_init+0x26b/0x2f7
[<ffffffff8100c20a>] ? child_rip+0xa/0x20
[<ffffffff81c2a649>] ? kernel_init+0x0/0x2f7
[<ffffffff8100c200>] ? child_rip+0x0/0x20
Best Regards,
Xudong
[-- Attachment #2: rhel6u6-guest.log --]
[-- Type: application/octet-stream, Size: 18618 bytes --]
[root@ivt-ex tao]# xl console 807
Initializing cgroup subsys cpuset
Initializing cgroup subsys cpu
Linux version 2.6.32-504.el6.x86_64 (mockbuild@x86-023.build.eng.bos.redhat.com) (gcc version 4.4.7 20120313 (Red Hat 4.4.7-11) (GCC) ) #1 SMP Tue Sep 16 01:56:35 EDT 2014
Command line: ro root=UUID=d0fc0b7f-5e83-469c-ba18-46a9384549ba rd_NO_LUKS console=tty0 console=ttyS0,115200,8n1 3
KERNEL supported cpus:
Intel GenuineIntel
AMD AuthenticAMD
Centaur CentaurHauls
Disabled fast string operations
BIOS-provided physical RAM map:
BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
BIOS-e820: 0000000000100000 - 00000000effff000 (usable)
BIOS-e820: 00000000effff000 - 00000000f0000000 (reserved)
BIOS-e820: 00000000fc000000 - 0000000100000000 (reserved)
BIOS-e820: 0000000100000000 - 000000010f000000 (usable)
DMI 2.4 present.
SMBIOS version 2.4 @ 0xF5E50
last_pfn = 0x10f000 max_arch_pfn = 0x400000000
x86 PAT enabled: cpu 0, old 0x7040600070406, new 0x7010600070106
last_pfn = 0xeffff max_arch_pfn = 0x400000000
Using GB pages for direct mapping
init_memory_mapping: 0000000000000000-00000000effff000
init_memory_mapping: 0000000100000000-000000010f000000
RAMDISK: 36d63000 - 37fefe2a
ACPI: RSDP 00000000000f5a40 00024 (v02 Xen)
ACPI: XSDT 00000000fc00a7c0 00054 (v01 Xen HVM 00000000 HVML 00000000)
ACPI: FACP 00000000fc00a0f0 000F4 (v04 Xen HVM 00000000 HVML 00000000)
ACPI: DSDT 00000000fc0019e0 08690 (v02 Xen HVM 00000000 INTL 20090123)
ACPI: FACS 00000000fc0019a0 00040
ACPI: APIC 00000000fc00a1f0 00460 (v02 Xen HVM 00000000 HVML 00000000)
ACPI: HPET 00000000fc00a6d0 00038 (v01 Xen HVM 00000000 HVML 00000000)
ACPI: WAET 00000000fc00a710 00028 (v01 Xen HVM 00000000 HVML 00000000)
ACPI: SSDT 00000000fc00a740 00031 (v02 Xen HVM 00000000 INTL 20090123)
ACPI: SSDT 00000000fc00a780 00031 (v02 Xen HVM 00000000 INTL 20090123)
Setting APIC routing to flat.
No NUMA configuration found
Faking a node at 0000000000000000-000000010f000000
Bootmem setup node 0 0000000000000000-000000010f000000
NODE_DATA [000000000000b000 - 000000000003efff]
bootmap [000000000003f000 - 0000000000060dff] pages 22
(8 early reservations) ==> bootmem [0000000000 - 010f000000]
#0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000]
#1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000]
#2 [0001000000 - 000202bbe4] TEXT DATA BSS ==> [0001000000 - 000202bbe4]
#3 [0036d63000 - 0037fefe2a] RAMDISK ==> [0036d63000 - 0037fefe2a]
#4 [000009fc00 - 0000100000] BIOS reserved ==> [000009fc00 - 0000100000]
#5 [000202c000 - 000202c0f9] BRK ==> [000202c000 - 000202c0f9]
#6 [0000008000 - 000000a000] PGTABLE ==> [0000008000 - 000000a000]
#7 [000000a000 - 000000b000] PGTABLE ==> [000000a000 - 000000b000]
found SMP MP-table at [ffff8800000f5af0] f5af0
Zone PFN ranges:
DMA 0x00000001 -> 0x00001000
DMA32 0x00001000 -> 0x00100000
Normal 0x00100000 -> 0x0010f000
Movable zone start PFN for each node
early_node_map[3] active PFN ranges
0: 0x00000001 -> 0x0000009f
0: 0x00000100 -> 0x000effff
0: 0x00100000 -> 0x0010f000
ACPI: PM-Timer IO Port: 0xb008
Setting APIC routing to flat.
ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
ACPI: LAPIC (acpi_id[0x08] lapic_id[0x10] enabled)
ACPI: LAPIC (acpi_id[0x09] lapic_id[0x12] enabled)
ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x14] enabled)
ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x16] enabled)
ACPI: LAPIC (acpi_id[0x0c] lapic_id[0x18] enabled)
ACPI: LAPIC (acpi_id[0x0d] lapic_id[0x1a] enabled)
ACPI: LAPIC (acpi_id[0x0e] lapic_id[0x1c] enabled)
ACPI: LAPIC (acpi_id[0x0f] lapic_id[0x1e] enabled)
ACPI: LAPIC (acpi_id[0x10] lapic_id[0x20] enabled)
ACPI: LAPIC (acpi_id[0x11] lapic_id[0x22] enabled)
ACPI: LAPIC (acpi_id[0x12] lapic_id[0x24] enabled)
ACPI: LAPIC (acpi_id[0x13] lapic_id[0x26] enabled)
ACPI: LAPIC (acpi_id[0x14] lapic_id[0x28] enabled)
ACPI: LAPIC (acpi_id[0x15] lapic_id[0x2a] enabled)
ACPI: LAPIC (acpi_id[0x16] lapic_id[0x2c] enabled)
ACPI: LAPIC (acpi_id[0x17] lapic_id[0x2e] enabled)
ACPI: LAPIC (acpi_id[0x18] lapic_id[0x30] enabled)
ACPI: LAPIC (acpi_id[0x19] lapic_id[0x32] enabled)
ACPI: LAPIC (acpi_id[0x1a] lapic_id[0x34] enabled)
ACPI: LAPIC (acpi_id[0x1b] lapic_id[0x36] enabled)
ACPI: LAPIC (acpi_id[0x1c] lapic_id[0x38] enabled)
ACPI: LAPIC (acpi_id[0x1d] lapic_id[0x3a] enabled)
ACPI: LAPIC (acpi_id[0x1e] lapic_id[0x3c] enabled)
ACPI: LAPIC (acpi_id[0x1f] lapic_id[0x3e] enabled)
ACPI: LAPIC (acpi_id[0x20] lapic_id[0x40] enabled)
ACPI: LAPIC (acpi_id[0x21] lapic_id[0x42] disabled)
ACPI: LAPIC (acpi_id[0x22] lapic_id[0x44] disabled)
ACPI: LAPIC (acpi_id[0x23] lapic_id[0x46] disabled)
ACPI: LAPIC (acpi_id[0x24] lapic_id[0x48] disabled)
ACPI: LAPIC (acpi_id[0x25] lapic_id[0x4a] disabled)
ACPI: LAPIC (acpi_id[0x26] lapic_id[0x4c] disabled)
ACPI: LAPIC (acpi_id[0x27] lapic_id[0x4e] disabled)
ACPI: LAPIC (acpi_id[0x28] lapic_id[0x50] disabled)
ACPI: LAPIC (acpi_id[0x29] lapic_id[0x52] disabled)
ACPI: LAPIC (acpi_id[0x2a] lapic_id[0x54] disabled)
ACPI: LAPIC (acpi_id[0x2b] lapic_id[0x56] disabled)
ACPI: LAPIC (acpi_id[0x2c] lapic_id[0x58] disabled)
ACPI: LAPIC (acpi_id[0x2d] lapic_id[0x5a] disabled)
ACPI: LAPIC (acpi_id[0x2e] lapic_id[0x5c] disabled)
ACPI: LAPIC (acpi_id[0x2f] lapic_id[0x5e] disabled)
ACPI: LAPIC (acpi_id[0x30] lapic_id[0x60] disabled)
ACPI: LAPIC (acpi_id[0x31] lapic_id[0x62] disabled)
ACPI: LAPIC (acpi_id[0x32] lapic_id[0x64] disabled)
ACPI: LAPIC (acpi_id[0x33] lapic_id[0x66] disabled)
ACPI: LAPIC (acpi_id[0x34] lapic_id[0x68] disabled)
ACPI: LAPIC (acpi_id[0x35] lapic_id[0x6a] disabled)
ACPI: LAPIC (acpi_id[0x36] lapic_id[0x6c] disabled)
ACPI: LAPIC (acpi_id[0x37] lapic_id[0x6e] disabled)
ACPI: LAPIC (acpi_id[0x38] lapic_id[0x70] disabled)
ACPI: LAPIC (acpi_id[0x39] lapic_id[0x72] disabled)
ACPI: LAPIC (acpi_id[0x3a] lapic_id[0x74] disabled)
ACPI: LAPIC (acpi_id[0x3b] lapic_id[0x76] disabled)
ACPI: LAPIC (acpi_id[0x3c] lapic_id[0x78] disabled)
ACPI: LAPIC (acpi_id[0x3d] lapic_id[0x7a] disabled)
ACPI: LAPIC (acpi_id[0x3e] lapic_id[0x7c] disabled)
ACPI: LAPIC (acpi_id[0x3f] lapic_id[0x7e] disabled)
ACPI: LAPIC (acpi_id[0x40] lapic_id[0x80] disabled)
ACPI: LAPIC (acpi_id[0x41] lapic_id[0x82] disabled)
ACPI: LAPIC (acpi_id[0x42] lapic_id[0x84] disabled)
ACPI: LAPIC (acpi_id[0x43] lapic_id[0x86] disabled)
ACPI: LAPIC (acpi_id[0x44] lapic_id[0x88] disabled)
ACPI: LAPIC (acpi_id[0x45] lapic_id[0x8a] disabled)
ACPI: LAPIC (acpi_id[0x46] lapic_id[0x8c] disabled)
ACPI: LAPIC (acpi_id[0x47] lapic_id[0x8e] disabled)
ACPI: LAPIC (acpi_id[0x48] lapic_id[0x90] disabled)
ACPI: LAPIC (acpi_id[0x49] lapic_id[0x92] disabled)
ACPI: LAPIC (acpi_id[0x4a] lapic_id[0x94] disabled)
ACPI: LAPIC (acpi_id[0x4b] lapic_id[0x96] disabled)
ACPI: LAPIC (acpi_id[0x4c] lapic_id[0x98] disabled)
ACPI: LAPIC (acpi_id[0x4d] lapic_id[0x9a] disabled)
ACPI: LAPIC (acpi_id[0x4e] lapic_id[0x9c] disabled)
ACPI: LAPIC (acpi_id[0x4f] lapic_id[0x9e] disabled)
ACPI: LAPIC (acpi_id[0x50] lapic_id[0xa0] disabled)
ACPI: LAPIC (acpi_id[0x51] lapic_id[0xa2] disabled)
ACPI: LAPIC (acpi_id[0x52] lapic_id[0xa4] disabled)
ACPI: LAPIC (acpi_id[0x53] lapic_id[0xa6] disabled)
ACPI: LAPIC (acpi_id[0x54] lapic_id[0xa8] disabled)
ACPI: LAPIC (acpi_id[0x55] lapic_id[0xaa] disabled)
ACPI: LAPIC (acpi_id[0x56] lapic_id[0xac] disabled)
ACPI: LAPIC (acpi_id[0x57] lapic_id[0xae] disabled)
ACPI: LAPIC (acpi_id[0x58] lapic_id[0xb0] disabled)
ACPI: LAPIC (acpi_id[0x59] lapic_id[0xb2] disabled)
ACPI: LAPIC (acpi_id[0x5a] lapic_id[0xb4] disabled)
ACPI: LAPIC (acpi_id[0x5b] lapic_id[0xb6] disabled)
ACPI: LAPIC (acpi_id[0x5c] lapic_id[0xb8] disabled)
ACPI: LAPIC (acpi_id[0x5d] lapic_id[0xba] disabled)
ACPI: LAPIC (acpi_id[0x5e] lapic_id[0xbc] disabled)
ACPI: LAPIC (acpi_id[0x5f] lapic_id[0xbe] disabled)
ACPI: LAPIC (acpi_id[0x60] lapic_id[0xc0] disabled)
ACPI: LAPIC (acpi_id[0x61] lapic_id[0xc2] disabled)
ACPI: LAPIC (acpi_id[0x62] lapic_id[0xc4] disabled)
ACPI: LAPIC (acpi_id[0x63] lapic_id[0xc6] disabled)
ACPI: LAPIC (acpi_id[0x64] lapic_id[0xc8] disabled)
ACPI: LAPIC (acpi_id[0x65] lapic_id[0xca] disabled)
ACPI: LAPIC (acpi_id[0x66] lapic_id[0xcc] disabled)
ACPI: LAPIC (acpi_id[0x67] lapic_id[0xce] disabled)
ACPI: LAPIC (acpi_id[0x68] lapic_id[0xd0] disabled)
ACPI: LAPIC (acpi_id[0x69] lapic_id[0xd2] disabled)
ACPI: LAPIC (acpi_id[0x6a] lapic_id[0xd4] disabled)
ACPI: LAPIC (acpi_id[0x6b] lapic_id[0xd6] disabled)
ACPI: LAPIC (acpi_id[0x6c] lapic_id[0xd8] disabled)
ACPI: LAPIC (acpi_id[0x6d] lapic_id[0xda] disabled)
ACPI: LAPIC (acpi_id[0x6e] lapic_id[0xdc] disabled)
ACPI: LAPIC (acpi_id[0x6f] lapic_id[0xde] disabled)
ACPI: LAPIC (acpi_id[0x70] lapic_id[0xe0] disabled)
ACPI: LAPIC (acpi_id[0x71] lapic_id[0xe2] disabled)
ACPI: LAPIC (acpi_id[0x72] lapic_id[0xe4] disabled)
ACPI: LAPIC (acpi_id[0x73] lapic_id[0xe6] disabled)
ACPI: LAPIC (acpi_id[0x74] lapic_id[0xe8] disabled)
ACPI: LAPIC (acpi_id[0x75] lapic_id[0xea] disabled)
ACPI: LAPIC (acpi_id[0x76] lapic_id[0xec] disabled)
ACPI: LAPIC (acpi_id[0x77] lapic_id[0xee] disabled)
ACPI: LAPIC (acpi_id[0x78] lapic_id[0xf0] disabled)
ACPI: LAPIC (acpi_id[0x79] lapic_id[0xf2] disabled)
ACPI: LAPIC (acpi_id[0x7a] lapic_id[0xf4] disabled)
ACPI: LAPIC (acpi_id[0x7b] lapic_id[0xf6] disabled)
ACPI: LAPIC (acpi_id[0x7c] lapic_id[0xf8] disabled)
ACPI: LAPIC (acpi_id[0x7d] lapic_id[0xfa] disabled)
ACPI: LAPIC (acpi_id[0x7e] lapic_id[0xfc] disabled)
ACPI: LAPIC (acpi_id[0x7f] lapic_id[0xfe] disabled)
ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-47
ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 low level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 low level)
ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 low level)
Using ACPI (MADT) for SMP configuration information
ACPI: HPET id: 0x8086a201 base: 0xfed00000
SMP: Allowing 128 CPUs, 95 hotplug CPUs
Xen version 4.6.
Netfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated NICs.
Blkfront and the Xen platform PCI driver have been compiled for this kernel: unplug emulated disks.
You might have to change the root device
from /dev/hd[a-d] to /dev/xvd[a-d]
in your root= kernel command line option
PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
PM: Registered nosave memory: 00000000effff000 - 00000000f0000000
PM: Registered nosave memory: 00000000f0000000 - 00000000fc000000
PM: Registered nosave memory: 00000000fc000000 - 0000000100000000
Allocating PCI resources starting at f0000000 (gap: f0000000:c000000)
Booting paravirtualized kernel on Xen
NR_CPUS:4096 nr_cpumask_bits:128 nr_cpu_ids:128 nr_node_ids:1
PERCPU: Embedded 31 pages/cpu @ffff88002c000000 s95064 r8192 d23720 u131072
pcpu-alloc: s95064 r8192 d23720 u131072 alloc=1*2097152
pcpu-alloc: [0] 000 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015
pcpu-alloc: [0] 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031
pcpu-alloc: [0] 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047
pcpu-alloc: [0] 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063
pcpu-alloc: [0] 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079
pcpu-alloc: [0] 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095
pcpu-alloc: [0] 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111
pcpu-alloc: [0] 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127
Built 1 zonelists in Node order, mobility grouping on. Total pages: 1029103
Policy zone: Normal
Kernel command line: ro root=UUID=d0fc0b7f-5e83-469c-ba18-46a9384549ba rd_NO_LUKS console=tty0 console=ttyS0,115200,8n1 3
PID hash table entries: 4096 (order: 3, 32768 bytes)
xsave/xrstor: enabled xstate_bv 0x7, cntxt size 0x340
Checking aperture...
No AGP bridge found
PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Placing 64MB software IO TLB between ffff880020000000 - ffff880024000000
software IO TLB at phys 0x20000000 - 0x24000000
Memory: 4000112k/4440064k available (5336k kernel code, 262540k absent, 177412k reserved, 7016k data, 1296k init)
Hierarchical RCU implementation.
NR_IRQS:33024 nr_irqs:1840
Xen HVM callback vector for event delivery is enabled
Console: colour VGA+ 80x25
console [tty0] enabled
console [ttyS0] enabled
allocated 16777216 bytes of page_cgroup
please try 'cgroup_disable=memory' option if you don't want memory cgroups
TSC: cpu family 6 model 62, tsc initial value = 1071f90755
Fast TSC calibration using PIT
Detected 2793.316 MHz processor.
Calibrating delay loop (skipped), value calculated using timer frequency.. 5586.63 BogoMIPS (lpj=2793316)
pid_max: default: 131072 minimum: 1024
Security Framework initialized
SELinux: Initializing.
Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes)
Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes)
Mount-cache hash table entries: 256
Initializing cgroup subsys ns
Initializing cgroup subsys cpuacct
Initializing cgroup subsys memory
Initializing cgroup subsys devices
Initializing cgroup subsys freezer
Initializing cgroup subsys net_cls
Initializing cgroup subsys blkio
Initializing cgroup subsys perf_event
Initializing cgroup subsys net_prio
Disabled fast string operations
CPU: Physical Processor ID: 0
CPU: Processor Core ID: 0
mce: CPU supports 2 MCE banks
alternatives: switching to unfair spinlock
ACPI: Core revision 20090903
ftrace: converting mcount calls to 0f 1f 44 00 00
ftrace: allocating 21917 entries in 86 pages
x2apic not enabled, IRQ remapping init failed
APIC routing finalized to physical flat.
..TIMER: vector=0x30 apic1=0 pin1=2 apic2=0 pin2=0
CPU0: Intel(R) Xeon(R) CPU E7-4890 v2 @ 2.80GHz stepping 07
Performance Events: unsupported p6 CPU model 62 no PMU driver, software events only.
NMI watchdog disabled (cpu0): hardware events not enabled
Booting Node 0, Processors #1
Disabled fast string operations
#2
Disabled fast string operations
#3
Disabled fast string operations
#4
Disabled fast string operations
#5
Disabled fast string operations
#6
Disabled fast string operations
#7
Disabled fast string operations
#8
Disabled fast string operations
#9
Disabled fast string operations
#10
Disabled fast string operations
#11
Disabled fast string operations
#12
Disabled fast string operations
#13
Disabled fast string operations
#14
Disabled fast string operations
#15
Disabled fast string operations
#16
Disabled fast string operations
#17
Disabled fast string operations
#18
Disabled fast string operations
#19
Disabled fast string operations
#20
Disabled fast string operations
#21
Disabled fast string operations
#22
Disabled fast string operations
#23
Disabled fast string operations
#24
Disabled fast string operations
#25
Disabled fast string operations
#26
Disabled fast string operations
#27
Disabled fast string operations
#28
Disabled fast string operations
#29
Disabled fast string operations
#30
Disabled fast string operations
#31
Disabled fast string operations
#32
Disabled fast string operations
CPU32: Stuck ??
Brought up 32 CPUs
Total of 32 processors activated (178772.22 BogoMIPS).
BUG: soft lockup - CPU#0 stuck for 67s! [swapper:1]
Modules linked in:
CPU 0
Modules linked in:
Pid: 1, comm: swapper Not tainted 2.6.32-504.el6.x86_64 #1 Xen HVM domU
RIP: 0010:[<ffffffff810b7438>] [<ffffffff810b7438>] smp_call_function_many+0x1e8/0x260
RSP: 0018:ffff88010cc1fca0 EFLAGS: 00000202
RAX: 0000000000000080 RBX: ffff88010cc1fce0 RCX: 0000000000000020
RDX: 0000000000000020 RSI: 0000000000000080 RDI: 0000000000000000
RBP: ffffffff8100bb8e R08: ffff88010eeb0c10 R09: 0000000000000080
R10: 00000000000001c8 R11: 0000000000000000 R12: ffff88010eee0600
R13: ffff88010ecb02c0 R14: ffff88010eee0600 R15: ffffffff81324619
FS: 0000000000000000(0000) GS:ffff88002c000000(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 0000000000000000 CR3: 0000000001a85000 CR4: 00000000001406f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 1, threadinfo ffff88010cc1e000, task ffff88010cc1d500)
Stack:
01ff88010cc1fcd0 ffff88010df10000 0000000000000246 ffffffff81172f60
<d> ffff88010df10000 00000000ffffffff ffff88010caa1300 000000000000fbac
<d> ffff88010cc1fcf0 ffffffff810b74d2 ffff88010cc1fd20 ffffffff8107d594
Call Trace:
[<ffffffff81172f60>] ? do_ccupdate_local+0x0/0x40
[<ffffffff810b74d2>] ? smp_call_function+0x22/0x30
[<ffffffff8107d594>] ? on_each_cpu+0x24/0x50
[<ffffffff81176080>] ? do_tune_cpucache+0x110/0x550
[<ffffffff8117668b>] ? enable_cpucache+0x3b/0xf0
[<ffffffff81512aee>] ? setup_cpu_cache+0x21e/0x270
[<ffffffff8117733a>] ? kmem_cache_create+0x41a/0x5a0
[<ffffffff81142620>] ? shmem_init_inode+0x0/0x20
[<ffffffff81c51434>] ? shmem_init+0x3c/0xd7
[<ffffffff81c2a8b4>] ? kernel_init+0x26b/0x2f7
[<ffffffff8100c20a>] ? child_rip+0xa/0x20
[<ffffffff81c2a649>] ? kernel_init+0x0/0x2f7
[<ffffffff8100c200>] ? child_rip+0x0/0x20
Code: e8 8e 5a 47 00 0f ae f0 48 8b 7b 30 ff 15 49 1f 9e 00 80 7d c7 00 0f 84 9f fe ff ff f6 43 20 01 0f 84 95 fe ff ff 0f 1f 44 00 00 <f3> 90 f6 43 20 01 75 f8 e9 83 fe ff ff 0f 1f 00 4c 89 ea 4c 89
Call Trace:
[<ffffffff81172f60>] ? do_ccupdate_local+0x0/0x40
[<ffffffff810b74d2>] ? smp_call_function+0x22/0x30
[<ffffffff8107d594>] ? on_each_cpu+0x24/0x50
[<ffffffff81176080>] ? do_tune_cpucache+0x110/0x550
[<ffffffff8117668b>] ? enable_cpucache+0x3b/0xf0
[<ffffffff81512aee>] ? setup_cpu_cache+0x21e/0x270
[<ffffffff8117733a>] ? kmem_cache_create+0x41a/0x5a0
[<ffffffff81142620>] ? shmem_init_inode+0x0/0x20
[<ffffffff81c51434>] ? shmem_init+0x3c/0xd7
[<ffffffff81c2a8b4>] ? kernel_init+0x26b/0x2f7
[<ffffffff8100c20a>] ? child_rip+0xa/0x20
[<ffffffff81c2a649>] ? kernel_init+0x0/0x2f7
[<ffffffff8100c200>] ? child_rip+0x0/0x20
[-- Attachment #3: Type: text/plain, Size: 126 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 8+ messages in thread* Re: Failure to boot HVM guest with more than 32 VCPUS
2015-08-12 9:02 Failure to boot HVM guest with more than 32 VCPUS Hao, Xudong
@ 2015-08-12 9:39 ` Vitaly Kuznetsov
2015-08-13 0:48 ` Hao, Xudong
0 siblings, 1 reply; 8+ messages in thread
From: Vitaly Kuznetsov @ 2015-08-12 9:39 UTC (permalink / raw)
To: Hao, Xudong; +Cc: xen-devel@lists.xen.org
"Hao, Xudong" <xudong.hao@intel.com> writes:
> Hi,
>
> In X86_64 platform, we noticed an issue that Xen boot a RHEL6u6 or
> Fedora22 guest, when configure the VCPU more than 32, the guest will
> fail to boot up.
The issue is well-known for RHEL6.6 (and is fixed in 6.7 and in 6.6.z)
but Fedora22 should boot. The log below is from RHEL6.6, can you please
provide one from Fedora?
>
> Guest config:
> ====================================================
> memory = 2173
> vcpus=33
> vif = [ 'type=ioemu, mac=00:16:3e:7c:87:72, bridge=xenbr0' ]
> disk = [ '/root/tao/test/rhel6u6.qcow,qcow2,xvda,rw' ]
> device_model_override = '/usr/local/lib/xen/bin/qemu-system-i386'
> device_model_version = 'qemu-xen'
> sdl=0
> vnc=1
> stdvga=1
> acpi=1
> hpet=1
>
> Paste the partial guest log here.(whole log attached)
> =====================================================
> ...
> Disabled fast string operations
> #31
> Disabled fast string operations
> #32
> Disabled fast string operations
> CPU32: Stuck ??
> Brought up 32 CPUs
> Total of 32 processors activated (178772.22 BogoMIPS).
> BUG: soft lockup - CPU#0 stuck for 67s! [swapper:1]
> Modules linked in:
> CPU 0
> Modules linked in:
>
> Pid: 1, comm: swapper Not tainted 2.6.32-504.el6.x86_64 #1 Xen HVM domU
> RIP: 0010:[<ffffffff810b7438>] [<ffffffff810b7438>] smp_call_function_many+0x1e8/0x260
> RSP: 0018:ffff88010cc1fca0 EFLAGS: 00000202
> RAX: 0000000000000080 RBX: ffff88010cc1fce0 RCX: 0000000000000020
> RDX: 0000000000000020 RSI: 0000000000000080 RDI: 0000000000000000
> RBP: ffffffff8100bb8e R08: ffff88010eeb0c10 R09: 0000000000000080
> R10: 00000000000001c8 R11: 0000000000000000 R12: ffff88010eee0600
> R13: ffff88010ecb02c0 R14: ffff88010eee0600 R15: ffffffff81324619
> FS: 0000000000000000(0000) GS:ffff88002c000000(0000) knlGS:0000000000000000
> CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
> CR2: 0000000000000000 CR3: 0000000001a85000 CR4: 00000000001406f0
> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> Process swapper (pid: 1, threadinfo ffff88010cc1e000, task ffff88010cc1d500)
> Stack:
> 01ff88010cc1fcd0 ffff88010df10000 0000000000000246 ffffffff81172f60
> <d> ffff88010df10000 00000000ffffffff ffff88010caa1300 000000000000fbac
> <d> ffff88010cc1fcf0 ffffffff810b74d2 ffff88010cc1fd20 ffffffff8107d594
> Call Trace:
> [<ffffffff81172f60>] ? do_ccupdate_local+0x0/0x40
> [<ffffffff810b74d2>] ? smp_call_function+0x22/0x30
> [<ffffffff8107d594>] ? on_each_cpu+0x24/0x50
> [<ffffffff81176080>] ? do_tune_cpucache+0x110/0x550
> [<ffffffff8117668b>] ? enable_cpucache+0x3b/0xf0
> [<ffffffff81512aee>] ? setup_cpu_cache+0x21e/0x270
> [<ffffffff8117733a>] ? kmem_cache_create+0x41a/0x5a0
> [<ffffffff81142620>] ? shmem_init_inode+0x0/0x20
> [<ffffffff81c51434>] ? shmem_init+0x3c/0xd7
> [<ffffffff81c2a8b4>] ? kernel_init+0x26b/0x2f7
> [<ffffffff8100c20a>] ? child_rip+0xa/0x20
> [<ffffffff81c2a649>] ? kernel_init+0x0/0x2f7
> [<ffffffff8100c200>] ? child_rip+0x0/0x20
> Code: e8 8e 5a 47 00 0f ae f0 48 8b 7b 30 ff 15 49 1f 9e 00 80 7d c7 00 0f 84 9f fe ff ff f6 43 20 01 0f 84 95 fe ff ff 0f 1f 44 00 00 <f3> 90 f6 43 20 01 75 f8 e9 83 fe ff ff 0f 1f 00 4c 89 ea 4c 89
> Call Trace:
> [<ffffffff81172f60>] ? do_ccupdate_local+0x0/0x40
> [<ffffffff810b74d2>] ? smp_call_function+0x22/0x30
> [<ffffffff8107d594>] ? on_each_cpu+0x24/0x50
> [<ffffffff81176080>] ? do_tune_cpucache+0x110/0x550
> [<ffffffff8117668b>] ? enable_cpucache+0x3b/0xf0
> [<ffffffff81512aee>] ? setup_cpu_cache+0x21e/0x270
> [<ffffffff8117733a>] ? kmem_cache_create+0x41a/0x5a0
> [<ffffffff81142620>] ? shmem_init_inode+0x0/0x20
> [<ffffffff81c51434>] ? shmem_init+0x3c/0xd7
> [<ffffffff81c2a8b4>] ? kernel_init+0x26b/0x2f7
> [<ffffffff8100c20a>] ? child_rip+0xa/0x20
> [<ffffffff81c2a649>] ? kernel_init+0x0/0x2f7
> [<ffffffff8100c200>] ? child_rip+0x0/0x20
>
> Best Regards,
> Xudong
--
Vitaly
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Failure to boot HVM guest with more than 32 VCPUS
2015-08-12 9:39 ` Vitaly Kuznetsov
@ 2015-08-13 0:48 ` Hao, Xudong
2015-08-13 8:20 ` Vitaly Kuznetsov
0 siblings, 1 reply; 8+ messages in thread
From: Hao, Xudong @ 2015-08-13 0:48 UTC (permalink / raw)
To: Vitaly Kuznetsov; +Cc: xen-devel@lists.xen.org
> -----Original Message-----
> From: Vitaly Kuznetsov [mailto:vkuznets@redhat.com]
> Sent: Wednesday, August 12, 2015 5:40 PM
> To: Hao, Xudong
> Cc: xen-devel@lists.xen.org
> Subject: Re: [Xen-devel] Failure to boot HVM guest with more than 32
> VCPUS
>
> "Hao, Xudong" <xudong.hao@intel.com> writes:
>
> > Hi,
> >
> > In X86_64 platform, we noticed an issue that Xen boot a RHEL6u6 or
> > Fedora22 guest, when configure the VCPU more than 32, the guest will
> > fail to boot up.
>
> The issue is well-known for RHEL6.6 (and is fixed in 6.7 and in 6.6.z)
> but Fedora22 should boot. The log below is from RHEL6.6, can you please
> provide one from Fedora?
>
Vitaly,
Thanks for quick response. Is the fix in guest pv driver?
Will catch Fedora22 log.
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Failure to boot HVM guest with more than 32 VCPUS
2015-08-13 0:48 ` Hao, Xudong
@ 2015-08-13 8:20 ` Vitaly Kuznetsov
2015-08-13 8:37 ` Hao, Xudong
2015-08-13 11:45 ` Konrad Rzeszutek Wilk
0 siblings, 2 replies; 8+ messages in thread
From: Vitaly Kuznetsov @ 2015-08-13 8:20 UTC (permalink / raw)
To: Hao, Xudong; +Cc: xen-devel@lists.xen.org
"Hao, Xudong" <xudong.hao@intel.com> writes:
>> -----Original Message-----
>> From: Vitaly Kuznetsov [mailto:vkuznets@redhat.com]
>> Sent: Wednesday, August 12, 2015 5:40 PM
>> To: Hao, Xudong
>> Cc: xen-devel@lists.xen.org
>> Subject: Re: [Xen-devel] Failure to boot HVM guest with more than 32
>> VCPUS
>>
>> "Hao, Xudong" <xudong.hao@intel.com> writes:
>>
>> > Hi,
>> >
>> > In X86_64 platform, we noticed an issue that Xen boot a RHEL6u6 or
>> > Fedora22 guest, when configure the VCPU more than 32, the guest will
>> > fail to boot up.
>>
>> The issue is well-known for RHEL6.6 (and is fixed in 6.7 and in 6.6.z)
>> but Fedora22 should boot. The log below is from RHEL6.6, can you please
>> provide one from Fedora?
>>
>
> Vitaly,
>
> Thanks for quick response. Is the fix in guest pv driver?
The fix is in RHEL6 kernel, prior to it there is no support for
vcpu_info outside of shared_info and so only 32 vcpus are supported.
> Will catch Fedora22 log.
Please do, this is probably a different issue.
--
Vitaly
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Failure to boot HVM guest with more than 32 VCPUS
2015-08-13 8:20 ` Vitaly Kuznetsov
@ 2015-08-13 8:37 ` Hao, Xudong
2015-08-13 9:20 ` Vitaly Kuznetsov
2015-08-13 11:45 ` Konrad Rzeszutek Wilk
1 sibling, 1 reply; 8+ messages in thread
From: Hao, Xudong @ 2015-08-13 8:37 UTC (permalink / raw)
To: Vitaly Kuznetsov; +Cc: xen-devel@lists.xen.org
[-- Attachment #1: Type: text/plain, Size: 1466 bytes --]
> -----Original Message-----
> From: Vitaly Kuznetsov [mailto:vkuznets@redhat.com]
> Sent: Thursday, August 13, 2015 4:20 PM
> To: Hao, Xudong <xudong.hao@intel.com>
> Cc: xen-devel@lists.xen.org
> Subject: Re: [Xen-devel] Failure to boot HVM guest with more than 32 VCPUS
>
> "Hao, Xudong" <xudong.hao@intel.com> writes:
>
> >> -----Original Message-----
> >> From: Vitaly Kuznetsov [mailto:vkuznets@redhat.com]
> >> Sent: Wednesday, August 12, 2015 5:40 PM
> >> To: Hao, Xudong
> >> Cc: xen-devel@lists.xen.org
> >> Subject: Re: [Xen-devel] Failure to boot HVM guest with more than 32
> >> VCPUS
> >>
> >> "Hao, Xudong" <xudong.hao@intel.com> writes:
> >>
> >> > Hi,
> >> >
> >> > In X86_64 platform, we noticed an issue that Xen boot a RHEL6u6 or
> >> > Fedora22 guest, when configure the VCPU more than 32, the guest
> >> > will fail to boot up.
> >>
> >> The issue is well-known for RHEL6.6 (and is fixed in 6.7 and in
> >> 6.6.z) but Fedora22 should boot. The log below is from RHEL6.6, can
> >> you please provide one from Fedora?
> >>
> >
> > Vitaly,
> >
> > Thanks for quick response. Is the fix in guest pv driver?
>
> The fix is in RHEL6 kernel, prior to it there is no support for vcpu_info outside of
> shared_info and so only 32 vcpus are supported.
>
> > Will catch Fedora22 log.
>
> Please do, this is probably a different issue.
>
Attach the Fedora22 log, a different issue.
> --
> Vitaly
[-- Attachment #2: fedora22.log --]
[-- Type: application/octet-stream, Size: 51924 bytes --]
[-- Attachment #3: Type: text/plain, Size: 126 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Failure to boot HVM guest with more than 32 VCPUS
2015-08-13 8:37 ` Hao, Xudong
@ 2015-08-13 9:20 ` Vitaly Kuznetsov
0 siblings, 0 replies; 8+ messages in thread
From: Vitaly Kuznetsov @ 2015-08-13 9:20 UTC (permalink / raw)
To: Hao, Xudong; +Cc: xen-devel@lists.xen.org
"Hao, Xudong" <xudong.hao@intel.com> writes:
>
> Attach the Fedora22 log, a different issue.
>
Here is the crash:
[ 6399.814801] xen_netfront: Initialising Xen virtual ethernet driver
[ 6399.814838] [drm] Initialized drm 1.1.0 20060810
[ 6399.838500] xen_netfront: can't alloc rx grant refs
[ 6399.838504] net eth0: only created 31 queues
[ 6399.839930] BUG: unable to handle kernel NULL pointer dereference at 0000000000000018
[ 6399.839938] IP: [<ffffffffa01a00cb>] netback_changed+0x8eb/0xef0 [xen_netfront]
[ 6399.839940] PGD 0
[ 6399.839943] Oops: 0000 [#1] SMP
[ 6399.839948] Modules linked in: drm xen_netfront(+) xen_blkfront(+) crc32c_intel ata_generic pata_acpi
[ 6399.839955] CPU: 0 PID: 241 Comm: xenwatch Not tainted 4.0.4-301.fc22.x86_64 #1
[ 6399.839957] Hardware name: Xen HVM domU, BIOS 4.6.0-rc 08/13/2015
[ 6399.839959] task: ffff880107ffc590 ti: ffff880107920000 task.ti: ffff880107920000
[ 6399.839963] RIP: 0010:[<ffffffffa01a00cb>] [<ffffffffa01a00cb>] netback_changed+0x8eb/0xef0 [xen_netfront]
[ 6399.839965] RSP: 0000:ffff880107923d68 EFLAGS: 00010202
[ 6399.839966] RAX: 0000000000000000 RBX: ffff8800e6568000 RCX: 0000000000000001
[ 6399.839968] RDX: 00000000000e6568 RSI: ffff8800e65c40f8 RDI: 0000000000003f41
[ 6399.839969] RBP: ffff880107923df8 R08: ffffc90000940000 R09: 0000000000000000
[ 6399.839971] R10: ffffea0003995a00 R11: 0000000000100000 R12: ffff8800e65c4000
[ 6399.839972] R13: ffff8800e65c40f8 R14: ffff8800e6567000 R15: 0000000000044000
[ 6399.839974] FS: 0000000000000000(0000) GS:ffff880109600000(0000) knlGS:0000000000000000
[ 6399.839975] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 6399.839977] CR2: 0000000000000018 CR3: 0000000001c0b000 CR4: 00000000001407f0
[ 6399.839980] Stack:
[ 6399.839983] ffff880107923d78 ffff8800e65c1e04 ffff8800e65c1f21 ffff8800eb8b1400
[ 6399.839985] ffff8800e73d8000 ffff8800eb8b1400 0000002107923dec ffff880000000020
[ 6399.839988] 0000000107ffc590 0000004000000001 ffff8800ebb261f1 0000000087ee3bd9
[ 6399.839989] Call Trace:
[ 6399.839998] [<ffffffff8147161d>] xenbus_otherend_changed+0xad/0x120
[ 6399.840014] [<ffffffff810decd7>] ? prepare_to_wait_event+0x87/0x100
[ 6399.840017] [<ffffffff814709c0>] ? unregister_xenbus_watch+0x1d0/0x1d0
[ 6399.840021] [<ffffffff81473b63>] backend_changed+0x13/0x20
[ 6399.840023] [<ffffffff81470a4f>] xenwatch_thread+0x8f/0x150
[ 6399.840026] [<ffffffff810dedc0>] ? wake_atomic_t_function+0x70/0x70
[ 6399.840031] [<ffffffff810bb678>] kthread+0xd8/0xf0
[ 6399.840035] [<ffffffff810bb5a0>] ? kthread_worker_fn+0x180/0x180
[ 6399.840041] [<ffffffff81788bd8>] ret_from_fork+0x58/0x90
[ 6399.840044] [<ffffffff810bb5a0>] ? kthread_worker_fn+0x180/0x180
[ 6399.840056] Code: 48 8b 04 f0 48 83 f8 ff 0f 84 e2 04 00 00 48 89 c6 48 b8 ff ff ff ff ff ff ff 3f 48 21 c6 e9 ad fd ff ff 49 8b 44 24 20 4c 89 ee <48> 8b 78 18 e8 fc ee 2c e1 85 c0 0f 88 be fd ff ff 49 8b 44 24
[ 6399.840059] RIP [<ffffffffa01a00cb>] netback_changed+0x8eb/0xef0 [xen_netfront]
[ 6399.840060] RSP <ffff880107923d68>
[ 6399.840061] CR2: 0000000000000018
[ 6399.840064] ---[ end trace 790f9d91e3f3059b ]---
The main issue (I suppose) is:
[ 6399.838500] xen_netfront: can't alloc rx grant refs
it happens when gnttab_alloc_grant_references() fails. As far as I can
see it can only happen when gnttab_expand() fails. Do you have anything
in your Xen dmesg ('xl dmegs' output on your host)? In case not, can you
try increasing you guest's memory to see if the issue goes away?
--
Vitaly
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Failure to boot HVM guest with more than 32 VCPUS
2015-08-13 8:20 ` Vitaly Kuznetsov
2015-08-13 8:37 ` Hao, Xudong
@ 2015-08-13 11:45 ` Konrad Rzeszutek Wilk
2015-08-13 12:58 ` Vitaly Kuznetsov
1 sibling, 1 reply; 8+ messages in thread
From: Konrad Rzeszutek Wilk @ 2015-08-13 11:45 UTC (permalink / raw)
To: Vitaly Kuznetsov, Hao, Xudong; +Cc: xen-devel@lists.xen.org
On August 13, 2015 4:20:11 AM EDT, Vitaly Kuznetsov <vkuznets@redhat.com> wrote:
>"Hao, Xudong" <xudong.hao@intel.com> writes:
>
>>> -----Original Message-----
>>> From: Vitaly Kuznetsov [mailto:vkuznets@redhat.com]
>>> Sent: Wednesday, August 12, 2015 5:40 PM
>>> To: Hao, Xudong
>>> Cc: xen-devel@lists.xen.org
>>> Subject: Re: [Xen-devel] Failure to boot HVM guest with more than 32
>>> VCPUS
>>>
>>> "Hao, Xudong" <xudong.hao@intel.com> writes:
>>>
>>> > Hi,
>>> >
>>> > In X86_64 platform, we noticed an issue that Xen boot a RHEL6u6 or
>>> > Fedora22 guest, when configure the VCPU more than 32, the guest
>will
>>> > fail to boot up.
>>>
>>> The issue is well-known for RHEL6.6 (and is fixed in 6.7 and in
>6.6.z)
>>> but Fedora22 should boot. The log below is from RHEL6.6, can you
>please
>>> provide one from Fedora?
>>>
>>
>> Vitaly,
>>
>> Thanks for quick response. Is the fix in guest pv driver?
>
>The fix is in RHEL6 kernel, prior to it there is no support for
>vcpu_info outside of shared_info and so only 32 vcpus are supported.
Is the patch available somewhere? Or is it the one I had posted some time ago?
>
>> Will catch Fedora22 log.
>
>Please do, this is probably a different issue.
^ permalink raw reply [flat|nested] 8+ messages in thread
* Re: Failure to boot HVM guest with more than 32 VCPUS
2015-08-13 11:45 ` Konrad Rzeszutek Wilk
@ 2015-08-13 12:58 ` Vitaly Kuznetsov
0 siblings, 0 replies; 8+ messages in thread
From: Vitaly Kuznetsov @ 2015-08-13 12:58 UTC (permalink / raw)
To: Konrad Rzeszutek Wilk; +Cc: Hao, Xudong, xen-devel@lists.xen.org
Konrad Rzeszutek Wilk <konrad.wilk@oracle.com> writes:
> On August 13, 2015 4:20:11 AM EDT, Vitaly Kuznetsov <vkuznets@redhat.com> wrote:
>>"Hao, Xudong" <xudong.hao@intel.com> writes:
>>
>>>> -----Original Message-----
>>>> From: Vitaly Kuznetsov [mailto:vkuznets@redhat.com]
>>>> Sent: Wednesday, August 12, 2015 5:40 PM
>>>> To: Hao, Xudong
>>>> Cc: xen-devel@lists.xen.org
>>>> Subject: Re: [Xen-devel] Failure to boot HVM guest with more than 32
>>>> VCPUS
>>>>
>>>> "Hao, Xudong" <xudong.hao@intel.com> writes:
>>>>
>>>> > Hi,
>>>> >
>>>> > In X86_64 platform, we noticed an issue that Xen boot a RHEL6u6 or
>>>> > Fedora22 guest, when configure the VCPU more than 32, the guest
>>will
>>>> > fail to boot up.
>>>>
>>>> The issue is well-known for RHEL6.6 (and is fixed in 6.7 and in
>>6.6.z)
>>>> but Fedora22 should boot. The log below is from RHEL6.6, can you
>>please
>>>> provide one from Fedora?
>>>>
>>>
>>> Vitaly,
>>>
>>> Thanks for quick response. Is the fix in guest pv driver?
>>
>>The fix is in RHEL6 kernel, prior to it there is no support for
>>vcpu_info outside of shared_info and so only 32 vcpus are supported.
>
> Is the patch available somewhere? Or is it the one I had posted some time ago?
>
These are upstream commit ids (linux.git):
c06ee78d73fd24e8d8a65f16380f6a0551107e1b "xen: support large numbers of CPUs with vcpu info placement"
90d4f5534d14815bd94c10e8ceccc57287657ecc "xen:pvhvm: enable PVHVM VCPU placement when using more than 32 CPUs."
d5b17dbff83d63fb6bf35daec21c8ebfb8d695b5 "xen/smp/pvhvm: Don't point per_cpu(xen_vpcu, 33 and larger) to shared_info"
--
Vitaly
^ permalink raw reply [flat|nested] 8+ messages in thread
end of thread, other threads:[~2015-08-13 12:58 UTC | newest]
Thread overview: 8+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-08-12 9:02 Failure to boot HVM guest with more than 32 VCPUS Hao, Xudong
2015-08-12 9:39 ` Vitaly Kuznetsov
2015-08-13 0:48 ` Hao, Xudong
2015-08-13 8:20 ` Vitaly Kuznetsov
2015-08-13 8:37 ` Hao, Xudong
2015-08-13 9:20 ` Vitaly Kuznetsov
2015-08-13 11:45 ` Konrad Rzeszutek Wilk
2015-08-13 12:58 ` Vitaly Kuznetsov
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.