From: Ed Swierk <eswierk@skyportsystems.com>
To: Jan Beulich <JBeulich@suse.com>
Cc: Andrew Cooper <andrew.cooper3@citrix.com>,
Chao Peng <chao.p.peng@linux.intel.com>,
xen-devel@lists.xen.org
Subject: Re: Crash in set_cpu_sibling_map() booting Xen 4.6.0 on Fusion
Date: Fri, 20 Nov 2015 17:21:11 -0800 [thread overview]
Message-ID: <CAO_EM_nRsqWRxiGHP6UMrFM-4jZad5MwqcpKaExjUVyTM8MwgQ@mail.gmail.com> (raw)
In-Reply-To: <CAO_EM_kxK3m5J0J8x=MDF+YHt44kaGdmbzQHiX_WSron5jSVpQ@mail.gmail.com>
[-- Attachment #1.1: Type: text/plain, Size: 61830 bytes --]
The problem is that the index of the socket_cpumask array is derived via
cpu_to_socket() from the APIC ID of the processor in a given socket, but
the size of the array is computed based on nr_sockets, which is not
necessarily equal to the maximum APIC ID.
Sizing the socket_cpumask to MAX_APICS rather than nr_sockets seems safer,
though a bit wasteful. I verified that this change fixes the boot crash
with 4 or 8 CPUs on VMware Fusion.
--- a/xen/arch/x86/smpboot.c
+++ b/xen/arch/x86/smpboot.c
@@ -819,7 +819,7 @@ void __init smp_prepare_cpus(unsigned int max_cpus)
set_nr_sockets();
- socket_cpumask = xzalloc_array(cpumask_t *, nr_sockets);
+ socket_cpumask = xzalloc_array(cpumask_t *, MAX_APICS);
if ( socket_cpumask == NULL ||
(socket_cpumask[cpu_to_socket(0)] = xzalloc(cpumask_t)) == NULL )
panic("No memory for socket CPU siblings map");
On Fri, Nov 20, 2015 at 10:53 AM, Ed Swierk <eswierk@skyportsystems.com>
wrote:
> I instrumented set_nr_sockets() and smp_store_cpu_info(), and re-ran with
> varying numbers of CPUs.
>
> With 4 CPUs, nr_sockets=4, so smp_store_cpu_info() exceeds the bounds of
> the socket_cpumask array when socket=4 or 6.
>
> Loading xen-4.6-amd64.gz... ok
> Loading vmlinuz-3.14.51-grsec-dock... ok
> Loading initrd.img-3.14.51-grsec-dock... ok
> (XEN) Xen version 4.6.1-pre (Debian 4.6.1~pre-1skyport1) (
> eswierk@skyportsystems.com) (gcc (Debian 4.9.3-4) 4.9.3) debug=y Fri Nov
> 20 10:07:47 PST 2015
> (XEN) Bootloader: SYSLINUX 4.05 20140113
> (XEN) Command line: console=com1,vga com1=115200 no-bootscrub
> dom0_mem=2048M,max:2048M loglvl=all cpuinfo=1 apic_verbosity=debug
> (XEN) Video information:
> (XEN) VGA is text mode 80x25, font 8x16
> (XEN) Disc information:
> (XEN) Found 1 MBR signatures
> (XEN) Found 1 EDD information structures
> (XEN) Xen-e820 RAM map:
> (XEN) 0000000000000000 - 000000000009f800 (usable)
> (XEN) 000000000009f800 - 00000000000a0000 (reserved)
> (XEN) 00000000000dc000 - 0000000000100000 (reserved)
> (XEN) 0000000000100000 - 00000000bfef0000 (usable)
> (XEN) 00000000bfef0000 - 00000000bfeff000 (ACPI data)
> (XEN) 00000000bfeff000 - 00000000bff00000 (ACPI NVS)
> (XEN) 00000000bff00000 - 00000000c0000000 (usable)
> (XEN) 00000000f0000000 - 00000000f8000000 (reserved)
> (XEN) 00000000fec00000 - 00000000fec10000 (reserved)
> (XEN) 00000000fee00000 - 00000000fee01000 (reserved)
> (XEN) 00000000fffe0000 - 0000000100000000 (reserved)
> (XEN) 0000000100000000 - 00000001c0000000 (usable)
> (XEN) ACPI: RSDP 000F6A10, 0024 (r2 PTLTD )
> (XEN) ACPI: XSDT BFEF030B, 0054 (r1 INTEL 440BX 6040000 VMW 1324272)
> (XEN) ACPI: FACP BFEFEE73, 00F4 (r4 INTEL 440BX 6040000 PTL F4240)
> (XEN) ACPI: DSDT BFEF05B1, E8C2 (r1 PTLTD Custom 6040000 MSFT 3000001)
> (XEN) ACPI: FACS BFEFFFC0, 0040
> (XEN) ACPI: BOOT BFEF0589, 0028 (r1 PTLTD $SBFTBL$ 6040000 LTP 1)
> (XEN) ACPI: APIC BFEF050F, 007A (r1 PTLTD APIC 6040000 LTP 0)
> (XEN) ACPI: MCFG BFEF04D3, 003C (r1 PTLTD $PCITBL$ 6040000 LTP 1)
> (XEN) ACPI: SRAT BFEF03C3, 0110 (r2 VMWARE MEMPLUG 6040000 VMW 1)
> (XEN) ACPI: WAET BFEF039B, 0028 (r1 VMWARE VMW WAET 6040000 VMW 1)
> (XEN) System RAM: 6143MB (6291004kB)
> (XEN) SRAT: PXM 0 -> APIC 00 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 02 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 04 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 06 -> Node 0
> (XEN) SRAT: Node 0 PXM 0 0-a0000
> (XEN) SRAT: Node 0 PXM 0 100000-10000000
> (XEN) SRAT: Node 0 PXM 0 10000000-c0000000
> (XEN) SRAT: Node 0 PXM 0 100000000-1c0000000
> (XEN) NUMA: Allocated memnodemap from 1bd8f8000 - 1bd8fa000
> (XEN) NUMA: Using 8 for the hash shift.
> (XEN) Domain heap initialised
> (XEN) found SMP MP-table at 000f6a80
> (XEN) DMI present.
> (XEN) APIC boot state is 'xapic'
> (XEN) Using APIC driver default
> (XEN) ACPI: PM-Timer IO Port: 0x1008
> (XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0]
> (XEN) ACPI: wakeup_vec[bfefffcc], vec_size[20]
> (XEN) ACPI: Local APIC address 0xfee00000
> (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> (XEN) Processor #0 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
> (XEN) Processor #2 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
> (XEN) Processor #4 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
> (XEN) Processor #6 6:6 APIC version 21
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
> (XEN) ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
> (XEN) IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
> (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> (XEN) ACPI: IRQ0 used by override.
> (XEN) ACPI: IRQ2 used by override.
> (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs
> (XEN) ERST table was not found
> (XEN) Using ACPI (MADT) for SMP configuration information
> (XEN) SMP: Allowing 4 CPUs (0 hotplug CPUs)
> (XEN) mapped APIC to ffff82cfffdfb000 (fee00000)
> (XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000)
> (XEN) IRQ limits: 24 GSI, 760 MSI/MSI-X
> (XEN) Not enabling x2APIC: depends on iommu_supports_eim.
> (XEN) CPU: Physical Processor ID: 0
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
> (XEN) CPU0: No MCE banks present. Machine check support disabled
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Initializing CPU#0
> (XEN) Detected 2592.620 MHz processor.
> (XEN) Initing memory sharing.
> (XEN) alt table ffff82d0802e6f10 -> ffff82d0802e81c4
> (XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
> (XEN) PCI: MCFG area at f0000000 reserved in E820
> (XEN) PCI: Using MCFG for segment 0000 bus 00-7f
> (XEN) I/O virtualisation disabled
> (XEN) smp_store_cpu_info id=0
> (XEN) CPU0: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) set_nr_sockets nr_sockets=4 num_processors=4 disabled_cpus=0 cpus=1
> (XEN) Getting VERSION: 50015
> (XEN) Getting VERSION: 50015
> (XEN) Getting ID: 0
> (XEN) Getting LVT0: 700
> (XEN) Getting LVT1: 400
> (XEN) enabled ExtINT on CPU#0
> (XEN) ENABLING IO-APIC IRQs
> (XEN) -> Using new ACK method
> (XEN) init IO_APIC IRQs
> (XEN) IO-APIC (apicid-pin) 1-0, 1-16, 1-17, 1-18, 1-19, 1-20, 1-21, 1-22,
> 1-23 not connected.
> (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
> (XEN) number of MP IRQ sources: 15.
> (XEN) number of IO-APIC #1 registers: 24.
> (XEN) testing the IO APIC.......................
> (XEN) IO APIC #1......
> (XEN) .... register #00: 01000000
> (XEN) ....... : physical APIC id: 01
> (XEN) ....... : Delivery Type: 0
> (XEN) ....... : LTS : 0
> (XEN) .... register #01: 00170011
> (XEN) ....... : max redirection entries: 0017
> (XEN) ....... : PRQ implemented: 0
> (XEN) ....... : IO APIC version: 0011
> (XEN) .... register #02: 01000000
> (XEN) ....... : arbitration: 01
> (XEN) .... IRQ redirection table:
> (XEN) NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:
> (XEN) 00 000 00 1 0 0 0 0 0 0 00
> (XEN) 01 001 01 0 0 0 0 0 1 1 28
> (XEN) 02 001 01 0 0 0 0 0 1 1 F0
> (XEN) 03 001 01 0 0 0 0 0 1 1 30
> (XEN) 04 001 01 0 0 0 0 0 1 1 F1
> (XEN) 05 001 01 0 0 0 0 0 1 1 38
> (XEN) 06 001 01 0 0 0 0 0 1 1 40
> (XEN) 07 001 01 0 0 0 0 0 1 1 48
> (XEN) 08 001 01 0 0 0 0 0 1 1 50
> (XEN) 09 001 01 0 0 0 0 0 1 1 58
> (XEN) 0a 001 01 0 0 0 0 0 1 1 60
> (XEN) 0b 001 01 0 0 0 0 0 1 1 68
> (XEN) 0c 001 01 0 0 0 0 0 1 1 70
> (XEN) 0d 001 01 0 0 0 0 0 1 1 78
> (XEN) 0e 001 01 0 0 0 0 0 1 1 88
> (XEN) 0f 001 01 0 0 0 0 0 1 1 90
> (XEN) 10 000 00 1 0 0 0 0 0 0 00
> (XEN) 11 000 00 1 0 0 0 0 0 0 00
> (XEN) 12 000 00 1 0 0 0 0 0 0 00
> (XEN) 13 000 00 1 0 0 0 0 0 0 00
> (XEN) 14 000 00 1 0 0 0 0 0 0 00
> (XEN) 15 000 00 1 0 0 0 0 0 0 00
> (XEN) 16 000 00 1 0 0 0 0 0 0 00
> (XEN) 17 000 00 1 0 0 0 0 0 0 00
> (XEN) Using vector-based indexing
> (XEN) IRQ to pin mappings:
> (XEN) IRQ240 -> 0:2
> (XEN) IRQ40 -> 0:1
> (XEN) IRQ48 -> 0:3
> (XEN) IRQ241 -> 0:4
> (XEN) IRQ56 -> 0:5
> (XEN) IRQ64 -> 0:6
> (XEN) IRQ72 -> 0:7
> (XEN) IRQ80 -> 0:8
> (XEN) IRQ88 -> 0:9
> (XEN) IRQ96 -> 0:10
> (XEN) IRQ104 -> 0:11
> (XEN) IRQ112 -> 0:12
> (XEN) IRQ120 -> 0:13
> (XEN) IRQ136 -> 0:14
> (XEN) IRQ144 -> 0:15
> (XEN) .................................... done.
> (XEN) Using local APIC timer interrupts.
> (XEN) calibrating APIC timer ...
> (XEN) ..... CPU clock speed is 2592.9295 MHz.
> (XEN) ..... host bus clock speed is 92.5953 MHz.
> (XEN) ..... bus_scale = 0x5ed2
> (XEN) Platform timer is 3.579MHz ACPI PM Timer
> (XEN) Allocated console ring of 32 KiB.
> (XEN) mwait-idle: MWAIT substates: 0x10
> (XEN) mwait-idle: v0.4 model 0x46
> (XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
> (XEN) VMX: Supported advanced features:
> (XEN) - APIC TPR shadow
> (XEN) - Extended Page Tables (EPT)
> (XEN) - Virtual-Processor Identifiers (VPID)
> (XEN) - Virtual NMI
> (XEN) - MSR direct-access bitmap
> (XEN) - Unrestricted Guest
> (XEN) HVM: ASIDs enabled.
> (XEN) HVM: VMX enabled
> (XEN) HVM: Hardware Assisted Paging (HAP) not detected
> (XEN) HVM: PVH mode not supported on this platform
> (XEN) CPU 0 APIC 0 -> Node 0
> (XEN) CPU 1 APIC 2 -> Node 0
> (XEN) Booting processor 1/2 eip 8f000
> (XEN) Initializing CPU#1
> (XEN) masked ExtINT on CPU#1
> (XEN) smp_store_cpu_info id=1
> (XEN) CPU: Physical Processor ID: 2
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU1: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=1 socket=2
> socket_cpumask[socket]=0000000000000000
> (XEN) CPU1: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 2 APIC 4 -> Node 0
> (XEN) Booting processor 2/4 eip 8f000
> (XEN) Initializing CPU#2
> (XEN) masked ExtINT on CPU#2
> (XEN) smp_store_cpu_info id=2
> (XEN) CPU: Physical Processor ID: 4
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU2: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=2 socket=4
> socket_cpumask[socket]=ffff8301bd8b5430
> (XEN) CPU2: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 3 APIC 6 -> Node 0
> (XEN) Booting processor 3/6 eip 8f000
> (XEN) Initializing CPU#3
> (XEN) masked ExtINT on CPU#3
> (XEN) smp_store_cpu_info id=3
> (XEN) CPU: Physical Processor ID: 6
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU3: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=3 socket=6
> socket_cpumask[socket]=0000000000000001
> (XEN) CPU3: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) ----[ Xen-4.6.1-pre x86_64 debug=y Not tainted ]----
> (XEN) CPU: 3
> (XEN) RIP: e008:[<ffff82d080188544>] set_cpu_sibling_map+0x53/0x38d
> (XEN) RFLAGS: 0000000000010097 CONTEXT: hypervisor
> (XEN) rax: 0000000000000001 rbx: 0000000000000000 rcx: 000000313d58dc80
> (XEN) rdx: 0000000000000006 rsi: 000000000000001e rdi: 0000000000000003
> (XEN) rbp: ffff8301bd87fee0 rsp: ffff8301bd87fea0 r8: ffff8301bd87fea0
> (XEN) r9: 0000000000000000 r10: 0000000000000001 r11: 0000000000000001
> (XEN) r12: 00000000000000c8 r13: 0000000000000003 r14: 0000000000000000
> (XEN) r15: 0000000000000000 cr0: 000000008005003b cr4: 00000000001526a0
> (XEN) cr3: 00000000bfc9f000 cr2: 0000000000000001
> (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008
> (XEN) Xen stack trace from rsp=ffff8301bd87fea0:
> (XEN) 0000000300000000 0000000000000003 ffff8301bd87fee0
> 0000000000000000
> (XEN) 00000000000000c8 0000000000000003 0000000000000000
> 0000000000000000
> (XEN) ffff8301bd87ff10 ffff82d080188fc3 0000000000000001
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000003 ffff8300bfffb000 000000313d58dc80
> 0000000000000000
> (XEN) Xen call trace:
> (XEN) [<ffff82d080188544>] set_cpu_sibling_map+0x53/0x38d
> (XEN) [<ffff82d080188fc3>] start_secondary+0x1fb/0x256
> (XEN)
> (XEN) Pagetable walk from 0000000000000001:
> (XEN) L4[0x000] = 00000001bd8ec063 ffffffffffffffff
> (XEN) L3[0x000] = 00000001bd8eb063 ffffffffffffffff
> (XEN) L2[0x000] = 00000001bd8ea063 ffffffffffffffff
> (XEN) L1[0x000] = 0000000000000000 ffffffffffffffff
> (XEN)
> (XEN) ****************************************
> (XEN) Panic on CPU 3:
> (XEN) FATAL PAGE FAULT
> (XEN) [error_code=0002]
> (XEN) Faulting linear address: 0000000000000001
> (XEN) ****************************************
> (XEN)
> (XEN) Reboot in five seconds...
>
> Similar issue with 8 CPUs.
>
> Loading xen-4.6-amd64.gz... ok
> Loading vmlinuz-3.14.51-grsec-dock... ok
> Loading initrd.img-3.14.51-grsec-dock... ok
> (XEN) Xen version 4.6.1-pre (Debian 4.6.1~pre-1skyport1) (
> eswierk@skyportsystems.com) (gcc (Debian 4.9.3-4) 4.9.3) debug=y Fri Nov
> 20 10:07:47 PST 2015
> (XEN) Bootloader: SYSLINUX 4.05 20140113
> (XEN) Command line: console=com1,vga com1=115200 no-bootscrub
> dom0_mem=2048M,max:2048M loglvl=all cpuinfo=1 apic_verbosity=debug
> (XEN) Video information:
> (XEN) VGA is text mode 80x25, font 8x16
> (XEN) Disc information:
> (XEN) Found 1 MBR signatures
> (XEN) Found 1 EDD information structures
> (XEN) Xen-e820 RAM map:
> (XEN) 0000000000000000 - 000000000009f800 (usable)
> (XEN) 000000000009f800 - 00000000000a0000 (reserved)
> (XEN) 00000000000dc000 - 0000000000100000 (reserved)
> (XEN) 0000000000100000 - 00000000bfef0000 (usable)
> (XEN) 00000000bfef0000 - 00000000bfeff000 (ACPI data)
> (XEN) 00000000bfeff000 - 00000000bff00000 (ACPI NVS)
> (XEN) 00000000bff00000 - 00000000c0000000 (usable)
> (XEN) 00000000f0000000 - 00000000f8000000 (reserved)
> (XEN) 00000000fec00000 - 00000000fec10000 (reserved)
> (XEN) 00000000fee00000 - 00000000fee01000 (reserved)
> (XEN) 00000000fffe0000 - 0000000100000000 (reserved)
> (XEN) 0000000100000000 - 00000001c0000000 (usable)
> (XEN) ACPI: RSDP 000F6A10, 0024 (r2 PTLTD )
> (XEN) ACPI: XSDT BFEF00E7, 0054 (r1 INTEL 440BX 6040000 VMW 1324272)
> (XEN) ACPI: FACP BFEFEE73, 00F4 (r4 INTEL 440BX 6040000 PTL F4240)
> (XEN) ACPI: DSDT BFEF0405, EA6E (r1 PTLTD Custom 6040000 MSFT 3000001)
> (XEN) ACPI: FACS BFEFFFC0, 0040
> (XEN) ACPI: BOOT BFEF03DD, 0028 (r1 PTLTD $SBFTBL$ 6040000 LTP 1)
> (XEN) ACPI: APIC BFEF032B, 00B2 (r1 PTLTD APIC 6040000 LTP 0)
> (XEN) ACPI: MCFG BFEF02EF, 003C (r1 PTLTD $PCITBL$ 6040000 LTP 1)
> (XEN) ACPI: SRAT BFEF019F, 0150 (r2 VMWARE MEMPLUG 6040000 VMW 1)
> (XEN) ACPI: WAET BFEF0177, 0028 (r1 VMWARE VMW WAET 6040000 VMW 1)
> (XEN) System RAM: 6143MB (6291004kB)
> (XEN) SRAT: PXM 0 -> APIC 00 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 02 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 04 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 06 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 08 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 0a -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 0c -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 0e -> Node 0
> (XEN) SRAT: Node 0 PXM 0 0-a0000
> (XEN) SRAT: Node 0 PXM 0 100000-10000000
> (XEN) SRAT: Node 0 PXM 0 10000000-c0000000
> (XEN) SRAT: Node 0 PXM 0 100000000-1c0000000
> (XEN) NUMA: Allocated memnodemap from 1bd8f8000 - 1bd8fa000
> (XEN) NUMA: Using 8 for the hash shift.
> (XEN) Domain heap initialised
> (XEN) found SMP MP-table at 000f6a80
> (XEN) DMI present.
> (XEN) APIC boot state is 'xapic'
> (XEN) Using APIC driver default
> (XEN) ACPI: PM-Timer IO Port: 0x1008
> (XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0]
> (XEN) ACPI: wakeup_vec[bfefffcc], vec_size[20]
> (XEN) ACPI: Local APIC address 0xfee00000
> (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> (XEN) Processor #0 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x02] enabled)
> (XEN) Processor #2 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x04] enabled)
> (XEN) Processor #4 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x06] enabled)
> (XEN) Processor #6 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x08] enabled)
> (XEN) Processor #8 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x0a] enabled)
> (XEN) Processor #10 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0c] enabled)
> (XEN) Processor #12 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0e] enabled)
> (XEN) Processor #14 6:6 APIC version 21
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
> (XEN) ACPI: IOAPIC (id[0x01] address[0xfec00000] gsi_base[0])
> (XEN) IOAPIC[0]: apic_id 1, version 17, address 0xfec00000, GSI 0-23
> (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> (XEN) ACPI: IRQ0 used by override.
> (XEN) ACPI: IRQ2 used by override.
> (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs
> (XEN) ERST table was not found
> (XEN) Using ACPI (MADT) for SMP configuration information
> (XEN) SMP: Allowing 8 CPUs (0 hotplug CPUs)
> (XEN) mapped APIC to ffff82cfffdfb000 (fee00000)
> (XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000)
> (XEN) IRQ limits: 24 GSI, 1528 MSI/MSI-X
> (XEN) Not enabling x2APIC: depends on iommu_supports_eim.
> (XEN) CPU: Physical Processor ID: 0
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
> (XEN) CPU0: No MCE banks present. Machine check support disabled
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Initializing CPU#0
> (XEN) Detected 2592.575 MHz processor.
> (XEN) Initing memory sharing.
> (XEN) alt table ffff82d0802e6f10 -> ffff82d0802e81c4
> (XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
> (XEN) PCI: MCFG area at f0000000 reserved in E820
> (XEN) PCI: Using MCFG for segment 0000 bus 00-7f
> (XEN) I/O virtualisation disabled
> (XEN) smp_store_cpu_info id=0
> (XEN) CPU0: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) set_nr_sockets nr_sockets=8 num_processors=8 disabled_cpus=0 cpus=1
> (XEN) Getting VERSION: 50015
> (XEN) Getting VERSION: 50015
> (XEN) Getting ID: 0
> (XEN) Getting LVT0: 700
> (XEN) Getting LVT1: 400
> (XEN) enabled ExtINT on CPU#0
> (XEN) ENABLING IO-APIC IRQs
> (XEN) -> Using new ACK method
> (XEN) init IO_APIC IRQs
> (XEN) IO-APIC (apicid-pin) 1-0, 1-16, 1-17, 1-18, 1-19, 1-20, 1-21, 1-22,
> 1-23 not connected.
> (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
> (XEN) number of MP IRQ sources: 15.
> (XEN) number of IO-APIC #1 registers: 24.
> (XEN) testing the IO APIC.......................
> (XEN) IO APIC #1......
> (XEN) .... register #00: 01000000
> (XEN) ....... : physical APIC id: 01
> (XEN) ....... : Delivery Type: 0
> (XEN) ....... : LTS : 0
> (XEN) .... register #01: 00170011
> (XEN) ....... : max redirection entries: 0017
> (XEN) ....... : PRQ implemented: 0
> (XEN) ....... : IO APIC version: 0011
> (XEN) .... register #02: 01000000
> (XEN) ....... : arbitration: 01
> (XEN) .... IRQ redirection table:
> (XEN) NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:
> (XEN) 00 000 00 1 0 0 0 0 0 0 00
> (XEN) 01 001 01 0 0 0 0 0 1 1 28
> (XEN) 02 001 01 0 0 0 0 0 1 1 F0
> (XEN) 03 001 01 0 0 0 0 0 1 1 30
> (XEN) 04 001 01 0 0 0 0 0 1 1 F1
> (XEN) 05 001 01 0 0 0 0 0 1 1 38
> (XEN) 06 001 01 0 0 0 0 0 1 1 40
> (XEN) 07 001 01 0 0 0 0 0 1 1 48
> (XEN) 08 001 01 0 0 0 0 0 1 1 50
> (XEN) 09 001 01 0 0 0 0 0 1 1 58
> (XEN) 0a 001 01 0 0 0 0 0 1 1 60
> (XEN) 0b 001 01 0 0 0 0 0 1 1 68
> (XEN) 0c 001 01 0 0 0 0 0 1 1 70
> (XEN) 0d 001 01 0 0 0 0 0 1 1 78
> (XEN) 0e 001 01 0 0 0 0 0 1 1 88
> (XEN) 0f 001 01 0 0 0 0 0 1 1 90
> (XEN) 10 000 00 1 0 0 0 0 0 0 00
> (XEN) 11 000 00 1 0 0 0 0 0 0 00
> (XEN) 12 000 00 1 0 0 0 0 0 0 00
> (XEN) 13 000 00 1 0 0 0 0 0 0 00
> (XEN) 14 000 00 1 0 0 0 0 0 0 00
> (XEN) 15 000 00 1 0 0 0 0 0 0 00
> (XEN) 16 000 00 1 0 0 0 0 0 0 00
> (XEN) 17 000 00 1 0 0 0 0 0 0 00
> (XEN) Using vector-based indexing
> (XEN) IRQ to pin mappings:
> (XEN) IRQ240 -> 0:2
> (XEN) IRQ40 -> 0:1
> (XEN) IRQ48 -> 0:3
> (XEN) IRQ241 -> 0:4
> (XEN) IRQ56 -> 0:5
> (XEN) IRQ64 -> 0:6
> (XEN) IRQ72 -> 0:7
> (XEN) IRQ80 -> 0:8
> (XEN) IRQ88 -> 0:9
> (XEN) IRQ96 -> 0:10
> (XEN) IRQ104 -> 0:11
> (XEN) IRQ112 -> 0:12
> (XEN) IRQ120 -> 0:13
> (XEN) IRQ136 -> 0:14
> (XEN) IRQ144 -> 0:15
> (XEN) .................................... done.
> (XEN) Using local APIC timer interrupts.
> (XEN) calibrating APIC timer ...
> (XEN) ..... CPU clock speed is 2592.9336 MHz.
> (XEN) ..... host bus clock speed is 92.6030 MHz.
> (XEN) ..... bus_scale = 0x5ed5
> (XEN) Platform timer is 3.579MHz ACPI PM Timer
> (XEN) Allocated console ring of 64 KiB.
> (XEN) mwait-idle: MWAIT substates: 0x10
> (XEN) mwait-idle: v0.4 model 0x46
> (XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
> (XEN) VMX: Supported advanced features:
> (XEN) - APIC TPR shadow
> (XEN) - Extended Page Tables (EPT)
> (XEN) - Virtual-Processor Identifiers (VPID)
> (XEN) - Virtual NMI
> (XEN) - MSR direct-access bitmap
> (XEN) - Unrestricted Guest
> (XEN) HVM: ASIDs enabled.
> (XEN) HVM: VMX enabled
> (XEN) HVM: Hardware Assisted Paging (HAP) not detected
> (XEN) HVM: PVH mode not supported on this platform
> (XEN) CPU 0 APIC 0 -> Node 0
> (XEN) CPU 1 APIC 2 -> Node 0
> (XEN) Booting processor 1/2 eip 8f000
> (XEN) Initializing CPU#1
> (XEN) masked ExtINT on CPU#1
> (XEN) smp_store_cpu_info id=1
> (XEN) CPU: Physical Processor ID: 2
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU1: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=1 socket=2
> socket_cpumask[socket]=0000000000000000
> (XEN) CPU1: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 2 APIC 4 -> Node 0
> (XEN) Booting processor 2/4 eip 8f000
> (XEN) Initializing CPU#2
> (XEN) masked ExtINT on CPU#2
> (XEN) smp_store_cpu_info id=2
> (XEN) CPU: Physical Processor ID: 4
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU2: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=2 socket=4
> socket_cpumask[socket]=0000000000000000
> (XEN) CPU2: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 3 APIC 6 -> Node 0
> (XEN) Booting processor 3/6 eip 8f000
> (XEN) Initializing CPU#3
> (XEN) masked ExtINT on CPU#3
> (XEN) smp_store_cpu_info id=3
> (XEN) CPU: Physical Processor ID: 6
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU3: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=3 socket=6
> socket_cpumask[socket]=0000000000000000
> (XEN) CPU3: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 4 APIC 8 -> Node 0
> (XEN) Booting processor 4/8 eip 8f000
> (XEN) Initializing CPU#4
> (XEN) masked ExtINT on CPU#4
> (XEN) smp_store_cpu_info id=4
> (XEN) CPU: Physical Processor ID: 8
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU4: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=4 socket=8
> socket_cpumask[socket]=ffff8301bd865430
> (XEN) CPU4: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 5 APIC 10 -> Node 0
> (XEN) Booting processor 5/10 eip 8f000
> (XEN) Initializing CPU#5
> (XEN) masked ExtINT on CPU#5
> (XEN) smp_store_cpu_info id=5
> (XEN) CPU: Physical Processor ID: 10
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU5: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=5 socket=10
> socket_cpumask[socket]=0000000000000001
> (XEN) CPU5: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) ----[ Xen-4.6.1-pre x86_64 debug=y Not tainted ]----
> (XEN) CPU: 5
> (XEN) RIP: e008:[<ffff82d080188544>] set_cpu_sibling_map+0x53/0x38d
> (XEN) RFLAGS: 0000000000010093 CONTEXT: hypervisor
> (XEN) rax: 0000000000000001 rbx: 0000000000000000 rcx: 000000313d571c80
> (XEN) rdx: 000000000000000a rsi: 0000000000000026 rdi: 0000000000000005
> (XEN) rbp: ffff8301bd8a7ee0 rsp: ffff8301bd8a7ea0 r8: ffff8301bd8a7ea0
> (XEN) r9: 0000000000000000 r10: 0000000000000001 r11: 0000000000000001
> (XEN) r12: 00000000000000c8 r13: 0000000000000005 r14: 0000000000000000
> (XEN) r15: 0000000000000000 cr0: 000000008005003b cr4: 00000000001526a0
> (XEN) cr3: 00000000bfc9f000 cr2: 0000000000000001
> (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008
> (XEN) Xen stack trace from rsp=ffff8301bd8a7ea0:
> (XEN) 0000000500000000 0000000000000005 ffff8301bd8a7ee0
> 0000000000000000
> (XEN) 00000000000000c8 0000000000000005 0000000000000000
> 0000000000000000
> (XEN) ffff8301bd8a7f10 ffff82d080188fc3 0000000000000001
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000000 0000000000000000 0000000000000000
> 0000000000000000
> (XEN) 0000000000000005 ffff8300bfff9000 000000313d571c80
> 0000000000000000
> (XEN) Xen call trace:
> (XEN) [<ffff82d080188544>] set_cpu_sibling_map+0x53/0x38d
> (XEN) [<ffff82d080188fc3>] start_secondary+0x1fb/0x256
> (XEN)
> (XEN) Pagetable walk from 0000000000000001:
> (XEN) L4[0x000] = 00000001bd8ec063 ffffffffffffffff
> (XEN) L3[0x000] = 00000001bd8eb063 ffffffffffffffff
> (XEN) L2[0x000] = 00000001bd8ea063 ffffffffffffffff
> (XEN) L1[0x000] = 0000000000000000 ffffffffffffffff
> (XEN)
> (XEN) ****************************************
> (XEN) Panic on CPU 5:
> (XEN) FATAL PAGE FAULT
> (XEN) [error_code=0002]
> (XEN) Faulting linear address: 0000000000000001
> (XEN) ****************************************
> (XEN)
> (XEN) Reboot in five seconds...
> (XEN) Resetting with ACPI MEMORY or I/O RESET_REG.
>
> With 3 CPUs the situation is completely different. nr_sockets=1, but
> socket is always 0 in smp_store_cpu_info().
>
> Loading xen-4.6-amd64.gz... ok
> Loading vmlinuz-3.14.51-grsec-dock... ok
> Loading initrd.img-3.14.51-grsec-dock... ok
> (XEN) Xen version 4.6.1-pre (Debian 4.6.1~pre-1skyport1) (
> eswierk@skyportsystems.com) (gcc (Debian 4.9.3-4) 4.9.3) debug=y Fri Nov
> 20 10:07:47 PST 2015
> (XEN) Bootloader: SYSLINUX 4.05 20140113
> (XEN) Command line: console=com1,vga com1=115200 no-bootscrub
> dom0_mem=2048M,max:2048M loglvl=all cpuinfo=1 apic_verbosity=debug
> (XEN) Video information:
> (XEN) VGA is text mode 80x25, font 8x16
> (XEN) Disc information:
> (XEN) Found 1 MBR signatures
> (XEN) Found 1 EDD information structures
> (XEN) Xen-e820 RAM map:
> (XEN) 0000000000000000 - 000000000009f800 (usable)
> (XEN) 000000000009f800 - 00000000000a0000 (reserved)
> (XEN) 00000000000dc000 - 0000000000100000 (reserved)
> (XEN) 0000000000100000 - 00000000bfef0000 (usable)
> (XEN) 00000000bfef0000 - 00000000bfeff000 (ACPI data)
> (XEN) 00000000bfeff000 - 00000000bff00000 (ACPI NVS)
> (XEN) 00000000bff00000 - 00000000c0000000 (usable)
> (XEN) 00000000f0000000 - 00000000f8000000 (reserved)
> (XEN) 00000000fec00000 - 00000000fec10000 (reserved)
> (XEN) 00000000fee00000 - 00000000fee01000 (reserved)
> (XEN) 00000000fffe0000 - 0000000100000000 (reserved)
> (XEN) 0000000100000000 - 00000001c0000000 (usable)
> (XEN) ACPI: RSDP 000F6A10, 0024 (r2 PTLTD )
> (XEN) ACPI: XSDT BFEF0396, 0054 (r1 INTEL 440BX 6040000 VMW 1324272)
> (XEN) ACPI: FACP BFEFEE73, 00F4 (r4 INTEL 440BX 6040000 PTL F4240)
> (XEN) ACPI: DSDT BFEF061E, E855 (r1 PTLTD Custom 6040000 MSFT 3000001)
> (XEN) ACPI: FACS BFEFFFC0, 0040
> (XEN) ACPI: BOOT BFEF05F6, 0028 (r1 PTLTD $SBFTBL$ 6040000 LTP 1)
> (XEN) ACPI: APIC BFEF058A, 006C (r1 PTLTD APIC 6040000 LTP 0)
> (XEN) ACPI: MCFG BFEF054E, 003C (r1 PTLTD $PCITBL$ 6040000 LTP 1)
> (XEN) ACPI: SRAT BFEF044E, 0100 (r2 VMWARE MEMPLUG 6040000 VMW 1)
> (XEN) ACPI: WAET BFEF0426, 0028 (r1 VMWARE VMW WAET 6040000 VMW 1)
> (XEN) System RAM: 6143MB (6291004kB)
> (XEN) SRAT: PXM 0 -> APIC 00 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 01 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 02 -> Node 0
> (XEN) SRAT: Node 0 PXM 0 0-a0000
> (XEN) SRAT: Node 0 PXM 0 100000-10000000
> (XEN) SRAT: Node 0 PXM 0 10000000-c0000000
> (XEN) SRAT: Node 0 PXM 0 100000000-1c0000000
> (XEN) NUMA: Allocated memnodemap from 1bd8f8000 - 1bd8fa000
> (XEN) NUMA: Using 8 for the hash shift.
> (XEN) Domain heap initialised
> (XEN) found SMP MP-table at 000f6a80
> (XEN) DMI present.
> (XEN) APIC boot state is 'xapic'
> (XEN) Using APIC driver default
> (XEN) ACPI: PM-Timer IO Port: 0x1008
> (XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0]
> (XEN) ACPI: wakeup_vec[bfefffcc], vec_size[20]
> (XEN) ACPI: Local APIC address 0xfee00000
> (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> (XEN) Processor #0 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
> (XEN) Processor #1 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
> (XEN) Processor #2 6:6 APIC version 21
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
> (XEN) ACPI: IOAPIC (id[0x03] address[0xfec00000] gsi_base[0])
> (XEN) IOAPIC[0]: apic_id 3, version 17, address 0xfec00000, GSI 0-23
> (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> (XEN) ACPI: IRQ0 used by override.
> (XEN) ACPI: IRQ2 used by override.
> (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs
> (XEN) ERST table was not found
> (XEN) Using ACPI (MADT) for SMP configuration information
> (XEN) SMP: Allowing 3 CPUs (0 hotplug CPUs)
> (XEN) mapped APIC to ffff82cfffdfb000 (fee00000)
> (XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000)
> (XEN) IRQ limits: 24 GSI, 568 MSI/MSI-X
> (XEN) Not enabling x2APIC: depends on iommu_supports_eim.
> (XEN) CPU: Physical Processor ID: 0
> (XEN) CPU: Processor Core ID: 0
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
> (XEN) CPU0: No MCE banks present. Machine check support disabled
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Initializing CPU#0
> (XEN) Detected 2592.635 MHz processor.
> (XEN) Initing memory sharing.
> (XEN) alt table ffff82d0802e6f10 -> ffff82d0802e81c4
> (XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
> (XEN) PCI: MCFG area at f0000000 reserved in E820
> (XEN) PCI: Using MCFG for segment 0000 bus 00-7f
> (XEN) I/O virtualisation disabled
> (XEN) smp_store_cpu_info id=0
> (XEN) CPU0: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) set_nr_sockets nr_sockets=1 num_processors=3 disabled_cpus=0 cpus=3
> (XEN) Getting VERSION: 50015
> (XEN) Getting VERSION: 50015
> (XEN) Getting ID: 0
> (XEN) Getting LVT0: 700
> (XEN) Getting LVT1: 400
> (XEN) enabled ExtINT on CPU#0
> (XEN) ENABLING IO-APIC IRQs
> (XEN) -> Using new ACK method
> (XEN) init IO_APIC IRQs
> (XEN) IO-APIC (apicid-pin) 3-0, 3-16, 3-17, 3-18, 3-19, 3-20, 3-21, 3-22,
> 3-23 not connected.
> (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
> (XEN) number of MP IRQ sources: 15.
> (XEN) number of IO-APIC #3 registers: 24.
> (XEN) testing the IO APIC.......................
> (XEN) IO APIC #3......
> (XEN) .... register #00: 03000000
> (XEN) ....... : physical APIC id: 03
> (XEN) ....... : Delivery Type: 0
> (XEN) ....... : LTS : 0
> (XEN) .... register #01: 00170011
> (XEN) ....... : max redirection entries: 0017
> (XEN) ....... : PRQ implemented: 0
> (XEN) ....... : IO APIC version: 0011
> (XEN) .... register #02: 03000000
> (XEN) ....... : arbitration: 03
> (XEN) .... IRQ redirection table:
> (XEN) NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:
> (XEN) 00 000 00 1 0 0 0 0 0 0 00
> (XEN) 01 001 01 0 0 0 0 0 1 1 28
> (XEN) 02 001 01 0 0 0 0 0 1 1 F0
> (XEN) 03 001 01 0 0 0 0 0 1 1 30
> (XEN) 04 001 01 0 0 0 0 0 1 1 F1
> (XEN) 05 001 01 0 0 0 0 0 1 1 38
> (XEN) 06 001 01 0 0 0 0 0 1 1 40
> (XEN) 07 001 01 0 0 0 0 0 1 1 48
> (XEN) 08 001 01 0 0 0 0 0 1 1 50
> (XEN) 09 001 01 0 0 0 0 0 1 1 58
> (XEN) 0a 001 01 0 0 0 0 0 1 1 60
> (XEN) 0b 001 01 0 0 0 0 0 1 1 68
> (XEN) 0c 001 01 0 0 0 0 0 1 1 70
> (XEN) 0d 001 01 0 0 0 0 0 1 1 78
> (XEN) 0e 001 01 0 0 0 0 0 1 1 88
> (XEN) 0f 001 01 0 0 0 0 0 1 1 90
> (XEN) 10 000 00 1 0 0 0 0 0 0 00
> (XEN) 11 000 00 1 0 0 0 0 0 0 00
> (XEN) 12 000 00 1 0 0 0 0 0 0 00
> (XEN) 13 000 00 1 0 0 0 0 0 0 00
> (XEN) 14 000 00 1 0 0 0 0 0 0 00
> (XEN) 15 000 00 1 0 0 0 0 0 0 00
> (XEN) 16 000 00 1 0 0 0 0 0 0 00
> (XEN) 17 000 00 1 0 0 0 0 0 0 00
> (XEN) Using vector-based indexing
> (XEN) IRQ to pin mappings:
> (XEN) IRQ240 -> 0:2
> (XEN) IRQ40 -> 0:1
> (XEN) IRQ48 -> 0:3
> (XEN) IRQ241 -> 0:4
> (XEN) IRQ56 -> 0:5
> (XEN) IRQ64 -> 0:6
> (XEN) IRQ72 -> 0:7
> (XEN) IRQ80 -> 0:8
> (XEN) IRQ88 -> 0:9
> (XEN) IRQ96 -> 0:10
> (XEN) IRQ104 -> 0:11
> (XEN) IRQ112 -> 0:12
> (XEN) IRQ120 -> 0:13
> (XEN) IRQ136 -> 0:14
> (XEN) IRQ144 -> 0:15
> (XEN) .................................... done.
> (XEN) Using local APIC timer interrupts.
> (XEN) calibrating APIC timer ...
> (XEN) ..... CPU clock speed is 2592.9209 MHz.
> (XEN) ..... host bus clock speed is 92.5952 MHz.
> (XEN) ..... bus_scale = 0x5ed2
> (XEN) Platform timer is 3.579MHz ACPI PM Timer
> (XEN) Allocated console ring of 32 KiB.
> (XEN) mwait-idle: MWAIT substates: 0x10
> (XEN) mwait-idle: v0.4 model 0x46
> (XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
> (XEN) VMX: Supported advanced features:
> (XEN) - APIC TPR shadow
> (XEN) - Extended Page Tables (EPT)
> (XEN) - Virtual-Processor Identifiers (VPID)
> (XEN) - Virtual NMI
> (XEN) - MSR direct-access bitmap
> (XEN) - Unrestricted Guest
> (XEN) HVM: ASIDs enabled.
> (XEN) HVM: VMX enabled
> (XEN) HVM: Hardware Assisted Paging (HAP) not detected
> (XEN) HVM: PVH mode not supported on this platform
> (XEN) CPU 0 APIC 0 -> Node 0
> (XEN) CPU 1 APIC 1 -> Node 0
> (XEN) Booting processor 1/1 eip 8f000
> (XEN) Initializing CPU#1
> (XEN) masked ExtINT on CPU#1
> (XEN) smp_store_cpu_info id=1
> (XEN) CPU: Physical Processor ID: 0
> (XEN) CPU: Processor Core ID: 1
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU1: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=1 socket=0
> socket_cpumask[socket]=ffff8301bd8e5460
> (XEN) CPU1: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 2 APIC 2 -> Node 0
> (XEN) Booting processor 2/2 eip 8f000
> (XEN) Initializing CPU#2
> (XEN) masked ExtINT on CPU#2
> (XEN) smp_store_cpu_info id=2
> (XEN) CPU: Physical Processor ID: 0
> (XEN) CPU: Processor Core ID: 2
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU2: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=2 socket=0
> socket_cpumask[socket]=ffff8301bd8e5460
> (XEN) CPU2: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) Brought up 3 CPUs
> (XEN) ACPI sleep modes: S3
> (XEN) VPMU: disabled
> (XEN) Dom0 has maximum 408 PIRQs
> (XEN) NX (Execute Disable) protection active
> (XEN) *** LOADING DOMAIN 0 ***
> (XEN) elf_parse_binary: phdr: paddr=0x1000000 memsz=0x68f6d8
> (XEN) elf_parse_binary: phdr: paddr=0x1690000 memsz=0x409000
> (XEN) elf_parse_binary: phdr: paddr=0x1a99000 memsz=0x32c120
> (XEN) elf_parse_binary: phdr: paddr=0x1dc6000 memsz=0x1000
> (XEN) elf_parse_binary: phdr: paddr=0x1dc7000 memsz=0x1d13c0
> (XEN) elf_parse_binary: phdr: paddr=0x1f99000 memsz=0x53000
> (XEN) elf_parse_binary: phdr: paddr=0x1fec000 memsz=0x1250
> (XEN) elf_parse_binary: phdr: paddr=0x1fee000 memsz=0x1012000
> (XEN) elf_parse_binary: memory: 0x1000000 -> 0x3000000
> (XEN) elf_xen_parse_note: GUEST_OS = "linux"
> (XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
> (XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
> (XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
> (XEN) elf_xen_parse_note: ENTRY = 0xffffffff81f991f0
> (XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff81001000
> (XEN) elf_xen_parse_note: FEATURES =
> "!writable_page_tables|pae_pgdir_above_4gb"
> (XEN) elf_xen_parse_note: SUPPORTED_FEATURES = 0x801
> (XEN) elf_xen_parse_note: PAE_MODE = "yes"
> (XEN) elf_xen_parse_note: LOADER = "generic"
> (XEN) elf_xen_parse_note: unknown xen elf note (0xd)
> (XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x1
> (XEN) elf_xen_parse_note: HV_START_LOW = 0xffff800000000000
> (XEN) elf_xen_parse_note: PADDR_OFFSET = 0x0
> (XEN) elf_xen_addr_calc_check: addresses:
> (XEN) virt_base = 0xffffffff80000000
> (XEN) elf_paddr_offset = 0x0
> (XEN) virt_offset = 0xffffffff80000000
> (XEN) virt_kstart = 0xffffffff81000000
> (XEN) virt_kend = 0xffffffff83000000
> (XEN) virt_entry = 0xffffffff81f991f0
> (XEN) p2m_base = 0xffffffffffffffff
> (XEN) Xen kernel: 64-bit, lsb, compat32
> (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x3000000
> (XEN) PHYSICAL MEMORY ARRANGEMENT:
> (XEN) Dom0 alloc.: 00000001b4000000->00000001b8000000 (504532 pages to
> be allocated)
> (XEN) Init. ramdisk: 00000001bf2d4000->00000001bffff800
> (XEN) VIRTUAL MEMORY ARRANGEMENT:
> (XEN) Loaded kernel: ffffffff81000000->ffffffff83000000
> (XEN) Init. ramdisk: ffffffff83000000->ffffffff83d2b800
> (XEN) Phys-Mach map: ffffffff83d2c000->ffffffff8412c000
> (XEN) Start info: ffffffff8412c000->ffffffff8412c4b4
> (XEN) Page tables: ffffffff8412d000->ffffffff84152000
> (XEN) Boot stack: ffffffff84152000->ffffffff84153000
> (XEN) TOTAL: ffffffff80000000->ffffffff84400000
> (XEN) ENTRY ADDRESS: ffffffff81f991f0
> (XEN) Dom0 has maximum 3 VCPUs
> (XEN) elf_load_binary: phdr 0 at 0xffffffff81000000 -> 0xffffffff8168f6d8
> (XEN) elf_load_binary: phdr 1 at 0xffffffff81690000 -> 0xffffffff81a99000
> (XEN) elf_load_binary: phdr 2 at 0xffffffff81a99000 -> 0xffffffff81dc5120
> (XEN) elf_load_binary: phdr 3 at 0xffffffff81dc6000 -> 0xffffffff81dc7000
> (XEN) elf_load_binary: phdr 4 at 0xffffffff81dc7000 -> 0xffffffff81f983c0
> (XEN) elf_load_binary: phdr 5 at 0xffffffff81f99000 -> 0xffffffff81fec000
> (XEN) elf_load_binary: phdr 6 at 0xffffffff81fec000 -> 0xffffffff81fed250
> (XEN) elf_load_binary: phdr 7 at 0xffffffff81fee000 -> 0xffffffff820ce000
> (XEN) Std. Loglevel: All
> (XEN) Guest Loglevel: All
> (XEN) Xen is relinquishing VGA console.
> (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input
> to Xen)
> (XEN) Freed 308kB init memory.
> mapping kernel into physical memory
> about to get started...
>
> Similarly with 6 CPUs, nr_sockets=2, and socket is always 0 or 1 in
> smp_store_cpu_info().
>
> Loading xen-4.6-amd64.gz... ok
> Loading vmlinuz-3.14.51-grsec-dock... ok
> Loading initrd.img-3.14.51-grsec-dock... ok
> (XEN) Xen version 4.6.1-pre (Debian 4.6.1~pre-1skyport1) (
> eswierk@skyportsystems.com) (gcc (Debian 4.9.3-4) 4.9.3) debug=y Fri Nov
> 20 10:07:47 PST 2015
> (XEN) Bootloader: SYSLINUX 4.05 20140113
> (XEN) Command line: console=com1,vga com1=115200 no-bootscrub
> dom0_mem=2048M,max:2048M loglvl=all cpuinfo=1 apic_verbosity=debug
> (XEN) Video information:
> (XEN) VGA is text mode 80x25, font 8x16
> (XEN) Disc information:
> (XEN) Found 1 MBR signatures
> (XEN) Found 1 EDD information structures
> (XEN) Xen-e820 RAM map:
> (XEN) 0000000000000000 - 000000000009f800 (usable)
> (XEN) 000000000009f800 - 00000000000a0000 (reserved)
> (XEN) 00000000000dc000 - 0000000000100000 (reserved)
> (XEN) 0000000000100000 - 00000000bfef0000 (usable)
> (XEN) 00000000bfef0000 - 00000000bfeff000 (ACPI data)
> (XEN) 00000000bfeff000 - 00000000bff00000 (ACPI NVS)
> (XEN) 00000000bff00000 - 00000000c0000000 (usable)
> (XEN) 00000000f0000000 - 00000000f8000000 (reserved)
> (XEN) 00000000fec00000 - 00000000fec10000 (reserved)
> (XEN) 00000000fee00000 - 00000000fee01000 (reserved)
> (XEN) 00000000fffe0000 - 0000000100000000 (reserved)
> (XEN) 0000000100000000 - 00000001c0000000 (usable)
> (XEN) ACPI: RSDP 000F6A10, 0024 (r2 PTLTD )
> (XEN) ACPI: XSDT BFEF01F9, 0054 (r1 INTEL 440BX 6040000 VMW 1324272)
> (XEN) ACPI: FACP BFEFEE73, 00F4 (r4 INTEL 440BX 6040000 PTL F4240)
> (XEN) ACPI: DSDT BFEF04DB, E998 (r1 PTLTD Custom 6040000 MSFT 3000001)
> (XEN) ACPI: FACS BFEFFFC0, 0040
> (XEN) ACPI: BOOT BFEF04B3, 0028 (r1 PTLTD $SBFTBL$ 6040000 LTP 1)
> (XEN) ACPI: APIC BFEF041D, 0096 (r1 PTLTD APIC 6040000 LTP 0)
> (XEN) ACPI: MCFG BFEF03E1, 003C (r1 PTLTD $PCITBL$ 6040000 LTP 1)
> (XEN) ACPI: SRAT BFEF02B1, 0130 (r2 VMWARE MEMPLUG 6040000 VMW 1)
> (XEN) ACPI: WAET BFEF0289, 0028 (r1 VMWARE VMW WAET 6040000 VMW 1)
> (XEN) System RAM: 6143MB (6291004kB)
> (XEN) SRAT: PXM 0 -> APIC 00 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 01 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 02 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 04 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 05 -> Node 0
> (XEN) SRAT: PXM 0 -> APIC 06 -> Node 0
> (XEN) SRAT: Node 0 PXM 0 0-a0000
> (XEN) SRAT: Node 0 PXM 0 100000-10000000
> (XEN) SRAT: Node 0 PXM 0 10000000-c0000000
> (XEN) SRAT: Node 0 PXM 0 100000000-1c0000000
> (XEN) NUMA: Allocated memnodemap from 1bd8f8000 - 1bd8fa000
> (XEN) NUMA: Using 8 for the hash shift.
> (XEN) Domain heap initialised
> (XEN) found SMP MP-table at 000f6a80
> (XEN) DMI present.
> (XEN) APIC boot state is 'xapic'
> (XEN) Using APIC driver default
> (XEN) ACPI: PM-Timer IO Port: 0x1008
> (XEN) ACPI: SLEEP INFO: pm1x_cnt[1:1004,1:0], pm1x_evt[1:1000,1:0]
> (XEN) ACPI: wakeup_vec[bfefffcc], vec_size[20]
> (XEN) ACPI: Local APIC address 0xfee00000
> (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> (XEN) Processor #0 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
> (XEN) Processor #1 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
> (XEN) Processor #2 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
> (XEN) Processor #4 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x05] enabled)
> (XEN) Processor #5 6:6 APIC version 21
> (XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x06] enabled)
> (XEN) Processor #6 6:6 APIC version 21
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
> (XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
> (XEN) ACPI: IOAPIC (id[0x03] address[0xfec00000] gsi_base[0])
> (XEN) IOAPIC[0]: apic_id 3, version 17, address 0xfec00000, GSI 0-23
> (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
> (XEN) ACPI: IRQ0 used by override.
> (XEN) ACPI: IRQ2 used by override.
> (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs
> (XEN) ERST table was not found
> (XEN) Using ACPI (MADT) for SMP configuration information
> (XEN) SMP: Allowing 6 CPUs (0 hotplug CPUs)
> (XEN) mapped APIC to ffff82cfffdfb000 (fee00000)
> (XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000)
> (XEN) IRQ limits: 24 GSI, 1144 MSI/MSI-X
> (XEN) Not enabling x2APIC: depends on iommu_supports_eim.
> (XEN) CPU: Physical Processor ID: 0
> (XEN) CPU: Processor Core ID: 0
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
> (XEN) CPU0: No MCE banks present. Machine check support disabled
> (XEN) Using scheduler: SMP Credit Scheduler (credit)
> (XEN) Initializing CPU#0
> (XEN) Detected 2592.566 MHz processor.
> (XEN) Initing memory sharing.
> (XEN) alt table ffff82d0802e6f10 -> ffff82d0802e81c4
> (XEN) PCI: MCFG configuration 0: base f0000000 segment 0000 buses 00 - 7f
> (XEN) PCI: MCFG area at f0000000 reserved in E820
> (XEN) PCI: Using MCFG for segment 0000 bus 00-7f
> (XEN) I/O virtualisation disabled
> (XEN) smp_store_cpu_info id=0
> (XEN) CPU0: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) set_nr_sockets nr_sockets=2 num_processors=6 disabled_cpus=0 cpus=3
> (XEN) Getting VERSION: 50015
> (XEN) Getting VERSION: 50015
> (XEN) Getting ID: 0
> (XEN) Getting LVT0: 700
> (XEN) Getting LVT1: 400
> (XEN) enabled ExtINT on CPU#0
> (XEN) ENABLING IO-APIC IRQs
> (XEN) -> Using new ACK method
> (XEN) init IO_APIC IRQs
> (XEN) IO-APIC (apicid-pin) 3-0, 3-16, 3-17, 3-18, 3-19, 3-20, 3-21, 3-22,
> 3-23 not connected.
> (XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
> (XEN) number of MP IRQ sources: 15.
> (XEN) number of IO-APIC #3 registers: 24.
> (XEN) testing the IO APIC.......................
> (XEN) IO APIC #3......
> (XEN) .... register #00: 03000000
> (XEN) ....... : physical APIC id: 03
> (XEN) ....... : Delivery Type: 0
> (XEN) ....... : LTS : 0
> (XEN) .... register #01: 00170011
> (XEN) ....... : max redirection entries: 0017
> (XEN) ....... : PRQ implemented: 0
> (XEN) ....... : IO APIC version: 0011
> (XEN) .... register #02: 03000000
> (XEN) ....... : arbitration: 03
> (XEN) .... IRQ redirection table:
> (XEN) NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:
> (XEN) 00 000 00 1 0 0 0 0 0 0 00
> (XEN) 01 001 01 0 0 0 0 0 1 1 28
> (XEN) 02 001 01 0 0 0 0 0 1 1 F0
> (XEN) 03 001 01 0 0 0 0 0 1 1 30
> (XEN) 04 001 01 0 0 0 0 0 1 1 F1
> (XEN) 05 001 01 0 0 0 0 0 1 1 38
> (XEN) 06 001 01 0 0 0 0 0 1 1 40
> (XEN) 07 001 01 0 0 0 0 0 1 1 48
> (XEN) 08 001 01 0 0 0 0 0 1 1 50
> (XEN) 09 001 01 0 0 0 0 0 1 1 58
> (XEN) 0a 001 01 0 0 0 0 0 1 1 60
> (XEN) 0b 001 01 0 0 0 0 0 1 1 68
> (XEN) 0c 001 01 0 0 0 0 0 1 1 70
> (XEN) 0d 001 01 0 0 0 0 0 1 1 78
> (XEN) 0e 001 01 0 0 0 0 0 1 1 88
> (XEN) 0f 001 01 0 0 0 0 0 1 1 90
> (XEN) 10 000 00 1 0 0 0 0 0 0 00
> (XEN) 11 000 00 1 0 0 0 0 0 0 00
> (XEN) 12 000 00 1 0 0 0 0 0 0 00
> (XEN) 13 000 00 1 0 0 0 0 0 0 00
> (XEN) 14 000 00 1 0 0 0 0 0 0 00
> (XEN) 15 000 00 1 0 0 0 0 0 0 00
> (XEN) 16 000 00 1 0 0 0 0 0 0 00
> (XEN) 17 000 00 1 0 0 0 0 0 0 00
> (XEN) Using vector-based indexing
> (XEN) IRQ to pin mappings:
> (XEN) IRQ240 -> 0:2
> (XEN) IRQ40 -> 0:1
> (XEN) IRQ48 -> 0:3
> (XEN) IRQ241 -> 0:4
> (XEN) IRQ56 -> 0:5
> (XEN) IRQ64 -> 0:6
> (XEN) IRQ72 -> 0:7
> (XEN) IRQ80 -> 0:8
> (XEN) IRQ88 -> 0:9
> (XEN) IRQ96 -> 0:10
> (XEN) IRQ104 -> 0:11
> (XEN) IRQ112 -> 0:12
> (XEN) IRQ120 -> 0:13
> (XEN) IRQ136 -> 0:14
> (XEN) IRQ144 -> 0:15
> (XEN) .................................... done.
> (XEN) Using local APIC timer interrupts.
> (XEN) calibrating APIC timer ...
> (XEN) ..... CPU clock speed is 2592.9460 MHz.
> (XEN) ..... host bus clock speed is 92.5859 MHz.
> (XEN) ..... bus_scale = 0x5ed0
> (XEN) Platform timer is 3.579MHz ACPI PM Timer
> (XEN) Allocated console ring of 64 KiB.
> (XEN) mwait-idle: MWAIT substates: 0x10
> (XEN) mwait-idle: v0.4 model 0x46
> (XEN) mwait-idle: lapic_timer_reliable_states 0xffffffff
> (XEN) VMX: Supported advanced features:
> (XEN) - APIC TPR shadow
> (XEN) - Extended Page Tables (EPT)
> (XEN) - Virtual-Processor Identifiers (VPID)
> (XEN) - Virtual NMI
> (XEN) - MSR direct-access bitmap
> (XEN) - Unrestricted Guest
> (XEN) HVM: ASIDs enabled.
> (XEN) HVM: VMX enabled
> (XEN) HVM: Hardware Assisted Paging (HAP) not detected
> (XEN) HVM: PVH mode not supported on this platform
> (XEN) CPU 0 APIC 0 -> Node 0
> (XEN) CPU 1 APIC 1 -> Node 0
> (XEN) Booting processor 1/1 eip 8f000
> (XEN) Initializing CPU#1
> (XEN) masked ExtINT on CPU#1
> (XEN) smp_store_cpu_info id=1
> (XEN) CPU: Physical Processor ID: 0
> (XEN) CPU: Processor Core ID: 1
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU1: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=1 socket=0
> socket_cpumask[socket]=ffff8301bd84d460
> (XEN) CPU1: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 2 APIC 2 -> Node 0
> (XEN) Booting processor 2/2 eip 8f000
> (XEN) Initializing CPU#2
> (XEN) masked ExtINT on CPU#2
> (XEN) smp_store_cpu_info id=2
> (XEN) CPU: Physical Processor ID: 0
> (XEN) CPU: Processor Core ID: 2
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU2: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=2 socket=0
> socket_cpumask[socket]=ffff8301bd84d460
> (XEN) CPU2: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 3 APIC 4 -> Node 0
> (XEN) Booting processor 3/4 eip 8f000
> (XEN) Initializing CPU#3
> (XEN) masked ExtINT on CPU#3
> (XEN) smp_store_cpu_info id=3
> (XEN) CPU: Physical Processor ID: 1
> (XEN) CPU: Processor Core ID: 0
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU3: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=3 socket=1
> socket_cpumask[socket]=0000000000000000
> (XEN) CPU3: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 4 APIC 5 -> Node 0
> (XEN) Booting processor 4/5 eip 8f000
> (XEN) Initializing CPU#4
> (XEN) masked ExtINT on CPU#4
> (XEN) smp_store_cpu_info id=4
> (XEN) CPU: Physical Processor ID: 1
> (XEN) CPU: Processor Core ID: 1
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU4: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=4 socket=1
> socket_cpumask[socket]=ffff8301bd84df90
> (XEN) CPU4: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) CPU 5 APIC 6 -> Node 0
> (XEN) Booting processor 5/6 eip 8f000
> (XEN) Initializing CPU#5
> (XEN) masked ExtINT on CPU#5
> (XEN) smp_store_cpu_info id=5
> (XEN) CPU: Physical Processor ID: 1
> (XEN) CPU: Processor Core ID: 2
> (XEN) CPU: L1 I cache: 32K, L1 D cache: 32K
> (XEN) CPU: L2 cache: 256K
> (XEN) CPU: L3 cache: 6144K
> (XEN) CPU5: No MCE banks present. Machine check support disabled
> (XEN) smp_store_cpu_info id=5 socket=1
> socket_cpumask[socket]=ffff8301bd84df90
> (XEN) CPU5: Intel(R) Core(TM) i7-4960HQ CPU @ 2.60GHz stepping 01
> (XEN) Brought up 6 CPUs
> (XEN) ACPI sleep modes: S3
> (XEN) VPMU: disabled
> (XEN) Dom0 has maximum 600 PIRQs
> (XEN) NX (Execute Disable) protection active
> (XEN) *** LOADING DOMAIN 0 ***
> (XEN) elf_parse_binary: phdr: paddr=0x1000000 memsz=0x68f6d8
> (XEN) elf_parse_binary: phdr: paddr=0x1690000 memsz=0x409000
> (XEN) elf_parse_binary: phdr: paddr=0x1a99000 memsz=0x32c120
> (XEN) elf_parse_binary: phdr: paddr=0x1dc6000 memsz=0x1000
> (XEN) elf_parse_binary: phdr: paddr=0x1dc7000 memsz=0x1d13c0
> (XEN) elf_parse_binary: phdr: paddr=0x1f99000 memsz=0x53000
> (XEN) elf_parse_binary: phdr: paddr=0x1fec000 memsz=0x1250
> (XEN) elf_parse_binary: phdr: paddr=0x1fee000 memsz=0x1012000
> (XEN) elf_parse_binary: memory: 0x1000000 -> 0x3000000
> (XEN) elf_xen_parse_note: GUEST_OS = "linux"
> (XEN) elf_xen_parse_note: GUEST_VERSION = "2.6"
> (XEN) elf_xen_parse_note: XEN_VERSION = "xen-3.0"
> (XEN) elf_xen_parse_note: VIRT_BASE = 0xffffffff80000000
> (XEN) elf_xen_parse_note: ENTRY = 0xffffffff81f991f0
> (XEN) elf_xen_parse_note: HYPERCALL_PAGE = 0xffffffff81001000
> (XEN) elf_xen_parse_note: FEATURES =
> "!writable_page_tables|pae_pgdir_above_4gb"
> (XEN) elf_xen_parse_note: SUPPORTED_FEATURES = 0x801
> (XEN) elf_xen_parse_note: PAE_MODE = "yes"
> (XEN) elf_xen_parse_note: LOADER = "generic"
> (XEN) elf_xen_parse_note: unknown xen elf note (0xd)
> (XEN) elf_xen_parse_note: SUSPEND_CANCEL = 0x1
> (XEN) elf_xen_parse_note: HV_START_LOW = 0xffff800000000000
> (XEN) elf_xen_parse_note: PADDR_OFFSET = 0x0
> (XEN) elf_xen_addr_calc_check: addresses:
> (XEN) virt_base = 0xffffffff80000000
> (XEN) elf_paddr_offset = 0x0
> (XEN) virt_offset = 0xffffffff80000000
> (XEN) virt_kstart = 0xffffffff81000000
> (XEN) virt_kend = 0xffffffff83000000
> (XEN) virt_entry = 0xffffffff81f991f0
> (XEN) p2m_base = 0xffffffffffffffff
> (XEN) Xen kernel: 64-bit, lsb, compat32
> (XEN) Dom0 kernel: 64-bit, PAE, lsb, paddr 0x1000000 -> 0x3000000
> (XEN) PHYSICAL MEMORY ARRANGEMENT:
> (XEN) Dom0 alloc.: 00000001b4000000->00000001b8000000 (504532 pages to
> be allocated)
> (XEN) Init. ramdisk: 00000001bf2d4000->00000001bffff800
> (XEN) VIRTUAL MEMORY ARRANGEMENT:
> (XEN) Loaded kernel: ffffffff81000000->ffffffff83000000
> (XEN) Init. ramdisk: ffffffff83000000->ffffffff83d2b800
> (XEN) Phys-Mach map: ffffffff83d2c000->ffffffff8412c000
> (XEN) Start info: ffffffff8412c000->ffffffff8412c4b4
> (XEN) Page tables: ffffffff8412d000->ffffffff84152000
> (XEN) Boot stack: ffffffff84152000->ffffffff84153000
> (XEN) TOTAL: ffffffff80000000->ffffffff84400000
> (XEN) ENTRY ADDRESS: ffffffff81f991f0
> (XEN) Dom0 has maximum 6 VCPUs
> (XEN) elf_load_binary: phdr 0 at 0xffffffff81000000 -> 0xffffffff8168f6d8
> (XEN) elf_load_binary: phdr 1 at 0xffffffff81690000 -> 0xffffffff81a99000
> (XEN) elf_load_binary: phdr 2 at 0xffffffff81a99000 -> 0xffffffff81dc5120
> (XEN) elf_load_binary: phdr 3 at 0xffffffff81dc6000 -> 0xffffffff81dc7000
> (XEN) elf_load_binary: phdr 4 at 0xffffffff81dc7000 -> 0xffffffff81f983c0
> (XEN) elf_load_binary: phdr 5 at 0xffffffff81f99000 -> 0xffffffff81fec000
> (XEN) elf_load_binary: phdr 6 at 0xffffffff81fec000 -> 0xffffffff81fed250
> (XEN) elf_load_binary: phdr 7 at 0xffffffff81fee000 -> 0xffffffff820ce000
> (XEN) Std. Loglevel: All
> (XEN) Guest Loglevel: All
> (XEN) Xen is relinquishing VGA console.
> (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input
> to Xen)
> (XEN) Freed 308kB init memory.
> mapping kernel into physical memory
> about to get started...
>
> So it looks like for power-of-2 CPUs, Fusion is providing a separate
> socket per CPU, numbered 0, 2, 4, ...
>
> For multiple-of-3 CPUs, Fusion is providing a socket for every 3 CPUs,
> numbered 0, 1, ...
>
> --Ed
>
>
> On Fri, Nov 20, 2015 at 2:25 AM, Jan Beulich <JBeulich@suse.com> wrote:
>
>> >>> On 20.11.15 at 02:22, <eswierk@skyportsystems.com> wrote:
>> > (XEN) ----[ Xen-4.6.1-pre x86_64 debug=n Not tainted ]----
>> > (XEN) CPU: 3
>> > (XEN) RIP: e008:[<ffff82d08018302f>] set_cpu_sibling_map+0x3f/0x330
>> > (XEN) RFLAGS: 0000000000010006 CONTEXT: hypervisor
>> > (XEN) rax: 0000000000000001 rbx: 0000000000000000 rcx:
>> 000000313d5b4080
>> > (XEN) rdx: 0000000000000006 rsi: 0000000000000000 rdi:
>> 0000000000000003
>> > (XEN) rbp: 0000000000000300 rsp: ffff8301bd87fe90 r8:
>> ffff8301bd878000
>> > (XEN) r9: 000000313d5b4080 r10: 0000000000000001 r11:
>> 0000000000000001
>> > (XEN) r12: ffff82d0802fd500 r13: 0000000000000000 r14:
>> 0000000000000000
>> > (XEN) r15: 0000000000000003 cr0: 000000008005003b cr4:
>> 00000000001526a0
>> > (XEN) cr3: 00000000bfc75000 cr2: 0000000000000001
>> > (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: e008
>> > (XEN) Xen stack trace from rsp=ffff8301bd87fe90:
>> > (XEN) 00000003802fd800 0000000000000018 0000000000000000
>> 0000010000000000
>> > (XEN) ffff82d0802fd800 0000000000000000 00000000000000c8
>> 0000000000000003
>> > (XEN) 0000000000000000 0000000000000000 0000000000000000
>> ffff82d0801834dc
>> > (XEN) 0000000000000000 0000000000000001 0000000000000000
>> 0000000000000000
>> > (XEN) 0000000000000000 0000000000000000 0000000000000000
>> 0000000000000000
>> > (XEN) 0000000000000000 0000000000000000 0000000000000000
>> 0000000000000000
>> > (XEN) 0000000000000000 0000000000000000 0000000000000000
>> 0000000000000000
>> > (XEN) 0000000000000000 0000000000000000 0000000000000000
>> 0000000000000000
>> > (XEN) 0000000000000000 0000000000000000 0000000000000000
>> 0000000000000000
>> > (XEN) 0000000000000000 0000000000000000 0000000000000000
>> 0000000000000000
>> > (XEN) 0000000000000000 0000000000000000 0000000000000003
>> ffff8300bfafc000
>> > (XEN) 000000313d5b4080 0000000000000000
>> > (XEN) Xen call trace:
>> > (XEN) [<ffff82d08018302f>] set_cpu_sibling_map+0x3f/0x330
>> > (XEN) [<ffff82d0801834dc>] start_secondary+0x1bc/0x250
>> > (XEN)
>> > (XEN) Pagetable walk from 0000000000000001:
>> > (XEN) L4[0x000] = 00000001bd8f0063 ffffffffffffffff
>> > (XEN) L3[0x000] = 00000001bd8ef063 ffffffffffffffff
>> > (XEN) L2[0x000] = 00000001bd8ee063 ffffffffffffffff
>> > (XEN) L1[0x000] = 0000000000000000 ffffffffffffffff
>> > (XEN)
>> > (XEN) ****************************************
>> > (XEN) Panic on CPU 3:
>> > (XEN) FATAL PAGE FAULT
>> > (XEN) [error_code=0002]
>> > (XEN) Faulting linear address: 0000000000000001
>> > (XEN) ****************************************
>> > (XEN)
>> > (XEN) Reboot in five seconds...
>> >
>> > set_cpu_sibling_map+0x3f is the second cpumask_set_cpu() call in
>> > set_cpu_sibling_map():
>> >
>> http://xenbits.xen.org/gitweb/?p=xen.git;a=blob;f=xen/arch/x86/smpboot.c;h=0
>> >
>> 94699286f4f6962942024ec8b2b24c7b7996cc0;hb=78833c04250416f1870c458309d3ac0e5c
>> > f915fd#l261
>>
>> I suppose cpu_to_socket(cpu) returns a value for which the
>> socket_cpumask[] entry didn't get set up yet. But to prove that,
>> we'd need to see the disassembly around the code location
>> above, to be able to associate register values with variables.
>>
>> If that's the case, then I'd further guess that the CPUID
>> information provided by Fusion isn't exactly as one would expect
>> on real hardware. Whether we need to fix something, or can
>> work around a quirk of theirs depends on the exact nature of
>> the issue. Instrumenting code populating socket_cpumask[]
>> would be a good first step.
>>
>> Jan
>>
>>
>
[-- Attachment #1.2: Type: text/html, Size: 78723 bytes --]
[-- Attachment #2: Type: text/plain, Size: 126 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
next prev parent reply other threads:[~2015-11-21 1:21 UTC|newest]
Thread overview: 22+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-11-20 1:22 Crash in set_cpu_sibling_map() booting Xen 4.6.0 on Fusion Ed Swierk
2015-11-20 10:25 ` Jan Beulich
2015-11-20 10:37 ` Andrew Cooper
2015-11-20 18:53 ` Ed Swierk
2015-11-21 1:21 ` Ed Swierk [this message]
2015-11-23 1:10 ` Chao Peng
2015-11-23 5:39 ` Chao Peng
2015-11-23 10:18 ` Jan Beulich
2015-11-23 16:36 ` Ed Swierk
2015-11-24 10:34 ` Jan Beulich
2015-11-24 14:13 ` Ed Swierk
2015-11-24 15:20 ` Jan Beulich
2015-11-24 20:28 ` Ed Swierk
2015-11-25 9:11 ` Jan Beulich
2015-12-02 13:48 ` Jan Beulich
2015-12-02 15:39 ` Ed Swierk
2015-11-25 7:48 ` Chao Peng
2015-11-25 9:04 ` Jan Beulich
2015-11-25 23:27 ` Ed Swierk
2015-11-26 7:49 ` Jan Beulich
2015-11-27 2:11 ` Chao Peng
2015-12-02 2:55 ` Nakajima, Jun
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAO_EM_nRsqWRxiGHP6UMrFM-4jZad5MwqcpKaExjUVyTM8MwgQ@mail.gmail.com \
--to=eswierk@skyportsystems.com \
--cc=JBeulich@suse.com \
--cc=andrew.cooper3@citrix.com \
--cc=chao.p.peng@linux.intel.com \
--cc=xen-devel@lists.xen.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).