From: Zachary Amsden <zamsden@redhat.com>
To: Michael Tokarev <mjt@tls.msk.ru>
Cc: Marcelo Tosatti <mtosatti@redhat.com>,
Arjan Koers <0h61vkll2ly8@xutrox.com>,
kvm@vger.kernel.org, Avi Kivity <avi@redhat.com>,
Glauber Costa <glommer@redhat.com>,
Andre Przywara <andre.przywara@amd.com>,
jeremy@xensource.com
Subject: Re: 2.6.35-rc1 regression with pvclock and smp guests
Date: Sat, 02 Oct 2010 11:55:04 -1000 [thread overview]
Message-ID: <4CA7AA38.1080005@redhat.com> (raw)
In-Reply-To: <4CA6E0BF.90605@msgid.tls.msk.ru>
On 10/01/2010 09:35 PM, Michael Tokarev wrote:
> 02.10.2010 09:35, Zachary Amsden wrote:
> []
>
>> Can you try this patch to see if it helps? I believe it is also safe
>> for Xen, but cc'ing to double check.
>>
> It makes no visible difference.
>
> For some reason one of my test guests - 2.6.35.6 32bit kernel -
> stopped booting completely, always handing at boot somewhere
> unless I disable printk.time. Here's the typical boot messages,
> up to the hang:
>
> [ 0.000000] Initializing cgroup subsys cpuset
> [ 0.000000] Initializing cgroup subsys cpu
> [ 0.000000] Linux version 2.6.35-i686 (mjt@gandalf) (gcc version 4.4.5 20100728 (prerelease) (Debian 4.4.4-8) ) #2.6.35.6 SMP Thu Sep 30 12:00:24 MSD 2010
> [ 0.000000] BIOS-provided physical RAM map:
> [ 0.000000] BIOS-e820: 0000000000000000 - 000000000009f400 (usable)
> [ 0.000000] BIOS-e820: 000000000009f400 - 00000000000a0000 (reserved)
> [ 0.000000] BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
> [ 0.000000] BIOS-e820: 0000000000100000 - 000000001fffd000 (usable)
> [ 0.000000] BIOS-e820: 000000001fffd000 - 0000000020000000 (reserved)
> [ 0.000000] BIOS-e820: 00000000feffd000 - 00000000ff001000 (reserved)
> [ 0.000000] BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved)
> [ 0.000000] Notice: NX (Execute Disable) protection cannot be enabled: non-PAE kernel!
> [ 0.000000] DMI 2.4 present.
> [ 0.000000] last_pfn = 0x1fffd max_arch_pfn = 0x100000
> [ 0.000000] x86 PAT enabled: cpu 0, old 0x0, new 0x7010600070106
> [ 0.000000] found SMP MP-table at [c00fdbe0] fdbe0
> [ 0.000000] init_memory_mapping: 0000000000000000-000000001fffd000
> [ 0.000000] RAMDISK: 1fbb5000 - 1fe96000
> [ 0.000000] ACPI: RSDP 000fdb90 00014 (v00 BOCHS )
> [ 0.000000] ACPI: RSDT 1fffde10 00034 (v01 BOCHS BXPCRSDT 00000001 BXPC 00000001)
> [ 0.000000] ACPI: FACP 1ffffe40 00074 (v01 BOCHS BXPCFACP 00000001 BXPC 00000001)
> [ 0.000000] ACPI: DSDT 1fffdfd0 01E22 (v01 BXPC BXDSDT 00000001 INTL 20090123)
> [ 0.000000] ACPI: FACS 1ffffe00 00040
> [ 0.000000] ACPI: SSDT 1fffdf80 00044 (v01 BOCHS BXPCSSDT 00000001 BXPC 00000001)
> [ 0.000000] ACPI: APIC 1fffde90 0007A (v01 BOCHS BXPCAPIC 00000001 BXPC 00000001)
> [ 0.000000] ACPI: HPET 1fffde50 00038 (v01 BOCHS BXPCHPET 00000001 BXPC 00000001)
> [ 0.000000] 0MB HIGHMEM available.
> [ 0.000000] 511MB LOWMEM available.
> [ 0.000000] mapped low ram: 0 - 1fffd000
> [ 0.000000] low ram: 0 - 1fffd000
> [ 0.000000] kvm-clock: Using msrs 12 and 11
> [ 0.000000] kvm-clock: cpu 0, msr 0:13c60c1, boot clock
> [ 0.000000] Zone PFN ranges:
> [ 0.000000] DMA 0x00000001 -> 0x00001000
> [ 0.000000] Normal 0x00001000 -> 0x0001fffd
> [ 0.000000] HighMem empty
> [ 0.000000] Movable zone start PFN for each node
> [ 0.000000] early_node_map[2] active PFN ranges
> [ 0.000000] 0: 0x00000001 -> 0x0000009f
> [ 0.000000] 0: 0x00000100 -> 0x0001fffd
> [ 0.000000] Using APIC driver default
> [ 0.000000] ACPI: PM-Timer IO Port: 0xb008
> [ 0.000000] ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
> [ 0.000000] ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
> [ 0.000000] ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
> [ 0.000000] IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, GSI 0-23
> [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
> [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 5 global_irq 5 high level)
> [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
> [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 10 global_irq 10 high level)
> [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 11 global_irq 11 high level)
> [ 0.000000] Using ACPI (MADT) for SMP configuration information
> [ 0.000000] ACPI: HPET id: 0x8086a201 base: 0xfed00000
> [ 0.000000] SMP: Allowing 2 CPUs, 0 hotplug CPUs
> [ 0.000000] PM: Registered nosave memory: 000000000009f000 - 00000000000a0000
> [ 0.000000] PM: Registered nosave memory: 00000000000a0000 - 00000000000f0000
> [ 0.000000] PM: Registered nosave memory: 00000000000f0000 - 0000000000100000
> [ 0.000000] Allocating PCI resources starting at 20000000 (gap: 20000000:deffd000)
> [ 0.000000] Booting paravirtualized kernel on KVM
> [ 0.000000] setup_percpu: NR_CPUS:8 nr_cpumask_bits:8 nr_cpu_ids:2 nr_node_ids:1
> [ 0.000000] PERCPU: Embedded 16 pages/cpu @c1c00000 s43072 r0 d22464 u2097152
> [ 0.000000] pcpu-alloc: s43072 r0 d22464 u2097152 alloc=1*4194304
> [ 0.000000] pcpu-alloc: [0] 0 1
> [ 0.000000] kvm-clock: cpu 0, msr 0:1c0a0c1, primary cpu clock
> [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 129947
> [ 0.000000] Kernel command line: acpi_enforce_resources=lax rootfs=nfs root=/usr/rb rootflags=ro,nolock bootrc=/remote/bootrc initrd=lnx/initrd-2.6.35-i686 ip=192.168.88.60:192.168.88.4:192.168.88.4:255.255.255.0 BOOTIF=01-52-54-00-12-34-56 console=tty1 console=ttyS0 BOOT_IMAGE=lnx/vmlinuz-2.6.35-i686
> [ 0.000000] PID hash table entries: 2048 (order: 1, 8192 bytes)
> [ 0.000000] Dentry cache hash table entries: 65536 (order: 6, 262144 bytes)
> [ 0.000000] Inode-cache hash table entries: 32768 (order: 5, 131072 bytes)
> [ 0.000000] Enabling fast FPU save and restore... done.
> [ 0.000000] Enabling unmasked SIMD FPU exception support... done.
> [ 0.000000] Initializing CPU#0
> [ 0.000000] Subtract (42 early reservations)
> [ 0.000000] #1 [0000001000 - 0000002000] EX TRAMPOLINE
> [ 0.000000] #2 [0001000000 - 000144a9e4] TEXT DATA BSS
> [ 0.000000] #3 [001fbb5000 - 001fe96000] RAMDISK
> [ 0.000000] #4 [000144b000 - 0001451049] BRK
> [ 0.000000] #5 [000009f400 - 00000fdbe0] BIOS reserved
> [ 0.000000] #6 [00000fdbe0 - 00000fdbf0] MP-table mpf
> [ 0.000000] #7 [00000fdce4 - 0000100000] BIOS reserved
> [ 0.000000] #8 [00000fdbf0 - 00000fdce4] MP-table mpc
> [ 0.000000] #9 [0000002000 - 0000003000] TRAMPOLINE
> [ 0.000000] #10 [0000003000 - 0000007000] ACPI WAKEUP
> [ 0.000000] #11 [0000007000 - 0000008000] PGTABLE
> [ 0.000000] #12 [0001452000 - 0001453000] BOOTMEM
> [ 0.000000] #13 [0001453000 - 0001853000] BOOTMEM
> [ 0.000000] #14 [000144aa00 - 000144aa04] BOOTMEM
> [ 0.000000] #15 [000144aa40 - 000144ab00] BOOTMEM
> [ 0.000000] #16 [000144ab00 - 000144ab30] BOOTMEM
> [ 0.000000] #17 [0001853000 - 0001854800] BOOTMEM
> [ 0.000000] #18 [000144ab40 - 000144ab65] BOOTMEM
> [ 0.000000] #19 [000144ab80 - 000144aba7] BOOTMEM
> [ 0.000000] #20 [000144abc0 - 000144aca0] BOOTMEM
> [ 0.000000] #21 [000144acc0 - 000144ad00] BOOTMEM
> [ 0.000000] #22 [000144ad00 - 000144ad40] BOOTMEM
> [ 0.000000] #23 [000144ad40 - 000144ad80] BOOTMEM
> [ 0.000000] #24 [000144ad80 - 000144adc0] BOOTMEM
> [ 0.000000] #25 [000144adc0 - 000144ae00] BOOTMEM
> [ 0.000000] #26 [000144ae00 - 000144ae40] BOOTMEM
> [ 0.000000] #27 [000144ae40 - 000144ae80] BOOTMEM
> [ 0.000000] #28 [000144ae80 - 000144ae90] BOOTMEM
> [ 0.000000] #29 [000144aec0 - 000144afcf] BOOTMEM
> [ 0.000000] #30 [0001451080 - 000145118f] BOOTMEM
> [ 0.000000] #31 [0001c00000 - 0001c10000] BOOTMEM
> [ 0.000000] #32 [0001e00000 - 0001e10000] BOOTMEM
> [ 0.000000] #33 [00014511c0 - 00014511c4] BOOTMEM
> [ 0.000000] #34 [0001451200 - 0001451204] BOOTMEM
> [ 0.000000] #35 [0001451240 - 0001451248] BOOTMEM
> [ 0.000000] #36 [0001451280 - 0001451288] BOOTMEM
> [ 0.000000] #37 [00014512c0 - 0001451368] BOOTMEM
> [ 0.000000] #38 [0001451380 - 00014513e8] BOOTMEM
> [ 0.000000] #39 [0001854800 - 0001856800] BOOTMEM
> [ 0.000000] #40 [0001856800 - 0001896800] BOOTMEM
> [ 0.000000] #41 [0001896800 - 00018b6800] BOOTMEM
> [ 0.000000] Initializing HighMem for node 0 (00000000:00000000)
> [ 0.000000] Memory: 511856k/524276k available (2554k kernel code, 12028k reserved, 930k data, 380k init, 0k highmem)
> [ 0.000000] virtual kernel memory layout:
> [ 0.000000] fixmap : 0xfff16000 - 0xfffff000 ( 932 kB)
> [ 0.000000] pkmap : 0xff800000 - 0xffc00000 (4096 kB)
> [ 0.000000] vmalloc : 0xe07fd000 - 0xff7fe000 ( 496 MB)
> [ 0.000000] lowmem : 0xc0000000 - 0xdfffd000 ( 511 MB)
> [ 0.000000] .init : 0xc1368000 - 0xc13c7000 ( 380 kB)
> [ 0.000000] .data : 0xc127ebb7 - 0xc1367488 ( 930 kB)
> [ 0.000000] .text : 0xc1000000 - 0xc127ebb7 (2554 kB)
> [ 0.000000] Checking if this processor honours the WP bit even in supervisor mode...Ok.
> [ 0.000000] Hierarchical RCU implementation.
> [ 0.000000] RCU-based detection of stalled CPUs is disabled.
> [ 0.000000] Verbose stalled-CPUs detection is disabled.
> [ 0.000000] NR_IRQS:512
> [ 0.000000] Console: colour VGA+ 80x25
> [ 0.000000] console [tty1] enabled
> [ 0.000000] console [ttyS0] enabled
> [ 0.000000] Detected 3217.252 MHz processor.
> [ 0.023332] Calibrating delay loop (skipped) preset value.. 6437.60 BogoMIPS (lpj=10724173)
> [ 0.023332] pid_max: default: 32768 minimum: 301
> [ 0.023332] Mount-cache hash table entries: 512
> [ 0.023447] Initializing cgroup subsys ns
> [ 0.024131] Initializing cgroup subsys cpuacct
> [ 0.024851] Initializing cgroup subsys devices
> [ 0.025580] Initializing cgroup subsys freezer
> [ 0.026669] Initializing cgroup subsys net_cls
> [ 0.027425] Initializing cgroup subsys blkio
> [ 0.030079] mce: CPU supports 10 MCE banks
> [ 0.030847] using C1E aware idle routine
> [ 0.031517] Performance Events: AMD PMU driver.
> [ 0.032313] ... version: 0
> [ 0.033335] ... bit width: 48
> [ 0.034036] ... generic registers: 4
> [ 0.034716] ... value mask: 0000ffffffffffff
> [ 0.035542] ... max period: 00007fffffffffff
> [ 0.036669] ... fixed-purpose events: 0
> [ 0.037521] ... event mask: 000000000000000f
> [ 0.041961] ACPI: Core revision 20100428
> [ 0.044150] Enabling APIC mode: Flat. Using 1 I/O APICs
> [ 0.045964] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
> [ 0.046671] CPU0: AMD Athlon(tm) II X2 260 Processor stepping 03
> [ 0.049999] APIC calibration not consistent with PM-Timer: 102ms instead of 100ms
> [ 0.049999] APIC delta adjusted to PM-Timer: 6248670 (6435422)
> [ 0.050298] Booting Node 0, Processors #1 Ok.
> [ 0.023332] Initializing CPU#1
>
Before this, time is very granular...
> [ 0.063333] kvm-clock: cpu 1, msr 0:1e0a0c1, secondary cpu clock
> [ 0.063333] Brought up 2 CPUs
> [ 0.063333] Total of 2 processors activated (12874.21 BogoMIPS).
> [ 0.076666] x86 PAT enabled: cpu 1, old 0x0, new 0x7010600070106
> [ 0.116666] devtmpfs: initialized
> [ 0.116666] NET: Registered protocol family 16
> [ 0.119999] ACPI: bus type pci registered
>
Now it is multiples of 1/300 ....
> [ 0.123333] PCI: PCI BIOS revision 2.10 entry at 0xffe77, last bus=0
> [ 0.123333] PCI: Using configuration type 1 for base access
> [ 0.123333] PCI: Using configuration type 1 for extended access
> [ 0.126666] mtrr: your CPUs had inconsistent variable MTRR settings
> [ 0.126666] mtrr: your CPUs had inconsistent MTRRdefType settings
> [ 0.126666] mtrr: probably your BIOS does not setup all CPUs.
> [ 0.126666] mtrr: corrected configuration.
> [ 0.136666] bio: create slab<bio-0> at 0
> [ 0.153333] ACPI: Interpreter enabled
> [ 0.153333] ACPI: (supports S0 S3 S4 S5)
> [ 0.153333] ACPI: Using IOAPIC for interrupt routing
> [ 0.203333] ACPI: No dock devices found.
> [ 0.203333] PCI: Ignoring host bridge windows from ACPI; if necessary, use "pci=use_crs" and report a bug
> [ 0.206666] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
> [ 0.209999] pci 0000:00:01.3: quirk: [io 0xb000-0xb03f] claimed by PIIX4 ACPI
> [ 0.209999] pci 0000:00:01.3: quirk: [io 0xb100-0xb10f] claimed by PIIX4 SMB
> [ 0.216666] ACPI: PCI Interrupt Link [LNKA] (IRQs 5 *10 11)
> [ 0.219999] ACPI: PCI Interrupt Link [LNKB] (IRQs 5 *10 11)
> [ 0.219999] ACPI: PCI Interrupt Link [LNKC] (IRQs 5 10 *11)
> [ 0.223333] ACPI: PCI Interrupt Link [LNKD] (IRQs 5 10 *11)
> [ 0.223333] HEST: Table is not found!
> [ 0.226666] vgaarb: device added: PCI:0000:00:02.0,decodes=io+mem,owns=io+mem,locks=none
> [ 0.229999] vgaarb: loaded
> [ 0.229999] PCI: Using ACPI for IRQ routing
> [ 0.233333] HPET: 3 timers in total, 0 timers will be used for per-cpu timer
> [ 0.239999] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
> [ 0.239999] hpet0: 3 comparators, 64-bit 100.000000 MHz counter
> [ 0.249999] Switching to clocksource kvm-clock
> [ 0.259999] pnp: PnP ACPI init
>
Then, of course, it fails.
What is your host clocksource? Does your machine have unstable TSC?
Here, I have unstable tsc:
[zamsden@mysore linux-2.6]$ cat
/sys/devices/system/clocksource/clocksource0/*
hpet acpi_pm
hpet
Can you do this in the guest too? That will make it very clear what
clocksources the guest finds during bootup.
next prev parent reply other threads:[~2010-10-02 21:55 UTC|newest]
Thread overview: 81+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-07-22 12:53 2.6.35-rc1 regression with pvclock and smp guests Andre Przywara
2010-07-25 8:44 ` Avi Kivity
2010-07-26 8:47 ` Andre Przywara
2010-07-26 18:59 ` Arjan Koers
2010-07-27 21:00 ` Arjan Koers
2010-07-28 10:37 ` Avi Kivity
2010-07-31 0:34 ` Arjan Koers
2010-07-31 1:38 ` Zachary Amsden
2010-07-31 11:50 ` Arjan Koers
2010-07-31 2:39 ` Zachary Amsden
2010-07-31 11:53 ` Arjan Koers
2010-07-31 16:36 ` Arjan Koers
2010-07-31 19:45 ` Arjan Koers
2010-07-31 23:55 ` Zachary Amsden
2010-08-02 14:43 ` Glauber Costa
2010-08-02 16:16 ` Arjan Koers
2010-08-02 18:07 ` Glauber Costa
2010-08-02 20:26 ` Zachary Amsden
2010-08-02 21:10 ` Glauber Costa
2010-08-02 21:35 ` Arjan Koers
2010-08-03 0:00 ` Zachary Amsden
2010-09-28 11:16 ` Michael Tokarev
2010-09-29 8:12 ` Michael Tokarev
2010-09-29 8:28 ` Avi Kivity
2010-09-29 9:17 ` Michael Tokarev
2010-09-29 9:19 ` Michael Tokarev
2010-09-29 19:26 ` Arjan Koers
2010-09-30 7:55 ` Michael Tokarev
2010-09-30 9:59 ` Michael Tokarev
2010-09-30 13:54 ` Zachary Amsden
2010-09-30 15:12 ` Michael Tokarev
2010-09-30 15:32 ` Zachary Amsden
2010-09-30 18:49 ` Arjan Koers
2010-09-30 19:05 ` Marcelo Tosatti
2010-09-30 20:16 ` Arjan Koers
2010-09-30 23:02 ` Michael Tokarev
2010-09-30 23:07 ` Michael Tokarev
2010-10-01 1:13 ` Zachary Amsden
2010-10-02 5:35 ` Zachary Amsden
2010-10-02 7:35 ` Michael Tokarev
2010-10-02 7:40 ` Michael Tokarev
2010-10-02 7:50 ` Michael Tokarev
2010-10-02 16:10 ` Arjan Koers
2010-10-02 20:26 ` Michael Tokarev
2010-10-02 23:42 ` Zachary Amsden
2010-10-03 8:27 ` Michael Tokarev
2010-10-08 0:12 ` Arjan Koers
2010-10-08 2:47 ` Zachary Amsden
2010-10-08 22:06 ` Marcelo Tosatti
2010-10-09 1:10 ` Arjan Koers
2010-10-09 2:27 ` Zachary Amsden
2010-10-09 6:29 ` Michael Tokarev
2010-10-09 8:59 ` Arjan Koers
2010-10-11 20:47 ` Zachary Amsden
2010-10-13 12:18 ` Glauber Costa
2010-10-10 1:20 ` Arjan Koers
2010-10-11 17:53 ` Anthony Liguori
2010-10-11 18:36 ` Marcelo Tosatti
2010-10-09 2:29 ` Zachary Amsden
2010-10-10 1:26 ` Arjan Koers
2010-10-20 20:47 ` Arjan Koers
2010-10-09 7:59 ` Michael Tokarev
2010-10-09 8:31 ` Michael Tokarev
2010-10-02 21:55 ` Zachary Amsden [this message]
2010-10-03 8:16 ` Michael Tokarev
2010-10-03 8:22 ` Avi Kivity
2010-10-03 8:30 ` Michael Tokarev
2010-07-27 10:03 ` Avi Kivity
2010-07-27 11:49 ` Andre Przywara
2010-07-27 12:06 ` Avi Kivity
2010-07-27 12:21 ` Andre Przywara
2010-07-27 12:34 ` Avi Kivity
2010-07-27 13:48 ` Andre Przywara
2010-07-27 13:58 ` Avi Kivity
2010-07-27 14:55 ` Andre Przywara
2010-07-27 21:51 ` Andre Przywara
2010-07-28 3:00 ` Zachary Amsden
2010-07-28 7:55 ` Andre Przywara
2010-07-28 12:25 ` Andre Przywara
2010-07-30 22:54 ` Zachary Amsden
2010-08-02 10:12 ` Andre Przywara
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4CA7AA38.1080005@redhat.com \
--to=zamsden@redhat.com \
--cc=0h61vkll2ly8@xutrox.com \
--cc=andre.przywara@amd.com \
--cc=avi@redhat.com \
--cc=glommer@redhat.com \
--cc=jeremy@xensource.com \
--cc=kvm@vger.kernel.org \
--cc=mjt@tls.msk.ru \
--cc=mtosatti@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.