Early boot oops with 2.5.67-bk(current) on a dual Athlon-MP [Asus A7M266-D] machine

Early boot oops with 2.5.67-bk(current) on a dual Athlon-MP [Asus A7M266-D] machine

[Nicholas Wourms]

[-- Attachment #1: Type: text/plain, Size: 846 bytes --]

Hi,

Attached is the oops (which results in a panic) when I 
attempt to boot the lastest bk current on my machine.  The 
only things I've added to the sources were:
1)Petr's latest matroxfb patch (fb won't work without it)
2)Rusty's kmsgdump (for obvious reasons)
3)A few cosmetic changes to resolve some module symbols and 
to get the kernel to compile with gcc-3.3.

As noted, I'm using a recent gcc-3.3 snapshot with the 
latest build of binutils head.  I've tried the -ac and -mm 
trees as well, with no success.  Each time it gets stuck 
around the same place (when the kernel is starting the 
migration threads).  I've tried booting with acpi=off and 
noapic, but the same things happens.  I attached my config 
file in which I intentionally enabled "the kitchen sink" in 
order to help catch compiler errors.  Any ideas?

Cheers,
Nicholas

[-- Attachment #2: dmesg.txt --]
[-- Type: text/plain, Size: 8659 bytes --]

<4>Linux version 2.5.67 (root@metamorph) (gcc version 3.3 20030403 (prerelease)) #2 SMP Sun Apr 13 14:46:51 EDT 2003
<4>Video mode to be used for restore is f00
<6>BIOS-provided physical RAM map:
<4> BIOS-e820: 0000000000000000 - 000000000009fc00 (usable)
<4> BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved)
<4> BIOS-e820: 00000000000f0000 - 0000000000100000 (reserved)
<4> BIOS-e820: 0000000000100000 - 000000003ffec000 (usable)
<4> BIOS-e820: 000000003ffec000 - 000000003ffef000 (ACPI data)
<4> BIOS-e820: 000000003ffef000 - 000000003ffff000 (reserved)
<4> BIOS-e820: 000000003ffff000 - 0000000040000000 (ACPI NVS)
<4> BIOS-e820: 00000000fec00000 - 00000000fec01000 (reserved)
<4> BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
<4> BIOS-e820: 00000000ffff0000 - 0000000100000000 (reserved)
<5>127MB HIGHMEM available.
<5>896MB LOWMEM available.
<6>found SMP MP-table at 000f7e90
<4>hm, page 000f7000 reserved twice.
<4>hm, page 000f8000 reserved twice.
<4>hm, page 000f7000 reserved twice.
<4>hm, page 000f8000 reserved twice.
<4>On node 0 totalpages: 262124
<4>  DMA zone: 4096 pages, LIFO batch:1
<4>  Normal zone: 225280 pages, LIFO batch:16
<4>  HighMem zone: 32748 pages, LIFO batch:7
<6>ACPI: RSDP (v000 ASUS                       ) @ 0x000f85e0
<6>ACPI: RSDT (v001 ASUS   A7M266-D 12336.12337) @ 0x3ffec000
<6>ACPI: FADT (v001 ASUS   A7M266-D 12336.12337) @ 0x3ffec100
<6>ACPI: BOOT (v001 ASUS   A7M266-D 12336.12337) @ 0x3ffec040
<6>ACPI: MADT (v001 ASUS   A7M266-D 12336.12337) @ 0x3ffec080
<6>ACPI: DSDT (v001   ASUS A7M266-D 00000.04096) @ 0x00000000
<5>ACPI: BIOS passes blacklist
<6>ACPI: Local APIC address 0xfee00000
<6>ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
<4>Processor #0 6:6 APIC version 16
<6>ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
<4>Processor #1 6:6 APIC version 16
<6>ACPI: LAPIC_NMI (acpi_id[0x00] polarity[0x1] trigger[0x1] lint[0x1])
<6>ACPI: LAPIC_NMI (acpi_id[0x01] polarity[0x1] trigger[0x1] lint[0x1])
<6>ACPI: IOAPIC (id[0x02] address[0xfec00000] global_irq_base[0x0])
<6>IOAPIC[0]: Assigned apic_id 2
<4>IOAPIC[0]: apic_id 2, version 17, address 0xfec00000, IRQ 0-23
<6>ACPI: INT_SRC_OVR (bus[0] irq[0x0] global_irq[0x2] polarity[0x0] trigger[0x0])
<6>ACPI: INT_SRC_OVR (bus[0] irq[0x9] global_irq[0x9] polarity[0x3] trigger[0x3])
<4>Enabling APIC mode:  Flat.  Using 1 I/O APICs
<6>Using ACPI (MADT) for SMP configuration information
<4>Building zonelist for node : 0
<4>Kernel command line: root=/dev/hda4
<6>Initializing CPU#0
<4>PID hash table entries: 4096 (order 12: 32768 bytes)
<4>Detected 1680.279 MHz processor.
<4>Console: colour VGA+ 80x25
<4>Calibrating delay loop... 3309.56 BogoMIPS
<6>Memory: 1030920k/1048496k available (3954k kernel code, 16668k reserved, 1675k data, 220k init, 130992k highmem)
<6>Security Scaffold v1.0.0 initialized
<6>Dentry cache hash table entries: 131072 (order: 7, 524288 bytes)
<4>Inode-cache hash table entries: 65536 (order: 6, 262144 bytes)
<4>Mount-cache hash table entries: 512 (order: 0, 4096 bytes)
<6>-> /dev
<6>-> /dev/console
<6>-> /root
<6>CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
<6>CPU: L2 Cache: 256K (64 bytes/line)
<7>CPU:     After generic, caps: 0383fbff c1cbfbff 00000000 00000000
<6>Intel machine check architecture supported.
<6>Intel machine check reporting enabled on CPU#0.
<6>Machine check exception polling timer started.
<6>Enabling fast FPU save and restore... done.
<6>Enabling unmasked SIMD FPU exception support... done.
<6>Checking 'hlt' instruction... OK.
<4>POSIX conformance testing by UNIFIX
<4>CPU0: AMD Athlon(TM) MP 2000+ stepping 02
<4>per-CPU timeslice cutoff: 731.14 usecs.
<4>task migration cache decay timeout: 1 msecs.
<4>enabled ExtINT on CPU#0
<4>ESR value before enabling vector: 00000000
<4>ESR value after enabling vector: 00000000
<4>Booting processor 1/1 eip 3000
<6>Initializing CPU#1
<4>masked ExtINT on CPU#1
<4>ESR value before enabling vector: 00000000
<4>ESR value after enabling vector: 00000000
<4>Calibrating delay loop... 3350.52 BogoMIPS
<6>CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line)
<6>CPU: L2 Cache: 256K (64 bytes/line)
<7>CPU:     After generic, caps: 0383fbff c1cbfbff 00000000 00000000
<6>Intel machine check architecture supported.
<6>Intel machine check reporting enabled on CPU#1.
<4>CPU1: AMD Athlon(TM) MP 2000+ stepping 02
<6>Total of 2 processors activated (6660.09 BogoMIPS).
<4>ENABLING IO-APIC IRQs
<7>init IO_APIC IRQs
<7> IO-APIC (apicid-pin) 2-0, 2-16, 2-17, 2-18, 2-19, 2-20, 2-21, 2-22, 2-23 not connected.
<6>..TIMER: vector=0x31 pin1=2 pin2=0
<7>number of MP IRQ sources: 16.
<7>number of IO-APIC #2 registers: 24.
<6>testing the IO APIC.......................
<4>
<7>IO APIC #2......
<7>.... register #00: 02000000
<7>.......    : physical APIC id: 02
<7>.......    : Delivery Type: 0
<7>.......    : LTS          : 0
<7>.... register #01: 00170011
<7>.......     : max redirection entries: 0017
<7>.......     : PRQ implemented: 0
<7>.......     : IO APIC version: 0011
<7>.... register #02: 00000000
<7>.......     : arbitration: 00
<7>.... IRQ redirection table:
<7> NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:   
<7> 00 000 00  1    0    0   0   0    0    0    00
<7> 01 001 01  0    0    0   0   0    1    1    39
<7> 02 001 01  0    0    0   0   0    1    1    31
<7> 03 001 01  0    0    0   0   0    1    1    41
<7> 04 001 01  0    0    0   0   0    1    1    49
<7> 05 001 01  0    0    0   0   0    1    1    51
<7> 06 001 01  0    0    0   0   0    1    1    59
<7> 07 001 01  0    0    0   0   0    1    1    61
<7> 08 001 01  0    0    0   0   0    1    1    69
<7> 09 001 01  1    1    0   1   0    1    1    71
<7> 0a 001 01  0    0    0   0   0    1    1    79
<7> 0b 001 01  0    0    0   0   0    1    1    81
<7> 0c 001 01  0    0    0   0   0    1    1    89
<7> 0d 001 01  0    0    0   0   0    1    1    91
<7> 0e 001 01  0    0    0   0   0    1    1    99
<7> 0f 001 01  0    0    0   0   0    1    1    A1
<7> 10 000 00  1    0    0   0   0    0    0    00
<7> 11 000 00  1    0    0   0   0    0    0    00
<7> 12 000 00  1    0    0   0   0    0    0    00
<7> 13 000 00  1    0    0   0   0    0    0    00
<7> 14 000 00  1    0    0   0   0    0    0    00
<7> 15 000 00  1    0    0   0   0    0    0    00
<7> 16 000 00  1    0    0   0   0    0    0    00
<7> 17 000 00  1    0    0   0   0    0    0    00
<7>IRQ to pin mappings:
<7>IRQ0 -> 0:2
<7>IRQ1 -> 0:1
<7>IRQ3 -> 0:3
<7>IRQ4 -> 0:4
<7>IRQ5 -> 0:5
<7>IRQ6 -> 0:6
<7>IRQ7 -> 0:7
<7>IRQ8 -> 0:8
<7>IRQ9 -> 0:9
<7>IRQ10 -> 0:10
<7>IRQ11 -> 0:11
<7>IRQ12 -> 0:12
<7>IRQ13 -> 0:13
<7>IRQ14 -> 0:14
<7>IRQ15 -> 0:15
<6>.................................... done.
<4>Using local APIC timer interrupts.
<4>calibrating APIC timer ...
<4>..... CPU clock speed is 1680.0031 MHz.
<4>..... host bus clock speed is 268.0805 MHz.
<4>checking TSC synchronization across 2 CPUs: passed.
<4>Starting migration thread for cpu 0
<4>Bringing up 1
<4>CPU 1 IS NOW UP!
<4>Starting migration thread for cpu 1
<1>Unable to handle kernel paging request at virtual address fffffff8
<4> printing eip:
<4>f7df6400
<1>*pde = 00004067
<4>Oops: 0002 [#1]
<4>CPU:    0
<4>EIP:    0060:[<f7df6400>]    Not tainted
<4>EFLAGS: 00010082
<4>EIP is at 0xf7df6400
<4>eax: f000ff48   ebx: 00000000   ecx: 00000003   edx: f000ff54
<4>esi: 00000000   edi: 00000001   ebp: c0681ebc   esp: c0681e9c
<4>ds: 007b   es: 007b   ss: 0068
<4>Process swapper (pid: 0, threadinfo=c0680000 task=c055e800)
<4>Stack: c012a82a f000ff48 00000003 00000000 00000014 c0680000 00000010 00000292 
<4>       c0681ee0 c012a887 00000010 00000003 00000001 00000000 00000000 c0680000 
<4>       c05607e4 c0681ef8 c01400a7 00000246 c0680000 c1a14640 00000000 c0681f04 
<4>Call Trace:
<4> [<c012a82a>] __wake_up_common+0x3a/0x58
<4> [<c012a887>] __wake_up+0x3f/0x68
<4> [<c01400a7>] queue_work+0x87/0x114
<4> [<c011b7ea>] mce_timerfunc+0xa2/0xa4
<4> [<c0138b3b>] run_timer_softirq+0xff/0x1d4
<4> [<c011b748>] mce_timerfunc+0x0/0xa4
<4> [<c0133cbb>] do_softirq+0xcb/0xd0
<4> [<c0122975>] smp_apic_timer_interrupt+0xd9/0x140
<4> [<c010f02c>] default_idle+0x0/0x3c
<4> [<c011246a>] apic_timer_interrupt+0x1a/0x20
<4> [<c010f02c>] default_idle+0x0/0x3c
<4> [<c010f05b>] default_idle+0x2f/0x3c
<4> [<c010f0f9>] cpu_idle+0x51/0x5c
<4> [<c0105000>] _stext+0x0/0x64
<4> [<c0682bf3>] start_kernel+0x1a3/0x1ec
<4> [<c0682688>] unknown_bootoption+0x0/0xf8
<4>
<4>Code: 00 64 df f7 80 a4 e0 f7 e0 e9 5a c0 00 00 00 00 00 00 00 00 
<4> <0>Kernel panic: Fatal exception in interrupt
<0>In interrupt handler - not syncing
<4> <0>Dumping messages in 0 seconds : last chance for Alt-SysRq...

[-- Attachment #3: ksymoops.txt --]
[-- Type: text/plain, Size: 3242 bytes --]

ksymoops 2.4.8 on i686 2.4.21-pre5-xfs-ac3.  Options used
     -v /usr/src/linux-beta/vmlinux (specified)
     -K (specified)
     -L (specified)
     -o /lib/modules/2.5.67/ (specified)
     -m /usr/src/linux-beta/System.map (specified)
     -S

No modules in ksyms, skipping objects
<6>ACPI: LAPIC_NMI (acpi_id[0x00] polarity[0x1] trigger[0x1] lint[0x1])
<6>ACPI: LAPIC_NMI (acpi_id[0x01] polarity[0x1] trigger[0x1] lint[0x1])
<6>Machine check exception polling timer started.
<4>CPU 1 IS NOW UP!
<1>Unable to handle kernel paging request at virtual address fffffff8
<4>f7df6400
<1>*pde = 00004067
<4>Oops: 0002 [#1]
<4>CPU:    0
<4>EIP:    0060:[<f7df6400>]    Not tainted
Using defaults from ksymoops -t elf32-i386 -a i386
<4>EFLAGS: 00010082
<4>eax: f000ff48   ebx: 00000000   ecx: 00000003   edx: f000ff54
<4>esi: 00000000   edi: 00000001   ebp: c0681ebc   esp: c0681e9c
<4>ds: 007b   es: 007b   ss: 0068
<4>Stack: c012a82a f000ff48 00000003 00000000 00000014 c0680000 00000010 00000292 
<4>       c0681ee0 c012a887 00000010 00000003 00000001 00000000 00000000 c0680000 
<4>       c05607e4 c0681ef8 c01400a7 00000246 c0680000 c1a14640 00000000 c0681f04 
<4>Call Trace:
<4> [<c012a82a>] __wake_up_common+0x3a/0x58
<4> [<c012a887>] __wake_up+0x3f/0x68
<4> [<c01400a7>] queue_work+0x87/0x114
<4> [<c011b7ea>] mce_timerfunc+0xa2/0xa4
<4> [<c0138b3b>] run_timer_softirq+0xff/0x1d4
<4> [<c011b748>] mce_timerfunc+0x0/0xa4
<4> [<c0133cbb>] do_softirq+0xcb/0xd0
<4> [<c0122975>] smp_apic_timer_interrupt+0xd9/0x140
<4> [<c010f02c>] default_idle+0x0/0x3c
<4> [<c011246a>] apic_timer_interrupt+0x1a/0x20
<4> [<c010f02c>] default_idle+0x0/0x3c
<4> [<c010f05b>] default_idle+0x2f/0x3c
<4> [<c010f0f9>] cpu_idle+0x51/0x5c
<4> [<c0105000>] _stext+0x0/0x64
<4> [<c0682bf3>] start_kernel+0x1a3/0x1ec
<4> [<c0682688>] unknown_bootoption+0x0/0xf8
<4>Code: 00 64 df f7 80 a4 e0 f7 e0 e9 5a c0 00 00 00 00 00 00 00 00 


>>EIP; f7df6400 <__crc_pnp_device_attach+147b67/2771ce>   <=====

>>eax; f000ff48 <__crc_taskfile_input_data+109a15/4fd437>
>>edx; f000ff54 <__crc_taskfile_input_data+109a21/4fd437>
>>ebp; c0681ebc <init_thread_union+1ebc/2000>
>>esp; c0681e9c <init_thread_union+1e9c/2000>

Trace; c012a82a <__wake_up_common+3a/58>
Trace; c012a887 <__wake_up+3f/68>
Trace; c01400a7 <queue_work+87/114>
Trace; c011b7ea <mce_timerfunc+a2/a4>
Trace; c0138b3b <run_timer_softirq+ff/1d4>
Trace; c011b748 <mce_timerfunc+0/a4>
Trace; c0133cbb <do_softirq+cb/d0>
Trace; c0122975 <smp_apic_timer_interrupt+d9/140>
Trace; c010f02c <default_idle+0/3c>
Trace; c011246a <apic_timer_interrupt+1a/20>
Trace; c010f02c <default_idle+0/3c>
Trace; c010f05b <default_idle+2f/3c>
Trace; c010f0f9 <cpu_idle+51/5c>
Trace; c0105000 <_stext+0/0>
Trace; c0682bf3 <start_kernel+1a3/1ec>
Trace; c0682688 <unknown_bootoption+0/f8>

Code;  f7df6400 <__crc_pnp_device_attach+147b67/2771ce> 00000000 <_EIP>:
Code;  f7df6400 <__crc_pnp_device_attach+147b67/2771ce>    0:   00 64 df f7               add    %ah,0xfffffff7(%edi,%ebx,8)   <=====
Code;  f7df6404 <__crc_pnp_device_attach+147b6b/2771ce>    4:   80 a4 e0 f7 e0 e9 5a      andb   $0xc0,0x5ae9e0f7(%eax,8)
Code;  f7df640b <__crc_pnp_device_attach+147b72/2771ce>    b:   c0 

<4> <0>Kernel panic: Fatal exception in interrupt

[-- Attachment #4: .config.bz2 --]
[-- Type: application/octet-stream, Size: 9834 bytes --]

Re: Early boot oops with 2.5.67-bk(current) on a dual Athlon-MP [Asus A7M266-D] machine

[Andrew Morton]

Nicholas Wourms <nwourms@myrealbox.com> wrote:
>
> Hi,
> 
> Attached is the oops (which results in a panic) when I 
> attempt to boot the lastest bk current on my machine.

The MCE code is using the workqueue infrastructure waaaaaaay earlier than it
is allowed to.  It looks like the timer went off before the workqueue
initialisation had been run.

This should fix it.


 arch/i386/kernel/cpu/mcheck/k7.c        |    4 ----
 arch/i386/kernel/cpu/mcheck/mce.h       |    2 --
 arch/i386/kernel/cpu/mcheck/non-fatal.c |    5 ++++-
 arch/i386/kernel/cpu/mcheck/p4.c        |    3 ---
 4 files changed, 4 insertions(+), 10 deletions(-)

diff -puN arch/i386/kernel/cpu/mcheck/k7.c~mce-workqueue-startup-fix arch/i386/kernel/cpu/mcheck/k7.c
--- 25/arch/i386/kernel/cpu/mcheck/k7.c~mce-workqueue-startup-fix	2003-04-13 16:41:36.000000000 -0700
+++ 25-akpm/arch/i386/kernel/cpu/mcheck/k7.c	2003-04-13 16:42:24.000000000 -0700
@@ -92,8 +92,4 @@ void __init amd_mcheck_init(struct cpuin
 	set_in_cr4 (X86_CR4_MCE);
 	printk (KERN_INFO "Intel machine check reporting enabled on CPU#%d.\n",
 		smp_processor_id());
-
-#ifdef CONFIG_X86_MCE_NONFATAL
-	init_nonfatal_mce_checker();
-#endif
 }
diff -puN arch/i386/kernel/cpu/mcheck/mce.h~mce-workqueue-startup-fix arch/i386/kernel/cpu/mcheck/mce.h
--- 25/arch/i386/kernel/cpu/mcheck/mce.h~mce-workqueue-startup-fix	2003-04-13 16:41:43.000000000 -0700
+++ 25-akpm/arch/i386/kernel/cpu/mcheck/mce.h	2003-04-13 16:42:27.000000000 -0700
@@ -6,8 +6,6 @@ void intel_p5_mcheck_init(struct cpuinfo
 void intel_p6_mcheck_init(struct cpuinfo_x86 *c);
 void winchip_mcheck_init(struct cpuinfo_x86 *c);
 
-void init_nonfatal_mce_checker(void);
-
 /* Call the installed machine check handler for this CPU setup. */
 extern void (*machine_check_vector)(struct pt_regs *, long error_code);
 
diff -puN arch/i386/kernel/cpu/mcheck/non-fatal.c~mce-workqueue-startup-fix arch/i386/kernel/cpu/mcheck/non-fatal.c
--- 25/arch/i386/kernel/cpu/mcheck/non-fatal.c~mce-workqueue-startup-fix	2003-04-13 16:41:50.000000000 -0700
+++ 25-akpm/arch/i386/kernel/cpu/mcheck/non-fatal.c	2003-04-13 16:45:01.000000000 -0700
@@ -11,6 +11,7 @@
 #include <linux/workqueue.h>
 #include <linux/interrupt.h>
 #include <linux/smp.h>
+#include <linux/module.h>
 
 #include <asm/processor.h> 
 #include <asm/system.h>
@@ -65,7 +66,7 @@ static void mce_timerfunc (unsigned long
 	add_timer (&mce_timer);
 }	
 
-void init_nonfatal_mce_checker()
+static int init_nonfatal_mce_checker()
 {
 	if (timerset == 0) {
 		/* Set the timer to check for non-fatal
@@ -78,4 +79,6 @@ void init_nonfatal_mce_checker()
 		timerset = 1;
 		printk(KERN_INFO "Machine check exception polling timer started.\n");
 	}
+	return 0;
 }
+module_init(init_nonfatal_mce_checker);
diff -puN arch/i386/kernel/cpu/mcheck/p4.c~mce-workqueue-startup-fix arch/i386/kernel/cpu/mcheck/p4.c
--- 25/arch/i386/kernel/cpu/mcheck/p4.c~mce-workqueue-startup-fix	2003-04-13 16:42:03.000000000 -0700
+++ 25-akpm/arch/i386/kernel/cpu/mcheck/p4.c	2003-04-13 16:44:22.000000000 -0700
@@ -255,7 +255,4 @@ void __init intel_p4_mcheck_init(struct 
 		intel_init_thermal(c);
 #endif
 	}
-#ifdef CONFIG_X86_MCE_NONFATAL
-	init_nonfatal_mce_checker();
-#endif
 }

_

Re: Early boot oops with 2.5.67-bk(current) on a dual Athlon-MP [Asus A7M266-D] machine

[Dave Jones]

On Sun, Apr 13, 2003 at 04:52:59PM -0700, Andrew Morton wrote:
 > > Attached is the oops (which results in a panic) when I 
 > > attempt to boot the lastest bk current on my machine.
 > The MCE code is using the workqueue infrastructure waaaaaaay earlier than it
 > is allowed to.  It looks like the timer went off before the workqueue
 > initialisation had been run.

Patch looks good to me, and cleans things up as an added bonus.

		Dave

Re: Early boot oops with 2.5.67-bk(current) on a dual Athlon-MP [Asus A7M266-D] machine

[Nicholas Wourms]

Andrew Morton wrote:
> Nicholas Wourms <nwourms@myrealbox.com> wrote:
> 
>>Hi,
>>
>>Attached is the oops (which results in a panic) when I 
>>attempt to boot the lastest bk current on my machine.
> 
> 
> The MCE code is using the workqueue infrastructure waaaaaaay earlier than it
> is allowed to.  It looks like the timer went off before the workqueue
> initialisation had been run.
> 
> This should fix it.
> 

Andrew,

Thanks for the patch.  No oops this time around, but now it 
freezes at the exact same point in the boot process.  My 
keyboard (usb) stops responding entirely, thus eliminating 
any use of the Magic SysRq key.  Same config as before, with 
your patch applied.

Cheers,
Nicholas