The Linux Kernel Mailing List
 help / color / mirror / Atom feed
* pre6 oom killer oops
@ 2001-10-31 13:45 Jeff Garzik
  2001-10-31 13:52 ` Jeff Garzik
  2001-10-31 15:28 ` Linus Torvalds
  0 siblings, 2 replies; 7+ messages in thread
From: Jeff Garzik @ 2001-10-31 13:45 UTC (permalink / raw)
  To: Linux Kernel Mailing List; +Cc: Linus Torvalds, Marcelo Tosatti

[-- Attachment #1: Type: text/plain, Size: 420 bytes --]

2.4.14-pre6 on alpha.  three oops attached, an oops right after oom
killer kicked in, and two hits on this BUG:  kernel BUG at buffer.c:498!

attachments:
dmesg.txt, dmesg output
oops.txt, ksymoops output
sysrqm.txt, sysrq-m output
meminfo.txt, /proc/meminfo output

-- 
Jeff Garzik      | Only so many songs can be sung
Building 1024    | with two lips, two lungs, and one tongue.
MandrakeSoft     |         - nomeansno

[-- Attachment #2: dmesg.txt --]
[-- Type: text/plain, Size: 15367 bytes --]

39B'
eth0: Setting 100mbps half-duplex based on auto-negotiated partner ability 40a1.
do_wp_page: bogus page at address 2000002dbc0 (page 0xfffffc173ab13b00)
VM: killing process cc1(29719)
Unable to handle kernel paging request at virtual address 0031003100303036
cc1(29719): Oops 0
pc = [<fffffc0000833d9c>]  ra = [<fffffc0000833b18>]  ps = 0000    Tainted: P 
v0 = fffffc0011869200  t0 = 0000000000000000  t1 = 0031003100303036
t2 = 0000000000000240  t3 = 00008c3400063301  t4 = fffffc0007256000
t5 = 000000012026bf00  t6 = fffffc0017576000  t7 = fffffc0006048000
s0 = 000000012026bf00  s1 = fffffc00009f72b0  s2 = fffffc0011869200
s3 = 000000012026bf00  s4 = 0000000000000001  s5 = 0000000000000001
s6 = 000000012026bf00
a0 = fffffc0001741dc0  a1 = fffffc0011869200  a2 = 000000012026bf00
a3 = 0000000000000001  a4 = fffffc0017577cf0  a5 = 0000000000000077
t8 = 000000011ffff537  t9 = 000000012026bf00  t10= 0000000000000000
t11= 0000000000000200  pv = fffffc0000833d60  at = fffffc000086adb0
gp = fffffc0000a355f8  sp = fffffc000604b8c8
Trace:fffffc0000833b18 fffffc000081d2d8 fffffc00008103fc fffffc000086c198 fffffc0000984770 fffffc000086adb0 fffffc00009847d0 fffffc0000856220 fffffc000086b690 fffffc00008565c0 fffffc0000856568 fffffc00008128f4 fffffc0000810b20 
Code: b55e0010  a42b0000  f4200030  a55d8b70  a44a0010  e4400006 <a4220000> b42a0010 
swap_free: Bad swap file entry 3539393100320030
swap_free: Bad swap file entry 310031004c3630
swap_free: Bad swap file entry 3931003000310032
swap_free: Bad swap file entry 3630353939310030
swap_free: Bad swap file entry 3000310031004c
swap_free: Bad swap offset entry 3100310031003100
swap_free: Bad swap file entry 2e66656464747368
memory.c:105: bad pmd 0000000000000003.
memory.c:105: bad pmd 000000011ffff2c8.
memory.c:105: bad pmd 000000012006ba80.
memory.c:105: bad pmd 000000012006bc20.
memory.c:105: bad pmd 0000000000000003.
memory.c:105: bad pmd 000002000027c2a8.
memory.c:105: bad pmd 0000000000000001.
swap_free: Bad swap file entry 1201140c0
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 120114060
swap_free: Bad swap file entry 120114040
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 12012f760
swap_free: Bad swap file entry 120113f60
swap_free: Bad swap file entry 120113f60
swap_free: Bad swap file entry 1201a6b40
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 12012f1f8
swap_free: Bad swap file entry 120113f60
swap_free: Bad swap file entry 12012f230
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 12012f470
swap_free: Unused swap offset entry 200000edee8
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 1201308a0
swap_free: Bad swap file entry 120113f60
swap_free: Bad swap file entry 1201308a8
swap_free: Bad swap file entry 120131810
swap_free: Bad swap file entry 1e00000030
swap_free: Bad swap file entry 120114610
swap_free: Bad swap file entry 1201142e8
swap_free: Bad swap file entry 120131850
swap_free: Bad swap file entry 120114448
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 1201143e8
swap_free: Bad swap file entry 1201143c8
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 120131810
swap_free: Bad swap file entry 1201142e8
swap_free: Bad swap file entry 100000808
swap_free: Bad swap file entry 1201142e8
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 120130930
swap_free: Bad swap file entry 1201142e8
swap_free: Bad swap file entry 120130960
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 120130a88
swap_free: Bad swap file entry 1201142e8
swap_free: Bad swap file entry 120130a90
swap_free: Bad swap file entry 1201328d0
swap_free: Bad swap file entry 120133ec0
swap_free: Bad swap file entry 120114610
swap_free: Bad swap file entry 120186150
swap_free: Bad swap file entry 120132920
swap_free: Bad swap file entry 120114770
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 120114710
swap_free: Bad swap file entry 1201146f0
swap_free: Bad swap file entry 12006cc60
swap_free: Bad swap file entry 1201328d0
swap_free: Bad swap file entry 120114610
swap_free: Bad swap file entry 120114610
swap_free: Bad swap file entry 40000086a
swap_free: Bad swap file entry 1201a6bb8
swap_free: Bad swap file entry 3900000038
swap_free: Bad swap file entry 1201158c8
swap_free: Bad swap file entry 120112900
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120113770
swap_free: Bad swap file entry 120114960
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 1201149d0
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120114ab0
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 3234334548454c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120114a40
swap_free: Bad swap file entry 3532334548454c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120114a78
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120112e70
swap_free: Bad swap file entry 120114b20
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 1201111f0
swap_free: Bad swap file entry 120114b90
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120112e70
swap_free: Bad swap file entry 120114c00
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120114c70
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120114dc8
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 3835334248454c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120114ce0
swap_free: Bad swap file entry 6e6972745374375a
swap_free: Bad swap file entry 120113a80
swap_free: Bad swap file entry 120115758
swap_free: Bad swap file entry 120113770
swap_free: Bad swap file entry 120138a88
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120114d48
swap_free: Bad swap file entry 120114e38
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 1201111f0
swap_free: Bad swap file entry 120114ea8
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120114d48
swap_free: Bad swap file entry 120114f18
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120114f88
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120114ff8
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120115068
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120115140
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 3537334248454c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 1201150d8
swap_free: Bad swap file entry 3033394c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120115110
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 1201151b0
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120113770
swap_free: Bad swap file entry 120115220
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 1201111f0
swap_free: Bad swap file entry 120115290
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120113770
swap_free: Bad swap file entry 120115300
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120115370
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120115450
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 3537334548454c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 1201153e0
swap_free: Bad swap file entry 3835334548454c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120115418
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120112e70
swap_free: Bad swap file entry 1201154c0
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 1201111f0
swap_free: Bad swap file entry 120115530
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120112e70
swap_free: Bad swap file entry 1201155a0
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120115610
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 1201156b8
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 3139334248454c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120115680
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 12010e338
swap_free: Bad swap file entry 1201157d8
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 5f63435f3831415a
swap_free: Bad swap file entry 6e69727453743752
swap_free: Bad swap file entry 120113ae0
swap_free: Bad swap file entry 120116420
swap_free: Bad swap file entry 120114d48
swap_free: Bad swap file entry 120132a08
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120115758
swap_free: Bad swap file entry 120115848
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 1201111f0
swap_free: Bad swap file entry 1201158e0
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 1201168b8
swap_free: Bad swap file entry 1201148e0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120115758
swap_free: Bad swap file entry 120115950
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 1201159c0
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120115a30
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120115aa0
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120115b78
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 3830344248454c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120115b10
swap_free: Bad swap file entry 3133394c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120115b48
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120115be8
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120113770
swap_free: Bad swap file entry 120115c58
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 1201111f0
swap_free: Bad swap file entry 120115cc8
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120113770
swap_free: Bad swap file entry 120115d38
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120115da8
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120115e48
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 3732374c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120115e18
swap_free: Bad swap file entry 120111998
swap_free: Bad swap file entry 120115f28
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 3830344548454c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120115eb8
swap_free: Bad swap file entry 3139334548454c24
swap_free: Bad swap file entry 12010a210
swap_free: Bad swap file entry 120115ef0
swap_free: Bad swap file entry 120111c20
swap_free: Bad swap file entry 120115f98
swap_free: Bad swap file entry 120046ef0
swap_free: Bad swap file entry 120111c20
swap_free: Bad swap file entry 120170ce8
swap_free: Bad swap file entry 120116008
swap_free: Bad swap file entry 120046ef0
kernel BUG at buffer.c:498!
ld(31453): Kernel Bug 1
pc = [<fffffc000084ca78>]  ra = [<fffffc000084ca6c>]  ps = 0000    Tainted: P 
v0 = 000000000000001c  t0 = 0000000000000001  t1 = fffffc0016cdbec8
t2 = 0000000000000023  t3 = 0000000000000001  t4 = fffffc0000a3a5d8
t5 = fffffc0001741dc0  t6 = 0000000000000065  t7 = fffffc0015b6c000
a0 = 0000000000000000  a1 = 0000000000000001  a2 = 0000000000000001
a3 = 0000000000000001  a4 = 00000000000000a0  a5 = 0000000000000002
t8 = fffffc0000a3b080  t9 = 0000000000004000  t10= fffffc0000a3b088
t11= fffffc0000a3b098  pv = fffffc000081e1b0  at = 0000000000000000
gp = fffffc0000a355f8  sp = fffffc0015b6fd88
Trace:fffffc000084db44 fffffc000084ea4c fffffc000084f3d0 fffffc000083af70 fffffc000084aad4 fffffc0000810b20 
Code: e4200005  a77da768  6b5b54bd  27ba001f  23bd8b8c  00000081 <a42a0000> f4200003 
kernel BUG at buffer.c:498!
kupdated(6): Kernel Bug 1
pc = [<fffffc000084ca78>]  ra = [<fffffc000084ca6c>]  ps = 0000    Tainted: P 
v0 = 000000000000001c  t0 = 0000000000000001  t1 = fffffc0016cdbec8
t2 = 0000000000000066  t3 = 0000000000000001  t4 = fffffc0000a3a5d8
t5 = fffffc00017415c0  t6 = 0000000000000065  t7 = fffffc0017f20000
a0 = 0000000000000000  a1 = 0000000000000001  a2 = 0000000000000001
a3 = 0000000000000001  a4 = 00000000000000a0  a5 = 0000000000000002
t8 = fffffc0000a3b080  t9 = 0000000000004000  t10= fffffc0000a3b088
t11= fffffc0000a3b098  pv = fffffc000081e1b0  at = 0000000000000000
gp = fffffc0000a355f8  sp = fffffc0017f238e0
Trace:fffffc000084c170 fffffc0000850be8 fffffc000084db44 fffffc000084dc14 fffffc000087b29c fffffc00008653ac fffffc000087de90 fffffc000087def8 fffffc0000851b28 fffffc0000850ba4 fffffc0000851028 fffffc0000810690 fffffc0000850ea0 
Code: e4200005  a77da768  6b5b54bd  27ba001f  23bd8b8c  00000081 <a42a0000> f4200003 

[-- Attachment #3: oops.txt --]
[-- Type: text/plain, Size: 8206 bytes --]

ksymoops 2.4.1 on alpha 2.4.14-pre6.  Options used
     -v /home/jgarzik/cvs/linux_2_4/vmlinux (specified)
     -k /proc/ksyms (specified)
     -l /proc/modules (specified)
     -o /lib/modules/2.4.14-pre6 (specified)
     -m /boot/System.map-2.4.14-pre6 (specified)

Warning (compare_maps): mismatch on symbol packet_socks_nr  , af_packet says fffffffc002c2584, /lib/modules/2.4.14-pre6/kernel/net/packet/af_packet.o says fffffffc002be004.  Ignoring /lib/modules/2.4.14-pre6/kernel/net/packet/af_packet.o entry
Unable to handle kernel paging request at virtual address 0031003100303036
cc1(29719): Oops 0
pc = [<fffffc0000833d9c>]  ra = [<fffffc0000833b18>]  ps = 0000    Tainted: P 
Using defaults from ksymoops -t elf64-alpha -a alpha
v0 = fffffc0011869200  t0 = 0000000000000000  t1 = 0031003100303036
t2 = 0000000000000240  t3 = 00008c3400063301  t4 = fffffc0007256000
t5 = 000000012026bf00  t6 = fffffc0017576000  t7 = fffffc0006048000
s0 = 000000012026bf00  s1 = fffffc00009f72b0  s2 = fffffc0011869200
s3 = 000000012026bf00  s4 = 0000000000000001  s5 = 0000000000000001
s6 = 000000012026bf00
a0 = fffffc0001741dc0  a1 = fffffc0011869200  a2 = 000000012026bf00
a3 = 0000000000000001  a4 = fffffc0017577cf0  a5 = 0000000000000077
t8 = 000000011ffff537  t9 = 000000012026bf00  t10= 0000000000000000
t11= 0000000000000200  pv = fffffc0000833d60  at = fffffc000086adb0
gp = fffffc0000a355f8  sp = fffffc000604b8c8
Trace:fffffc0000833b18 fffffc000081d2d8 fffffc00008103fc fffffc000086c198 fffffc0000984770 fffffc000086adb0 fffffc00009847d0 fffffc0000856220 fffffc000086b690 fffffc00008565c0 fffffc0000856568 fffffc00008128f4 fffffc0000810b20 
Code: b55e0010  a42b0000  f4200030  a55d8b70  a44a0010  e4400006 <a4220000> b42a0010 

>>PC;  fffffc0000833d9c <pte_alloc+3c/130>   <=====
Trace; fffffc0000833b18 <handle_mm_fault+98/1c0>
Trace; fffffc000081d2d8 <do_page_fault+208/4c0>
Trace; fffffc00008103fc <entMM+9c/c0>
Trace; fffffc000086c198 <load_elf_binary+b08/cc0>
Trace; fffffc0000984770 <__do_clear_user+0/150>
Trace; fffffc000086adb0 <padzero+40/50>
Trace; fffffc00009847d0 <__do_clear_user+60/150>
Trace; fffffc0000856220 <search_binary_handler+140/310>
Trace; fffffc000086b690 <load_elf_binary+0/cc0>
Trace; fffffc00008565c0 <do_execve+1d0/280>
Trace; fffffc0000856568 <do_execve+178/280>
Trace; fffffc00008128f4 <sys_execve+64/b0>
Trace; fffffc0000810b20 <entSys+a8/c0>
Code;  fffffc0000833d84 <pte_alloc+24/130>
0000000000000000 <_PC>:
Code;  fffffc0000833d84 <pte_alloc+24/130>
   0:   10 00 5e b5       stq  s1,16(sp)
Code;  fffffc0000833d88 <pte_alloc+28/130>
   4:   00 00 2b a4       ldq  t0,0(s2)
Code;  fffffc0000833d8c <pte_alloc+2c/130>
   8:   30 00 20 f4       bne  t0,cc <_PC+0xcc> fffffc0000833e50 <pte_alloc+f0/130>
Code;  fffffc0000833d90 <pte_alloc+30/130>
   c:   70 8b 5d a5       ldq  s1,-29840(gp)
Code;  fffffc0000833d94 <pte_alloc+34/130>
  10:   10 00 4a a4       ldq  t1,16(s1)
Code;  fffffc0000833d98 <pte_alloc+38/130>
  14:   06 00 40 e4       beq  t1,30 <_PC+0x30> fffffc0000833db4 <pte_alloc+54/130>
Code;  fffffc0000833d9c <pte_alloc+3c/130>   <=====
  18:   00 00 22 a4       ldq  t0,0(t1)   <=====
Code;  fffffc0000833da0 <pte_alloc+40/130>
  1c:   10 00 2a b4       stq  t0,16(s1)

kernel BUG at buffer.c:498!
ld(31453): Kernel Bug 1
pc = [<fffffc000084ca78>]  ra = [<fffffc000084ca6c>]  ps = 0000    Tainted: P 
v0 = 000000000000001c  t0 = 0000000000000001  t1 = fffffc0016cdbec8
t2 = 0000000000000023  t3 = 0000000000000001  t4 = fffffc0000a3a5d8
t5 = fffffc0001741dc0  t6 = 0000000000000065  t7 = fffffc0015b6c000
a0 = 0000000000000000  a1 = 0000000000000001  a2 = 0000000000000001
a3 = 0000000000000001  a4 = 00000000000000a0  a5 = 0000000000000002
t8 = fffffc0000a3b080  t9 = 0000000000004000  t10= fffffc0000a3b088
t11= fffffc0000a3b098  pv = fffffc000081e1b0  at = 0000000000000000
gp = fffffc0000a355f8  sp = fffffc0015b6fd88
Trace:fffffc000084db44 fffffc000084ea4c fffffc000084f3d0 fffffc000083af70 fffffc000084aad4 fffffc0000810b20 
Code: e4200005  a77da768  6b5b54bd  27ba001f  23bd8b8c  00000081 <a42a0000> f4200003 

>>PC;  fffffc000084ca78 <__insert_into_lru_list+68/f0>   <=====
Trace; fffffc000084db44 <refile_buffer+14/20>
Trace; fffffc000084ea4c <__block_commit_write+fc/180>
Trace; fffffc000084f3d0 <generic_commit_write+40/80>
Trace; fffffc000083af70 <generic_file_write+550/740>
Trace; fffffc000084aad4 <sys_write+e4/160>
Trace; fffffc0000810b20 <entSys+a8/c0>
Code;  fffffc000084ca60 <__insert_into_lru_list+50/f0>
0000000000000000 <_PC>:
Code;  fffffc000084ca60 <__insert_into_lru_list+50/f0>
   0:   05 00 20 e4       beq  t0,18 <_PC+0x18> fffffc000084ca78 <__insert_into_lru_list+68/f0>
Code;  fffffc000084ca64 <__insert_into_lru_list+54/f0>
   4:   68 a7 7d a7       ldq  t12,-22680(gp)
Code;  fffffc000084ca68 <__insert_into_lru_list+58/f0>
   8:   bd 54 5b 6b       jsr  ra,(t12),5300 <_PC+0x5300> fffffc0000851d60 <alloc_super+20/170>
Code;  fffffc000084ca6c <__insert_into_lru_list+5c/f0>
   c:   1f 00 ba 27       ldah gp,31(ra)
Code;  fffffc000084ca70 <__insert_into_lru_list+60/f0>
  10:   8c 8b bd 23       lda  gp,-29812(gp)
Code;  fffffc000084ca74 <__insert_into_lru_list+64/f0>
  14:   81 00 00 00       call_pal     0x81
Code;  fffffc000084ca78 <__insert_into_lru_list+68/f0>   <=====
  18:   00 00 2a a4       ldq  t0,0(s1)   <=====
Code;  fffffc000084ca7c <__insert_into_lru_list+6c/f0>
  1c:   03 00 20 f4       bne  t0,2c <_PC+0x2c> fffffc000084ca8c <__insert_into_lru_list+7c/f0>

kernel BUG at buffer.c:498!
kupdated(6): Kernel Bug 1
pc = [<fffffc000084ca78>]  ra = [<fffffc000084ca6c>]  ps = 0000    Tainted: P 
v0 = 000000000000001c  t0 = 0000000000000001  t1 = fffffc0016cdbec8
t2 = 0000000000000066  t3 = 0000000000000001  t4 = fffffc0000a3a5d8
t5 = fffffc00017415c0  t6 = 0000000000000065  t7 = fffffc0017f20000
a0 = 0000000000000000  a1 = 0000000000000001  a2 = 0000000000000001
a3 = 0000000000000001  a4 = 00000000000000a0  a5 = 0000000000000002
t8 = fffffc0000a3b080  t9 = 0000000000004000  t10= fffffc0000a3b088
t11= fffffc0000a3b098  pv = fffffc000081e1b0  at = 0000000000000000
gp = fffffc0000a355f8  sp = fffffc0017f238e0
Trace:fffffc000084c170 fffffc0000850be8 fffffc000084db44 fffffc000084dc14 fffffc000087b29c fffffc00008653ac fffffc000087de90 fffffc000087def8 fffffc0000851b28 fffffc0000850ba4 fffffc0000851028 fffffc0000810690 fffffc0000850ea0 
Code: e4200005  a77da768  6b5b54bd  27ba001f  23bd8b8c  00000081 <a42a0000> f4200003 

>>PC;  fffffc000084ca78 <__insert_into_lru_list+68/f0>   <=====
Trace; fffffc000084c170 <write_some_buffers+b0/160>
Trace; fffffc0000850be8 <sync_old_buffers+78/b0>
Trace; fffffc000084db44 <refile_buffer+14/20>
Trace; fffffc000084dc14 <bread+14/90>
Trace; fffffc000087b29c <ext2_update_inode+16c/4c0>
Trace; fffffc00008653ac <sync_unlocked_inodes+1bc/200>
Trace; fffffc000087de90 <ext2_commit_super+30/50>
Trace; fffffc000087def8 <ext2_write_super+48/60>
Trace; fffffc0000851b28 <sync_supers+218/250>
Trace; fffffc0000850ba4 <sync_old_buffers+34/b0>
Trace; fffffc0000851028 <kupdate+188/190>
Trace; fffffc0000810690 <kernel_thread+58/70>
Trace; fffffc0000850ea0 <kupdate+0/190>
Code;  fffffc000084ca60 <__insert_into_lru_list+50/f0>
0000000000000000 <_PC>:
Code;  fffffc000084ca60 <__insert_into_lru_list+50/f0>
   0:   05 00 20 e4       beq  t0,18 <_PC+0x18> fffffc000084ca78 <__insert_into_lru_list+68/f0>
Code;  fffffc000084ca64 <__insert_into_lru_list+54/f0>
   4:   68 a7 7d a7       ldq  t12,-22680(gp)
Code;  fffffc000084ca68 <__insert_into_lru_list+58/f0>
   8:   bd 54 5b 6b       jsr  ra,(t12),5300 <_PC+0x5300> fffffc0000851d60 <alloc_super+20/170>
Code;  fffffc000084ca6c <__insert_into_lru_list+5c/f0>
   c:   1f 00 ba 27       ldah gp,31(ra)
Code;  fffffc000084ca70 <__insert_into_lru_list+60/f0>
  10:   8c 8b bd 23       lda  gp,-29812(gp)
Code;  fffffc000084ca74 <__insert_into_lru_list+64/f0>
  14:   81 00 00 00       call_pal     0x81
Code;  fffffc000084ca78 <__insert_into_lru_list+68/f0>   <=====
  18:   00 00 2a a4       ldq  t0,0(s1)   <=====
Code;  fffffc000084ca7c <__insert_into_lru_list+6c/f0>
  1c:   03 00 20 f4       bne  t0,2c <_PC+0x2c> fffffc000084ca8c <__insert_into_lru_list+7c/f0>


1 warning issued.  Results may not be reliable.

[-- Attachment #4: sysrqm.txt --]
[-- Type: text/plain, Size: 804 bytes --]

SysRq : Show Memory

Mem-info:
Free pages:       86776kB (     0kB HighMem)
Zone:DMA freepages:  1912kB min:   512KB low:  1024kB high:  1536kB
Zone:Normal freepages: 84864kB min:  2040KB low:  4080kB high:  6120kB
Zone:HighMem freepages:     0kB min:     0KB low:     0kB high:     0kB
Free pages:       86776kB (     0kB HighMem)
( Active: 9813, inactive: 19020, free: 10847 )
85*8kB 13*16kB 0*32kB 0*64kB 0*128kB 0*256kB 0*512kB 1*1024kB 0*2048kB 0*4096kB = 1912kB)
780*8kB 2760*16kB 725*32kB 82*64kB 13*128kB 3*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 84864kB)
= 0kB)
Swap cache: add 111, delete 13, find 19/20, race 0+0
Free swap:       408368kB
49074 pages of RAM
11317 free pages
1299 reserved pages
23424 pages shared
98 pages swap cached
49 pages in page table cache
Buffer memory:    33344kB

[-- Attachment #5: meminfo.txt --]
[-- Type: text/plain, Size: 522 bytes --]

        total:    used:    free:  shared: buffers:  cached:
Mem:  391372800 302718976 88653824        0 34152448 187908096
Swap: 418996224   827392 418168832
MemTotal:       382200 kB
MemFree:         86576 kB
MemShared:           0 kB
Buffers:         33352 kB
Cached:         182720 kB
SwapCached:        784 kB
Active:          78520 kB
Inactive:       152320 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:       382200 kB
LowFree:         86576 kB
SwapTotal:      409176 kB
SwapFree:       408368 kB

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: pre6 oom killer oops
  2001-10-31 13:45 pre6 oom killer oops Jeff Garzik
@ 2001-10-31 13:52 ` Jeff Garzik
  2001-10-31 14:12   ` Jeff Garzik
  2001-10-31 15:28 ` Linus Torvalds
  1 sibling, 1 reply; 7+ messages in thread
From: Jeff Garzik @ 2001-10-31 13:52 UTC (permalink / raw)
  To: Linux Kernel Mailing List; +Cc: Linus Torvalds, Marcelo Tosatti

[-- Attachment #1: Type: text/plain, Size: 664 bytes --]

further comments on that report.

machine survived, and sysrq-m output was taken a few minutes after I (a)
noticed the oops and (b) installed the ksymoops RPM :)  So the sysrq-m
is not from immediately after the oops.

I attach vmstat output from the alpha, running pre6.  TAKE THIS OUTPUT
WITH A GRAIN OF SALT.  I -think- the output starts when I start the rpm
build, and -think- the output stops when I noticed the oops.  But the
possibility exists that I stopped the vmstat before the oom killer
kicked in.

-- 
Jeff Garzik      | Only so many songs can be sung
Building 1024    | with two lips, two lungs, and one tongue.
MandrakeSoft     |         - nomeansno

[-- Attachment #2: vmstat.txt --]
[-- Type: text/plain, Size: 12640 bytes --]

   procs                      memory    swap          io     system         cpu
 r  b  w   swpd   free   buff  cache  si  so    bi    bo   in    cs  us  sy  id
 1  0  0    808  96536  27888 181040   0   0    38   159 1102   204  60   9  31
 3  0  0    808  96688  27928 181040   0   0    29     0 1100   300  80  19   0
 1  0  0    808  96352  27928 181024   0   0     0     0 1070   239  81  19   0
 1  0  0    808  96664  27928 181024   0   0     0     0 1063   223  80  20   0
 1  0  0    808  96616  27928 181024   0   0     0     8 1077   248  80  20   0
 1  0  0    808  96432  27928 181024   0   0     0     0 1073   250  78  22   0
 1  0  0    808  96512  27928 181024   0   0     0     0 1059   215  80  20   0
 1  0  0    808  96336  27928 181024   0   0     0    24 1052   163  83  17   0
 1  0  0    808  96648  27928 181024   0   0     0    48 1069   197  82  18   0
 1  0  0    808  96328  27928 181024   0   0     0     0 1039   160  83  17   0
 1  0  0    808  96304  27928 181024   0   0     0     0 1058   213  81  19   0
 1  0  0    808  96336  27928 181016   0   0     0     0 1062   219  80  20   0
 1  0  0    808  96416  27928 181016   0   0     0     0 1134   310  79  21   0
 1  0  0    808  96616  27928 181016   0   0     0     0 1148   298  79  20   0
 1  0  0    808  96336  27928 181016   0   0     0     0 1162   322  80  20   0
 1  0  0    808  96504  27928 181008   0   0     0     0 1143   288  80  19   0
 2  0  0    808  95944  27928 181008   0   0     0     8 1140   248  85  14   0
 1  0  0    808  96568  27928 181008   0   0     0     8 1040   160  88  12   0
 2  0  0    808  96320  27928 181008   0   0     0     8 1031   106  89  11   0
 2  0  0    808  96320  27928 181008   0   0     0     0 1030   112  88  12   0
 1  0  0    808  94952  27928 181008   0   0     0     0 1032   124  89  11   0
 1  0  0    808  94936  27928 181008   0   0     0     8 1033   102  90  10   0
 1  0  0    808  95160  27928 181008   0   0     0     0 1028    89  90  10   0
 1  0  0    808  96376  27928 181296   0   0     0     8 1035   177  85  15   0
 1  0  0    808  69520  28584 202488   0   0     0     0 1028   419  86  14   0
 1  0  0    808  45432  30168 224912   0   0     2    16 1040   816  92   8   0
 1  0  0    808  30824  31640 238048   0   0    12     8 1044   694  95   5   0
 1  0  0    808  15632  32776 252096   0   0     1     0 1027   733  96   4   0
 2  0  0    808   9208  31472 265232   0   0    32     0 1062   648  84  15   0
 1  0  0    808  16032  30696 260584   0   0     1     0 1028   444  67  32   1
 1  0  0    808   6904  30536 259304   0   0     1     8 1031   145  91   9   0
 1  0  0    808   7424  30560 259560   0   0     0     8 1031    41  97   3   0
 1  0  1    808  13704  30592 259464   0   0     0  3032 1053    42  96   4   0
 1  0  0    808  12992  30720 260096   0   0     0  3388 1111   280  52  24  24
 1  0  0    808  14344  30752 260288   0   0     0     0 1030   475  71  29   0
 2  0  0    808  13408  30832 260416   0   0     2     0 1039   242  86  14   0
 1  0  0    808  14912  30440 258952   0   0     0     0 1028   128  91   9   0
 1  0  0    808  11352  30472 259144   0   0     0     0 1028   187  88  12   0
 1  0  0    808  14608  30512 259232   0   0     0     0 1027   210  86  14   0
 1  0  0    808  16320  30536 259720   0   0     0     0 1034   389  74  25   0
 1  0  0    808  16128  30632 259824   0   0     0     0 1032   408  68  31   0
 2  0  0    808  13312  30680 260024   0   0     1     0 1029   369  76  24   0
   procs                      memory    swap          io     system         cpu
 r  b  w   swpd   free   buff  cache  si  so    bi    bo   in    cs  us  sy  id
 3  0  0    808   6560  30696 260088   0   0     1     0 1028   126  93   7   0
 1  0  0    808   7760  30408 256552   0   0     1     0 1028    36  98   2   0
 2  0  0    808  16672  30424 256704   0   0     0     0 1027   133  93   7   0
 1  0  0    808  11864  30424 256744   0   0     0     0 1027    99  95   5   0
 1  0  0    808  12664  30432 256848   0   0     0     0 1027    83  95   5   0
 1  1  0    808  19504  30440 256912   0   0     0     0 1032   151  92   8   0
 3  0  0    808  18000  30440 256984   0   0     0     0 1027   145  91   9   0
 1  0  0    808  11216  30448 257040   0   0     0     0 1027   136  92   8   0
 1  0  0    808  13656  30456 257096   0   0     0     0 1027   102  94   6   0
 1  0  0    808  12200  30456 257160   0   0     0     0 1028   158  91   9   0
 1  0  0    808  13624  30464 257256   0   0     0     0 1028   126  93   7   0
 1  0  0    808   6600  30464 257288   0   0     0     0 1028    80  96   4   0
 1  0  0    808   5152  29872 255968   0   0     0     0 1027    99  95   5   0
 1  0  0    808  12480  28616 251080   0   0     0     0 1027    16  99   1   0
 2  0  0    808  26448  28624 251392   0   0     0     0 1027   147  92   8   0
 2  0  0    808  22928  28624 251456   0   0     0     0 1028   164  91   9   0
 1  0  0    808  18296  28640 251536   0   0     0     0 1028   139  92   8   0
 2  0  0    808  21784  28648 251624   0   0     0     0 1027   157  91   9   0
 1  0  0    808  20624  28648 251696   0   0     0     0 1027   166  91   9   0
 1  0  0    808  18000  28656 251768   0   0     0     0 1027   131  93   7   0
 1  0  0    808  19920  28656 251840   0   0     0     0 1027   177  90  10   0
 1  0  0    808  19168  28656 251904   0   0     0     0 1027   172  91   9   0
 2  0  0    808  25480  28656 251976   0   0     0     0 1027   169  91   9   0
 1  0  0    808  20200  28672 252064   0   0     1     0 1028   138  91   8   1
 1  0  0    808  19344  28680 252168   0   0     1     0 1028    54  97   3   0
 2  0  0    808  24088  28800 253800   0   0     0     0 1030   129  87  13   1
 1  0  0    808  16728  28840 254176   0   0     1     0 1029    91  92   8   0
 1  0  0    808  23864  28856 254560   0   0     0     0 1027   103  91   9   0
 1  1  0    808  23544  28864 254728   0   0     1     0 1031   155  88  12   0
 2  0  0    808   9624  28872 254808   0   0     1     0 1028   130  90  10   0
 2  0  0    808  22912  28888 254928   0   0     0     0 1027    77  96   4   0
 2  0  0    808  22912  28904 255256   0   0     0     0 1028   133  89  11   0
 1  0  0    808  27544  28536 251608   0   0     0     0 1032    80  96   4   0
 2  0  0    808  91952  30104 187432   0   0     1     0 1047  1098  65  34   1
 1  0  1    808  89032  30192 187512   0   0     8   244 1103   476  61  24  14
 1  0  1    808  89744  30240 188344   0   0     0  4391 1110   108  86  11   2
 1  0  0    808  85720  30264 188536   0   0     0   243 1066   100  90  10   0
 1  0  0    808  78528  30280 188792   0   0     1   120 1057    71  96   4   0
 1  0  1    808  86880  30312 189608   0   0     2   213 1029    81  93   7   1
 1  0  0    808  81424  30336 189608   0   0     0    67 1058   450  57  22  21
 2  0  0    808  89184  30384 190296   0   0     0   293 1062    44  91   9   0
 2  1  1    808  86416  30416 190648   0   0     0   171 1049   349  84  16   0
   procs                      memory    swap          io     system         cpu
 r  b  w   swpd   free   buff  cache  si  so    bi    bo   in    cs  us  sy  id
 2  0  0    808  79536  30424 190760   0   0     0     0 1035   109  96   4   0
 1  0  0    808  78008  30432 190896   0   0     0    64 1038    82  97   3   0
 1  0  0    808  84400  30432 191104   0   0     0    52 1038    91  97   3   0
 1  0  0    808  69352  30432 191120   0   0     0    61 1039    81  97   3   0
 1  0  0    808  77088  30448 191360   0   0     0    78 1031    82  97   3   0
 2  0  0    808  86048  30464 192064   0   0     0     0 1035    84  94   6   0
 1  0  0    808  77464  30480 192096   0   0     0   203 1063   457  64  24  11
 2  0  0    808  85800  30568 192672   0   0     1   183 1059   116  89  11   0
 1  0  0    808  80568  30584 192776   0   0     0     0 1033   124  93   7   0
 1  0  0    808  77840  30600 192880   0   0     0    62 1042   126  93   7   0
 1  0  0    808  79936  30632 193000   0   0     1    52 1041   105  94   6   0
 1  0  0    808  76880  30688 193880   0   0    20   142 1049    85  93   6   1
 2  0  0    808  84016  30760 194432   0   0    17     0 1030   394  75  23   2
 2  0  0    808  84152  30800 194768   0   0     0   263 1066   313  80  20   0
 1  0  0    808  83144  30840 195488   0   0     0   111 1059   401  82  18   0
 1  0  1    808  83056  30848 195864   0   0     0   203 1043   434  79  21   0
 1  0  0    808  75984  30864 195936   0   0     0    90 1049   497  62  26  12
 2  0  0    808  81424  30896 196248   0   0     0   119 1058   281  59  21  21
 2  0  0    808  81424  30920 196664   0   0     0   142 1056   344  71  15  14
 1  0  0    808  79424  30928 196760   0   0     0     0 1028   445  78  22   0
 1  0  0    808  81672  30960 197024   0   0     0   140 1055   429  61  23  17
 1  0  0    808 114576  31176 163768   0   0     1     8 1039   386  77  23   0
 2  0  0    808 112984  31224 163864   0   0     2     0 1031   421  68  31   1
 1  0  0    808 100728  31224 163896   0   0     0     0 1027    62  94   6   0
 1  0  0    808  96984  31224 163896   0   0     0     0 1027    32  98   2   0
 1  0  0    808 101112  31232 163904   0   0     0     0 1027    45  97   3   0
 1  0  0    808  95768  31232 163904   0   0     0     0 1027    33  98   2   0
 1  0  0    808  88960  31232 163904   0   0     0     0 1027    15  99   1   0
 2  0  0    808  95888  31232 163904   0   0     0     2 1029    39  98   2   0
 1  0  0    808  81376  31232 163904   0   0     0     7 1034    21  99   1   0
 1  0  0    808  81720  31232 163904   0   0     0     0 1027    13  99   1   0
 1  0  0    808  77920  31232 163904   0   0     0     0 1027    11  99   1   0
 1  0  0    808  73288  31248 163912   0   0     3     0 1028    13  98   1   1
 2  0  0    808  67408  31248 163912   0   0     0     0 1027    14  99   1   0
 1  0  0    808 107184  31248 163912   0   0     0     0 1028    55  96   4   0
 2  1  0    808 112496  31248 163928   0   0     0     0 1027    49  97   3   0
 1  0  0    808  90632  31264 163976   0   0     4     0 1028    43  96   3   1
 1  0  0    808  75424  31264 163976   0   0     0     0 1027    10  98   2   0
 1  0  0    808  69848  31264 163976   0   0     0     0 1027     4  99   1   0
 1  0  0    808  69848  31264 163976   0   0     0     0 1027     4 100   0   0
 1  0  0    808  65464  31264 163976   0   0     0     0 1027     4  96   4   0
 1  0  0    808  65696  31264 163976   0   0     0     0 1027    11  97   3   0
   procs                      memory    swap          io     system         cpu
 r  b  w   swpd   free   buff  cache  si  so    bi    bo   in    cs  us  sy  id
 2  0  0    808  63672  31264 163976   0   0     0     0 1028    13 100   0   0
 1  0  0    808  95744  31280 164392   0   0     0     0 1027    89  92   8   0
 1  0  0    808  94544  31280 164392   0   0     0     0 1027    11  99   1   0
 1  0  0    808  98472  31280 164392   0   0     0     0 1027    33  98   2   0
 2  0  0    808 111552  31280 164392   0   0     0     0 1027    18  99   1   0
 1  0  0    808 101904  31280 164392   0   0     0     0 1027    39  97   3   0
 1  0  0    808  98656  31280 164440   0   0     0     0 1027    47  97   3   0
 1  0  0    808  92456  31280 164440   0   0     0     0 1028    14  99   1   0
 1  0  0    808  84640  31280 164440   0   0     0     0 1027    12  99   1   0
 1  0  0    808  94816  31288 164440   0   0     0     0 1027    29  98   2   0
 1  0  0    808 103008  31288 164456   0   0     0     0 1027    34  97   3   0
 2  0  0    808 112952  31296 164464   0   0     0     0 1027    59  95   5   0
 1  0  0    808  98552  31304 164488   0   0     0     0 1027    65  95   5   0
 1  0  0    808  92896  31304 164488   0   0     0     0 1027    13  99   1   0
 1  0  0    808  88040  31304 164488   0   0     0     0 1028    11  99   1   0
 2  0  0    808 100520  31312 164488   0   0     0     0 1027    29  98   2   0
 1  0  0    808 103320  31312 164488   0   0     0     0 1029    28  98   2   0
 1  0  0    808 100328  31312 164544   0   0     0     0 1027    56  96   4   0
 1  0  0    808 100896  31320 164648   0   0     0     0 1027    30  98   2   0
 1  0  0    808 102568  31320 164680   0   0     0     0 1041   117  94   6   0
 2  0  0    808  99160  31320 164704   0   0     0     0 1065   108  98   2   0
 1  0  0    808 104864  31328 164872   0   0     0     0 1035    58  96   4   0
 1  0  0    808 100576  31336 164920   0   0     0     0 1028    54  97   3   0
 1  0  0    808 101512  31344 165080   0   0     0     0 1028    30  98   2   0

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: pre6 oom killer oops
  2001-10-31 13:52 ` Jeff Garzik
@ 2001-10-31 14:12   ` Jeff Garzik
  2001-10-31 14:18     ` Alexander Viro
  0 siblings, 1 reply; 7+ messages in thread
From: Jeff Garzik @ 2001-10-31 14:12 UTC (permalink / raw)
  To: Linux Kernel Mailing List; +Cc: Linus Torvalds, Marcelo Tosatti

further comments #2:

when rebooting, there was some disk corruption in the ext2 filesystem.

It is my guess that this is to the large number of buffers in the vmstat
output, which I believe are dirty buffers that never got written out

-- 
Jeff Garzik      | Only so many songs can be sung
Building 1024    | with two lips, two lungs, and one tongue.
MandrakeSoft     |         - nomeansno


^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: pre6 oom killer oops
  2001-10-31 14:12   ` Jeff Garzik
@ 2001-10-31 14:18     ` Alexander Viro
  2001-10-31 14:27       ` Jeff Garzik
  0 siblings, 1 reply; 7+ messages in thread
From: Alexander Viro @ 2001-10-31 14:18 UTC (permalink / raw)
  To: Jeff Garzik; +Cc: Linux Kernel Mailing List, Linus Torvalds, Marcelo Tosatti



On Wed, 31 Oct 2001, Jeff Garzik wrote:

> further comments #2:
> 
> when rebooting, there was some disk corruption in the ext2 filesystem.
> 
> It is my guess that this is to the large number of buffers in the vmstat
> output, which I believe are dirty buffers that never got written out

Judging by your log it's not an OOM - page table corruption got caught by
do_wp_page(), which means that handle_mm_fault() fails (surprise, surprise),
which kills the process.

Looks like a massive memory corruption - later it fscked you in pte_alloc()
and then it screwed buffer cache lists.


^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: pre6 oom killer oops
  2001-10-31 14:18     ` Alexander Viro
@ 2001-10-31 14:27       ` Jeff Garzik
  2001-10-31 15:43         ` Linus Torvalds
  0 siblings, 1 reply; 7+ messages in thread
From: Jeff Garzik @ 2001-10-31 14:27 UTC (permalink / raw)
  To: Linux Kernel Mailing List; +Cc: Alexander Viro, Linus Torvalds, Marcelo Tosatti

Alexander Viro wrote:
> 
> On Wed, 31 Oct 2001, Jeff Garzik wrote:
> 
> > further comments #2:
> >
> > when rebooting, there was some disk corruption in the ext2 filesystem.
> >
> > It is my guess that this is to the large number of buffers in the vmstat
> > output, which I believe are dirty buffers that never got written out
> 
> Judging by your log it's not an OOM - page table corruption got caught by
> do_wp_page(), which means that handle_mm_fault() fails (surprise, surprise),
> which kills the process.
> 
> Looks like a massive memory corruption - later it fscked you in pte_alloc()
> and then it screwed buffer cache lists.

I'm reinstalling now, with a bad blocks check, to make sure random disk
crap isn't affecting things.  Disk is good AFAIK.  Vaguely recent ATA-33
drive.  I'll switch to the other alpha to see if I can see similar
symptoms.  

Unfortunately I don't know of a good alpha memory tester like
memtest86.  SRM firmware tests memory ok, but that probably doesn't mean
much.

Final comment before leaving this machine.  Restarting the rpm-rebuilder
(post reboot and fsck), I still see a very large number of buffs.  Since
there is zero swapped, this may or may not be normal.  The cache value
appears sane, FWIW.


   procs                      memory    swap          io    
system         cpu
 r  b  w   swpd   free   buff  cache  si  so    bi    bo   in    cs  us 
sy  id
 2  0  0      0  35024  13016 267256   0   0     3   491 1046   136  84 
12   4
 1  0  0      0 106776  14864 191984   0   0   380     0 1903   696  13 
20  67
 3  0  0      0  85448  16424 210216   0   0   239    11 1066  1305  58 
25  17
 1  0  0      0  83624  16560 210712   0   0   107    21 1068   550  54 
25  21
 1  0  0      0  81952  16600 211224   0   0     3     0 1030    96 
93   6   0
 1  0  0      0  78720  16704 212080   0   0   144    11 1045   118  79 
12   9
 2  0  0      0  79608  16728 212400   0   0    30     0 1037   108 
86   8   5
 1  0  0      0  73288  16792 212736   0   0    35    11 1039    84 
91   5   4
 1  0  0      0  71784  16792 212736   0   0     0    11 1038    25 
99   1   0
 1  0  0      0  81560  16944 214840   0   0   446     0 1049   259  70 
19  11
 1  0  0      0  76920  16984 215480   0   0     4     0 1031   487  75 
24   1
 1  0  0      0  79384  17016 215600   0   0     0     0 1029    23 
94   6   0
 0  1  1      0  79432  17056 215976   0   0    12  1396 1132   188  48 
12  40
 0  1  1      0  79384  17056 216008   0   0    11  4542 1107    14  
0   2  98
 1  0  0      0  74400  17128 216984   0   0   331   217 1090   269  25 
10  65
 2  0  0      0  70456  17136 217064   0   0     0   288 1030   119 
96   4   0
 1  0  0      0  72200  17152 217176   0   0     0     0 1050    96 
97   3   0
 1  0  0      0  67232  17152 217264   0   0     0   107 1041    93 
98   2   0
 1  0  0      0  70072  17160 217416   0   0     0     0 1029    91 
97   3   0
 1  0  0      0  68272  17168 217496   0   0     0    75 1035   122 
96   4   0

-- 
Jeff Garzik      | Only so many songs can be sung
Building 1024    | with two lips, two lungs, and one tongue.
MandrakeSoft     |         - nomeansno


^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: pre6 oom killer oops
  2001-10-31 13:45 pre6 oom killer oops Jeff Garzik
  2001-10-31 13:52 ` Jeff Garzik
@ 2001-10-31 15:28 ` Linus Torvalds
  1 sibling, 0 replies; 7+ messages in thread
From: Linus Torvalds @ 2001-10-31 15:28 UTC (permalink / raw)
  To: Jeff Garzik; +Cc: Linux Kernel Mailing List, Marcelo Tosatti


On Wed, 31 Oct 2001, Jeff Garzik wrote:
>
> 2.4.14-pre6 on alpha.  three oops attached, an oops right after oom
> killer kicked in, and two hits on this BUG:  kernel BUG at buffer.c:498!

This isn't the oom killer - look more closely at your oops:

	do_wp_page: bogus page at address 2000002dbc0 (page 0xfffffc173ab13b00)
	VM: killing process cc1(29719)

Note the "do_wp_page" message _before_ the VM decided to kill the process.
And the first oops seems to be more of the same: big corruption in the
page tables.

Looks like the oom killer kicked in under extreme memory load, but the
extreme memory load caused something else too.

		Linus


^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: pre6 oom killer oops
  2001-10-31 14:27       ` Jeff Garzik
@ 2001-10-31 15:43         ` Linus Torvalds
  0 siblings, 0 replies; 7+ messages in thread
From: Linus Torvalds @ 2001-10-31 15:43 UTC (permalink / raw)
  To: Jeff Garzik; +Cc: Linux Kernel Mailing List, Alexander Viro, Marcelo Tosatti


On Wed, 31 Oct 2001, Jeff Garzik wrote:
>
> I'm reinstalling now, with a bad blocks check, to make sure random disk
> crap isn't affecting things.  Disk is good AFAIK.  Vaguely recent ATA-33
> drive.  I'll switch to the other alpha to see if I can see similar
> symptoms.

Bad disks won't cause the kind of page table corruption you saw - even if
the disk is total cr*p, and you have a swap partition on it, we never
actually put metadata in swap, only the actual user pages (some other
systems will page out the page directories too, Linux won't).

To me it actually looks like something corrupted a _big_ chunk of memory.
Which is not indicative of memory trouble either (sure, random one-bit
corruption can do just about anything, including causing a big memcpy to
go to the wrong place, but ..).

One thing that does things like this is missed TLB invalidates. Especially
on SMP. If you unmap and free a page, and user space still has a TLB entry
for it, you can have the kernel re-use the page at the same time user
space writes "garbage" to it.

This is, of course, a lot easier to trigger with MMU contexts and the
like.



Something like that is especially likely, as one of the values in your
oops is

	swap_free: Bad swap file entry 2e66656464747368

where that value looks suspiciously like a likely string from a compiler:

	"hstddef."

So I'd look very closely at the TLB invalidate code, or possibly try to
see if we might re-use a page for some other reason too early.

		Linus


^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2001-10-31 15:46 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2001-10-31 13:45 pre6 oom killer oops Jeff Garzik
2001-10-31 13:52 ` Jeff Garzik
2001-10-31 14:12   ` Jeff Garzik
2001-10-31 14:18     ` Alexander Viro
2001-10-31 14:27       ` Jeff Garzik
2001-10-31 15:43         ` Linus Torvalds
2001-10-31 15:28 ` Linus Torvalds

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox