* Unable to handle kernel paging request at virtual address 04000460
@ 2005-06-01 11:31 raghunathan.venkatesan
2005-06-01 18:54 ` David S. Miller
0 siblings, 1 reply; 5+ messages in thread
From: raghunathan.venkatesan @ 2005-06-01 11:31 UTC (permalink / raw)
To: linux-net, netdev, linux
[-- Attachment #1: Type: text/plain, Size: 1006 bytes --]
Hi Everyone,
We are facing the following crash in custom Linux 2.4.26 kernel, when we
run a netperf TCP Stream (sizes varying from 64 to 32586 bytes) test
over an IPSEC tunnel created between a host and a VPN server through our
box. This is a Au1550 MIPS32 based board (DB1550 Cabernet board from
AMD). We observe that crash happens randomly (the PrId keeps changing at
each crash), because of burstiness in the netperf tool generated
traffic. Please look into the following capture below. I'd like some
help in debugging this issue. The same set of IPSEC drivers (not from
Linux) works fine on a custom Linux 2.4.25 based kernel. We debugged the
Oops traces and found that all problems arise in skbuff (donno where in
skbuff). Is there a patch that needs to be applied for Linux 2.4.26 ?
Thanks & Regards,
Raghu Venkatesan
Project Manager (E & PE, Semiconductor & Access),
CDC2, Sozhanganallur,
Chennai - 600 119, INDIA
+91 -44-24500200 Ext. 2643
raghunathan.venkatesan@wipro.com
[-- Attachment #2: recent.cap_send1.oops --]
[-- Type: application/octet-stream, Size: 5317 bytes --]
ksymoops 2.4.9 on i686 2.4.22-1.2115.nptl. Options used
-v /home/amd/project/amd/kernel/vmlinux (default)
-K (specified)
-l /proc/modules (default)
-o /home/amd/project/amd/filesystem/usr/lib/modules/ (default)
-m /home/amd/project/amd/kernel/System.map (default)
-t elf32-littlemips -a mips:4600
No modules in ksyms, skipping objects
No ksyms, skipping lsmod
Unable to handle kernel paging request at virtual address 020004d4, epc == 8024af6c, ra == 8024b094
Oops in fault.c::do_page_fault, line 206:
$0 : 00000000 1000fc00 8abbb600 02000460 02000460 8abbb5ec 00000000 000005ec
$8 : 5ad3436e 8abbbdec b3de5d71 56736988 0783fdfb 80323858 80323804 24e12ae5
$16: 02000460 00000001 8abbb800 00000600 00000cfc 000005dc 00000014 00003408
$24: 00000000 2aea3c70 80322000 80323a28 0000341c 8024b094
Hi : 00000000
Lo : 00000800
epc : 8024af6c Not tainted
Status: 1000fc03
Cause : 00800008
Process swapper (pid: 0, stackpage=80322000)
Stack: 8b962480 00000000 00000000 00000000 00000800 8b6af460 8024b094
8b6af460 8abbb800 00000600 00000cfc 000005dc 00000800 8b6af460 8024b7cc
8024b7b0 24e12ae5 80323858 80323804 c01c2050 8b6af460 803a0400 000005c8
812be300 802501d4 000005dc 00000014 00002e40 00000000 2aea3c70 8b6af460
8aea1160 000005c8 8026a9e8 00002e54 8026a184 1000fc03 00000000 8b6af460
8abbb010 ...
Call Trace: [<8024b094>] [<8024b7cc>] [<8024b7b0>] [<802501d4>] [<8026a9e8>]
[<8026a184>] [<8026a30c>] [<8026a1dc>] [<8026a90c>] [<8026a90c>] [<8029c418>]
[<8026a90c>] [<8026a90c>] [<8025a484>] [<8026a90c>] [<8026a90c>] [<8025a948>]
[<802da0e0>] [<8026a90c>] [<8026a8d4>] [<8026a90c>] [<8026a30c>] [<8026a184>]
[<80267130>] [<802671b0>] [<8026a744>] [<8025a98c>] [<8029ed88>] [<80267130>]
[<8029fd34>] [<8026706c>] [<80267130>] [<802657f8>] [<80265a20>] [<8025a484>]
[<c01ce2a8>] [<802657f8>] [<802657f8>] [<8025a98c>] [<8025a948>] ...
Warning (Oops_trace_line): garbage '...' at end of trace line ignored
Code: 8c500008 ac400008 02002021 <8c820074> 10510009 8e100000 c0830074 00711023 e0820074
>>RA; 000000008024b094 <skb_release_data+b0/bc>
>>$13; 0000000080323858 <init_task_union+1858/2000>
>>$14; 0000000080323804 <init_task_union+1804/2000>
>>$28; 0000000080322000 <init_task_union+0/2000>
>>$29; 0000000080323a28 <init_task_union+1a28/2000>
>>$31; 000000008024b094 <skb_release_data+b0/bc>
>>PC; 000000008024af6c <skb_drop_fraglist+34/74> <=====
Trace; 000000008024b094 <skb_release_data+b0/bc>
Trace; 000000008024b7cc <skb_linearize+c4/14c>
Trace; 000000008024b7b0 <skb_linearize+a8/14c>
Trace; 00000000802501d4 <dev_queue_xmit+50/3b8>
Trace; 000000008026a9e8 <ip_finish_output2+ec/150>
Trace; 000000008026a184 <ip_fragment+240/500>
Trace; 000000008026a30c <ip_fragment+3c8/500>
Trace; 000000008026a1dc <ip_fragment+298/500>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008029c418 <ip_refrag+68/74>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008025a484 <nf_iterate+94/114>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008025a948 <nf_hook_slow+128/1f8>
Trace; 00000000802da0e0 <memset+0/1c>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008026a8d4 <ip_finish_output+1a0/1a4>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008026a30c <ip_fragment+3c8/500>
Trace; 000000008026a184 <ip_fragment+240/500>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 00000000802671b0 <ip_forward_finish+90/a0>
Trace; 000000008026a744 <ip_finish_output+10/1a4>
Trace; 000000008025a98c <nf_hook_slow+16c/1f8>
Trace; 000000008029ed88 <ip_ct_refresh+84/b8>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 000000008029fd34 <icmp_packet+98/9c>
Trace; 000000008026706c <__gnu_compiled_c+26c/320>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 0000000080265a20 <ip_rcv_finish+238/2a8>
Trace; 000000008025a484 <nf_iterate+94/114>
Trace; 00000000c01ce2a8 <END_OF_CODE+3fe3baa8/????>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 000000008025a98c <nf_hook_slow+16c/1f8>
Trace; 000000008025a948 <nf_hook_slow+128/1f8>
Code; 000000008024af60 <skb_drop_fraglist+28/74>
00000000 <_PC>:
Code; 000000008024af60 <skb_drop_fraglist+28/74>
0: 8c500008 lw s0,8(v0)
Code; 000000008024af64 <skb_drop_fraglist+2c/74>
4: ac400008 sw zero,8(v0)
Code; 000000008024af68 <skb_drop_fraglist+30/74>
8: 02002021 move a0,s0
Code; 000000008024af6c <skb_drop_fraglist+34/74> <=====
c: 8c820074 lw v0,116(a0) <=====
Code; 000000008024af70 <skb_drop_fraglist+38/74>
10: 10510009 beq v0,s1,38 <_PC+0x38>
Code; 000000008024af74 <skb_drop_fraglist+3c/74>
14: 8e100000 lw s0,0(s0)
Code; 000000008024af78 <skb_drop_fraglist+40/74>
18: c0830074 ll v1,116(a0)
Code; 000000008024af7c <skb_drop_fraglist+44/74>
1c: 00711023 subu v0,v1,s1
Code; 000000008024af80 <skb_drop_fraglist+48/74>
20: e0820074 sc v0,116(a0)
Kernel panic: Aiee, killing interrupt handler!
1 warning issued. Results may not be reliable.
[-- Attachment #3: recent.cap.oops --]
[-- Type: application/octet-stream, Size: 5334 bytes --]
ksymoops 2.4.9 on i686 2.4.22-1.2115.nptl. Options used
-v /home/amd/project/amd/kernel/vmlinux (default)
-K (specified)
-l /proc/modules (default)
-o /home/amd/project/amd/filesystem/usr/lib/modules/ (default)
-m /home/amd/project/amd/kernel/System.map (default)
-t elf32-littlemips -a mips:4600
No modules in ksyms, skipping objects
No ksyms, skipping lsmod
Unable to handle kernel paging request at virtual address 04000460, epc == 8024b20c, ra == 802c49f8
Oops in fault.c::do_page_fault, line 206:
$0 : 00000000 00000000 00000000 00000001 8b783580 00000000 04000460 00000001
$8 : 00000000 00000000 00000002 d3d0b000 80323b68 00000000 80323d60 7b7a7978
$16: 812beb20 812beb20 ffffffff 8bb0d800 803a0804 00000000 00000002 80323e10
$24: 00000000 2b00ac70 80322000 80323ad0 00002401 802c49f8
Hi : 00002091
Lo : d691285e
epc : 8024b20c Not tainted
Status: 1000fc03
Cause : 00800008
Process swapper (pid: 0, stackpage=80322000)
Stack: 00000000 8bb0d800 803a0804 00000000 812beb20 802c49f8 80107c28
00000000 00000000 00000000 812beb20 8124fc68 8b6af5a0 803a0800 00000004
80250088 00000000 00000000 00000000 00000000 812b6560 803a0800 8b6af5a0
803a0800 00000000 8025c3e0 00000000 00000000 80323c18 80369bf0 8034d7e8
803a0800 00000000 8025037c 8029c3ec 00000000 8b783580 8b6af5a0 0000000e
8b6af5a0 ...
Call Trace: [<802c49f8>] [<80107c28>] [<80250088>] [<8025c3e0>] [<8025037c>]
[<8029c3ec>] [<802573a8>] [<8025a484>] [<8026a90c>] [<8026a9e8>] [<8026a90c>]
[<8025a98c>] [<8025a948>] [<8026a90c>] [<802a3d98>] [<80267130>] [<8026a8d4>]
[<8026a90c>] [<802671c0>] [<80267130>] [<8025a98c>] [<8029cf50>] [<80267130>]
[<8029fd04>] [<8026706c>] [<80267130>] [<802657f8>] [<80265a20>] [<8025a484>]
[<c01ce2a8>] [<802657f8>] [<802657f8>] [<8025a98c>] [<8025a948>] [<802657f8>]
[<802655a0>] [<802657f8>] [<80250d48>] [<802e01f4>] [<80107c28>] ...
Warning (Oops_trace_line): garbage '...' at end of trace line ignored
Code: 8e06009c 10c0000e 24030001 <8cc20000> c0450000 00a32023 e0440000 1080fffc 00a32023
>>RA; 00000000802c49f8 <packet_rcv_spkt+29c/2b0>
>>$12; 0000000080323b68 <init_task_union+1b68/2000>
>>$14; 0000000080323d60 <init_task_union+1d60/2000>
>>$23; 0000000080323e10 <init_task_union+1e10/2000>
>>$28; 0000000080322000 <init_task_union+0/2000>
>>$29; 0000000080323ad0 <init_task_union+1ad0/2000>
>>$31; 00000000802c49f8 <packet_rcv_spkt+29c/2b0>
>>PC; 000000008024b20c <__kfree_skb+a4/130> <=====
Trace; 00000000802c49f8 <packet_rcv_spkt+29c/2b0>
Trace; 0000000080107c28 <do_gettimeofday+58/114>
Trace; 0000000080250088 <dev_queue_xmit_nit+bc/110>
Trace; 000000008025c3e0 <__gnu_compiled_c+70/14c>
Trace; 000000008025037c <dev_queue_xmit+1f8/3b8>
Trace; 000000008029c3ec <ip_refrag+3c/74>
Trace; 00000000802573a8 <neigh_resolve_output+1fc/29c>
Trace; 000000008025a484 <nf_iterate+94/114>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008026a9e8 <ip_finish_output2+ec/150>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008025a98c <nf_hook_slow+16c/1f8>
Trace; 000000008025a948 <nf_hook_slow+128/1f8>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 00000000802a3d98 <ipt_local_out_hook+4/8c>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 000000008026a8d4 <ip_finish_output+1a0/1a4>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 00000000802671c0 <ip_options_build+0/0>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 000000008025a98c <nf_hook_slow+16c/1f8>
Trace; 000000008029cf50 <death_by_timeout+3c/a8>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 000000008029fd04 <icmp_packet+68/9c>
Trace; 000000008026706c <__gnu_compiled_c+26c/320>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 0000000080265a20 <ip_rcv_finish+238/2a8>
Trace; 000000008025a484 <nf_iterate+94/114>
Trace; 00000000c01ce2a8 <END_OF_CODE+3fe3baa8/????>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 000000008025a98c <nf_hook_slow+16c/1f8>
Trace; 000000008025a948 <nf_hook_slow+128/1f8>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 00000000802655a0 <ip_rcv+510/578>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 0000000080250d48 <netif_receive_skb+270/2c0>
Trace; 00000000802e01f4 <au1000_IRQ+134/1a0>
Trace; 0000000080107c28 <do_gettimeofday+58/114>
Code; 000000008024b200 <__kfree_skb+98/130>
00000000 <_PC>:
Code; 000000008024b200 <__kfree_skb+98/130>
0: 8e06009c lw a2,156(s0)
Code; 000000008024b204 <__kfree_skb+9c/130>
4: 10c0000e beqz a2,40 <_PC+0x40>
Code; 000000008024b208 <__kfree_skb+a0/130>
8: 24030001 li v1,1
Code; 000000008024b20c <__kfree_skb+a4/130> <=====
c: 8cc20000 lw v0,0(a2) <=====
Code; 000000008024b210 <__kfree_skb+a8/130>
10: c0450000 ll a1,0(v0)
Code; 000000008024b214 <__kfree_skb+ac/130>
14: 00a32023 subu a0,a1,v1
Code; 000000008024b218 <__kfree_skb+b0/130>
18: e0440000 sc a0,0(v0)
Code; 000000008024b21c <__kfree_skb+b4/130>
1c: 1080fffc beqz a0,10 <_PC+0x10>
Code; 000000008024b220 <__kfree_skb+b8/130>
20: 00a32023 subu a0,a1,v1
Kernel panic: Aiee, killing interrupt handler!
1 warning issued. Results may not be reliable.
[-- Attachment #4: recent.cap_recv.oops --]
[-- Type: application/octet-stream, Size: 5074 bytes --]
ksymoops 2.4.9 on i686 2.4.22-1.2115.nptl. Options used
-v /home/amd/project/amd/kernel/vmlinux (default)
-K (specified)
-l /proc/modules (default)
-o /home/amd/project/amd/filesystem/usr/lib/modules/ (default)
-m /home/amd/project/amd/kernel/System.map (default)
-t elf32-littlemips -a mips:4600
No modules in ksyms, skipping objects
No ksyms, skipping lsmod
Unable to handle kernel paging request at virtual address 00003260, epc == 8024b20c, ra == 802c49f8
Oops in fault.c::do_page_fault, line 206:
$0 : 00000000 00000000 00000000 00000001 8b780760 00000000 00003260 00000001
$8 : 00000000 00000000 00000002 d3d0b000 c0115000 000014b8 8b9bfd28 7b7a7978
$16: 8b6b5460 8b6b5460 ffffffff 8b90f800 803a0804 00000000 00000002 8b9bfdd8
$24: 00000000 2acad550 8b9be000 8b9bfa98 0000479d 802c49f8
Hi : 00002361
Lo : 7650f108
epc : 8024b20c Not tainted
Status: 1000fc03
Cause : 00800008
Process voslog (pid: 134, stackpage=8b9be000)
Stack: 00000000 8b90f800 803a0804 00000000 8b6b5460 802c49f8 80107c28
00000000 00000000 00000000 8b6b5460 8124fc68 812bed00 803a0800 00000004
80250088 00000000 00000000 8029d380 00000000 812b6560 803a0800 812bed00
803a0800 00000000 8025c3e0 8026a90c 00000003 00000002 8029c3ac 8034d7e8
803a0800 00000000 8025037c 8029c3ec 00000000 8b780760 812bed00 0000000e
812bed00 ...
Call Trace: [<802c49f8>] [<80107c28>] [<80250088>] [<8029d380>] [<8025c3e0>]
[<8026a90c>] [<8029c3ac>] [<8025037c>] [<8029c3ec>] [<802573a8>] [<8025a484>]
[<8026a90c>] [<8026a9e8>] [<8026a90c>] [<8025a98c>] [<8025a948>] [<8026a90c>]
[<802a3d98>] [<80267130>] [<8026a8d4>] [<8026a90c>] [<802671c0>] [<80267130>]
[<8025a98c>] [<80267130>] [<8029fd34>] [<8026706c>] [<80267130>] [<802657f8>]
[<80265a20>] [<8025a484>] [<c01ce2a8>] [<802657f8>] [<802657f8>] [<8025a98c>]
[<8025a948>] [<802657f8>] [<802655a0>] [<802657f8>] [<8010133c>] ...
Warning (Oops_trace_line): garbage '...' at end of trace line ignored
Code: 8e06009c 10c0000e 24030001 <8cc20000> c0450000 00a32023 e0440000 1080fffc 00a32023
>>RA; 00000000802c49f8 <packet_rcv_spkt+29c/2b0>
>>$31; 00000000802c49f8 <packet_rcv_spkt+29c/2b0>
>>PC; 000000008024b20c <__kfree_skb+a4/130> <=====
Trace; 00000000802c49f8 <packet_rcv_spkt+29c/2b0>
Trace; 0000000080107c28 <do_gettimeofday+58/114>
Trace; 0000000080250088 <dev_queue_xmit_nit+bc/110>
Trace; 000000008029d380 <__ip_conntrack_confirm+238/2c8>
Trace; 000000008025c3e0 <__gnu_compiled_c+70/14c>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008029c3ac <ip_confirm+48/4c>
Trace; 000000008025037c <dev_queue_xmit+1f8/3b8>
Trace; 000000008029c3ec <ip_refrag+3c/74>
Trace; 00000000802573a8 <neigh_resolve_output+1fc/29c>
Trace; 000000008025a484 <nf_iterate+94/114>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008026a9e8 <ip_finish_output2+ec/150>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008025a98c <nf_hook_slow+16c/1f8>
Trace; 000000008025a948 <nf_hook_slow+128/1f8>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 00000000802a3d98 <ipt_local_out_hook+4/8c>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 000000008026a8d4 <ip_finish_output+1a0/1a4>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 00000000802671c0 <ip_options_build+0/0>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 000000008025a98c <nf_hook_slow+16c/1f8>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 000000008029fd34 <icmp_packet+98/9c>
Trace; 000000008026706c <__gnu_compiled_c+26c/320>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 0000000080265a20 <ip_rcv_finish+238/2a8>
Trace; 000000008025a484 <nf_iterate+94/114>
Trace; 00000000c01ce2a8 <END_OF_CODE+3fe3baa8/????>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 000000008025a98c <nf_hook_slow+16c/1f8>
Trace; 000000008025a948 <nf_hook_slow+128/1f8>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 00000000802655a0 <ip_rcv+510/578>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 000000008010133c <do_IRQ+f4/118>
Code; 000000008024b200 <__kfree_skb+98/130>
00000000 <_PC>:
Code; 000000008024b200 <__kfree_skb+98/130>
0: 8e06009c lw a2,156(s0)
Code; 000000008024b204 <__kfree_skb+9c/130>
4: 10c0000e beqz a2,40 <_PC+0x40>
Code; 000000008024b208 <__kfree_skb+a0/130>
8: 24030001 li v1,1
Code; 000000008024b20c <__kfree_skb+a4/130> <=====
c: 8cc20000 lw v0,0(a2) <=====
Code; 000000008024b210 <__kfree_skb+a8/130>
10: c0450000 ll a1,0(v0)
Code; 000000008024b214 <__kfree_skb+ac/130>
14: 00a32023 subu a0,a1,v1
Code; 000000008024b218 <__kfree_skb+b0/130>
18: e0440000 sc a0,0(v0)
Code; 000000008024b21c <__kfree_skb+b4/130>
1c: 1080fffc beqz a0,10 <_PC+0x10>
Code; 000000008024b220 <__kfree_skb+b8/130>
20: 00a32023 subu a0,a1,v1
Kernel panic: Aiee, killing interrupt handler!
1 warning issued. Results may not be reliable.
[-- Attachment #5: recent.cap_send.oops --]
[-- Type: application/octet-stream, Size: 5205 bytes --]
ksymoops 2.4.9 on i686 2.4.22-1.2115.nptl. Options used
-v /home/amd/project/amd/kernel/vmlinux (default)
-K (specified)
-l /proc/modules (default)
-o /home/amd/project/amd/filesystem/usr/lib/modules/ (default)
-m /home/amd/project/amd/kernel/System.map (default)
-t elf32-littlemips -a mips:4600
No modules in ksyms, skipping objects
No ksyms, skipping lsmod
Unable to handle kernel paging request at virtual address 000032d4, epc == 8024af6c, ra == 8024b094
Oops in fault.c::do_page_fault, line 206:
$0 : 00000000 1000fc00 8ac81e00 00003260 00003260 00000000 00000000 8b38b340
$8 : 00000030 802da1a0 00000010 bfbebdbc a3a2a1a0 00000000 8ab79de8 a7a6a5a4
$16: 00003260 00000001 8aea8260 c017294c 0000000f 8024b178 c0167ab8 c0172950
$24: 00000010 0040e0f0 8ab78000 8ab79a68 c01727d8 8024b094
Hi : 00000000
Lo : 0000000b
epc : 8024af6c Not tainted
Status: 1000fc03
Cause : 00800008
Process mdm-wipro-no-de (pid: 410, stackpage=8ab78000)
Stack: 8ab79ad8 80369bf0 00000004 8025a484 8b6b5460 8b6b5460 8024b094
fffbc473 8026a90c 803a0400 812bea80 803a0400 8b6b5460 8b38b360 8024b0c4
00000000 00000002 000040d2 802da0e0 8ab79c58 8b6b5460 8024b298 812b6460
803a0400 803a0400 8ab79ad8 8b6b5460 c0171f58 812bebc0 803906a8 00000020
8024ae38 8b6b5780 8aac40f6 8b428d60 00000000 812bebc0 8aac0010 8aea8260
000040d2 ...
Call Trace: [<8025a484>] [<8024b094>] [<8026a90c>] [<8024b0c4>] [<802da0e0>]
[<8024b298>] [<c0171f58>] [<8024ae38>] [<802d9d80>] [<c0171e10>] [<8026a90c>]
[<c0172414>] [<c01740e8>] [<8025a484>] [<8026a90c>] [<8026a90c>] [<8025a948>]
[<802da0e0>] [<8026a90c>] [<c01751dc>] [<8026a8d4>] [<8026a90c>] [<8026a30c>]
[<8026a184>] [<80267130>] [<802671b0>] [<8026a744>] [<8025a98c>] [<80267130>]
[<8026706c>] [<80267130>] [<802657f8>] [<80265a20>] [<8025a484>] [<c01ce2a8>]
[<802657f8>] [<802657f8>] [<8025a98c>] [<8025a948>] [<802657f8>] ...
Warning (Oops_trace_line): garbage '...' at end of trace line ignored
Code: 8c500008 ac400008 02002021 <8c820074> 10510009 8e100000 c0830074 00711023 e0820074
>>RA; 000000008024b094 <skb_release_data+b0/bc>
>>$9; 00000000802da1a0 <memset_partial+24/6c>
>>$21; 000000008024b178 <__kfree_skb+10/130>
>>$31; 000000008024b094 <skb_release_data+b0/bc>
>>PC; 000000008024af6c <skb_drop_fraglist+34/74> <=====
Trace; 000000008025a484 <nf_iterate+94/114>
Trace; 000000008024b094 <skb_release_data+b0/bc>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008024b0c4 <kfree_skbmem+24/c8>
Trace; 00000000802da0e0 <memset+0/1c>
Trace; 000000008024b298 <skb_clone+0/250>
Trace; 00000000c0171f58 <END_OF_CODE+3fddf758/????>
Trace; 000000008024ae38 <alloc_skb+160/260>
Trace; 00000000802d9d80 <memcpy+0/4>
Trace; 00000000c0171e10 <END_OF_CODE+3fddf610/????>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 00000000c0172414 <END_OF_CODE+3fddfc14/????>
Trace; 00000000c01740e8 <END_OF_CODE+3fde18e8/????>
Trace; 000000008025a484 <nf_iterate+94/114>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008025a948 <nf_hook_slow+128/1f8>
Trace; 00000000802da0e0 <memset+0/1c>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 00000000c01751dc <END_OF_CODE+3fde29dc/????>
Trace; 000000008026a8d4 <ip_finish_output+1a0/1a4>
Trace; 000000008026a90c <ip_finish_output2+10/150>
Trace; 000000008026a30c <ip_fragment+3c8/500>
Trace; 000000008026a184 <ip_fragment+240/500>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 00000000802671b0 <ip_forward_finish+90/a0>
Trace; 000000008026a744 <ip_finish_output+10/1a4>
Trace; 000000008025a98c <nf_hook_slow+16c/1f8>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 000000008026706c <__gnu_compiled_c+26c/320>
Trace; 0000000080267130 <ip_forward_finish+10/a0>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 0000000080265a20 <ip_rcv_finish+238/2a8>
Trace; 000000008025a484 <nf_iterate+94/114>
Trace; 00000000c01ce2a8 <END_OF_CODE+3fe3baa8/????>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Trace; 000000008025a98c <nf_hook_slow+16c/1f8>
Trace; 000000008025a948 <nf_hook_slow+128/1f8>
Trace; 00000000802657f8 <ip_rcv_finish+10/2a8>
Code; 000000008024af60 <skb_drop_fraglist+28/74>
00000000 <_PC>:
Code; 000000008024af60 <skb_drop_fraglist+28/74>
0: 8c500008 lw s0,8(v0)
Code; 000000008024af64 <skb_drop_fraglist+2c/74>
4: ac400008 sw zero,8(v0)
Code; 000000008024af68 <skb_drop_fraglist+30/74>
8: 02002021 move a0,s0
Code; 000000008024af6c <skb_drop_fraglist+34/74> <=====
c: 8c820074 lw v0,116(a0) <=====
Code; 000000008024af70 <skb_drop_fraglist+38/74>
10: 10510009 beq v0,s1,38 <_PC+0x38>
Code; 000000008024af74 <skb_drop_fraglist+3c/74>
14: 8e100000 lw s0,0(s0)
Code; 000000008024af78 <skb_drop_fraglist+40/74>
18: c0830074 ll v1,116(a0)
Code; 000000008024af7c <skb_drop_fraglist+44/74>
1c: 00711023 subu v0,v1,s1
Code; 000000008024af80 <skb_drop_fraglist+48/74>
20: e0820074 sc v0,116(a0)
Kernel panic: Aiee, killing interrupt handler!
1 warning issued. Results may not be reliable.
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Unable to handle kernel paging request at virtual address 04000460
2005-06-01 11:31 Unable to handle kernel paging request at virtual address 04000460 raghunathan.venkatesan
@ 2005-06-01 18:54 ` David S. Miller
0 siblings, 0 replies; 5+ messages in thread
From: David S. Miller @ 2005-06-01 18:54 UTC (permalink / raw)
To: raghunathan.venkatesan; +Cc: linux-net, netdev, linux
Please don't ask the community to debug your custom kernel with
private VPN driver modules installed.
^ permalink raw reply [flat|nested] 5+ messages in thread
* RE: Unable to handle kernel paging request at virtual address 04000460
@ 2005-06-02 3:50 raghunathan.venkatesan
2005-06-02 17:44 ` Stephen Hemminger
0 siblings, 1 reply; 5+ messages in thread
From: raghunathan.venkatesan @ 2005-06-02 3:50 UTC (permalink / raw)
To: davem; +Cc: linux-net, netdev, linux
Hi David,
I understand that the linux community may not be able to debug it for
me. All I require is if people have seen similar problems (the problems
we face are w.r.t to kfree_skb and skb_drop_fraglist crashing due to
some reason, which could be a Memory Management issue or some thing we
are not aware of), then let us know the patches, so that we can try them
out here.
Thankyou for your response.
Regards,
Raghu
-----Original Message-----
From: David S. Miller [mailto:davem@davemloft.net]
Sent: Thursday, June 02, 2005 12:25 AM
To: Raghunathan Venkatesan (WT01 - EMBEDDED & PRODUCT ENGINEERING
SOLUTIONS)
Cc: linux-net@vger.kernel.org; netdev@oss.sgi.com; linux@der-keiler.de
Subject: Re: Unable to handle kernel paging request at virtual address
04000460
Please don't ask the community to debug your custom kernel with private
VPN driver modules installed.
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Unable to handle kernel paging request at virtual address 04000460
2005-06-02 3:50 raghunathan.venkatesan
@ 2005-06-02 17:44 ` Stephen Hemminger
0 siblings, 0 replies; 5+ messages in thread
From: Stephen Hemminger @ 2005-06-02 17:44 UTC (permalink / raw)
To: raghunathan.venkatesan; +Cc: davem, linux-net, netdev, linux
On Thu, 2 Jun 2005 09:20:21 +0530
<raghunathan.venkatesan@wipro.com> wrote:
> Hi David,
> I understand that the linux community may not be able to debug it for
> me. All I require is if people have seen similar problems (the problems
> we face are w.r.t to kfree_skb and skb_drop_fraglist crashing due to
> some reason, which could be a Memory Management issue or some thing we
> are not aware of), then let us know the patches, so that we can try them
> out here.
Turn on Debug memory allocations, spinlock debugging, sleep-inside-spinlock
checking, and preempt, it will help your debugging. If you are not building
your own kernel from source learn how.
You are probably freeing memory twice, or not doing ref counting properly
or other locking issues. Since it is your code, good luck debugging it,
if you want the community help it needs to be open source code that
is available for download or be in the kernel.org kernel.
^ permalink raw reply [flat|nested] 5+ messages in thread
* RE: Unable to handle kernel paging request at virtual address 04000460
@ 2005-06-03 2:58 raghunathan.venkatesan
0 siblings, 0 replies; 5+ messages in thread
From: raghunathan.venkatesan @ 2005-06-03 2:58 UTC (permalink / raw)
To: shemminger; +Cc: davem, linux-net, netdev, linux
Hi Stephen,
I appreciate you response.
We'll get deeper into the problem after turning on these debugs.
Thanks,
Raghu
-----Original Message-----
From: Stephen Hemminger [mailto:shemminger@osdl.org]
Sent: Thursday, June 02, 2005 11:14 PM
To: Raghunathan Venkatesan (WT01 - EMBEDDED & PRODUCT ENGINEERING
SOLUTIONS)
Cc: davem@davemloft.net; linux-net@vger.kernel.org; netdev@oss.sgi.com;
linux@der-keiler.de
Subject: Re: Unable to handle kernel paging request at virtual address
04000460
On Thu, 2 Jun 2005 09:20:21 +0530
<raghunathan.venkatesan@wipro.com> wrote:
> Hi David,
> I understand that the linux community may not be able to debug it for
> me. All I require is if people have seen similar problems (the
> problems we face are w.r.t to kfree_skb and skb_drop_fraglist crashing
> due to some reason, which could be a Memory Management issue or some
> thing we are not aware of), then let us know the patches, so that we
> can try them out here.
Turn on Debug memory allocations, spinlock debugging,
sleep-inside-spinlock checking, and preempt, it will help your
debugging. If you are not building your own kernel from source learn
how.
You are probably freeing memory twice, or not doing ref counting
properly or other locking issues. Since it is your code, good luck
debugging it, if you want the community help it needs to be open source
code that is available for download or be in the kernel.org kernel.
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2005-06-03 2:58 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2005-06-01 11:31 Unable to handle kernel paging request at virtual address 04000460 raghunathan.venkatesan
2005-06-01 18:54 ` David S. Miller
-- strict thread matches above, loose matches on Subject: below --
2005-06-02 3:50 raghunathan.venkatesan
2005-06-02 17:44 ` Stephen Hemminger
2005-06-03 2:58 raghunathan.venkatesan
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).