* [AX25] kernel panic
@ 2008-03-18 10:44 Bernard Pidoux F6BVP
2008-03-18 21:25 ` Francois Romieu
0 siblings, 1 reply; 29+ messages in thread
From: Bernard Pidoux F6BVP @ 2008-03-18 10:44 UTC (permalink / raw)
To: Linux Netdev List
Hi,
I used netconsole to document a kernel panic related to AX25 on one of
my systems.
This occurs systematically as soon as I close an AX25 session
established through a level 3 ROSE network (FPAC) via AXUDP link (ax25ipd).
It is not triggered when connecting locally or via AX25 call through LAN.
This is observed with kernel-2.6.24.2 and -3 with most recent AX25
patches applied.
Bernard Pidoux
BUG: unable to handle kernel paging request at virtual address 6b6b6c2b
printing eip: c0139585 *pde = 00000000
Oops: 0002 [#1]
Modules linked in: netconsole configfs rose netrom mkiss crc16 ax25 mga
drm nfsd exportfs nfs lockd nfs_acl sunrpc af_packet ipv6 snd_seq_dummy
snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss snd_mixer_oss
binfmt_misc loop floppy usbhid snd_ens1371 snd_rawmidi snd_seq_device
snd_ac97_codec snd_pcm uhci_hcd snd_timer snd soundcore snd_page_alloc
usbcore ne2k_pci intel_agp ac97_bus ide_cd 8390 agpgart ext3 jbd
ide_disk piix ide_core
Pid: 3527, comm: ax25ipd Not tainted (2.6.24.2 #2)
EIP: 0060:[<c0139585>] EFLAGS: 00010012 CPU: 0
EIP is at __lock_acquire+0x65/0x11d0
EAX: 00000012 EBX: 00000001 ECX: c7670068 EDX: 00000002
ESI: 00000000 EDI: 6b6b6b6b EBP: c6bf5bc0 ESP: c6bf5b38
DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 0068
Process ax25ipd (pid: 3527, ti=c6bf4000 task=c60251d0 task.ti=c6bf4000)
Stack: 0000580b 00000000 02c059e8 00000000 c04f73d8 02c059e8 00000000
c6bf5be4
c01397d8 00000001 c017ecc0 00000000 00000002 00000000 c7670068
c60251d0
0000580b 00000000 02c059d1 00000000 c04f3ce0 00000002 00000000
c75290f8
Call Trace:
[<c010513a>] show_trace_log_lvl+0x1a/0x30
[<c01051f9>] show_stack_log_lvl+0xa9/0xd0
[<c01052e6>] show_registers+0xc6/0x1b0
[<c01054b5>] die+0xe5/0x220
[<c011244f>] do_page_fault+0x15f/0x610
[<c02c2cfa>] error_code+0x6a/0x70
[<c013a773>] lock_acquire+0x83/0xa0
[<c02c2abe>] _spin_lock_irqsave+0x3e/0x70
[<c011458b>] __wake_up+0x1b/0x50
[<c024d56c>] sock_def_write_space+0x9c/0xc0
[<c024d96a>] sock_wfree+0x3a/0x40
[<c024fb61>] skb_release_all+0x51/0x120
[<c024f30b>] __kfree_skb+0xb/0x90
[<c024f3a9>] kfree_skb+0x19/0x30
[<c8c19e03>] ax25_frames_acked+0x43/0x70 [ax25]
[<c8c17a10>] ax25_check_iframes_acked+0x40/0x60 [ax25]
[<c8c1946f>] ax25_std_frame_in+0x6af/0x890 [ax25]
[<c8c16dba>] ax25_kiss_rcv+0x2ba/0x7b0 [ax25]
[<c0254e89>] netif_receive_skb+0x379/0x470
[<c0257a85>] process_backlog+0x75/0xe0
[<c025759b>] net_rx_action+0x12b/0x1d0
[<c011d595>] __do_softirq+0x55/0xc0
[<c011d647>] do_softirq+0x47/0x50
[<c011d9f5>] local_bh_enable_ip+0x95/0xe0
[<c02c24b5>] _spin_unlock_bh+0x25/0x30
[<c8c0c6b0>] mkiss_receive_buf+0x360/0x420 [mkiss]
[<c020e077>] pty_write+0x47/0x60
[<c020b642>] write_chan+0x222/0x330
[<c0208d06>] tty_write+0x126/0x1b0
[<c01727ff>] vfs_write+0xaf/0x120
[<c0172d4d>] sys_write+0x3d/0x70
[<c010412a>] sysenter_past_esp+0x5f/0xa5
=======================
Code: 00 9c 58 f6 c4 02 0f 85 52 06 00 00 83 fe 07 0f 87 7b 06 00 00 85
f6 0f 85 fe 03 00 00 8b 4d b0 8b 79 04 85 ff 0f 84 f0 03 00 00 <ff> 87
c0 00 00 00 89 f8 e8 ce c9 ff ff 85 c0 0f 85 d6 02 00 00
EIP: [<c0139585>] __lock_acquire+0x65/0x11d0 SS:ESP 0068:c6bf5b38
Kernel panic - not syncing: Fatal exception in interrupt
^ permalink raw reply [flat|nested] 29+ messages in thread* Re: [AX25] kernel panic 2008-03-18 10:44 [AX25] kernel panic Bernard Pidoux F6BVP @ 2008-03-18 21:25 ` Francois Romieu 2008-03-19 7:36 ` Bernard Pidoux F6BVP 0 siblings, 1 reply; 29+ messages in thread From: Francois Romieu @ 2008-03-18 21:25 UTC (permalink / raw) To: Bernard Pidoux F6BVP; +Cc: Linux Netdev List Bernard Pidoux F6BVP <f6bvp@free.fr> : [...] > I used netconsole to document a kernel panic related to AX25 on one of my > systems. > This occurs systematically as soon as I close an AX25 session established > through a level 3 ROSE network (FPAC) via AXUDP link (ax25ipd). > It is not triggered when connecting locally or via AX25 call through LAN. May be replacing netif_rx() in drivers/net/hamradio/mkiss.c::ax_bump() by netif_receive_skb() ? -- Ueimor ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-18 21:25 ` Francois Romieu @ 2008-03-19 7:36 ` Bernard Pidoux F6BVP 2008-03-19 20:57 ` Bernard Pidoux 0 siblings, 1 reply; 29+ messages in thread From: Bernard Pidoux F6BVP @ 2008-03-19 7:36 UTC (permalink / raw) To: Francois Romieu; +Cc: Linux Netdev List Francois Romieu wrote: > Bernard Pidoux F6BVP <f6bvp@free.fr> : > [...] >> I used netconsole to document a kernel panic related to AX25 on one of my >> systems. >> This occurs systematically as soon as I close an AX25 session established >> through a level 3 ROSE network (FPAC) via AXUDP link (ax25ipd). >> It is not triggered when connecting locally or via AX25 call through LAN. > > May be replacing netif_rx() in drivers/net/hamradio/mkiss.c::ax_bump() > by netif_receive_skb() ? > Sorry, this does not made it. I replaced netif_rx() by netif_receive_skb(skb) but this gives a worst situation : system is frozen. Thank you for the suggestion. ======================= BUG: soft lockup - CPU#0 stuck for 11s! [ax25ipd:3584] Pid: 3584, comm: ax25ipd Not tainted (2.6.24.3 #7) EIP: 0060:[<c01ed892>] EFLAGS: 00000246 CPU: 0 EIP is at delay_tsc+0x12/0x20 EAX: 7752234b EBX: 00000001 ECX: 7752234b EDX: 00000016 ESI: 087022c8 EDI: 00000000 EBP: c6bb5bc0 ESP: c6bb5bbc DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 CR0: 8005003b CR2: b7dd86f8 CR3: 07960000 CR4: 000000d0 DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 DR6: ffff0ff0 DR7: 00000400 [<c010535a>] show_trace_log_lvl+0x1a/0x30 [<c0105d82>] show_trace+0x12/0x20 [<c01024cc>] show_regs+0x1c/0x20 [<c015555b>] softlockup_tick+0x11b/0x150 [<c0126c12>] run_local_timers+0x12/0x20 [<c012708f>] update_process_times+0x2f/0x60 [<c013a355>] tick_periodic+0x25/0x80 [<c013a3c9>] tick_handle_periodic+0x19/0x80 [<c0107aca>] timer_interrupt+0x4a/0x60 [<c0155928>] handle_IRQ_event+0x28/0x60 [<c015725f>] handle_level_irq+0x7f/0xf0 [<c0106e68>] do_IRQ+0x48/0xa0 [<c0104d16>] common_interrupt+0x2e/0x34 [<c01ed839>] __delay+0x9/0x10 [<c01f15f2>] _raw_spin_lock+0xb2/0x140 [<c02cd350>] _spin_lock_bh+0x50/0x60 [<c8c59e72>] ax_xmit+0x112/0x370 [mkiss] [<c025e947>] dev_hard_start_xmit+0x207/0x270 [<c026f454>] __qdisc_run+0x54/0x1b0 [<c0261226>] dev_queue_xmit+0x266/0x340 [<c8c27a87>] ax25_queue_xmit+0x47/0x70 [ax25] [<c8c27b77>] ax25_transmit_buffer+0xc7/0x110 [ax25] [<c8c27c3d>] ax25_send_iframe+0x7d/0x110 [ax25] [<c8c27d80>] ax25_kick+0xb0/0x1b0 [ax25] [<c8c28e49>] ax25_std_frame_in+0x69/0x890 [ax25] [<c8c26dbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] [<c025e24a>] netif_receive_skb+0x38a/0x480 [<c8c596ab>] mkiss_receive_buf+0x34b/0x420 [mkiss] [<c0219457>] pty_write+0x47/0x60 [<c0216a19>] write_chan+0x229/0x330 [<c021407b>] tty_write+0x12b/0x1c0 [<c017b66f>] vfs_write+0xaf/0x120 [<c017bcbd>] sys_write+0x3d/0x70 [<c010427e>] sysenter_past_esp+0x5f/0xa5 ======================= Regards, Bernard Pidoux ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-19 7:36 ` Bernard Pidoux F6BVP @ 2008-03-19 20:57 ` Bernard Pidoux 2008-03-20 7:30 ` Jarek Poplawski 0 siblings, 1 reply; 29+ messages in thread From: Bernard Pidoux @ 2008-03-19 20:57 UTC (permalink / raw) To: Bernard Pidoux F6BVP; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Bernard Pidoux F6BVP wrote: > > Francois Romieu wrote: >> Bernard Pidoux F6BVP <f6bvp@free.fr> : >> [...] >>> I used netconsole to document a kernel panic related to AX25 on one >>> of my systems. >>> This occurs systematically as soon as I close an AX25 session >>> established through a level 3 ROSE network (FPAC) via AXUDP link >>> (ax25ipd). >>> It is not triggered when connecting locally or via AX25 call through >>> LAN. >> >> May be replacing netif_rx() in drivers/net/hamradio/mkiss.c::ax_bump() >> by netif_receive_skb() ? >> > > Sorry, this does not made it. > I replaced netif_rx() by netif_receive_skb(skb) > but this gives a worst situation : system is frozen. > Thank you for the suggestion. > > ======================= > BUG: soft lockup - CPU#0 stuck for 11s! [ax25ipd:3584] > > Pid: 3584, comm: ax25ipd Not tainted (2.6.24.3 #7) > EIP: 0060:[<c01ed892>] EFLAGS: 00000246 CPU: 0 > EIP is at delay_tsc+0x12/0x20 > EAX: 7752234b EBX: 00000001 ECX: 7752234b EDX: 00000016 > ESI: 087022c8 EDI: 00000000 EBP: c6bb5bc0 ESP: c6bb5bbc > DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 > CR0: 8005003b CR2: b7dd86f8 CR3: 07960000 CR4: 000000d0 > DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 > DR6: ffff0ff0 DR7: 00000400 > [<c010535a>] show_trace_log_lvl+0x1a/0x30 > [<c0105d82>] show_trace+0x12/0x20 > [<c01024cc>] show_regs+0x1c/0x20 > [<c015555b>] softlockup_tick+0x11b/0x150 > [<c0126c12>] run_local_timers+0x12/0x20 > [<c012708f>] update_process_times+0x2f/0x60 > [<c013a355>] tick_periodic+0x25/0x80 > [<c013a3c9>] tick_handle_periodic+0x19/0x80 > [<c0107aca>] timer_interrupt+0x4a/0x60 > [<c0155928>] handle_IRQ_event+0x28/0x60 > [<c015725f>] handle_level_irq+0x7f/0xf0 > [<c0106e68>] do_IRQ+0x48/0xa0 > [<c0104d16>] common_interrupt+0x2e/0x34 > [<c01ed839>] __delay+0x9/0x10 > [<c01f15f2>] _raw_spin_lock+0xb2/0x140 > [<c02cd350>] _spin_lock_bh+0x50/0x60 > [<c8c59e72>] ax_xmit+0x112/0x370 [mkiss] > [<c025e947>] dev_hard_start_xmit+0x207/0x270 > [<c026f454>] __qdisc_run+0x54/0x1b0 > [<c0261226>] dev_queue_xmit+0x266/0x340 > [<c8c27a87>] ax25_queue_xmit+0x47/0x70 [ax25] > [<c8c27b77>] ax25_transmit_buffer+0xc7/0x110 [ax25] > [<c8c27c3d>] ax25_send_iframe+0x7d/0x110 [ax25] > [<c8c27d80>] ax25_kick+0xb0/0x1b0 [ax25] > [<c8c28e49>] ax25_std_frame_in+0x69/0x890 [ax25] > [<c8c26dbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] > [<c025e24a>] netif_receive_skb+0x38a/0x480 > [<c8c596ab>] mkiss_receive_buf+0x34b/0x420 [mkiss] > [<c0219457>] pty_write+0x47/0x60 > [<c0216a19>] write_chan+0x229/0x330 > [<c021407b>] tty_write+0x12b/0x1c0 > [<c017b66f>] vfs_write+0xaf/0x120 > [<c017bcbd>] sys_write+0x3d/0x70 > [<c010427e>] sysenter_past_esp+0x5f/0xa5 > ======================= > > Regards, > > Bernard Pidoux > -- > To unsubscribe from this list: send the line "unsubscribe netdev" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > > I also tried to revert Jarek's mkiss ax_bump() patch, but this did not prevent kernel lockup, although this time swapper is involved and not ax25ipd. Bernard Pidoux BUG: unable to handle kernel paging request at virtual address 6b6b6c2b printing eip: c013fc67 *pde = 00000000 Oops: 0002 [#1] SMP Modules linked in: rose netrom mkiss crc16 ax25 mga netconsole drm configfs nfsd exportfs nfs lockd nfs_acl sunrpc af_packet ipv6 snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss snd_mixer_oss binfmt_misc loop usb_storage scsi_mod floppy usbhid snd_ens1371 snd_rawmidi snd_seq_device snd_ac97_codec snd_pcm snd_timer snd uhci_hcd soundcore usbcore snd_page_alloc ne2k_pci ide_cd ac97_bus intel_agp 8390 agpgart genrtc ext3 jbd ide_disk piix ide_core Pid: 0, comm: swapper Not tainted (2.6.24.3 #7) EIP: 0060:[<c013fc67>] EFLAGS: 00010012 CPU: 0 EIP is at __lock_acquire+0x67/0x1170 EAX: 00000002 EBX: 00000001 ECX: c7657030 EDX: 00000002 ESI: 6b6b6b6b EDI: 00000000 EBP: c0395c84 ESP: c0395c00 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 Process swapper (pid: 0, ti=c0394000 task=c036a3c0 task.ti=c0394000) Stack: 0000600c 00000000 030061f9 00000000 c0514298 030061f9 00000000 c0395ca8 c013fe71 c0395cb0 c013fe71 00000001 000001e2 00000000 00000002 00000000 c7657030 c036a3c0 030061e2 00000000 c0510ba8 030061e2 000001f9 00000002 Call Trace: [<c010535a>] show_trace_log_lvl+0x1a/0x30 [<c0105419>] show_stack_log_lvl+0xa9/0xd0 [<c0105507>] show_registers+0xc7/0x1b0 [<c01056fa>] die+0x10a/0x230 [<c01146f0>] do_page_fault+0x160/0x630 [<c02cdaea>] error_code+0x72/0x78 [<c0140df5>] lock_acquire+0x85/0xa0 [<c02cd79e>] _spin_lock_irqsave+0x3e/0x70 [<c0117c4b>] __wake_up+0x1b/0x50 [<c025689c>] sock_def_write_space+0x9c/0xc0 [<c0256c9c>] sock_wfree+0x3c/0x50 [<c0258ef7>] skb_release_all+0x57/0x130 [<c025868b>] __kfree_skb+0xb/0x90 [<c0258729>] kfree_skb+0x19/0x40 [<c8cc1e23>] ax25_frames_acked+0x43/0x70 [ax25] [<c8cc11db>] ax25_std_frame_in+0x3fb/0x890 [ax25] [<c8cbedbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] [<c025e24a>] netif_receive_skb+0x38a/0x480 [<c0260e9b>] process_backlog+0x7b/0xf0 [<c02609a7>] net_rx_action+0x167/0x210 [<c0122da3>] __do_softirq+0x93/0x120 [<c0122e87>] do_softirq+0x57/0x60 [<c0123235>] irq_exit+0x85/0x90 [<c0106e6d>] do_IRQ+0x4d/0xa0 [<c0104d16>] common_interrupt+0x2e/0x34 [<c0102606>] cpu_idle+0x76/0xa0 [<c02ca6a9>] rest_init+0x49/0x50 [<c0399d75>] start_kernel+0x2d5/0x360 [<00000000>] 0x0 ======================= Code: 9c 58 f6 c4 02 0f 85 ff 05 00 00 83 ff 07 0f 87 28 06 00 00 85 ff 0f 85 ac 03 00 00 8b 4d bc 8b 71 04 85 f6 0f 84 9e 03 00 00 90 <ff> 86 c0 00 00 00 89 f0 e8 bc c8 ff ff 85 c0 0f 85 84 02 00 00 EIP: [<c013fc67>] __lock_acquire+0x67/0x1170 SS:ESP 0068:c0395c00 Kernel panic - not syncing: Fatal exception in interrupt ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-19 20:57 ` Bernard Pidoux @ 2008-03-20 7:30 ` Jarek Poplawski 2008-03-20 22:58 ` Bernard Pidoux 0 siblings, 1 reply; 29+ messages in thread From: Jarek Poplawski @ 2008-03-20 7:30 UTC (permalink / raw) To: Bernard Pidoux Cc: Bernard Pidoux F6BVP, Francois Romieu, Linux Netdev List, Jarek Poplawski On Wed, Mar 19, 2008 at 09:57:18PM +0100, Bernard Pidoux wrote: ... > I also tried to revert Jarek's mkiss ax_bump() patch, but this did not > prevent > kernel lockup, although this time swapper is involved and not ax25ipd. ... > BUG: unable to handle kernel paging request at virtual address 6b6b6c2b > printing eip: c013fc67 *pde = 00000000 > Oops: 0002 [#1] SMP Well, the rest looks very similarly and not trivial... Probably a socket is destructed too soon (or something...). Could you try to reproduce this with some debugging turned off, e.g.: CONFIG_DEBUG_LOCK_ALLOC, CONFIG_DEBUG_PAGEALLOC, (CONFIG_SLUB_DEBUG?). Regards, Jarek P. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-20 7:30 ` Jarek Poplawski @ 2008-03-20 22:58 ` Bernard Pidoux 2008-03-21 0:28 ` Jarek Poplawski ` (2 more replies) 0 siblings, 3 replies; 29+ messages in thread From: Bernard Pidoux @ 2008-03-20 22:58 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek Poplawski wrote: > On Wed, Mar 19, 2008 at 09:57:18PM +0100, Bernard Pidoux wrote: > ... >> I also tried to revert Jarek's mkiss ax_bump() patch, but this did not >> prevent >> kernel lockup, although this time swapper is involved and not ax25ipd. > ... >> BUG: unable to handle kernel paging request at virtual address 6b6b6c2b >> printing eip: c013fc67 *pde = 00000000 >> Oops: 0002 [#1] SMP > > Well, the rest looks very similarly and not trivial... Probably a > socket is destructed too soon (or something...). Could you try to > reproduce this with some debugging turned off, e.g.: > CONFIG_DEBUG_LOCK_ALLOC, CONFIG_DEBUG_PAGEALLOC, (CONFIG_SLUB_DEBUG?). > > Regards, > Jarek P. I recompiled the kernel after turning off the above options. However there is still a kernel panic documented below. Does it help ? Bernard Pidoux BUG: spinlock bad magic on CPU#0, swapper/0 BUG: unable to handle kernel paging request at virtual address 6b6b6c2f printing eip: c01e730b *pde = 00000000 Oops: 0000 [#1] SMP Modules linked in: rose netrom mkiss crc16 ax25 mga drm netconsole configfs nfsd exportfs nfs lockd nfs_acl sunrpc af_packet ipv6 snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss snd_mixer_oss binfmt_misc loop usb_storage scsi_mod floppy usbhid snd_ens1371 snd_rawmidi snd_seq_device snd_ac97_codec snd_pcm snd_timer snd uhci_hcd intel_agp ne2k_pci ide_cd usbcore soundcore snd_page_alloc ac97_bus 8390 agpgart genrtc ext3 jbd ide_disk piix ide_core Pid: 0, comm: swapper Not tainted (2.6.24.3 #8) EIP: 0060:[<c01e730b>] EFLAGS: 00010002 CPU: 0 EIP is at spin_bug+0xdb/0xf0 EAX: 0000002f EBX: 6b6b6b6b ECX: 6b6b6b6b EDX: 00000082 ESI: c07e5a38 EDI: c0333633 EBP: c0379c78 ESP: c0379c54 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 Process swapper (pid: 0, ti=c0378000 task=c0353340 task.ti=c0378000) Stack: c0333724 c0333633 00000000 c0353509 00000000 00000010 c07e5a38 00000001 c7b8abb8 c0379cb0 c01e7409 c11448c8 c1147740 00000000 c11448c0 c0379cb8 c114775c c11448c8 c1147740 00000000 00000282 00000001 c7b8abb8 c0379cbc Call Trace: [<c010527a>] show_trace_log_lvl+0x1a/0x30 [<c0105339>] show_stack_log_lvl+0xa9/0xd0 [<c0105427>] show_registers+0xc7/0x1b0 [<c010561a>] die+0x10a/0x230 [<c0114855>] do_page_fault+0x2f5/0x600 [<c02c039a>] error_code+0x72/0x78 [<c01e7409>] _raw_spin_lock+0x69/0x140 [<c02c01cc>] _spin_lock_irqsave+0xc/0x20 [<c0117c9b>] __wake_up+0x1b/0x50 [<c024badc>] sock_def_write_space+0x9c/0xc0 [<c024bdcc>] sock_wfree+0x3c/0x50 [<c024dfc7>] skb_release_all+0x57/0x130 [<c024d75b>] __kfree_skb+0xb/0x90 [<c024d7f9>] kfree_skb+0x19/0x40 [<c8c49e33>] ax25_frames_acked+0x43/0x70 [ax25] [<c8c47a30>] ax25_check_iframes_acked+0x40/0x60 [ax25] [<c8c4949f>] ax25_std_frame_in+0x6af/0x890 [ax25] [<c8c46dbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] [<c02531eb>] netif_receive_skb+0x33b/0x420 [<c0255c1b>] process_backlog+0x6b/0xd0 [<c025573f>] net_rx_action+0xff/0x1a0 [<c0122864>] __do_softirq+0x84/0x100 [<c012291b>] do_softirq+0x3b/0x50 [<c0122b69>] irq_exit+0x79/0x90 [<c0106d46>] do_IRQ+0x46/0x80 [<c0104c67>] common_interrupt+0x23/0x28 [<c01025f6>] cpu_idle+0x76/0xa0 [<c02bd8e9>] rest_init+0x49/0x50 [<c037dd55>] start_kernel+0x2b5/0x330 [<00000000>] 0x0 ======================= Code: 00 64 8b 0d 08 f0 3a c0 89 44 24 0c 89 4c 24 08 89 54 24 10 89 7c 24 04 c7 04 24 24 37 33 c0 e8 5c 6f f3 ff 85 db 8b 4e 08 74 83 <8b> 93 c4 00 00 00 8d 83 c9 01 00 00 e9 7c ff ff ff 8d 74 26 00 EIP: [<c01e730b>] spin_bug+0xdb/0xf0 SS:ESP 0068:c0379c54 Kernel panic - not syncing: Fatal exception in interrupt ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-20 22:58 ` Bernard Pidoux @ 2008-03-21 0:28 ` Jarek Poplawski 2008-03-21 9:52 ` Bernard Pidoux 2008-03-21 9:40 ` Bernard Pidoux 2008-03-22 11:36 ` Jarek Poplawski 2 siblings, 1 reply; 29+ messages in thread From: Jarek Poplawski @ 2008-03-21 0:28 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Thu, Mar 20, 2008 at 11:58:35PM +0100, Bernard Pidoux wrote: ... > I recompiled the kernel after turning off the above options. > However there is still a kernel panic documented below. > Does it help ? I wanted to see something more on the stack than lockdep's code only. Will see... It seems some memory debugging is still on and doing this poisoning with '6b', but I can't check now what it is. (Sometimes this could omit some warnings). Thanks, Jarek P. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-21 0:28 ` Jarek Poplawski @ 2008-03-21 9:52 ` Bernard Pidoux 2008-03-21 11:22 ` Jarek Poplawski 0 siblings, 1 reply; 29+ messages in thread From: Bernard Pidoux @ 2008-03-21 9:52 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek Poplawski wrote: > On Thu, Mar 20, 2008 at 11:58:35PM +0100, Bernard Pidoux wrote: > ... >> I recompiled the kernel after turning off the above options. >> However there is still a kernel panic documented below. >> Does it help ? > > I wanted to see something more on the stack than lockdep's code only. > Will see... It seems some memory debugging is still on and doing this > poisoning with '6b', but I can't check now what it is. (Sometimes this > could omit some warnings). > > Thanks, > Jarek P. The only difference I can see compared to the original spinlock report is this line : [<c01e7409>] _raw_spin_lock+0x69/0x140 Regards, Bernard P. BUG: spinlock bad magic on CPU#0, ax25ipd/3648 BUG: unable to handle kernel paging request at virtual address 6b6b6c2f printing eip: c01e730b *pde = 00000000 Oops: 0000 [#1] SMP Modules linked in: rose netrom mkiss crc16 ax25 mga drm netconsole configfs nfsd exportfs nfs lockd nfs_acl sunrpc af_packet ipv6 snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss snd_mixer_oss binfmt_misc loop usb_storage scsi_mod floppy usbhid snd_ens1371 snd_rawmidi snd_seq_device snd_ac97_codec snd_pcm snd_timer snd uhci_hcd soundcore snd_page_alloc usbcore ne2k_pci ide_cd 8390 ac97_bus intel_agp agpgart genrtc ext3 jbd ide_disk piix ide_core Pid: 3648, comm: ax25ipd Not tainted (2.6.24.3 #8) EIP: 0060:[<c01e730b>] EFLAGS: 00010002 CPU: 0 EIP is at spin_bug+0xdb/0xf0 EAX: 00000032 EBX: 6b6b6b6b ECX: 6b6b6b6b EDX: 00000096 ESI: c0e4bc30 EDI: c0333633 EBP: c5c7bbc4 ESP: c5c7bba0 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 Process ax25ipd (pid: 3648, ti=c5c7a000 task=c6abec90 task.ti=c5c7a000) Stack: c0333724 c0333633 00000000 c6abee59 00000e40 00000007 c0e4bc30 00000001 c697ebf8 c5c7bbfc c01e7409 00000000 00000001 c0180640 00000000 00000000 00000003 c0a320b8 00000000 c6abec90 00000282 00000001 c697ebf8 c5c7bc08 Call Trace: [<c010527a>] show_trace_log_lvl+0x1a/0x30 [<c0105339>] show_stack_log_lvl+0xa9/0xd0 [<c0105427>] show_registers+0xc7/0x1b0 [<c010561a>] die+0x10a/0x230 [<c0114855>] do_page_fault+0x2f5/0x600 [<c02c039a>] error_code+0x72/0x78 [<c01e7409>] _raw_spin_lock+0x69/0x140 [<c02c01cc>] _spin_lock_irqsave+0xc/0x20 [<c0117c9b>] __wake_up+0x1b/0x50 [<c024badc>] sock_def_write_space+0x9c/0xc0 [<c024bdcc>] sock_wfree+0x3c/0x50 [<c024dfc7>] skb_release_all+0x57/0x130 [<c024d75b>] __kfree_skb+0xb/0x90 [<c024d7f9>] kfree_skb+0x19/0x40 [<c8c49e33>] ax25_frames_acked+0x43/0x70 [ax25] [<c8c47a30>] ax25_check_iframes_acked+0x40/0x60 [ax25] [<c8c4949f>] ax25_std_frame_in+0x6af/0x890 [ax25] [<c8c46dbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] [<c02531eb>] netif_receive_skb+0x33b/0x420 [<c0255c1b>] process_backlog+0x6b/0xd0 [<c025573f>] net_rx_action+0xff/0x1a0 [<c0122864>] __do_softirq+0x84/0x100 [<c012291b>] do_softirq+0x3b/0x50 [<c0122ae5>] local_bh_enable_ip+0x45/0x50 [<c02c0050>] _spin_unlock_bh+0x10/0x20 [<c8c396ca>] mkiss_receive_buf+0x36a/0x420 [mkiss] [<c020f037>] pty_write+0x47/0x60 [<c020c5f9>] write_chan+0x229/0x330 [<c0209c98>] tty_write+0x128/0x1c0 [<c017346f>] vfs_write+0xaf/0x120 [<c0173aad>] sys_write+0x3d/0x70 [<c0104256>] sysenter_past_esp+0x5f/0x85 ======================= Code: 00 64 8b 0d 08 f0 3a c0 89 44 24 0c 89 4c 24 08 89 54 24 10 89 7c 24 04 c7 04 24 24 37 33 c0 e8 5c 6f f3 ff 85 db 8b 4e 08 74 83 <8b> 93 c4 00 00 00 8d 83 c9 01 00 00 e9 7c ff ff ff 8d 74 26 00 EIP: [<c01e730b>] spin_bug+0xdb/0xf0 SS:ESP 0068:c5c7bba0 Kernel panic - not syncing: Fatal exception in interrupt ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-21 9:52 ` Bernard Pidoux @ 2008-03-21 11:22 ` Jarek Poplawski 0 siblings, 0 replies; 29+ messages in thread From: Jarek Poplawski @ 2008-03-21 11:22 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Fri, Mar 21, 2008 at 10:52:27AM +0100, Bernard Pidoux wrote: ... > The only difference I can see compared to the original spinlock report > is this line : > > [<c01e7409>] _raw_spin_lock+0x69/0x140 Bernard, thanks for these reports. I simply need more time to find various places in ax25 which could matter here. Of course any additional information could help, but these reports mostly repeat the same. BTW, I wonder if it's possible to run this command for closing the session which causes the bug with strace?: strace -o strace.log a_command Regards, Jarek P. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-20 22:58 ` Bernard Pidoux 2008-03-21 0:28 ` Jarek Poplawski @ 2008-03-21 9:40 ` Bernard Pidoux 2008-03-22 11:36 ` Jarek Poplawski 2 siblings, 0 replies; 29+ messages in thread From: Bernard Pidoux @ 2008-03-21 9:40 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Hi Jarek, Please ignore the spinlock report I sent in this previous message. I simply forgot to apply back your mkiss ax_bump() patch when doing some trials. After applying again your patch and turning off the debug you asked for, I observe exactly the same spinlock I first reported i.e. involving ax25ipd. Sorry for the confusion. Regards, Bernard Bernard Pidoux wrote: > > Jarek Poplawski wrote: >> On Wed, Mar 19, 2008 at 09:57:18PM +0100, Bernard Pidoux wrote: >> ... >>> I also tried to revert Jarek's mkiss ax_bump() patch, but this did >>> not prevent >>> kernel lockup, although this time swapper is involved and not ax25ipd. >> ... >>> BUG: unable to handle kernel paging request at virtual address 6b6b6c2b >>> printing eip: c013fc67 *pde = 00000000 >>> Oops: 0002 [#1] SMP >> >> Well, the rest looks very similarly and not trivial... Probably a >> socket is destructed too soon (or something...). Could you try to >> reproduce this with some debugging turned off, e.g.: >> CONFIG_DEBUG_LOCK_ALLOC, CONFIG_DEBUG_PAGEALLOC, (CONFIG_SLUB_DEBUG?). >> >> Regards, >> Jarek P. > > I recompiled the kernel after turning off the above options. > However there is still a kernel panic documented below. > Does it help ? > > Bernard Pidoux > > > > BUG: spinlock bad magic on CPU#0, swapper/0 > BUG: unable to handle kernel paging request at virtual address 6b6b6c2f > printing eip: c01e730b *pde = 00000000 > Oops: 0000 [#1] SMP > Modules linked in: rose netrom mkiss crc16 ax25 mga drm netconsole > configfs nfsd exportfs nfs lockd nfs_acl sunrpc af_packet ipv6 > snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss > snd_mixer_oss binfmt_misc loop usb_storage scsi_mod floppy usbhid > snd_ens1371 snd_rawmidi snd_seq_device snd_ac97_codec snd_pcm snd_timer > snd uhci_hcd intel_agp ne2k_pci ide_cd usbcore soundcore snd_page_alloc > ac97_bus 8390 agpgart genrtc ext3 jbd ide_disk piix ide_core > > Pid: 0, comm: swapper Not tainted (2.6.24.3 #8) > EIP: 0060:[<c01e730b>] EFLAGS: 00010002 CPU: 0 > EIP is at spin_bug+0xdb/0xf0 > EAX: 0000002f EBX: 6b6b6b6b ECX: 6b6b6b6b EDX: 00000082 > ESI: c07e5a38 EDI: c0333633 EBP: c0379c78 ESP: c0379c54 > DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 > Process swapper (pid: 0, ti=c0378000 task=c0353340 task.ti=c0378000) > Stack: c0333724 c0333633 00000000 c0353509 00000000 00000010 c07e5a38 > 00000001 > c7b8abb8 c0379cb0 c01e7409 c11448c8 c1147740 00000000 c11448c0 > c0379cb8 > c114775c c11448c8 c1147740 00000000 00000282 00000001 c7b8abb8 > c0379cbc > Call Trace: > [<c010527a>] show_trace_log_lvl+0x1a/0x30 > [<c0105339>] show_stack_log_lvl+0xa9/0xd0 > [<c0105427>] show_registers+0xc7/0x1b0 > [<c010561a>] die+0x10a/0x230 > [<c0114855>] do_page_fault+0x2f5/0x600 > [<c02c039a>] error_code+0x72/0x78 > [<c01e7409>] _raw_spin_lock+0x69/0x140 > [<c02c01cc>] _spin_lock_irqsave+0xc/0x20 > [<c0117c9b>] __wake_up+0x1b/0x50 > [<c024badc>] sock_def_write_space+0x9c/0xc0 > [<c024bdcc>] sock_wfree+0x3c/0x50 > [<c024dfc7>] skb_release_all+0x57/0x130 > [<c024d75b>] __kfree_skb+0xb/0x90 > [<c024d7f9>] kfree_skb+0x19/0x40 > [<c8c49e33>] ax25_frames_acked+0x43/0x70 [ax25] > [<c8c47a30>] ax25_check_iframes_acked+0x40/0x60 [ax25] > [<c8c4949f>] ax25_std_frame_in+0x6af/0x890 [ax25] > [<c8c46dbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] > [<c02531eb>] netif_receive_skb+0x33b/0x420 > [<c0255c1b>] process_backlog+0x6b/0xd0 > [<c025573f>] net_rx_action+0xff/0x1a0 > [<c0122864>] __do_softirq+0x84/0x100 > [<c012291b>] do_softirq+0x3b/0x50 > [<c0122b69>] irq_exit+0x79/0x90 > [<c0106d46>] do_IRQ+0x46/0x80 > [<c0104c67>] common_interrupt+0x23/0x28 > [<c01025f6>] cpu_idle+0x76/0xa0 > [<c02bd8e9>] rest_init+0x49/0x50 > [<c037dd55>] start_kernel+0x2b5/0x330 > [<00000000>] 0x0 > ======================= > Code: 00 64 8b 0d 08 f0 3a c0 89 44 24 0c 89 4c 24 08 89 54 24 10 89 7c > 24 04 c7 04 24 24 37 33 c0 e8 5c 6f f3 ff 85 db 8b 4e 08 74 83 <8b> 93 > c4 00 00 00 8d 83 c9 01 00 00 e9 7c ff ff ff 8d 74 26 00 > EIP: [<c01e730b>] spin_bug+0xdb/0xf0 SS:ESP 0068:c0379c54 > Kernel panic - not syncing: Fatal exception in interrupt > > > -- > To unsubscribe from this list: send the line "unsubscribe netdev" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > > ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-20 22:58 ` Bernard Pidoux 2008-03-21 0:28 ` Jarek Poplawski 2008-03-21 9:40 ` Bernard Pidoux @ 2008-03-22 11:36 ` Jarek Poplawski 2008-03-23 17:00 ` Bernard Pidoux 2 siblings, 1 reply; 29+ messages in thread From: Jarek Poplawski @ 2008-03-22 11:36 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Thu, Mar 20, 2008 at 11:58:35PM +0100, Bernard Pidoux wrote: ... > BUG: spinlock bad magic on CPU#0, swapper/0 > BUG: unable to handle kernel paging request at virtual address 6b6b6c2f > printing eip: c01e730b *pde = 00000000 > Oops: 0000 [#1] SMP ... > Pid: 0, comm: swapper Not tainted (2.6.24.3 #8) > EIP: 0060:[<c01e730b>] EFLAGS: 00010002 CPU: 0 > EIP is at spin_bug+0xdb/0xf0 ... Hi, Bernard, could you try this debugging patch? Thanks, Jarek P. --- diff -Nurp 2.6.24.3-/net/core/sock.c 2.6.24.3+/net/core/sock.c --- 2.6.24.3-/net/core/sock.c 2008-01-24 23:58:37.000000000 +0100 +++ 2.6.24.3+/net/core/sock.c 2008-03-22 12:10:10.000000000 +0100 @@ -1517,14 +1517,21 @@ static void sock_def_write_space(struct * progress. --DaveM */ if ((atomic_read(&sk->sk_wmem_alloc) << 1) <= sk->sk_sndbuf) { - if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) + if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) { + if (!sk->sk_socket || sk->sk_socket->sk != sk) { + WARN_ON_ONCE(1); + sk->sk_socket = NULL; + sk->sk_sleep = NULL; + goto out; + } wake_up_interruptible(sk->sk_sleep); + } /* Should agree with poll, otherwise some programs break */ if (sock_writeable(sk)) sk_wake_async(sk, 2, POLL_OUT); } - +out: read_unlock(&sk->sk_callback_lock); } ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-22 11:36 ` Jarek Poplawski @ 2008-03-23 17:00 ` Bernard Pidoux 2008-03-24 20:51 ` Jarek Poplawski 0 siblings, 1 reply; 29+ messages in thread From: Bernard Pidoux @ 2008-03-23 17:00 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek Poplawski wrote: > On Thu, Mar 20, 2008 at 11:58:35PM +0100, Bernard Pidoux wrote: > ... >> BUG: spinlock bad magic on CPU#0, swapper/0 >> BUG: unable to handle kernel paging request at virtual address 6b6b6c2f >> printing eip: c01e730b *pde = 00000000 >> Oops: 0000 [#1] SMP > ... >> Pid: 0, comm: swapper Not tainted (2.6.24.3 #8) >> EIP: 0060:[<c01e730b>] EFLAGS: 00010002 CPU: 0 >> EIP is at spin_bug+0xdb/0xf0 > ... > > Hi, > > Bernard, could you try this debugging patch? > > Thanks, > Jarek P. > > --- > > diff -Nurp 2.6.24.3-/net/core/sock.c 2.6.24.3+/net/core/sock.c > --- 2.6.24.3-/net/core/sock.c 2008-01-24 23:58:37.000000000 +0100 > +++ 2.6.24.3+/net/core/sock.c 2008-03-22 12:10:10.000000000 +0100 > @@ -1517,14 +1517,21 @@ static void sock_def_write_space(struct > * progress. --DaveM > */ > if ((atomic_read(&sk->sk_wmem_alloc) << 1) <= sk->sk_sndbuf) { > - if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) > + if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) { > + if (!sk->sk_socket || sk->sk_socket->sk != sk) { > + WARN_ON_ONCE(1); > + sk->sk_socket = NULL; > + sk->sk_sleep = NULL; > + goto out; > + } > wake_up_interruptible(sk->sk_sleep); > + } > > /* Should agree with poll, otherwise some programs break */ > if (sock_writeable(sk)) > sk_wake_async(sk, 2, POLL_OUT); > } > - > +out: > read_unlock(&sk->sk_callback_lock); > } > Hi Jarek, Here is the result of your patch : WARNING: at net/core/sock.c:1522 sock_def_write_space() Pid: 3452, comm: mkiss Not tainted 2.6.24.3 #2 [<c010513a>] show_trace_log_lvl+0x1a/0x30 [<c0105b52>] show_trace+0x12/0x20 [<c01064ac>] dump_stack+0x6c/0x80 [<c024d54b>] sock_def_write_space+0x10b/0x120 [<c024d93a>] sock_wfree+0x3a/0x40 [<c024fafd>] skb_release_all+0x4d/0xf0 [<c024f2ab>] __kfree_skb+0xb/0x90 [<c024f349>] kfree_skb+0x19/0x30 [<c8cb5e37>] ax_xmit+0xf7/0x360 [mkiss] [<c0255367>] dev_hard_start_xmit+0x207/0x270 [<c02657f4>] __qdisc_run+0x54/0x1a0 [<c0257bac>] dev_queue_xmit+0x25c/0x330 [<c8cc8a77>] ax25_queue_xmit+0x47/0x70 [ax25] [<c8cc8b65>] ax25_transmit_buffer+0xc5/0x110 [ax25] [<c8cc8c2d>] ax25_send_iframe+0x7d/0x110 [ax25] [<c8cc8d70>] ax25_kick+0xb0/0x1b0 [ax25] [<c8cc9e29>] ax25_std_frame_in+0x69/0x890 [ax25] [<c8cc7dba>] ax25_kiss_rcv+0x2ba/0x7b0 [ax25] [<c0254cc4>] netif_receive_skb+0x244/0x2e0 [<c0257835>] process_backlog+0x75/0xe0 [<c025734b>] net_rx_action+0x12b/0x1d0 [<c011d595>] __do_softirq+0x55/0xc0 [<c011d647>] do_softirq+0x47/0x50 [<c011d9f5>] local_bh_enable_ip+0x95/0xe0 [<c02babe5>] _spin_unlock_bh+0x25/0x30 [<c8cb56b0>] mkiss_receive_buf+0x360/0x420 [mkiss] [<c020dfe7>] pty_write+0x47/0x60 [<c020b5b2>] write_chan+0x222/0x330 [<c0208c76>] tty_write+0x126/0x1b0 [<c01728df>] vfs_write+0xaf/0x120 [<c0172e2d>] sys_write+0x3d/0x70 [<c010412a>] sysenter_past_esp+0x5f/0xa5 ======================= Happy Easter, Bernard Pidoux ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-23 17:00 ` Bernard Pidoux @ 2008-03-24 20:51 ` Jarek Poplawski 2008-03-25 13:23 ` Bernard Pidoux 0 siblings, 1 reply; 29+ messages in thread From: Jarek Poplawski @ 2008-03-24 20:51 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Sun, Mar 23, 2008 at 06:00:17PM +0100, Bernard Pidoux wrote: ... > Here is the result of your patch : > > > WARNING: at net/core/sock.c:1522 sock_def_write_space() > Pid: 3452, comm: mkiss Not tainted 2.6.24.3 #2 ... Thanks. Here is one more (to apply after the previous one). Happy Holidays... Jarek P. --- diff -Nurp 2.6.24.3-with1/include/net/sock.h 2.6.24.3-with2/include/net/sock.h --- 2.6.24.3-with1/include/net/sock.h 2008-01-24 23:58:37.000000000 +0100 +++ 2.6.24.3-with2/include/net/sock.h 2008-03-24 21:14:43.000000000 +0100 @@ -263,6 +263,7 @@ struct sock { int (*sk_backlog_rcv)(struct sock *sk, struct sk_buff *skb); void (*sk_destruct)(struct sock *sk); + int sk_ax25_debug; }; /* diff -Nurp 2.6.24.3-with1/net/ax25/af_ax25.c 2.6.24.3-with2/net/ax25/af_ax25.c --- 2.6.24.3-with1/net/ax25/af_ax25.c 2008-01-24 23:58:37.000000000 +0100 +++ 2.6.24.3-with2/net/ax25/af_ax25.c 2008-03-23 00:53:51.000000000 +0100 @@ -936,6 +936,7 @@ struct sock *ax25_make_new(struct sock * } sk->sk_protinfo = ax25; + sk->sk_ax25_debug = 1; ax25->sk = sk; return sk; diff -Nurp 2.6.24.3-with1/net/core/sock.c 2.6.24.3-with2/net/core/sock.c --- 2.6.24.3-with1/net/core/sock.c 2008-03-22 12:10:10.000000000 +0100 +++ 2.6.24.3-with2/net/core/sock.c 2008-03-24 21:43:46.000000000 +0100 @@ -1519,6 +1519,9 @@ static void sock_def_write_space(struct if ((atomic_read(&sk->sk_wmem_alloc) << 1) <= sk->sk_sndbuf) { if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) { if (!sk->sk_socket || sk->sk_socket->sk != sk) { + if (net_ratelimit()) + printk(KERN_INFO "sk_ax25_debug = %d, %p\n", + sk->sk_ax25_debug, sk->sk_socket); WARN_ON_ONCE(1); sk->sk_socket = NULL; sk->sk_sleep = NULL; ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-24 20:51 ` Jarek Poplawski @ 2008-03-25 13:23 ` Bernard Pidoux 2008-03-25 20:51 ` Jarek Poplawski 2008-03-26 18:35 ` Jarek Poplawski 0 siblings, 2 replies; 29+ messages in thread From: Bernard Pidoux @ 2008-03-25 13:23 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek Poplawski wrote: > On Sun, Mar 23, 2008 at 06:00:17PM +0100, Bernard Pidoux wrote: > ... >> Here is the result of your patch : >> >> >> WARNING: at net/core/sock.c:1522 sock_def_write_space() >> Pid: 3452, comm: mkiss Not tainted 2.6.24.3 #2 > ... > > Thanks. Here is one more (to apply after the previous one). > > Happy Holidays... > Jarek P. > > --- > > diff -Nurp 2.6.24.3-with1/include/net/sock.h 2.6.24.3-with2/include/net/sock.h > --- 2.6.24.3-with1/include/net/sock.h 2008-01-24 23:58:37.000000000 +0100 > +++ 2.6.24.3-with2/include/net/sock.h 2008-03-24 21:14:43.000000000 +0100 > @@ -263,6 +263,7 @@ struct sock { > int (*sk_backlog_rcv)(struct sock *sk, > struct sk_buff *skb); > void (*sk_destruct)(struct sock *sk); > + int sk_ax25_debug; > }; > > /* > diff -Nurp 2.6.24.3-with1/net/ax25/af_ax25.c 2.6.24.3-with2/net/ax25/af_ax25.c > --- 2.6.24.3-with1/net/ax25/af_ax25.c 2008-01-24 23:58:37.000000000 +0100 > +++ 2.6.24.3-with2/net/ax25/af_ax25.c 2008-03-23 00:53:51.000000000 +0100 > @@ -936,6 +936,7 @@ struct sock *ax25_make_new(struct sock * > } > > sk->sk_protinfo = ax25; > + sk->sk_ax25_debug = 1; > ax25->sk = sk; > > return sk; > diff -Nurp 2.6.24.3-with1/net/core/sock.c 2.6.24.3-with2/net/core/sock.c > --- 2.6.24.3-with1/net/core/sock.c 2008-03-22 12:10:10.000000000 +0100 > +++ 2.6.24.3-with2/net/core/sock.c 2008-03-24 21:43:46.000000000 +0100 > @@ -1519,6 +1519,9 @@ static void sock_def_write_space(struct > if ((atomic_read(&sk->sk_wmem_alloc) << 1) <= sk->sk_sndbuf) { > if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) { > if (!sk->sk_socket || sk->sk_socket->sk != sk) { > + if (net_ratelimit()) > + printk(KERN_INFO "sk_ax25_debug = %d, %p\n", > + sk->sk_ax25_debug, sk->sk_socket); > WARN_ON_ONCE(1); > sk->sk_socket = NULL; > sk->sk_sleep = NULL; > > After applying this patch I did not see any sk_ax25_debug = 1 into /var/log/messages. It was always = 0. Mar 25 12:03:07 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:11:55 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:13:07 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:16:39 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 12:18:57 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 12:23:12 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 12:26:50 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 12:32:34 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 12:33:14 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:33:57 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 12:36:56 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 12:43:16 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 12:48:34 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 12:48:57 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 12:53:10 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 13:00:31 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 13:03:24 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 13:03:56 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 13:10:52 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 13:13:22 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Here is an extract of /var/log/kernel/warnings.log Mar 25 11:54:04 f6bvp-9 kernel: NET: Registered protocol family 3 Mar 25 11:54:04 f6bvp-9 kernel: mkiss: AX.25 Multikiss, Hans Albas PE1AYX Mar 25 11:54:04 f6bvp-9 mkiss[3443]: starting Mar 25 11:54:04 f6bvp-9 kernel: mkiss: ax0: crc mode is auto. Mar 25 11:54:04 f6bvp-9 kernel: ADDRCONF(NETDEV_CHANGE): ax0: link becomes ready Mar 25 11:54:04 f6bvp-9 kernel: mkiss: ax1: crc mode is auto. Mar 25 11:54:04 f6bvp-9 kernel: ADDRCONF(NETDEV_CHANGE): ax1: link becomes ready Mar 25 11:54:05 f6bvp-9 mkiss[3455]: starting Mar 25 11:54:05 f6bvp-9 kernel: mkiss: ax2: crc mode is auto. Mar 25 11:54:05 f6bvp-9 kernel: ADDRCONF(NETDEV_CHANGE): ax2: link becomes ready Mar 25 11:54:05 f6bvp-9 kernel: mkiss: ax3: crc mode is auto. Mar 25 11:54:05 f6bvp-9 kernel: ADDRCONF(NETDEV_CHANGE): ax3: link becomes ready Mar 25 11:54:11 f6bvp-9 kdm_greet[3470]: Can't open default user face Mar 25 11:54:22 f6bvp-9 kernel: mkiss: ax4: crc mode is auto. Mar 25 11:54:22 f6bvp-9 kernel: ADDRCONF(NETDEV_CHANGE): ax4: link becomes ready Mar 25 11:54:22 f6bvp-9 kissattach[3510]: AX.25 port 4 bound to device ax4 Mar 25 11:54:22 f6bvp-9 ax25ipd: Current configuration: Mar 25 11:54:22 f6bvp-9 ax25ipd: socket udp on port 10093 Mar 25 11:54:22 f6bvp-9 ax25ipd: mode tnc Mar 25 11:54:22 f6bvp-9 ax25ipd: device /dev/ttyq1 Mar 25 11:54:22 f6bvp-9 ax25ipd: speed 115200 Mar 25 11:54:22 f6bvp-9 ax25ipd: loglevel 2 Mar 25 11:54:22 f6bvp-9 ax25ipd: 6 active routes. Mar 25 11:54:22 f6bvp-9 ax25ipd: F6BVP-11 192.168.0.66 udp 10093 0 Mar 25 11:54:22 f6bvp-9 ax25ipd: F6BVP-10 192.168.0.66 udp 10093 1 Mar 25 11:54:22 f6bvp-9 ax25ipd: F6BVP-7 192.168.0.103 udp 10093 0 Mar 25 11:54:22 f6bvp-9 ax25ipd: F6BVP-6 192.168.0.103 udp 10093 1 Mar 25 11:54:22 f6bvp-9 ax25ipd: F6BVP-12 192.168.0.66 udp 10093 0 Mar 25 11:54:22 f6bvp-9 ax25ipd: VA2BBS 216.239.82.253 udp 10093 1 va2bbs.homeip.net Mar 25 11:54:22 f6bvp-9 ax25ipd: 0 parameters Mar 25 11:54:26 f6bvp-9 kernel: NET: Registered protocol family 6 Mar 25 11:54:27 f6bvp-9 kernel: netromd uses obsolete (PF_INET,SOCK_PACKET) Mar 25 11:54:27 f6bvp-9 netromd[3553]: starting -- Mar 25 12:03:07 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:03:07 f6bvp-9 kernel: WARNING: at net/core/sock.c:1559 sock_def_write_space() Mar 25 12:03:07 f6bvp-9 kernel: Pid: 3443, comm: mkiss Not tainted 2.6.24.3 #3 Mar 25 12:03:07 f6bvp-9 kernel: [<c010513a>] show_trace_log_lvl+0x1a/0x30 Mar 25 12:03:07 f6bvp-9 kernel: [<c0105b52>] show_trace+0x12/0x20 Mar 25 12:03:07 f6bvp-9 kernel: [<c01064ac>] dump_stack+0x6c/0x80 Mar 25 12:03:07 f6bvp-9 kernel: [<c024d5d0>] sock_def_write_space+0x150/0x160 Mar 25 12:03:07 f6bvp-9 kernel: [<c024d9ba>] sock_wfree+0x3a/0x40 Mar 25 12:03:07 f6bvp-9 kernel: [<c024fb7d>] skb_release_all+0x4d/0xf0 Mar 25 12:03:07 f6bvp-9 kernel: [<c024f32b>] __kfree_skb+0xb/0x90 Mar 25 12:03:07 f6bvp-9 kernel: [<c024f3c9>] kfree_skb+0x19/0x30 Mar 25 12:03:07 f6bvp-9 kernel: [<c8c79e03>] ax25_frames_acked+0x43/0x70 [ax25] Mar 25 12:03:07 f6bvp-9 kernel: [<c8c77a10>] ax25_check_iframes_acked+0x40/0x60 [ax25] Mar 25 12:03:07 f6bvp-9 kernel: [<c8c7946f>] ax25_std_frame_in+0x6af/0x890 [ax25] Mar 25 12:03:07 f6bvp-9 kernel: [<c8c76dba>] ax25_kiss_rcv+0x2ba/0x7b0 [ax25] Mar 25 12:03:07 f6bvp-9 kernel: [<c0254d44>] netif_receive_skb+0x244/0x2e0 Mar 25 12:03:07 f6bvp-9 kernel: [<c02578b5>] process_backlog+0x75/0xe0 Mar 25 12:03:07 f6bvp-9 kernel: [<c02573cb>] net_rx_action+0x12b/0x1d0 Mar 25 12:03:07 f6bvp-9 kernel: [<c011d595>] __do_softirq+0x55/0xc0 Mar 25 12:03:07 f6bvp-9 kernel: [<c011d647>] do_softirq+0x47/0x50 Mar 25 12:03:07 f6bvp-9 kernel: [<c011d9f5>] local_bh_enable_ip+0x95/0xe0 Mar 25 12:03:07 f6bvp-9 kernel: [<c02bac55>] _spin_unlock_bh+0x25/0x30 Mar 25 12:03:07 f6bvp-9 kernel: [<c8c696b0>] mkiss_receive_buf+0x360/0x420 [mkiss] Mar 25 12:03:07 f6bvp-9 kernel: [<c020dfe7>] pty_write+0x47/0x60 Mar 25 12:03:07 f6bvp-9 kernel: [<c020b5b2>] write_chan+0x222/0x330 Mar 25 12:03:07 f6bvp-9 kernel: [<c0208c76>] tty_write+0x126/0x1b0 Mar 25 12:03:07 f6bvp-9 kernel: [<c01728df>] vfs_write+0xaf/0x120 Mar 25 12:03:07 f6bvp-9 kernel: [<c0172e2d>] sys_write+0x3d/0x70 Mar 25 12:03:07 f6bvp-9 kernel: [<c010412a>] sysenter_past_esp+0x5f/0xa5 Mar 25 12:03:07 f6bvp-9 kernel: ======================= Mar 25 12:09:01 f6bvp-9 crond[3928]: (root) CMD ([ -d /var/lib/php ] && find /var/lib/php/ -type f -mmin +$(/usr/lib/php/maxlifetime) -print0 | xargs -r -0 rm) Mar 25 12:11:55 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:13:07 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 I forgot to mention an obvious thing : since the WARN_ON_ONCE patch there is no more kernel panic. But you knew that of course. Many thanks for your help. I am prepared for the next step you probably want to explore. If it is easier for you, to prepare a patch, I can upgrade to 2.6.24.4. Best regards, Bernard P. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-25 13:23 ` Bernard Pidoux @ 2008-03-25 20:51 ` Jarek Poplawski 2008-03-26 18:35 ` Jarek Poplawski 1 sibling, 0 replies; 29+ messages in thread From: Jarek Poplawski @ 2008-03-25 20:51 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Tue, Mar 25, 2008 at 02:23:46PM +0100, Bernard Pidoux wrote: ... > I am prepared for the next step you probably want to explore. > > If it is easier for you, to prepare a patch, I can upgrade to 2.6.24.4. I need some time yet; it looks like 2.6.24.4 doesn't collide with these patches, but upgrade could be reasonable for other reasons. Best regards, Jarek P. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-25 13:23 ` Bernard Pidoux 2008-03-25 20:51 ` Jarek Poplawski @ 2008-03-26 18:35 ` Jarek Poplawski 2008-03-28 8:24 ` Bernard Pidoux ` (2 more replies) 1 sibling, 3 replies; 29+ messages in thread From: Jarek Poplawski @ 2008-03-26 18:35 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Tue, Mar 25, 2008 at 02:23:46PM +0100, Bernard Pidoux wrote: ... > I am prepared for the next step you probably want to explore. ... OK, here is the next try. (Apply after all previous patches to any 2.6.24.x; there would be more noise, so revert it after catching some data.) Thanks, Jarek P. (debugging patch #3) --- diff -Nurp 2.6.24.3-with2/include/net/sock.h 2.6.24.3-with3/include/net/sock.h --- 2.6.24.3-with2/include/net/sock.h 2008-03-24 21:14:43.000000000 +0100 +++ 2.6.24.3-with3/include/net/sock.h 2008-03-26 19:10:33.000000000 +0100 @@ -1414,4 +1414,20 @@ extern int sysctl_optmem_max; extern __u32 sysctl_wmem_default; extern __u32 sysctl_rmem_default; +static inline int sock_debug_ax25(struct sk_buff *skb, struct sock *ax25_sk) +{ + struct sock *sk = skb->sk; + + if (sk && sk->sk_socket && sk->sk_socket->sk != sk) { + if (net_ratelimit()) + printk(KERN_INFO "AX25: %s, %d, %p, %p, %p, %p, %p\n", + __FUNCTION__, __LINE__, sk, sk->sk_socket, + sk->sk_socket->sk, ax25_sk, + ax25_sk == NULL ? NULL : ax25_sk->sk_socket); + skb->destructor = NULL; + return 1; + } + return 0; +} + #endif /* _SOCK_H */ diff -Nurp 2.6.24.3-with2/net/ax25/af_ax25.c 2.6.24.3-with3/net/ax25/af_ax25.c --- 2.6.24.3-with2/net/ax25/af_ax25.c 2008-03-23 00:53:51.000000000 +0100 +++ 2.6.24.3-with3/net/ax25/af_ax25.c 2008-03-26 18:52:54.000000000 +0100 @@ -952,6 +952,8 @@ static int ax25_release(struct socket *s sock_hold(sk); sock_orphan(sk); + if (net_ratelimit()) + printk(KERN_INFO "AX25- %s, %d, %p, %p\n", __FUNCTION__, __LINE__, sk, sock); lock_sock(sk); ax25 = ax25_sk(sk); @@ -1372,12 +1374,16 @@ static int ax25_accept(struct socket *so newsk = skb->sk; newsk->sk_socket = newsock; newsk->sk_sleep = &newsock->wait; + newsk->sk_ax25_debug = 2; /* Now attach up the new socket */ kfree_skb(skb); sk->sk_ack_backlog--; newsock->sk = newsk; newsock->state = SS_CONNECTED; + if (net_ratelimit()) + printk(KERN_INFO "AX25= %s, %d, %p, %p, %p\n", + __FUNCTION__, __LINE__, newsk, sock, newsock); out: release_sock(sk); diff -Nurp 2.6.24.3-with2/net/ax25/ax25_out.c 2.6.24.3-with3/net/ax25/ax25_out.c --- 2.6.24.3-with2/net/ax25/ax25_out.c 2008-03-26 16:38:23.000000000 +0100 +++ 2.6.24.3-with3/net/ax25/ax25_out.c 2008-03-26 18:54:47.000000000 +0100 @@ -98,6 +98,7 @@ ax25_cb *ax25_send_frame(struct sk_buff ax25_start_heartbeat(ax25); + sock_debug_ax25(skb, ax25->sk); ax25_output(ax25, paclen, skb); return ax25; /* We had to create it */ @@ -176,11 +177,13 @@ void ax25_output(ax25_cb *ax25, int pacl } skb_pull(skb, len); + sock_debug_ax25(skbn, ax25->sk); skb_queue_tail(&ax25->write_queue, skbn); /* Throw it on the queue */ } kfree_skb(skb); } else { + sock_debug_ax25(skb, ax25->sk); skb_queue_tail(&ax25->write_queue, skb); /* Throw it on the queue */ } @@ -274,6 +277,8 @@ void ax25_kick(ax25_cb *ax25) ax25->vs = start; do { + sock_debug_ax25(skb, ax25->sk); + if ((skbn = skb_clone(skb, GFP_ATOMIC)) == NULL) { skb_queue_head(&ax25->write_queue, skb); break; @@ -308,6 +313,8 @@ void ax25_kick(ax25_cb *ax25) /* * Requeue the original data frame. */ + + sock_debug_ax25(skb, ax25->sk); skb_queue_tail(&ax25->ack_queue, skb); } while (!last && (skb = skb_dequeue(&ax25->write_queue)) != NULL); diff -Nurp 2.6.24.3-with2/net/ax25/ax25_subr.c 2.6.24.3-with3/net/ax25/ax25_subr.c --- 2.6.24.3-with2/net/ax25/ax25_subr.c 2008-01-24 23:58:37.000000000 +0100 +++ 2.6.24.3-with3/net/ax25/ax25_subr.c 2008-03-26 19:23:03.000000000 +0100 @@ -56,6 +56,7 @@ void ax25_frames_acked(ax25_cb *ax25, un if (ax25->va != nr) { while (skb_peek(&ax25->ack_queue) != NULL && ax25->va != nr) { skb = skb_dequeue(&ax25->ack_queue); + sock_debug_ax25(skb, ax25->sk); kfree_skb(skb); ax25->va = (ax25->va + 1) % ax25->modulus; } diff -Nurp 2.6.24.3-with2/net/core/sock.c 2.6.24.3-with3/net/core/sock.c --- 2.6.24.3-with2/net/core/sock.c 2008-03-24 21:43:46.000000000 +0100 +++ 2.6.24.3-with3/net/core/sock.c 2008-03-26 19:14:37.000000000 +0100 @@ -1520,8 +1520,10 @@ static void sock_def_write_space(struct if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) { if (!sk->sk_socket || sk->sk_socket->sk != sk) { if (net_ratelimit()) - printk(KERN_INFO "sk_ax25_debug = %d, %p\n", - sk->sk_ax25_debug, sk->sk_socket); + printk(KERN_INFO "sk_ax25_debug = %d, %d, %d, %d, %p, %p, %p\n", + sk->sk_ax25_debug, sk->sk_family, + (int)sk->sk_protocol, sk->sk_type, sk->sk_socket, + sk->sk_socket == NULL ? NULL : sk->sk_socket->sk, sk); WARN_ON_ONCE(1); sk->sk_socket = NULL; sk->sk_sleep = NULL; ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-26 18:35 ` Jarek Poplawski @ 2008-03-28 8:24 ` Bernard Pidoux 2008-03-28 8:27 ` Bernard Pidoux 2008-03-28 12:07 ` Jarek Poplawski 2 siblings, 0 replies; 29+ messages in thread From: Bernard Pidoux @ 2008-03-28 8:24 UTC (permalink / raw) To: Linux Netdev List Hi Jarek, Thank you for the new debugging patch. I think I have collected enough data for you to make some interesting deductions. Here are the data collected and filtered with cat /var/log/kernel/info.log | grep AX25 I have noticed that there is no AX25= result, although the system ran a few hours. Mar 27 15:50:49 f6bvp-9 kernel: AX25- ax25_release, 952, c340fad0, c513a820 Mar 27 15:50:54 f6bvp-9 kernel: AX25- ax25_release, 952, c0f07b10, c0cc0820 Mar 27 15:50:55 f6bvp-9 kernel: AX25- ax25_release, 952, c34676d8, c0cc0d60 Mar 27 15:50:55 f6bvp-9 kernel: AX25- ax25_release, 952, c340e240, c0cc0820 Mar 27 15:50:55 f6bvp-9 kernel: AX25- ax25_release, 952, c0f07b10, c0cc02e0 Mar 27 15:50:55 f6bvp-9 kernel: AX25- ax25_release, 952, c0f07b10, c0cc0d60 Mar 27 15:50:55 f6bvp-9 kernel: AX25- ax25_release, 952, c0f07b10, c0cc02e0 Mar 27 15:51:17 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c148aac0 Mar 27 15:51:22 f6bvp-9 kernel: AX25- ax25_release, 952, c0d482c0, c148a2e0 Mar 27 15:51:22 f6bvp-9 kernel: AX25- ax25_release, 952, c0805758, c148a580 Mar 27 15:51:22 f6bvp-9 kernel: AX25- ax25_release, 952, c0804f28, c148a820 Mar 27 15:51:22 f6bvp-9 kernel: AX25- ax25_release, 952, c08046f8, c0cfdd60 Mar 27 15:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0804f28, c148a820 Mar 27 15:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d48af0, c148a820 Mar 27 15:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c148aac0 Mar 27 15:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0804f28, c148a820 Mar 27 15:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0804f28, c148a040 Mar 27 15:51:37 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c148aac0 Mar 27 15:51:47 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c148aac0 Mar 27 15:51:47 f6bvp-9 kernel: AX25- ax25_release, 952, c0d486d8, c0cfdd60 Mar 27 15:52:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d486d8, c0cfdd60 Mar 27 15:52:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d486d8, c0cfdd60 Mar 27 15:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c0cfd820 Mar 27 15:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c0cfd820 Mar 27 15:54:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c0cfdd60 Mar 27 15:54:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c0cfdd60 Mar 27 15:55:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:55:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:56:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c0892580 Mar 27 15:57:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c0892580 Mar 27 15:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:59:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c0892580 Mar 27 16:02:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 16:02:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 16:03:07 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb7640, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 16:03:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d28718, c08922e0 Mar 27 16:03:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d28718, c08922e0 Mar 27 16:04:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c0892040 Mar 27 16:04:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c0892040 Mar 27 16:05:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 16:06:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 16:07:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:07:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:08:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:08:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:09:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c0892580 Mar 27 16:09:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c0892580 Mar 27 16:10:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2758, c0892580 Mar 27 16:11:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2758, c0892580 Mar 27 16:12:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:13:21 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb6610, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 16:13:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c08922e0 Mar 27 16:13:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c08922e0 Mar 27 16:14:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:14:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:15:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:16:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:16:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb6e28, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 16:17:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:17:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:18:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:18:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:19:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c56c8f68, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 16:19:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:20:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:21:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 16:21:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 16:22:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:22:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:23:03 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c56c9780, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 16:23:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:23:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:24:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:24:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:25:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:28:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:28:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:29:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:29:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:30:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:30:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:31:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:32:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:33:05 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7790190, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 16:33:07 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77989c8, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 16:33:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 16:34:06 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77991e0, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 16:34:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:35:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:36:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:37:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:38:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:39:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:40:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:41:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:41:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:42:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:42:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:43:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c2180510, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 16:43:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:43:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:44:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:44:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:45:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:46:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:47:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 16:48:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:48:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:48:56 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77981b0, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 16:49:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c2181540, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 16:49:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:49:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:50:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:50:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d798, c08922e0 Mar 27 16:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d798, c08922e0 Mar 27 16:51:33 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:52:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d798, c08922e0 Mar 27 16:52:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d798, c08922e0 Mar 27 16:52:48 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:53:10 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77909a8, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 16:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:54:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892040 Mar 27 16:55:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 16:55:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 16:56:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:57:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:59:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:59:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c0892580 Mar 27 17:00:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 17:00:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 17:00:56 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77911c0, c50c2d60, 6b6b6b6b, 00000000, 00000000 Mar 27 17:01:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c50c2d60 Mar 27 17:02:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c50c2d60 Mar 27 17:03:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3432c88, c50c2d60, 6b6b6b6b, 00000000, 00000000 Mar 27 17:03:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:03:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:04:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3432470, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 17:04:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:04:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:05:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892040 Mar 27 17:05:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892040 Mar 27 17:06:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:06:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:07:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:10:19 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c2180d28, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:10:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:10:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:11:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:11:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:12:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:12:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:13:08 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c0894770, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:13:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:13:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:14:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:14:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:15:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:16:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:16:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:16:56 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c56c8750, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:17:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:17:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:18:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:18:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:19:03 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c695b440, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 17:19:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:19:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:20:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:20:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:21:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:21:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:22:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:23:01 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c695a410, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:23:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:23:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:24:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:24:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:25:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:25:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:26:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:26:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:27:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:28:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:29:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:30:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:30:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:31:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:31:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:32:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:32:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:32:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67b34c0, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:33:05 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c695ac28, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 17:33:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:33:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:34:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67b2490, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 17:34:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:34:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:35:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 17:37:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:37:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:38:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 17:38:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 17:39:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:39:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:40:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:40:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:41:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:41:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:41:46 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67b2ca8, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 17:42:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:42:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:43:08 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bcb520, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 17:43:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:44:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:45:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:45:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:46:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:46:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:47:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:47:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:48:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:48:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:48:56 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bcad08, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 17:49:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bca4f0, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:49:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:49:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:50:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c08922e0 Mar 27 17:51:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c08922e0 Mar 27 17:51:34 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:52:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 17:52:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 17:52:49 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:53:02 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc35a0, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:54:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:55:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:55:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:56:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:58:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:59:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:59:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 18:00:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:00:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:00:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc2570, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 18:01:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:01:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:02:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 18:02:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 18:03:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc2d88, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 18:03:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 18:03:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 18:04:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a3d5e0, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 18:04:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 18:05:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 18:06:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:06:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:07:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 18:07:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 18:08:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:11:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 18:12:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:12:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:13:07 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a3c5b0, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 18:13:11 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a3cdc8, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 18:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:14:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 18:14:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 18:15:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892580 Mar 27 18:15:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892580 Mar 27 18:16:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:16:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:16:56 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc5660, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 18:17:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:17:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:18:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:19:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc4630, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 18:19:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:20:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:21:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 18:21:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 18:22:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:22:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:23:14 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc4e48, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 18:23:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:23:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:24:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:26:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:26:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:27:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:28:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:29:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892580 Mar 27 18:30:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892580 Mar 27 18:31:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:31:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:32:27 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892580 Mar 27 18:32:59 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd0ee8, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 18:33:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd1700, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 18:33:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:36:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:37:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:38:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:40:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:40:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:41:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:41:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:42:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:42:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:43:12 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd06d0, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 18:43:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:43:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:44:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:45:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:46:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:47:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:47:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:48:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:48:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:48:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67bb7a0, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 18:49:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:50:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:51:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c08922e0 Mar 27 18:51:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c08922e0 Mar 27 18:51:36 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:52:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 18:52:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 18:52:51 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:53:02 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67ba770, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 18:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:54:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:54:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:55:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:56:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:57:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:58:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:59:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:59:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 19:00:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c50c2d60 Mar 27 19:00:58 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c0a43080, c50c2d60, 6b6b6b6b, 00000000, 00000000 Mar 27 19:01:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c50c2d60 Mar 27 19:02:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c50c2d60 Mar 27 19:03:05 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c0a42868, c50c2d60, 6b6b6b6b, 00000000, 00000000 Mar 27 19:03:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:03:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:04:05 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c0a42050, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 19:04:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:04:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:05:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:05:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:06:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:06:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:07:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:08:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:09:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:10:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:13:08 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67baf88, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 19:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:14:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:15:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 19:16:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 19:16:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb3140, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 19:17:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 19:17:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 19:18:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 19:18:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 19:19:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb2110, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:19:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 19:19:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 19:20:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:22:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:23:20 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb2928, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 19:23:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:23:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:24:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 19:24:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 19:25:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 19:28:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 19:29:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 19:30:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:30:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:31:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:31:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:32:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:32:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:32:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a9a9c8, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:33:01 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a9b1e0, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:33:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:33:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:34:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a9a1b0, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 19:34:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:34:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:35:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 19:36:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:37:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:38:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 19:38:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 19:39:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 19:39:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 19:40:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:40:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:41:23 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd3240, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 19:41:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:43:13 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd2a28, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:43:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:44:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:45:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892040 Mar 27 19:45:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892040 Mar 27 19:46:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 19:46:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 19:47:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 19:47:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 19:48:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:48:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:48:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd2210, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:49:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a032a0, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:49:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:50:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:50:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:51:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c509c2e0 Mar 27 19:51:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c509c2e0 Mar 27 19:51:37 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:52:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c509c2e0 Mar 27 19:52:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c509c2e0 Mar 27 19:52:52 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:53:11 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a02a88, c509c2e0, 6b6b6b6b, 00000000, 00000000 Mar 27 19:53:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:53:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:54:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:54:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:55:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:55:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:56:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:57:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 20:00:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 20:00:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 20:00:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a02270, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 20:01:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 20:01:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 20:02:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 20:02:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 20:03:03 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a05320, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 20:03:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 20:04:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a042f0, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 20:04:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 20:04:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 20:05:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c040 Mar 27 20:08:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 20:08:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 20:09:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:09:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:10:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 20:11:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:11:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:11:42 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a04b08, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 20:12:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:12:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cf68, c0892580 Mar 27 20:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cf68, c0892580 Mar 27 20:14:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cf68, c0892040 Mar 27 20:14:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cf68, c0892040 Mar 27 20:15:16 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a18370, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 20:15:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2758, c509c040 Mar 27 20:16:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2758, c509c040 Mar 27 20:17:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa37b8, c0892580 Mar 27 20:17:46 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a18b88, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 20:18:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7b28d48, c0892580 Mar 27 20:18:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7b28d48, c0892580 Mar 27 20:19:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7b9d400, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 20:19:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 20:19:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 20:20:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7b28d48, c0892040 Mar 27 20:20:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7b28d48, c0892040 Mar 27 20:21:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 20:21:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 20:22:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Regards, Bernard P. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-26 18:35 ` Jarek Poplawski 2008-03-28 8:24 ` Bernard Pidoux @ 2008-03-28 8:27 ` Bernard Pidoux 2008-03-28 12:07 ` Jarek Poplawski 2 siblings, 0 replies; 29+ messages in thread From: Bernard Pidoux @ 2008-03-28 8:27 UTC (permalink / raw) To: Linux Netdev List Hi Jarek, Here is the result of cat /var/log/messages | grep -B1 -A50 core/sock No event was detected before 16:33. -- Mar 27 16:33:05 f6bvp-9 kernel: sk_ax25_debug = 0, 11, 0, 5, c08922e0, 6b6b6b6b, c7790190 Mar 27 16:33:05 f6bvp-9 kernel: WARNING: at net/core/sock.c:1561 sock_def_write_space() Mar 27 16:33:05 f6bvp-9 kernel: Pid: 3454, comm: mkiss Not tainted 2.6.24.4 #4 Mar 27 16:33:05 f6bvp-9 kernel: [<c010513a>] show_trace_log_lvl+0x1a/0x30 Mar 27 16:33:05 f6bvp-9 kernel: [<c0105b52>] show_trace+0x12/0x20 Mar 27 16:33:05 f6bvp-9 kernel: [<c01064ac>] dump_stack+0x6c/0x80 Mar 27 16:33:05 f6bvp-9 kernel: [<c024d68b>] sock_def_write_space+0x17b/0x190 Mar 27 16:33:05 f6bvp-9 kernel: [<c024da7a>] sock_wfree+0x3a/0x40 Mar 27 16:33:05 f6bvp-9 kernel: [<c024fc3d>] skb_release_all+0x4d/0xf0 Mar 27 16:33:05 f6bvp-9 kernel: [<c024f3eb>] __kfree_skb+0xb/0x90 Mar 27 16:33:05 f6bvp-9 kernel: [<c024f489>] kfree_skb+0x19/0x30 Mar 27 16:33:05 f6bvp-9 kernel: [<c8cbfe37>] ax_xmit+0xf7/0x360 [mkiss] Mar 27 16:33:05 f6bvp-9 kernel: [<c02554a7>] dev_hard_start_xmit+0x207/0x270 Mar 27 16:33:05 f6bvp-9 kernel: [<c0265934>] __qdisc_run+0x54/0x1a0 Mar 27 16:33:05 f6bvp-9 kernel: [<c0257cec>] dev_queue_xmit+0x25c/0x330 Mar 27 16:33:05 f6bvp-9 kernel: [<c8befa77>] ax25_queue_xmit+0x47/0x70 [ax25] Mar 27 16:33:05 f6bvp-9 kernel: [<c8befb65>] ax25_transmit_buffer+0xc5/0x110 [ax25] Mar 27 16:33:05 f6bvp-9 kernel: [<c8befc2d>] ax25_send_iframe+0x7d/0x110 [ax25] Mar 27 16:33:06 f6bvp-9 kernel: [<c8befd70>] ax25_kick+0xb0/0x2b0 [ax25] Mar 27 16:33:06 f6bvp-9 kernel: [<c8bf10c9>] ax25_std_frame_in+0x69/0x890 [ax25] Mar 27 16:33:06 f6bvp-9 kernel: [<c8beedba>] ax25_kiss_rcv+0x2ba/0x7b0 [ax25] Mar 27 16:33:06 f6bvp-9 kernel: [<c0254e04>] netif_receive_skb+0x244/0x2e0 Mar 27 16:33:06 f6bvp-9 kernel: [<c0257975>] process_backlog+0x75/0xe0 Mar 27 16:33:06 f6bvp-9 kernel: [<c025748b>] net_rx_action+0x12b/0x1d0 Mar 27 16:33:06 f6bvp-9 kernel: [<c011d5c5>] __do_softirq+0x55/0xc0 Mar 27 16:33:06 f6bvp-9 kernel: [<c011d677>] do_softirq+0x47/0x50 Mar 27 16:33:06 f6bvp-9 kernel: [<c011da25>] local_bh_enable_ip+0x95/0xe0 Mar 27 16:33:06 f6bvp-9 kernel: [<c02bad05>] _spin_unlock_bh+0x25/0x30 Mar 27 16:33:06 f6bvp-9 kernel: [<c8cbf6b0>] mkiss_receive_buf+0x360/0x420 [mkiss] Mar 27 16:33:06 f6bvp-9 kernel: [<c020e097>] pty_write+0x47/0x60 Mar 27 16:33:06 f6bvp-9 kernel: [<c020b662>] write_chan+0x222/0x330 Mar 27 16:33:06 f6bvp-9 kernel: [<c0208d26>] tty_write+0x126/0x1b0 Mar 27 16:33:06 f6bvp-9 kernel: [<c017298f>] vfs_write+0xaf/0x120 Mar 27 16:33:06 f6bvp-9 kernel: [<c0172edd>] sys_write+0x3d/0x70 Mar 27 16:33:06 f6bvp-9 kernel: [<c010412a>] sysenter_past_esp+0x5f/0xa5 Mar 27 16:33:06 f6bvp-9 kernel: ======================= Mar 27 16:33:07 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77989c8, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 16:33:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 16:33:27 f6bvp-9 last message repeated 3 times Mar 27 16:34:06 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77991e0, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 16:34:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:35:27 f6bvp-9 last message repeated 2 times Mar 27 16:35:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:36:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:37:27 f6bvp-9 last message repeated 2 times Mar 27 16:37:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:38:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:38:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:39:01 f6bvp-9 crond[4300]: (root) CMD ([ -d /var/lib/php ] && find /var/lib/php/ -type f -mmin +$(/usr/lib/php/maxlifetime) -print0 | xargs -r -0 rm) Mar 27 16:39:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:39:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:40:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Regards, Bernard P. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-26 18:35 ` Jarek Poplawski 2008-03-28 8:24 ` Bernard Pidoux 2008-03-28 8:27 ` Bernard Pidoux @ 2008-03-28 12:07 ` Jarek Poplawski 2008-03-29 12:04 ` Bernard Pidoux 2 siblings, 1 reply; 29+ messages in thread From: Jarek Poplawski @ 2008-03-28 12:07 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Wed, Mar 26, 2008 at 07:35:38PM +0100, Jarek Poplawski wrote: ... > OK, here is the next try. (Apply after all previous patches to any 2.6.24.x; > there would be more noise, so revert it after catching some data.) Bernard, I fucked it up with this #3: (changed macro to function at the last minute). I'm currently reading this, and maybe I'll figure out something, but if it's not a big problem for you to repeat this after adding this #4 (after all previous) it should be 'a bit' easier. (But no need to hurry.) Very sorry, Jarek P. (debugging patch #4) --- diff -Nurp 2.6.24.3-with3/include/net/sock.h 2.6.24.3-with4/include/net/sock.h --- 2.6.24.3-with3/include/net/sock.h 2008-03-26 19:10:33.000000000 +0100 +++ 2.6.24.3-with4/include/net/sock.h 2008-03-28 12:42:19.000000000 +0100 @@ -1414,20 +1414,18 @@ extern int sysctl_optmem_max; extern __u32 sysctl_wmem_default; extern __u32 sysctl_rmem_default; -static inline int sock_debug_ax25(struct sk_buff *skb, struct sock *ax25_sk) -{ - struct sock *sk = skb->sk; - - if (sk && sk->sk_socket && sk->sk_socket->sk != sk) { - if (net_ratelimit()) - printk(KERN_INFO "AX25: %s, %d, %p, %p, %p, %p, %p\n", - __FUNCTION__, __LINE__, sk, sk->sk_socket, - sk->sk_socket->sk, ax25_sk, - ax25_sk == NULL ? NULL : ax25_sk->sk_socket); - skb->destructor = NULL; - return 1; - } - return 0; -} +#define sock_debug_ax25(__skb, __ax25_sk) \ +({ \ + struct sock *__sk = __skb->sk; \ + \ + if (__sk && __sk->sk_socket && __sk->sk_socket->sk != __sk) { \ + if (net_ratelimit()) \ + printk(KERN_INFO "AX25: %s, %d, %p, %p, %p, %p, %p\n", \ + __FUNCTION__, __LINE__, __sk, __sk->sk_socket, \ + __sk->sk_socket->sk, __ax25_sk, \ + __ax25_sk == NULL ? NULL : __ax25_sk->sk_socket); \ + __skb->destructor = NULL; \ + } \ +}) #endif /* _SOCK_H */ diff -Nurp 2.6.24.3-with3/net/ax25/af_ax25.c 2.6.24.3-with4/net/ax25/af_ax25.c --- 2.6.24.3-with3/net/ax25/af_ax25.c 2008-03-26 18:52:54.000000000 +0100 +++ 2.6.24.3-with4/net/ax25/af_ax25.c 2008-03-28 12:50:35.000000000 +0100 @@ -866,6 +866,9 @@ static int ax25_create(struct net *net, ax25->sk = sk; + if (net_ratelimit()) + printk(KERN_INFO "AX25+ %s, %d, %p, %p\n", __FUNCTION__, __LINE__, sk, sock); + return 0; } @@ -939,6 +942,10 @@ struct sock *ax25_make_new(struct sock * sk->sk_ax25_debug = 1; ax25->sk = sk; + if (net_ratelimit()) + printk(KERN_INFO "AX25; %s, %d, %p, %p\n", + __FUNCTION__, __LINE__, sk, sk->sk_socket); + return sk; } ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-28 12:07 ` Jarek Poplawski @ 2008-03-29 12:04 ` Bernard Pidoux 2008-03-29 12:24 ` Jarek Poplawski 0 siblings, 1 reply; 29+ messages in thread From: Bernard Pidoux @ 2008-03-29 12:04 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek Poplawski wrote: > On Wed, Mar 26, 2008 at 07:35:38PM +0100, Jarek Poplawski wrote: > ... >> OK, here is the next try. (Apply after all previous patches to any 2.6.24.x; >> there would be more noise, so revert it after catching some data.) > > Bernard, I fucked it up with this #3: (changed macro to function at > the last minute). I'm currently reading this, and maybe I'll figure > out something, but if it's not a big problem for you to repeat this > after adding this #4 (after all previous) it should be 'a bit' easier. > (But no need to hurry.) > > Very sorry, > Jarek P. > > (debugging patch #4) Please find below an extract of /var/log/messages The time of interest is around 12:03 Mar 29 11:52:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a820 Mar 29 11:52:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a820 Mar 29 11:52:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a820 Mar 29 11:52:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a820 Mar 29 11:52:59 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c6ae2bc8, c0f0a040, 6b6b6b6b, 00000000, 00000000 Mar 29 11:53:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a580 Mar 29 11:53:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a580 Mar 29 11:53:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a580 Mar 29 11:53:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a580 Mar 29 11:54:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a580 Mar 29 11:54:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a580 Mar 29 11:54:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a580 Mar 29 11:54:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a580 Mar 29 11:55:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:55:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:55:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:55:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:56:52 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:56:52 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:57:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:57:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:57:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:57:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:58:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:58:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:58:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:58:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:59:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:59:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:59:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:59:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 12:00:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d58040 Mar 29 12:00:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d58040 Mar 29 12:00:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d58040 Mar 29 12:00:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d58040 Mar 29 12:01:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d58040 Mar 29 12:01:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d58040 Mar 29 12:01:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d58040 Mar 29 12:01:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d58040 Mar 29 12:02:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 12:02:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 12:02:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 12:02:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 12:03:07 f6bvp-9 kernel: AX25: ax25_kick, 279, c65e43f0, c0d58040, 6b6b6b6b, 00000000, 00000000 Mar 29 12:03:07 f6bvp-9 kernel: sk_ax25_debug = 0, 11, 0, 5, c0d58040, 6b6b6b6b, c65e43f0 Mar 29 12:03:07 f6bvp-9 kernel: WARNING: at net/core/sock.c:1561 sock_def_write_space() Mar 29 12:03:07 f6bvp-9 kernel: Pid: 3447, comm: mkiss Not tainted 2.6.24.4 #6 Mar 29 12:03:07 f6bvp-9 kernel: [<c010513a>] show_trace_log_lvl+0x1a/0x30 Mar 29 12:03:07 f6bvp-9 kernel: [<c0105b52>] show_trace+0x12/0x20 Mar 29 12:03:07 f6bvp-9 kernel: [<c01064ac>] dump_stack+0x6c/0x80 Mar 29 12:03:07 f6bvp-9 kernel: [<c024d68b>] sock_def_write_space+0x17b/0x190 Mar 29 12:03:07 f6bvp-9 kernel: [<c024da7a>] sock_wfree+0x3a/0x40 Mar 29 12:03:07 f6bvp-9 kernel: [<c024fc3d>] skb_release_all+0x4d/0xf0 Mar 29 12:03:07 f6bvp-9 kernel: [<c024f3eb>] __kfree_skb+0xb/0x90 Mar 29 12:03:07 f6bvp-9 kernel: [<c024f489>] kfree_skb+0x19/0x30 Mar 29 12:03:07 f6bvp-9 kernel: [<c8c6ae37>] ax_xmit+0xf7/0x360 [mkiss] Mar 29 12:03:07 f6bvp-9 kernel: [<c0255497>] dev_hard_start_xmit+0x207/0x270 Mar 29 12:03:07 f6bvp-9 kernel: [<c0265924>] __qdisc_run+0x54/0x1a0 Mar 29 12:03:07 f6bvp-9 kernel: [<c0257cdc>] dev_queue_xmit+0x25c/0x330 Mar 29 12:03:07 f6bvp-9 kernel: [<c8c77a77>] ax25_queue_xmit+0x47/0x70 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c8c77b65>] ax25_transmit_buffer+0xc5/0x110 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c8c77c2d>] ax25_send_iframe+0x7d/0x110 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c8c77d70>] ax25_kick+0xb0/0x2a0 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c8c790a9>] ax25_std_frame_in+0x69/0x890 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c8c76dba>] ax25_kiss_rcv+0x2ba/0x7b0 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c0254df4>] netif_receive_skb+0x244/0x2e0 Mar 29 12:03:07 f6bvp-9 kernel: [<c0257965>] process_backlog+0x75/0xe0 Mar 29 12:03:07 f6bvp-9 kernel: [<c025747b>] net_rx_action+0x12b/0x1d0 Mar 29 12:03:07 f6bvp-9 kernel: [<c011d5c5>] __do_softirq+0x55/0xc0 Mar 29 12:03:07 f6bvp-9 kernel: [<c011d677>] do_softirq+0x47/0x50 Mar 29 12:03:07 f6bvp-9 kernel: [<c011da25>] local_bh_enable_ip+0x95/0xe0 Mar 29 12:03:07 f6bvp-9 kernel: [<c02bace5>] _spin_unlock_bh+0x25/0x30 Mar 29 12:03:07 f6bvp-9 kernel: [<c8c6a6b0>] mkiss_receive_buf+0x360/0x420 [mkiss] Mar 29 12:03:07 f6bvp-9 kernel: [<c020e097>] pty_write+0x47/0x60 Mar 29 12:03:07 f6bvp-9 kernel: [<c020b662>] write_chan+0x222/0x330 Mar 29 12:03:07 f6bvp-9 kernel: [<c0208d26>] tty_write+0x126/0x1b0 Mar 29 12:03:07 f6bvp-9 kernel: [<c017298f>] vfs_write+0xaf/0x120 Mar 29 12:03:07 f6bvp-9 kernel: [<c0172edd>] sys_write+0x3d/0x70 Mar 29 12:03:07 f6bvp-9 kernel: [<c010412a>] sysenter_past_esp+0x5f/0xa5 Mar 29 12:03:07 f6bvp-9 kernel: ======================= Mar 29 12:03:52 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:03:52 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:04:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:04:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:04:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:04:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:05:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:05:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:05:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:05:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:06:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:06:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:06:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:06:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:07:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:07:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:07:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:07:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:08:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:08:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:08:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:08:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:09:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:09:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:09:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:09:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:10:52 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:10:52 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:11:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:11:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:11:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:11:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:11:59 f6bvp-9 netromd[3557]: netromr: SIOCADDRT: Invalid argument Mar 29 12:12:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d582e0 Mar 29 12:12:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d582e0 Mar 29 12:12:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d582e0 Mar 29 12:12:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d582e0 Mar 29 12:12:55 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c65e4c08, c0d58040, 6b6b6b6b, 00000000, 00000000 Mar 29 12:12:57 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c7ba74a0, c0d582e0, 6b6b6b6b, 00000000, 00000000 Mar 29 12:13:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d582e0 Mar 29 12:13:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d582e0 Regards, Bernard P. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-29 12:04 ` Bernard Pidoux @ 2008-03-29 12:24 ` Jarek Poplawski 2008-03-30 8:43 ` Bernard Pidoux ` (2 more replies) 0 siblings, 3 replies; 29+ messages in thread From: Jarek Poplawski @ 2008-03-29 12:24 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Sat, Mar 29, 2008 at 01:04:16PM +0100, Bernard Pidoux wrote: ... > Please find below an extract of /var/log/messages > The time of interest is around 12:03 > > > Mar 29 11:52:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a820 > Mar 29 11:52:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, > c0f0a820 > Mar 29 11:52:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a820 > Mar 29 11:52:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, > c0f0a820 > Mar 29 11:52:59 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c6ae2bc8, > c0f0a040, 6b6b6b6b, 00000000, 00000000 ... Thanks Bernard! ...On the other hand, if you could hold these patches a while yet and maybe find more of these "AX25:" it should be very helpful (of course with other AX25* lines). Regards, Jarek P. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-29 12:24 ` Jarek Poplawski @ 2008-03-30 8:43 ` Bernard Pidoux 2008-03-30 9:16 ` Jarek Poplawski 2008-03-30 9:00 ` Bernard Pidoux [not found] ` <47EE38BA.9090500@free.fr> 2 siblings, 1 reply; 29+ messages in thread From: Bernard Pidoux @ 2008-03-30 8:43 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski [-- Attachment #1: Type: text/plain, Size: 140 bytes --] Hi Jarek, please find attached another collection of data from /var/log/kernel/info.log that I bziped for it is rather large. Bernard [-- Attachment #2: AX25_kernel_debug_info.bz2 --] [-- Type: application/x-bzip, Size: 4904 bytes --] ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-30 8:43 ` Bernard Pidoux @ 2008-03-30 9:16 ` Jarek Poplawski 2008-03-30 17:38 ` Bernard Pidoux 0 siblings, 1 reply; 29+ messages in thread From: Jarek Poplawski @ 2008-03-30 9:16 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Sun, Mar 30, 2008 at 10:43:07AM +0200, Bernard Pidoux wrote: > Hi Jarek, Hi Bernard, > > please find attached another collection of data from > /var/log/kernel/info.log that I bziped for it is rather large. Thanks again. It looks like ROSE sockets aren't released properly. Here is a try to fix this. Could you test it with all previous patches present? Regards, Jarek P. (patch #5) --- diff -Nurp 2.6.24.4-/net/rose/af_rose.c 2.6.24.4+/net/rose/af_rose.c --- 2.6.24.4-/net/rose/af_rose.c 2008-01-24 23:58:37.000000000 +0100 +++ 2.6.24.4+/net/rose/af_rose.c 2008-03-30 10:53:19.000000000 +0200 @@ -599,17 +599,24 @@ static int rose_release(struct socket *s if (sk == NULL) return 0; + sock_hold(sk); + sock_orphan(sk); + lock_sock(sk); rose = rose_sk(sk); switch (rose->state) { case ROSE_STATE_0: + release_sock(sk); rose_disconnect(sk, 0, -1, -1); + lock_sock(sk); rose_destroy_socket(sk); break; case ROSE_STATE_2: rose->neighbour->use--; + release_sock(sk); rose_disconnect(sk, 0, -1, -1); + lock_sock(sk); rose_destroy_socket(sk); break; @@ -634,6 +641,8 @@ static int rose_release(struct socket *s } sock->sk = NULL; + release_sock(sk); + sock_put(sk); return 0; } ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-30 9:16 ` Jarek Poplawski @ 2008-03-30 17:38 ` Bernard Pidoux 2008-03-30 18:49 ` Jarek Poplawski 0 siblings, 1 reply; 29+ messages in thread From: Bernard Pidoux @ 2008-03-30 17:38 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski [-- Attachment #1: Type: text/plain, Size: 2588 bytes --] Jarek Poplawski wrote: > On Sun, Mar 30, 2008 at 10:43:07AM +0200, Bernard Pidoux wrote: >> Hi Jarek, > > Hi Bernard, >> please find attached another collection of data from >> /var/log/kernel/info.log that I bziped for it is rather large. > > Thanks again. It looks like ROSE sockets aren't released properly. > Here is a try to fix this. Could you test it with all previous patches > present? > > Regards, > Jarek P. > > (patch #5) > --- > > diff -Nurp 2.6.24.4-/net/rose/af_rose.c 2.6.24.4+/net/rose/af_rose.c > --- 2.6.24.4-/net/rose/af_rose.c 2008-01-24 23:58:37.000000000 +0100 > +++ 2.6.24.4+/net/rose/af_rose.c 2008-03-30 10:53:19.000000000 +0200 > @@ -599,17 +599,24 @@ static int rose_release(struct socket *s > > if (sk == NULL) return 0; > > + sock_hold(sk); > + sock_orphan(sk); > + lock_sock(sk); > rose = rose_sk(sk); > > switch (rose->state) { > case ROSE_STATE_0: > + release_sock(sk); > rose_disconnect(sk, 0, -1, -1); > + lock_sock(sk); > rose_destroy_socket(sk); > break; > > case ROSE_STATE_2: > rose->neighbour->use--; > + release_sock(sk); > rose_disconnect(sk, 0, -1, -1); > + lock_sock(sk); > rose_destroy_socket(sk); > break; > > @@ -634,6 +641,8 @@ static int rose_release(struct socket *s > } > > sock->sk = NULL; > + release_sock(sk); > + sock_put(sk); > > return 0; > } > -- Jarek, It looks like you hit the right target ! There is no more warnings and no more ax25_frames_acked or sk_ax25_debug. We only get ax25_create and ax25_release data, plus ax25_make_new when there is an AX25 connexion. cat /var/log/messages | grep 'Mar 30 17' | grep AX... Mar 30 17:00:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6738, c3300040 Mar 30 17:00:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6738, c3300040 Mar 30 17:00:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6738, c3300040 Mar 30 17:00:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6738, c3300040 Mar 30 17:01:23 f6bvp-9 kernel: AX25; ax25_make_new, 943, c73a6738, c762a820 Mar 30 17:01:23 f6bvp-9 kernel: AX25= ax25_accept, 1386, c73a6738, c762a820, c3300040 Mar 30 17:01:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6f68, c7673ac0 Mar 30 17:01:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6f68, c7673ac0 Mar 30 17:01:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6f68, c7673ac0 Please excuse the following questions if you find they are too naive. Could you tell us how did you suspect ROSE socket from the data collected ? and why improperly released ROSE sockets could interfere with AX25 ? Regards, Bernard P. [-- Attachment #2: AX25.kernel.debug5.bz2 --] [-- Type: application/x-bzip, Size: 869 bytes --] ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-30 17:38 ` Bernard Pidoux @ 2008-03-30 18:49 ` Jarek Poplawski 0 siblings, 0 replies; 29+ messages in thread From: Jarek Poplawski @ 2008-03-30 18:49 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Sun, Mar 30, 2008 at 07:38:51PM +0200, Bernard Pidoux wrote: ... > There is no more warnings and no more ax25_frames_acked or > sk_ax25_debug. > > We only get ax25_create and ax25_release data, plus ax25_make_new when > there is an AX25 connexion. > > cat /var/log/messages | grep 'Mar 30 17' | grep AX... > Mar 30 17:00:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6738, c3300040 > Mar 30 17:00:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6738, c3300040 > Mar 30 17:00:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6738, c3300040 > Mar 30 17:00:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6738, c3300040 > Mar 30 17:01:23 f6bvp-9 kernel: AX25; ax25_make_new, 943, c73a6738, c762a820 > Mar 30 17:01:23 f6bvp-9 kernel: AX25= ax25_accept, 1386, c73a6738, > c762a820, c3300040 > Mar 30 17:01:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6f68, c7673ac0 > Mar 30 17:01:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6f68, c7673ac0 > Mar 30 17:01:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6f68, c7673ac0 Yes, if it's only like this, it's OK. > > > Please excuse the following questions if you find they are too naive. > Could you tell us how did you suspect ROSE socket from the data > collected ? and why improperly released ROSE sockets could interfere > with AX25 ? No problem! Patch #3 added to "sk_ax25_debug =" sk->sk_family as the 2nd number, and 11 according to include/linux/socket.h means AF_ROSE. sock_def_write() function in net/core/sock.c where the OOPs triggered runs some cleaning on sockets when their skbs are kfreed, but this shouldn't be done after socket had been closed (sock_orphan() removes some pointers). When ROSE sends it's skbs with ax25_send_frame(), they are added to AX25 queues, and kfreed after transmitting. If it's after ROSE socket had been released, but not properly updated, the cleaning is done on kfreed memory not used by the socket anymore. Cheers, Jarek P. ^ permalink raw reply [flat|nested] 29+ messages in thread
* Re: [AX25] kernel panic 2008-03-29 12:24 ` Jarek Poplawski 2008-03-30 8:43 ` Bernard Pidoux @ 2008-03-30 9:00 ` Bernard Pidoux [not found] ` <47EE38BA.9090500@free.fr> 2 siblings, 0 replies; 29+ messages in thread From: Bernard Pidoux @ 2008-03-30 9:00 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek, I enlarged grep filter in order to grab AX.25 data that might be interesting too. And this is the result : # cat /var/log/kernel/info.log | grep AX... Mar 30 10:19:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c74322e0 Mar 30 10:19:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c74322e0 Mar 30 10:19:13 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c2aa4130, c74322e0, 6b6b6b6b, 00000000, 00000000 Mar 30 10:19:59 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7a70, c74322e0 Mar 30 10:19:59 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7a70, c74322e0 Mar 30 10:20:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7a70, c74322e0 Mar 30 10:20:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7a70, c74322e0 Mar 30 10:20:59 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c74322e0 Mar 30 10:20:59 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c74322e0 Mar 30 10:21:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c74322e0 Mar 30 10:21:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c74322e0 Mar 30 10:21:59 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c74322e0 Mar 30 10:21:59 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c74322e0 Mar 30 10:22:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c74322e0 Mar 30 10:22:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c74322e0 Mar 30 10:22:37 f6bvp-9 kernel: AX25; ax25_make_new, 943, c14e7a70, c51ad820 Mar 30 10:22:37 f6bvp-9 kernel: AX25= ax25_accept, 1386, c14e7a70, c51ad820, c74322e0 Mar 30 10:22:38 f6bvp-9 kernel: AX.25: sendto: Addresses built. Mar 30 10:22:38 f6bvp-9 kernel: AX.25: sendto: building packet. Mar 30 10:22:38 f6bvp-9 kernel: AX.25: Appending user data Mar 30 10:22:38 f6bvp-9 kernel: AX.25: Transmitting buffer Mar 30 10:22:39 f6bvp-9 kernel: AX.25: sendto: Addresses built. Mar 30 10:22:39 f6bvp-9 kernel: AX.25: sendto: building packet. Mar 30 10:22:39 f6bvp-9 kernel: AX.25: Appending user data Mar 30 10:22:39 f6bvp-9 kernel: AX.25: Transmitting buffer Mar 30 10:22:39 f6bvp-9 kernel: AX.25: sendto: Addresses built. Mar 30 10:22:39 f6bvp-9 kernel: AX.25: sendto: building packet. Mar 30 10:22:39 f6bvp-9 kernel: AX.25: Appending user data Mar 30 10:22:39 f6bvp-9 kernel: AX.25: Transmitting buffer Mar 30 10:22:48 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c0f72290, c744a580, 6b6b6b6b, 00000000, 00000000 Mar 30 10:22:59 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:22:59 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:23:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:23:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:23:59 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:24:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:24:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:24:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:24:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:24:53 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:24:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:24:53 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:25:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:25:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:25:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:25:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:26:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:26:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:26:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:26:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:27:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c744a580 Mar 30 10:27:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c744a580 Mar 30 10:27:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c744a580 Mar 30 10:27:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c744a580 Mar 30 10:28:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:28:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:28:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:28:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:29:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c744a580 Mar 30 10:29:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c744a580 Mar 30 10:29:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c744a580 Mar 30 10:29:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c744a580 Mar 30 10:30:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c77bd040 Mar 30 10:30:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c77bd040 Mar 30 10:30:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c7527040 Mar 30 10:30:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c7527040 Mar 30 10:31:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:31:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:31:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:31:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:31:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:31:53 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:31:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:31:53 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:32:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:32:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:32:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:32:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:32:38 f6bvp-9 kernel: AX.25: sendto: Addresses built. Mar 30 10:32:38 f6bvp-9 kernel: AX.25: sendto: building packet. Mar 30 10:32:38 f6bvp-9 kernel: AX.25: Appending user data Mar 30 10:32:38 f6bvp-9 kernel: AX.25: Transmitting buffer Mar 30 10:32:39 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7a70, c74322e0 Mar 30 10:32:52 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c0f72aa8, c74322e0, 6b6b6b6b, 00000000, 00000000 Mar 30 10:32:52 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c0f732c0, c779cd60, 6b6b6b6b, 00000000, 00000000 Mar 30 10:33:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c779cd60 Mar 30 10:33:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c779cd60 # Regards, Bernard ^ permalink raw reply [flat|nested] 29+ messages in thread
[parent not found: <47EE38BA.9090500@free.fr>]
[parent not found: <20080329130451.GC3407@ami.dom.local>]
[parent not found: <47EF6479.7030702@free.fr>]
[parent not found: <20080330115958.GA4975@ami.dom.local>]
* Re: [AX25] kernel panic [not found] ` <20080330115958.GA4975@ami.dom.local> @ 2008-04-01 20:37 ` Bernard Pidoux 2008-04-02 6:41 ` [ROSE/AX25] af_rose: rose_release() fix Jarek Poplawski 0 siblings, 1 reply; 29+ messages in thread From: Bernard Pidoux @ 2008-04-01 20:37 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Jarek Poplawski, Linux Netdev List, Ralf Baechle DL5RB Jarek Poplawski wrote: > On Sun, Mar 30, 2008 at 11:59:21AM +0200, Bernard Pidoux wrote: > ... >> I would not be surprised if ROSE was involved as, remember, I first >> found the bug when I closed an AX25 session established through a level >> 3 ROSE network (FPAC) via AXUDP link (ax25ipd). As I said in my first >> bug report, the bug is not triggered when connecting locally or via AX25 >> call through LAN. Thus ROSE level is involved. >> >> However, I guess that lower layer (AX25) should stand a possible error >> in the upper layer protocol (ROSE). > > I think ROSE breaks some general rules here: bugs trigger in sock.c > code when ROSE packets are destroyed after closing its sockets, but > without proper information on this. > >> ROSE is actually an AX25 packet routing protocol with only three byte >> offset added to AX25 frames (encapsulation). Of course it has its own >> bugs... > > Probably... BTW, my today's patch adds some locking, so there is always > some risk of a lockup or some new lockdep warning. And if accidentally > it works, after testing with these debugging patches there would be > needed later a test of this #5 alone, as well. > > Thanks, > Jarek P. > > I did what you suggested and reversed your patches #2,#3 and #4 to verify that there was no system incompatibilities with the new locks you introduced into rose_release(). Patch #1 has also been removed on another machine running a 64 bit Core2 duo CPU. Three Linux boxes have been are running for more than 24 hours now with only patch #5. They handled a lot of AX25 connections with no problems. Thus, we can reasonably expect that things are going to stay stable. If you want to commit patch#5 I will sustain it very much. I hope that it will be accepted quickly in order to make a coherent system with AX25 patches already applied or not yet applied (if any). Thank you very much Jarek for this very nice job. Best regards, Bernard Pidoux, F6BVP ^ permalink raw reply [flat|nested] 29+ messages in thread
* [ROSE/AX25] af_rose: rose_release() fix 2008-04-01 20:37 ` Bernard Pidoux @ 2008-04-02 6:41 ` Jarek Poplawski 2008-04-02 6:56 ` David Miller 0 siblings, 1 reply; 29+ messages in thread From: Jarek Poplawski @ 2008-04-02 6:41 UTC (permalink / raw) To: David S. Miller; +Cc: Bernard Pidoux, Ralf Baechle DL5RB, Linux Netdev List On Tue, Apr 01, 2008 at 10:37:02PM +0200, Bernard Pidoux wrote: ... > Three Linux boxes have been are running for more than 24 hours now with > only patch #5. They handled a lot of AX25 connections with no problems. > > Thus, we can reasonably expect that things are going to stay stable. > > If you want to commit patch#5 I will sustain it very much. > > I hope that it will be accepted quickly in order to make a coherent > system with AX25 patches already applied or not yet applied (if any). > > Thank you very much Jarek for this very nice job. The same to you Bernard! David & Ralf: Here I resend the testing patch #5 from this thread: (the only change - it's against current netdev tree, so 1 line offset added). Thanks, Jarek P. --------------------> Subject: [ROSE/AX25] af_rose: rose_release() fix rose_release() doesn't release sockets properly, e.g. it skips sock_orphan(), so OOPSes are triggered in sock_def_write_space(), which was observed especially while ROSE skbs were kfreed from ax25_frames_acked(). There is also sock_hold() and lock_sock() added - similarly to ax25_release(). Thanks to Bernard Pidoux for substantial help in debugging this problem. Signed-off-by: Jarek Poplawski <jarkao2@gmail.com> Reported-and-tested-by: Bernard Pidoux <bpidoux@free.fr> Cc: Ralf Baechle DL5RB <ralf@linux-mips.org> --- net/rose/af_rose.c | 9 +++++++++ 1 files changed, 9 insertions(+), 0 deletions(-) diff --git a/net/rose/af_rose.c b/net/rose/af_rose.c index 92d85c3..d1ff3f8 100644 --- a/net/rose/af_rose.c +++ b/net/rose/af_rose.c @@ -598,17 +598,24 @@ static int rose_release(struct socket *sock) if (sk == NULL) return 0; + sock_hold(sk); + sock_orphan(sk); + lock_sock(sk); rose = rose_sk(sk); switch (rose->state) { case ROSE_STATE_0: + release_sock(sk); rose_disconnect(sk, 0, -1, -1); + lock_sock(sk); rose_destroy_socket(sk); break; case ROSE_STATE_2: rose->neighbour->use--; + release_sock(sk); rose_disconnect(sk, 0, -1, -1); + lock_sock(sk); rose_destroy_socket(sk); break; @@ -633,6 +640,8 @@ static int rose_release(struct socket *sock) } sock->sk = NULL; + release_sock(sk); + sock_put(sk); return 0; } ^ permalink raw reply related [flat|nested] 29+ messages in thread
* Re: [ROSE/AX25] af_rose: rose_release() fix 2008-04-02 6:41 ` [ROSE/AX25] af_rose: rose_release() fix Jarek Poplawski @ 2008-04-02 6:56 ` David Miller 0 siblings, 0 replies; 29+ messages in thread From: David Miller @ 2008-04-02 6:56 UTC (permalink / raw) To: jarkao2; +Cc: bpidoux, ralf, netdev From: Jarek Poplawski <jarkao2@gmail.com> Date: Wed, 2 Apr 2008 06:41:07 +0000 > Here I resend the testing patch #5 from this thread: (the only change > - it's against current netdev tree, so 1 line offset added). > } Thanks so much for fixing this bug, applied to net-2.6 ^ permalink raw reply [flat|nested] 29+ messages in thread
end of thread, other threads:[~2008-04-02 6:56 UTC | newest]
Thread overview: 29+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2008-03-18 10:44 [AX25] kernel panic Bernard Pidoux F6BVP
2008-03-18 21:25 ` Francois Romieu
2008-03-19 7:36 ` Bernard Pidoux F6BVP
2008-03-19 20:57 ` Bernard Pidoux
2008-03-20 7:30 ` Jarek Poplawski
2008-03-20 22:58 ` Bernard Pidoux
2008-03-21 0:28 ` Jarek Poplawski
2008-03-21 9:52 ` Bernard Pidoux
2008-03-21 11:22 ` Jarek Poplawski
2008-03-21 9:40 ` Bernard Pidoux
2008-03-22 11:36 ` Jarek Poplawski
2008-03-23 17:00 ` Bernard Pidoux
2008-03-24 20:51 ` Jarek Poplawski
2008-03-25 13:23 ` Bernard Pidoux
2008-03-25 20:51 ` Jarek Poplawski
2008-03-26 18:35 ` Jarek Poplawski
2008-03-28 8:24 ` Bernard Pidoux
2008-03-28 8:27 ` Bernard Pidoux
2008-03-28 12:07 ` Jarek Poplawski
2008-03-29 12:04 ` Bernard Pidoux
2008-03-29 12:24 ` Jarek Poplawski
2008-03-30 8:43 ` Bernard Pidoux
2008-03-30 9:16 ` Jarek Poplawski
2008-03-30 17:38 ` Bernard Pidoux
2008-03-30 18:49 ` Jarek Poplawski
2008-03-30 9:00 ` Bernard Pidoux
[not found] ` <47EE38BA.9090500@free.fr>
[not found] ` <20080329130451.GC3407@ami.dom.local>
[not found] ` <47EF6479.7030702@free.fr>
[not found] ` <20080330115958.GA4975@ami.dom.local>
2008-04-01 20:37 ` Bernard Pidoux
2008-04-02 6:41 ` [ROSE/AX25] af_rose: rose_release() fix Jarek Poplawski
2008-04-02 6:56 ` David Miller
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).