From: Massimo Cetra <ctrixk@navynet.it>
To: David Miller <davem@davemloft.net>
Cc: rjw@sisk.pl, linux-kernel@vger.kernel.org,
kernel-testers@vger.kernel.org, netdev@vger.kernel.org
Subject: Re: [Bug #14378] Problems with net/core/skbuff.c
Date: Tue, 13 Oct 2009 11:11:17 +0200 [thread overview]
Message-ID: <4AD44435.3050703@navynet.it> (raw)
In-Reply-To: <20091012.034224.64980795.davem@davemloft.net>
[-- Attachment #1: Type: text/plain, Size: 959 bytes --]
David Miller ha scritto:
> From: "Rafael J. Wysocki" <rjw@sisk.pl>
> Date: Mon, 12 Oct 2009 00:22:04 +0200 (CEST)
>
>
>> Bug-Entry : http://bugzilla.kernel.org/show_bug.cgi?id=14378
>> Subject : Problems with net/core/skbuff.c
>> Submitter : Massimo Cetra <mcetra@navynet.it>
>> Date : 2009-10-08 14:51 (4 days old)
>> References : http://marc.info/?l=linux-kernel&m=125501488220358&w=4
>>
>
> I don't know what to do about this one.
>
> The user indicates that they have the vserver patches applied,
> so maybe there is some interaction with that stuff.
>
Actually i found another oops which is very similar to the previous one.
Here, vserver is not involved, and the problem starts at drbd which
lives in kernel space (the other oops started at ocfs2).
Both ocfs2 and drbd make heavy use of network I/O so i guess the problem
is something in the network layer.
Anything i can do to help to debugging and solving this issue ?
Thanks
Max
[-- Attachment #2: oops2.txt --]
[-- Type: text/plain, Size: 122916 bytes --]
[60257.728500] ------------[ cut here ]------------
[60257.728500] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60257.728500] Hardware name:
[60257.728500] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60257.728500] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60257.728500] Call Trace:
[60257.728500] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60257.728500] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60257.728500] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60257.728500] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60257.728500] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60257.728500] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60257.728500] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60257.728500] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60257.728500] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60257.728500] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60257.728500] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60257.728500] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60257.728500] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60257.728500] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60257.728500] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60257.728500] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60257.728500] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60257.728500] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60257.728500] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60257.728500] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60257.728500] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60257.728500] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60257.728500] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60257.728500] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60257.728500] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60257.728500] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60257.728500] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60257.728500] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60257.728500] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60257.728500] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60257.728500] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60257.728500] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60257.728500] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60257.728500] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60257.728500] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60257.728500] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60257.728500] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60257.728500] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60257.728500] ---[ end trace 694817acca794f2c ]---
[60257.728500] ------------[ cut here ]------------
[60257.728500] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60257.728500] Hardware name:
[60257.728500] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60257.728500] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60257.728500] Call Trace:
[60257.728500] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60257.728500] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60257.728500] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60257.728500] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60257.728500] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60257.728500] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60257.728500] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60257.728500] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60257.728500] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60257.728500] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60257.728500] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60257.728500] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60257.728500] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60257.728500] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60257.728500] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60257.728500] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60257.728500] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60257.728500] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60257.728500] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60257.728500] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60257.728500] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60257.728500] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60257.728500] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60257.728500] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60257.728500] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60257.728500] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60257.728500] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60257.728500] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60257.728500] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60257.728500] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60257.728500] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60257.728500] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60257.728500] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60257.728500] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60257.728500] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60257.728500] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60257.728500] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60257.728500] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60257.728500] ---[ end trace 694817acca794f2d ]---
[60257.728500] ------------[ cut here ]------------
[60257.728500] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60257.728500] Hardware name:
[60257.728500] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60257.728500] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60257.728500] Call Trace:
[60257.728500] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60257.728500] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60257.728500] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60257.728500] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60257.728500] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60257.728500] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60257.728500] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60257.728500] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60257.728500] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60257.728500] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60257.728500] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60257.728500] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60257.728500] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60257.728500] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60257.728500] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60257.728500] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60257.728500] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60257.728500] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60257.728500] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60257.728500] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60257.728500] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60257.728500] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60257.728500] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60257.728500] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60257.728500] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60257.728500] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60257.728500] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60257.728500] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60257.728500] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60257.728500] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60257.728500] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60257.728500] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60257.728500] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60257.728500] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60257.728500] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60257.728500] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60257.728500] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60257.728500] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60257.728500] ---[ end trace 694817acca794f2e ]---
[60257.728500] ------------[ cut here ]------------
[60257.728500] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60257.728500] Hardware name:
[60257.728500] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60257.728500] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60257.728500] Call Trace:
[60257.728500] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60257.728500] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60257.728500] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60257.728500] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60257.728500] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60257.728500] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60257.728500] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60257.728500] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60257.728500] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60257.728500] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60257.728500] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60257.728500] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60257.728500] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60257.728500] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60257.728500] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60257.728500] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60257.728500] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60257.728500] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60257.728500] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60257.728500] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60257.728500] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60257.728500] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60257.728500] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60257.728500] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60257.728500] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60257.728500] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60257.728500] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60257.728500] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60257.728500] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60257.728500] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60257.728500] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60257.728500] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60257.728500] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60257.728500] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60257.728500] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60257.728500] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60257.728500] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60257.728500] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60257.728500] ---[ end trace 694817acca794f2f ]---
[60257.728500] ------------[ cut here ]------------
[60257.728500] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60257.728500] Hardware name:
[60257.728500] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60257.728500] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60257.728500] Call Trace:
[60257.728500] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60257.728500] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60257.728500] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60257.728500] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60257.728500] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60257.728500] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60257.728500] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60257.728500] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60257.728500] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60257.728500] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60257.728500] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60257.728500] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60257.728500] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60257.728500] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60257.728500] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60257.728500] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60257.728500] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60257.728500] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60257.728500] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60257.728500] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60257.728500] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60257.728500] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60257.728500] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60257.728500] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60257.728500] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60257.728500] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60257.728500] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60257.728500] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60257.728500] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60257.728500] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60257.728500] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60257.728500] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60257.728500] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60257.728500] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60257.728500] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60257.728500] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60257.728500] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60257.728500] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60257.728500] ---[ end trace 694817acca794f30 ]---
[60257.728500] ------------[ cut here ]------------
[60257.728500] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60257.728500] Hardware name:
[60257.728500] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60257.728500] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60257.728500] Call Trace:
[60257.728500] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60257.728500] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60257.728500] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60257.728500] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60257.728500] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60257.728500] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60257.728500] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60257.728500] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60257.728500] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60257.728500] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60257.728500] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60257.728500] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60257.728500] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60257.728500] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60257.728500] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60257.728500] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60257.728500] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60257.728500] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60257.728500] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60257.728500] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60257.728500] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60257.728500] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60257.728500] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60257.728500] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60257.728500] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60257.728500] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60257.728500] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60257.728500] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60257.728500] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60257.728500] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60257.728500] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60257.728500] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60257.728500] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60257.728500] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60257.728500] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60257.728500] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60257.728500] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60257.728500] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60257.728500] ---[ end trace 694817acca794f31 ]---
[60257.728500] ------------[ cut here ]------------
[60257.728500] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60257.728500] Hardware name:
[60257.728500] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60257.728500] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60257.728500] Call Trace:
[60257.728500] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60257.728500] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60257.728500] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60257.728500] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60257.728500] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60257.728500] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60257.728500] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60257.728500] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60257.728500] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60257.728500] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60257.728500] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60257.728500] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60257.728500] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60257.728500] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60257.728500] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60257.728500] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60257.728500] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60257.728500] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60257.728500] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60257.728500] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60257.728500] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60257.728500] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60257.728500] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60257.728500] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60257.728500] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60257.728500] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60257.728500] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60257.728500] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60257.728500] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60257.728500] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60257.728500] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60257.728500] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60257.728500] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60257.728500] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60257.728500] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60257.728500] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60257.728500] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60257.728500] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60257.728500] ---[ end trace 694817acca794f32 ]---
[60257.728500] ------------[ cut here ]------------
[60257.728500] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60257.728500] Hardware name:
[60257.728500] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60257.728500] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60257.728500] Call Trace:
[60257.728500] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60257.728500] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60257.728500] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60257.728500] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60257.728500] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60257.728500] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60257.728500] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60257.728500] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60257.728500] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60257.728500] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60257.728500] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60257.728500] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60257.728500] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60257.728500] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60257.728500] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60257.728500] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60257.728500] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60257.728500] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60257.728500] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60257.728500] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60257.728500] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60257.728500] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60257.728500] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60257.728500] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60257.728500] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60257.728500] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60257.728500] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60257.728500] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60257.728500] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60257.728500] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60257.728500] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60257.728500] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60257.728500] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60257.728500] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60257.728500] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60257.728500] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60257.728500] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60257.728500] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60257.728500] ---[ end trace 694817acca794f33 ]---
[60257.728500] ------------[ cut here ]------------
[60257.728500] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60257.728500] Hardware name:
[60257.728500] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60257.728500] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60257.728500] Call Trace:
[60257.728500] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60257.728500] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60257.728500] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60257.728500] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60257.728500] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60257.728500] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60257.728500] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60257.728500] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60257.728500] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60257.728500] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60257.728500] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60257.728500] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60257.728500] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60257.728500] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60257.728500] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60257.728500] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60257.728500] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60257.728500] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60257.728500] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60257.728500] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60257.728500] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60257.728500] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60257.728500] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60257.728500] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60257.728500] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60257.728500] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60257.728500] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60257.728500] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60257.728500] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60257.728500] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60257.728500] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60257.728500] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60257.728500] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60257.728500] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60257.728500] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60257.728500] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60257.728500] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60257.728500] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60257.728500] ---[ end trace 694817acca794f34 ]---
[60257.728500] ------------[ cut here ]------------
[60257.728500] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60257.728500] Hardware name:
[60257.728500] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60257.728500] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60257.728500] Call Trace:
[60257.728500] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60257.728500] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60257.728500] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60257.728500] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60257.728500] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60257.728500] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60257.728500] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60257.728500] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60257.728500] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60257.728500] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60257.728500] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60257.728500] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60257.728500] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60257.728500] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60257.728500] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60257.728500] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60257.728500] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60257.728500] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60257.728500] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60257.728500] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60257.728500] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60257.728500] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60257.728500] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60257.728500] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60257.728500] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60257.728500] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60257.728500] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60257.728500] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60257.728500] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60257.728500] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60257.728500] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60257.728500] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60257.728500] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60257.728500] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60257.728500] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60257.728500] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60257.728500] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60257.728500] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60257.728500] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60257.728500] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60257.728500] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60257.728500] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60257.728500] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60257.728500] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60257.728500] ---[ end trace 694817acca794f35 ]---
[60258.036152] ------------[ cut here ]------------
[60258.036152] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60258.036152] Hardware name:
[60258.036152] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60258.036152] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60258.036152] Call Trace:
[60258.036152] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60258.036152] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60258.036152] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60258.036152] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60258.036152] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60258.036152] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60258.036152] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60258.036152] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60258.036152] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60258.036152] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60258.036152] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60258.036152] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60258.036152] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60258.036152] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60258.036152] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60258.036152] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60258.036152] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60258.036152] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60258.036152] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60258.036152] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60258.036152] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60258.036152] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60258.036152] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60258.036152] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60258.036152] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60258.036152] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60258.036152] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60258.036152] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60258.036152] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60258.036152] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60258.036152] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60258.036152] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60258.036152] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60258.036152] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60258.036152] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60258.036152] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60258.036152] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60258.036152] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60258.036152] ---[ end trace 694817acca794f36 ]---
[60258.036152] ------------[ cut here ]------------
[60258.036152] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60258.036152] Hardware name:
[60258.036152] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60258.036152] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60258.036152] Call Trace:
[60258.036152] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60258.036152] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60258.036152] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60258.036152] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60258.036152] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60258.036152] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60258.036152] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60258.036152] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60258.036152] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60258.036152] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60258.036152] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60258.036152] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60258.036152] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60258.036152] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60258.036152] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60258.036152] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60258.036152] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60258.036152] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60258.036152] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60258.036152] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60258.036152] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60258.036152] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60258.036152] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60258.036152] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60258.036152] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60258.036152] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60258.036152] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60258.036152] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60258.036152] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60258.036152] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60258.036152] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60258.036152] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60258.036152] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60258.036152] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60258.036152] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60258.036152] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60258.036152] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60258.036152] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60258.036152] ---[ end trace 694817acca794f37 ]---
[60258.036152] ------------[ cut here ]------------
[60258.036152] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60258.036152] Hardware name:
[60258.036152] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60258.036152] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60258.036152] Call Trace:
[60258.036152] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60258.036152] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60258.036152] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60258.036152] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60258.036152] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60258.036152] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60258.036152] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60258.036152] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60258.036152] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60258.036152] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60258.036152] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60258.036152] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60258.036152] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60258.036152] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60258.036152] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60258.036152] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60258.036152] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60258.036152] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60258.036152] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60258.036152] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60258.036152] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60258.036152] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60258.036152] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60258.036152] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60258.036152] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60258.036152] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60258.036152] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60258.036152] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60258.036152] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60258.036152] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60258.036152] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60258.036152] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60258.036152] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60258.036152] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60258.036152] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60258.036152] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60258.036152] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60258.036152] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60258.036152] ---[ end trace 694817acca794f38 ]---
[60258.036152] ------------[ cut here ]------------
[60258.036152] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60258.036152] Hardware name:
[60258.036152] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60258.036152] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60258.036152] Call Trace:
[60258.036152] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60258.036152] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60258.036152] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60258.036152] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60258.036152] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60258.036152] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60258.036152] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60258.036152] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60258.036152] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60258.036152] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60258.036152] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60258.036152] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60258.036152] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60258.036152] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60258.036152] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60258.036152] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60258.036152] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60258.036152] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60258.036152] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60258.036152] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60258.036152] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60258.036152] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60258.036152] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60258.036152] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60258.036152] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60258.036152] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60258.036152] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60258.036152] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60258.036152] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60258.036152] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60258.036152] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60258.036152] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60258.036152] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60258.036152] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60258.036152] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60258.036152] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60258.036152] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60258.036152] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60258.036152] ---[ end trace 694817acca794f39 ]---
[60258.036152] ------------[ cut here ]------------
[60258.036152] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60258.036152] Hardware name:
[60258.036152] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60258.036152] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60258.036152] Call Trace:
[60258.036152] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60258.036152] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60258.036152] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60258.036152] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60258.036152] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60258.036152] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60258.036152] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60258.036152] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60258.036152] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60258.036152] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60258.036152] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60258.036152] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60258.036152] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60258.036152] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60258.036152] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60258.036152] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60258.036152] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60258.036152] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60258.036152] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60258.036152] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60258.036152] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60258.036152] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60258.036152] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60258.036152] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60258.036152] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60258.036152] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60258.036152] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60258.036152] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60258.036152] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60258.036152] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60258.036152] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60258.036152] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60258.036152] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60258.036152] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60258.036152] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60258.036152] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60258.036152] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60258.036152] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60258.036152] ---[ end trace 694817acca794f3a ]---
[60258.036152] ------------[ cut here ]------------
[60258.036152] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60258.036152] Hardware name:
[60258.036152] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60258.036152] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60258.036152] Call Trace:
[60258.036152] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60258.036152] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60258.036152] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60258.036152] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60258.036152] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60258.036152] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60258.036152] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60258.036152] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60258.036152] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60258.036152] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60258.036152] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60258.036152] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60258.036152] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60258.036152] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60258.036152] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60258.036152] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60258.036152] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60258.036152] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60258.036152] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60258.036152] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60258.036152] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60258.036152] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60258.036152] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60258.036152] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60258.036152] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60258.036152] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60258.036152] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60258.036152] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60258.036152] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60258.036152] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60258.036152] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60258.036152] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60258.036152] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60258.036152] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60258.036152] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60258.036152] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60258.036152] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60258.036152] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60258.036152] ---[ end trace 694817acca794f3b ]---
[60258.036152] ------------[ cut here ]------------
[60258.036152] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60258.036152] Hardware name:
[60258.036152] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60258.036152] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60258.036152] Call Trace:
[60258.036152] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60258.036152] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60258.036152] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60258.036152] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60258.036152] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60258.036152] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60258.036152] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60258.036152] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60258.036152] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60258.036152] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60258.036152] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60258.036152] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60258.036152] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60258.036152] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60258.036152] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60258.036152] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60258.036152] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60258.036152] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60258.036152] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60258.036152] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60258.036152] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60258.036152] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60258.036152] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60258.036152] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60258.036152] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60258.036152] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60258.036152] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60258.036152] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60258.036152] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60258.036152] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60258.036152] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60258.036152] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60258.036152] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60258.036152] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60258.036152] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60258.036152] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60258.036152] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60258.036152] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60258.036152] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60258.036152] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60258.036152] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60258.036152] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60258.036152] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60258.036152] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60258.036152] ---[ end trace 694817acca794f3c ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f3d ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f3e ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f3f ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f40 ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f41 ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f42 ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f43 ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f44 ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f45 ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f46 ]---
[60259.116162] ------------[ cut here ]------------
[60259.116162] WARNING: at net/core/skbuff.c:398 skb_release_head_state+0x64/0xc8()
[60259.116162] Hardware name:
[60259.116162] Modules linked in: ocfs2 jbd2 quota_tree ocfs2_dlmfs ocfs2_stack_o2cb ocfs2_dlm ocfs2_nodemanager ocfs2_stackglue crc32c netconsole configfs drbd cn loop snd_pcm snd_timer snd soundcore snd_page_alloc serio_raw virtio_net pcspkr psmouse virtio_balloon parport_pc parport button processor i2c_piix4 i2c_core evdev ext3 jbd mbcache dm_mirror dm_region_hash dm_log dm_snapshot dm_mod ide_cd_mod cdrom virtio_blk ata_generic ata_piix libata scsi_mod virtio_pci virtio_ring virtio piix ide_pci_generic ide_core floppy thermal fan thermal_sys
[60259.116162] Pid: 1814, comm: drbd1_receiver Tainted: G W 2.6.31.2-vserver-navynet #1
[60259.116162] Call Trace:
[60259.116162] <IRQ> [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81049ae1>] ? warn_slowpath_common+0x77/0xa3
[60259.116162] [<ffffffff81253cd5>] ? skb_release_head_state+0x64/0xc8
[60259.116162] [<ffffffff81253a1a>] ? __kfree_skb+0x9/0x7d
[60259.116162] [<ffffffffa01e2139>] ? free_old_xmit_skbs+0x51/0x6e [virtio_net]
[60259.116162] [<ffffffffa01e2c85>] ? start_xmit+0x26/0xf2 [virtio_net]
[60259.116162] [<ffffffff8126934f>] ? netpoll_send_skb+0xd2/0x205
[60259.116162] [<ffffffffa02a2216>] ? write_msg+0x90/0xeb [netconsole]
[60259.116162] [<ffffffff81049f06>] ? __call_console_drivers+0x5e/0x6f
[60259.116162] [<ffffffff8104a082>] ? release_console_sem+0x115/0x1ba
[60259.116162] [<ffffffff8104a632>] ? vprintk+0x2f2/0x34b
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81308309>] ? printk+0x4e/0x5d
[60259.116162] [<ffffffff8102b49d>] ? kvm_clock_read+0x4d/0x52
[60259.116162] [<ffffffff81070b62>] ? getnstimeofday+0x55/0xaf
[60259.116162] [<ffffffff81062683>] ? ktime_get_ts+0x21/0x49
[60259.116162] [<ffffffff810626b7>] ? ktime_get+0xc/0x41
[60259.116162] [<ffffffff81062788>] ? hrtimer_interrupt+0x9c/0x146
[60259.116162] [<ffffffff81024a4b>] ? smp_apic_timer_interrupt+0x80/0x93
[60259.116162] [<ffffffff81011663>] ? apic_timer_interrupt+0x13/0x20
[60259.116162] <EOI> [<ffffffff81157811>] ? cap_socket_recvmsg+0x0/0x3
[60259.116162] [<ffffffff8130a9eb>] ? _spin_unlock_irq+0xd/0x31
[60259.116162] [<ffffffff8103e6de>] ? finish_task_switch+0x5b/0xec
[60259.116162] [<ffffffff81308f73>] ? thread_return+0x47/0xd5
[60259.116162] [<ffffffff81293cc8>] ? tcp_current_mss+0x3f/0x5a
[60259.116162] [<ffffffff81309213>] ? schedule_timeout+0x21/0x197
[60259.116162] [<ffffffff8104f482>] ? local_bh_disable+0xe/0x10
[60259.116162] [<ffffffff8130a7bf>] ? _spin_lock_bh+0x13/0x29
[60259.116162] [<ffffffff8124f6ba>] ? release_sock+0x19/0xc3
[60259.116162] [<ffffffff8124fd9b>] ? sk_wait_data+0x85/0xca
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff812892ab>] ? tcp_prequeue_process+0x9d/0xac
[60259.116162] [<ffffffff8128a4ae>] ? tcp_recvmsg+0x421/0xabd
[60259.116162] [<ffffffff8118d7cb>] ? cfq_add_rq_rb+0xd2/0xe5
[60259.116162] [<ffffffff8124eb4a>] ? sock_common_recvmsg+0x30/0x45
[60259.116162] [<ffffffff8124cde9>] ? sock_recvmsg+0xf7/0x18d
[60259.116162] [<ffffffff8105f762>] ? autoremove_wake_function+0x0/0x2e
[60259.116162] [<ffffffff8130a825>] ? _spin_lock_irqsave+0x25/0x41
[60259.116162] [<ffffffffa0271e4d>] ? _drbd_send_cmd+0x11d/0x1eb [drbd]
[60259.116162] [<ffffffff811851cf>] ? blk_rq_map_sg+0x12d/0x276
[60259.116162] [<ffffffffa025c7d8>] ? drbd_recv+0x74/0x147 [drbd]
[60259.116162] [<ffffffffa025c001>] ? drbd_may_finish_epoch+0x2c4/0x46e [drbd]
[60259.116162] [<ffffffffa025ee5d>] ? drbd_recv_header+0x18/0xc8 [drbd]
[60259.116162] [<ffffffffa025ef39>] ? drbdd+0x2c/0x1d6 [drbd]
[60259.116162] [<ffffffffa026212b>] ? drbdd_init+0xf2/0x14a [drbd]
[60259.116162] [<ffffffffa0273275>] ? drbd_thread_setup+0x16f/0x231 [drbd]
[60259.116162] [<ffffffff81011b9a>] ? child_rip+0xa/0x20
[60259.116162] [<ffffffff811b1e73>] ? vgacon_cursor+0x0/0x1a4
[60259.116162] [<ffffffffa0273106>] ? drbd_thread_setup+0x0/0x231 [drbd]
[60259.116162] [<ffffffff81011b90>] ? child_rip+0x0/0x20
[60259.116162] ---[ end trace 694817acca794f47 ]---
next prev parent reply other threads:[~2009-10-13 9:11 UTC|newest]
Thread overview: 124+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-10-11 22:07 2.6.32-rc4: Reported regressions from 2.6.31 Rafael J. Wysocki
2009-10-11 22:07 ` Rafael J. Wysocki
2009-10-11 22:07 ` Rafael J. Wysocki
2009-10-11 22:15 ` [Bug #14277] Caught 8-bit read from freed memory in b43 driver at association Rafael J. Wysocki
2009-10-11 22:15 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14296] spitz boots but suspend/resume is broken Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14278] New message "NOHZ: local_softirq_pending 08" at each ping request Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-12 13:15 ` Michael Buesch
2009-10-12 13:15 ` Michael Buesch
[not found] ` <200910121515.49393.mb-fseUSCV1ubazQB+pC5nmwQ@public.gmane.org>
2009-10-12 21:49 ` Rafael J. Wysocki
2009-10-12 21:49 ` Rafael J. Wysocki
[not found] ` <200910122349.39408.rjw-KKrjLPT3xs0@public.gmane.org>
2009-10-13 14:27 ` John W. Linville
2009-10-13 14:27 ` John W. Linville
[not found] ` <20091013142726.GA2747-2XuSBdqkA4R54TAoqtyWWQ@public.gmane.org>
2009-10-13 20:50 ` Rafael J. Wysocki
2009-10-13 20:50 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14279] Suspend to RAM freeze totally since 2.6.32-rc1 - Acer Aspire 1511Lmi laptop Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-12 8:09 ` Jan Beulich
[not found] ` <4AD30073020000780001938F-Qfbpwmsw6RoS3W1tAdPHOtBPR1lH4CV8@public.gmane.org>
2009-10-12 21:50 ` Rafael J. Wysocki
2009-10-12 21:50 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14352] WARNING: at net/mac80211/scan.c:267 Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14298] warning at manage.c:361 (set_irq_wake), matrix-keypad related? Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14334] pcmcia suspend regression from 2.6.31.1 to 2.6.31.2 - Dell Inspiron 600m Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14302] Kernel panic on i386 machine when booting with profile=2 Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14299] oops in wireless, iwl3945 related? Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14297] console resume broken since ba15ab0e8d Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14354] Bad corruption with 2.6.32-rc1 and upwards Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14370] ext4 corruptions Rafael J. Wysocki
2009-10-12 6:50 ` Alexey Fisher
2009-10-12 21:53 ` Rafael J. Wysocki
2009-10-12 21:53 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14353] BUG: sleeping function called from invalid context at kernel/mutex.c:280 Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14355] USB serial regression after 2.6.31.1 with Huawei E169 GSM modem Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14374] MCEs caused by commit db8be50c4307dac2b37305fc59c8dc0f978d09ea Rafael J. Wysocki
2009-10-12 13:35 ` Mikael Pettersson
2009-10-12 21:56 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14373] Task blocked for more than 120 seconds Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14372] Wireless not working after suspend-resume Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-12 18:48 ` Fabio Comolli
2009-10-12 18:48 ` Fabio Comolli
2009-10-12 21:55 ` Rafael J. Wysocki
2009-10-13 7:07 ` Maciej Rutecki
2009-10-13 7:07 ` Maciej Rutecki
2009-10-11 22:22 ` [Bug #14375] Intel(R) I/OAT DMA Engine init failed Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14378] Problems with net/core/skbuff.c Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-12 10:42 ` David Miller
2009-10-12 15:07 ` Massimo "CtRiX" Cetra
2009-10-12 15:07 ` [Ocfs2-devel] " Massimo CtRiX Cetra
2009-10-13 9:11 ` Massimo Cetra [this message]
2009-10-13 9:23 ` Massimo Cetra
2009-10-13 10:19 ` Eric Dumazet
2009-10-13 10:25 ` David Miller
2009-10-13 10:26 ` Massimo Cetra
2009-10-14 19:27 ` Massimo Cetra
[not found] ` <4AD62626.6010709-BBpJ+9iBSNKonA0d6jMUrA@public.gmane.org>
2009-10-15 0:36 ` [PATCH] virtio_net: use dev_kfree_skb_any() in free_old_xmit_skbs() Eric Dumazet
2009-10-15 0:36 ` Eric Dumazet
2009-10-15 6:30 ` David Miller
[not found] ` <4AD44435.3050703-BBpJ+9iBSNKonA0d6jMUrA@public.gmane.org>
2009-10-13 10:22 ` [Bug #14378] Problems with net/core/skbuff.c David Miller
2009-10-13 10:22 ` David Miller
[not found] ` <20091013.032237.45775304.davem-fT/PcQaiUtIeIZ0/mPfg9Q@public.gmane.org>
2009-10-13 10:27 ` Massimo Cetra
2009-10-13 10:27 ` Massimo Cetra
2009-10-11 22:22 ` [Bug #14376] Kernel NULL pointer dereference/ kvm subsystem Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14379] ACPI Warning for _SB_.BAT0._BIF: Converted Buffer to expected String Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-12 3:14 ` Justin Mattock
2009-10-12 3:14 ` Justin Mattock
[not found] ` <dd18b0c30910112014m4bfdc238j542864bb9f1e8161-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-10-12 3:35 ` Lin Ming
2009-10-12 3:35 ` Lin Ming
2009-10-12 3:58 ` Justin P. Mattock
2009-10-12 21:58 ` Rafael J. Wysocki
[not found] ` <200910122358.42255.rjw-KKrjLPT3xs0@public.gmane.org>
2009-10-13 3:12 ` Justin P. Mattock
2009-10-13 3:12 ` Justin P. Mattock
2009-10-11 22:22 ` [Bug #14381] iwlagn lost connection after s2ram (with warnings) Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14382] Transmit failure in et131x Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:30 ` Alan Cox
2009-10-11 22:30 ` Alan Cox
2009-10-11 22:22 ` [Bug #14380] Video tearing/glitching with T400 laptops Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14386] GPF in snd_hda_intel Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14383] hackbench regression with kernel 2.6.32-rc1 Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14384] tbench regression with 2.6.32-rc1 Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14387] deadlock with fallocate Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14389] Build system issue Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-13 18:53 ` Sam Ravnborg
2009-10-13 18:53 ` Sam Ravnborg
2009-10-13 20:52 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14392] Touchpad "paste" stops working after suspend to RAM Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 22:22 ` [Bug #14390] "bind" a device to a driver doesn't not work anymore Rafael J. Wysocki
2009-10-11 22:22 ` Rafael J. Wysocki
2009-10-11 23:07 ` 2.6.32-rc4: Reported regressions from 2.6.31 Linus Torvalds
2009-10-12 10:18 ` David Woodhouse
2009-10-12 12:06 ` [PATCH 1/4] Rename pci_init() to pci_apply_final_quirks(), move it to quirks.c David Woodhouse
2009-10-12 12:06 ` [PATCH 2/4] Mark pci_apply_final_quirks() __init rather than __devinit David Woodhouse
2009-10-12 12:06 ` [PATCH 3/4] Run pci_apply_final_quirks() sooner David Woodhouse
2009-10-12 12:06 ` [PATCH 4/4] x86: Move pci_iommu_init to rootfs_initcall() David Woodhouse
2009-10-12 14:26 ` 2.6.32-rc4: Reported regressions from 2.6.31 David Woodhouse
2009-10-12 15:24 ` Linus Torvalds
2009-10-12 15:56 ` David Woodhouse
2009-10-12 16:13 ` Alan Cox
2009-10-12 17:35 ` Linus Torvalds
2009-10-12 20:29 ` David Woodhouse
2009-10-11 23:11 ` Linus Torvalds
2009-10-12 0:02 ` Theodore Tso
-- strict thread matches above, loose matches on Subject: below --
2009-10-26 18:45 2.6.32-rc5-git3: " Rafael J. Wysocki
2009-10-26 18:55 ` [Bug #14378] Problems with net/core/skbuff.c Rafael J. Wysocki
2009-10-26 19:50 ` Eric Dumazet
2009-10-26 19:50 ` Eric Dumazet
[not found] ` <4AE5FD84.8070906-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2009-10-26 20:57 ` Rafael J. Wysocki
2009-10-26 20:57 ` Rafael J. Wysocki
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4AD44435.3050703@navynet.it \
--to=ctrixk@navynet.it \
--cc=davem@davemloft.net \
--cc=kernel-testers@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=netdev@vger.kernel.org \
--cc=rjw@sisk.pl \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.