netdev.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* Bug inkvm_set_irq
@ 2011-02-25  9:07 Jean-Philippe Menil
  2011-02-25 10:36 ` Gleb Natapov
  2011-02-27 17:00 ` Michael S. Tsirkin
  0 siblings, 2 replies; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-02-25  9:07 UTC (permalink / raw)
  To: kvm; +Cc: netdev, virtualization

[-- Attachment #1: Type: text/plain, Size: 6833 bytes --]

Hi,

Each time i try tou use vhost_net, i'm facing a kernel bug.
I do a "modprobe vhost_net", and start guest whith vhost=on.

Following is a trace with a kernel 2.6.37, but  i had the same problem 
with 2.6.36 (cf https://lkml.org/lkml/2010/11/30/29).

The bug only occurs whith vhost_net charged, so i don't know if this is 
a bug in kvm module code or in the vhost_net code.

Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243100] 
BUG: unable to handle kernel paging request at 0000000000002458
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243250] 
IP: [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243378] 
PGD 45d363067 PUD 45e77a067 PMD 0
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243556] 
Oops: 0000 [#1] SMP
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243692] 
last sysfs file: 
/sys/devices/pci0000:00/0000:00:0d.0/0000:05:00.0/0000:06:00.0/irq
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243777] CPU 0
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243820] 
Modules linked in: vhost_net macvtap macvlan tun powernow_k8 mperf 
cpufreq_userspace cpufreq_stats cpufreq_powersave cpufreq_ondemand fre
q_table cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter 
ip6_tables ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state 
iptable_filter ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp 
nf_connt
rack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 mbcache dm_round_robin 
dm_multipath nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 kvm_amd kvm 
ipv6 snd_pcm snd_timer snd soundcore snd_page_alloc tpm_tis tpm ps
mouse dcdbas tpm_bios processor i2c_nforce2 shpchp pcspkr ghes serio_raw 
joydev evdev pci_hotplug i2c_core hed button thermal_sys xfs exportfs 
dm_mod sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosu
re megaraid_sas ohci_hcd lpfc scsi_transport_fc scsi_tgt bnx2 scsi_mod 
ehci_hcd [last unloaded: scsi_wait_scan]
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
Pid: 10, comm: kworker/0:1 Not tainted 2.6.37-dsiun-110105 #17 
0K543T/PowerEdge M605
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
RIP: 0010:[<ffffffffa041aa8a>]  [<ffffffffa041aa8a>] 
kvm_set_irq+0x2a/0x130 [kvm]
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
RSP: 0018:ffff88045fc89d30  EFLAGS: 00010246
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
RAX: 0000000000000000 RBX: 000000000000001a RCX: 0000000000000001
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
RBP: 0000000000000000 R08: 0000000000000001 R09: ffff880856a91e48
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
R10: 0000000000000000 R11: 00000000ffffffff R12: 0000000000000000
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
FS:  00007f617986c710(0000) GS:ffff88007f800000(0000) knlGS:0000000000000000
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
CR2: 0000000000002458 CR3: 000000045d197000 CR4: 00000000000006f0
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
Process kworker/0:1 (pid: 10, threadinfo ffff88045fc88000, task 
ffff88085fc53c30)
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] Stack:
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
ffff88045fc89fd8 00000000000119c0 ffff88045fc88010 ffff88085fc53ee8
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
ffff88045fc89fd8 ffff88085fc53ee0 ffff88085fc53c30 00000000000119c0
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
00000000000119c0 ffffffff8137f7ce ffff88007f80df40 00000000ffffffff
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
Call Trace:
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffff8137f7ce>] ? common_interrupt+0xe/0x13
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffffa041bc57>] ? irqfd_inject+0x27/0x50 [kvm]
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffff8106b6f2>] ? process_one_work+0x112/0x460
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffff8106be25>] ? worker_thread+0x145/0x410
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffff8103a3d0>] ? __wake_up_common+0x50/0x80
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffff8106bce0>] ? worker_thread+0x0/0x410
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffff8106bce0>] ? worker_thread+0x0/0x410
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffff8106f786>] ? kthread+0x96/0xa0
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffff81003ce4>] ? kernel_thread_helper+0x4/0x10
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffff8106f6f0>] ? kthread+0x0/0xa0
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
[<ffffffff81003ce0>] ? kernel_thread_helper+0x0/0x10
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
Code: ff 41 57 41 89 f7 41 56 41 55 41 89 cd 41 54 49 89 fc 55 53 89 d3 
48 81 ec 98 00 00 00 8b 15 c6 79 03 00 85 d2 0f 85 c4 00 00 00 <4
9> 8b 84 24 58 24 00 00 3b 98 28 01 00 00 73 5e 89 db 48 8b 84
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
RIP  [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]  
RSP <ffff88045fc89d30>
Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] 
CR2: 0000000000002458


If someone can help me, on how to solve this.

Regards.

[-- Attachment #2: jean-philippe_menil.vcf --]
[-- Type: text/x-vcard, Size: 281 bytes --]

begin:vcard
fn:Jean-Philippe Menil
n:Menil;Jean-Philippe
org;quoted-printable:Universit=C3=A9 de Nantes;IRTS
adr;dom:;;;Nantes
email;internet:jean-philippe.menil@univ-nantes.fr
title:Reseau
tel;work:02.53.48.49.27
tel;fax:02.53.48.49.97
x-mozilla-html:FALSE
version:2.1
end:vcard


[-- Attachment #3: Type: text/plain, Size: 184 bytes --]

_______________________________________________
Virtualization mailing list
Virtualization@lists.linux-foundation.org
https://lists.linux-foundation.org/mailman/listinfo/virtualization

^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-02-25  9:07 Bug inkvm_set_irq Jean-Philippe Menil
@ 2011-02-25 10:36 ` Gleb Natapov
  2011-02-27 17:00 ` Michael S. Tsirkin
  1 sibling, 0 replies; 27+ messages in thread
From: Gleb Natapov @ 2011-02-25 10:36 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: kvm, netdev, virtualization, mst

CCing Michael in case he missed this.

On Fri, Feb 25, 2011 at 10:07:22AM +0100, Jean-Philippe Menil wrote:
> Hi,
> 
> Each time i try tou use vhost_net, i'm facing a kernel bug.
> I do a "modprobe vhost_net", and start guest whith vhost=on.
> 
> Following is a trace with a kernel 2.6.37, but  i had the same
> problem with 2.6.36 (cf https://lkml.org/lkml/2010/11/30/29).
> 
> The bug only occurs whith vhost_net charged, so i don't know if this
> is a bug in kvm module code or in the vhost_net code.
> 
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243100] BUG: unable to handle kernel paging request at
> 0000000000002458
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243250] IP: [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243378] PGD 45d363067 PUD 45e77a067 PMD 0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243556] Oops: 0000 [#1] SMP
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243692] last sysfs file:
> /sys/devices/pci0000:00/0000:00:0d.0/0000:05:00.0/0000:06:00.0/irq
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243777] CPU 0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243820] Modules linked in: vhost_net macvtap macvlan tun
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand fre
> q_table cpufreq_conservative fuse xt_physdev ip6t_LOG
> ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit xt_tcpudp
> xt_state iptable_filter ip_tables x_tables nf_conntrack_tftp
> nf_conntrack_ftp nf_connt
> rack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 mbcache
> dm_round_robin dm_multipath nf_conntrack_ipv6 nf_conntrack
> nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm snd_timer snd soundcore
> snd_page_alloc tpm_tis tpm ps
> mouse dcdbas tpm_bios processor i2c_nforce2 shpchp pcspkr ghes
> serio_raw joydev evdev pci_hotplug i2c_core hed button thermal_sys
> xfs exportfs dm_mod sg sr_mod cdrom usbhid hid usb_storage ses
> sd_mod enclosu
> re megaraid_sas ohci_hcd lpfc scsi_transport_fc scsi_tgt bnx2
> scsi_mod ehci_hcd [last unloaded: scsi_wait_scan]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] Pid: 10, comm: kworker/0:1 Not tainted
> 2.6.37-dsiun-110105 #17 0K543T/PowerEdge M605
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RIP: 0010:[<ffffffffa041aa8a>]  [<ffffffffa041aa8a>]
> kvm_set_irq+0x2a/0x130 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RSP: 0018:ffff88045fc89d30  EFLAGS: 00010246
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RAX: 0000000000000000 RBX: 000000000000001a RCX:
> 0000000000000001
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
> 0000000000000000
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RBP: 0000000000000000 R08: 0000000000000001 R09:
> ffff880856a91e48
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] R10: 0000000000000000 R11: 00000000ffffffff R12:
> 0000000000000000
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] R13: 0000000000000001 R14: 0000000000000000 R15:
> 0000000000000000
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] FS:  00007f617986c710(0000) GS:ffff88007f800000(0000)
> knlGS:0000000000000000
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] CR2: 0000000000002458 CR3: 000000045d197000 CR4:
> 00000000000006f0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] Process kworker/0:1 (pid: 10, threadinfo
> ffff88045fc88000, task ffff88085fc53c30)
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] Stack:
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  ffff88045fc89fd8 00000000000119c0 ffff88045fc88010
> ffff88085fc53ee8
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  ffff88045fc89fd8 ffff88085fc53ee0 ffff88085fc53c30
> 00000000000119c0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  00000000000119c0 ffffffff8137f7ce ffff88007f80df40
> 00000000ffffffff
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] Call Trace:
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8137f7ce>] ? common_interrupt+0xe/0x13
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffffa041bc57>] ? irqfd_inject+0x27/0x50 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106b6f2>] ? process_one_work+0x112/0x460
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106be25>] ? worker_thread+0x145/0x410
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8103a3d0>] ? __wake_up_common+0x50/0x80
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106f786>] ? kthread+0x96/0xa0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff81003ce4>] ? kernel_thread_helper+0x4/0x10
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106f6f0>] ? kthread+0x0/0xa0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff81003ce0>] ? kernel_thread_helper+0x0/0x10
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] Code: ff 41 57 41 89 f7 41 56 41 55 41 89 cd 41 54 49 89
> fc 55 53 89 d3 48 81 ec 98 00 00 00 8b 15 c6 79 03 00 85 d2 0f 85 c4
> 00 00 00 <4
> 9> 8b 84 24 58 24 00 00 3b 98 28 01 00 00 73 5e 89 db 48 8b 84
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RIP  [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  RSP <ffff88045fc89d30>
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] CR2: 0000000000002458
> 
> 
> If someone can help me, on how to solve this.
> 
> Regards.

> begin:vcard
> fn:Jean-Philippe Menil
> n:Menil;Jean-Philippe
> org;quoted-printable:Universit=C3=A9 de Nantes;IRTS
> adr;dom:;;;Nantes
> email;internet:jean-philippe.menil@univ-nantes.fr
> title:Reseau
> tel;work:02.53.48.49.27
> tel;fax:02.53.48.49.97
> x-mozilla-html:FALSE
> version:2.1
> end:vcard
> 

> _______________________________________________
> Virtualization mailing list
> Virtualization@lists.linux-foundation.org
> https://lists.linux-foundation.org/mailman/listinfo/virtualization


--
			Gleb.

^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-02-25  9:07 Bug inkvm_set_irq Jean-Philippe Menil
  2011-02-25 10:36 ` Gleb Natapov
@ 2011-02-27 17:00 ` Michael S. Tsirkin
  2011-02-28  8:56   ` Jean-Philippe Menil
  1 sibling, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-02-27 17:00 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: kvm, netdev, virtualization

On Fri, Feb 25, 2011 at 10:07:22AM +0100, Jean-Philippe Menil wrote:
> Hi,
> 
> Each time i try tou use vhost_net, i'm facing a kernel bug.
> I do a "modprobe vhost_net", and start guest whith vhost=on.
> 
> Following is a trace with a kernel 2.6.37, but  i had the same
> problem with 2.6.36 (cf https://lkml.org/lkml/2010/11/30/29).

2.6.36 had a theorectical race that could explain this,
but it should be ok in 2.6.37.

> 
> The bug only occurs whith vhost_net charged, so i don't know if this
> is a bug in kvm module code or in the vhost_net code.

It could be a bug in eventfd which is the interface
used by both kvm and vhost_net.
Just for fun, you can try 3.6.38 - eventfd code has been changed
a lot in 2.6.38 and if it does not trigger there
it's a hint that irqfd is the reason.

> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243100] BUG: unable to handle kernel paging request at
> 0000000000002458
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243250] IP: [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]


Could you run markup_oops/ ksymoops on this please?
As far as I can see kvm_set_irq can only get a wrong
kvm pointer. Unless there's some general memory corruption,
I'd guess 

You can also try comparing the irqfd->kvm pointer in
kvm_irqfd_assign irqfd_wakeup and kvm_set_irq in
virt/kvm/eventfd.c.

> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243378] PGD 45d363067 PUD 45e77a067 PMD 0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243556] Oops: 0000 [#1] SMP
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243692] last sysfs file:
> /sys/devices/pci0000:00/0000:00:0d.0/0000:05:00.0/0000:06:00.0/irq
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243777] CPU 0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.243820] Modules linked in: vhost_net macvtap macvlan tun
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand fre
> q_table cpufreq_conservative fuse xt_physdev ip6t_LOG
> ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit xt_tcpudp
> xt_state iptable_filter ip_tables x_tables nf_conntrack_tftp
> nf_conntrack_ftp nf_connt
> rack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 mbcache
> dm_round_robin dm_multipath nf_conntrack_ipv6 nf_conntrack
> nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm snd_timer snd soundcore
> snd_page_alloc tpm_tis tpm ps
> mouse dcdbas tpm_bios processor i2c_nforce2 shpchp pcspkr ghes
> serio_raw joydev evdev pci_hotplug i2c_core hed button thermal_sys
> xfs exportfs dm_mod sg sr_mod cdrom usbhid hid usb_storage ses
> sd_mod enclosu
> re megaraid_sas ohci_hcd lpfc scsi_transport_fc scsi_tgt bnx2
> scsi_mod ehci_hcd [last unloaded: scsi_wait_scan]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] Pid: 10, comm: kworker/0:1 Not tainted
> 2.6.37-dsiun-110105 #17 0K543T/PowerEdge M605
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RIP: 0010:[<ffffffffa041aa8a>]  [<ffffffffa041aa8a>]
> kvm_set_irq+0x2a/0x130 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RSP: 0018:ffff88045fc89d30  EFLAGS: 00010246
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RAX: 0000000000000000 RBX: 000000000000001a RCX:
> 0000000000000001
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
> 0000000000000000
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RBP: 0000000000000000 R08: 0000000000000001 R09:
> ffff880856a91e48
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] R10: 0000000000000000 R11: 00000000ffffffff R12:
> 0000000000000000
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] R13: 0000000000000001 R14: 0000000000000000 R15:
> 0000000000000000
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] FS:  00007f617986c710(0000) GS:ffff88007f800000(0000)
> knlGS:0000000000000000
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] CR2: 0000000000002458 CR3: 000000045d197000 CR4:
> 00000000000006f0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] Process kworker/0:1 (pid: 10, threadinfo
> ffff88045fc88000, task ffff88085fc53c30)
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] Stack:
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  ffff88045fc89fd8 00000000000119c0 ffff88045fc88010
> ffff88085fc53ee8
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  ffff88045fc89fd8 ffff88085fc53ee0 ffff88085fc53c30
> 00000000000119c0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  00000000000119c0 ffffffff8137f7ce ffff88007f80df40
> 00000000ffffffff
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] Call Trace:
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8137f7ce>] ? common_interrupt+0xe/0x13
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffffa041bc57>] ? irqfd_inject+0x27/0x50 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106b6f2>] ? process_one_work+0x112/0x460
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106be25>] ? worker_thread+0x145/0x410
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8103a3d0>] ? __wake_up_common+0x50/0x80
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106f786>] ? kthread+0x96/0xa0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff81003ce4>] ? kernel_thread_helper+0x4/0x10
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff8106f6f0>] ? kthread+0x0/0xa0
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  [<ffffffff81003ce0>] ? kernel_thread_helper+0x0/0x10
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] Code: ff 41 57 41 89 f7 41 56 41 55 41 89 cd 41 54 49 89
> fc 55 53 89 d3 48 81 ec 98 00 00 00 8b 15 c6 79 03 00 85 d2 0f 85 c4
> 00 00 00 <4
> 9> 8b 84 24 58 24 00 00 3b 98 28 01 00 00 73 5e 89 db 48 8b 84
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] RIP  [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123]  RSP <ffff88045fc89d30>
> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> 685.246123] CR2: 0000000000002458
> 
> 
> If someone can help me, on how to solve this.
> 
> Regards.

> begin:vcard
> fn:Jean-Philippe Menil
> n:Menil;Jean-Philippe
> org;quoted-printable:Universit=C3=A9 de Nantes;IRTS
> adr;dom:;;;Nantes
> email;internet:jean-philippe.menil@univ-nantes.fr
> title:Reseau
> tel;work:02.53.48.49.27
> tel;fax:02.53.48.49.97
> x-mozilla-html:FALSE
> version:2.1
> end:vcard
> 

> _______________________________________________
> Virtualization mailing list
> Virtualization@lists.linux-foundation.org
> https://lists.linux-foundation.org/mailman/listinfo/virtualization


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-02-27 17:00 ` Michael S. Tsirkin
@ 2011-02-28  8:56   ` Jean-Philippe Menil
  2011-02-28 10:11     ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-02-28  8:56 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: kvm, netdev, virtualization

Le 27/02/2011 18:00, Michael S. Tsirkin a écrit :
> On Fri, Feb 25, 2011 at 10:07:22AM +0100, Jean-Philippe Menil wrote:
>> Hi,
>>
>> Each time i try tou use vhost_net, i'm facing a kernel bug.
>> I do a "modprobe vhost_net", and start guest whith vhost=on.
>>
>> Following is a trace with a kernel 2.6.37, but  i had the same
>> problem with 2.6.36 (cf https://lkml.org/lkml/2010/11/30/29).
> 2.6.36 had a theorectical race that could explain this,
> but it should be ok in 2.6.37.
>
>> The bug only occurs whith vhost_net charged, so i don't know if this
>> is a bug in kvm module code or in the vhost_net code.
> It could be a bug in eventfd which is the interface
> used by both kvm and vhost_net.
> Just for fun, you can try 3.6.38 - eventfd code has been changed
> a lot in 2.6.38 and if it does not trigger there
> it's a hint that irqfd is the reason.
>
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.243100] BUG: unable to handle kernel paging request at
>> 0000000000002458
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.243250] IP: [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
>
> Could you run markup_oops/ ksymoops on this please?
> As far as I can see kvm_set_irq can only get a wrong
> kvm pointer. Unless there's some general memory corruption,
> I'd guess
>
> You can also try comparing the irqfd->kvm pointer in
> kvm_irqfd_assign irqfd_wakeup and kvm_set_irq in
> virt/kvm/eventfd.c.
>
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.243378] PGD 45d363067 PUD 45e77a067 PMD 0
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.243556] Oops: 0000 [#1] SMP
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.243692] last sysfs file:
>> /sys/devices/pci0000:00/0000:00:0d.0/0000:05:00.0/0000:06:00.0/irq
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243777] CPU 0
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.243820] Modules linked in: vhost_net macvtap macvlan tun
>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>> cpufreq_ondemand fre
>> q_table cpufreq_conservative fuse xt_physdev ip6t_LOG
>> ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit xt_tcpudp
>> xt_state iptable_filter ip_tables x_tables nf_conntrack_tftp
>> nf_conntrack_ftp nf_connt
>> rack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 mbcache
>> dm_round_robin dm_multipath nf_conntrack_ipv6 nf_conntrack
>> nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm snd_timer snd soundcore
>> snd_page_alloc tpm_tis tpm ps
>> mouse dcdbas tpm_bios processor i2c_nforce2 shpchp pcspkr ghes
>> serio_raw joydev evdev pci_hotplug i2c_core hed button thermal_sys
>> xfs exportfs dm_mod sg sr_mod cdrom usbhid hid usb_storage ses
>> sd_mod enclosu
>> re megaraid_sas ohci_hcd lpfc scsi_transport_fc scsi_tgt bnx2
>> scsi_mod ehci_hcd [last unloaded: scsi_wait_scan]
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] Pid: 10, comm: kworker/0:1 Not tainted
>> 2.6.37-dsiun-110105 #17 0K543T/PowerEdge M605
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] RIP: 0010:[<ffffffffa041aa8a>]  [<ffffffffa041aa8a>]
>> kvm_set_irq+0x2a/0x130 [kvm]
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] RSP: 0018:ffff88045fc89d30  EFLAGS: 00010246
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] RAX: 0000000000000000 RBX: 000000000000001a RCX:
>> 0000000000000001
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
>> 0000000000000000
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] RBP: 0000000000000000 R08: 0000000000000001 R09:
>> ffff880856a91e48
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] R10: 0000000000000000 R11: 00000000ffffffff R12:
>> 0000000000000000
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] R13: 0000000000000001 R14: 0000000000000000 R15:
>> 0000000000000000
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] FS:  00007f617986c710(0000) GS:ffff88007f800000(0000)
>> knlGS:0000000000000000
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] CR2: 0000000000002458 CR3: 000000045d197000 CR4:
>> 00000000000006f0
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] Process kworker/0:1 (pid: 10, threadinfo
>> ffff88045fc88000, task ffff88085fc53c30)
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] Stack:
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  ffff88045fc89fd8 00000000000119c0 ffff88045fc88010
>> ffff88085fc53ee8
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  ffff88045fc89fd8 ffff88085fc53ee0 ffff88085fc53c30
>> 00000000000119c0
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  00000000000119c0 ffffffff8137f7ce ffff88007f80df40
>> 00000000ffffffff
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] Call Trace:
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffff8137f7ce>] ? common_interrupt+0xe/0x13
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffffa041bc57>] ? irqfd_inject+0x27/0x50 [kvm]
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffff8106b6f2>] ? process_one_work+0x112/0x460
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffff8106be25>] ? worker_thread+0x145/0x410
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffff8103a3d0>] ? __wake_up_common+0x50/0x80
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffff8106f786>] ? kthread+0x96/0xa0
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffff81003ce4>] ? kernel_thread_helper+0x4/0x10
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffff8106f6f0>] ? kthread+0x0/0xa0
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  [<ffffffff81003ce0>] ? kernel_thread_helper+0x0/0x10
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] Code: ff 41 57 41 89 f7 41 56 41 55 41 89 cd 41 54 49 89
>> fc 55 53 89 d3 48 81 ec 98 00 00 00 8b 15 c6 79 03 00 85 d2 0f 85 c4
>> 00 00 00<4
>> 9>  8b 84 24 58 24 00 00 3b 98 28 01 00 00 73 5e 89 db 48 8b 84
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] RIP  [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123]  RSP<ffff88045fc89d30>
>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>> 685.246123] CR2: 0000000000002458
>>
>>
>> If someone can help me, on how to solve this.
>>
>> Regards.
>> _______________________________________________
>> Virtualization mailing list
>> Virtualization@lists.linux-foundation.org
>> https://lists.linux-foundation.org/mailman/listinfo/virtualization
> --
> To unsubscribe from this list: send the line "unsubscribe netdev" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html

Hi,

thanks for your response.

This is what markup_oops.pl return me:
"No matching code found "

So this is not a vhost_net bug, or my oops is incomplete and markup_oops 
can't find the good vma offset.

I will try to compare the pointers you indicate me, even it could be a 
little difficult for me.

Maybe i will try a 2.6.38, will wait a response from the kvm team.

Regards.

-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-02-28  8:56   ` Jean-Philippe Menil
@ 2011-02-28 10:11     ` Michael S. Tsirkin
  2011-02-28 10:40       ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-02-28 10:11 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: kvm, netdev, virtualization

On Mon, Feb 28, 2011 at 09:56:46AM +0100, Jean-Philippe Menil wrote:
> Le 27/02/2011 18:00, Michael S. Tsirkin a écrit :
> >On Fri, Feb 25, 2011 at 10:07:22AM +0100, Jean-Philippe Menil wrote:
> >>Hi,
> >>
> >>Each time i try tou use vhost_net, i'm facing a kernel bug.
> >>I do a "modprobe vhost_net", and start guest whith vhost=on.
> >>
> >>Following is a trace with a kernel 2.6.37, but  i had the same
> >>problem with 2.6.36 (cf https://lkml.org/lkml/2010/11/30/29).
> >2.6.36 had a theorectical race that could explain this,
> >but it should be ok in 2.6.37.
> >
> >>The bug only occurs whith vhost_net charged, so i don't know if this
> >>is a bug in kvm module code or in the vhost_net code.
> >It could be a bug in eventfd which is the interface
> >used by both kvm and vhost_net.
> >Just for fun, you can try 3.6.38 - eventfd code has been changed
> >a lot in 2.6.38 and if it does not trigger there
> >it's a hint that irqfd is the reason.
> >
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.243100] BUG: unable to handle kernel paging request at
> >>0000000000002458
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.243250] IP: [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
> >
> >Could you run markup_oops/ ksymoops on this please?
> >As far as I can see kvm_set_irq can only get a wrong
> >kvm pointer. Unless there's some general memory corruption,
> >I'd guess
> >
> >You can also try comparing the irqfd->kvm pointer in
> >kvm_irqfd_assign irqfd_wakeup and kvm_set_irq in
> >virt/kvm/eventfd.c.
> >
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.243378] PGD 45d363067 PUD 45e77a067 PMD 0
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.243556] Oops: 0000 [#1] SMP
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.243692] last sysfs file:
> >>/sys/devices/pci0000:00/0000:00:0d.0/0000:05:00.0/0000:06:00.0/irq
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243777] CPU 0
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.243820] Modules linked in: vhost_net macvtap macvlan tun
> >>powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> >>cpufreq_ondemand fre
> >>q_table cpufreq_conservative fuse xt_physdev ip6t_LOG
> >>ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit xt_tcpudp
> >>xt_state iptable_filter ip_tables x_tables nf_conntrack_tftp
> >>nf_conntrack_ftp nf_connt
> >>rack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 mbcache
> >>dm_round_robin dm_multipath nf_conntrack_ipv6 nf_conntrack
> >>nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm snd_timer snd soundcore
> >>snd_page_alloc tpm_tis tpm ps
> >>mouse dcdbas tpm_bios processor i2c_nforce2 shpchp pcspkr ghes
> >>serio_raw joydev evdev pci_hotplug i2c_core hed button thermal_sys
> >>xfs exportfs dm_mod sg sr_mod cdrom usbhid hid usb_storage ses
> >>sd_mod enclosu
> >>re megaraid_sas ohci_hcd lpfc scsi_transport_fc scsi_tgt bnx2
> >>scsi_mod ehci_hcd [last unloaded: scsi_wait_scan]
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] Pid: 10, comm: kworker/0:1 Not tainted
> >>2.6.37-dsiun-110105 #17 0K543T/PowerEdge M605
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] RIP: 0010:[<ffffffffa041aa8a>]  [<ffffffffa041aa8a>]
> >>kvm_set_irq+0x2a/0x130 [kvm]
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] RSP: 0018:ffff88045fc89d30  EFLAGS: 00010246
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] RAX: 0000000000000000 RBX: 000000000000001a RCX:
> >>0000000000000001
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
> >>0000000000000000
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] RBP: 0000000000000000 R08: 0000000000000001 R09:
> >>ffff880856a91e48
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] R10: 0000000000000000 R11: 00000000ffffffff R12:
> >>0000000000000000
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] R13: 0000000000000001 R14: 0000000000000000 R15:
> >>0000000000000000
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] FS:  00007f617986c710(0000) GS:ffff88007f800000(0000)
> >>knlGS:0000000000000000
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] CR2: 0000000000002458 CR3: 000000045d197000 CR4:
> >>00000000000006f0
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> >>0000000000000000
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> >>0000000000000400
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] Process kworker/0:1 (pid: 10, threadinfo
> >>ffff88045fc88000, task ffff88085fc53c30)
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] Stack:
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  ffff88045fc89fd8 00000000000119c0 ffff88045fc88010
> >>ffff88085fc53ee8
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  ffff88045fc89fd8 ffff88085fc53ee0 ffff88085fc53c30
> >>00000000000119c0
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  00000000000119c0 ffffffff8137f7ce ffff88007f80df40
> >>00000000ffffffff
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] Call Trace:
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffff8137f7ce>] ? common_interrupt+0xe/0x13
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffffa041bc57>] ? irqfd_inject+0x27/0x50 [kvm]
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffff8106b6f2>] ? process_one_work+0x112/0x460
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffff8106be25>] ? worker_thread+0x145/0x410
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffff8103a3d0>] ? __wake_up_common+0x50/0x80
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffff8106f786>] ? kthread+0x96/0xa0
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffff81003ce4>] ? kernel_thread_helper+0x4/0x10
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffff8106f6f0>] ? kthread+0x0/0xa0
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  [<ffffffff81003ce0>] ? kernel_thread_helper+0x0/0x10
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] Code: ff 41 57 41 89 f7 41 56 41 55 41 89 cd 41 54 49 89
> >>fc 55 53 89 d3 48 81 ec 98 00 00 00 8b 15 c6 79 03 00 85 d2 0f 85 c4
> >>00 00 00<4
> >>9>  8b 84 24 58 24 00 00 3b 98 28 01 00 00 73 5e 89 db 48 8b 84
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] RIP  [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123]  RSP<ffff88045fc89d30>
> >>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>685.246123] CR2: 0000000000002458
> >>
> >>
> >>If someone can help me, on how to solve this.
> >>
> >>Regards.
> >>_______________________________________________
> >>Virtualization mailing list
> >>Virtualization@lists.linux-foundation.org
> >>https://lists.linux-foundation.org/mailman/listinfo/virtualization
> >--
> >To unsubscribe from this list: send the line "unsubscribe netdev" in
> >the body of a message to majordomo@vger.kernel.org
> >More majordomo info at  http://vger.kernel.org/majordomo-info.html
> 
> Hi,
> 
> thanks for your response.
> 
> This is what markup_oops.pl return me:
> "No matching code found "

Well, let's try to understand what's there.

Do objdumop -ldS kvm.ko
look for <kvm_set_irq>

and paste the content from start of that function
to offset 0x2a and a bit beyond.

You can also upload your kvm.ko somewhere, I'll try to take a look.


> So this is not a vhost_net bug, or my oops is incomplete and
> markup_oops can't find the good vma offset.
> 
> I will try to compare the pointers you indicate me, even it could be
> a little difficult for me.

Hmm you know how to add printk to code and rebuild, right?

> 
> Maybe i will try a 2.6.38, will wait a response from the kvm team.
> 
> Regards.
> 
> -- 
> Jean-Philippe Menil - Pôle réseau Service IRTS
> DSI Université de Nantes
> jean-philippe.menil@univ-nantes.fr
> Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09

^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-02-28 10:11     ` Michael S. Tsirkin
@ 2011-02-28 10:40       ` Jean-Philippe Menil
  2011-02-28 11:39         ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-02-28 10:40 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: kvm, netdev, virtualization

Le 28/02/2011 11:11, Michael S. Tsirkin a écrit :
> On Mon, Feb 28, 2011 at 09:56:46AM +0100, Jean-Philippe Menil wrote:
>> Le 27/02/2011 18:00, Michael S. Tsirkin a écrit :
>>> On Fri, Feb 25, 2011 at 10:07:22AM +0100, Jean-Philippe Menil wrote:
>>>> Hi,
>>>>
>>>> Each time i try tou use vhost_net, i'm facing a kernel bug.
>>>> I do a "modprobe vhost_net", and start guest whith vhost=on.
>>>>
>>>> Following is a trace with a kernel 2.6.37, but  i had the same
>>>> problem with 2.6.36 (cf https://lkml.org/lkml/2010/11/30/29).
>>> 2.6.36 had a theorectical race that could explain this,
>>> but it should be ok in 2.6.37.
>>>
>>>> The bug only occurs whith vhost_net charged, so i don't know if this
>>>> is a bug in kvm module code or in the vhost_net code.
>>> It could be a bug in eventfd which is the interface
>>> used by both kvm and vhost_net.
>>> Just for fun, you can try 3.6.38 - eventfd code has been changed
>>> a lot in 2.6.38 and if it does not trigger there
>>> it's a hint that irqfd is the reason.
>>>
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.243100] BUG: unable to handle kernel paging request at
>>>> 0000000000002458
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.243250] IP: [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
>>> Could you run markup_oops/ ksymoops on this please?
>>> As far as I can see kvm_set_irq can only get a wrong
>>> kvm pointer. Unless there's some general memory corruption,
>>> I'd guess
>>>
>>> You can also try comparing the irqfd->kvm pointer in
>>> kvm_irqfd_assign irqfd_wakeup and kvm_set_irq in
>>> virt/kvm/eventfd.c.
>>>
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.243378] PGD 45d363067 PUD 45e77a067 PMD 0
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.243556] Oops: 0000 [#1] SMP
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.243692] last sysfs file:
>>>> /sys/devices/pci0000:00/0000:00:0d.0/0000:05:00.0/0000:06:00.0/irq
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243777] CPU 0
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.243820] Modules linked in: vhost_net macvtap macvlan tun
>>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>>> cpufreq_ondemand fre
>>>> q_table cpufreq_conservative fuse xt_physdev ip6t_LOG
>>>> ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit xt_tcpudp
>>>> xt_state iptable_filter ip_tables x_tables nf_conntrack_tftp
>>>> nf_conntrack_ftp nf_connt
>>>> rack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 mbcache
>>>> dm_round_robin dm_multipath nf_conntrack_ipv6 nf_conntrack
>>>> nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm snd_timer snd soundcore
>>>> snd_page_alloc tpm_tis tpm ps
>>>> mouse dcdbas tpm_bios processor i2c_nforce2 shpchp pcspkr ghes
>>>> serio_raw joydev evdev pci_hotplug i2c_core hed button thermal_sys
>>>> xfs exportfs dm_mod sg sr_mod cdrom usbhid hid usb_storage ses
>>>> sd_mod enclosu
>>>> re megaraid_sas ohci_hcd lpfc scsi_transport_fc scsi_tgt bnx2
>>>> scsi_mod ehci_hcd [last unloaded: scsi_wait_scan]
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] Pid: 10, comm: kworker/0:1 Not tainted
>>>> 2.6.37-dsiun-110105 #17 0K543T/PowerEdge M605
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] RIP: 0010:[<ffffffffa041aa8a>]  [<ffffffffa041aa8a>]
>>>> kvm_set_irq+0x2a/0x130 [kvm]
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] RSP: 0018:ffff88045fc89d30  EFLAGS: 00010246
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] RAX: 0000000000000000 RBX: 000000000000001a RCX:
>>>> 0000000000000001
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
>>>> 0000000000000000
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] RBP: 0000000000000000 R08: 0000000000000001 R09:
>>>> ffff880856a91e48
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] R10: 0000000000000000 R11: 00000000ffffffff R12:
>>>> 0000000000000000
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] R13: 0000000000000001 R14: 0000000000000000 R15:
>>>> 0000000000000000
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] FS:  00007f617986c710(0000) GS:ffff88007f800000(0000)
>>>> knlGS:0000000000000000
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] CR2: 0000000000002458 CR3: 000000045d197000 CR4:
>>>> 00000000000006f0
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>>> 0000000000000000
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>>> 0000000000000400
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] Process kworker/0:1 (pid: 10, threadinfo
>>>> ffff88045fc88000, task ffff88085fc53c30)
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] Stack:
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  ffff88045fc89fd8 00000000000119c0 ffff88045fc88010
>>>> ffff88085fc53ee8
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  ffff88045fc89fd8 ffff88085fc53ee0 ffff88085fc53c30
>>>> 00000000000119c0
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  00000000000119c0 ffffffff8137f7ce ffff88007f80df40
>>>> 00000000ffffffff
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] Call Trace:
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffff8137f7ce>] ? common_interrupt+0xe/0x13
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffffa041bc57>] ? irqfd_inject+0x27/0x50 [kvm]
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffff8106b6f2>] ? process_one_work+0x112/0x460
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffff8106be25>] ? worker_thread+0x145/0x410
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffff8103a3d0>] ? __wake_up_common+0x50/0x80
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffff8106f786>] ? kthread+0x96/0xa0
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffff81003ce4>] ? kernel_thread_helper+0x4/0x10
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffff8106f6f0>] ? kthread+0x0/0xa0
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  [<ffffffff81003ce0>] ? kernel_thread_helper+0x0/0x10
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] Code: ff 41 57 41 89 f7 41 56 41 55 41 89 cd 41 54 49 89
>>>> fc 55 53 89 d3 48 81 ec 98 00 00 00 8b 15 c6 79 03 00 85 d2 0f 85 c4
>>>> 00 00 00<4
>>>> 9>   8b 84 24 58 24 00 00 3b 98 28 01 00 00 73 5e 89 db 48 8b 84
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] RIP  [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123]  RSP<ffff88045fc89d30>
>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>> 685.246123] CR2: 0000000000002458
>>>>
>>>>
>>>> If someone can help me, on how to solve this.
>>>>
>>>> Regards.
>>>> _______________________________________________
>>>> Virtualization mailing list
>>>> Virtualization@lists.linux-foundation.org
>>>> https://lists.linux-foundation.org/mailman/listinfo/virtualization
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe netdev" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> Hi,
>>
>> thanks for your response.
>>
>> This is what markup_oops.pl return me:
>> "No matching code found"
> Well, let's try to understand what's there.
>
> Do objdumop -ldS kvm.ko
> look for<kvm_set_irq>
>
> and paste the content from start of that function
> to offset 0x2a and a bit beyond.
>
> You can also upload your kvm.ko somewhere, I'll try to take a look.
>
>
>> So this is not a vhost_net bug, or my oops is incomplete and
>> markup_oops can't find the good vma offset.
>>
>> I will try to compare the pointers you indicate me, even it could be
>> a little difficult for me.
> Hmm you know how to add printk to code and rebuild, right?
>
>> Maybe i will try a 2.6.38, will wait a response from the kvm team.
>>
>> Regards.
>>
>> -- 
>> Jean-Philippe Menil - Pôle réseau Service IRTS
>> DSI Université de Nantes
>> jean-philippe.menil@univ-nantes.fr
>> Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09
So, here is the result for the objdump against the kvm.ko (the 
kvm_set_irq part) :

0000000000006a60 <kvm_set_irq>:
kvm_set_irq():
     6a60:       41 57                   push   %r15
     6a62:       41 89 f7                mov    %esi,%r15d
     6a65:       41 56                   push   %r14
     6a67:       41 55                   push   %r13
     6a69:       41 89 cd                mov    %ecx,%r13d
     6a6c:       41 54                   push   %r12
     6a6e:       49 89 fc                mov    %rdi,%r12
     6a71:       55                      push   %rbp
     6a72:       53                      push   %rbx
     6a73:       89 d3                   mov    %edx,%ebx
     6a75:       48 81 ec 98 00 00 00    sub    $0x98,%rsp
     6a7c:       8b 15 00 00 00 00       mov    0x0(%rip),%edx        # 
6a82 <kvm_set_irq+0x22>
     6a82:       85 d2                   test   %edx,%edx
     6a84:       0f 85 c4 00 00 00       jne    6b4e <kvm_set_irq+0xee>
     6a8a:       49 8b 84 24 58 24 00    mov    0x2458(%r12),%rax
     6a91:       00
     6a92:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
     6a98:       73 5e                   jae    6af8 <kvm_set_irq+0x98>
     6a9a:       89 db                   mov    %ebx,%ebx
     6a9c:       48 8b 84 d8 30 01 00    mov    0x130(%rax,%rbx,8),%rax
     6aa3:       00
     6aa4:       48 85 c0                test   %rax,%rax
     6aa7:       74 4f                   je     6af8 <kvm_set_irq+0x98>
     6aa9:       48 89 e2                mov    %rsp,%rdx
     6aac:       31 db                   xor    %ebx,%ebx
     6aae:       48 8b 08                mov    (%rax),%rcx
     6ab1:       83 c3 01                add    $0x1,%ebx
     6ab4:       0f 18 09                prefetcht0 (%rcx)
     6ab7:       48 8b 48 e0             mov    -0x20(%rax),%rcx
     6abb:       48 89 0a                mov    %rcx,(%rdx)
     6abe:       48 8b 48 e8             mov    -0x18(%rax),%rcx
     6ac2:       48 89 4a 08             mov    %rcx,0x8(%rdx)
     6ac6:       48 8b 48 f0             mov    -0x10(%rax),%rcx
     6aca:       48 89 4a 10             mov    %rcx,0x10(%rdx)
     6ace:       48 8b 48 f8             mov    -0x8(%rax),%rcx
     6ad2:       48 89 4a 18             mov    %rcx,0x18(%rdx)
     6ad6:       48 8b 08                mov    (%rax),%rcx
     6ad9:       48 89 4a 20             mov    %rcx,0x20(%rdx)
     6add:       48 8b 48 08             mov    0x8(%rax),%rcx
     6ae1:       48 89 4a 28             mov    %rcx,0x28(%rdx)
     6ae5:       48 8b 00                mov    (%rax),%rax
     6ae8:       48 83 c2 30             add    $0x30,%rdx
     6aec:       48 85 c0                test   %rax,%rax
     6aef:       75 bd                   jne    6aae <kvm_set_irq+0x4e>
     6af1:       eb 07                   jmp    6afa <kvm_set_irq+0x9a>
     6af3:       0f 1f 44 00 00          nopl   0x0(%rax,%rax,1)
     6af8:       31 db                   xor    %ebx,%ebx
     6afa:       bd ff ff ff ff          mov    $0xffffffff,%ebp
     6aff:       49 89 e6                mov    %rsp,%r14
     6b02:       85 db                   test   %ebx,%ebx
     6b04:       74 34                   je     6b3a <kvm_set_irq+0xda>
     6b06:       83 eb 01                sub    $0x1,%ebx
     6b09:       44 89 e9                mov    %r13d,%ecx
     6b0c:       44 89 fa                mov    %r15d,%edx
     6b0f:       48 63 c3                movslq %ebx,%rax
     6b12:       4c 89 e6                mov    %r12,%rsi
     6b15:       48 8d 04 40             lea    (%rax,%rax,2),%rax
     6b19:       48 c1 e0 04             shl    $0x4,%rax
     6b1d:       49 8d 3c 06             lea    (%r14,%rax,1),%rdi
     6b21:       ff 54 04 08             callq  *0x8(%rsp,%rax,1)
     6b25:       85 c0                   test   %eax,%eax
     6b27:       78 d9                   js     6b02 <kvm_set_irq+0xa2>
     6b29:       85 ed                   test   %ebp,%ebp
     6b2b:       ba 00 00 00 00          mov    $0x0,%edx
     6b30:       0f 48 ea                cmovs  %edx,%ebp
     6b33:       85 db                   test   %ebx,%ebx
     6b35:       8d 2c 28                lea    (%rax,%rbp,1),%ebp
     6b38:       75 cc                   jne    6b06 <kvm_set_irq+0xa6>
     6b3a:       48 81 c4 98 00 00 00    add    $0x98,%rsp
     6b41:       89 e8                   mov    %ebp,%eax
     6b43:       5b                      pop    %rbx
     6b44:       5d                      pop    %rbp
     6b45:       41 5c                   pop    %r12
     6b47:       41 5d                   pop    %r13
     6b49:       41 5e                   pop    %r14
     6b4b:       41 5f                   pop    %r15
     6b4d:       c3                      retq
     6b4e:       48 8b 2d 00 00 00 00    mov    0x0(%rip),%rbp        # 
6b55 <kvm_set_irq+0xf5>
     6b55:       48 85 ed                test   %rbp,%rbp
     6b58:       0f 84 2c ff ff ff       je     6a8a <kvm_set_irq+0x2a>
     6b5e:       48 8b 45 00             mov    0x0(%rbp),%rax
     6b62:       48 8b 7d 08             mov    0x8(%rbp),%rdi
     6b66:       48 83 c5 10             add    $0x10,%rbp
     6b6a:       44 89 f9                mov    %r15d,%ecx
     6b6d:       44 89 ea                mov    %r13d,%edx
     6b70:       89 de                   mov    %ebx,%esi
     6b72:       ff d0                   callq  *%rax
     6b74:       48 8b 45 00             mov    0x0(%rbp),%rax
     6b78:       48 85 c0                test   %rax,%rax
     6b7b:       75 e5                   jne    6b62 <kvm_set_irq+0x102>
     6b7d:       e9 08 ff ff ff          jmpq   6a8a <kvm_set_irq+0x2a>
     6b82:       66 66 66 66 66 2e 0f    nopw   %cs:0x0(%rax,%rax,1)
     6b89:       1f 84 00 00 00 00 00

I admit that this analysis is too complicated for me.
I, effectively, can rebuild a kernel with more printk, and program a reboot.

The kvm.ko is available through the following address:
http://filex.univ-nantes.fr/get?k=k1jKhQghdcHLz12Z50H

Regards.

-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-02-28 10:40       ` Jean-Philippe Menil
@ 2011-02-28 11:39         ` Michael S. Tsirkin
  2011-02-28 15:13           ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-02-28 11:39 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: kvm, netdev, virtualization

On Mon, Feb 28, 2011 at 11:40:43AM +0100, Jean-Philippe Menil wrote:
> Le 28/02/2011 11:11, Michael S. Tsirkin a écrit :
> >On Mon, Feb 28, 2011 at 09:56:46AM +0100, Jean-Philippe Menil wrote:
> >>Le 27/02/2011 18:00, Michael S. Tsirkin a écrit :
> >>>On Fri, Feb 25, 2011 at 10:07:22AM +0100, Jean-Philippe Menil wrote:
> >>>>Hi,
> >>>>
> >>>>Each time i try tou use vhost_net, i'm facing a kernel bug.
> >>>>I do a "modprobe vhost_net", and start guest whith vhost=on.
> >>>>
> >>>>Following is a trace with a kernel 2.6.37, but  i had the same
> >>>>problem with 2.6.36 (cf https://lkml.org/lkml/2010/11/30/29).
> >>>2.6.36 had a theorectical race that could explain this,
> >>>but it should be ok in 2.6.37.
> >>>
> >>>>The bug only occurs whith vhost_net charged, so i don't know if this
> >>>>is a bug in kvm module code or in the vhost_net code.
> >>>It could be a bug in eventfd which is the interface
> >>>used by both kvm and vhost_net.
> >>>Just for fun, you can try 3.6.38 - eventfd code has been changed
> >>>a lot in 2.6.38 and if it does not trigger there
> >>>it's a hint that irqfd is the reason.
> >>>
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.243100] BUG: unable to handle kernel paging request at
> >>>>0000000000002458
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.243250] IP: [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
> >>>Could you run markup_oops/ ksymoops on this please?
> >>>As far as I can see kvm_set_irq can only get a wrong
> >>>kvm pointer. Unless there's some general memory corruption,
> >>>I'd guess
> >>>
> >>>You can also try comparing the irqfd->kvm pointer in
> >>>kvm_irqfd_assign irqfd_wakeup and kvm_set_irq in
> >>>virt/kvm/eventfd.c.
> >>>
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.243378] PGD 45d363067 PUD 45e77a067 PMD 0
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.243556] Oops: 0000 [#1] SMP
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.243692] last sysfs file:
> >>>>/sys/devices/pci0000:00/0000:00:0d.0/0000:05:00.0/0000:06:00.0/irq
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243777] CPU 0
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.243820] Modules linked in: vhost_net macvtap macvlan tun
> >>>>powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> >>>>cpufreq_ondemand fre
> >>>>q_table cpufreq_conservative fuse xt_physdev ip6t_LOG
> >>>>ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit xt_tcpudp
> >>>>xt_state iptable_filter ip_tables x_tables nf_conntrack_tftp
> >>>>nf_conntrack_ftp nf_connt
> >>>>rack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 mbcache
> >>>>dm_round_robin dm_multipath nf_conntrack_ipv6 nf_conntrack
> >>>>nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm snd_timer snd soundcore
> >>>>snd_page_alloc tpm_tis tpm ps
> >>>>mouse dcdbas tpm_bios processor i2c_nforce2 shpchp pcspkr ghes
> >>>>serio_raw joydev evdev pci_hotplug i2c_core hed button thermal_sys
> >>>>xfs exportfs dm_mod sg sr_mod cdrom usbhid hid usb_storage ses
> >>>>sd_mod enclosu
> >>>>re megaraid_sas ohci_hcd lpfc scsi_transport_fc scsi_tgt bnx2
> >>>>scsi_mod ehci_hcd [last unloaded: scsi_wait_scan]
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] Pid: 10, comm: kworker/0:1 Not tainted
> >>>>2.6.37-dsiun-110105 #17 0K543T/PowerEdge M605
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] RIP: 0010:[<ffffffffa041aa8a>]  [<ffffffffa041aa8a>]
> >>>>kvm_set_irq+0x2a/0x130 [kvm]
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] RSP: 0018:ffff88045fc89d30  EFLAGS: 00010246
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] RAX: 0000000000000000 RBX: 000000000000001a RCX:
> >>>>0000000000000001
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
> >>>>0000000000000000
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] RBP: 0000000000000000 R08: 0000000000000001 R09:
> >>>>ffff880856a91e48
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] R10: 0000000000000000 R11: 00000000ffffffff R12:
> >>>>0000000000000000
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] R13: 0000000000000001 R14: 0000000000000000 R15:
> >>>>0000000000000000
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] FS:  00007f617986c710(0000) GS:ffff88007f800000(0000)
> >>>>knlGS:0000000000000000
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] CR2: 0000000000002458 CR3: 000000045d197000 CR4:
> >>>>00000000000006f0
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> >>>>0000000000000000
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> >>>>0000000000000400
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] Process kworker/0:1 (pid: 10, threadinfo
> >>>>ffff88045fc88000, task ffff88085fc53c30)
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] Stack:
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  ffff88045fc89fd8 00000000000119c0 ffff88045fc88010
> >>>>ffff88085fc53ee8
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  ffff88045fc89fd8 ffff88085fc53ee0 ffff88085fc53c30
> >>>>00000000000119c0
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  00000000000119c0 ffffffff8137f7ce ffff88007f80df40
> >>>>00000000ffffffff
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] Call Trace:
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffff8137f7ce>] ? common_interrupt+0xe/0x13
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffffa041bc57>] ? irqfd_inject+0x27/0x50 [kvm]
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffff8106b6f2>] ? process_one_work+0x112/0x460
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffff8106be25>] ? worker_thread+0x145/0x410
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffff8103a3d0>] ? __wake_up_common+0x50/0x80
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffff8106f786>] ? kthread+0x96/0xa0
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffff81003ce4>] ? kernel_thread_helper+0x4/0x10
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffff8106f6f0>] ? kthread+0x0/0xa0
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  [<ffffffff81003ce0>] ? kernel_thread_helper+0x0/0x10
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] Code: ff 41 57 41 89 f7 41 56 41 55 41 89 cd 41 54 49 89
> >>>>fc 55 53 89 d3 48 81 ec 98 00 00 00 8b 15 c6 79 03 00 85 d2 0f 85 c4
> >>>>00 00 00<4
> >>>>9>   8b 84 24 58 24 00 00 3b 98 28 01 00 00 73 5e 89 db 48 8b 84
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] RIP  [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123]  RSP<ffff88045fc89d30>
> >>>>Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
> >>>>685.246123] CR2: 0000000000002458
> >>>>
> >>>>
> >>>>If someone can help me, on how to solve this.
> >>>>
> >>>>Regards.
> >>>>_______________________________________________
> >>>>Virtualization mailing list
> >>>>Virtualization@lists.linux-foundation.org
> >>>>https://lists.linux-foundation.org/mailman/listinfo/virtualization
> >>>--
> >>>To unsubscribe from this list: send the line "unsubscribe netdev" in
> >>>the body of a message to majordomo@vger.kernel.org
> >>>More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >>Hi,
> >>
> >>thanks for your response.
> >>
> >>This is what markup_oops.pl return me:
> >>"No matching code found"
> >Well, let's try to understand what's there.
> >
> >Do objdumop -ldS kvm.ko
> >look for<kvm_set_irq>
> >
> >and paste the content from start of that function
> >to offset 0x2a and a bit beyond.
> >
> >You can also upload your kvm.ko somewhere, I'll try to take a look.
> >
> >
> >>So this is not a vhost_net bug, or my oops is incomplete and
> >>markup_oops can't find the good vma offset.
> >>
> >>I will try to compare the pointers you indicate me, even it could be
> >>a little difficult for me.
> >Hmm you know how to add printk to code and rebuild, right?
> >
> >>Maybe i will try a 2.6.38, will wait a response from the kvm team.
> >>
> >>Regards.
> >>
> >>-- 
> >>Jean-Philippe Menil - Pôle réseau Service IRTS
> >>DSI Université de Nantes
> >>jean-philippe.menil@univ-nantes.fr
> >>Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09
> So, here is the result for the objdump against the kvm.ko (the
> kvm_set_irq part) :

Can you try building with -g and adding -l and -S to objdump
please? I'd rather make the tool do the legwork than
do it manually.

> 
> 0000000000006a60 <kvm_set_irq>:
> kvm_set_irq():
>     6a60:       41 57                   push   %r15
>     6a62:       41 89 f7                mov    %esi,%r15d
>     6a65:       41 56                   push   %r14
>     6a67:       41 55                   push   %r13
>     6a69:       41 89 cd                mov    %ecx,%r13d
>     6a6c:       41 54                   push   %r12
>     6a6e:       49 89 fc                mov    %rdi,%r12
>     6a71:       55                      push   %rbp
>     6a72:       53                      push   %rbx
>     6a73:       89 d3                   mov    %edx,%ebx
>     6a75:       48 81 ec 98 00 00 00    sub    $0x98,%rsp
>     6a7c:       8b 15 00 00 00 00       mov    0x0(%rip),%edx
> # 6a82 <kvm_set_irq+0x22>
>     6a82:       85 d2                   test   %edx,%edx
>     6a84:       0f 85 c4 00 00 00       jne    6b4e <kvm_set_irq+0xee>
>     6a8a:       49 8b 84 24 58 24 00    mov    0x2458(%r12),%rax

OK, 0x6a8a is the offset.
After you build with -g, try

addr2line kvm.ko 0x6a8a

and see which line this points to.


>     6a91:       00
>     6a92:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
>     6a98:       73 5e                   jae    6af8 <kvm_set_irq+0x98>
>     6a9a:       89 db                   mov    %ebx,%ebx
>     6a9c:       48 8b 84 d8 30 01 00    mov    0x130(%rax,%rbx,8),%rax
>     6aa3:       00
>     6aa4:       48 85 c0                test   %rax,%rax
>     6aa7:       74 4f                   je     6af8 <kvm_set_irq+0x98>
>     6aa9:       48 89 e2                mov    %rsp,%rdx
>     6aac:       31 db                   xor    %ebx,%ebx
>     6aae:       48 8b 08                mov    (%rax),%rcx
>     6ab1:       83 c3 01                add    $0x1,%ebx
>     6ab4:       0f 18 09                prefetcht0 (%rcx)
>     6ab7:       48 8b 48 e0             mov    -0x20(%rax),%rcx
>     6abb:       48 89 0a                mov    %rcx,(%rdx)
>     6abe:       48 8b 48 e8             mov    -0x18(%rax),%rcx
>     6ac2:       48 89 4a 08             mov    %rcx,0x8(%rdx)
>     6ac6:       48 8b 48 f0             mov    -0x10(%rax),%rcx
>     6aca:       48 89 4a 10             mov    %rcx,0x10(%rdx)
>     6ace:       48 8b 48 f8             mov    -0x8(%rax),%rcx
>     6ad2:       48 89 4a 18             mov    %rcx,0x18(%rdx)
>     6ad6:       48 8b 08                mov    (%rax),%rcx
>     6ad9:       48 89 4a 20             mov    %rcx,0x20(%rdx)
>     6add:       48 8b 48 08             mov    0x8(%rax),%rcx
>     6ae1:       48 89 4a 28             mov    %rcx,0x28(%rdx)
>     6ae5:       48 8b 00                mov    (%rax),%rax
>     6ae8:       48 83 c2 30             add    $0x30,%rdx
>     6aec:       48 85 c0                test   %rax,%rax
>     6aef:       75 bd                   jne    6aae <kvm_set_irq+0x4e>
>     6af1:       eb 07                   jmp    6afa <kvm_set_irq+0x9a>
>     6af3:       0f 1f 44 00 00          nopl   0x0(%rax,%rax,1)
>     6af8:       31 db                   xor    %ebx,%ebx
>     6afa:       bd ff ff ff ff          mov    $0xffffffff,%ebp
>     6aff:       49 89 e6                mov    %rsp,%r14
>     6b02:       85 db                   test   %ebx,%ebx
>     6b04:       74 34                   je     6b3a <kvm_set_irq+0xda>
>     6b06:       83 eb 01                sub    $0x1,%ebx
>     6b09:       44 89 e9                mov    %r13d,%ecx
>     6b0c:       44 89 fa                mov    %r15d,%edx
>     6b0f:       48 63 c3                movslq %ebx,%rax
>     6b12:       4c 89 e6                mov    %r12,%rsi
>     6b15:       48 8d 04 40             lea    (%rax,%rax,2),%rax
>     6b19:       48 c1 e0 04             shl    $0x4,%rax
>     6b1d:       49 8d 3c 06             lea    (%r14,%rax,1),%rdi
>     6b21:       ff 54 04 08             callq  *0x8(%rsp,%rax,1)
>     6b25:       85 c0                   test   %eax,%eax
>     6b27:       78 d9                   js     6b02 <kvm_set_irq+0xa2>
>     6b29:       85 ed                   test   %ebp,%ebp
>     6b2b:       ba 00 00 00 00          mov    $0x0,%edx
>     6b30:       0f 48 ea                cmovs  %edx,%ebp
>     6b33:       85 db                   test   %ebx,%ebx
>     6b35:       8d 2c 28                lea    (%rax,%rbp,1),%ebp
>     6b38:       75 cc                   jne    6b06 <kvm_set_irq+0xa6>
>     6b3a:       48 81 c4 98 00 00 00    add    $0x98,%rsp
>     6b41:       89 e8                   mov    %ebp,%eax
>     6b43:       5b                      pop    %rbx
>     6b44:       5d                      pop    %rbp
>     6b45:       41 5c                   pop    %r12
>     6b47:       41 5d                   pop    %r13
>     6b49:       41 5e                   pop    %r14
>     6b4b:       41 5f                   pop    %r15
>     6b4d:       c3                      retq
>     6b4e:       48 8b 2d 00 00 00 00    mov    0x0(%rip),%rbp
> # 6b55 <kvm_set_irq+0xf5>
>     6b55:       48 85 ed                test   %rbp,%rbp
>     6b58:       0f 84 2c ff ff ff       je     6a8a <kvm_set_irq+0x2a>
>     6b5e:       48 8b 45 00             mov    0x0(%rbp),%rax
>     6b62:       48 8b 7d 08             mov    0x8(%rbp),%rdi
>     6b66:       48 83 c5 10             add    $0x10,%rbp
>     6b6a:       44 89 f9                mov    %r15d,%ecx
>     6b6d:       44 89 ea                mov    %r13d,%edx
>     6b70:       89 de                   mov    %ebx,%esi
>     6b72:       ff d0                   callq  *%rax
>     6b74:       48 8b 45 00             mov    0x0(%rbp),%rax
>     6b78:       48 85 c0                test   %rax,%rax
>     6b7b:       75 e5                   jne    6b62 <kvm_set_irq+0x102>
>     6b7d:       e9 08 ff ff ff          jmpq   6a8a <kvm_set_irq+0x2a>
>     6b82:       66 66 66 66 66 2e 0f    nopw   %cs:0x0(%rax,%rax,1)
>     6b89:       1f 84 00 00 00 00 00
> 
> I admit that this analysis is too complicated for me.
> I, effectively, can rebuild a kernel with more printk, and program a reboot.
> 
> The kvm.ko is available through the following address:
> http://filex.univ-nantes.fr/get?k=k1jKhQghdcHLz12Z50H
> 
> Regards.

This has no debug data. Can you rebuild with -g please?

BTW if you want to rerun and get more reliable backtrace,
tyr enabling frame pointers (do you know how to?). But this will change code
so backtrace will no longer be val we will need
a new one.

> -- 
> Jean-Philippe Menil - Pôle réseau Service IRTS
> DSI Université de Nantes
> jean-philippe.menil@univ-nantes.fr
> Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09

^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-02-28 11:39         ` Michael S. Tsirkin
@ 2011-02-28 15:13           ` Jean-Philippe Menil
  2011-02-28 22:34             ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-02-28 15:13 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: kvm, netdev, virtualization

Le 28/02/2011 12:39, Michael S. Tsirkin a écrit :
> On Mon, Feb 28, 2011 at 11:40:43AM +0100, Jean-Philippe Menil wrote:
>> Le 28/02/2011 11:11, Michael S. Tsirkin a écrit :
>>> On Mon, Feb 28, 2011 at 09:56:46AM +0100, Jean-Philippe Menil wrote:
>>>> Le 27/02/2011 18:00, Michael S. Tsirkin a écrit :
>>>>> On Fri, Feb 25, 2011 at 10:07:22AM +0100, Jean-Philippe Menil wrote:
>>>>>> Hi,
>>>>>>
>>>>>> Each time i try tou use vhost_net, i'm facing a kernel bug.
>>>>>> I do a "modprobe vhost_net", and start guest whith vhost=on.
>>>>>>
>>>>>> Following is a trace with a kernel 2.6.37, but  i had the same
>>>>>> problem with 2.6.36 (cf https://lkml.org/lkml/2010/11/30/29).
>>>>> 2.6.36 had a theorectical race that could explain this,
>>>>> but it should be ok in 2.6.37.
>>>>>
>>>>>> The bug only occurs whith vhost_net charged, so i don't know if this
>>>>>> is a bug in kvm module code or in the vhost_net code.
>>>>> It could be a bug in eventfd which is the interface
>>>>> used by both kvm and vhost_net.
>>>>> Just for fun, you can try 3.6.38 - eventfd code has been changed
>>>>> a lot in 2.6.38 and if it does not trigger there
>>>>> it's a hint that irqfd is the reason.
>>>>>
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.243100] BUG: unable to handle kernel paging request at
>>>>>> 0000000000002458
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.243250] IP: [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
>>>>> Could you run markup_oops/ ksymoops on this please?
>>>>> As far as I can see kvm_set_irq can only get a wrong
>>>>> kvm pointer. Unless there's some general memory corruption,
>>>>> I'd guess
>>>>>
>>>>> You can also try comparing the irqfd->kvm pointer in
>>>>> kvm_irqfd_assign irqfd_wakeup and kvm_set_irq in
>>>>> virt/kvm/eventfd.c.
>>>>>
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.243378] PGD 45d363067 PUD 45e77a067 PMD 0
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.243556] Oops: 0000 [#1] SMP
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.243692] last sysfs file:
>>>>>> /sys/devices/pci0000:00/0000:00:0d.0/0000:05:00.0/0000:06:00.0/irq
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.243777] CPU 0
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.243820] Modules linked in: vhost_net macvtap macvlan tun
>>>>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>>>>> cpufreq_ondemand fre
>>>>>> q_table cpufreq_conservative fuse xt_physdev ip6t_LOG
>>>>>> ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit xt_tcpudp
>>>>>> xt_state iptable_filter ip_tables x_tables nf_conntrack_tftp
>>>>>> nf_conntrack_ftp nf_connt
>>>>>> rack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 mbcache
>>>>>> dm_round_robin dm_multipath nf_conntrack_ipv6 nf_conntrack
>>>>>> nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm snd_timer snd soundcore
>>>>>> snd_page_alloc tpm_tis tpm ps
>>>>>> mouse dcdbas tpm_bios processor i2c_nforce2 shpchp pcspkr ghes
>>>>>> serio_raw joydev evdev pci_hotplug i2c_core hed button thermal_sys
>>>>>> xfs exportfs dm_mod sg sr_mod cdrom usbhid hid usb_storage ses
>>>>>> sd_mod enclosu
>>>>>> re megaraid_sas ohci_hcd lpfc scsi_transport_fc scsi_tgt bnx2
>>>>>> scsi_mod ehci_hcd [last unloaded: scsi_wait_scan]
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123]
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] Pid: 10, comm: kworker/0:1 Not tainted
>>>>>> 2.6.37-dsiun-110105 #17 0K543T/PowerEdge M605
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] RIP: 0010:[<ffffffffa041aa8a>]  [<ffffffffa041aa8a>]
>>>>>> kvm_set_irq+0x2a/0x130 [kvm]
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] RSP: 0018:ffff88045fc89d30  EFLAGS: 00010246
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] RAX: 0000000000000000 RBX: 000000000000001a RCX:
>>>>>> 0000000000000001
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
>>>>>> 0000000000000000
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] RBP: 0000000000000000 R08: 0000000000000001 R09:
>>>>>> ffff880856a91e48
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] R10: 0000000000000000 R11: 00000000ffffffff R12:
>>>>>> 0000000000000000
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] R13: 0000000000000001 R14: 0000000000000000 R15:
>>>>>> 0000000000000000
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] FS:  00007f617986c710(0000) GS:ffff88007f800000(0000)
>>>>>> knlGS:0000000000000000
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] CR2: 0000000000002458 CR3: 000000045d197000 CR4:
>>>>>> 00000000000006f0
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>>>>> 0000000000000000
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>>>>> 0000000000000400
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] Process kworker/0:1 (pid: 10, threadinfo
>>>>>> ffff88045fc88000, task ffff88085fc53c30)
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [  685.246123] Stack:
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  ffff88045fc89fd8 00000000000119c0 ffff88045fc88010
>>>>>> ffff88085fc53ee8
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  ffff88045fc89fd8 ffff88085fc53ee0 ffff88085fc53c30
>>>>>> 00000000000119c0
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  00000000000119c0 ffffffff8137f7ce ffff88007f80df40
>>>>>> 00000000ffffffff
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] Call Trace:
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffff8137f7ce>] ? common_interrupt+0xe/0x13
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffffa041bc57>] ? irqfd_inject+0x27/0x50 [kvm]
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffffa041bc30>] ? irqfd_inject+0x0/0x50 [kvm]
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffff8106b6f2>] ? process_one_work+0x112/0x460
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffff8106be25>] ? worker_thread+0x145/0x410
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffff8103a3d0>] ? __wake_up_common+0x50/0x80
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffff8106bce0>] ? worker_thread+0x0/0x410
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffff8106f786>] ? kthread+0x96/0xa0
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffff81003ce4>] ? kernel_thread_helper+0x4/0x10
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffff8106f6f0>] ? kthread+0x0/0xa0
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  [<ffffffff81003ce0>] ? kernel_thread_helper+0x0/0x10
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] Code: ff 41 57 41 89 f7 41 56 41 55 41 89 cd 41 54 49 89
>>>>>> fc 55 53 89 d3 48 81 ec 98 00 00 00 8b 15 c6 79 03 00 85 d2 0f 85 c4
>>>>>> 00 00 00<4
>>>>>> 9>    8b 84 24 58 24 00 00 3b 98 28 01 00 00 73 5e 89 db 48 8b 84
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] RIP  [<ffffffffa041aa8a>] kvm_set_irq+0x2a/0x130 [kvm]
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123]  RSP<ffff88045fc89d30>
>>>>>> Feb 23 13:56:19 ayrshire.u06.univ-nantes.prive kernel: [
>>>>>> 685.246123] CR2: 0000000000002458
>>>>>>
>>>>>>
>>>>>> If someone can help me, on how to solve this.
>>>>>>
>>>>>> Regards.
>>>>>> _______________________________________________
>>>>>> Virtualization mailing list
>>>>>> Virtualization@lists.linux-foundation.org
>>>>>> https://lists.linux-foundation.org/mailman/listinfo/virtualization
>>>>> --
>>>>> To unsubscribe from this list: send the line "unsubscribe netdev" in
>>>>> the body of a message to majordomo@vger.kernel.org
>>>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>> Hi,
>>>>
>>>> thanks for your response.
>>>>
>>>> This is what markup_oops.pl return me:
>>>> "No matching code found"
>>> Well, let's try to understand what's there.
>>>
>>> Do objdumop -ldS kvm.ko
>>> look for<kvm_set_irq>
>>>
>>> and paste the content from start of that function
>>> to offset 0x2a and a bit beyond.
>>>
>>> You can also upload your kvm.ko somewhere, I'll try to take a look.
>>>
>>>
>>>> So this is not a vhost_net bug, or my oops is incomplete and
>>>> markup_oops can't find the good vma offset.
>>>>
>>>> I will try to compare the pointers you indicate me, even it could be
>>>> a little difficult for me.
>>> Hmm you know how to add printk to code and rebuild, right?
>>>
>>>> Maybe i will try a 2.6.38, will wait a response from the kvm team.
>>>>
>>>> Regards.
>>>>
>>>> -- 
>>>> Jean-Philippe Menil - Pôle réseau Service IRTS
>>>> DSI Université de Nantes
>>>> jean-philippe.menil@univ-nantes.fr
>>>> Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09
>> So, here is the result for the objdump against the kvm.ko (the
>> kvm_set_irq part) :
> Can you try building with -g and adding -l and -S to objdump
> please? I'd rather make the tool do the legwork than
> do it manually.
>
>> 0000000000006a60<kvm_set_irq>:
>> kvm_set_irq():
>>      6a60:       41 57                   push   %r15
>>      6a62:       41 89 f7                mov    %esi,%r15d
>>      6a65:       41 56                   push   %r14
>>      6a67:       41 55                   push   %r13
>>      6a69:       41 89 cd                mov    %ecx,%r13d
>>      6a6c:       41 54                   push   %r12
>>      6a6e:       49 89 fc                mov    %rdi,%r12
>>      6a71:       55                      push   %rbp
>>      6a72:       53                      push   %rbx
>>      6a73:       89 d3                   mov    %edx,%ebx
>>      6a75:       48 81 ec 98 00 00 00    sub    $0x98,%rsp
>>      6a7c:       8b 15 00 00 00 00       mov    0x0(%rip),%edx
>> # 6a82<kvm_set_irq+0x22>
>>      6a82:       85 d2                   test   %edx,%edx
>>      6a84:       0f 85 c4 00 00 00       jne    6b4e<kvm_set_irq+0xee>
>>      6a8a:       49 8b 84 24 58 24 00    mov    0x2458(%r12),%rax
> OK, 0x6a8a is the offset.
> After you build with -g, try
>
> addr2line kvm.ko 0x6a8a
>
> and see which line this points to.
>
>
>>      6a91:       00
>>      6a92:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
>>      6a98:       73 5e                   jae    6af8<kvm_set_irq+0x98>
>>      6a9a:       89 db                   mov    %ebx,%ebx
>>      6a9c:       48 8b 84 d8 30 01 00    mov    0x130(%rax,%rbx,8),%rax
>>      6aa3:       00
>>      6aa4:       48 85 c0                test   %rax,%rax
>>      6aa7:       74 4f                   je     6af8<kvm_set_irq+0x98>
>>      6aa9:       48 89 e2                mov    %rsp,%rdx
>>      6aac:       31 db                   xor    %ebx,%ebx
>>      6aae:       48 8b 08                mov    (%rax),%rcx
>>      6ab1:       83 c3 01                add    $0x1,%ebx
>>      6ab4:       0f 18 09                prefetcht0 (%rcx)
>>      6ab7:       48 8b 48 e0             mov    -0x20(%rax),%rcx
>>      6abb:       48 89 0a                mov    %rcx,(%rdx)
>>      6abe:       48 8b 48 e8             mov    -0x18(%rax),%rcx
>>      6ac2:       48 89 4a 08             mov    %rcx,0x8(%rdx)
>>      6ac6:       48 8b 48 f0             mov    -0x10(%rax),%rcx
>>      6aca:       48 89 4a 10             mov    %rcx,0x10(%rdx)
>>      6ace:       48 8b 48 f8             mov    -0x8(%rax),%rcx
>>      6ad2:       48 89 4a 18             mov    %rcx,0x18(%rdx)
>>      6ad6:       48 8b 08                mov    (%rax),%rcx
>>      6ad9:       48 89 4a 20             mov    %rcx,0x20(%rdx)
>>      6add:       48 8b 48 08             mov    0x8(%rax),%rcx
>>      6ae1:       48 89 4a 28             mov    %rcx,0x28(%rdx)
>>      6ae5:       48 8b 00                mov    (%rax),%rax
>>      6ae8:       48 83 c2 30             add    $0x30,%rdx
>>      6aec:       48 85 c0                test   %rax,%rax
>>      6aef:       75 bd                   jne    6aae<kvm_set_irq+0x4e>
>>      6af1:       eb 07                   jmp    6afa<kvm_set_irq+0x9a>
>>      6af3:       0f 1f 44 00 00          nopl   0x0(%rax,%rax,1)
>>      6af8:       31 db                   xor    %ebx,%ebx
>>      6afa:       bd ff ff ff ff          mov    $0xffffffff,%ebp
>>      6aff:       49 89 e6                mov    %rsp,%r14
>>      6b02:       85 db                   test   %ebx,%ebx
>>      6b04:       74 34                   je     6b3a<kvm_set_irq+0xda>
>>      6b06:       83 eb 01                sub    $0x1,%ebx
>>      6b09:       44 89 e9                mov    %r13d,%ecx
>>      6b0c:       44 89 fa                mov    %r15d,%edx
>>      6b0f:       48 63 c3                movslq %ebx,%rax
>>      6b12:       4c 89 e6                mov    %r12,%rsi
>>      6b15:       48 8d 04 40             lea    (%rax,%rax,2),%rax
>>      6b19:       48 c1 e0 04             shl    $0x4,%rax
>>      6b1d:       49 8d 3c 06             lea    (%r14,%rax,1),%rdi
>>      6b21:       ff 54 04 08             callq  *0x8(%rsp,%rax,1)
>>      6b25:       85 c0                   test   %eax,%eax
>>      6b27:       78 d9                   js     6b02<kvm_set_irq+0xa2>
>>      6b29:       85 ed                   test   %ebp,%ebp
>>      6b2b:       ba 00 00 00 00          mov    $0x0,%edx
>>      6b30:       0f 48 ea                cmovs  %edx,%ebp
>>      6b33:       85 db                   test   %ebx,%ebx
>>      6b35:       8d 2c 28                lea    (%rax,%rbp,1),%ebp
>>      6b38:       75 cc                   jne    6b06<kvm_set_irq+0xa6>
>>      6b3a:       48 81 c4 98 00 00 00    add    $0x98,%rsp
>>      6b41:       89 e8                   mov    %ebp,%eax
>>      6b43:       5b                      pop    %rbx
>>      6b44:       5d                      pop    %rbp
>>      6b45:       41 5c                   pop    %r12
>>      6b47:       41 5d                   pop    %r13
>>      6b49:       41 5e                   pop    %r14
>>      6b4b:       41 5f                   pop    %r15
>>      6b4d:       c3                      retq
>>      6b4e:       48 8b 2d 00 00 00 00    mov    0x0(%rip),%rbp
>> # 6b55<kvm_set_irq+0xf5>
>>      6b55:       48 85 ed                test   %rbp,%rbp
>>      6b58:       0f 84 2c ff ff ff       je     6a8a<kvm_set_irq+0x2a>
>>      6b5e:       48 8b 45 00             mov    0x0(%rbp),%rax
>>      6b62:       48 8b 7d 08             mov    0x8(%rbp),%rdi
>>      6b66:       48 83 c5 10             add    $0x10,%rbp
>>      6b6a:       44 89 f9                mov    %r15d,%ecx
>>      6b6d:       44 89 ea                mov    %r13d,%edx
>>      6b70:       89 de                   mov    %ebx,%esi
>>      6b72:       ff d0                   callq  *%rax
>>      6b74:       48 8b 45 00             mov    0x0(%rbp),%rax
>>      6b78:       48 85 c0                test   %rax,%rax
>>      6b7b:       75 e5                   jne    6b62<kvm_set_irq+0x102>
>>      6b7d:       e9 08 ff ff ff          jmpq   6a8a<kvm_set_irq+0x2a>
>>      6b82:       66 66 66 66 66 2e 0f    nopw   %cs:0x0(%rax,%rax,1)
>>      6b89:       1f 84 00 00 00 00 00
>>
>> I admit that this analysis is too complicated for me.
>> I, effectively, can rebuild a kernel with more printk, and program a reboot.
>>
>> The kvm.ko is available through the following address:
>> http://filex.univ-nantes.fr/get?k=k1jKhQghdcHLz12Z50H
>>
>> Regards.
> This has no debug data. Can you rebuild with -g please?
>
> BTW if you want to rerun and get more reliable backtrace,
> tyr enabling frame pointers (do you know how to?). But this will change code
> so backtrace will no longer be val we will need
> a new one.
>
>> -- 
>> Jean-Philippe Menil - Pôle réseau Service IRTS
>> DSI Université de Nantes
>> jean-philippe.menil@univ-nantes.fr
>> Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09
> --
> To unsubscribe from this list: send the line "unsubscribe netdev" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
Host reboot with his new kernel (2.6.37.2), i modprobe vhost_net, start 
three kvm guests.
Host hang in a half an hour.

This time i get a general protection fault:

[ 2380.381225] general protection fault: 0000 [#1] SMP
[ 2380.381261] last sysfs file: 
/sys/devices/system/cpu/cpu11/cache/index2/shared_cpu_map
[ 2380.381309] CPU 0
[ 2380.381316] Modules linked in: vhost_net macvtap macvlan tun veth 
powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave 
cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev 
ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit 
xt_tcpudp xt_state iptable_filter ip_tables x_tables nf_conntrack_tftp 
nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 
mbcache dm_round_robin dm_multipath nf_conntrack_ipv6 nf_conntrack 
nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm snd_timer snd soundcore 
snd_page_alloc shpchp i2c_nforce2 pci_hotplug psmouse tpm_tis joydev 
pcspkr tpm evdev i2c_core dcdbas tpm_bios serio_raw processor ghes 
button hed thermal_sys xfs exportfs dm_mod sg sr_mod cdrom usbhid hid 
usb_storage sd_mod ses enclosure megaraid_sas lpfc ohci_hcd 
scsi_transport_fc scsi_tgt scsi_mod bnx2 ehci_hcd [last unloaded: 
scsi_wait_scan]
Feb 28 15:28:09 ayrshire.u06.univ-nantes.prive kernel: Feb 28 15:28:09 
ayrshire.u06.univ-nantes.prive kernel: [ 2380.381839] Pid: 10, comm: 
kworker/0:1 Not tainted 2.6.37.2-dsiun-110105+ #2 Dell Inc. PowerEdge 
M605/0K543T
[ 2380.381902] RIP: 0010:[<ffffffffa037e877>]  [<ffffffffa037e877>] 
kvm_set_irq+0x37/0x140 [kvm]
[ 2380.381973] RSP: 0018:ffff88045fc85d00  EFLAGS: 00010246
[ 2380.382002] RAX: 000200740000029c RBX: 000000000000001a RCX: 
0000000000000001
[ 2380.382035] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 
ffff88045dbb7440
[ 2380.382068] RBP: ffff88045fc85dd0 R08: ffff88045fc84000 R09: 
000000000000000c
[ 2380.382101] R10: 0000000000000036 R11: 00000000ffffffff R12: 
ffff88045dbb7440
[ 2380.382134] R13: ffff88045dbb7440 R14: ffffffffa037faa0 R15: 
0000000000000001
[ 2380.382168] FS:  00007f0c97165720(0000) GS:ffff88007f800000(0000) 
knlGS:0000000000000000
[ 2380.382216] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 2380.382246] CR2: 00007f13bcc80b40 CR3: 000000045e96c000 CR4: 
00000000000006f0
[ 2380.382279] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 
0000000000000000
[ 2380.382312] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 
0000000000000400
[ 2380.382347] Process kworker/0:1 (pid: 10, threadinfo 
ffff88045fc84000, task ffff88085fc53c30)
[ 2380.382395] Stack:
[ 2380.382416]  00000000000119c0 00000000000119c0 00000000000119c0 
ffff88085fc53c30
[ 2380.382466]  ffff88085fc53ee0 ffff88045fc85fd8 ffff88085fc53ee8 
ffff88045fc84010
[ 2380.382516]  00000000000119c0 ffff88045fc85fd8 00000000000119c0 
00000000000119c0
[ 2380.382566] Call Trace:
[ 2380.382600]  [<ffffffff813818ce>] ? common_interrupt+0xe/0x13
[ 2380.382648]  [<ffffffffa037faa0>] ? irqfd_inject+0x0/0x50 [kvm]
[ 2380.382694]  [<ffffffffa037faca>] irqfd_inject+0x2a/0x50 [kvm]
[ 2380.382729]  [<ffffffff8106b7bb>] process_one_work+0x11b/0x450
[ 2380.382762]  [<ffffffff8106bf37>] worker_thread+0x157/0x410
[ 2380.382796]  [<ffffffff8103a569>] ? __wake_up_common+0x59/0x90
[ 2380.382828]  [<ffffffff8106bde0>] ? worker_thread+0x0/0x410
[ 2380.382861]  [<ffffffff8106f996>] kthread+0x96/0xa0
[ 2380.382894]  [<ffffffff81003c64>] kernel_thread_helper+0x4/0x10
[ 2380.382927]  [<ffffffff8106f900>] ? kthread+0x0/0xa0
[ 2380.382958]  [<ffffffff81003c60>] ? kernel_thread_helper+0x0/0x10
[ 2380.382987] Code: 55 49 89 fd 41 54 53 89 d3 48 81 ec a8 00 00 00 8b 
15 a6 75 03 00 89 b5 3c ff ff ff 85 d2 0f 85 d5 00 00 00 49 8b 85 58 24 
00 00 <3b> 98 28 01 00 00 73 61 89 db 48 8b 84 d8 30 01 00 00 48 85 c0
[ 2380.383185] RIP  [<ffffffffa037e877>] kvm_set_irq+0x37/0x140 [kvm]
[ 2380.383231]  RSP <ffff88045fc85d00>

Running markup_oops.pl give me the following:

vmaoffset = 18446744072102576128 ffffffffa037e841:    48 89 
e5                 mov    %rsp,%rbp
  ffffffffa037e844:    41 57                    push   %r15
  ffffffffa037e846:    41 89 cf                 mov    %ecx,%r15d  |  
%r15 => 1  %ecx = 1
  ffffffffa037e849:    41 56                    push   %r14        |  
%r14 => ffffffffa037faa0
  ffffffffa037e84b:    41 55                    push   %r13
  ffffffffa037e84d:    49 89 fd                 mov    %rdi,%r13   |  
%edi = ffff88045dbb7440  %r13 => ffff88045dbb7440
  ffffffffa037e850:    41 54                    push   %r12        |  
%r12 => ffff88045dbb7440
  ffffffffa037e852:    53                       push   %rbx
  ffffffffa037e853:    89 d3                    mov    %edx,%ebx   |  
%ebx => 1a
  ffffffffa037e855:    48 81 ec a8 00 00 00     sub    $0xa8,%rsp
  ffffffffa037e85c:    8b 15 00 00 00 00        mov    
0x0(%rip),%edx        # ffffffffa037e862 <kvm_set_irq+0x22>
  ffffffffa037e862:    89 b5 3c ff ff ff        mov    %esi,-0xc4(%rbp) 
|  %esi = 0
  ffffffffa037e868:    85 d2                    test   %edx,%edx   |  
%edx => 0
  ffffffffa037e86a:    0f 85 d5 00 00 00        jne    ffffffffa037e945 
<kvm_set_irq+0x105>
  ffffffffa037e870:    49 8b 85 58 24 00 00     mov    0x2458(%r13),%rax 
|  %eax => 200740000029c  %r13 = ffff88045dbb7440
*ffffffffa037e877:    3b 98 28 01 00 00        cmp    0x128(%rax),%ebx 
|  %eax = 200740000029c  %ebx = 1a <--- faulting instruction
  ffffffffa037e87d:    73 61                    jae    ffffffffa037e8e0 
<kvm_set_irq+0xa0>
  ffffffffa037e87f:    89 db                    mov    %ebx,%ebx
  ffffffffa037e881:    48 8b 84 d8 30 01 00     mov    
0x130(%rax,%rbx,8),%rax
  ffffffffa037e888:    00
  ffffffffa037e889:    48 85 c0                 test   %rax,%rax
  ffffffffa037e88c:    74 52                    je     ffffffffa037e8e0 
<kvm_set_irq+0xa0>
  ffffffffa037e88e:    48 8d 95 40 ff ff ff     lea    -0xc0(%rbp),%rdx
  ffffffffa037e895:    31 db                    xor    %ebx,%ebx
  ffffffffa037e897:    48 8b 08                 mov    (%rax),%rcx
  ffffffffa037e89a:    83 c3 01                 add    $0x1,%ebx
  ffffffffa037e89d:    0f 18 09                 prefetcht0 (%rcx)
  ffffffffa037e8a0:    48 8b 48 e0              mov    -0x20(%rax),%rcx
  ffffffffa037e8a4:    48 89 0a                 mov    %rcx,(%rdx)
  ffffffffa037e8a7:    48 8b 48 e8              mov    -0x18(%rax),%rcx
  ffffffffa037e8ab:    48 89 4a 08              mov    %rcx,0x8(%rdx)
  ffffffffa037e8af:    48 8b 48 f0              mov    -0x10(%rax),%rcx
  ffffffffa037e8b3:    48 89 4a 10              mov    %rcx,0x10(%rdx)
  ffffffffa037e8b7:    48 8b 48 f8              mov    -0x8(%rax),%rcx
  ffffffffa037e8bb:    48 89 4a 18              mov    %rcx,0x18(%rdx)
  ffffffffa037e8bf:    48 8b 08                 mov    (%rax),%rcx

I've re-run markup_oops on the first oops (2.6.37.1) (on the right 
module this time, sorry for that), it give me the following:

vmaoffset = 18446744072103215104 ffffffffa041aa62:    41 89 
f7                 mov    %esi,%r15d  |  %r15 => 0  %esi = 0
  ffffffffa041aa65:    41 56                    push   %r14        |  
%r14 => 0
  ffffffffa041aa67:    41 55                    push   %r13
  ffffffffa041aa69:    41 89 cd                 mov    %ecx,%r13d  |  
%ecx = 1  %r13 => 1
  ffffffffa041aa6c:    41 54                    push   %r12
  ffffffffa041aa6e:    49 89 fc                 mov    %rdi,%r12   |  
%edi = 0  %r12 => 0
  ffffffffa041aa71:    55                       push   %rbp
  ffffffffa041aa72:    53                       push   %rbx
  ffffffffa041aa73:    89 d3                    mov    %edx,%ebx   |  
%ebx => 1a
  ffffffffa041aa75:    48 81 ec 98 00 00 00     sub    $0x98,%rsp
  ffffffffa041aa7c:    8b 15 00 00 00 00        mov    
0x0(%rip),%edx        # ffffffffa041aa82 <kvm_set_irq+0x22>
  ffffffffa041aa82:    85 d2                    test   %edx,%edx   |  
%edx => 0
  ffffffffa041aa84:    0f 85 c4 00 00 00        jne    ffffffffa041ab4e 
<kvm_set_irq+0xee>
*ffffffffa041aa8a:    49 8b 84 24 58 24 00     mov    0x2458(%r12),%rax 
|  %eax = 0  %r12 = 0 <--- faulting instruction
  ffffffffa041aa91:    00
  ffffffffa041aa92:    3b 98 28 01 00 00        cmp    0x128(%rax),%ebx
  ffffffffa041aa98:    73 5e                    jae    ffffffffa041aaf8 
<kvm_set_irq+0x98>
  ffffffffa041aa9a:    89 db                    mov    %ebx,%ebx
  ffffffffa041aa9c:    48 8b 84 d8 30 01 00     mov    
0x130(%rax,%rbx,8),%rax
  ffffffffa041aaa3:    00
  ffffffffa041aaa4:    48 85 c0                 test   %rax,%rax
  ffffffffa041aaa7:    74 4f                    je     ffffffffa041aaf8 
<kvm_set_irq+0x98>
  ffffffffa041aaa9:    48 89 e2                 mov    %rsp,%rdx
  ffffffffa041aaac:    31 db                    xor    %ebx,%ebx
  ffffffffa041aaae:    48 8b 08                 mov    (%rax),%rcx
  ffffffffa041aab1:    83 c3 01                 add    $0x1,%ebx
  ffffffffa041aab4:    0f 18 09                 prefetcht0 (%rcx)
  ffffffffa041aab7:    48 8b 48 e0              mov    -0x20(%rax),%rcx
  ffffffffa041aabb:    48 89 0a                 mov    %rcx,(%rdx)
  ffffffffa041aabe:    48 8b 48 e8              mov    -0x18(%rax),%rcx
  ffffffffa041aac2:    48 89 4a 08              mov    %rcx,0x8(%rdx)
  ffffffffa041aac6:    48 8b 48 f0              mov    -0x10(%rax),%rcx
  ffffffffa041aaca:    48 89 4a 10              mov    %rcx,0x10(%rdx)
  ffffffffa041aace:    48 8b 48 f8              mov    -0x8(%rax),%rcx

It's appear that the kernel i recompiled (make-pkg) with the debug 
options for kvm module, doesn't have the debug!
addr2line give me an "??:0"

I will retent with the good options.

Regards.

-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-02-28 15:13           ` Jean-Philippe Menil
@ 2011-02-28 22:34             ` Jean-Philippe Menil
  2011-03-01  7:03               ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-02-28 22:34 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: netdev, kvm, virtualization

[-- Attachment #1: Type: text/plain, Size: 14653 bytes --]

Hi,

here is another trace with kvm.ko compiled with debug flags.

the bug:
[12099.503414] BUG: unable to handle kernel paging request at 
000000000b6635e9
[12099.503462] IP: [<ffffffffa03ee877>] kvm_set_irq+0x37/0x140 [kvm]
[12099.503521] PGD 45d8d2067 PUD 45d58e067 PMD 0
[12099.503560] Oops: 0000 [#1] SMP
[12099.503591] last sysfs file: 
/sys/devices/system/cpu/cpu11/cache/index2/shared_cpu_map
[12099.503641] CPU 0
[12099.503648] Modules linked in: netconsole configfs vhost_net macvtap 
macvlan tun veth powernow_k8 mperf cpufreq_userspace cpufreq_stats 
cpufreq_powersave cpufreq_ondemand freq_table cpufreq_conservative fuse 
xt_physdev ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport 
xt_limit xt_tcpudp xt_state iptable_filter ip_tables x_tables 
nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4 
8021q bridge stp ext2 mbcache dm_round_robin dm_multipath 
nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm 
snd_timer snd soundcore snd_page_alloc shpchp pci_hotplug tpm_tis 
i2c_nforce2 tpm i2c_core pcspkr evdev psmouse joydev tpm_bios processor 
ghes dcdbas hed button serio_raw thermal_sys xfs exportfs dm_mod sg 
sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure megaraid_sas 
ohci_hcd lpfc scsi_transport_fc bnx2 scsi_tgt scsi_mod ehci_hcd [last 
unloaded: scsi_wait_scan]
[12099.504277]
[12099.504302] Pid: 1742, comm: kworker/0:2 Not tainted 
2.6.37.2-dsiun-110105+ #2 Dell Inc. PowerEdge M605/0K543T
[12099.504373] RIP: 0010:[<ffffffffa03ee877>]  [<ffffffffa03ee877>] 
kvm_set_irq+0x37/0x140 [kvm]
[12099.504444] RSP: 0018:ffff88045e013d00  EFLAGS: 00010246
[12099.504474] RAX: 000000000b6634c1 RBX: 0000000000000018 RCX: 
0000000000000001
[12099.504508] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 
ffff880419b600c0
[12099.504541] RBP: ffff88045e013dd0 R08: ffff88045e012000 R09: 
0000000000000000
[12099.504575] R10: 0000000000000000 R11: 00000000ffffffff R12: 
ffff880419b600c0
[12099.504609] R13: ffff880419b600c0 R14: ffffffffa03efaa0 R15: 
0000000000000001
[12099.504643] FS:  00007f3abaa05710(0000) GS:ffff88007f800000(0000) 
knlGS:0000000000000000
[12099.504693] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[12099.504724] CR2: 000000000b6635e9 CR3: 000000045e2bc000 CR4: 
00000000000006f0
[12099.504757] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 
0000000000000000
[12099.504791] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 
0000000000000400
[12099.504825] Process kworker/0:2 (pid: 1742, threadinfo 
ffkvm_set_irqff88045e012000, task ffff88045ffb0d60)
[12099.504874] Stack:
[12099.504897]  00000000000119c0 00000000000119c0 00000000000119c0 
ffff88045ffb0d60
[12099.504953]  ffff88045ffb1010 ffff88045e013fd8 ffff88045ffb1018 
ffff88045e012010
[12099.505009]  00000000000119c0 ffff88045e013fd8 00000000000119c0 
00000000000119c0
[12099.505065] Call Trace:
[12099.505099]  [<ffffffff813818ce>] ? common_interrupt+0xe/0x13
[12099.505145]  [<ffffffffa03efaa0>] ? irqfd_inject+0x0/0x50 [kvm]
[12099.505145]  [<ffffffffa03efaca>] irqfd_inject+0x2a/0x50 [kvm]
[12099.505145]  [<ffffffff8106b7bb>] process_one_work+0x11b/0x450
[12099.505145]  [<ffffffff8106bf37>] worker_thread+0x157/0x410
[12099.505145]  [<ffffffff8103a569>] ? __wake_up_common+0x59/0x90
[12099.505145]  [<ffffffff8106bde0>] ? worker_thread+0x0/0x410
[12099.505145]  [<ffffffff8106f996>] kthread+0x96/0xa0
[12099.505145]  [<ffffffff81003c64>] kernel_thread_helper+0x4/0x10
[12099.505145]  [<ffffffff8106f900>] ? kthread+0x0/0xa0
[12099.505145]  [<ffffffff81003c60>] ? kernel_thread_helper+0x0/0x10
[12099.505145] Code: 55 49 89 fd 41 54 53 89 d3 48 81 ec a8 00 00 00 8b 
15 a6 75 03 00 89 b5 3c ff ff ff 85 d2 0f 85 d5 00 00 00 49 8b 85 58 24 
00 00 <3b> 98 28 01 00 00 73 61 89 db 48 8b 84 d8 30 01 00 00 48 85 c0
[12099.505145] RIP  [<ffffffffa03ee877>] kvm_set_irq+0x37/0x140 [kvm]
[12099.505145]  RSP <ffff88045e013d00>
[12099.505145] CR2: 000000000b6635e9


markup_oops result:

root@ayrshire:~# cat bug.txt | perl markup_oops.pl -m 
/lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko 
/boot/vmlinuz-2.6.37.2-dsiun-110105+
vmaoffset = 18446744072103034880 ffffffffa03ee841:	48 89 e5 
   	mov    %rsp,%rbp
  ffffffffa03ee844:	41 57                	push   %r15
  ffffffffa03ee846:	41 89 cf             	mov    %ecx,%r15d  |  %r15 => 
1  %ecx = 1
  ffffffffa03ee849:	41 56                	push   %r14        |  %r14 => 
ffffffffa03efaa0
  ffffffffa03ee84b:	41 55                	push   %r13
  ffffffffa03ee84d:	49 89 fd             	mov    %rdi,%r13   |  %edi = 
ffff880419b600c0  %r13 => ffff880419b600c0
  ffffffffa03ee850:	41 54                	push   %r12        |  %r12 => 
ffff880419b600c0
  ffffffffa03ee852:	53                   	push   %rbx
  ffffffffa03ee853:	89 d3                	mov    %edx,%ebx   |  %ebx => 18
  ffffffffa03ee855:	48 81 ec a8 00 00 00 	sub    $0xa8,%rsp
  ffffffffa03ee85c:	8b 15 00 00 00 00    	mov    0x0(%rip),%edx        # 
ffffffffa03ee862 <kvm_set_irq+0x22>
  ffffffffa03ee862:	89 b5 3c ff ff ff    	mov    %esi,-0xc4(%rbp) | 
%esi = 0
  ffffffffa03ee868:	85 d2                	test   %edx,%edx   |  %edx => 0
  ffffffffa03ee86a:	0f 85 d5 00 00 00    	jne    ffffffffa03ee945 
<kvm_set_irq+0x105>
  ffffffffa03ee870:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax | 
%eax => b6634c1  %r13 = ffff880419b600c0
*ffffffffa03ee877:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx |  %eax 
= b6634c1  %ebx = 18 <--- faulting instruction
  ffffffffa03ee87d:	73 61                	jae    ffffffffa03ee8e0 
<kvm_set_irq+0xa0>
  ffffffffa03ee87f:	89 db                	mov    %ebx,%ebx
  ffffffffa03ee881:	48 8b 84 d8 30 01 00 	mov    0x130(%rax,%rbx,8),%rax
  ffffffffa03ee888:	00
  ffffffffa03ee889:	48 85 c0             	test   %rax,%rax
  ffffffffa03ee88c:	74 52                	je     ffffffffa03ee8e0 
<kvm_set_irq+0xa0>
  ffffffffa03ee88e:	48 8d 95 40 ff ff ff 	lea    -0xc0(%rbp),%rdx
  ffffffffa03ee895:	31 db                	xor    %ebx,%ebx
  ffffffffa03ee897:	48 8b 08             	mov    (%rax),%rcx
  ffffffffa03ee89a:	83 c3 01             	add    $0x1,%ebx
  ffffffffa03ee89d:	0f 18 09             	prefetcht0 (%rcx)
  ffffffffa03ee8a0:	48 8b 48 e0          	mov    -0x20(%rax),%rcx
  ffffffffa03ee8a4:	48 89 0a             	mov    %rcx,(%rdx)
  ffffffffa03ee8a7:	48 8b 48 e8          	mov    -0x18(%rax),%rcx
  ffffffffa03ee8ab:	48 89 4a 08          	mov    %rcx,0x8(%rdx)
  ffffffffa03ee8af:	48 8b 48 f0          	mov    -0x10(%rax),%rcx
  ffffffffa03ee8b3:	48 89 4a 10          	mov    %rcx,0x10(%rdx)
  ffffffffa03ee8b7:	48 8b 48 f8          	mov    -0x8(%rax),%rcx
  ffffffffa03ee8bb:	48 89 4a 18          	mov    %rcx,0x18(%rdx)
  ffffffffa03ee8bf:	48 8b 08             	mov    (%rax),%rcx

The relvant part of objdump for kvm_set_irq:
root@ayrshire:~# objdump -ldS 
/lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko > dump.txt

0000000000006840 <kvm_set_irq>:
kvm_set_irq():
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:148
     6840:       55                      push   %rbp
     6841:       48 89 e5                mov    %rsp,%rbp
     6844:       41 57                   push   %r15
     6846:       41 89 cf                mov    %ecx,%r15d
     6849:       41 56                   push   %r14
     684b:       41 55                   push   %r13
     684d:       49 89 fd                mov    %rdi,%r13
     6850:       41 54                   push   %r12
     6852:       53                      push   %rbx
     6853:       89 d3                   mov    %edx,%ebx
     6855:       48 81 ec a8 00 00 00    sub    $0xa8,%rsp
trace_kvm_set_irq():
/usr/src/GIT/linux-2.6-stable/include/trace/events/kvm.h:10
     685c:       8b 15 00 00 00 00       mov    0x0(%rip),%edx        # 
6862 <kvm_set_irq+0x22>
kvm_set_irq():
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:148
     6862:       89 b5 3c ff ff ff       mov    %esi,-0xc4(%rbp)
trace_kvm_set_irq():
/usr/src/GIT/linux-2.6-stable/include/trace/events/kvm.h:10
     6868:       85 d2                   test   %edx,%edx
     686a:       0f 85 d5 00 00 00       jne    6945 <kvm_set_irq+0x105>
kvm_set_irq():
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
     6870:       49 8b 85 58 24 00 00    mov    0x2458(%r13),%rax
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
     6877:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
     687d:       73 61                   jae    68e0 <kvm_set_irq+0xa0>
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:163
     687f:       89 db                   mov    %ebx,%ebx
     6881:       48 8b 84 d8 30 01 00    mov    0x130(%rax,%rbx,8),%rax
     6888:       00
     6889:       48 85 c0                test   %rax,%rax
     688c:       74 52                   je     68e0 <kvm_set_irq+0xa0>
     688e:       48 8d 95 40 ff ff ff    lea    -0xc0(%rbp),%rdx
     6895:       31 db                   xor    %ebx,%ebx
     6897:       48 8b 08                mov    (%rax),%rcx
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:164
     689a:       83 c3 01                add    $0x1,%ebx
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:163
     689d:       0f 18 09                prefetcht0 (%rcx)
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:164
     68a0:       48 8b 48 e0             mov    -0x20(%rax),%rcx
     68a4:       48 89 0a                mov    %rcx,(%rdx)
     68a7:       48 8b 48 e8             mov    -0x18(%rax),%rcx
     68ab:       48 89 4a 08             mov    %rcx,0x8(%rdx)
     68af:       48 8b 48 f0             mov    -0x10(%rax),%rcx
     68b3:       48 89 4a 10             mov    %rcx,0x10(%rdx)
     68b7:       48 8b 48 f8             mov    -0x8(%rax),%rcx
     68bb:       48 89 4a 18             mov    %rcx,0x18(%rdx)
     68bf:       48 8b 08                mov    (%rax),%rcx
     68c2:       48 89 4a 20             mov    %rcx,0x20(%rdx)
     68c6:       48 8b 48 08             mov    0x8(%rax),%rcx
     68ca:       48 89 4a 28             mov    %rcx,0x28(%rdx)
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:163
     68ce:       48 8b 00                mov    (%rax),%rax
     68d1:       48 83 c2 30             add    $0x30,%rdx
     68d5:       48 85 c0                test   %rax,%rax
     68d8:       75 bd                   jne    6897 <kvm_set_irq+0x57>
     68da:       eb 06                   jmp    68e2 <kvm_set_irq+0xa2>
     68dc:       0f 1f 40 00             nopl   0x0(%rax)
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
     68e0:       31 db                   xor    %ebx,%ebx
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:169
     68e2:       4c 8d b5 40 ff ff ff    lea    -0xc0(%rbp),%r14
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
     68e9:       41 bc ff ff ff ff       mov    $0xffffffff,%r12d
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:167
     68ef:       85 db                   test   %ebx,%ebx
     68f1:       74 3d                   je     6930 <kvm_set_irq+0xf0>
     68f3:       83 eb 01                sub    $0x1,%ebx
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:169
     68f6:       44 89 f9                mov    %r15d,%ecx
     68f9:       8b 95 3c ff ff ff       mov    -0xc4(%rbp),%edx
     68ff:       48 63 c3                movslq %ebx,%rax
     6902:       4c 89 ee                mov    %r13,%rsi
     6905:       48 8d 04 40             lea    (%rax,%rax,2),%rax
     6909:       48 c1 e0 04             shl    $0x4,%rax
     690d:       49 8d 3c 06             lea    (%r14,%rax,1),%rdi
     6911:       ff 94 05 48 ff ff ff    callq  *-0xb8(%rbp,%rax,1)
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:170
     6918:       85 c0                   test   %eax,%eax
     691a:       78 d3                   js     68ef <kvm_set_irq+0xaf>
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:173
     691c:       45 85 e4                test   %r12d,%r12d
     691f:       ba 00 00 00 00          mov    $0x0,%edx
     6924:       44 0f 48 e2             cmovs  %edx,%r12d
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:167
     6928:       85 db                   test   %ebx,%ebx
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:173
     692a:       46 8d 24 20             lea    (%rax,%r12,1),%r12d
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:167
     692e:       75 c3                   jne    68f3 <kvm_set_irq+0xb3>
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:177
     6930:       48 81 c4 a8 00 00 00    add    $0xa8,%rsp
     6937:       44 89 e0                mov    %r12d,%eax
     693a:       5b                      pop    %rbx
     693b:       41 5c                   pop    %r12
     693d:       41 5d                   pop    %r13
     693f:       41 5e                   pop    %r14
     6941:       41 5f                   pop    %r15
     6943:       c9                      leaveq
     6944:       c3                      retq
trace_kvm_set_irq():
/usr/src/GIT/linux-2.6-stable/include/trace/events/kvm.h:10
     6945:       4c 8b 25 00 00 00 00    mov    0x0(%rip),%r12        # 
694c <kvm_set_irq+0x10c>
     694c:       4d 85 e4                test   %r12,%r12
     694f:       0f 84 1b ff ff ff       je     6870 <kvm_set_irq+0x30>
     6955:       49 8b 04 24             mov    (%r12),%rax
     6959:       49 8b 7c 24 08          mov    0x8(%r12),%rdi
     695e:       49 83 c4 10             add    $0x10,%r12
     6962:       8b 8d 3c ff ff ff       mov    -0xc4(%rbp),%ecx
     6968:       44 89 fa                mov    %r15d,%edx
     696b:       89 de                   mov    %ebx,%esi
     696d:       ff d0                   callq  *%rax
     696f:       49 8b 04 24             mov    (%r12),%rax
     6973:       48 85 c0                test   %rax,%rax
     6976:       75 e1                   jne    6959 <kvm_set_irq+0x119>
     6978:       e9 f3 fe ff ff          jmpq   6870 <kvm_set_irq+0x30>
kvm_set_irq():
     697d:       0f 1f 00                nopl   (%rax)

So, if i've read correctly, the offset is 0x6877 ?

root@ayrshire:~# addr2line -e 
/lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko 0x6877
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162


Is it the correct way to analyse this?

Regards.

[-- Attachment #2: jean-philippe_menil.vcf --]
[-- Type: text/x-vcard, Size: 361 bytes --]

begin:vcard
fn:Jean-Philippe Menil
n:Menil;Jean-Philippe
org;quoted-printable:Universit=C3=A9 de Nantes;IRTS - DSI
adr;quoted-printable:;;2 rue de la Houssini=C3=A8re;Nantes;Loire-Atlantique;44382;France
email;internet:jean-philippe.menil@univ-nantes.fr
title;quoted-printable:Administrateur R=C3=A9seau
url:http://www.cri.univ-nantes.fr
version:2.1
end:vcard


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-02-28 22:34             ` Jean-Philippe Menil
@ 2011-03-01  7:03               ` Michael S. Tsirkin
  2011-03-01 14:39                 ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-03-01  7:03 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: netdev, kvm, virtualization

On Mon, Feb 28, 2011 at 11:34:16PM +0100, Jean-Philippe Menil wrote:
> Hi,
> 
> here is another trace with kvm.ko compiled with debug flags.
> 
> the bug:
> [12099.503414] BUG: unable to handle kernel paging request at
> 000000000b6635e9
> [12099.503462] IP: [<ffffffffa03ee877>] kvm_set_irq+0x37/0x140 [kvm]
> [12099.503521] PGD 45d8d2067 PUD 45d58e067 PMD 0
> [12099.503560] Oops: 0000 [#1] SMP
> [12099.503591] last sysfs file:
> /sys/devices/system/cpu/cpu11/cache/index2/shared_cpu_map
> [12099.503641] CPU 0
> [12099.503648] Modules linked in: netconsole configfs vhost_net
> macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace
> cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table
> cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter
> ip6_tables ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state
> iptable_filter ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp
> nf_conntrack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 mbcache
> dm_round_robin dm_multipath nf_conntrack_ipv6 nf_conntrack
> nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm snd_timer snd soundcore
> snd_page_alloc shpchp pci_hotplug tpm_tis i2c_nforce2 tpm i2c_core
> pcspkr evdev psmouse joydev tpm_bios processor ghes dcdbas hed
> button serio_raw thermal_sys xfs exportfs dm_mod sg sr_mod cdrom
> usbhid hid usb_storage ses sd_mod enclosure megaraid_sas ohci_hcd
> lpfc scsi_transport_fc bnx2 scsi_tgt scsi_mod ehci_hcd [last
> unloaded: scsi_wait_scan]
> [12099.504277]
> [12099.504302] Pid: 1742, comm: kworker/0:2 Not tainted
> 2.6.37.2-dsiun-110105+ #2 Dell Inc. PowerEdge M605/0K543T
> [12099.504373] RIP: 0010:[<ffffffffa03ee877>]  [<ffffffffa03ee877>]
> kvm_set_irq+0x37/0x140 [kvm]
> [12099.504444] RSP: 0018:ffff88045e013d00  EFLAGS: 00010246
> [12099.504474] RAX: 000000000b6634c1 RBX: 0000000000000018 RCX:
> 0000000000000001
> [12099.504508] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
> ffff880419b600c0
> [12099.504541] RBP: ffff88045e013dd0 R08: ffff88045e012000 R09:
> 0000000000000000
> [12099.504575] R10: 0000000000000000 R11: 00000000ffffffff R12:
> ffff880419b600c0
> [12099.504609] R13: ffff880419b600c0 R14: ffffffffa03efaa0 R15:
> 0000000000000001
> [12099.504643] FS:  00007f3abaa05710(0000) GS:ffff88007f800000(0000)
> knlGS:0000000000000000
> [12099.504693] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> [12099.504724] CR2: 000000000b6635e9 CR3: 000000045e2bc000 CR4:
> 00000000000006f0
> [12099.504757] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [12099.504791] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> [12099.504825] Process kworker/0:2 (pid: 1742, threadinfo
> ffkvm_set_irqff88045e012000, task ffff88045ffb0d60)
> [12099.504874] Stack:
> [12099.504897]  00000000000119c0 00000000000119c0 00000000000119c0
> ffff88045ffb0d60
> [12099.504953]  ffff88045ffb1010 ffff88045e013fd8 ffff88045ffb1018
> ffff88045e012010
> [12099.505009]  00000000000119c0 ffff88045e013fd8 00000000000119c0
> 00000000000119c0
> [12099.505065] Call Trace:
> [12099.505099]  [<ffffffff813818ce>] ? common_interrupt+0xe/0x13
> [12099.505145]  [<ffffffffa03efaa0>] ? irqfd_inject+0x0/0x50 [kvm]
> [12099.505145]  [<ffffffffa03efaca>] irqfd_inject+0x2a/0x50 [kvm]
> [12099.505145]  [<ffffffff8106b7bb>] process_one_work+0x11b/0x450
> [12099.505145]  [<ffffffff8106bf37>] worker_thread+0x157/0x410
> [12099.505145]  [<ffffffff8103a569>] ? __wake_up_common+0x59/0x90
> [12099.505145]  [<ffffffff8106bde0>] ? worker_thread+0x0/0x410
> [12099.505145]  [<ffffffff8106f996>] kthread+0x96/0xa0
> [12099.505145]  [<ffffffff81003c64>] kernel_thread_helper+0x4/0x10
> [12099.505145]  [<ffffffff8106f900>] ? kthread+0x0/0xa0
> [12099.505145]  [<ffffffff81003c60>] ? kernel_thread_helper+0x0/0x10
> [12099.505145] Code: 55 49 89 fd 41 54 53 89 d3 48 81 ec a8 00 00 00
> 8b 15 a6 75 03 00 89 b5 3c ff ff ff 85 d2 0f 85 d5 00 00 00 49 8b 85
> 58 24 00 00 <3b> 98 28 01 00 00 73 61 89 db 48 8b 84 d8 30 01 00 00
> 48 85 c0
> [12099.505145] RIP  [<ffffffffa03ee877>] kvm_set_irq+0x37/0x140 [kvm]
> [12099.505145]  RSP <ffff88045e013d00>
> [12099.505145] CR2: 000000000b6635e9
> 
> 
> markup_oops result:
> 
> root@ayrshire:~# cat bug.txt | perl markup_oops.pl -m
> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
> /boot/vmlinuz-2.6.37.2-dsiun-110105+
> vmaoffset = 18446744072103034880 ffffffffa03ee841:	48 89 e5   	mov
> %rsp,%rbp
>  ffffffffa03ee844:	41 57                	push   %r15
>  ffffffffa03ee846:	41 89 cf             	mov    %ecx,%r15d  |  %r15
> => 1  %ecx = 1
>  ffffffffa03ee849:	41 56                	push   %r14        |  %r14
> => ffffffffa03efaa0
>  ffffffffa03ee84b:	41 55                	push   %r13
>  ffffffffa03ee84d:	49 89 fd             	mov    %rdi,%r13   |  %edi
> = ffff880419b600c0  %r13 => ffff880419b600c0
>  ffffffffa03ee850:	41 54                	push   %r12        |  %r12
> => ffff880419b600c0
>  ffffffffa03ee852:	53                   	push   %rbx
>  ffffffffa03ee853:	89 d3                	mov    %edx,%ebx   |  %ebx => 18
>  ffffffffa03ee855:	48 81 ec a8 00 00 00 	sub    $0xa8,%rsp
>  ffffffffa03ee85c:	8b 15 00 00 00 00    	mov    0x0(%rip),%edx
> # ffffffffa03ee862 <kvm_set_irq+0x22>
>  ffffffffa03ee862:	89 b5 3c ff ff ff    	mov    %esi,-0xc4(%rbp) |
> %esi = 0
>  ffffffffa03ee868:	85 d2                	test   %edx,%edx   |  %edx => 0
>  ffffffffa03ee86a:	0f 85 d5 00 00 00    	jne    ffffffffa03ee945
> <kvm_set_irq+0x105>
>  ffffffffa03ee870:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax |
> %eax => b6634c1  %r13 = ffff880419b600c0
> *ffffffffa03ee877:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx |
> %eax = b6634c1  %ebx = 18 <--- faulting instruction
>  ffffffffa03ee87d:	73 61                	jae    ffffffffa03ee8e0
> <kvm_set_irq+0xa0>
>  ffffffffa03ee87f:	89 db                	mov    %ebx,%ebx
>  ffffffffa03ee881:	48 8b 84 d8 30 01 00 	mov    0x130(%rax,%rbx,8),%rax
>  ffffffffa03ee888:	00
>  ffffffffa03ee889:	48 85 c0             	test   %rax,%rax
>  ffffffffa03ee88c:	74 52                	je     ffffffffa03ee8e0
> <kvm_set_irq+0xa0>
>  ffffffffa03ee88e:	48 8d 95 40 ff ff ff 	lea    -0xc0(%rbp),%rdx
>  ffffffffa03ee895:	31 db                	xor    %ebx,%ebx
>  ffffffffa03ee897:	48 8b 08             	mov    (%rax),%rcx
>  ffffffffa03ee89a:	83 c3 01             	add    $0x1,%ebx
>  ffffffffa03ee89d:	0f 18 09             	prefetcht0 (%rcx)
>  ffffffffa03ee8a0:	48 8b 48 e0          	mov    -0x20(%rax),%rcx
>  ffffffffa03ee8a4:	48 89 0a             	mov    %rcx,(%rdx)
>  ffffffffa03ee8a7:	48 8b 48 e8          	mov    -0x18(%rax),%rcx
>  ffffffffa03ee8ab:	48 89 4a 08          	mov    %rcx,0x8(%rdx)
>  ffffffffa03ee8af:	48 8b 48 f0          	mov    -0x10(%rax),%rcx
>  ffffffffa03ee8b3:	48 89 4a 10          	mov    %rcx,0x10(%rdx)
>  ffffffffa03ee8b7:	48 8b 48 f8          	mov    -0x8(%rax),%rcx
>  ffffffffa03ee8bb:	48 89 4a 18          	mov    %rcx,0x18(%rdx)
>  ffffffffa03ee8bf:	48 8b 08             	mov    (%rax),%rcx
> 
> The relvant part of objdump for kvm_set_irq:
> root@ayrshire:~# objdump -ldS
> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko >
> dump.txt
> 
> 0000000000006840 <kvm_set_irq>:
> kvm_set_irq():
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:148
>     6840:       55                      push   %rbp
>     6841:       48 89 e5                mov    %rsp,%rbp
>     6844:       41 57                   push   %r15
>     6846:       41 89 cf                mov    %ecx,%r15d
>     6849:       41 56                   push   %r14
>     684b:       41 55                   push   %r13
>     684d:       49 89 fd                mov    %rdi,%r13
>     6850:       41 54                   push   %r12
>     6852:       53                      push   %rbx
>     6853:       89 d3                   mov    %edx,%ebx
>     6855:       48 81 ec a8 00 00 00    sub    $0xa8,%rsp
> trace_kvm_set_irq():
> /usr/src/GIT/linux-2.6-stable/include/trace/events/kvm.h:10
>     685c:       8b 15 00 00 00 00       mov    0x0(%rip),%edx
> # 6862 <kvm_set_irq+0x22>
> kvm_set_irq():
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:148
>     6862:       89 b5 3c ff ff ff       mov    %esi,-0xc4(%rbp)
> trace_kvm_set_irq():
> /usr/src/GIT/linux-2.6-stable/include/trace/events/kvm.h:10
>     6868:       85 d2                   test   %edx,%edx
>     686a:       0f 85 d5 00 00 00       jne    6945 <kvm_set_irq+0x105>
> kvm_set_irq():
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
>     6870:       49 8b 85 58 24 00 00    mov    0x2458(%r13),%rax
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>     6877:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
>     687d:       73 61                   jae    68e0 <kvm_set_irq+0xa0>
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:163
>     687f:       89 db                   mov    %ebx,%ebx
>     6881:       48 8b 84 d8 30 01 00    mov    0x130(%rax,%rbx,8),%rax
>     6888:       00
>     6889:       48 85 c0                test   %rax,%rax
>     688c:       74 52                   je     68e0 <kvm_set_irq+0xa0>
>     688e:       48 8d 95 40 ff ff ff    lea    -0xc0(%rbp),%rdx
>     6895:       31 db                   xor    %ebx,%ebx
>     6897:       48 8b 08                mov    (%rax),%rcx
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:164
>     689a:       83 c3 01                add    $0x1,%ebx
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:163
>     689d:       0f 18 09                prefetcht0 (%rcx)
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:164
>     68a0:       48 8b 48 e0             mov    -0x20(%rax),%rcx
>     68a4:       48 89 0a                mov    %rcx,(%rdx)
>     68a7:       48 8b 48 e8             mov    -0x18(%rax),%rcx
>     68ab:       48 89 4a 08             mov    %rcx,0x8(%rdx)
>     68af:       48 8b 48 f0             mov    -0x10(%rax),%rcx
>     68b3:       48 89 4a 10             mov    %rcx,0x10(%rdx)
>     68b7:       48 8b 48 f8             mov    -0x8(%rax),%rcx
>     68bb:       48 89 4a 18             mov    %rcx,0x18(%rdx)
>     68bf:       48 8b 08                mov    (%rax),%rcx
>     68c2:       48 89 4a 20             mov    %rcx,0x20(%rdx)
>     68c6:       48 8b 48 08             mov    0x8(%rax),%rcx
>     68ca:       48 89 4a 28             mov    %rcx,0x28(%rdx)
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:163
>     68ce:       48 8b 00                mov    (%rax),%rax
>     68d1:       48 83 c2 30             add    $0x30,%rdx
>     68d5:       48 85 c0                test   %rax,%rax
>     68d8:       75 bd                   jne    6897 <kvm_set_irq+0x57>
>     68da:       eb 06                   jmp    68e2 <kvm_set_irq+0xa2>
>     68dc:       0f 1f 40 00             nopl   0x0(%rax)
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>     68e0:       31 db                   xor    %ebx,%ebx
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:169
>     68e2:       4c 8d b5 40 ff ff ff    lea    -0xc0(%rbp),%r14
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>     68e9:       41 bc ff ff ff ff       mov    $0xffffffff,%r12d
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:167
>     68ef:       85 db                   test   %ebx,%ebx
>     68f1:       74 3d                   je     6930 <kvm_set_irq+0xf0>
>     68f3:       83 eb 01                sub    $0x1,%ebx
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:169
>     68f6:       44 89 f9                mov    %r15d,%ecx
>     68f9:       8b 95 3c ff ff ff       mov    -0xc4(%rbp),%edx
>     68ff:       48 63 c3                movslq %ebx,%rax
>     6902:       4c 89 ee                mov    %r13,%rsi
>     6905:       48 8d 04 40             lea    (%rax,%rax,2),%rax
>     6909:       48 c1 e0 04             shl    $0x4,%rax
>     690d:       49 8d 3c 06             lea    (%r14,%rax,1),%rdi
>     6911:       ff 94 05 48 ff ff ff    callq  *-0xb8(%rbp,%rax,1)
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:170
>     6918:       85 c0                   test   %eax,%eax
>     691a:       78 d3                   js     68ef <kvm_set_irq+0xaf>
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:173
>     691c:       45 85 e4                test   %r12d,%r12d
>     691f:       ba 00 00 00 00          mov    $0x0,%edx
>     6924:       44 0f 48 e2             cmovs  %edx,%r12d
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:167
>     6928:       85 db                   test   %ebx,%ebx
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:173
>     692a:       46 8d 24 20             lea    (%rax,%r12,1),%r12d
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:167
>     692e:       75 c3                   jne    68f3 <kvm_set_irq+0xb3>
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:177
>     6930:       48 81 c4 a8 00 00 00    add    $0xa8,%rsp
>     6937:       44 89 e0                mov    %r12d,%eax
>     693a:       5b                      pop    %rbx
>     693b:       41 5c                   pop    %r12
>     693d:       41 5d                   pop    %r13
>     693f:       41 5e                   pop    %r14
>     6941:       41 5f                   pop    %r15
>     6943:       c9                      leaveq
>     6944:       c3                      retq
> trace_kvm_set_irq():
> /usr/src/GIT/linux-2.6-stable/include/trace/events/kvm.h:10
>     6945:       4c 8b 25 00 00 00 00    mov    0x0(%rip),%r12
> # 694c <kvm_set_irq+0x10c>
>     694c:       4d 85 e4                test   %r12,%r12
>     694f:       0f 84 1b ff ff ff       je     6870 <kvm_set_irq+0x30>
>     6955:       49 8b 04 24             mov    (%r12),%rax
>     6959:       49 8b 7c 24 08          mov    0x8(%r12),%rdi
>     695e:       49 83 c4 10             add    $0x10,%r12
>     6962:       8b 8d 3c ff ff ff       mov    -0xc4(%rbp),%ecx
>     6968:       44 89 fa                mov    %r15d,%edx
>     696b:       89 de                   mov    %ebx,%esi
>     696d:       ff d0                   callq  *%rax
>     696f:       49 8b 04 24             mov    (%r12),%rax
>     6973:       48 85 c0                test   %rax,%rax
>     6976:       75 e1                   jne    6959 <kvm_set_irq+0x119>
>     6978:       e9 f3 fe ff ff          jmpq   6870 <kvm_set_irq+0x30>
> kvm_set_irq():
>     697d:       0f 1f 00                nopl   (%rax)
> 
> So, if i've read correctly, the offset is 0x6877 ?
> 
> root@ayrshire:~# addr2line -e
> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
> 0x6877
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
> 
> 
> Is it the correct way to analyse this?
> 
> Regards.

Yes.  So we have:

        irq_rt = rcu_dereference(kvm->irq_routing);

>  ffffffffa03ee870:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax |
> %eax => b6634c1  %r13 = ffff880419b600c0

        if (irq < irq_rt->nr_rt_entries)

> *ffffffffa03ee877:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx |
> %eax = b6634c1  %ebx = 18 <--- faulting instruction

The problem then is that while the kvm pointer is
ffff880419b600c0 which looks sane,
the value we read from kvm->irq_routing is b6634c1 which
does not make sense. When we dereference that, kaboom.

Is the kvm pointer wrong or the memory corrupted?
Try printing the kvm pointer during
initialization, e.g. in kvm_vm_ioctl_create_vcpu,
then and compare to markup_oops.


-- 
MST

^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-01  7:03               ` Michael S. Tsirkin
@ 2011-03-01 14:39                 ` Jean-Philippe Menil
  2011-03-03 14:47                   ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-03-01 14:39 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: netdev, kvm, virtualization

[-- Attachment #1: Type: text/plain, Size: 19679 bytes --]

Le 01/03/2011 08:03, Michael S. Tsirkin a écrit :
> On Mon, Feb 28, 2011 at 11:34:16PM +0100, Jean-Philippe Menil wrote:
>> Hi,
>>
>> here is another trace with kvm.ko compiled with debug flags.
>>
>> the bug:
>> [12099.503414] BUG: unable to handle kernel paging request at
>> 000000000b6635e9
>> [12099.503462] IP: [<ffffffffa03ee877>] kvm_set_irq+0x37/0x140 [kvm]
>> [12099.503521] PGD 45d8d2067 PUD 45d58e067 PMD 0
>> [12099.503560] Oops: 0000 [#1] SMP
>> [12099.503591] last sysfs file:
>> /sys/devices/system/cpu/cpu11/cache/index2/shared_cpu_map
>> [12099.503641] CPU 0
>> [12099.503648] Modules linked in: netconsole configfs vhost_net
>> macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace
>> cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table
>> cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter
>> ip6_tables ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state
>> iptable_filter ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp
>> nf_conntrack_ipv4 nf_defrag_ipv4 8021q bridge stp ext2 mbcache
>> dm_round_robin dm_multipath nf_conntrack_ipv6 nf_conntrack
>> nf_defrag_ipv6 kvm_amd kvm ipv6 snd_pcm snd_timer snd soundcore
>> snd_page_alloc shpchp pci_hotplug tpm_tis i2c_nforce2 tpm i2c_core
>> pcspkr evdev psmouse joydev tpm_bios processor ghes dcdbas hed
>> button serio_raw thermal_sys xfs exportfs dm_mod sg sr_mod cdrom
>> usbhid hid usb_storage ses sd_mod enclosure megaraid_sas ohci_hcd
>> lpfc scsi_transport_fc bnx2 scsi_tgt scsi_mod ehci_hcd [last
>> unloaded: scsi_wait_scan]
>> [12099.504277]
>> [12099.504302] Pid: 1742, comm: kworker/0:2 Not tainted
>> 2.6.37.2-dsiun-110105+ #2 Dell Inc. PowerEdge M605/0K543T
>> [12099.504373] RIP: 0010:[<ffffffffa03ee877>]  [<ffffffffa03ee877>]
>> kvm_set_irq+0x37/0x140 [kvm]
>> [12099.504444] RSP: 0018:ffff88045e013d00  EFLAGS: 00010246
>> [12099.504474] RAX: 000000000b6634c1 RBX: 0000000000000018 RCX:
>> 0000000000000001
>> [12099.504508] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
>> ffff880419b600c0
>> [12099.504541] RBP: ffff88045e013dd0 R08: ffff88045e012000 R09:
>> 0000000000000000
>> [12099.504575] R10: 0000000000000000 R11: 00000000ffffffff R12:
>> ffff880419b600c0
>> [12099.504609] R13: ffff880419b600c0 R14: ffffffffa03efaa0 R15:
>> 0000000000000001
>> [12099.504643] FS:  00007f3abaa05710(0000) GS:ffff88007f800000(0000)
>> knlGS:0000000000000000
>> [12099.504693] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> [12099.504724] CR2: 000000000b6635e9 CR3: 000000045e2bc000 CR4:
>> 00000000000006f0
>> [12099.504757] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> [12099.504791] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> [12099.504825] Process kworker/0:2 (pid: 1742, threadinfo
>> ffkvm_set_irqff88045e012000, task ffff88045ffb0d60)
>> [12099.504874] Stack:
>> [12099.504897]  00000000000119c0 00000000000119c0 00000000000119c0
>> ffff88045ffb0d60
>> [12099.504953]  ffff88045ffb1010 ffff88045e013fd8 ffff88045ffb1018
>> ffff88045e012010
>> [12099.505009]  00000000000119c0 ffff88045e013fd8 00000000000119c0
>> 00000000000119c0
>> [12099.505065] Call Trace:
>> [12099.505099]  [<ffffffff813818ce>] ? common_interrupt+0xe/0x13
>> [12099.505145]  [<ffffffffa03efaa0>] ? irqfd_inject+0x0/0x50 [kvm]
>> [12099.505145]  [<ffffffffa03efaca>] irqfd_inject+0x2a/0x50 [kvm]
>> [12099.505145]  [<ffffffff8106b7bb>] process_one_work+0x11b/0x450
>> [12099.505145]  [<ffffffff8106bf37>] worker_thread+0x157/0x410
>> [12099.505145]  [<ffffffff8103a569>] ? __wake_up_common+0x59/0x90
>> [12099.505145]  [<ffffffff8106bde0>] ? worker_thread+0x0/0x410
>> [12099.505145]  [<ffffffff8106f996>] kthread+0x96/0xa0
>> [12099.505145]  [<ffffffff81003c64>] kernel_thread_helper+0x4/0x10
>> [12099.505145]  [<ffffffff8106f900>] ? kthread+0x0/0xa0
>> [12099.505145]  [<ffffffff81003c60>] ? kernel_thread_helper+0x0/0x10
>> [12099.505145] Code: 55 49 89 fd 41 54 53 89 d3 48 81 ec a8 00 00 00
>> 8b 15 a6 75 03 00 89 b5 3c ff ff ff 85 d2 0f 85 d5 00 00 00 49 8b 85
>> 58 24 00 00<3b>  98 28 01 00 00 73 61 89 db 48 8b 84 d8 30 01 00 00
>> 48 85 c0
>> [12099.505145] RIP  [<ffffffffa03ee877>] kvm_set_irq+0x37/0x140 [kvm]
>> [12099.505145]  RSP<ffff88045e013d00>
>> [12099.505145] CR2: 000000000b6635e9
>>
>>
>> markup_oops result:
>>
>> root@ayrshire:~# cat bug.txt | perl markup_oops.pl -m
>> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
>> /boot/vmlinuz-2.6.37.2-dsiun-110105+
>> vmaoffset = 18446744072103034880 ffffffffa03ee841:	48 89 e5   	mov
>> %rsp,%rbp
>>   ffffffffa03ee844:	41 57                	push   %r15
>>   ffffffffa03ee846:	41 89 cf             	mov    %ecx,%r15d  |  %r15
>> =>  1  %ecx = 1
>>   ffffffffa03ee849:	41 56                	push   %r14        |  %r14
>> =>  ffffffffa03efaa0
>>   ffffffffa03ee84b:	41 55                	push   %r13
>>   ffffffffa03ee84d:	49 89 fd             	mov    %rdi,%r13   |  %edi
>> = ffff880419b600c0  %r13 =>  ffff880419b600c0
>>   ffffffffa03ee850:	41 54                	push   %r12        |  %r12
>> =>  ffff880419b600c0
>>   ffffffffa03ee852:	53                   	push   %rbx
>>   ffffffffa03ee853:	89 d3                	mov    %edx,%ebx   |  %ebx =>  18
>>   ffffffffa03ee855:	48 81 ec a8 00 00 00 	sub    $0xa8,%rsp
>>   ffffffffa03ee85c:	8b 15 00 00 00 00    	mov    0x0(%rip),%edx
>> # ffffffffa03ee862<kvm_set_irq+0x22>
>>   ffffffffa03ee862:	89 b5 3c ff ff ff    	mov    %esi,-0xc4(%rbp) |
>> %esi = 0
>>   ffffffffa03ee868:	85 d2                	test   %edx,%edx   |  %edx =>  0
>>   ffffffffa03ee86a:	0f 85 d5 00 00 00    	jne    ffffffffa03ee945
>> <kvm_set_irq+0x105>
>>   ffffffffa03ee870:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax |
>> %eax =>  b6634c1  %r13 = ffff880419b600c0
>> *ffffffffa03ee877:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx |
>> %eax = b6634c1  %ebx = 18<--- faulting instruction
>>   ffffffffa03ee87d:	73 61                	jae    ffffffffa03ee8e0
>> <kvm_set_irq+0xa0>
>>   ffffffffa03ee87f:	89 db                	mov    %ebx,%ebx
>>   ffffffffa03ee881:	48 8b 84 d8 30 01 00 	mov    0x130(%rax,%rbx,8),%rax
>>   ffffffffa03ee888:	00
>>   ffffffffa03ee889:	48 85 c0             	test   %rax,%rax
>>   ffffffffa03ee88c:	74 52                	je     ffffffffa03ee8e0
>> <kvm_set_irq+0xa0>
>>   ffffffffa03ee88e:	48 8d 95 40 ff ff ff 	lea    -0xc0(%rbp),%rdx
>>   ffffffffa03ee895:	31 db                	xor    %ebx,%ebx
>>   ffffffffa03ee897:	48 8b 08             	mov    (%rax),%rcx
>>   ffffffffa03ee89a:	83 c3 01             	add    $0x1,%ebx
>>   ffffffffa03ee89d:	0f 18 09             	prefetcht0 (%rcx)
>>   ffffffffa03ee8a0:	48 8b 48 e0          	mov    -0x20(%rax),%rcx
>>   ffffffffa03ee8a4:	48 89 0a             	mov    %rcx,(%rdx)
>>   ffffffffa03ee8a7:	48 8b 48 e8          	mov    -0x18(%rax),%rcx
>>   ffffffffa03ee8ab:	48 89 4a 08          	mov    %rcx,0x8(%rdx)
>>   ffffffffa03ee8af:	48 8b 48 f0          	mov    -0x10(%rax),%rcx
>>   ffffffffa03ee8b3:	48 89 4a 10          	mov    %rcx,0x10(%rdx)
>>   ffffffffa03ee8b7:	48 8b 48 f8          	mov    -0x8(%rax),%rcx
>>   ffffffffa03ee8bb:	48 89 4a 18          	mov    %rcx,0x18(%rdx)
>>   ffffffffa03ee8bf:	48 8b 08             	mov    (%rax),%rcx
>>
>> The relvant part of objdump for kvm_set_irq:
>> root@ayrshire:~# objdump -ldS
>> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko>
>> dump.txt
>>
>> 0000000000006840<kvm_set_irq>:
>> kvm_set_irq():
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:148
>>      6840:       55                      push   %rbp
>>      6841:       48 89 e5                mov    %rsp,%rbp
>>      6844:       41 57                   push   %r15
>>      6846:       41 89 cf                mov    %ecx,%r15d
>>      6849:       41 56                   push   %r14
>>      684b:       41 55                   push   %r13
>>      684d:       49 89 fd                mov    %rdi,%r13
>>      6850:       41 54                   push   %r12
>>      6852:       53                      push   %rbx
>>      6853:       89 d3                   mov    %edx,%ebx
>>      6855:       48 81 ec a8 00 00 00    sub    $0xa8,%rsp
>> trace_kvm_set_irq():
>> /usr/src/GIT/linux-2.6-stable/include/trace/events/kvm.h:10
>>      685c:       8b 15 00 00 00 00       mov    0x0(%rip),%edx
>> # 6862<kvm_set_irq+0x22>
>> kvm_set_irq():
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:148
>>      6862:       89 b5 3c ff ff ff       mov    %esi,-0xc4(%rbp)
>> trace_kvm_set_irq():
>> /usr/src/GIT/linux-2.6-stable/include/trace/events/kvm.h:10
>>      6868:       85 d2                   test   %edx,%edx
>>      686a:       0f 85 d5 00 00 00       jne    6945<kvm_set_irq+0x105>
>> kvm_set_irq():
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
>>      6870:       49 8b 85 58 24 00 00    mov    0x2458(%r13),%rax
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>>      6877:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
>>      687d:       73 61                   jae    68e0<kvm_set_irq+0xa0>
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:163
>>      687f:       89 db                   mov    %ebx,%ebx
>>      6881:       48 8b 84 d8 30 01 00    mov    0x130(%rax,%rbx,8),%rax
>>      6888:       00
>>      6889:       48 85 c0                test   %rax,%rax
>>      688c:       74 52                   je     68e0<kvm_set_irq+0xa0>
>>      688e:       48 8d 95 40 ff ff ff    lea    -0xc0(%rbp),%rdx
>>      6895:       31 db                   xor    %ebx,%ebx
>>      6897:       48 8b 08                mov    (%rax),%rcx
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:164
>>      689a:       83 c3 01                add    $0x1,%ebx
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:163
>>      689d:       0f 18 09                prefetcht0 (%rcx)
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:164
>>      68a0:       48 8b 48 e0             mov    -0x20(%rax),%rcx
>>      68a4:       48 89 0a                mov    %rcx,(%rdx)
>>      68a7:       48 8b 48 e8             mov    -0x18(%rax),%rcx
>>      68ab:       48 89 4a 08             mov    %rcx,0x8(%rdx)
>>      68af:       48 8b 48 f0             mov    -0x10(%rax),%rcx
>>      68b3:       48 89 4a 10             mov    %rcx,0x10(%rdx)
>>      68b7:       48 8b 48 f8             mov    -0x8(%rax),%rcx
>>      68bb:       48 89 4a 18             mov    %rcx,0x18(%rdx)
>>      68bf:       48 8b 08                mov    (%rax),%rcx
>>      68c2:       48 89 4a 20             mov    %rcx,0x20(%rdx)
>>      68c6:       48 8b 48 08             mov    0x8(%rax),%rcx
>>      68ca:       48 89 4a 28             mov    %rcx,0x28(%rdx)
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:163
>>      68ce:       48 8b 00                mov    (%rax),%rax
>>      68d1:       48 83 c2 30             add    $0x30,%rdx
>>      68d5:       48 85 c0                test   %rax,%rax
>>      68d8:       75 bd                   jne    6897<kvm_set_irq+0x57>
>>      68da:       eb 06                   jmp    68e2<kvm_set_irq+0xa2>
>>      68dc:       0f 1f 40 00             nopl   0x0(%rax)
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>>      68e0:       31 db                   xor    %ebx,%ebx
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:169
>>      68e2:       4c 8d b5 40 ff ff ff    lea    -0xc0(%rbp),%r14
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>>      68e9:       41 bc ff ff ff ff       mov    $0xffffffff,%r12d
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:167
>>      68ef:       85 db                   test   %ebx,%ebx
>>      68f1:       74 3d                   je     6930<kvm_set_irq+0xf0>
>>      68f3:       83 eb 01                sub    $0x1,%ebx
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:169
>>      68f6:       44 89 f9                mov    %r15d,%ecx
>>      68f9:       8b 95 3c ff ff ff       mov    -0xc4(%rbp),%edx
>>      68ff:       48 63 c3                movslq %ebx,%rax
>>      6902:       4c 89 ee                mov    %r13,%rsi
>>      6905:       48 8d 04 40             lea    (%rax,%rax,2),%rax
>>      6909:       48 c1 e0 04             shl    $0x4,%rax
>>      690d:       49 8d 3c 06             lea    (%r14,%rax,1),%rdi
>>      6911:       ff 94 05 48 ff ff ff    callq  *-0xb8(%rbp,%rax,1)
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:170
>>      6918:       85 c0                   test   %eax,%eax
>>      691a:       78 d3                   js     68ef<kvm_set_irq+0xaf>
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:173
>>      691c:       45 85 e4                test   %r12d,%r12d
>>      691f:       ba 00 00 00 00          mov    $0x0,%edx
>>      6924:       44 0f 48 e2             cmovs  %edx,%r12d
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:167
>>      6928:       85 db                   test   %ebx,%ebx
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:173
>>      692a:       46 8d 24 20             lea    (%rax,%r12,1),%r12d
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:167
>>      692e:       75 c3                   jne    68f3<kvm_set_irq+0xb3>
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:177
>>      6930:       48 81 c4 a8 00 00 00    add    $0xa8,%rsp
>>      6937:       44 89 e0                mov    %r12d,%eax
>>      693a:       5b                      pop    %rbx
>>      693b:       41 5c                   pop    %r12
>>      693d:       41 5d                   pop    %r13
>>      693f:       41 5e                   pop    %r14
>>      6941:       41 5f                   pop    %r15
>>      6943:       c9                      leaveq
>>      6944:       c3                      retq
>> trace_kvm_set_irq():
>> /usr/src/GIT/linux-2.6-stable/include/trace/events/kvm.h:10
>>      6945:       4c 8b 25 00 00 00 00    mov    0x0(%rip),%r12
>> # 694c<kvm_set_irq+0x10c>
>>      694c:       4d 85 e4                test   %r12,%r12
>>      694f:       0f 84 1b ff ff ff       je     6870<kvm_set_irq+0x30>
>>      6955:       49 8b 04 24             mov    (%r12),%rax
>>      6959:       49 8b 7c 24 08          mov    0x8(%r12),%rdi
>>      695e:       49 83 c4 10             add    $0x10,%r12
>>      6962:       8b 8d 3c ff ff ff       mov    -0xc4(%rbp),%ecx
>>      6968:       44 89 fa                mov    %r15d,%edx
>>      696b:       89 de                   mov    %ebx,%esi
>>      696d:       ff d0                   callq  *%rax
>>      696f:       49 8b 04 24             mov    (%r12),%rax
>>      6973:       48 85 c0                test   %rax,%rax
>>      6976:       75 e1                   jne    6959<kvm_set_irq+0x119>
>>      6978:       e9 f3 fe ff ff          jmpq   6870<kvm_set_irq+0x30>
>> kvm_set_irq():
>>      697d:       0f 1f 00                nopl   (%rax)
>>
>> So, if i've read correctly, the offset is 0x6877 ?
>>
>> root@ayrshire:~# addr2line -e
>> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
>> 0x6877
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>>
>>
>> Is it the correct way to analyse this?
>>
>> Regards.
>
> Yes.  So we have:
>
>          irq_rt = rcu_dereference(kvm->irq_routing);
>
>>   ffffffffa03ee870:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax |
>> %eax =>  b6634c1  %r13 = ffff880419b600c0
>
>          if (irq<  irq_rt->nr_rt_entries)
>
>> *ffffffffa03ee877:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx |
>> %eax = b6634c1  %ebx = 18<--- faulting instruction
>
> The problem then is that while the kvm pointer is
> ffff880419b600c0 which looks sane,
> the value we read from kvm->irq_routing is b6634c1 which
> does not make sense. When we dereference that, kaboom.
>
> Is the kvm pointer wrong or the memory corrupted?
> Try printing the kvm pointer during
> initialization, e.g. in kvm_vm_ioctl_create_vcpu,
> then and compare to markup_oops.
>
>
Hi,

so this time the bug is:

[17882.612303] BUG: unable to handle kernel paging request at 
0000000000002458
[17882.612342] IP: [<ffffffffa03898a0>] kvm_set_irq+0x30/0x140 [kvm]

markup_oops give me this:

root@ayrshire:~# cat bug-0103.txt | perl markup_oops.pl -m 
/lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko 
/boot/vmlinuz-2.6.37.2-dsiun-110105+
vmaoffset = 18446744072102621184 ffffffffa0389871:	48 89 e5 
   	mov    %rsp,%rbp
  ffffffffa0389874:	41 57                	push   %r15
  ffffffffa0389876:	41 89 cf             	mov    %ecx,%r15d  |  %r15 => 
1  %ecx = 1
  ffffffffa0389879:	41 56                	push   %r14        |  %r14 => 
ffffffffa038aad0
  ffffffffa038987b:	41 55                	push   %r13
  ffffffffa038987d:	49 89 fd             	mov    %rdi,%r13   |  %edi = 0 
  %r13 => 0
  ffffffffa0389880:	41 54                	push   %r12        |  %r12 => 0
  ffffffffa0389882:	53                   	push   %rbx
  ffffffffa0389883:	89 d3                	mov    %edx,%ebx   |  %ebx => 1a
  ffffffffa0389885:	48 81 ec a8 00 00 00 	sub    $0xa8,%rsp
  ffffffffa038988c:	8b 15 00 00 00 00    	mov    0x0(%rip),%edx        # 
ffffffffa0389892 <kvm_set_irq+0x22>
  ffffffffa0389892:	89 b5 3c ff ff ff    	mov    %esi,-0xc4(%rbp) | 
%esi = 0
  ffffffffa0389898:	85 d2                	test   %edx,%edx   |  %edx => 0
  ffffffffa038989a:	0f 85 d5 00 00 00    	jne    ffffffffa0389975 
<kvm_set_irq+0x105>
*ffffffffa03898a0:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax | 
%eax = 0  %r13 = 0 <--- faulting instruction
  ffffffffa03898a7:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx
  ffffffffa03898ad:	73 61                	jae    ffffffffa0389910 
<kvm_set_irq+0xa0>
  ffffffffa03898af:	89 db                	mov    %ebx,%ebx
  ffffffffa03898b1:	48 8b 84 d8 30 01 00 	mov    0x130(%rax,%rbx,8),%rax
  ffffffffa03898b8:	00
  ffffffffa03898b9:	48 85 c0             	test   %rax,%rax
  ffffffffa03898bc:	74 52                	je     ffffffffa0389910 
<kvm_set_irq+0xa0>
  ffffffffa03898be:	48 8d 95 40 ff ff ff 	lea    -0xc0(%rbp),%rdx
  ffffffffa03898c5:	31 db                	xor    %ebx,%ebx
  ffffffffa03898c7:	48 8b 08             	mov    (%rax),%rcx
  ffffffffa03898ca:	83 c3 01             	add    $0x1,%ebx
  ffffffffa03898cd:	0f 18 09             	prefetcht0 (%rcx)
  ffffffffa03898d0:	48 8b 48 e0          	mov    -0x20(%rax),%rcx
  ffffffffa03898d4:	48 89 0a             	mov    %rcx,(%rdx)
  ffffffffa03898d7:	48 8b 48 e8          	mov    -0x18(%rax),%rcx
  ffffffffa03898db:	48 89 4a 08          	mov    %rcx,0x8(%rdx)
  ffffffffa03898df:	48 8b 48 f0          	mov    -0x10(%rax),%rcx
  ffffffffa03898e3:	48 89 4a 10          	mov    %rcx,0x10(%rdx)
  ffffffffa03898e7:	48 8b 48 f8          	mov    -0x8(%rax),%rcx
  ffffffffa03898eb:	48 89 4a 18          	mov    %rcx,0x18(%rdx)

wich correspond to offset 68a0 (from objdump):

kvm_set_irq():
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
     68a0:       49 8b 85 58 24 00 00    mov    0x2458(%r13),%rax
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
     68a7:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx

root@ayrshire:~# addr2line -e 
/lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko 0x68a0
/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161

So here kvm->irq_routing is null.

How can it be?

Regards.

[-- Attachment #2: jean-philippe_menil.vcf --]
[-- Type: text/x-vcard, Size: 361 bytes --]

begin:vcard
fn:Jean-Philippe Menil
n:Menil;Jean-Philippe
org;quoted-printable:Universit=C3=A9 de Nantes;IRTS - DSI
adr;quoted-printable:;;2 rue de la Houssini=C3=A8re;Nantes;Loire-Atlantique;44382;France
email;internet:jean-philippe.menil@univ-nantes.fr
title;quoted-printable:Administrateur R=C3=A9seau
url:http://www.cri.univ-nantes.fr
version:2.1
end:vcard


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-01 14:39                 ` Jean-Philippe Menil
@ 2011-03-03 14:47                   ` Michael S. Tsirkin
  2011-03-03 15:26                     ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-03-03 14:47 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: netdev, kvm, virtualization

On Tue, Mar 01, 2011 at 03:39:12PM +0100, Jean-Philippe Menil wrote:
> so this time the bug is:
> 
> [17882.612303] BUG: unable to handle kernel paging request at
> 0000000000002458
> [17882.612342] IP: [<ffffffffa03898a0>] kvm_set_irq+0x30/0x140 [kvm]
> 
> markup_oops give me this:
> 
> root@ayrshire:~# cat bug-0103.txt | perl markup_oops.pl -m
> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
> /boot/vmlinuz-2.6.37.2-dsiun-110105+
> vmaoffset = 18446744072102621184 ffffffffa0389871:	48 89 e5   	mov
> %rsp,%rbp
>  ffffffffa0389874:	41 57                	push   %r15
>  ffffffffa0389876:	41 89 cf             	mov    %ecx,%r15d  |  %r15
> => 1  %ecx = 1
>  ffffffffa0389879:	41 56                	push   %r14        |  %r14
> => ffffffffa038aad0
>  ffffffffa038987b:	41 55                	push   %r13
>  ffffffffa038987d:	49 89 fd             	mov    %rdi,%r13   |  %edi
> = 0  %r13 => 0
>  ffffffffa0389880:	41 54                	push   %r12        |  %r12 => 0
>  ffffffffa0389882:	53                   	push   %rbx
>  ffffffffa0389883:	89 d3                	mov    %edx,%ebx   |  %ebx => 1a
>  ffffffffa0389885:	48 81 ec a8 00 00 00 	sub    $0xa8,%rsp
>  ffffffffa038988c:	8b 15 00 00 00 00    	mov    0x0(%rip),%edx
> # ffffffffa0389892 <kvm_set_irq+0x22>
>  ffffffffa0389892:	89 b5 3c ff ff ff    	mov    %esi,-0xc4(%rbp) |
> %esi = 0
>  ffffffffa0389898:	85 d2                	test   %edx,%edx   |  %edx => 0
>  ffffffffa038989a:	0f 85 d5 00 00 00    	jne    ffffffffa0389975
> <kvm_set_irq+0x105>
> *ffffffffa03898a0:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax |
> %eax = 0  %r13 = 0 <--- faulting instruction
>  ffffffffa03898a7:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx
>  ffffffffa03898ad:	73 61                	jae    ffffffffa0389910
> <kvm_set_irq+0xa0>
>  ffffffffa03898af:	89 db                	mov    %ebx,%ebx
>  ffffffffa03898b1:	48 8b 84 d8 30 01 00 	mov    0x130(%rax,%rbx,8),%rax
>  ffffffffa03898b8:	00
>  ffffffffa03898b9:	48 85 c0             	test   %rax,%rax
>  ffffffffa03898bc:	74 52                	je     ffffffffa0389910
> <kvm_set_irq+0xa0>
>  ffffffffa03898be:	48 8d 95 40 ff ff ff 	lea    -0xc0(%rbp),%rdx
>  ffffffffa03898c5:	31 db                	xor    %ebx,%ebx
>  ffffffffa03898c7:	48 8b 08             	mov    (%rax),%rcx
>  ffffffffa03898ca:	83 c3 01             	add    $0x1,%ebx
>  ffffffffa03898cd:	0f 18 09             	prefetcht0 (%rcx)
>  ffffffffa03898d0:	48 8b 48 e0          	mov    -0x20(%rax),%rcx
>  ffffffffa03898d4:	48 89 0a             	mov    %rcx,(%rdx)
>  ffffffffa03898d7:	48 8b 48 e8          	mov    -0x18(%rax),%rcx
>  ffffffffa03898db:	48 89 4a 08          	mov    %rcx,0x8(%rdx)
>  ffffffffa03898df:	48 8b 48 f0          	mov    -0x10(%rax),%rcx
>  ffffffffa03898e3:	48 89 4a 10          	mov    %rcx,0x10(%rdx)
>  ffffffffa03898e7:	48 8b 48 f8          	mov    -0x8(%rax),%rcx
>  ffffffffa03898eb:	48 89 4a 18          	mov    %rcx,0x18(%rdx)
> 
> wich correspond to offset 68a0 (from objdump):
> 
> kvm_set_irq():
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
>     68a0:       49 8b 85 58 24 00 00    mov    0x2458(%r13),%rax
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>     68a7:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
> 
> root@ayrshire:~# addr2line -e
> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
> 0x68a0
> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
> 
> So here kvm->irq_routing is null.
> 
> How can it be?
> 
> Regards.

Not null, this seems to be invalid.
I suspect use after free where the kvm pointer is
pointing at some random memory. Use after free?
Could you please try enabling a slab debugger,
recompile and rerun the test?

-- 
MST

^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-03 14:47                   ` Michael S. Tsirkin
@ 2011-03-03 15:26                     ` Jean-Philippe Menil
  2011-03-03 15:55                       ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-03-03 15:26 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: netdev, kvm, virtualization

Le 03/03/2011 15:47, Michael S. Tsirkin a écrit :
> On Tue, Mar 01, 2011 at 03:39:12PM +0100, Jean-Philippe Menil wrote:
>> so this time the bug is:
>>
>> [17882.612303] BUG: unable to handle kernel paging request at
>> 0000000000002458
>> [17882.612342] IP: [<ffffffffa03898a0>] kvm_set_irq+0x30/0x140 [kvm]
>>
>> markup_oops give me this:
>>
>> root@ayrshire:~# cat bug-0103.txt | perl markup_oops.pl -m
>> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
>> /boot/vmlinuz-2.6.37.2-dsiun-110105+
>> vmaoffset = 18446744072102621184 ffffffffa0389871:	48 89 e5   	mov
>> %rsp,%rbp
>>   ffffffffa0389874:	41 57                	push   %r15
>>   ffffffffa0389876:	41 89 cf             	mov    %ecx,%r15d  |  %r15
>> =>  1  %ecx = 1
>>   ffffffffa0389879:	41 56                	push   %r14        |  %r14
>> =>  ffffffffa038aad0
>>   ffffffffa038987b:	41 55                	push   %r13
>>   ffffffffa038987d:	49 89 fd             	mov    %rdi,%r13   |  %edi
>> = 0  %r13 =>  0
>>   ffffffffa0389880:	41 54                	push   %r12        |  %r12 =>  0
>>   ffffffffa0389882:	53                   	push   %rbx
>>   ffffffffa0389883:	89 d3                	mov    %edx,%ebx   |  %ebx =>  1a
>>   ffffffffa0389885:	48 81 ec a8 00 00 00 	sub    $0xa8,%rsp
>>   ffffffffa038988c:	8b 15 00 00 00 00    	mov    0x0(%rip),%edx
>> # ffffffffa0389892<kvm_set_irq+0x22>
>>   ffffffffa0389892:	89 b5 3c ff ff ff    	mov    %esi,-0xc4(%rbp) |
>> %esi = 0
>>   ffffffffa0389898:	85 d2                	test   %edx,%edx   |  %edx =>  0
>>   ffffffffa038989a:	0f 85 d5 00 00 00    	jne    ffffffffa0389975
>> <kvm_set_irq+0x105>
>> *ffffffffa03898a0:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax |
>> %eax = 0  %r13 = 0<--- faulting instruction
>>   ffffffffa03898a7:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx
>>   ffffffffa03898ad:	73 61                	jae    ffffffffa0389910
>> <kvm_set_irq+0xa0>
>>   ffffffffa03898af:	89 db                	mov    %ebx,%ebx
>>   ffffffffa03898b1:	48 8b 84 d8 30 01 00 	mov    0x130(%rax,%rbx,8),%rax
>>   ffffffffa03898b8:	00
>>   ffffffffa03898b9:	48 85 c0             	test   %rax,%rax
>>   ffffffffa03898bc:	74 52                	je     ffffffffa0389910
>> <kvm_set_irq+0xa0>
>>   ffffffffa03898be:	48 8d 95 40 ff ff ff 	lea    -0xc0(%rbp),%rdx
>>   ffffffffa03898c5:	31 db                	xor    %ebx,%ebx
>>   ffffffffa03898c7:	48 8b 08             	mov    (%rax),%rcx
>>   ffffffffa03898ca:	83 c3 01             	add    $0x1,%ebx
>>   ffffffffa03898cd:	0f 18 09             	prefetcht0 (%rcx)
>>   ffffffffa03898d0:	48 8b 48 e0          	mov    -0x20(%rax),%rcx
>>   ffffffffa03898d4:	48 89 0a             	mov    %rcx,(%rdx)
>>   ffffffffa03898d7:	48 8b 48 e8          	mov    -0x18(%rax),%rcx
>>   ffffffffa03898db:	48 89 4a 08          	mov    %rcx,0x8(%rdx)
>>   ffffffffa03898df:	48 8b 48 f0          	mov    -0x10(%rax),%rcx
>>   ffffffffa03898e3:	48 89 4a 10          	mov    %rcx,0x10(%rdx)
>>   ffffffffa03898e7:	48 8b 48 f8          	mov    -0x8(%rax),%rcx
>>   ffffffffa03898eb:	48 89 4a 18          	mov    %rcx,0x18(%rdx)
>>
>> wich correspond to offset 68a0 (from objdump):
>>
>> kvm_set_irq():
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
>>      68a0:       49 8b 85 58 24 00 00    mov    0x2458(%r13),%rax
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>>      68a7:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
>>
>> root@ayrshire:~# addr2line -e
>> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
>> 0x68a0
>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
>>
>> So here kvm->irq_routing is null.
>>
>> How can it be?
>>
>> Regards.
> Not null, this seems to be invalid.
> I suspect use after free where the kvm pointer is
> pointing at some random memory. Use after free?
> Could you please try enabling a slab debugger,
> recompile and rerun the test?
>
Hi,

I'm not sure to activate the right thing.
Is that what you want?

CONFIG_SLAB=y
CONFIG_SLABINFO=y
CONFIG_DEBUG_SLAB=y
CONFIG_DEBUG_SLAB_LEAK=y

Regards.

-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-03 15:26                     ` Jean-Philippe Menil
@ 2011-03-03 15:55                       ` Michael S. Tsirkin
  2011-03-04  9:22                         ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-03-03 15:55 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: netdev, kvm, virtualization

On Thu, Mar 03, 2011 at 04:26:11PM +0100, Jean-Philippe Menil wrote:
> Le 03/03/2011 15:47, Michael S. Tsirkin a écrit :
> >On Tue, Mar 01, 2011 at 03:39:12PM +0100, Jean-Philippe Menil wrote:
> >>so this time the bug is:
> >>
> >>[17882.612303] BUG: unable to handle kernel paging request at
> >>0000000000002458
> >>[17882.612342] IP: [<ffffffffa03898a0>] kvm_set_irq+0x30/0x140 [kvm]
> >>
> >>markup_oops give me this:
> >>
> >>root@ayrshire:~# cat bug-0103.txt | perl markup_oops.pl -m
> >>/lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
> >>/boot/vmlinuz-2.6.37.2-dsiun-110105+
> >>vmaoffset = 18446744072102621184 ffffffffa0389871:	48 89 e5   	mov
> >>%rsp,%rbp
> >>  ffffffffa0389874:	41 57                	push   %r15
> >>  ffffffffa0389876:	41 89 cf             	mov    %ecx,%r15d  |  %r15
> >>=>  1  %ecx = 1
> >>  ffffffffa0389879:	41 56                	push   %r14        |  %r14
> >>=>  ffffffffa038aad0
> >>  ffffffffa038987b:	41 55                	push   %r13
> >>  ffffffffa038987d:	49 89 fd             	mov    %rdi,%r13   |  %edi
> >>= 0  %r13 =>  0
> >>  ffffffffa0389880:	41 54                	push   %r12        |  %r12 =>  0
> >>  ffffffffa0389882:	53                   	push   %rbx
> >>  ffffffffa0389883:	89 d3                	mov    %edx,%ebx   |  %ebx =>  1a
> >>  ffffffffa0389885:	48 81 ec a8 00 00 00 	sub    $0xa8,%rsp
> >>  ffffffffa038988c:	8b 15 00 00 00 00    	mov    0x0(%rip),%edx
> >># ffffffffa0389892<kvm_set_irq+0x22>
> >>  ffffffffa0389892:	89 b5 3c ff ff ff    	mov    %esi,-0xc4(%rbp) |
> >>%esi = 0
> >>  ffffffffa0389898:	85 d2                	test   %edx,%edx   |  %edx =>  0
> >>  ffffffffa038989a:	0f 85 d5 00 00 00    	jne    ffffffffa0389975
> >><kvm_set_irq+0x105>
> >>*ffffffffa03898a0:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax |
> >>%eax = 0  %r13 = 0<--- faulting instruction
> >>  ffffffffa03898a7:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx
> >>  ffffffffa03898ad:	73 61                	jae    ffffffffa0389910
> >><kvm_set_irq+0xa0>
> >>  ffffffffa03898af:	89 db                	mov    %ebx,%ebx
> >>  ffffffffa03898b1:	48 8b 84 d8 30 01 00 	mov    0x130(%rax,%rbx,8),%rax
> >>  ffffffffa03898b8:	00
> >>  ffffffffa03898b9:	48 85 c0             	test   %rax,%rax
> >>  ffffffffa03898bc:	74 52                	je     ffffffffa0389910
> >><kvm_set_irq+0xa0>
> >>  ffffffffa03898be:	48 8d 95 40 ff ff ff 	lea    -0xc0(%rbp),%rdx
> >>  ffffffffa03898c5:	31 db                	xor    %ebx,%ebx
> >>  ffffffffa03898c7:	48 8b 08             	mov    (%rax),%rcx
> >>  ffffffffa03898ca:	83 c3 01             	add    $0x1,%ebx
> >>  ffffffffa03898cd:	0f 18 09             	prefetcht0 (%rcx)
> >>  ffffffffa03898d0:	48 8b 48 e0          	mov    -0x20(%rax),%rcx
> >>  ffffffffa03898d4:	48 89 0a             	mov    %rcx,(%rdx)
> >>  ffffffffa03898d7:	48 8b 48 e8          	mov    -0x18(%rax),%rcx
> >>  ffffffffa03898db:	48 89 4a 08          	mov    %rcx,0x8(%rdx)
> >>  ffffffffa03898df:	48 8b 48 f0          	mov    -0x10(%rax),%rcx
> >>  ffffffffa03898e3:	48 89 4a 10          	mov    %rcx,0x10(%rdx)
> >>  ffffffffa03898e7:	48 8b 48 f8          	mov    -0x8(%rax),%rcx
> >>  ffffffffa03898eb:	48 89 4a 18          	mov    %rcx,0x18(%rdx)
> >>
> >>wich correspond to offset 68a0 (from objdump):
> >>
> >>kvm_set_irq():
> >>/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
> >>     68a0:       49 8b 85 58 24 00 00    mov    0x2458(%r13),%rax
> >>/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
> >>     68a7:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
> >>
> >>root@ayrshire:~# addr2line -e
> >>/lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
> >>0x68a0
> >>/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
> >>
> >>So here kvm->irq_routing is null.
> >>
> >>How can it be?
> >>
> >>Regards.
> >Not null, this seems to be invalid.
> >I suspect use after free where the kvm pointer is
> >pointing at some random memory. Use after free?
> >Could you please try enabling a slab debugger,
> >recompile and rerun the test?
> >
> Hi,
> 
> I'm not sure to activate the right thing.
> Is that what you want?
> 
> CONFIG_SLAB=y
> CONFIG_SLABINFO=y
> CONFIG_DEBUG_SLAB=y
> CONFIG_DEBUG_SLAB_LEAK=y
> 
> Regards.

Yes, maybe disable SLAB_LEAK.

> -- 
> Jean-Philippe Menil - Pôle réseau Service IRTS
> DSI Université de Nantes
> jean-philippe.menil@univ-nantes.fr
> Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09

^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-03 15:55                       ` Michael S. Tsirkin
@ 2011-03-04  9:22                         ` Jean-Philippe Menil
  2011-03-04  9:35                           ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-03-04  9:22 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: netdev, kvm, virtualization

Le 03/03/2011 16:55, Michael S. Tsirkin a écrit :
> On Thu, Mar 03, 2011 at 04:26:11PM +0100, Jean-Philippe Menil wrote:
>> Le 03/03/2011 15:47, Michael S. Tsirkin a écrit :
>>> On Tue, Mar 01, 2011 at 03:39:12PM +0100, Jean-Philippe Menil wrote:
>>>> so this time the bug is:
>>>>
>>>> [17882.612303] BUG: unable to handle kernel paging request at
>>>> 0000000000002458
>>>> [17882.612342] IP: [<ffffffffa03898a0>] kvm_set_irq+0x30/0x140 [kvm]
>>>>
>>>> markup_oops give me this:
>>>>
>>>> root@ayrshire:~# cat bug-0103.txt | perl markup_oops.pl -m
>>>> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
>>>> /boot/vmlinuz-2.6.37.2-dsiun-110105+
>>>> vmaoffset = 18446744072102621184 ffffffffa0389871:	48 89 e5   	mov
>>>> %rsp,%rbp
>>>>   ffffffffa0389874:	41 57                	push   %r15
>>>>   ffffffffa0389876:	41 89 cf             	mov    %ecx,%r15d  |  %r15
>>>> =>   1  %ecx = 1
>>>>   ffffffffa0389879:	41 56                	push   %r14        |  %r14
>>>> =>   ffffffffa038aad0
>>>>   ffffffffa038987b:	41 55                	push   %r13
>>>>   ffffffffa038987d:	49 89 fd             	mov    %rdi,%r13   |  %edi
>>>> = 0  %r13 =>   0
>>>>   ffffffffa0389880:	41 54                	push   %r12        |  %r12 =>   0
>>>>   ffffffffa0389882:	53                   	push   %rbx
>>>>   ffffffffa0389883:	89 d3                	mov    %edx,%ebx   |  %ebx =>   1a
>>>>   ffffffffa0389885:	48 81 ec a8 00 00 00 	sub    $0xa8,%rsp
>>>>   ffffffffa038988c:	8b 15 00 00 00 00    	mov    0x0(%rip),%edx
>>>> # ffffffffa0389892<kvm_set_irq+0x22>
>>>>   ffffffffa0389892:	89 b5 3c ff ff ff    	mov    %esi,-0xc4(%rbp) |
>>>> %esi = 0
>>>>   ffffffffa0389898:	85 d2                	test   %edx,%edx   |  %edx =>   0
>>>>   ffffffffa038989a:	0f 85 d5 00 00 00    	jne    ffffffffa0389975
>>>> <kvm_set_irq+0x105>
>>>> *ffffffffa03898a0:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax |
>>>> %eax = 0  %r13 = 0<--- faulting instruction
>>>>   ffffffffa03898a7:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx
>>>>   ffffffffa03898ad:	73 61                	jae    ffffffffa0389910
>>>> <kvm_set_irq+0xa0>
>>>>   ffffffffa03898af:	89 db                	mov    %ebx,%ebx
>>>>   ffffffffa03898b1:	48 8b 84 d8 30 01 00 	mov    0x130(%rax,%rbx,8),%rax
>>>>   ffffffffa03898b8:	00
>>>>   ffffffffa03898b9:	48 85 c0             	test   %rax,%rax
>>>>   ffffffffa03898bc:	74 52                	je     ffffffffa0389910
>>>> <kvm_set_irq+0xa0>
>>>>   ffffffffa03898be:	48 8d 95 40 ff ff ff 	lea    -0xc0(%rbp),%rdx
>>>>   ffffffffa03898c5:	31 db                	xor    %ebx,%ebx
>>>>   ffffffffa03898c7:	48 8b 08             	mov    (%rax),%rcx
>>>>   ffffffffa03898ca:	83 c3 01             	add    $0x1,%ebx
>>>>   ffffffffa03898cd:	0f 18 09             	prefetcht0 (%rcx)
>>>>   ffffffffa03898d0:	48 8b 48 e0          	mov    -0x20(%rax),%rcx
>>>>   ffffffffa03898d4:	48 89 0a             	mov    %rcx,(%rdx)
>>>>   ffffffffa03898d7:	48 8b 48 e8          	mov    -0x18(%rax),%rcx
>>>>   ffffffffa03898db:	48 89 4a 08          	mov    %rcx,0x8(%rdx)
>>>>   ffffffffa03898df:	48 8b 48 f0          	mov    -0x10(%rax),%rcx
>>>>   ffffffffa03898e3:	48 89 4a 10          	mov    %rcx,0x10(%rdx)
>>>>   ffffffffa03898e7:	48 8b 48 f8          	mov    -0x8(%rax),%rcx
>>>>   ffffffffa03898eb:	48 89 4a 18          	mov    %rcx,0x18(%rdx)
>>>>
>>>> wich correspond to offset 68a0 (from objdump):
>>>>
>>>> kvm_set_irq():
>>>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
>>>>      68a0:       49 8b 85 58 24 00 00    mov    0x2458(%r13),%rax
>>>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>>>>      68a7:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
>>>>
>>>> root@ayrshire:~# addr2line -e
>>>> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
>>>> 0x68a0
>>>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
>>>>
>>>> So here kvm->irq_routing is null.
>>>>
>>>> How can it be?
>>>>
>>>> Regards.
>>> Not null, this seems to be invalid.
>>> I suspect use after free where the kvm pointer is
>>> pointing at some random memory. Use after free?
>>> Could you please try enabling a slab debugger,
>>> recompile and rerun the test?
>>>
>> Hi,
>>
>> I'm not sure to activate the right thing.
>> Is that what you want?
>>
>> CONFIG_SLAB=y
>> CONFIG_SLABINFO=y
>> CONFIG_DEBUG_SLAB=y
>> CONFIG_DEBUG_SLAB_LEAK=y
>>
>> Regards.
> Yes, maybe disable SLAB_LEAK.
>
>> -- 
>> Jean-Philippe Menil - Pôle réseau Service IRTS
>> DSI Université de Nantes
>> jean-philippe.menil@univ-nantes.fr
>> Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09
> --
> To unsubscribe from this list: send the line "unsubscribe kvm" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
Hi,

so this time, here is what markup_oops says:

root@ayrshire:~# cat oops-0403.txt | perl markup_oops.pl -m 
/lib/modules/2.6.37.2.999-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko 
/boot/vmlinuz-2.6.37.2.999-dsiun-110105+
vmaoffset = 18446744072102948864 ffffffffa03d9811:    48 89 
e5                 mov    %rsp,%rbp
  ffffffffa03d9814:    41 57                    push   %r15
  ffffffffa03d9816:    41 89 cf                 mov    %ecx,%r15d  |  
%r15 => 1  %ecx = 1
  ffffffffa03d9819:    41 56                    push   %r14        |  
%r14 => ffffffffa03daa50
  ffffffffa03d981b:    41 55                    push   %r13
  ffffffffa03d981d:    49 89 fd                 mov    %rdi,%r13   |  
%edi = 6b6b6b6b6b6b6b6b  %r13 => 6b6b6b6b6b6b6b6b
  ffffffffa03d9820:    41 54                    push   %r12        |  
%r12 => 6b6b6b6b6b6b6b6b
  ffffffffa03d9822:    53                       push   %rbx
  ffffffffa03d9823:    89 d3                    mov    %edx,%ebx   |  
%ebx => 6b6b6b6b
  ffffffffa03d9825:    48 81 ec a8 00 00 00     sub    $0xa8,%rsp
  ffffffffa03d982c:    8b 15 00 00 00 00        mov    
0x0(%rip),%edx        # ffffffffa03d9832 <kvm_set_irq+0x22>
  ffffffffa03d9832:    89 b5 3c ff ff ff        mov    %esi,-0xc4(%rbp) 
|  %esi = 0
  ffffffffa03d9838:    85 d2                    test   %edx,%edx   |  
%edx => 0
  ffffffffa03d983a:    0f 85 d5 00 00 00        jne    ffffffffa03d9915 
<kvm_set_irq+0x105>
*ffffffffa03d9840:    49 8b 85 58 24 00 00     mov    0x2458(%r13),%rax 
|  %eax = 0  %r13 = 6b6b6b6b6b6b6b6b <--- faulting instruction
  ffffffffa03d9847:    3b 98 28 01 00 00        cmp    0x128(%rax),%ebx
  ffffffffa03d984d:    73 61                    jae    ffffffffa03d98b0 
<kvm_set_irq+0xa0>
  ffffffffa03d984f:    89 db                    mov    %ebx,%ebx
  ffffffffa03d9851:    48 8b 84 d8 30 01 00     mov    
0x130(%rax,%rbx,8),%rax
  ffffffffa03d9858:    00
  ffffffffa03d9859:    48 85 c0                 test   %rax,%rax
  ffffffffa03d985c:    74 52                    je     ffffffffa03d98b0 
<kvm_set_irq+0xa0>
  ffffffffa03d985e:    48 8d 95 40 ff ff ff     lea    -0xc0(%rbp),%rdx
  ffffffffa03d9865:    31 db                    xor    %ebx,%ebx
  ffffffffa03d9867:    48 8b 08                 mov    (%rax),%rcx
  ffffffffa03d986a:    83 c3 01                 add    $0x1,%ebx
  ffffffffa03d986d:    0f 18 09                 prefetcht0 (%rcx)
  ffffffffa03d9870:    48 8b 48 e0              mov    -0x20(%rax),%rcx
  ffffffffa03d9874:    48 89 0a                 mov    %rcx,(%rdx)
  ffffffffa03d9877:    48 8b 48 e8              mov    -0x18(%rax),%rcx
  ffffffffa03d987b:    48 89 4a 08              mov    %rcx,0x8(%rdx)
  ffffffffa03d987f:    48 8b 48 f0              mov    -0x10(%rax),%rcx
  ffffffffa03d9883:    48 89 4a 10              mov    %rcx,0x10(%rdx)
  ffffffffa03d9887:    48 8b 48 f8              mov    -0x8(%rax),%rcx
  ffffffffa03d988b:    48 89 4a 18              mov    %rcx,0x18(%rdx)


Is that you wanted, the "6b6b6b6b6b6b6b6b" ?

Regards.

-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-04  9:22                         ` Jean-Philippe Menil
@ 2011-03-04  9:35                           ` Michael S. Tsirkin
  2011-03-04  9:39                             ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-03-04  9:35 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: netdev, kvm, virtualization

On Fri, Mar 04, 2011 at 10:22:03AM +0100, Jean-Philippe Menil wrote:
> Le 03/03/2011 16:55, Michael S. Tsirkin a écrit :
> >On Thu, Mar 03, 2011 at 04:26:11PM +0100, Jean-Philippe Menil wrote:
> >>Le 03/03/2011 15:47, Michael S. Tsirkin a écrit :
> >>>On Tue, Mar 01, 2011 at 03:39:12PM +0100, Jean-Philippe Menil wrote:
> >>>>so this time the bug is:
> >>>>
> >>>>[17882.612303] BUG: unable to handle kernel paging request at
> >>>>0000000000002458
> >>>>[17882.612342] IP: [<ffffffffa03898a0>] kvm_set_irq+0x30/0x140 [kvm]
> >>>>
> >>>>markup_oops give me this:
> >>>>
> >>>>root@ayrshire:~# cat bug-0103.txt | perl markup_oops.pl -m
> >>>>/lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
> >>>>/boot/vmlinuz-2.6.37.2-dsiun-110105+
> >>>>vmaoffset = 18446744072102621184 ffffffffa0389871:	48 89 e5   	mov
> >>>>%rsp,%rbp
> >>>>  ffffffffa0389874:	41 57                	push   %r15
> >>>>  ffffffffa0389876:	41 89 cf             	mov    %ecx,%r15d  |  %r15
> >>>>=>   1  %ecx = 1
> >>>>  ffffffffa0389879:	41 56                	push   %r14        |  %r14
> >>>>=>   ffffffffa038aad0
> >>>>  ffffffffa038987b:	41 55                	push   %r13
> >>>>  ffffffffa038987d:	49 89 fd             	mov    %rdi,%r13   |  %edi
> >>>>= 0  %r13 =>   0
> >>>>  ffffffffa0389880:	41 54                	push   %r12        |  %r12 =>   0
> >>>>  ffffffffa0389882:	53                   	push   %rbx
> >>>>  ffffffffa0389883:	89 d3                	mov    %edx,%ebx   |  %ebx =>   1a
> >>>>  ffffffffa0389885:	48 81 ec a8 00 00 00 	sub    $0xa8,%rsp
> >>>>  ffffffffa038988c:	8b 15 00 00 00 00    	mov    0x0(%rip),%edx
> >>>># ffffffffa0389892<kvm_set_irq+0x22>
> >>>>  ffffffffa0389892:	89 b5 3c ff ff ff    	mov    %esi,-0xc4(%rbp) |
> >>>>%esi = 0
> >>>>  ffffffffa0389898:	85 d2                	test   %edx,%edx   |  %edx =>   0
> >>>>  ffffffffa038989a:	0f 85 d5 00 00 00    	jne    ffffffffa0389975
> >>>><kvm_set_irq+0x105>
> >>>>*ffffffffa03898a0:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax |
> >>>>%eax = 0  %r13 = 0<--- faulting instruction
> >>>>  ffffffffa03898a7:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx
> >>>>  ffffffffa03898ad:	73 61                	jae    ffffffffa0389910
> >>>><kvm_set_irq+0xa0>
> >>>>  ffffffffa03898af:	89 db                	mov    %ebx,%ebx
> >>>>  ffffffffa03898b1:	48 8b 84 d8 30 01 00 	mov    0x130(%rax,%rbx,8),%rax
> >>>>  ffffffffa03898b8:	00
> >>>>  ffffffffa03898b9:	48 85 c0             	test   %rax,%rax
> >>>>  ffffffffa03898bc:	74 52                	je     ffffffffa0389910
> >>>><kvm_set_irq+0xa0>
> >>>>  ffffffffa03898be:	48 8d 95 40 ff ff ff 	lea    -0xc0(%rbp),%rdx
> >>>>  ffffffffa03898c5:	31 db                	xor    %ebx,%ebx
> >>>>  ffffffffa03898c7:	48 8b 08             	mov    (%rax),%rcx
> >>>>  ffffffffa03898ca:	83 c3 01             	add    $0x1,%ebx
> >>>>  ffffffffa03898cd:	0f 18 09             	prefetcht0 (%rcx)
> >>>>  ffffffffa03898d0:	48 8b 48 e0          	mov    -0x20(%rax),%rcx
> >>>>  ffffffffa03898d4:	48 89 0a             	mov    %rcx,(%rdx)
> >>>>  ffffffffa03898d7:	48 8b 48 e8          	mov    -0x18(%rax),%rcx
> >>>>  ffffffffa03898db:	48 89 4a 08          	mov    %rcx,0x8(%rdx)
> >>>>  ffffffffa03898df:	48 8b 48 f0          	mov    -0x10(%rax),%rcx
> >>>>  ffffffffa03898e3:	48 89 4a 10          	mov    %rcx,0x10(%rdx)
> >>>>  ffffffffa03898e7:	48 8b 48 f8          	mov    -0x8(%rax),%rcx
> >>>>  ffffffffa03898eb:	48 89 4a 18          	mov    %rcx,0x18(%rdx)
> >>>>
> >>>>wich correspond to offset 68a0 (from objdump):
> >>>>
> >>>>kvm_set_irq():
> >>>>/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
> >>>>     68a0:       49 8b 85 58 24 00 00    mov    0x2458(%r13),%rax
> >>>>/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
> >>>>     68a7:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
> >>>>
> >>>>root@ayrshire:~# addr2line -e
> >>>>/lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
> >>>>0x68a0
> >>>>/usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
> >>>>
> >>>>So here kvm->irq_routing is null.
> >>>>
> >>>>How can it be?
> >>>>
> >>>>Regards.
> >>>Not null, this seems to be invalid.
> >>>I suspect use after free where the kvm pointer is
> >>>pointing at some random memory. Use after free?
> >>>Could you please try enabling a slab debugger,
> >>>recompile and rerun the test?
> >>>
> >>Hi,
> >>
> >>I'm not sure to activate the right thing.
> >>Is that what you want?
> >>
> >>CONFIG_SLAB=y
> >>CONFIG_SLABINFO=y
> >>CONFIG_DEBUG_SLAB=y
> >>CONFIG_DEBUG_SLAB_LEAK=y
> >>
> >>Regards.
> >Yes, maybe disable SLAB_LEAK.
> >
> >>-- 
> >>Jean-Philippe Menil - Pôle réseau Service IRTS
> >>DSI Université de Nantes
> >>jean-philippe.menil@univ-nantes.fr
> >>Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09
> >--
> >To unsubscribe from this list: send the line "unsubscribe kvm" in
> >the body of a message to majordomo@vger.kernel.org
> >More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Hi,
> 
> so this time, here is what markup_oops says:
> 
> root@ayrshire:~# cat oops-0403.txt | perl markup_oops.pl -m
> /lib/modules/2.6.37.2.999-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
> /boot/vmlinuz-2.6.37.2.999-dsiun-110105+
> vmaoffset = 18446744072102948864 ffffffffa03d9811:    48 89 e5
> mov    %rsp,%rbp
>  ffffffffa03d9814:    41 57                    push   %r15
>  ffffffffa03d9816:    41 89 cf                 mov    %ecx,%r15d  |
> %r15 => 1  %ecx = 1
>  ffffffffa03d9819:    41 56                    push   %r14        |
> %r14 => ffffffffa03daa50
>  ffffffffa03d981b:    41 55                    push   %r13
>  ffffffffa03d981d:    49 89 fd                 mov    %rdi,%r13   |
> %edi = 6b6b6b6b6b6b6b6b  %r13 => 6b6b6b6b6b6b6b6b
>  ffffffffa03d9820:    41 54                    push   %r12        |
> %r12 => 6b6b6b6b6b6b6b6b
>  ffffffffa03d9822:    53                       push   %rbx
>  ffffffffa03d9823:    89 d3                    mov    %edx,%ebx   |
> %ebx => 6b6b6b6b
>  ffffffffa03d9825:    48 81 ec a8 00 00 00     sub    $0xa8,%rsp
>  ffffffffa03d982c:    8b 15 00 00 00 00        mov    0x0(%rip),%edx
> # ffffffffa03d9832 <kvm_set_irq+0x22>
>  ffffffffa03d9832:    89 b5 3c ff ff ff        mov
> %esi,-0xc4(%rbp) |  %esi = 0
>  ffffffffa03d9838:    85 d2                    test   %edx,%edx   |
> %edx => 0
>  ffffffffa03d983a:    0f 85 d5 00 00 00        jne
> ffffffffa03d9915 <kvm_set_irq+0x105>
> *ffffffffa03d9840:    49 8b 85 58 24 00 00     mov
> 0x2458(%r13),%rax |  %eax = 0  %r13 = 6b6b6b6b6b6b6b6b <--- faulting
> instruction
>  ffffffffa03d9847:    3b 98 28 01 00 00        cmp    0x128(%rax),%ebx
>  ffffffffa03d984d:    73 61                    jae
> ffffffffa03d98b0 <kvm_set_irq+0xa0>
>  ffffffffa03d984f:    89 db                    mov    %ebx,%ebx
>  ffffffffa03d9851:    48 8b 84 d8 30 01 00     mov
> 0x130(%rax,%rbx,8),%rax
>  ffffffffa03d9858:    00
>  ffffffffa03d9859:    48 85 c0                 test   %rax,%rax
>  ffffffffa03d985c:    74 52                    je
> ffffffffa03d98b0 <kvm_set_irq+0xa0>
>  ffffffffa03d985e:    48 8d 95 40 ff ff ff     lea    -0xc0(%rbp),%rdx
>  ffffffffa03d9865:    31 db                    xor    %ebx,%ebx
>  ffffffffa03d9867:    48 8b 08                 mov    (%rax),%rcx
>  ffffffffa03d986a:    83 c3 01                 add    $0x1,%ebx
>  ffffffffa03d986d:    0f 18 09                 prefetcht0 (%rcx)
>  ffffffffa03d9870:    48 8b 48 e0              mov    -0x20(%rax),%rcx
>  ffffffffa03d9874:    48 89 0a                 mov    %rcx,(%rdx)
>  ffffffffa03d9877:    48 8b 48 e8              mov    -0x18(%rax),%rcx
>  ffffffffa03d987b:    48 89 4a 08              mov    %rcx,0x8(%rdx)
>  ffffffffa03d987f:    48 8b 48 f0              mov    -0x10(%rax),%rcx
>  ffffffffa03d9883:    48 89 4a 10              mov    %rcx,0x10(%rdx)
>  ffffffffa03d9887:    48 8b 48 f8              mov    -0x8(%rax),%rcx
>  ffffffffa03d988b:    48 89 4a 18              mov    %rcx,0x18(%rdx)
> 
> 
> Is that you wanted, the "6b6b6b6b6b6b6b6b" ?
> 
> Regards.

Yes, excellent. So now we can detect the problem by comparing
kvm with 6b6b6b6b6b6b6b6b, and print out stuff to understand where
this comes from.
I will prepare such a debugging patch.

For that, could you please tell me which kernel version, exactly, are
you using?


-- 
MST

^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-04  9:35                           ` Michael S. Tsirkin
@ 2011-03-04  9:39                             ` Jean-Philippe Menil
  2011-03-08 11:13                               ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-03-04  9:39 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: netdev, kvm, virtualization

Le 04/03/2011 10:35, Michael S. Tsirkin a écrit :
> On Fri, Mar 04, 2011 at 10:22:03AM +0100, Jean-Philippe Menil wrote:
>> Le 03/03/2011 16:55, Michael S. Tsirkin a écrit :
>>> On Thu, Mar 03, 2011 at 04:26:11PM +0100, Jean-Philippe Menil wrote:
>>>> Le 03/03/2011 15:47, Michael S. Tsirkin a écrit :
>>>>> On Tue, Mar 01, 2011 at 03:39:12PM +0100, Jean-Philippe Menil wrote:
>>>>>> so this time the bug is:
>>>>>>
>>>>>> [17882.612303] BUG: unable to handle kernel paging request at
>>>>>> 0000000000002458
>>>>>> [17882.612342] IP: [<ffffffffa03898a0>] kvm_set_irq+0x30/0x140 [kvm]
>>>>>>
>>>>>> markup_oops give me this:
>>>>>>
>>>>>> root@ayrshire:~# cat bug-0103.txt | perl markup_oops.pl -m
>>>>>> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
>>>>>> /boot/vmlinuz-2.6.37.2-dsiun-110105+
>>>>>> vmaoffset = 18446744072102621184 ffffffffa0389871:	48 89 e5   	mov
>>>>>> %rsp,%rbp
>>>>>>   ffffffffa0389874:	41 57                	push   %r15
>>>>>>   ffffffffa0389876:	41 89 cf             	mov    %ecx,%r15d  |  %r15
>>>>>> =>    1  %ecx = 1
>>>>>>   ffffffffa0389879:	41 56                	push   %r14        |  %r14
>>>>>> =>    ffffffffa038aad0
>>>>>>   ffffffffa038987b:	41 55                	push   %r13
>>>>>>   ffffffffa038987d:	49 89 fd             	mov    %rdi,%r13   |  %edi
>>>>>> = 0  %r13 =>    0
>>>>>>   ffffffffa0389880:	41 54                	push   %r12        |  %r12 =>    0
>>>>>>   ffffffffa0389882:	53                   	push   %rbx
>>>>>>   ffffffffa0389883:	89 d3                	mov    %edx,%ebx   |  %ebx =>    1a
>>>>>>   ffffffffa0389885:	48 81 ec a8 00 00 00 	sub    $0xa8,%rsp
>>>>>>   ffffffffa038988c:	8b 15 00 00 00 00    	mov    0x0(%rip),%edx
>>>>>> # ffffffffa0389892<kvm_set_irq+0x22>
>>>>>>   ffffffffa0389892:	89 b5 3c ff ff ff    	mov    %esi,-0xc4(%rbp) |
>>>>>> %esi = 0
>>>>>>   ffffffffa0389898:	85 d2                	test   %edx,%edx   |  %edx =>    0
>>>>>>   ffffffffa038989a:	0f 85 d5 00 00 00    	jne    ffffffffa0389975
>>>>>> <kvm_set_irq+0x105>
>>>>>> *ffffffffa03898a0:	49 8b 85 58 24 00 00 	mov    0x2458(%r13),%rax |
>>>>>> %eax = 0  %r13 = 0<--- faulting instruction
>>>>>>   ffffffffa03898a7:	3b 98 28 01 00 00    	cmp    0x128(%rax),%ebx
>>>>>>   ffffffffa03898ad:	73 61                	jae    ffffffffa0389910
>>>>>> <kvm_set_irq+0xa0>
>>>>>>   ffffffffa03898af:	89 db                	mov    %ebx,%ebx
>>>>>>   ffffffffa03898b1:	48 8b 84 d8 30 01 00 	mov    0x130(%rax,%rbx,8),%rax
>>>>>>   ffffffffa03898b8:	00
>>>>>>   ffffffffa03898b9:	48 85 c0             	test   %rax,%rax
>>>>>>   ffffffffa03898bc:	74 52                	je     ffffffffa0389910
>>>>>> <kvm_set_irq+0xa0>
>>>>>>   ffffffffa03898be:	48 8d 95 40 ff ff ff 	lea    -0xc0(%rbp),%rdx
>>>>>>   ffffffffa03898c5:	31 db                	xor    %ebx,%ebx
>>>>>>   ffffffffa03898c7:	48 8b 08             	mov    (%rax),%rcx
>>>>>>   ffffffffa03898ca:	83 c3 01             	add    $0x1,%ebx
>>>>>>   ffffffffa03898cd:	0f 18 09             	prefetcht0 (%rcx)
>>>>>>   ffffffffa03898d0:	48 8b 48 e0          	mov    -0x20(%rax),%rcx
>>>>>>   ffffffffa03898d4:	48 89 0a             	mov    %rcx,(%rdx)
>>>>>>   ffffffffa03898d7:	48 8b 48 e8          	mov    -0x18(%rax),%rcx
>>>>>>   ffffffffa03898db:	48 89 4a 08          	mov    %rcx,0x8(%rdx)
>>>>>>   ffffffffa03898df:	48 8b 48 f0          	mov    -0x10(%rax),%rcx
>>>>>>   ffffffffa03898e3:	48 89 4a 10          	mov    %rcx,0x10(%rdx)
>>>>>>   ffffffffa03898e7:	48 8b 48 f8          	mov    -0x8(%rax),%rcx
>>>>>>   ffffffffa03898eb:	48 89 4a 18          	mov    %rcx,0x18(%rdx)
>>>>>>
>>>>>> wich correspond to offset 68a0 (from objdump):
>>>>>>
>>>>>> kvm_set_irq():
>>>>>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
>>>>>>      68a0:       49 8b 85 58 24 00 00    mov    0x2458(%r13),%rax
>>>>>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:162
>>>>>>      68a7:       3b 98 28 01 00 00       cmp    0x128(%rax),%ebx
>>>>>>
>>>>>> root@ayrshire:~# addr2line -e
>>>>>> /lib/modules/2.6.37.2-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
>>>>>> 0x68a0
>>>>>> /usr/src/GIT/linux-2.6-stable/arch/x86/kvm/../../../virt/kvm/irq_comm.c:161
>>>>>>
>>>>>> So here kvm->irq_routing is null.
>>>>>>
>>>>>> How can it be?
>>>>>>
>>>>>> Regards.
>>>>> Not null, this seems to be invalid.
>>>>> I suspect use after free where the kvm pointer is
>>>>> pointing at some random memory. Use after free?
>>>>> Could you please try enabling a slab debugger,
>>>>> recompile and rerun the test?
>>>>>
>>>> Hi,
>>>>
>>>> I'm not sure to activate the right thing.
>>>> Is that what you want?
>>>>
>>>> CONFIG_SLAB=y
>>>> CONFIG_SLABINFO=y
>>>> CONFIG_DEBUG_SLAB=y
>>>> CONFIG_DEBUG_SLAB_LEAK=y
>>>>
>>>> Regards.
>>> Yes, maybe disable SLAB_LEAK.
>>>
>>>> -- 
>>>> Jean-Philippe Menil - Pôle réseau Service IRTS
>>>> DSI Université de Nantes
>>>> jean-philippe.menil@univ-nantes.fr
>>>> Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe kvm" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> Hi,
>>
>> so this time, here is what markup_oops says:
>>
>> root@ayrshire:~# cat oops-0403.txt | perl markup_oops.pl -m
>> /lib/modules/2.6.37.2.999-dsiun-110105+/kernel/arch/x86/kvm/kvm.ko
>> /boot/vmlinuz-2.6.37.2.999-dsiun-110105+
>> vmaoffset = 18446744072102948864 ffffffffa03d9811:    48 89 e5
>> mov    %rsp,%rbp
>>   ffffffffa03d9814:    41 57                    push   %r15
>>   ffffffffa03d9816:    41 89 cf                 mov    %ecx,%r15d  |
>> %r15 =>  1  %ecx = 1
>>   ffffffffa03d9819:    41 56                    push   %r14        |
>> %r14 =>  ffffffffa03daa50
>>   ffffffffa03d981b:    41 55                    push   %r13
>>   ffffffffa03d981d:    49 89 fd                 mov    %rdi,%r13   |
>> %edi = 6b6b6b6b6b6b6b6b  %r13 =>  6b6b6b6b6b6b6b6b
>>   ffffffffa03d9820:    41 54                    push   %r12        |
>> %r12 =>  6b6b6b6b6b6b6b6b
>>   ffffffffa03d9822:    53                       push   %rbx
>>   ffffffffa03d9823:    89 d3                    mov    %edx,%ebx   |
>> %ebx =>  6b6b6b6b
>>   ffffffffa03d9825:    48 81 ec a8 00 00 00     sub    $0xa8,%rsp
>>   ffffffffa03d982c:    8b 15 00 00 00 00        mov    0x0(%rip),%edx
>> # ffffffffa03d9832<kvm_set_irq+0x22>
>>   ffffffffa03d9832:    89 b5 3c ff ff ff        mov
>> %esi,-0xc4(%rbp) |  %esi = 0
>>   ffffffffa03d9838:    85 d2                    test   %edx,%edx   |
>> %edx =>  0
>>   ffffffffa03d983a:    0f 85 d5 00 00 00        jne
>> ffffffffa03d9915<kvm_set_irq+0x105>
>> *ffffffffa03d9840:    49 8b 85 58 24 00 00     mov
>> 0x2458(%r13),%rax |  %eax = 0  %r13 = 6b6b6b6b6b6b6b6b<--- faulting
>> instruction
>>   ffffffffa03d9847:    3b 98 28 01 00 00        cmp    0x128(%rax),%ebx
>>   ffffffffa03d984d:    73 61                    jae
>> ffffffffa03d98b0<kvm_set_irq+0xa0>
>>   ffffffffa03d984f:    89 db                    mov    %ebx,%ebx
>>   ffffffffa03d9851:    48 8b 84 d8 30 01 00     mov
>> 0x130(%rax,%rbx,8),%rax
>>   ffffffffa03d9858:    00
>>   ffffffffa03d9859:    48 85 c0                 test   %rax,%rax
>>   ffffffffa03d985c:    74 52                    je
>> ffffffffa03d98b0<kvm_set_irq+0xa0>
>>   ffffffffa03d985e:    48 8d 95 40 ff ff ff     lea    -0xc0(%rbp),%rdx
>>   ffffffffa03d9865:    31 db                    xor    %ebx,%ebx
>>   ffffffffa03d9867:    48 8b 08                 mov    (%rax),%rcx
>>   ffffffffa03d986a:    83 c3 01                 add    $0x1,%ebx
>>   ffffffffa03d986d:    0f 18 09                 prefetcht0 (%rcx)
>>   ffffffffa03d9870:    48 8b 48 e0              mov    -0x20(%rax),%rcx
>>   ffffffffa03d9874:    48 89 0a                 mov    %rcx,(%rdx)
>>   ffffffffa03d9877:    48 8b 48 e8              mov    -0x18(%rax),%rcx
>>   ffffffffa03d987b:    48 89 4a 08              mov    %rcx,0x8(%rdx)
>>   ffffffffa03d987f:    48 8b 48 f0              mov    -0x10(%rax),%rcx
>>   ffffffffa03d9883:    48 89 4a 10              mov    %rcx,0x10(%rdx)
>>   ffffffffa03d9887:    48 8b 48 f8              mov    -0x8(%rax),%rcx
>>   ffffffffa03d988b:    48 89 4a 18              mov    %rcx,0x18(%rdx)
>>
>>
>> Is that you wanted, the "6b6b6b6b6b6b6b6b" ?
>>
>> Regards.
> Yes, excellent. So now we can detect the problem by comparing
> kvm with 6b6b6b6b6b6b6b6b, and print out stuff to understand where
> this comes from.
> I will prepare such a debugging patch.
>
> For that, could you please tell me which kernel version, exactly, are
> you using?
>
>
Yes, it's a 2.6.37.2 kernel.

Thanks a lot.


-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-04  9:39                             ` Jean-Philippe Menil
@ 2011-03-08 11:13                               ` Michael S. Tsirkin
  2011-03-09 12:28                                 ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-03-08 11:13 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: netdev, kvm, virtualization

On Fri, Mar 04, 2011 at 10:39:05AM +0100, Jean-Philippe Menil wrote:
> Yes, it's a 2.6.37.2 kernel.

OK, here's a debugging patch.
Please run with slab debugging as previously until you see
'eventfd bug detected!' in dmesg or until there is a crash.
It might be also useful to enable timestampts on printk with
 Symbol: PRINTK_TIME [=y]
  │ Type  : boolean
  │ Prompt: Show timing information on printks
 
once you see the error, please upload the
full dmesg output somewhere to we can track what
goes on.

Hopefully there won't be an oops this time which
should make it easier for you to test (no need to
reboot).


diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
index c1f1e3c..3cb679b 100644
--- a/virt/kvm/eventfd.c
+++ b/virt/kvm/eventfd.c
@@ -32,6 +32,7 @@
 #include <linux/eventfd.h>
 #include <linux/kernel.h>
 #include <linux/slab.h>
+#include <linux/nmi.h>
 
 #include "iodev.h"
 
@@ -43,6 +44,8 @@
  * --------------------------------------------------------------------
  */
 
+#define KVM_BAD_PTR ((void*)(long)(0x6b6b6b6b6b6b6b6bull))
+
 struct _irqfd {
 	struct kvm               *kvm;
 	struct eventfd_ctx       *eventfd;
@@ -61,6 +64,13 @@ irqfd_inject(struct work_struct *work)
 {
 	struct _irqfd *irqfd = container_of(work, struct _irqfd, inject);
 	struct kvm *kvm = irqfd->kvm;
+	if (kvm == KVM_BAD_PTR) {
+		printk(KERN_ERR "Eventfd bug detected!\n");
+		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
+			work, irqfd, kvm, irqfd->gsi);
+		trigger_all_cpu_backtrace();
+		return;
+	}
 
 	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 1);
 	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 0);
@@ -75,6 +85,8 @@ irqfd_shutdown(struct work_struct *work)
 	struct _irqfd *irqfd = container_of(work, struct _irqfd, shutdown);
 	u64 cnt;
 
+	printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
+	       work, irqfd, irqfd->kvm, irqfd->gsi);
 	/*
 	 * Synchronize with the wait-queue and unhook ourselves to prevent
 	 * further events.
@@ -91,6 +103,8 @@ irqfd_shutdown(struct work_struct *work)
 	 * It is now safe to release the object's resources
 	 */
 	eventfd_ctx_put(irqfd->eventfd);
+	printk(KERN_ERR "kfree at %s(work=%p,irqfd=%p)\n", __func__,
+	       work, irqfd);
 	kfree(irqfd);
 }
 
@@ -111,6 +125,8 @@ static void
 irqfd_deactivate(struct _irqfd *irqfd)
 {
 	BUG_ON(!irqfd_is_active(irqfd));
+	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
+	       irqfd, irqfd->kvm, irqfd->gsi);
 
 	list_del_init(&irqfd->list);
 
@@ -178,6 +194,8 @@ kvm_irqfd_assign(struct kvm *kvm, int fd, int gsi)
 
 	irqfd->kvm = kvm;
 	irqfd->gsi = gsi;
+	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
+	       irqfd, kvm, gsi);
 	INIT_LIST_HEAD(&irqfd->list);
 	INIT_WORK(&irqfd->inject, irqfd_inject);
 	INIT_WORK(&irqfd->shutdown, irqfd_shutdown);
@@ -264,6 +282,8 @@ kvm_irqfd_deassign(struct kvm *kvm, int fd, int gsi)
 	struct _irqfd *irqfd, *tmp;
 	struct eventfd_ctx *eventfd;
 
+	printk(KERN_ERR "%s(kvm=%p, gsi=%d)\n", __func__,
+	       kvm, gsi);
 	eventfd = eventfd_ctx_fdget(fd);
 	if (IS_ERR(eventfd))
 		return PTR_ERR(eventfd);
@@ -305,6 +325,7 @@ void
 kvm_irqfd_release(struct kvm *kvm)
 {
 	struct _irqfd *irqfd, *tmp;
+	printk(KERN_ERR "%s(kvm=%p)\n", __func__, kvm);
 
 	spin_lock_irq(&kvm->irqfds.lock);
 

^ permalink raw reply related	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-08 11:13                               ` Michael S. Tsirkin
@ 2011-03-09 12:28                                 ` Jean-Philippe Menil
  2011-03-09 13:00                                   ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-03-09 12:28 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: netdev, kvm, virtualization

Le 08/03/2011 12:13, Michael S. Tsirkin a écrit :
> On Fri, Mar 04, 2011 at 10:39:05AM +0100, Jean-Philippe Menil wrote:
>> Yes, it's a 2.6.37.2 kernel.
> OK, here's a debugging patch.
> Please run with slab debugging as previously until you see
> 'eventfd bug detected!' in dmesg or until there is a crash.
> It might be also useful to enable timestampts on printk with
>   Symbol: PRINTK_TIME [=y]
>    │ Type  : boolean
>    │ Prompt: Show timing information on printks
>
> once you see the error, please upload the
> full dmesg output somewhere to we can track what
> goes on.
>
> Hopefully there won't be an oops this time which
> should make it easier for you to test (no need to
> reboot).
>
>
> diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
> index c1f1e3c..3cb679b 100644
> --- a/virt/kvm/eventfd.c
> +++ b/virt/kvm/eventfd.c
> @@ -32,6 +32,7 @@
>   #include<linux/eventfd.h>
>   #include<linux/kernel.h>
>   #include<linux/slab.h>
> +#include<linux/nmi.h>
>
>   #include "iodev.h"
>
> @@ -43,6 +44,8 @@
>    * --------------------------------------------------------------------
>    */
>
> +#define KVM_BAD_PTR ((void*)(long)(0x6b6b6b6b6b6b6b6bull))
> +
>   struct _irqfd {
>   	struct kvm               *kvm;
>   	struct eventfd_ctx       *eventfd;
> @@ -61,6 +64,13 @@ irqfd_inject(struct work_struct *work)
>   {
>   	struct _irqfd *irqfd = container_of(work, struct _irqfd, inject);
>   	struct kvm *kvm = irqfd->kvm;
> +	if (kvm == KVM_BAD_PTR) {
> +		printk(KERN_ERR "Eventfd bug detected!\n");
> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
> +			work, irqfd, kvm, irqfd->gsi);
> +		trigger_all_cpu_backtrace();
> +		return;
> +	}
>
>   	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 1);
>   	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 0);
> @@ -75,6 +85,8 @@ irqfd_shutdown(struct work_struct *work)
>   	struct _irqfd *irqfd = container_of(work, struct _irqfd, shutdown);
>   	u64 cnt;
>
> +	printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> +	       work, irqfd, irqfd->kvm, irqfd->gsi);
>   	/*
>   	 * Synchronize with the wait-queue and unhook ourselves to prevent
>   	 * further events.
> @@ -91,6 +103,8 @@ irqfd_shutdown(struct work_struct *work)
>   	 * It is now safe to release the object's resources
>   	 */
>   	eventfd_ctx_put(irqfd->eventfd);
> +	printk(KERN_ERR "kfree at %s(work=%p,irqfd=%p)\n", __func__,
> +	       work, irqfd);
>   	kfree(irqfd);
>   }
>
> @@ -111,6 +125,8 @@ static void
>   irqfd_deactivate(struct _irqfd *irqfd)
>   {
>   	BUG_ON(!irqfd_is_active(irqfd));
> +	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> +	       irqfd, irqfd->kvm, irqfd->gsi);
>
>   	list_del_init(&irqfd->list);
>
> @@ -178,6 +194,8 @@ kvm_irqfd_assign(struct kvm *kvm, int fd, int gsi)
>
>   	irqfd->kvm = kvm;
>   	irqfd->gsi = gsi;
> +	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> +	       irqfd, kvm, gsi);
>   	INIT_LIST_HEAD(&irqfd->list);
>   	INIT_WORK(&irqfd->inject, irqfd_inject);
>   	INIT_WORK(&irqfd->shutdown, irqfd_shutdown);
> @@ -264,6 +282,8 @@ kvm_irqfd_deassign(struct kvm *kvm, int fd, int gsi)
>   	struct _irqfd *irqfd, *tmp;
>   	struct eventfd_ctx *eventfd;
>
> +	printk(KERN_ERR "%s(kvm=%p, gsi=%d)\n", __func__,
> +	       kvm, gsi);
>   	eventfd = eventfd_ctx_fdget(fd);
>   	if (IS_ERR(eventfd))
>   		return PTR_ERR(eventfd);
> @@ -305,6 +325,7 @@ void
>   kvm_irqfd_release(struct kvm *kvm)
>   {
>   	struct _irqfd *irqfd, *tmp;
> +	printk(KERN_ERR "%s(kvm=%p)\n", __func__, kvm);
>
>   	spin_lock_irq(&kvm->irqfds.lock);
>
> --
> To unsubscribe from this list: send the line "unsubscribe netdev" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
Hi,

I boot the host with the patched kernel yesterday.
No crach until now, but two "Eventfd bug detected!" in the log at "Mar  
9 02:04:31" and "Mar  9 02:15:17"
You can find part of the log at the following adress:
http://filex.univ-nantes.fr/get?k=jL4Fe7yfSMN57toAH7V

It a split file of the kern.log (1,4G), so if you need another part of 
the log, let me know.

Thanks for all.

Regards.


-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-09 12:28                                 ` Jean-Philippe Menil
@ 2011-03-09 13:00                                   ` Michael S. Tsirkin
  2011-03-09 13:12                                     ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-03-09 13:00 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: netdev, kvm, virtualization

On Wed, Mar 09, 2011 at 01:28:43PM +0100, Jean-Philippe Menil wrote:
> Le 08/03/2011 12:13, Michael S. Tsirkin a écrit :
> >On Fri, Mar 04, 2011 at 10:39:05AM +0100, Jean-Philippe Menil wrote:
> >>Yes, it's a 2.6.37.2 kernel.
> >OK, here's a debugging patch.
> >Please run with slab debugging as previously until you see
> >'eventfd bug detected!' in dmesg or until there is a crash.
> >It might be also useful to enable timestampts on printk with
> >  Symbol: PRINTK_TIME [=y]
> >   │ Type  : boolean
> >   │ Prompt: Show timing information on printks
> >
> >once you see the error, please upload the
> >full dmesg output somewhere to we can track what
> >goes on.
> >
> >Hopefully there won't be an oops this time which
> >should make it easier for you to test (no need to
> >reboot).
> >
> >
> >diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
> >index c1f1e3c..3cb679b 100644
> >--- a/virt/kvm/eventfd.c
> >+++ b/virt/kvm/eventfd.c
> >@@ -32,6 +32,7 @@
> >  #include<linux/eventfd.h>
> >  #include<linux/kernel.h>
> >  #include<linux/slab.h>
> >+#include<linux/nmi.h>
> >
> >  #include "iodev.h"
> >
> >@@ -43,6 +44,8 @@
> >   * --------------------------------------------------------------------
> >   */
> >
> >+#define KVM_BAD_PTR ((void*)(long)(0x6b6b6b6b6b6b6b6bull))
> >+
> >  struct _irqfd {
> >  	struct kvm               *kvm;
> >  	struct eventfd_ctx       *eventfd;
> >@@ -61,6 +64,13 @@ irqfd_inject(struct work_struct *work)
> >  {
> >  	struct _irqfd *irqfd = container_of(work, struct _irqfd, inject);
> >  	struct kvm *kvm = irqfd->kvm;
> >+	if (kvm == KVM_BAD_PTR) {
> >+		printk(KERN_ERR "Eventfd bug detected!\n");
> >+		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
> >+			work, irqfd, kvm, irqfd->gsi);
> >+		trigger_all_cpu_backtrace();
> >+		return;
> >+	}
> >
> >  	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 1);
> >  	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 0);
> >@@ -75,6 +85,8 @@ irqfd_shutdown(struct work_struct *work)
> >  	struct _irqfd *irqfd = container_of(work, struct _irqfd, shutdown);
> >  	u64 cnt;
> >
> >+	printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> >+	       work, irqfd, irqfd->kvm, irqfd->gsi);
> >  	/*
> >  	 * Synchronize with the wait-queue and unhook ourselves to prevent
> >  	 * further events.
> >@@ -91,6 +103,8 @@ irqfd_shutdown(struct work_struct *work)
> >  	 * It is now safe to release the object's resources
> >  	 */
> >  	eventfd_ctx_put(irqfd->eventfd);
> >+	printk(KERN_ERR "kfree at %s(work=%p,irqfd=%p)\n", __func__,
> >+	       work, irqfd);
> >  	kfree(irqfd);
> >  }
> >
> >@@ -111,6 +125,8 @@ static void
> >  irqfd_deactivate(struct _irqfd *irqfd)
> >  {
> >  	BUG_ON(!irqfd_is_active(irqfd));
> >+	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> >+	       irqfd, irqfd->kvm, irqfd->gsi);
> >
> >  	list_del_init(&irqfd->list);
> >
> >@@ -178,6 +194,8 @@ kvm_irqfd_assign(struct kvm *kvm, int fd, int gsi)
> >
> >  	irqfd->kvm = kvm;
> >  	irqfd->gsi = gsi;
> >+	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> >+	       irqfd, kvm, gsi);
> >  	INIT_LIST_HEAD(&irqfd->list);
> >  	INIT_WORK(&irqfd->inject, irqfd_inject);
> >  	INIT_WORK(&irqfd->shutdown, irqfd_shutdown);
> >@@ -264,6 +282,8 @@ kvm_irqfd_deassign(struct kvm *kvm, int fd, int gsi)
> >  	struct _irqfd *irqfd, *tmp;
> >  	struct eventfd_ctx *eventfd;
> >
> >+	printk(KERN_ERR "%s(kvm=%p, gsi=%d)\n", __func__,
> >+	       kvm, gsi);
> >  	eventfd = eventfd_ctx_fdget(fd);
> >  	if (IS_ERR(eventfd))
> >  		return PTR_ERR(eventfd);
> >@@ -305,6 +325,7 @@ void
> >  kvm_irqfd_release(struct kvm *kvm)
> >  {
> >  	struct _irqfd *irqfd, *tmp;
> >+	printk(KERN_ERR "%s(kvm=%p)\n", __func__, kvm);
> >
> >  	spin_lock_irq(&kvm->irqfds.lock);
> >
> >--
> >To unsubscribe from this list: send the line "unsubscribe netdev" in
> >the body of a message to majordomo@vger.kernel.org
> >More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Hi,
> 
> I boot the host with the patched kernel yesterday.
> No crach until now, but two "Eventfd bug detected!" in the log at
> "Mar  9 02:04:31" and "Mar  9 02:15:17"
> You can find part of the log at the following adress:
> http://filex.univ-nantes.fr/get?k=jL4Fe7yfSMN57toAH7V
> 
> It a split file of the kern.log (1,4G), so if you need another part
> of the log, let me know.
> 
> Thanks for all.
> 
> Regards.

Downloading, it's big :)
What about some 1000 lines before and after Eventfd bug detected! line?

^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-09 13:00                                   ` Michael S. Tsirkin
@ 2011-03-09 13:12                                     ` Jean-Philippe Menil
  2011-03-09 13:59                                       ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-03-09 13:12 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: netdev, kvm, virtualization

Le 09/03/2011 14:00, Michael S. Tsirkin a écrit :
> On Wed, Mar 09, 2011 at 01:28:43PM +0100, Jean-Philippe Menil wrote:
>> Le 08/03/2011 12:13, Michael S. Tsirkin a écrit :
>>> On Fri, Mar 04, 2011 at 10:39:05AM +0100, Jean-Philippe Menil wrote:
>>>> Yes, it's a 2.6.37.2 kernel.
>>> OK, here's a debugging patch.
>>> Please run with slab debugging as previously until you see
>>> 'eventfd bug detected!' in dmesg or until there is a crash.
>>> It might be also useful to enable timestampts on printk with
>>>   Symbol: PRINTK_TIME [=y]
>>>    │ Type  : boolean
>>>    │ Prompt: Show timing information on printks
>>>
>>> once you see the error, please upload the
>>> full dmesg output somewhere to we can track what
>>> goes on.
>>>
>>> Hopefully there won't be an oops this time which
>>> should make it easier for you to test (no need to
>>> reboot).
>>>
>>>
>>> diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
>>> index c1f1e3c..3cb679b 100644
>>> --- a/virt/kvm/eventfd.c
>>> +++ b/virt/kvm/eventfd.c
>>> @@ -32,6 +32,7 @@
>>>   #include<linux/eventfd.h>
>>>   #include<linux/kernel.h>
>>>   #include<linux/slab.h>
>>> +#include<linux/nmi.h>
>>>
>>>   #include "iodev.h"
>>>
>>> @@ -43,6 +44,8 @@
>>>    * --------------------------------------------------------------------
>>>    */
>>>
>>> +#define KVM_BAD_PTR ((void*)(long)(0x6b6b6b6b6b6b6b6bull))
>>> +
>>>   struct _irqfd {
>>>   	struct kvm               *kvm;
>>>   	struct eventfd_ctx       *eventfd;
>>> @@ -61,6 +64,13 @@ irqfd_inject(struct work_struct *work)
>>>   {
>>>   	struct _irqfd *irqfd = container_of(work, struct _irqfd, inject);
>>>   	struct kvm *kvm = irqfd->kvm;
>>> +	if (kvm == KVM_BAD_PTR) {
>>> +		printk(KERN_ERR "Eventfd bug detected!\n");
>>> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
>>> +			work, irqfd, kvm, irqfd->gsi);
>>> +		trigger_all_cpu_backtrace();
>>> +		return;
>>> +	}
>>>
>>>   	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 1);
>>>   	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 0);
>>> @@ -75,6 +85,8 @@ irqfd_shutdown(struct work_struct *work)
>>>   	struct _irqfd *irqfd = container_of(work, struct _irqfd, shutdown);
>>>   	u64 cnt;
>>>
>>> +	printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>> +	       work, irqfd, irqfd->kvm, irqfd->gsi);
>>>   	/*
>>>   	 * Synchronize with the wait-queue and unhook ourselves to prevent
>>>   	 * further events.
>>> @@ -91,6 +103,8 @@ irqfd_shutdown(struct work_struct *work)
>>>   	 * It is now safe to release the object's resources
>>>   	 */
>>>   	eventfd_ctx_put(irqfd->eventfd);
>>> +	printk(KERN_ERR "kfree at %s(work=%p,irqfd=%p)\n", __func__,
>>> +	       work, irqfd);
>>>   	kfree(irqfd);
>>>   }
>>>
>>> @@ -111,6 +125,8 @@ static void
>>>   irqfd_deactivate(struct _irqfd *irqfd)
>>>   {
>>>   	BUG_ON(!irqfd_is_active(irqfd));
>>> +	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>> +	       irqfd, irqfd->kvm, irqfd->gsi);
>>>
>>>   	list_del_init(&irqfd->list);
>>>
>>> @@ -178,6 +194,8 @@ kvm_irqfd_assign(struct kvm *kvm, int fd, int gsi)
>>>
>>>   	irqfd->kvm = kvm;
>>>   	irqfd->gsi = gsi;
>>> +	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>> +	       irqfd, kvm, gsi);
>>>   	INIT_LIST_HEAD(&irqfd->list);
>>>   	INIT_WORK(&irqfd->inject, irqfd_inject);
>>>   	INIT_WORK(&irqfd->shutdown, irqfd_shutdown);
>>> @@ -264,6 +282,8 @@ kvm_irqfd_deassign(struct kvm *kvm, int fd, int gsi)
>>>   	struct _irqfd *irqfd, *tmp;
>>>   	struct eventfd_ctx *eventfd;
>>>
>>> +	printk(KERN_ERR "%s(kvm=%p, gsi=%d)\n", __func__,
>>> +	       kvm, gsi);
>>>   	eventfd = eventfd_ctx_fdget(fd);
>>>   	if (IS_ERR(eventfd))
>>>   		return PTR_ERR(eventfd);
>>> @@ -305,6 +325,7 @@ void
>>>   kvm_irqfd_release(struct kvm *kvm)
>>>   {
>>>   	struct _irqfd *irqfd, *tmp;
>>> +	printk(KERN_ERR "%s(kvm=%p)\n", __func__, kvm);
>>>
>>>   	spin_lock_irq(&kvm->irqfds.lock);
>>>
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe netdev" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> Hi,
>>
>> I boot the host with the patched kernel yesterday.
>> No crach until now, but two "Eventfd bug detected!" in the log at
>> "Mar  9 02:04:31" and "Mar  9 02:15:17"
>> You can find part of the log at the following adress:
>> http://filex.univ-nantes.fr/get?k=jL4Fe7yfSMN57toAH7V
>>
>> It a split file of the kern.log (1,4G), so if you need another part
>> of the log, let me know.
>>
>> Thanks for all.
>>
>> Regards.
> Downloading, it's big :)
> What about some 1000 lines before and after Eventfd bug detected! line?
> --
> To unsubscribe from this list: send the line "unsubscribe kvm" in
> the body of a message to majordomo@vger.kernel.org
> More majordomo info at  http://vger.kernel.org/majordomo-info.html
Yes, sorry about that.
I could have split my log into a smaller file.

I was a little afraid of not transmit enough informations, and i was a 
bit wide.
I hope you can find usefull trace anyway.

Regards.

-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-09 13:12                                     ` Jean-Philippe Menil
@ 2011-03-09 13:59                                       ` Michael S. Tsirkin
  2011-03-10  8:42                                         ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-03-09 13:59 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: netdev, kvm, virtualization

On Wed, Mar 09, 2011 at 02:12:58PM +0100, Jean-Philippe Menil wrote:
> Le 09/03/2011 14:00, Michael S. Tsirkin a écrit :
> >On Wed, Mar 09, 2011 at 01:28:43PM +0100, Jean-Philippe Menil wrote:
> >>Le 08/03/2011 12:13, Michael S. Tsirkin a écrit :
> >>>On Fri, Mar 04, 2011 at 10:39:05AM +0100, Jean-Philippe Menil wrote:
> >>>>Yes, it's a 2.6.37.2 kernel.
> >>>OK, here's a debugging patch.
> >>>Please run with slab debugging as previously until you see
> >>>'eventfd bug detected!' in dmesg or until there is a crash.
> >>>It might be also useful to enable timestampts on printk with
> >>>  Symbol: PRINTK_TIME [=y]
> >>>   │ Type  : boolean
> >>>   │ Prompt: Show timing information on printks
> >>>
> >>>once you see the error, please upload the
> >>>full dmesg output somewhere to we can track what
> >>>goes on.
> >>>
> >>>Hopefully there won't be an oops this time which
> >>>should make it easier for you to test (no need to
> >>>reboot).
> >>>
> >>>
> >>>diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
> >>>index c1f1e3c..3cb679b 100644
> >>>--- a/virt/kvm/eventfd.c
> >>>+++ b/virt/kvm/eventfd.c
> >>>@@ -32,6 +32,7 @@
> >>>  #include<linux/eventfd.h>
> >>>  #include<linux/kernel.h>
> >>>  #include<linux/slab.h>
> >>>+#include<linux/nmi.h>
> >>>
> >>>  #include "iodev.h"
> >>>
> >>>@@ -43,6 +44,8 @@
> >>>   * --------------------------------------------------------------------
> >>>   */
> >>>
> >>>+#define KVM_BAD_PTR ((void*)(long)(0x6b6b6b6b6b6b6b6bull))
> >>>+
> >>>  struct _irqfd {
> >>>  	struct kvm               *kvm;
> >>>  	struct eventfd_ctx       *eventfd;
> >>>@@ -61,6 +64,13 @@ irqfd_inject(struct work_struct *work)
> >>>  {
> >>>  	struct _irqfd *irqfd = container_of(work, struct _irqfd, inject);
> >>>  	struct kvm *kvm = irqfd->kvm;
> >>>+	if (kvm == KVM_BAD_PTR) {
> >>>+		printk(KERN_ERR "Eventfd bug detected!\n");
> >>>+		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
> >>>+			work, irqfd, kvm, irqfd->gsi);
> >>>+		trigger_all_cpu_backtrace();
> >>>+		return;
> >>>+	}
> >>>
> >>>  	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 1);
> >>>  	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 0);
> >>>@@ -75,6 +85,8 @@ irqfd_shutdown(struct work_struct *work)
> >>>  	struct _irqfd *irqfd = container_of(work, struct _irqfd, shutdown);
> >>>  	u64 cnt;
> >>>
> >>>+	printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> >>>+	       work, irqfd, irqfd->kvm, irqfd->gsi);
> >>>  	/*
> >>>  	 * Synchronize with the wait-queue and unhook ourselves to prevent
> >>>  	 * further events.
> >>>@@ -91,6 +103,8 @@ irqfd_shutdown(struct work_struct *work)
> >>>  	 * It is now safe to release the object's resources
> >>>  	 */
> >>>  	eventfd_ctx_put(irqfd->eventfd);
> >>>+	printk(KERN_ERR "kfree at %s(work=%p,irqfd=%p)\n", __func__,
> >>>+	       work, irqfd);
> >>>  	kfree(irqfd);
> >>>  }
> >>>
> >>>@@ -111,6 +125,8 @@ static void
> >>>  irqfd_deactivate(struct _irqfd *irqfd)
> >>>  {
> >>>  	BUG_ON(!irqfd_is_active(irqfd));
> >>>+	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> >>>+	       irqfd, irqfd->kvm, irqfd->gsi);
> >>>
> >>>  	list_del_init(&irqfd->list);
> >>>
> >>>@@ -178,6 +194,8 @@ kvm_irqfd_assign(struct kvm *kvm, int fd, int gsi)
> >>>
> >>>  	irqfd->kvm = kvm;
> >>>  	irqfd->gsi = gsi;
> >>>+	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> >>>+	       irqfd, kvm, gsi);
> >>>  	INIT_LIST_HEAD(&irqfd->list);
> >>>  	INIT_WORK(&irqfd->inject, irqfd_inject);
> >>>  	INIT_WORK(&irqfd->shutdown, irqfd_shutdown);
> >>>@@ -264,6 +282,8 @@ kvm_irqfd_deassign(struct kvm *kvm, int fd, int gsi)
> >>>  	struct _irqfd *irqfd, *tmp;
> >>>  	struct eventfd_ctx *eventfd;
> >>>
> >>>+	printk(KERN_ERR "%s(kvm=%p, gsi=%d)\n", __func__,
> >>>+	       kvm, gsi);
> >>>  	eventfd = eventfd_ctx_fdget(fd);
> >>>  	if (IS_ERR(eventfd))
> >>>  		return PTR_ERR(eventfd);
> >>>@@ -305,6 +325,7 @@ void
> >>>  kvm_irqfd_release(struct kvm *kvm)
> >>>  {
> >>>  	struct _irqfd *irqfd, *tmp;
> >>>+	printk(KERN_ERR "%s(kvm=%p)\n", __func__, kvm);
> >>>
> >>>  	spin_lock_irq(&kvm->irqfds.lock);
> >>>
> >>>--
> >>>To unsubscribe from this list: send the line "unsubscribe netdev" in
> >>>the body of a message to majordomo@vger.kernel.org
> >>>More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >>Hi,
> >>
> >>I boot the host with the patched kernel yesterday.
> >>No crach until now, but two "Eventfd bug detected!" in the log at
> >>"Mar  9 02:04:31" and "Mar  9 02:15:17"
> >>You can find part of the log at the following adress:
> >>http://filex.univ-nantes.fr/get?k=jL4Fe7yfSMN57toAH7V
> >>
> >>It a split file of the kern.log (1,4G), so if you need another part
> >>of the log, let me know.
> >>
> >>Thanks for all.
> >>
> >>Regards.
> >Downloading, it's big :)
> >What about some 1000 lines before and after Eventfd bug detected! line?
> >--
> >To unsubscribe from this list: send the line "unsubscribe kvm" in
> >the body of a message to majordomo@vger.kernel.org
> >More majordomo info at  http://vger.kernel.org/majordomo-info.html
> Yes, sorry about that.
> I could have split my log into a smaller file.
> 
> I was a little afraid of not transmit enough informations, and i was
> a bit wide.
> I hope you can find usefull trace anyway.
> 
> Regards.


OK, use after free.


Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.593681]
kvm_irqfd_assign(irqfd=ffff88045e8d6230,kvm=ffff88085151c000, gsi=26)
Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605359]
kvm_irqfd_deassign(kvm=ffff88085151c000, gsi=26)
Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605388]
irqfd_deactivate(irqfd=ffff88045e8d6230,kvm=ffff88085151c000, gsi=26)
Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605461]
irqfd_shutdown(work=ffff88045e8d62b0,irqfd=ffff88045e8d6230,kvm=ffff88085151c000,
gsi=26)
Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605509]
kfree at irqfd_shutdown(work=ffff88045e8d62b0,irqfd=ffff88045e8d6230)
Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605588]
Eventfd bug detected!
Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605612]
irqfd_inject(work=ffff88045e8d6290,irqfd=ffff88045e8d6230,kvm=6b6b6b6b6b6b6b6b,gsi=1802201963)


and 1802201963 is also 6b6b6b6b.


I suspect that somehow, we get an event from eventfd even
though we did eventfd_ctx_remove_wait_queue.
Could you please try the following patch on top?
When you see Eventfd bug or Wakeup bug, paste some
last lines.
For the full log file - better compress with xz.


diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
index 3cb679b..63aeba5 100644
--- a/virt/kvm/eventfd.c
+++ b/virt/kvm/eventfd.c
@@ -92,6 +92,8 @@ irqfd_shutdown(struct work_struct *work)
 	 * further events.
 	 */
 	eventfd_ctx_remove_wait_queue(irqfd->eventfd, &irqfd->wait, &cnt);
+	printk(KERN_ERR "remove wq at %s(work=%p,irqfd=%p)\n", __func__,
+	       work, irqfd);
 
 	/*
 	 * We know no new events will be scheduled at this point, so block
@@ -142,6 +144,13 @@ irqfd_wakeup(wait_queue_t *wait, unsigned mode, int sync, void *key)
 	struct _irqfd *irqfd = container_of(wait, struct _irqfd, wait);
 	unsigned long flags = (unsigned long)key;
 
+	if (irqfd->kvm == KVM_BAD_PTR) {
+		printk(KERN_ERR "Wakeup bug detected! flags 0x%lx\n", flags);
+		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
+			&irqfd->inject, irqfd, irqfd->kvm, irqfd->gsi);
+		trigger_all_cpu_backtrace();
+		return 0;
+	}
 	if (flags & POLLIN)
 		/* An event has been signaled, inject an interrupt */
 		schedule_work(&irqfd->inject);
@@ -153,6 +162,9 @@ irqfd_wakeup(wait_queue_t *wait, unsigned mode, int sync, void *key)
 
 		spin_lock_irqsave(&kvm->irqfds.lock, flags);
 
+		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d,active=%d)\n", __func__,
+			&irqfd->inject, irqfd, irqfd->kvm, irqfd->gsi,
+			irqfd_is_active(irqfd));
 		/*
 		 * We must check if someone deactivated the irqfd before
 		 * we could acquire the irqfds.lock since the item is

-- 
MST

^ permalink raw reply related	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-09 13:59                                       ` Michael S. Tsirkin
@ 2011-03-10  8:42                                         ` Jean-Philippe Menil
  2011-03-15 14:32                                           ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-03-10  8:42 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: netdev, kvm, virtualization

Le 09/03/2011 14:59, Michael S. Tsirkin a écrit :
> On Wed, Mar 09, 2011 at 02:12:58PM +0100, Jean-Philippe Menil wrote:
>> Le 09/03/2011 14:00, Michael S. Tsirkin a écrit :
>>> On Wed, Mar 09, 2011 at 01:28:43PM +0100, Jean-Philippe Menil wrote:
>>>> Le 08/03/2011 12:13, Michael S. Tsirkin a écrit :
>>>>> On Fri, Mar 04, 2011 at 10:39:05AM +0100, Jean-Philippe Menil wrote:
>>>>>> Yes, it's a 2.6.37.2 kernel.
>>>>> OK, here's a debugging patch.
>>>>> Please run with slab debugging as previously until you see
>>>>> 'eventfd bug detected!' in dmesg or until there is a crash.
>>>>> It might be also useful to enable timestampts on printk with
>>>>>   Symbol: PRINTK_TIME [=y]
>>>>>    │ Type  : boolean
>>>>>    │ Prompt: Show timing information on printks
>>>>>
>>>>> once you see the error, please upload the
>>>>> full dmesg output somewhere to we can track what
>>>>> goes on.
>>>>>
>>>>> Hopefully there won't be an oops this time which
>>>>> should make it easier for you to test (no need to
>>>>> reboot).
>>>>>
>>>>>
>>>>> diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
>>>>> index c1f1e3c..3cb679b 100644
>>>>> --- a/virt/kvm/eventfd.c
>>>>> +++ b/virt/kvm/eventfd.c
>>>>> @@ -32,6 +32,7 @@
>>>>>   #include<linux/eventfd.h>
>>>>>   #include<linux/kernel.h>
>>>>>   #include<linux/slab.h>
>>>>> +#include<linux/nmi.h>
>>>>>
>>>>>   #include "iodev.h"
>>>>>
>>>>> @@ -43,6 +44,8 @@
>>>>>    * --------------------------------------------------------------------
>>>>>    */
>>>>>
>>>>> +#define KVM_BAD_PTR ((void*)(long)(0x6b6b6b6b6b6b6b6bull))
>>>>> +
>>>>>   struct _irqfd {
>>>>>   	struct kvm               *kvm;
>>>>>   	struct eventfd_ctx       *eventfd;
>>>>> @@ -61,6 +64,13 @@ irqfd_inject(struct work_struct *work)
>>>>>   {
>>>>>   	struct _irqfd *irqfd = container_of(work, struct _irqfd, inject);
>>>>>   	struct kvm *kvm = irqfd->kvm;
>>>>> +	if (kvm == KVM_BAD_PTR) {
>>>>> +		printk(KERN_ERR "Eventfd bug detected!\n");
>>>>> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
>>>>> +			work, irqfd, kvm, irqfd->gsi);
>>>>> +		trigger_all_cpu_backtrace();
>>>>> +		return;
>>>>> +	}
>>>>>
>>>>>   	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 1);
>>>>>   	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 0);
>>>>> @@ -75,6 +85,8 @@ irqfd_shutdown(struct work_struct *work)
>>>>>   	struct _irqfd *irqfd = container_of(work, struct _irqfd, shutdown);
>>>>>   	u64 cnt;
>>>>>
>>>>> +	printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>>>> +	       work, irqfd, irqfd->kvm, irqfd->gsi);
>>>>>   	/*
>>>>>   	 * Synchronize with the wait-queue and unhook ourselves to prevent
>>>>>   	 * further events.
>>>>> @@ -91,6 +103,8 @@ irqfd_shutdown(struct work_struct *work)
>>>>>   	 * It is now safe to release the object's resources
>>>>>   	 */
>>>>>   	eventfd_ctx_put(irqfd->eventfd);
>>>>> +	printk(KERN_ERR "kfree at %s(work=%p,irqfd=%p)\n", __func__,
>>>>> +	       work, irqfd);
>>>>>   	kfree(irqfd);
>>>>>   }
>>>>>
>>>>> @@ -111,6 +125,8 @@ static void
>>>>>   irqfd_deactivate(struct _irqfd *irqfd)
>>>>>   {
>>>>>   	BUG_ON(!irqfd_is_active(irqfd));
>>>>> +	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>>>> +	       irqfd, irqfd->kvm, irqfd->gsi);
>>>>>
>>>>>   	list_del_init(&irqfd->list);
>>>>>
>>>>> @@ -178,6 +194,8 @@ kvm_irqfd_assign(struct kvm *kvm, int fd, int gsi)
>>>>>
>>>>>   	irqfd->kvm = kvm;
>>>>>   	irqfd->gsi = gsi;
>>>>> +	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>>>> +	       irqfd, kvm, gsi);
>>>>>   	INIT_LIST_HEAD(&irqfd->list);
>>>>>   	INIT_WORK(&irqfd->inject, irqfd_inject);
>>>>>   	INIT_WORK(&irqfd->shutdown, irqfd_shutdown);
>>>>> @@ -264,6 +282,8 @@ kvm_irqfd_deassign(struct kvm *kvm, int fd, int gsi)
>>>>>   	struct _irqfd *irqfd, *tmp;
>>>>>   	struct eventfd_ctx *eventfd;
>>>>>
>>>>> +	printk(KERN_ERR "%s(kvm=%p, gsi=%d)\n", __func__,
>>>>> +	       kvm, gsi);
>>>>>   	eventfd = eventfd_ctx_fdget(fd);
>>>>>   	if (IS_ERR(eventfd))
>>>>>   		return PTR_ERR(eventfd);
>>>>> @@ -305,6 +325,7 @@ void
>>>>>   kvm_irqfd_release(struct kvm *kvm)
>>>>>   {
>>>>>   	struct _irqfd *irqfd, *tmp;
>>>>> +	printk(KERN_ERR "%s(kvm=%p)\n", __func__, kvm);
>>>>>
>>>>>   	spin_lock_irq(&kvm->irqfds.lock);
>>>>>
>>>>> --
>>>>> To unsubscribe from this list: send the line "unsubscribe netdev" in
>>>>> the body of a message to majordomo@vger.kernel.org
>>>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>> Hi,
>>>>
>>>> I boot the host with the patched kernel yesterday.
>>>> No crach until now, but two "Eventfd bug detected!" in the log at
>>>> "Mar  9 02:04:31" and "Mar  9 02:15:17"
>>>> You can find part of the log at the following adress:
>>>> http://filex.univ-nantes.fr/get?k=jL4Fe7yfSMN57toAH7V
>>>>
>>>> It a split file of the kern.log (1,4G), so if you need another part
>>>> of the log, let me know.
>>>>
>>>> Thanks for all.
>>>>
>>>> Regards.
>>> Downloading, it's big :)
>>> What about some 1000 lines before and after Eventfd bug detected! line?
>>> --
>>> To unsubscribe from this list: send the line "unsubscribe kvm" in
>>> the body of a message to majordomo@vger.kernel.org
>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>> Yes, sorry about that.
>> I could have split my log into a smaller file.
>>
>> I was a little afraid of not transmit enough informations, and i was
>> a bit wide.
>> I hope you can find usefull trace anyway.
>>
>> Regards.
>
> OK, use after free.
>
>
> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.593681]
> kvm_irqfd_assign(irqfd=ffff88045e8d6230,kvm=ffff88085151c000, gsi=26)
> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605359]
> kvm_irqfd_deassign(kvm=ffff88085151c000, gsi=26)
> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605388]
> irqfd_deactivate(irqfd=ffff88045e8d6230,kvm=ffff88085151c000, gsi=26)
> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605461]
> irqfd_shutdown(work=ffff88045e8d62b0,irqfd=ffff88045e8d6230,kvm=ffff88085151c000,
> gsi=26)
> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605509]
> kfree at irqfd_shutdown(work=ffff88045e8d62b0,irqfd=ffff88045e8d6230)
> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605588]
> Eventfd bug detected!
> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605612]
> irqfd_inject(work=ffff88045e8d6290,irqfd=ffff88045e8d6230,kvm=6b6b6b6b6b6b6b6b,gsi=1802201963)
>
>
> and 1802201963 is also 6b6b6b6b.
>
>
> I suspect that somehow, we get an event from eventfd even
> though we did eventfd_ctx_remove_wait_queue.
> Could you please try the following patch on top?
> When you see Eventfd bug or Wakeup bug, paste some
> last lines.
> For the full log file - better compress with xz.
>
>
> diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
> index 3cb679b..63aeba5 100644
> --- a/virt/kvm/eventfd.c
> +++ b/virt/kvm/eventfd.c
> @@ -92,6 +92,8 @@ irqfd_shutdown(struct work_struct *work)
>   	 * further events.
>   	 */
>   	eventfd_ctx_remove_wait_queue(irqfd->eventfd,&irqfd->wait,&cnt);
> +	printk(KERN_ERR "remove wq at %s(work=%p,irqfd=%p)\n", __func__,
> +	       work, irqfd);
>
>   	/*
>   	 * We know no new events will be scheduled at this point, so block
> @@ -142,6 +144,13 @@ irqfd_wakeup(wait_queue_t *wait, unsigned mode, int sync, void *key)
>   	struct _irqfd *irqfd = container_of(wait, struct _irqfd, wait);
>   	unsigned long flags = (unsigned long)key;
>
> +	if (irqfd->kvm == KVM_BAD_PTR) {
> +		printk(KERN_ERR "Wakeup bug detected! flags 0x%lx\n", flags);
> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
> +			&irqfd->inject, irqfd, irqfd->kvm, irqfd->gsi);
> +		trigger_all_cpu_backtrace();
> +		return 0;
> +	}
>   	if (flags&  POLLIN)
>   		/* An event has been signaled, inject an interrupt */
>   		schedule_work(&irqfd->inject);
> @@ -153,6 +162,9 @@ irqfd_wakeup(wait_queue_t *wait, unsigned mode, int sync, void *key)
>
>   		spin_lock_irqsave(&kvm->irqfds.lock, flags);
>
> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d,active=%d)\n", __func__,
> +			&irqfd->inject, irqfd, irqfd->kvm, irqfd->gsi,
> +			irqfd_is_active(irqfd));
>   		/*
>   		 * We must check if someone deactivated the irqfd before
>   		 * we could acquire the irqfds.lock since the item is
>
Hi,

I noted seven "Eventfd bug detected" events during the night, and only 
one Wakeup event:

fifth.ah:Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: 
[44867.105868] Eventfd bug detected!
first.ad:Mar 10 01:08:15 ayrshire.u06.univ-nantes.prive kernel: 
[34729.771260] Eventfd bug detected!
fourth.ad:Mar 10 02:54:41 ayrshire.u06.univ-nantes.prive kernel: 
[41115.140873] Eventfd bug detected!
second.ab:Mar 10 02:41:55 ayrshire.u06.univ-nantes.prive kernel: 
[40348.967192] Eventfd bug detected!
seventh.ab:Mar 10 07:52:29 ayrshire.u06.univ-nantes.prive kernel: 
[58983.145646] Eventfd bug detected!
sixth.ab:Mar 10 05:19:54 ayrshire.u06.univ-nantes.prive kernel: 
[49828.785558] Eventfd bug detected!
third.ae:Mar 10 02:54:07 ayrshire.u06.univ-nantes.prive kernel: 
[41081.638633] Eventfd bug detected!

grep -i wakeup *
seventh.ab:Mar 10 07:52:29 ayrshire.u06.univ-nantes.prive kernel: 
[58983.154161]  [<ffffffffa02cbf96>] vhost_poll_wakeup+0x16/0x20 [vhost_net


Here is a trace, for the thirst event:

Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.101747] 
irqfd_deactivate(irqfd=ffff88042e0b5e00,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.101873] 
irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00,kvm=ffff8804542d0000, 
gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.101928] 
remove wq at irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.101990] 
kfree at irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.102381] 
kvm_irqfd_assign(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.103796] 
kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.103833] 
irqfd_deactivate(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.103904] 
irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818,kvm=ffff8804542d0000, 
gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.103958] 
remove wq at irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.104023] 
kfree at irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.104311] 
kvm_irqfd_assign(irqfd=ffff88081a190b78,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.104511] 
kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.104549] 
irqfd_deactivate(irqfd=ffff88081a190b78,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.104614] 
irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78,kvm=ffff8804542d0000, 
gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.104667] 
remove wq at irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.104715] 
kfree at irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.104911] 
kvm_irqfd_assign(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.105868] 
Eventfd bug detected!
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.105901] 
irqfd_inject(work=ffff88042e0b5e60,irqfd=ffff88042e0b5e00,kvm=6b6b6b6b6b6b6b6b,gsi=1802201963)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.105951] 
sending NMI to all CPUs:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.105961] 
NMI backtrace for cpu 0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.105986] CPU 0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.105992] 
Modules linked in: btrfs zlib_deflate crc32c libcrc32c ufs qnx4 hfsplus 
hfs minix ntfs vfat msdos fat jfs reiserfs ext4 jbd2 crc16 ext3 jbd 
vhost_net macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace 
cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table 
cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter ip6_tables 
ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state iptable_filter 
ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 
nf_defrag_ipv4 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath 
nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer snd 
soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm pci_hotplug 
psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev ghes serio_raw 
processor thermal_sys hed button xfs exportfs dm_mod sg sr_mod cdrom 
usbhid hid usb_storage ses sd_mod enclosure lpfc scsi_transport_fc 
ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2 ehci_hcd [last unloaded: 
scsi_wait_sca
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106557]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106581] 
Pid: 10, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17 
Dell Inc. PowerEdge M605/0K543T
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106644] 
RIP: 0010:[<ffffffff8105fa4b>]  [<ffffffff8105fa4b>] 
default_send_IPI_mask_sequence_phys+0xbb/0xe0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106706] 
RSP: 0018:ffff88045fcb1d50  EFLAGS: 00000046
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106735] 
RAX: ffff88087fc00000 RBX: 0000000000000002 RCX: 0000000000000008
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106767] 
RDX: 0000000000000001 RSI: 0000000000000020 RDI: 0000000000000020
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106799] 
RBP: ffff88045fcb1d90 R08: ffffffff8159faf0 R09: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106831] 
R10: 0000000000000000 R11: 0000000000000006 R12: 000000000000c620
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106863] 
R13: ffffffff8159faf0 R14: 0000000000000400 R15: 0000000000000286
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106896] 
FS:  00007f66f7754720(0000) GS:ffff88007f800000(0000) knlGS:0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106944] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106973] 
CR2: 0000000000e64048 CR3: 000000045ea45000 CR4: 00000000000006f0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.107005] 
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.107037] 
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.107070] 
Process kworker/0:1 (pid: 10, threadinfo ffff88045fcb0000, task 
ffff88045fcaae70)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.107117] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.107138]  
ffffffff00000000 0000000000000000 ffff88045fcb1d70 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
6b6b6b6b6b6b6b6b ffff88007f814e00 ffffffff81008ba0 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
ffff88045fcb1da0 ffffffff81062c12 ffff88045fcb1dc0 ffffffff8105fb3c
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff8105fb3c>] arch_trigger_all_cpu_backtrace+0x3c/0x70
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810a971b>] process_one_work+0x11b/0x450
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810a9e97>] worker_thread+0x157/0x410
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81078519>] ? __wake_up_common+0x59/0x90
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810a9d40>] ? worker_thread+0x0/0x410
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810ad8f6>] kthread+0x96/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810ad860>] ? kthread+0x0/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011] 
Code: 83 fb 02 44 89 f0 0f 45 c3 89 04 25 00 c3 5f ff eb 9e 4c 89 ff 57 
9d 66 66 90 66 90 48 83 c4 18 5b 41 5c 41 5d 41 5e 41 5f c9 c3 <48> 8b 
05 4e fb 53 00 48 89 55 c8 89 4d c0 ff 90 58 01 00 00 48
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff8105fb3c>] arch_trigger_all_cpu_backtrace+0x3c/0x70
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810a971b>] process_one_work+0x11b/0x450
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810a9e97>] worker_thread+0x157/0x410
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81078519>] ? __wake_up_common+0x59/0x90
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810a9d40>] ? worker_thread+0x0/0x410
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810ad8f6>] kthread+0x96/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810ad860>] ? kthread+0x0/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011] 
Pid: 10, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011] 
<NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff813be5f0>] nmi+0x20/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff8105fa4b>] ? default_send_IPI_mask_sequence_phys+0xbb/0xe0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011] 
<<EOE>>  [<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff8105fb3c>] arch_trigger_all_cpu_backtrace+0x3c/0x70
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810a971b>] process_one_work+0x11b/0x450
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810a9e97>] worker_thread+0x157/0x410
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81078519>] ? __wake_up_common+0x59/0x90
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810a9d40>] ? worker_thread+0x0/0x410
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810ad8f6>] kthread+0x96/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff810ad860>] ? kthread+0x0/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108011]  
[<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110243] 
NMI backtrace for cpu 3
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110272] CPU 3
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110280] 
Modules linked in: btrfs zlib_deflate crc32c libcrc32c ufs qnx4 hfsplus 
hfs minix ntfs vfat msdos fat jfs reiserfs ext4 jbd2 crc16 ext3 jbd 
vhost_net macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace 
cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table 
cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter ip6_tables 
ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state iptable_filter 
ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 
nf_defrag_ipv4 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath 
nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer snd 
soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm pci_hotplug 
psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev ghes serio_raw 
processor thermal_sys hed button xfs exportfs dm_mod sg sr_mod cdrom 
usbhid hid usb_storage ses sd_mod enclosure lpfc scsi_transport_fc 
ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2 ehci_hcd [last unloaded: 
scsi_wait_sca
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110882]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110906] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17 
Dell Inc. PowerEdge M605/0K543T
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110970] 
RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>] 
native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111030] 
RSP: 0018:ffff88045fcd3ea8  EFLAGS: 00000246
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111059] 
RAX: 0000000000000000 RBX: 0000000000000003 RCX: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111091] 
RDX: 0000000000000000 RSI: ffff88045fcd3ee4 RDI: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111123] 
RBP: ffff88045fcd3ea8 R08: 0000000000000000 R09: 0000000000000001
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111155] 
R10: 0000000000000000 R11: 0000000000000001 R12: ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111186] 
R13: 0000000000000003 R14: 0000000000000000 R15: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111220] 
FS:  00007fb1eafc6740(0000) GS:ffff88087fc40000(0000) knlGS:0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111268] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111297] 
CR2: 00007ff12a981de0 CR3: 000000045569f000 CR4: 00000000000006e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111329] 
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111362] 
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111395] 
Process kworker/0:1 (pid: 0, threadinfo ffff88045fcd2000, task 
ffff88045fcca820)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111442] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111463]  
ffff88045fcd3ec8 ffffffff8104a016 ffff88045fcd3ee4 ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111515]  
ffff88045fcd3ef8 ffffffff8104a168 ffff88045fcd3ee8 00000000810b3255
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111566]  
ffff88045fcd2010 ffffffff8159faf0 ffff88045fcd3f28 ffffffff8104003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111618] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111648]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111680]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111712]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111745]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111774] 
Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84 00 00 00 00 00 55 
48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <c9> c3 
0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66 0f 1f 84
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111982] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112007]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112038]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112069]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112099]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112131] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112176] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112198] 
<NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112238]  
[<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112272]  
[<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112303]  
[<ffffffff813be5f0>] nmi+0x20/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112332]  
[<ffffffff81066716>] ? native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112361] 
<<EOE>>  [<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112399]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112430]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112460]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112024] 
NMI backtrace for cpu 2
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112024] CPU 2
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112024] 
Modules linked in: btrfs zlib_deflate crc32c libcrc32c ufs qnx4 hfsplus 
hfs minix ntfs vfat msdos fat jfs reiserfs ext4 jbd2 crc16 ext3 jbd 
vhost_net macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace 
cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table 
cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter ip6_tables 
ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state iptable_filter 
ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 
nf_defrag_ipv4 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath 
nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer snd 
soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm pci_hotplug 
psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev ghes serio_raw 
processor thermal_sys hed button xfs exportfs dm_mod sg sr_mod cdrom 
usbhid hid usb_storage ses sd_mod enclosure lpfc scsi_transport_fc 
ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2 ehci_hcd [last unloaded: 
scsi_wait_sca
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17 
Dell Inc. PowerEdge M605/0K543T
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>] 
native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
RSP: 0018:ffff88045fcc5ea8  EFLAGS: 00000246
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
RAX: 0000000000000000 RBX: 0000000000000002 RCX: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
RDX: 0000000000000000 RSI: ffff88045fcc5ee4 RDI: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
RBP: ffff88045fcc5ea8 R08: 0000000000000000 R09: 0000000000000001
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
R10: 0000000000000000 R11: 0000000000000000 R12: ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
R13: 0000000000000002 R14: 0000000000000000 R15: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
FS:  00007f66f7754720(0000) GS:ffff88007f840000(0000) knlGS:0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
CR2: 00007f241ad1f0b8 CR3: 000000045ea45000 CR4: 00000000000006f0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
Process kworker/0:1 (pid: 0, threadinfo ffff88045fcc4000, task 
ffff88045fcb87e0)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
ffff88045fcc5ec8 ffffffff8104a016 ffff88045fcc5ee4 ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
ffff88045fcc5ef8 ffffffff8104a168 ffff88045fcc5ee8 00000000810b3255
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
ffff88045fcc4010 ffffffff8159faf0 ffff88045fcc5f28 ffffffff8104003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84 00 00 00 00 00 55 
48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <c9> c3 
0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66 0f 1f 84
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
<NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff813be5f0>] nmi+0x20/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff81066716>] ? native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] 
<<EOE>>  [<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
NMI backtrace for cpu 1
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] CPU 1
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
Modules linked in: btrfs zlib_deflate crc32c libcrc32c ufs qnx4 hfsplus 
hfs minix ntfs vfat msdos fat jfs reiserfs ext4 jbd2 crc16 ext3 jbd 
vhost_net macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace 
cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table 
cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter ip6_tables 
ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state iptable_filter 
ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 
nf_defrag_ipv4 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath 
nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer snd 
soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm pci_hotplug 
psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev ghes serio_raw 
processor thermal_sys hed button xfs exportfs dm_mod sg sr_mod cdrom 
usbhid hid usb_storage ses sd_mod enclosure lpfc scsi_transport_fc 
ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2 ehci_hcd [last unloaded: 
scsi_wait_sca
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
Pid: 0, comm: kworker/0:0 Not tainted 2.6.37.2-patchjp-110308-c+ #17 
Dell Inc. PowerEdge M605/0K543T
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>] 
native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
RSP: 0018:ffff88045fcb3ea8  EFLAGS: 00000246
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
RDX: 0000000000000000 RSI: ffff88045fcb3ee4 RDI: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
RBP: ffff88045fcb3ea8 R08: 0000000000000000 R09: ffff88087fc0e408
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
R10: 000028ce70db0d2f R11: 0000000000000001 R12: ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
FS:  00007fb8e1893710(0000) GS:ffff88087fc00000(0000) knlGS:0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
CR2: 00007f241aca71a0 CR3: 000000045ed50000 CR4: 00000000000006e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
Process kworker/0:0 (pid: 0, threadinfo ffff88045fcb2000, task 
ffff88045fcaa7a0)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
ffff88045fcb3ec8 ffffffff8104a016 ffff88045fcb3ee4 ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
ffff88045fcb3ef8 ffffffff8104a168 ffff88045fcb3ee8 00000000810b3255
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
ffff88045fcb2010 ffffffff8159faf0 ffff88045fcb3f28 ffffffff8104003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84 00 00 00 00 00 55 
48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <c9> c3 
0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66 0f 1f 84
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
<NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
[<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
[<ffffffff813be5f0>] nmi+0x20/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] 
<<EOE>>  [<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896] 
Modules linked in: btrfs zlib_deflate crc32c libcrc32c ufs qnx4 hfsplus 
hfs minix ntfs vfat msdos fat jfs reiserfs ext4 jbd2 crc16 ext3 jbd 
vhost_net macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace 
cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table 
cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter ip6_tables 
ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state iptable_filter 
ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 
nf_defrag_ipv4 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath 
nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer snd 
soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm pci_hotplug 
psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev ghes serio_raw 
processor thermal_sys hed button xfs exportfs dm_mod sg sr_mod cdrom 
usbhid hid usb_storage ses sd_mod enclosure lpfc scsi_transport_fc 
ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2 ehci_hcd [last unloaded: 
scsi_wait_sca
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896] 
RAX: 0000000000000000 RBX: 0000000000000005 RCX: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896] 
RDX: 0000000000000000 RSI: ffff88045fd11ee4 RDI: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896]  
ffff88045fd11ef8 ffffffff8104a168 ffff88045fd11ee8 00000000810b3255
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896]  
ffff88045fd10010 ffffffff8159faf0 ffff88045fd11f28 ffffffff8104003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110896] 
Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84 00 00 00 00 00 55 
48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <c9> c3 
0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66 0f 1f 84
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.119695] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.119695]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.119695]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.119695]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.119985]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.119985] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.119985] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.119985] 
<NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120119]  
[<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120164]  
[<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018] 
CR2: 00007f241ad1f0b8 CR3: 000000045ed50000 CR4: 00000000000006e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018] 
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018] 
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018] 
Process kworker/0:1 (pid: 0, threadinfo ffff88045fd00000, task 
ffff88045fcd8860)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018]  
ffff88045fd01ec8 ffffffff8104a016 ffff88045fd01ee4 ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018]  
ffff88045fd01ef8 ffffffff8104a168 ffff88045fd01ee8 00000000810b3255
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018]  
ffff88045fd00010 ffffffff8159faf0 ffff88045fd01f28 ffffffff8104003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018]  
[<ffffffff813be5f0>] nmi+0x20/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.123585] 
NMI backtrace for cpu 7
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.124502] 
RAX: 0000000000000000 RBX: 0000000000000007 RCX: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.125007] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.125206] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] 
Modules linked in: btrfs zlib_deflate crc32c libcrc32c ufs qnx4 hfsplus 
hfs minix ntfs vfat msdos fat jfs reiserfs ext4 jbd2 crc16 ext3 jbd 
vhost_net macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace 
cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table 
cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter ip6_tables 
ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state iptable_filter 
ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 
nf_defrag_ipv4 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath 
nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer snd 
soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm pci_hotplug 
psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev ghes serio_raw 
processor thermal_sys hed button xfs exportfs dm_mod sg sr_mod cdrom 
usbhid hid usb_storage ses sd_mod enclosure lpfc scsi_transport_fc 
ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2 ehci_hcd [last unloaded: 
scsi_wait_sca
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17 
Dell Inc. PowerEdge M605/0K543T
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] 
RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>] 
native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] 
RSP: 0018:ffff88045fd23ea8  EFLAGS: 00000246
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] 
RAX: 0000000000000000 RBX: 0000000000000006 RCX: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] 
RDX: 0000000000000000 RSI: ffff88045fd23ee4 RDI: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] 
RBP: ffff88045fd23ea8 R08: 0000000000000000 R09: ffff88007f8ce408
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] 
R10: 0000000000000000 R11: 0000000000000001 R12: ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]  
ffff88045fd23ec8 ffffffff8104a016 ffff88045fd23ee4 ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]  
[<ffffffff813be5f0>] nmi+0x20/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
Modules linked in: btrfs zlib_deflate crc32c libcrc32c ufs qnx4 hfsplus 
hfs minix ntfs vfat msdos fat jfs reiserfs ext4 jbd2 crc16 ext3 jbd 
vhost_net macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace 
cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table 
cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter ip6_tables 
ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state iptable_filter 
ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 
nf_defrag_ipv4 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath 
nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer snd 
soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm pci_hotplug 
psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev ghes serio_raw 
processor thermal_sys hed button xfs exportfs dm_mod sg sr_mod cdrom 
usbhid hid usb_storage ses sd_mod enclosure lpfc scsi_transport_fc 
ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2 ehci_hcd [last unloaded: 
scsi_wait_sca
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
R10: 000028ce766a74a3 R11: 0000000000000001 R12: ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
R13: 0000000000000009 R14: 0000000000000000 R15: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
FS:  00007fa0cb316710(0000) GS:ffff88087fd00000(0000) knlGS:0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
CR2: 0000000000e64048 CR3: 000000045ea45000 CR4: 00000000000006e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
Process kworker/0:1 (pid: 0, threadinfo ffff88045fd6e000, task 
ffff88045fd669a0)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
ffff88045fd6fec8 ffffffff8104a016 ffff88045fd6fee4 ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
ffff88045fd6fef8 ffffffff8104a168 ffff88045fd6fee8 00000000810b3255
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
ffff88045fd6e010 ffffffff8159faf0 ffff88045fd6ff28 ffffffff8104003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84 00 00 00 00 00 55 
48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <c9> c3 
0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66 0f 1f 84
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
<NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff813be5f0>] nmi+0x20/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff81066716>] ? native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] 
<<EOE>>  [<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
NMI backtrace for cpu 11
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
CPU 11
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
Modules linked in: btrfs zlib_deflate crc32c libcrc32c ufs qnx4 hfsplus 
hfs minix ntfs vfat msdos fat jfs reiserfs ext4 jbd2 crc16 ext3 jbd 
vhost_net macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace 
cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table 
cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter ip6_tables 
ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state iptable_filter 
ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 
nf_defrag_ipv4 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath 
nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer snd 
soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm pci_hotplug 
psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev ghes serio_raw 
processor thermal_sys hed button xfs exportfs dm_mod sg sr_mod cdrom 
usbhid hid usb_storage ses sd_mod enclosure lpfc scsi_transport_fc 
ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2 ehci_hcd [last unloaded: 
scsi_wait_sca
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17 
Dell Inc. PowerEdge M605/0K543T
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>] 
native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
RSP: 0018:ffff88045fd8fea8  EFLAGS: 00000246
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
RAX: 0000000000000000 RBX: 000000000000000b RCX: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
RDX: 0000000000000000 RSI: ffff88045fd8fee4 RDI: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
RBP: ffff88045fd8fea8 R08: 0000000000000000 R09: ffff88087fd4e408
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
R10: 000028ce71c3578e R11: 0000000000000001 R12: ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
R13: 000000000000000b R14: 0000000000000000 R15: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
FS:  00007fa0ce156740(0000) GS:ffff88087fd40000(0000) knlGS:0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
CR2: 00007f2421c3eae0 CR3: 000000045ea45000 CR4: 00000000000006e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
Process kworker/0:1 (pid: 0, threadinfo ffff88045fd8e000, task 
ffff88045fd86a20)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
ffff88045fd8fec8 ffffffff8104a016 ffff88045fd8fee4 ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
ffff88045fd8fef8 ffffffff8104a168 ffff88045fd8fee8 00000000810b3255
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
ffff88045fd8e010 ffffffff8159faf0 ffff88045fd8ff28 ffffffff8104003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84 00 00 00 00 00 55 
48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <c9> c3 
0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66 0f 1f 84
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
<NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff813be5f0>] nmi+0x20/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff81066716>] ? native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] 
<<EOE>>  [<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
NMI backtrace for cpu 8
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] CPU 8
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
Modules linked in: btrfs zlib_deflate crc32c libcrc32c ufs qnx4 hfsplus 
hfs minix ntfs vfat msdos fat jfs reiserfs ext4 jbd2 crc16 ext3 jbd 
vhost_net macvtap macvlan tun veth powernow_k8 mperf cpufreq_userspace 
cpufreq_stats cpufreq_powersave cpufreq_ondemand freq_table 
cpufreq_conservative fuse xt_physdev ip6t_LOG ip6table_filter ip6_tables 
ipt_LOG xt_multiport xt_limit xt_tcpudp xt_state iptable_filter 
ip_tables x_tables nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 
nf_defrag_ipv4 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath 
nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer snd 
soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm pci_hotplug 
psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev ghes serio_raw 
processor thermal_sys hed button xfs exportfs dm_mod sg sr_mod cdrom 
usbhid hid usb_storage ses sd_mod enclosure lpfc scsi_transport_fc 
ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2 ehci_hcd [last unloaded: 
scsi_wait_sca
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17 
Dell Inc. PowerEdge M605/0K543T
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>] 
native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
RSP: 0018:ffff88045fd63ea8  EFLAGS: 00000246
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
RAX: 0000000000000000 RBX: 0000000000000008 RCX: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
RDX: 0000000000000000 RSI: ffff88045fd63ee4 RDI: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
RBP: ffff88045fd63ea8 R08: 0000000000000000 R09: ffff88007f90e408
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
R10: 0000000000000000 R11: 0000000000000001 R12: ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
R13: 0000000000000008 R14: 0000000000000000 R15: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
FS:  00007fb8e0891710(0000) GS:ffff88007f900000(0000) knlGS:0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
CR2: 0000000000e63f28 CR3: 000000045ed50000 CR4: 00000000000006e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
Process kworker/0:1 (pid: 0, threadinfo ffff88045fd62000, task 
ffff88045fd34960)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]  
ffff88045fd63ec8 ffffffff8104a016 ffff88045fd63ee4 ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]  
ffff88045fd63ef8 ffffffff8104a168 ffff88045fd63ee8 00000000810b3255
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]  
ffff88045fd62010 ffffffff8159faf0 ffff88045fd63f28
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136088] 
kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136098] 
irqfd_deactivate(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84 00 00 00 00 00 55 
48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48 89 e5 fb f4 <c9> c3 0f
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136661] 
kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136665] 
irqfd_deactivate(irqfd=ffff880810a21e00,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136702] 
irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00,kvm=ffff8804542d0000, 
gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136709] 
remove wq at irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136715] 
kfree at irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 1f 
84 00 00 00
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136910] 
kvm_irqfd_assign(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 00 
00 55 48 89 e5 f4 c9 c3 66 0f 1f 84
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]  
[<ffffffff8104a168>] c1e_idle+0x58/0x120
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136975] 
Pid: 0, comm: kworker/0:1 Not tainted 2.6.37.2-patchjp-110308-c+ #17
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136975] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136975] 
<NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136975]  
[<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136975]  
[<ffffffff813be5f0>] nmi+0x20/0x30
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.136975]  
[<ffffffff81066716>] ? native_safe_halt+0x6/0x10
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] 
FS:  00007f2787814700(0000) GS:ffff88007f940000(0000) knlGS:0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] 
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] 
CR2: 0000000000e63f28 CR3: 000000045ea45000 CR4: 00000000000006e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] 
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] 
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] 
Process kworker/0:1 (pid: 0, threadinfo ffff88045fd80000, task 
ffff88045fd769e0)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] Stack:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004]  
ffff88045fd81ec8 ffffffff8104a016 ffff88045fd81ee4 ffffffff8159faf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004]  
ffff88045fd81ef8 ffffffff8104a168 ffff88045fd81ee8 00000000810b3255
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004]  
ffff88045fd80010 ffffffff8159faf0 ffff88045fd81f28 ffffffff8104003b
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] 
Call Trace:
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004]  
[<ffffffff8104a016>] default_idle+0x46/0xa0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004]  
[<ffffffff8104003b>] cpu_idle+0x6b/0xf0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004]  
[<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004]  
[<ffffffff813b7247>] start_secondary+0x1b9/0x1be
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.148658] 
kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.148687] 
irqfd_deactivate(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.148759] 
irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0,kvm=ffff8804542d0000, 
gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.148814] 
remove wq at irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.148862] 
kfree at irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.149086] 
kvm_irqfd_assign(irqfd=ffff88081a190b78,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.149379] 
kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=48)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.149416] 
irqfd_deactivate(irqfd=ffff88045efd3740,kvm=ffff8804542d0000, gsi=48)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.149540] 
irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740,kvm=ffff8804542d0000, 
gsi=48)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.149594] 
remove wq at irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.149643] 
kfree at irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.149922] 
kvm_irqfd_assign(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000, gsi=48)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.171869] 
kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.171907] 
irqfd_deactivate(irqfd=ffff88081a190b78,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.171989] 
irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78,kvm=ffff8804542d0000, 
gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.172111] 
remove wq at irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.172160] 
kfree at irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.172493] 
kvm_irqfd_assign(irqfd=ffff88083b062308,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.172672] 
kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.172710] 
irqfd_deactivate(irqfd=ffff88083b062308,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.172782] 
irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308,kvm=ffff8804542d0000, 
gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.172836] 
remove wq at irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.172884] 
kfree at irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.173074] 
kvm_irqfd_assign(irqfd=ffff88081a190230,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.175303] 
kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.175339] 
irqfd_deactivate(irqfd=ffff88081a190230,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.175466] 
irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230,kvm=ffff8804542d0000, 
gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.175521] 
remove wq at irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.175569] 
kfree at irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.175769] 
kvm_irqfd_assign(irqfd=ffff88045eabb668,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.176002] 
kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.176058] 
irqfd_deactivate(irqfd=ffff88045eabb668,kvm=ffff8804542d0000, gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.176122] 
irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668,kvm=ffff8804542d0000, 
gsi=24)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.176177] 
remove wq at irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.176225] 
kfree at irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668)
Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.176427] 
kvm_irqfd_assign(irqfd=ffff88045ed96c50,kvm=ffff8804542d0000, gsi=24


You can find all the trace at the following adress:
http://filex.univ-nantes.fr/get?k=R94kna5sckVmdvCoKsn

It's a tar.gz of seven file, from 100k to 200k each ;)

Again, thanks a lot for the time you spent on this.

Regards.

-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-10  8:42                                         ` Jean-Philippe Menil
@ 2011-03-15 14:32                                           ` Michael S. Tsirkin
  2011-03-15 14:58                                             ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-03-15 14:32 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: netdev, kvm, virtualization

On Thu, Mar 10, 2011 at 09:42:28AM +0100, Jean-Philippe Menil wrote:
> Le 09/03/2011 14:59, Michael S. Tsirkin a écrit :
> >On Wed, Mar 09, 2011 at 02:12:58PM +0100, Jean-Philippe Menil wrote:
> >>Le 09/03/2011 14:00, Michael S. Tsirkin a écrit :
> >>>On Wed, Mar 09, 2011 at 01:28:43PM +0100, Jean-Philippe Menil wrote:
> >>>>Le 08/03/2011 12:13, Michael S. Tsirkin a écrit :
> >>>>>On Fri, Mar 04, 2011 at 10:39:05AM +0100, Jean-Philippe Menil wrote:
> >>>>>>Yes, it's a 2.6.37.2 kernel.
> >>>>>OK, here's a debugging patch.
> >>>>>Please run with slab debugging as previously until you see
> >>>>>'eventfd bug detected!' in dmesg or until there is a crash.
> >>>>>It might be also useful to enable timestampts on printk with
> >>>>>  Symbol: PRINTK_TIME [=y]
> >>>>>   │ Type  : boolean
> >>>>>   │ Prompt: Show timing information on printks
> >>>>>
> >>>>>once you see the error, please upload the
> >>>>>full dmesg output somewhere to we can track what
> >>>>>goes on.
> >>>>>
> >>>>>Hopefully there won't be an oops this time which
> >>>>>should make it easier for you to test (no need to
> >>>>>reboot).
> >>>>>
> >>>>>
> >>>>>diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
> >>>>>index c1f1e3c..3cb679b 100644
> >>>>>--- a/virt/kvm/eventfd.c
> >>>>>+++ b/virt/kvm/eventfd.c
> >>>>>@@ -32,6 +32,7 @@
> >>>>>  #include<linux/eventfd.h>
> >>>>>  #include<linux/kernel.h>
> >>>>>  #include<linux/slab.h>
> >>>>>+#include<linux/nmi.h>
> >>>>>
> >>>>>  #include "iodev.h"
> >>>>>
> >>>>>@@ -43,6 +44,8 @@
> >>>>>   * --------------------------------------------------------------------
> >>>>>   */
> >>>>>
> >>>>>+#define KVM_BAD_PTR ((void*)(long)(0x6b6b6b6b6b6b6b6bull))
> >>>>>+
> >>>>>  struct _irqfd {
> >>>>>  	struct kvm               *kvm;
> >>>>>  	struct eventfd_ctx       *eventfd;
> >>>>>@@ -61,6 +64,13 @@ irqfd_inject(struct work_struct *work)
> >>>>>  {
> >>>>>  	struct _irqfd *irqfd = container_of(work, struct _irqfd, inject);
> >>>>>  	struct kvm *kvm = irqfd->kvm;
> >>>>>+	if (kvm == KVM_BAD_PTR) {
> >>>>>+		printk(KERN_ERR "Eventfd bug detected!\n");
> >>>>>+		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
> >>>>>+			work, irqfd, kvm, irqfd->gsi);
> >>>>>+		trigger_all_cpu_backtrace();
> >>>>>+		return;
> >>>>>+	}
> >>>>>
> >>>>>  	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 1);
> >>>>>  	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 0);
> >>>>>@@ -75,6 +85,8 @@ irqfd_shutdown(struct work_struct *work)
> >>>>>  	struct _irqfd *irqfd = container_of(work, struct _irqfd, shutdown);
> >>>>>  	u64 cnt;
> >>>>>
> >>>>>+	printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> >>>>>+	       work, irqfd, irqfd->kvm, irqfd->gsi);
> >>>>>  	/*
> >>>>>  	 * Synchronize with the wait-queue and unhook ourselves to prevent
> >>>>>  	 * further events.
> >>>>>@@ -91,6 +103,8 @@ irqfd_shutdown(struct work_struct *work)
> >>>>>  	 * It is now safe to release the object's resources
> >>>>>  	 */
> >>>>>  	eventfd_ctx_put(irqfd->eventfd);
> >>>>>+	printk(KERN_ERR "kfree at %s(work=%p,irqfd=%p)\n", __func__,
> >>>>>+	       work, irqfd);
> >>>>>  	kfree(irqfd);
> >>>>>  }
> >>>>>
> >>>>>@@ -111,6 +125,8 @@ static void
> >>>>>  irqfd_deactivate(struct _irqfd *irqfd)
> >>>>>  {
> >>>>>  	BUG_ON(!irqfd_is_active(irqfd));
> >>>>>+	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> >>>>>+	       irqfd, irqfd->kvm, irqfd->gsi);
> >>>>>
> >>>>>  	list_del_init(&irqfd->list);
> >>>>>
> >>>>>@@ -178,6 +194,8 @@ kvm_irqfd_assign(struct kvm *kvm, int fd, int gsi)
> >>>>>
> >>>>>  	irqfd->kvm = kvm;
> >>>>>  	irqfd->gsi = gsi;
> >>>>>+	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
> >>>>>+	       irqfd, kvm, gsi);
> >>>>>  	INIT_LIST_HEAD(&irqfd->list);
> >>>>>  	INIT_WORK(&irqfd->inject, irqfd_inject);
> >>>>>  	INIT_WORK(&irqfd->shutdown, irqfd_shutdown);
> >>>>>@@ -264,6 +282,8 @@ kvm_irqfd_deassign(struct kvm *kvm, int fd, int gsi)
> >>>>>  	struct _irqfd *irqfd, *tmp;
> >>>>>  	struct eventfd_ctx *eventfd;
> >>>>>
> >>>>>+	printk(KERN_ERR "%s(kvm=%p, gsi=%d)\n", __func__,
> >>>>>+	       kvm, gsi);
> >>>>>  	eventfd = eventfd_ctx_fdget(fd);
> >>>>>  	if (IS_ERR(eventfd))
> >>>>>  		return PTR_ERR(eventfd);
> >>>>>@@ -305,6 +325,7 @@ void
> >>>>>  kvm_irqfd_release(struct kvm *kvm)
> >>>>>  {
> >>>>>  	struct _irqfd *irqfd, *tmp;
> >>>>>+	printk(KERN_ERR "%s(kvm=%p)\n", __func__, kvm);
> >>>>>
> >>>>>  	spin_lock_irq(&kvm->irqfds.lock);
> >>>>>
> >>>>>--
> >>>>>To unsubscribe from this list: send the line "unsubscribe netdev" in
> >>>>>the body of a message to majordomo@vger.kernel.org
> >>>>>More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >>>>Hi,
> >>>>
> >>>>I boot the host with the patched kernel yesterday.
> >>>>No crach until now, but two "Eventfd bug detected!" in the log at
> >>>>"Mar  9 02:04:31" and "Mar  9 02:15:17"
> >>>>You can find part of the log at the following adress:
> >>>>http://filex.univ-nantes.fr/get?k=jL4Fe7yfSMN57toAH7V
> >>>>
> >>>>It a split file of the kern.log (1,4G), so if you need another part
> >>>>of the log, let me know.
> >>>>
> >>>>Thanks for all.
> >>>>
> >>>>Regards.
> >>>Downloading, it's big :)
> >>>What about some 1000 lines before and after Eventfd bug detected! line?
> >>>--
> >>>To unsubscribe from this list: send the line "unsubscribe kvm" in
> >>>the body of a message to majordomo@vger.kernel.org
> >>>More majordomo info at  http://vger.kernel.org/majordomo-info.html
> >>Yes, sorry about that.
> >>I could have split my log into a smaller file.
> >>
> >>I was a little afraid of not transmit enough informations, and i was
> >>a bit wide.
> >>I hope you can find usefull trace anyway.
> >>
> >>Regards.
> >
> >OK, use after free.
> >
> >
> >Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.593681]
> >kvm_irqfd_assign(irqfd=ffff88045e8d6230,kvm=ffff88085151c000, gsi=26)
> >Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605359]
> >kvm_irqfd_deassign(kvm=ffff88085151c000, gsi=26)
> >Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605388]
> >irqfd_deactivate(irqfd=ffff88045e8d6230,kvm=ffff88085151c000, gsi=26)
> >Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605461]
> >irqfd_shutdown(work=ffff88045e8d62b0,irqfd=ffff88045e8d6230,kvm=ffff88085151c000,
> >gsi=26)
> >Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605509]
> >kfree at irqfd_shutdown(work=ffff88045e8d62b0,irqfd=ffff88045e8d6230)
> >Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605588]
> >Eventfd bug detected!
> >Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605612]
> >irqfd_inject(work=ffff88045e8d6290,irqfd=ffff88045e8d6230,kvm=6b6b6b6b6b6b6b6b,gsi=1802201963)
> >
> >
> >and 1802201963 is also 6b6b6b6b.
> >
> >
> >I suspect that somehow, we get an event from eventfd even
> >though we did eventfd_ctx_remove_wait_queue.
> >Could you please try the following patch on top?
> >When you see Eventfd bug or Wakeup bug, paste some
> >last lines.
> >For the full log file - better compress with xz.
> >
> >
> >diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
> >index 3cb679b..63aeba5 100644
> >--- a/virt/kvm/eventfd.c
> >+++ b/virt/kvm/eventfd.c
> >@@ -92,6 +92,8 @@ irqfd_shutdown(struct work_struct *work)
> >  	 * further events.
> >  	 */
> >  	eventfd_ctx_remove_wait_queue(irqfd->eventfd,&irqfd->wait,&cnt);
> >+	printk(KERN_ERR "remove wq at %s(work=%p,irqfd=%p)\n", __func__,
> >+	       work, irqfd);
> >
> >  	/*
> >  	 * We know no new events will be scheduled at this point, so block
> >@@ -142,6 +144,13 @@ irqfd_wakeup(wait_queue_t *wait, unsigned mode, int sync, void *key)
> >  	struct _irqfd *irqfd = container_of(wait, struct _irqfd, wait);
> >  	unsigned long flags = (unsigned long)key;
> >
> >+	if (irqfd->kvm == KVM_BAD_PTR) {
> >+		printk(KERN_ERR "Wakeup bug detected! flags 0x%lx\n", flags);
> >+		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
> >+			&irqfd->inject, irqfd, irqfd->kvm, irqfd->gsi);
> >+		trigger_all_cpu_backtrace();
> >+		return 0;
> >+	}
> >  	if (flags&  POLLIN)
> >  		/* An event has been signaled, inject an interrupt */
> >  		schedule_work(&irqfd->inject);
> >@@ -153,6 +162,9 @@ irqfd_wakeup(wait_queue_t *wait, unsigned mode, int sync, void *key)
> >
> >  		spin_lock_irqsave(&kvm->irqfds.lock, flags);
> >
> >+		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d,active=%d)\n", __func__,
> >+			&irqfd->inject, irqfd, irqfd->kvm, irqfd->gsi,
> >+			irqfd_is_active(irqfd));
> >  		/*
> >  		 * We must check if someone deactivated the irqfd before
> >  		 * we could acquire the irqfds.lock since the item is
> >
> Hi,
> 
> I noted seven "Eventfd bug detected" events during the night, and
> only one Wakeup event:
> 
> fifth.ah:Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.105868] Eventfd bug detected!
> first.ad:Mar 10 01:08:15 ayrshire.u06.univ-nantes.prive kernel:
> [34729.771260] Eventfd bug detected!
> fourth.ad:Mar 10 02:54:41 ayrshire.u06.univ-nantes.prive kernel:
> [41115.140873] Eventfd bug detected!
> second.ab:Mar 10 02:41:55 ayrshire.u06.univ-nantes.prive kernel:
> [40348.967192] Eventfd bug detected!
> seventh.ab:Mar 10 07:52:29 ayrshire.u06.univ-nantes.prive kernel:
> [58983.145646] Eventfd bug detected!
> sixth.ab:Mar 10 05:19:54 ayrshire.u06.univ-nantes.prive kernel:
> [49828.785558] Eventfd bug detected!
> third.ae:Mar 10 02:54:07 ayrshire.u06.univ-nantes.prive kernel:
> [41081.638633] Eventfd bug detected!
> 
> grep -i wakeup *
> seventh.ab:Mar 10 07:52:29 ayrshire.u06.univ-nantes.prive kernel:
> [58983.154161]  [<ffffffffa02cbf96>] vhost_poll_wakeup+0x16/0x20
> [vhost_net
> 
> 
> Here is a trace, for the thirst event:
> 
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.101747]
> irqfd_deactivate(irqfd=ffff88042e0b5e00,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.101873] irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.101928] remove wq at
> irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.101990] kfree at
> irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.102381]
> kvm_irqfd_assign(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.103796] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.103833]
> irqfd_deactivate(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.103904] irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.103958] remove wq at
> irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.104023] kfree at
> irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.104311]
> kvm_irqfd_assign(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.104511] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.104549]
> irqfd_deactivate(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.104614] irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.104667] remove wq at
> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.104715] kfree at
> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.104911]
> kvm_irqfd_assign(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.105868] Eventfd bug detected!
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.105901] irqfd_inject(work=ffff88042e0b5e60,irqfd=ffff88042e0b5e00,kvm=6b6b6b6b6b6b6b6b,gsi=1802201963)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.105951] sending NMI to all CPUs:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.105961] NMI backtrace for cpu 0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.105986] CPU 0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.105992] Modules linked in: btrfs zlib_deflate crc32c
> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
> xt_tcpudp xt_state iptable_filter ip_tables x_tables
> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
> ehci_hcd [last unloaded: scsi_wait_sca
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106557]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106581] Pid: 10, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106644] RIP: 0010:[<ffffffff8105fa4b>]  [<ffffffff8105fa4b>]
> default_send_IPI_mask_sequence_phys+0xbb/0xe0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106706] RSP: 0018:ffff88045fcb1d50  EFLAGS: 00000046
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106735] RAX: ffff88087fc00000 RBX: 0000000000000002 RCX:
> 0000000000000008
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106767] RDX: 0000000000000001 RSI: 0000000000000020 RDI:
> 0000000000000020
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106799] RBP: ffff88045fcb1d90 R08: ffffffff8159faf0 R09:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106831] R10: 0000000000000000 R11: 0000000000000006 R12:
> 000000000000c620
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106863] R13: ffffffff8159faf0 R14: 0000000000000400 R15:
> 0000000000000286
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106896] FS:  00007f66f7754720(0000) GS:ffff88007f800000(0000)
> knlGS:0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106944] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.106973] CR2: 0000000000e64048 CR3: 000000045ea45000 CR4:
> 00000000000006f0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.107005] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.107037] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.107070] Process kworker/0:1 (pid: 10, threadinfo
> ffff88045fcb0000, task ffff88045fcaae70)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.107117] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.107138]  ffffffff00000000 0000000000000000 ffff88045fcb1d70
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  6b6b6b6b6b6b6b6b ffff88007f814e00 ffffffff81008ba0
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  ffff88045fcb1da0 ffffffff81062c12 ffff88045fcb1dc0
> ffffffff8105fb3c
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff8105fb3c>]
> arch_trigger_all_cpu_backtrace+0x3c/0x70
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810a971b>] process_one_work+0x11b/0x450
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810a9e97>] worker_thread+0x157/0x410
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81078519>] ? __wake_up_common+0x59/0x90
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810a9d40>] ? worker_thread+0x0/0x410
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810ad8f6>] kthread+0x96/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810ad860>] ? kthread+0x0/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011] Code: 83 fb 02 44 89 f0 0f 45 c3 89 04 25 00 c3 5f ff
> eb 9e 4c 89 ff 57 9d 66 66 90 66 90 48 83 c4 18 5b 41 5c 41 5d 41 5e
> 41 5f c9 c3 <48> 8b 05 4e fb 53 00 48 89 55 c8 89 4d c0 ff 90 58 01
> 00 00 48
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff8105fb3c>]
> arch_trigger_all_cpu_backtrace+0x3c/0x70
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810a971b>] process_one_work+0x11b/0x450
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810a9e97>] worker_thread+0x157/0x410
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81078519>] ? __wake_up_common+0x59/0x90
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810a9d40>] ? worker_thread+0x0/0x410
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810ad8f6>] kthread+0x96/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810ad860>] ? kthread+0x0/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011] Pid: 10, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011] <NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff813be5f0>] nmi+0x20/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff8105fa4b>] ?
> default_send_IPI_mask_sequence_phys+0xbb/0xe0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011] <<EOE>>  [<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff8105fb3c>]
> arch_trigger_all_cpu_backtrace+0x3c/0x70
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810a971b>] process_one_work+0x11b/0x450
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810a9e97>] worker_thread+0x157/0x410
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81078519>] ? __wake_up_common+0x59/0x90
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810a9d40>] ? worker_thread+0x0/0x410
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810ad8f6>] kthread+0x96/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff810ad860>] ? kthread+0x0/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108011]  [<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110243] NMI backtrace for cpu 3
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110272] CPU 3
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110280] Modules linked in: btrfs zlib_deflate crc32c
> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
> xt_tcpudp xt_state iptable_filter ip_tables x_tables
> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
> ehci_hcd [last unloaded: scsi_wait_sca
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110882]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110906] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110970] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
> native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111030] RSP: 0018:ffff88045fcd3ea8  EFLAGS: 00000246
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111059] RAX: 0000000000000000 RBX: 0000000000000003 RCX:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111091] RDX: 0000000000000000 RSI: ffff88045fcd3ee4 RDI:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111123] RBP: ffff88045fcd3ea8 R08: 0000000000000000 R09:
> 0000000000000001
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111155] R10: 0000000000000000 R11: 0000000000000001 R12:
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111186] R13: 0000000000000003 R14: 0000000000000000 R15:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111220] FS:  00007fb1eafc6740(0000) GS:ffff88087fc40000(0000)
> knlGS:0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111268] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111297] CR2: 00007ff12a981de0 CR3: 000000045569f000 CR4:
> 00000000000006e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111329] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111362] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111395] Process kworker/0:1 (pid: 0, threadinfo
> ffff88045fcd2000, task ffff88045fcca820)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111442] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111463]  ffff88045fcd3ec8 ffffffff8104a016 ffff88045fcd3ee4
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111515]  ffff88045fcd3ef8 ffffffff8104a168 ffff88045fcd3ee8
> 00000000810b3255
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111566]  ffff88045fcd2010 ffffffff8159faf0 ffff88045fcd3f28
> ffffffff8104003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111618] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111648]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111680]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111712]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111745]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111774] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
> 89 e5 fb f4 <c9> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
> 0f 1f 84
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111982] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112007]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112038]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112069]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112099]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112131] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112176] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112198] <NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112238]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112272]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112303]  [<ffffffff813be5f0>] nmi+0x20/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112332]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112361] <<EOE>>  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112399]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112430]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112460]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112024] NMI backtrace for cpu 2
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112024] CPU 2
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112024] Modules linked in: btrfs zlib_deflate crc32c
> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
> xt_tcpudp xt_state iptable_filter ip_tables x_tables
> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
> ehci_hcd [last unloaded: scsi_wait_sca
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
> native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] RSP: 0018:ffff88045fcc5ea8  EFLAGS: 00000246
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] RAX: 0000000000000000 RBX: 0000000000000002 RCX:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] RDX: 0000000000000000 RSI: ffff88045fcc5ee4 RDI:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] RBP: ffff88045fcc5ea8 R08: 0000000000000000 R09:
> 0000000000000001
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] R10: 0000000000000000 R11: 0000000000000000 R12:
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] R13: 0000000000000002 R14: 0000000000000000 R15:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] FS:  00007f66f7754720(0000) GS:ffff88007f840000(0000)
> knlGS:0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] CR2: 00007f241ad1f0b8 CR3: 000000045ea45000 CR4:
> 00000000000006f0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] Process kworker/0:1 (pid: 0, threadinfo
> ffff88045fcc4000, task ffff88045fcb87e0)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  ffff88045fcc5ec8 ffffffff8104a016 ffff88045fcc5ee4
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  ffff88045fcc5ef8 ffffffff8104a168 ffff88045fcc5ee8
> 00000000810b3255
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  ffff88045fcc4010 ffffffff8159faf0 ffff88045fcc5f28
> ffffffff8104003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
> 89 e5 fb f4 <c9> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
> 0f 1f 84
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] <NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff813be5f0>] nmi+0x20/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616] <<EOE>>  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112616]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] NMI backtrace for cpu 1
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] CPU 1
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] Modules linked in: btrfs zlib_deflate crc32c
> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
> xt_tcpudp xt_state iptable_filter ip_tables x_tables
> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
> ehci_hcd [last unloaded: scsi_wait_sca
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] Pid: 0, comm: kworker/0:0 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
> native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] RSP: 0018:ffff88045fcb3ea8  EFLAGS: 00000246
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] RAX: 0000000000000000 RBX: 0000000000000001 RCX:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] RDX: 0000000000000000 RSI: ffff88045fcb3ee4 RDI:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] RBP: ffff88045fcb3ea8 R08: 0000000000000000 R09:
> ffff88087fc0e408
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] R10: 000028ce70db0d2f R11: 0000000000000001 R12:
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] R13: 0000000000000001 R14: 0000000000000000 R15:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] FS:  00007fb8e1893710(0000) GS:ffff88087fc00000(0000)
> knlGS:0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] CR2: 00007f241aca71a0 CR3: 000000045ed50000 CR4:
> 00000000000006e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] Process kworker/0:0 (pid: 0, threadinfo
> ffff88045fcb2000, task ffff88045fcaa7a0)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  ffff88045fcb3ec8 ffffffff8104a016 ffff88045fcb3ee4
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  ffff88045fcb3ef8 ffffffff8104a168 ffff88045fcb3ee8
> 00000000810b3255
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  ffff88045fcb2010 ffffffff8159faf0 ffff88045fcb3f28
> ffffffff8104003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
> 89 e5 fb f4 <c9> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
> 0f 1f 84
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] <NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  [<ffffffff813be5f0>] nmi+0x20/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285] <<EOE>>  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112285]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896] Modules linked in: btrfs zlib_deflate crc32c
> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
> xt_tcpudp xt_state iptable_filter ip_tables x_tables
> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
> ehci_hcd [last unloaded: scsi_wait_sca
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896] RAX: 0000000000000000 RBX: 0000000000000005 RCX:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896] RDX: 0000000000000000 RSI: ffff88045fd11ee4 RDI:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896]  ffff88045fd11ef8 ffffffff8104a168 ffff88045fd11ee8
> 00000000810b3255
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896]  ffff88045fd10010 ffffffff8159faf0 ffff88045fd11f28
> ffffffff8104003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.110896] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
> 89 e5 fb f4 <c9> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
> 0f 1f 84
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.119695] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.119695]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.119695]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.119695]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.119985]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.119985] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.119985] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.119985] <NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120119]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120164]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018] CR2: 00007f241ad1f0b8 CR3: 000000045ed50000 CR4:
> 00000000000006e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018] Process kworker/0:1 (pid: 0, threadinfo
> ffff88045fd00000, task ffff88045fcd8860)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018]  ffff88045fd01ec8 ffffffff8104a016 ffff88045fd01ee4
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018]  ffff88045fd01ef8 ffffffff8104a168 ffff88045fd01ee8
> 00000000810b3255
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018]  ffff88045fd00010 ffffffff8159faf0 ffff88045fd01f28
> ffffffff8104003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018]  [<ffffffff813be5f0>] nmi+0x20/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.112018]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.123585] NMI backtrace for cpu 7
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.124502] RAX: 0000000000000000 RBX: 0000000000000007 RCX:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.125007] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.125206] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015] Modules linked in: btrfs zlib_deflate crc32c
> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
> xt_tcpudp xt_state iptable_filter ip_tables x_tables
> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
> ehci_hcd [last unloaded: scsi_wait_sca
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
> native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015] RSP: 0018:ffff88045fd23ea8  EFLAGS: 00000246
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015] RAX: 0000000000000000 RBX: 0000000000000006 RCX:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015] RDX: 0000000000000000 RSI: ffff88045fd23ee4 RDI:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015] RBP: ffff88045fd23ea8 R08: 0000000000000000 R09:
> ffff88007f8ce408
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015] R10: 0000000000000000 R11: 0000000000000001 R12:
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015]  ffff88045fd23ec8 ffffffff8104a016 ffff88045fd23ee4
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015]  [<ffffffff813be5f0>] nmi+0x20/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108015]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] Modules linked in: btrfs zlib_deflate crc32c
> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
> xt_tcpudp xt_state iptable_filter ip_tables x_tables
> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
> ehci_hcd [last unloaded: scsi_wait_sca
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] R10: 000028ce766a74a3 R11: 0000000000000001 R12:
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] R13: 0000000000000009 R14: 0000000000000000 R15:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] FS:  00007fa0cb316710(0000) GS:ffff88087fd00000(0000)
> knlGS:0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] CR2: 0000000000e64048 CR3: 000000045ea45000 CR4:
> 00000000000006e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] Process kworker/0:1 (pid: 0, threadinfo
> ffff88045fd6e000, task ffff88045fd669a0)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  ffff88045fd6fec8 ffffffff8104a016 ffff88045fd6fee4
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  ffff88045fd6fef8 ffffffff8104a168 ffff88045fd6fee8
> 00000000810b3255
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  ffff88045fd6e010 ffffffff8159faf0 ffff88045fd6ff28
> ffffffff8104003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
> 89 e5 fb f4 <c9> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
> 0f 1f 84
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] <NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff813be5f0>] nmi+0x20/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621] <<EOE>>  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.126621]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] NMI backtrace for cpu 11
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] CPU 11
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] Modules linked in: btrfs zlib_deflate crc32c
> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
> xt_tcpudp xt_state iptable_filter ip_tables x_tables
> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
> ehci_hcd [last unloaded: scsi_wait_sca
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
> native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] RSP: 0018:ffff88045fd8fea8  EFLAGS: 00000246
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] RAX: 0000000000000000 RBX: 000000000000000b RCX:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] RDX: 0000000000000000 RSI: ffff88045fd8fee4 RDI:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] RBP: ffff88045fd8fea8 R08: 0000000000000000 R09:
> ffff88087fd4e408
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] R10: 000028ce71c3578e R11: 0000000000000001 R12:
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] R13: 000000000000000b R14: 0000000000000000 R15:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] FS:  00007fa0ce156740(0000) GS:ffff88087fd40000(0000)
> knlGS:0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] CR2: 00007f2421c3eae0 CR3: 000000045ea45000 CR4:
> 00000000000006e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] Process kworker/0:1 (pid: 0, threadinfo
> ffff88045fd8e000, task ffff88045fd86a20)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  ffff88045fd8fec8 ffffffff8104a016 ffff88045fd8fee4
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  ffff88045fd8fef8 ffffffff8104a168 ffff88045fd8fee8
> 00000000810b3255
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  ffff88045fd8e010 ffffffff8159faf0 ffff88045fd8ff28
> ffffffff8104003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
> 89 e5 fb f4 <c9> c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
> 0f 1f 84
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] <NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff813be5f0>] nmi+0x20/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333] <<EOE>>  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.111333]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] NMI backtrace for cpu 8
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] CPU 8
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] Modules linked in: btrfs zlib_deflate crc32c
> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
> xt_tcpudp xt_state iptable_filter ip_tables x_tables
> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
> ehci_hcd [last unloaded: scsi_wait_sca
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
> native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] RSP: 0018:ffff88045fd63ea8  EFLAGS: 00000246
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] RAX: 0000000000000000 RBX: 0000000000000008 RCX:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] RDX: 0000000000000000 RSI: ffff88045fd63ee4 RDI:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] RBP: ffff88045fd63ea8 R08: 0000000000000000 R09:
> ffff88007f90e408
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] R10: 0000000000000000 R11: 0000000000000001 R12:
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] R13: 0000000000000008 R14: 0000000000000000 R15:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] FS:  00007fb8e0891710(0000) GS:ffff88007f900000(0000)
> knlGS:0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] CR2: 0000000000e63f28 CR3: 000000045ed50000 CR4:
> 00000000000006e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] Process kworker/0:1 (pid: 0, threadinfo
> ffff88045fd62000, task ffff88045fd34960)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010]  ffff88045fd63ec8 ffffffff8104a016 ffff88045fd63ee4
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010]  ffff88045fd63ef8 ffffffff8104a168 ffff88045fd63ee8
> 00000000810b3255
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010]  ffff88045fd62010 ffffffff8159faf0 ffff88045fd63f28
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136088] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136098]
> irqfd_deactivate(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
> 89 e5 fb f4 <c9> c3 0f
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136661] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136665]
> irqfd_deactivate(irqfd=ffff880810a21e00,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136702] irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136709] remove wq at
> irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136715] kfree at
> irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] 1f 84 00 00 00
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136910]
> kvm_irqfd_assign(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] 00 00 55 48 89 e5 f4 c9 c3 66 0f 1f 84
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.108010]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136975] Pid: 0, comm: kworker/0:1 Not tainted
> 2.6.37.2-patchjp-110308-c+ #17
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136975] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136975] <NMI>  [<ffffffff8104a786>] ? show_regs+0x26/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136975]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136975]  [<ffffffff813be5f0>] nmi+0x20/0x30
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.136975]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004] FS:  00007f2787814700(0000) GS:ffff88007f940000(0000)
> knlGS:0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004] CR2: 0000000000e63f28 CR3: 000000045ea45000 CR4:
> 00000000000006e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
> 0000000000000000
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
> 0000000000000400
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004] Process kworker/0:1 (pid: 0, threadinfo
> ffff88045fd80000, task ffff88045fd769e0)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] Stack:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004]  ffff88045fd81ec8 ffffffff8104a016 ffff88045fd81ee4
> ffffffff8159faf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004]  ffff88045fd81ef8 ffffffff8104a168 ffff88045fd81ee8
> 00000000810b3255
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004]  ffff88045fd80010 ffffffff8159faf0 ffff88045fd81f28
> ffffffff8104003b
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004] Call Trace:
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004]  [<ffffffff8104a016>] default_idle+0x46/0xa0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.120004]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.148658] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.148687]
> irqfd_deactivate(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.148759] irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.148814] remove wq at
> irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.148862] kfree at
> irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.149086]
> kvm_irqfd_assign(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.149379] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=48)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.149416]
> irqfd_deactivate(irqfd=ffff88045efd3740,kvm=ffff8804542d0000,
> gsi=48)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.149540] irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740,kvm=ffff8804542d0000,
> gsi=48)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.149594] remove wq at
> irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.149643] kfree at
> irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.149922]
> kvm_irqfd_assign(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
> gsi=48)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.171869] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.171907]
> irqfd_deactivate(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.171989] irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.172111] remove wq at
> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.172160] kfree at
> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.172493]
> kvm_irqfd_assign(irqfd=ffff88083b062308,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.172672] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.172710]
> irqfd_deactivate(irqfd=ffff88083b062308,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.172782] irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.172836] remove wq at
> irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.172884] kfree at
> irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.173074]
> kvm_irqfd_assign(irqfd=ffff88081a190230,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.175303] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.175339]
> irqfd_deactivate(irqfd=ffff88081a190230,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.175466] irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.175521] remove wq at
> irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.175569] kfree at
> irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.175769]
> kvm_irqfd_assign(irqfd=ffff88045eabb668,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.176002] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.176058]
> irqfd_deactivate(irqfd=ffff88045eabb668,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.176122] irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668,kvm=ffff8804542d0000,
> gsi=24)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.176177] remove wq at
> irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.176225] kfree at
> irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668)
> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
> [44867.176427]
> kvm_irqfd_assign(irqfd=ffff88045ed96c50,kvm=ffff8804542d0000, gsi=24
> 
> 
> You can find all the trace at the following adress:
> http://filex.univ-nantes.fr/get?k=R94kna5sckVmdvCoKsn
> 
> It's a tar.gz of seven file, from 100k to 200k each ;)
> 
> Again, thanks a lot for the time you spent on this.
> 
> Regards.

Are you running a preemptible kernel?
Does the following help at all?

diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
index 2ca4535..cdf51c9 100644
--- a/virt/kvm/eventfd.c
+++ b/virt/kvm/eventfd.c
@@ -90,7 +90,7 @@ irqfd_shutdown(struct work_struct *work)
 	 * We know no new events will be scheduled at this point, so block
 	 * until all previously outstanding events have completed
 	 */
-	flush_work(&irqfd->inject);
+	flush_work_sync(&irqfd->inject);
 
 	/*
 	 * It is now safe to release the object's resources

-- 
MST

^ permalink raw reply related	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-15 14:32                                           ` Michael S. Tsirkin
@ 2011-03-15 14:58                                             ` Jean-Philippe Menil
  2011-03-17  8:00                                               ` Jean-Philippe Menil
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-03-15 14:58 UTC (permalink / raw)
  To: Michael S. Tsirkin; +Cc: netdev, kvm, virtualization

Le 15/03/2011 15:32, Michael S. Tsirkin a écrit :
> On Thu, Mar 10, 2011 at 09:42:28AM +0100, Jean-Philippe Menil wrote:
>> Le 09/03/2011 14:59, Michael S. Tsirkin a écrit :
>>> On Wed, Mar 09, 2011 at 02:12:58PM +0100, Jean-Philippe Menil wrote:
>>>> Le 09/03/2011 14:00, Michael S. Tsirkin a écrit :
>>>>> On Wed, Mar 09, 2011 at 01:28:43PM +0100, Jean-Philippe Menil wrote:
>>>>>> Le 08/03/2011 12:13, Michael S. Tsirkin a écrit :
>>>>>>> On Fri, Mar 04, 2011 at 10:39:05AM +0100, Jean-Philippe Menil wrote:
>>>>>>>> Yes, it's a 2.6.37.2 kernel.
>>>>>>> OK, here's a debugging patch.
>>>>>>> Please run with slab debugging as previously until you see
>>>>>>> 'eventfd bug detected!' in dmesg or until there is a crash.
>>>>>>> It might be also useful to enable timestampts on printk with
>>>>>>>   Symbol: PRINTK_TIME [=y]
>>>>>>>    │ Type  : boolean
>>>>>>>    │ Prompt: Show timing information on printks
>>>>>>>
>>>>>>> once you see the error, please upload the
>>>>>>> full dmesg output somewhere to we can track what
>>>>>>> goes on.
>>>>>>>
>>>>>>> Hopefully there won't be an oops this time which
>>>>>>> should make it easier for you to test (no need to
>>>>>>> reboot).
>>>>>>>
>>>>>>>
>>>>>>> diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
>>>>>>> index c1f1e3c..3cb679b 100644
>>>>>>> --- a/virt/kvm/eventfd.c
>>>>>>> +++ b/virt/kvm/eventfd.c
>>>>>>> @@ -32,6 +32,7 @@
>>>>>>>   #include<linux/eventfd.h>
>>>>>>>   #include<linux/kernel.h>
>>>>>>>   #include<linux/slab.h>
>>>>>>> +#include<linux/nmi.h>
>>>>>>>
>>>>>>>   #include "iodev.h"
>>>>>>>
>>>>>>> @@ -43,6 +44,8 @@
>>>>>>>    * --------------------------------------------------------------------
>>>>>>>    */
>>>>>>>
>>>>>>> +#define KVM_BAD_PTR ((void*)(long)(0x6b6b6b6b6b6b6b6bull))
>>>>>>> +
>>>>>>>   struct _irqfd {
>>>>>>>   	struct kvm               *kvm;
>>>>>>>   	struct eventfd_ctx       *eventfd;
>>>>>>> @@ -61,6 +64,13 @@ irqfd_inject(struct work_struct *work)
>>>>>>>   {
>>>>>>>   	struct _irqfd *irqfd = container_of(work, struct _irqfd, inject);
>>>>>>>   	struct kvm *kvm = irqfd->kvm;
>>>>>>> +	if (kvm == KVM_BAD_PTR) {
>>>>>>> +		printk(KERN_ERR "Eventfd bug detected!\n");
>>>>>>> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
>>>>>>> +			work, irqfd, kvm, irqfd->gsi);
>>>>>>> +		trigger_all_cpu_backtrace();
>>>>>>> +		return;
>>>>>>> +	}
>>>>>>>
>>>>>>>   	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 1);
>>>>>>>   	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 0);
>>>>>>> @@ -75,6 +85,8 @@ irqfd_shutdown(struct work_struct *work)
>>>>>>>   	struct _irqfd *irqfd = container_of(work, struct _irqfd, shutdown);
>>>>>>>   	u64 cnt;
>>>>>>>
>>>>>>> +	printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>>>>>> +	       work, irqfd, irqfd->kvm, irqfd->gsi);
>>>>>>>   	/*
>>>>>>>   	 * Synchronize with the wait-queue and unhook ourselves to prevent
>>>>>>>   	 * further events.
>>>>>>> @@ -91,6 +103,8 @@ irqfd_shutdown(struct work_struct *work)
>>>>>>>   	 * It is now safe to release the object's resources
>>>>>>>   	 */
>>>>>>>   	eventfd_ctx_put(irqfd->eventfd);
>>>>>>> +	printk(KERN_ERR "kfree at %s(work=%p,irqfd=%p)\n", __func__,
>>>>>>> +	       work, irqfd);
>>>>>>>   	kfree(irqfd);
>>>>>>>   }
>>>>>>>
>>>>>>> @@ -111,6 +125,8 @@ static void
>>>>>>>   irqfd_deactivate(struct _irqfd *irqfd)
>>>>>>>   {
>>>>>>>   	BUG_ON(!irqfd_is_active(irqfd));
>>>>>>> +	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>>>>>> +	       irqfd, irqfd->kvm, irqfd->gsi);
>>>>>>>
>>>>>>>   	list_del_init(&irqfd->list);
>>>>>>>
>>>>>>> @@ -178,6 +194,8 @@ kvm_irqfd_assign(struct kvm *kvm, int fd, int gsi)
>>>>>>>
>>>>>>>   	irqfd->kvm = kvm;
>>>>>>>   	irqfd->gsi = gsi;
>>>>>>> +	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>>>>>> +	       irqfd, kvm, gsi);
>>>>>>>   	INIT_LIST_HEAD(&irqfd->list);
>>>>>>>   	INIT_WORK(&irqfd->inject, irqfd_inject);
>>>>>>>   	INIT_WORK(&irqfd->shutdown, irqfd_shutdown);
>>>>>>> @@ -264,6 +282,8 @@ kvm_irqfd_deassign(struct kvm *kvm, int fd, int gsi)
>>>>>>>   	struct _irqfd *irqfd, *tmp;
>>>>>>>   	struct eventfd_ctx *eventfd;
>>>>>>>
>>>>>>> +	printk(KERN_ERR "%s(kvm=%p, gsi=%d)\n", __func__,
>>>>>>> +	       kvm, gsi);
>>>>>>>   	eventfd = eventfd_ctx_fdget(fd);
>>>>>>>   	if (IS_ERR(eventfd))
>>>>>>>   		return PTR_ERR(eventfd);
>>>>>>> @@ -305,6 +325,7 @@ void
>>>>>>>   kvm_irqfd_release(struct kvm *kvm)
>>>>>>>   {
>>>>>>>   	struct _irqfd *irqfd, *tmp;
>>>>>>> +	printk(KERN_ERR "%s(kvm=%p)\n", __func__, kvm);
>>>>>>>
>>>>>>>   	spin_lock_irq(&kvm->irqfds.lock);
>>>>>>>
>>>>>>> --
>>>>>>> To unsubscribe from this list: send the line "unsubscribe netdev" in
>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>>>> Hi,
>>>>>>
>>>>>> I boot the host with the patched kernel yesterday.
>>>>>> No crach until now, but two "Eventfd bug detected!" in the log at
>>>>>> "Mar  9 02:04:31" and "Mar  9 02:15:17"
>>>>>> You can find part of the log at the following adress:
>>>>>> http://filex.univ-nantes.fr/get?k=jL4Fe7yfSMN57toAH7V
>>>>>>
>>>>>> It a split file of the kern.log (1,4G), so if you need another part
>>>>>> of the log, let me know.
>>>>>>
>>>>>> Thanks for all.
>>>>>>
>>>>>> Regards.
>>>>> Downloading, it's big :)
>>>>> What about some 1000 lines before and after Eventfd bug detected! line?
>>>>> --
>>>>> To unsubscribe from this list: send the line "unsubscribe kvm" in
>>>>> the body of a message to majordomo@vger.kernel.org
>>>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>> Yes, sorry about that.
>>>> I could have split my log into a smaller file.
>>>>
>>>> I was a little afraid of not transmit enough informations, and i was
>>>> a bit wide.
>>>> I hope you can find usefull trace anyway.
>>>>
>>>> Regards.
>>> OK, use after free.
>>>
>>>
>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.593681]
>>> kvm_irqfd_assign(irqfd=ffff88045e8d6230,kvm=ffff88085151c000, gsi=26)
>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605359]
>>> kvm_irqfd_deassign(kvm=ffff88085151c000, gsi=26)
>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605388]
>>> irqfd_deactivate(irqfd=ffff88045e8d6230,kvm=ffff88085151c000, gsi=26)
>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605461]
>>> irqfd_shutdown(work=ffff88045e8d62b0,irqfd=ffff88045e8d6230,kvm=ffff88085151c000,
>>> gsi=26)
>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605509]
>>> kfree at irqfd_shutdown(work=ffff88045e8d62b0,irqfd=ffff88045e8d6230)
>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605588]
>>> Eventfd bug detected!
>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605612]
>>> irqfd_inject(work=ffff88045e8d6290,irqfd=ffff88045e8d6230,kvm=6b6b6b6b6b6b6b6b,gsi=1802201963)
>>>
>>>
>>> and 1802201963 is also 6b6b6b6b.
>>>
>>>
>>> I suspect that somehow, we get an event from eventfd even
>>> though we did eventfd_ctx_remove_wait_queue.
>>> Could you please try the following patch on top?
>>> When you see Eventfd bug or Wakeup bug, paste some
>>> last lines.
>>> For the full log file - better compress with xz.
>>>
>>>
>>> diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
>>> index 3cb679b..63aeba5 100644
>>> --- a/virt/kvm/eventfd.c
>>> +++ b/virt/kvm/eventfd.c
>>> @@ -92,6 +92,8 @@ irqfd_shutdown(struct work_struct *work)
>>>   	 * further events.
>>>   	 */
>>>   	eventfd_ctx_remove_wait_queue(irqfd->eventfd,&irqfd->wait,&cnt);
>>> +	printk(KERN_ERR "remove wq at %s(work=%p,irqfd=%p)\n", __func__,
>>> +	       work, irqfd);
>>>
>>>   	/*
>>>   	 * We know no new events will be scheduled at this point, so block
>>> @@ -142,6 +144,13 @@ irqfd_wakeup(wait_queue_t *wait, unsigned mode, int sync, void *key)
>>>   	struct _irqfd *irqfd = container_of(wait, struct _irqfd, wait);
>>>   	unsigned long flags = (unsigned long)key;
>>>
>>> +	if (irqfd->kvm == KVM_BAD_PTR) {
>>> +		printk(KERN_ERR "Wakeup bug detected! flags 0x%lx\n", flags);
>>> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
>>> +			&irqfd->inject, irqfd, irqfd->kvm, irqfd->gsi);
>>> +		trigger_all_cpu_backtrace();
>>> +		return 0;
>>> +	}
>>>   	if (flags&   POLLIN)
>>>   		/* An event has been signaled, inject an interrupt */
>>>   		schedule_work(&irqfd->inject);
>>> @@ -153,6 +162,9 @@ irqfd_wakeup(wait_queue_t *wait, unsigned mode, int sync, void *key)
>>>
>>>   		spin_lock_irqsave(&kvm->irqfds.lock, flags);
>>>
>>> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d,active=%d)\n", __func__,
>>> +			&irqfd->inject, irqfd, irqfd->kvm, irqfd->gsi,
>>> +			irqfd_is_active(irqfd));
>>>   		/*
>>>   		 * We must check if someone deactivated the irqfd before
>>>   		 * we could acquire the irqfds.lock since the item is
>>>
>> Hi,
>>
>> I noted seven "Eventfd bug detected" events during the night, and
>> only one Wakeup event:
>>
>> fifth.ah:Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.105868] Eventfd bug detected!
>> first.ad:Mar 10 01:08:15 ayrshire.u06.univ-nantes.prive kernel:
>> [34729.771260] Eventfd bug detected!
>> fourth.ad:Mar 10 02:54:41 ayrshire.u06.univ-nantes.prive kernel:
>> [41115.140873] Eventfd bug detected!
>> second.ab:Mar 10 02:41:55 ayrshire.u06.univ-nantes.prive kernel:
>> [40348.967192] Eventfd bug detected!
>> seventh.ab:Mar 10 07:52:29 ayrshire.u06.univ-nantes.prive kernel:
>> [58983.145646] Eventfd bug detected!
>> sixth.ab:Mar 10 05:19:54 ayrshire.u06.univ-nantes.prive kernel:
>> [49828.785558] Eventfd bug detected!
>> third.ae:Mar 10 02:54:07 ayrshire.u06.univ-nantes.prive kernel:
>> [41081.638633] Eventfd bug detected!
>>
>> grep -i wakeup *
>> seventh.ab:Mar 10 07:52:29 ayrshire.u06.univ-nantes.prive kernel:
>> [58983.154161]  [<ffffffffa02cbf96>] vhost_poll_wakeup+0x16/0x20
>> [vhost_net
>>
>>
>> Here is a trace, for the thirst event:
>>
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.101747]
>> irqfd_deactivate(irqfd=ffff88042e0b5e00,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.101873] irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.101928] remove wq at
>> irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.101990] kfree at
>> irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.102381]
>> kvm_irqfd_assign(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.103796] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.103833]
>> irqfd_deactivate(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.103904] irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.103958] remove wq at
>> irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.104023] kfree at
>> irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.104311]
>> kvm_irqfd_assign(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.104511] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.104549]
>> irqfd_deactivate(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.104614] irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.104667] remove wq at
>> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.104715] kfree at
>> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.104911]
>> kvm_irqfd_assign(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.105868] Eventfd bug detected!
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.105901] irqfd_inject(work=ffff88042e0b5e60,irqfd=ffff88042e0b5e00,kvm=6b6b6b6b6b6b6b6b,gsi=1802201963)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.105951] sending NMI to all CPUs:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.105961] NMI backtrace for cpu 0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.105986] CPU 0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.105992] Modules linked in: btrfs zlib_deflate crc32c
>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>> ehci_hcd [last unloaded: scsi_wait_sca
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106557]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106581] Pid: 10, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106644] RIP: 0010:[<ffffffff8105fa4b>]  [<ffffffff8105fa4b>]
>> default_send_IPI_mask_sequence_phys+0xbb/0xe0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106706] RSP: 0018:ffff88045fcb1d50  EFLAGS: 00000046
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106735] RAX: ffff88087fc00000 RBX: 0000000000000002 RCX:
>> 0000000000000008
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106767] RDX: 0000000000000001 RSI: 0000000000000020 RDI:
>> 0000000000000020
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106799] RBP: ffff88045fcb1d90 R08: ffffffff8159faf0 R09:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106831] R10: 0000000000000000 R11: 0000000000000006 R12:
>> 000000000000c620
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106863] R13: ffffffff8159faf0 R14: 0000000000000400 R15:
>> 0000000000000286
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106896] FS:  00007f66f7754720(0000) GS:ffff88007f800000(0000)
>> knlGS:0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106944] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.106973] CR2: 0000000000e64048 CR3: 000000045ea45000 CR4:
>> 00000000000006f0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.107005] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.107037] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.107070] Process kworker/0:1 (pid: 10, threadinfo
>> ffff88045fcb0000, task ffff88045fcaae70)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.107117] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.107138]  ffffffff00000000 0000000000000000 ffff88045fcb1d70
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  6b6b6b6b6b6b6b6b ffff88007f814e00 ffffffff81008ba0
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  ffff88045fcb1da0 ffffffff81062c12 ffff88045fcb1dc0
>> ffffffff8105fb3c
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff8105fb3c>]
>> arch_trigger_all_cpu_backtrace+0x3c/0x70
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810a971b>] process_one_work+0x11b/0x450
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810a9e97>] worker_thread+0x157/0x410
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81078519>] ? __wake_up_common+0x59/0x90
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810a9d40>] ? worker_thread+0x0/0x410
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810ad8f6>] kthread+0x96/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810ad860>] ? kthread+0x0/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011] Code: 83 fb 02 44 89 f0 0f 45 c3 89 04 25 00 c3 5f ff
>> eb 9e 4c 89 ff 57 9d 66 66 90 66 90 48 83 c4 18 5b 41 5c 41 5d 41 5e
>> 41 5f c9 c3<48>  8b 05 4e fb 53 00 48 89 55 c8 89 4d c0 ff 90 58 01
>> 00 00 48
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff8105fb3c>]
>> arch_trigger_all_cpu_backtrace+0x3c/0x70
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810a971b>] process_one_work+0x11b/0x450
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810a9e97>] worker_thread+0x157/0x410
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81078519>] ? __wake_up_common+0x59/0x90
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810a9d40>] ? worker_thread+0x0/0x410
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810ad8f6>] kthread+0x96/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810ad860>] ? kthread+0x0/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011] Pid: 10, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]<NMI>   [<ffffffff8104a786>] ? show_regs+0x26/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff813be5f0>] nmi+0x20/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff8105fa4b>] ?
>> default_send_IPI_mask_sequence_phys+0xbb/0xe0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]<<EOE>>   [<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff8105fb3c>]
>> arch_trigger_all_cpu_backtrace+0x3c/0x70
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810a971b>] process_one_work+0x11b/0x450
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810a9e97>] worker_thread+0x157/0x410
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81078519>] ? __wake_up_common+0x59/0x90
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810a9d40>] ? worker_thread+0x0/0x410
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810ad8f6>] kthread+0x96/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff810ad860>] ? kthread+0x0/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108011]  [<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110243] NMI backtrace for cpu 3
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110272] CPU 3
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110280] Modules linked in: btrfs zlib_deflate crc32c
>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>> ehci_hcd [last unloaded: scsi_wait_sca
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110882]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110906] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110970] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>> native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111030] RSP: 0018:ffff88045fcd3ea8  EFLAGS: 00000246
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111059] RAX: 0000000000000000 RBX: 0000000000000003 RCX:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111091] RDX: 0000000000000000 RSI: ffff88045fcd3ee4 RDI:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111123] RBP: ffff88045fcd3ea8 R08: 0000000000000000 R09:
>> 0000000000000001
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111155] R10: 0000000000000000 R11: 0000000000000001 R12:
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111186] R13: 0000000000000003 R14: 0000000000000000 R15:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111220] FS:  00007fb1eafc6740(0000) GS:ffff88087fc40000(0000)
>> knlGS:0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111268] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111297] CR2: 00007ff12a981de0 CR3: 000000045569f000 CR4:
>> 00000000000006e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111329] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111362] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111395] Process kworker/0:1 (pid: 0, threadinfo
>> ffff88045fcd2000, task ffff88045fcca820)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111442] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111463]  ffff88045fcd3ec8 ffffffff8104a016 ffff88045fcd3ee4
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111515]  ffff88045fcd3ef8 ffffffff8104a168 ffff88045fcd3ee8
>> 00000000810b3255
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111566]  ffff88045fcd2010 ffffffff8159faf0 ffff88045fcd3f28
>> ffffffff8104003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111618] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111648]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111680]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111712]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111745]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111774] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>> 89 e5 fb f4<c9>  c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>> 0f 1f 84
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111982] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112007]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112038]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112069]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112099]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112131] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112176] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112198]<NMI>   [<ffffffff8104a786>] ? show_regs+0x26/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112238]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112272]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112303]  [<ffffffff813be5f0>] nmi+0x20/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112332]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112361]<<EOE>>   [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112399]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112430]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112460]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112024] NMI backtrace for cpu 2
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112024] CPU 2
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112024] Modules linked in: btrfs zlib_deflate crc32c
>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>> ehci_hcd [last unloaded: scsi_wait_sca
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>> native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] RSP: 0018:ffff88045fcc5ea8  EFLAGS: 00000246
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] RAX: 0000000000000000 RBX: 0000000000000002 RCX:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] RDX: 0000000000000000 RSI: ffff88045fcc5ee4 RDI:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] RBP: ffff88045fcc5ea8 R08: 0000000000000000 R09:
>> 0000000000000001
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] R10: 0000000000000000 R11: 0000000000000000 R12:
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] R13: 0000000000000002 R14: 0000000000000000 R15:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] FS:  00007f66f7754720(0000) GS:ffff88007f840000(0000)
>> knlGS:0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] CR2: 00007f241ad1f0b8 CR3: 000000045ea45000 CR4:
>> 00000000000006f0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] Process kworker/0:1 (pid: 0, threadinfo
>> ffff88045fcc4000, task ffff88045fcb87e0)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  ffff88045fcc5ec8 ffffffff8104a016 ffff88045fcc5ee4
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  ffff88045fcc5ef8 ffffffff8104a168 ffff88045fcc5ee8
>> 00000000810b3255
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  ffff88045fcc4010 ffffffff8159faf0 ffff88045fcc5f28
>> ffffffff8104003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>> 89 e5 fb f4<c9>  c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>> 0f 1f 84
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]<NMI>   [<ffffffff8104a786>] ? show_regs+0x26/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff813be5f0>] nmi+0x20/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]<<EOE>>   [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112616]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] NMI backtrace for cpu 1
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] CPU 1
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] Modules linked in: btrfs zlib_deflate crc32c
>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>> ehci_hcd [last unloaded: scsi_wait_sca
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] Pid: 0, comm: kworker/0:0 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>> native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] RSP: 0018:ffff88045fcb3ea8  EFLAGS: 00000246
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] RAX: 0000000000000000 RBX: 0000000000000001 RCX:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] RDX: 0000000000000000 RSI: ffff88045fcb3ee4 RDI:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] RBP: ffff88045fcb3ea8 R08: 0000000000000000 R09:
>> ffff88087fc0e408
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] R10: 000028ce70db0d2f R11: 0000000000000001 R12:
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] R13: 0000000000000001 R14: 0000000000000000 R15:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] FS:  00007fb8e1893710(0000) GS:ffff88087fc00000(0000)
>> knlGS:0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] CR2: 00007f241aca71a0 CR3: 000000045ed50000 CR4:
>> 00000000000006e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] Process kworker/0:0 (pid: 0, threadinfo
>> ffff88045fcb2000, task ffff88045fcaa7a0)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  ffff88045fcb3ec8 ffffffff8104a016 ffff88045fcb3ee4
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  ffff88045fcb3ef8 ffffffff8104a168 ffff88045fcb3ee8
>> 00000000810b3255
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  ffff88045fcb2010 ffffffff8159faf0 ffff88045fcb3f28
>> ffffffff8104003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>> 89 e5 fb f4<c9>  c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>> 0f 1f 84
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]<NMI>   [<ffffffff8104a786>] ? show_regs+0x26/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  [<ffffffff813be5f0>] nmi+0x20/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]<<EOE>>   [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112285]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896] Modules linked in: btrfs zlib_deflate crc32c
>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>> ehci_hcd [last unloaded: scsi_wait_sca
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896] RAX: 0000000000000000 RBX: 0000000000000005 RCX:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896] RDX: 0000000000000000 RSI: ffff88045fd11ee4 RDI:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896]  ffff88045fd11ef8 ffffffff8104a168 ffff88045fd11ee8
>> 00000000810b3255
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896]  ffff88045fd10010 ffffffff8159faf0 ffff88045fd11f28
>> ffffffff8104003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.110896] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>> 89 e5 fb f4<c9>  c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>> 0f 1f 84
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.119695] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.119695]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.119695]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.119695]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.119985]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.119985] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.119985] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.119985]<NMI>   [<ffffffff8104a786>] ? show_regs+0x26/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120119]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120164]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018] CR2: 00007f241ad1f0b8 CR3: 000000045ed50000 CR4:
>> 00000000000006e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018] Process kworker/0:1 (pid: 0, threadinfo
>> ffff88045fd00000, task ffff88045fcd8860)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018]  ffff88045fd01ec8 ffffffff8104a016 ffff88045fd01ee4
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018]  ffff88045fd01ef8 ffffffff8104a168 ffff88045fd01ee8
>> 00000000810b3255
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018]  ffff88045fd00010 ffffffff8159faf0 ffff88045fd01f28
>> ffffffff8104003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018]  [<ffffffff813be5f0>] nmi+0x20/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.112018]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.123585] NMI backtrace for cpu 7
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.124502] RAX: 0000000000000000 RBX: 0000000000000007 RCX:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.125007] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.125206] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015] Modules linked in: btrfs zlib_deflate crc32c
>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>> ehci_hcd [last unloaded: scsi_wait_sca
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>> native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015] RSP: 0018:ffff88045fd23ea8  EFLAGS: 00000246
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015] RAX: 0000000000000000 RBX: 0000000000000006 RCX:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015] RDX: 0000000000000000 RSI: ffff88045fd23ee4 RDI:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015] RBP: ffff88045fd23ea8 R08: 0000000000000000 R09:
>> ffff88007f8ce408
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015] R10: 0000000000000000 R11: 0000000000000001 R12:
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015]  ffff88045fd23ec8 ffffffff8104a016 ffff88045fd23ee4
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015]  [<ffffffff813be5f0>] nmi+0x20/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108015]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] Modules linked in: btrfs zlib_deflate crc32c
>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>> ehci_hcd [last unloaded: scsi_wait_sca
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] R10: 000028ce766a74a3 R11: 0000000000000001 R12:
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] R13: 0000000000000009 R14: 0000000000000000 R15:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] FS:  00007fa0cb316710(0000) GS:ffff88087fd00000(0000)
>> knlGS:0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] CR2: 0000000000e64048 CR3: 000000045ea45000 CR4:
>> 00000000000006e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] Process kworker/0:1 (pid: 0, threadinfo
>> ffff88045fd6e000, task ffff88045fd669a0)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  ffff88045fd6fec8 ffffffff8104a016 ffff88045fd6fee4
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  ffff88045fd6fef8 ffffffff8104a168 ffff88045fd6fee8
>> 00000000810b3255
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  ffff88045fd6e010 ffffffff8159faf0 ffff88045fd6ff28
>> ffffffff8104003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>> 89 e5 fb f4<c9>  c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>> 0f 1f 84
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]<NMI>   [<ffffffff8104a786>] ? show_regs+0x26/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff813be5f0>] nmi+0x20/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]<<EOE>>   [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.126621]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] NMI backtrace for cpu 11
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] CPU 11
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] Modules linked in: btrfs zlib_deflate crc32c
>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>> ehci_hcd [last unloaded: scsi_wait_sca
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>> native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] RSP: 0018:ffff88045fd8fea8  EFLAGS: 00000246
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] RAX: 0000000000000000 RBX: 000000000000000b RCX:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] RDX: 0000000000000000 RSI: ffff88045fd8fee4 RDI:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] RBP: ffff88045fd8fea8 R08: 0000000000000000 R09:
>> ffff88087fd4e408
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] R10: 000028ce71c3578e R11: 0000000000000001 R12:
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] R13: 000000000000000b R14: 0000000000000000 R15:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] FS:  00007fa0ce156740(0000) GS:ffff88087fd40000(0000)
>> knlGS:0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] CR2: 00007f2421c3eae0 CR3: 000000045ea45000 CR4:
>> 00000000000006e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] Process kworker/0:1 (pid: 0, threadinfo
>> ffff88045fd8e000, task ffff88045fd86a20)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  ffff88045fd8fec8 ffffffff8104a016 ffff88045fd8fee4
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  ffff88045fd8fef8 ffffffff8104a168 ffff88045fd8fee8
>> 00000000810b3255
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  ffff88045fd8e010 ffffffff8159faf0 ffff88045fd8ff28
>> ffffffff8104003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>> 89 e5 fb f4<c9>  c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>> 0f 1f 84
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]<NMI>   [<ffffffff8104a786>] ? show_regs+0x26/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff813be5f0>] nmi+0x20/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]<<EOE>>   [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.111333]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] NMI backtrace for cpu 8
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] CPU 8
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] Modules linked in: btrfs zlib_deflate crc32c
>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>> ehci_hcd [last unloaded: scsi_wait_sca
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>> native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] RSP: 0018:ffff88045fd63ea8  EFLAGS: 00000246
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] RAX: 0000000000000000 RBX: 0000000000000008 RCX:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] RDX: 0000000000000000 RSI: ffff88045fd63ee4 RDI:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] RBP: ffff88045fd63ea8 R08: 0000000000000000 R09:
>> ffff88007f90e408
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] R10: 0000000000000000 R11: 0000000000000001 R12:
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] R13: 0000000000000008 R14: 0000000000000000 R15:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] FS:  00007fb8e0891710(0000) GS:ffff88007f900000(0000)
>> knlGS:0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] CR2: 0000000000e63f28 CR3: 000000045ed50000 CR4:
>> 00000000000006e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] Process kworker/0:1 (pid: 0, threadinfo
>> ffff88045fd62000, task ffff88045fd34960)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010]  ffff88045fd63ec8 ffffffff8104a016 ffff88045fd63ee4
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010]  ffff88045fd63ef8 ffffffff8104a168 ffff88045fd63ee8
>> 00000000810b3255
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010]  ffff88045fd62010 ffffffff8159faf0 ffff88045fd63f28
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136088] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136098]
>> irqfd_deactivate(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>> 89 e5 fb f4<c9>  c3 0f
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136661] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136665]
>> irqfd_deactivate(irqfd=ffff880810a21e00,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136702] irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136709] remove wq at
>> irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136715] kfree at
>> irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] 1f 84 00 00 00
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136910]
>> kvm_irqfd_assign(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] 00 00 55 48 89 e5 f4 c9 c3 66 0f 1f 84
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.108010]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136975] Pid: 0, comm: kworker/0:1 Not tainted
>> 2.6.37.2-patchjp-110308-c+ #17
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136975] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136975]<NMI>   [<ffffffff8104a786>] ? show_regs+0x26/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136975]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136975]  [<ffffffff813be5f0>] nmi+0x20/0x30
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.136975]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004] FS:  00007f2787814700(0000) GS:ffff88007f940000(0000)
>> knlGS:0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004] CR2: 0000000000e63f28 CR3: 000000045ea45000 CR4:
>> 00000000000006e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>> 0000000000000000
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>> 0000000000000400
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004] Process kworker/0:1 (pid: 0, threadinfo
>> ffff88045fd80000, task ffff88045fd769e0)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] Stack:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004]  ffff88045fd81ec8 ffffffff8104a016 ffff88045fd81ee4
>> ffffffff8159faf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004]  ffff88045fd81ef8 ffffffff8104a168 ffff88045fd81ee8
>> 00000000810b3255
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004]  ffff88045fd80010 ffffffff8159faf0 ffff88045fd81f28
>> ffffffff8104003b
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004] Call Trace:
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.120004]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.148658] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.148687]
>> irqfd_deactivate(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.148759] irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.148814] remove wq at
>> irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.148862] kfree at
>> irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.149086]
>> kvm_irqfd_assign(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.149379] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=48)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.149416]
>> irqfd_deactivate(irqfd=ffff88045efd3740,kvm=ffff8804542d0000,
>> gsi=48)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.149540] irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740,kvm=ffff8804542d0000,
>> gsi=48)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.149594] remove wq at
>> irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.149643] kfree at
>> irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.149922]
>> kvm_irqfd_assign(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
>> gsi=48)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.171869] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.171907]
>> irqfd_deactivate(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.171989] irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.172111] remove wq at
>> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.172160] kfree at
>> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.172493]
>> kvm_irqfd_assign(irqfd=ffff88083b062308,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.172672] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.172710]
>> irqfd_deactivate(irqfd=ffff88083b062308,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.172782] irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.172836] remove wq at
>> irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.172884] kfree at
>> irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.173074]
>> kvm_irqfd_assign(irqfd=ffff88081a190230,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.175303] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.175339]
>> irqfd_deactivate(irqfd=ffff88081a190230,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.175466] irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.175521] remove wq at
>> irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.175569] kfree at
>> irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.175769]
>> kvm_irqfd_assign(irqfd=ffff88045eabb668,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.176002] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.176058]
>> irqfd_deactivate(irqfd=ffff88045eabb668,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.176122] irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668,kvm=ffff8804542d0000,
>> gsi=24)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.176177] remove wq at
>> irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.176225] kfree at
>> irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668)
>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>> [44867.176427]
>> kvm_irqfd_assign(irqfd=ffff88045ed96c50,kvm=ffff8804542d0000, gsi=24
>>
>>
>> You can find all the trace at the following adress:
>> http://filex.univ-nantes.fr/get?k=R94kna5sckVmdvCoKsn
>>
>> It's a tar.gz of seven file, from 100k to 200k each ;)
>>
>> Again, thanks a lot for the time you spent on this.
>>
>> Regards.
> Are you running a preemptible kernel?
> Does the following help at all?
>
> diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
> index 2ca4535..cdf51c9 100644
> --- a/virt/kvm/eventfd.c
> +++ b/virt/kvm/eventfd.c
> @@ -90,7 +90,7 @@ irqfd_shutdown(struct work_struct *work)
>   	 * We know no new events will be scheduled at this point, so block
>   	 * until all previously outstanding events have completed
>   	 */
> -	flush_work(&irqfd->inject);
> +	flush_work_sync(&irqfd->inject);
>
>   	/*
>   	 * It is now safe to release the object's resources
>
Hi,

thanks for the response.

root@ayrshire:~# zcat /proc/config.gz | grep -i preempt
# CONFIG_PREEMPT_RCU is not set
CONFIG_PREEMPT_NOTIFIERS=y
CONFIG_PREEMPT_NONE=y
# CONFIG_PREEMPT_VOLUNTARY is not set
# CONFIG_PREEMPT is not set

It does not seem to be a preemptible kernel.

I will test tour patch, and report the result.

Regards.

-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-15 14:58                                             ` Jean-Philippe Menil
@ 2011-03-17  8:00                                               ` Jean-Philippe Menil
  2011-03-17  8:21                                                 ` Michael S. Tsirkin
  0 siblings, 1 reply; 27+ messages in thread
From: Jean-Philippe Menil @ 2011-03-17  8:00 UTC (permalink / raw)
  To: jean-philippe.menil; +Cc: Michael S. Tsirkin, netdev, kvm, virtualization

Le 15/03/2011 15:58, Jean-Philippe Menil a écrit :
> Le 15/03/2011 15:32, Michael S. Tsirkin a écrit :
>> On Thu, Mar 10, 2011 at 09:42:28AM +0100, Jean-Philippe Menil wrote:
>>> Le 09/03/2011 14:59, Michael S. Tsirkin a écrit :
>>>> On Wed, Mar 09, 2011 at 02:12:58PM +0100, Jean-Philippe Menil wrote:
>>>>> Le 09/03/2011 14:00, Michael S. Tsirkin a écrit :
>>>>>> On Wed, Mar 09, 2011 at 01:28:43PM +0100, Jean-Philippe Menil wrote:
>>>>>>> Le 08/03/2011 12:13, Michael S. Tsirkin a écrit :
>>>>>>>> On Fri, Mar 04, 2011 at 10:39:05AM +0100, Jean-Philippe Menil wrote:
>>>>>>>>> Yes, it's a 2.6.37.2 kernel.
>>>>>>>> OK, here's a debugging patch.
>>>>>>>> Please run with slab debugging as previously until you see
>>>>>>>> 'eventfd bug detected!' in dmesg or until there is a crash.
>>>>>>>> It might be also useful to enable timestampts on printk with
>>>>>>>>    Symbol: PRINTK_TIME [=y]
>>>>>>>>     │ Type  : boolean
>>>>>>>>     │ Prompt: Show timing information on printks
>>>>>>>>
>>>>>>>> once you see the error, please upload the
>>>>>>>> full dmesg output somewhere to we can track what
>>>>>>>> goes on.
>>>>>>>>
>>>>>>>> Hopefully there won't be an oops this time which
>>>>>>>> should make it easier for you to test (no need to
>>>>>>>> reboot).
>>>>>>>>
>>>>>>>>
>>>>>>>> diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
>>>>>>>> index c1f1e3c..3cb679b 100644
>>>>>>>> --- a/virt/kvm/eventfd.c
>>>>>>>> +++ b/virt/kvm/eventfd.c
>>>>>>>> @@ -32,6 +32,7 @@
>>>>>>>>    #include<linux/eventfd.h>
>>>>>>>>    #include<linux/kernel.h>
>>>>>>>>    #include<linux/slab.h>
>>>>>>>> +#include<linux/nmi.h>
>>>>>>>>
>>>>>>>>    #include "iodev.h"
>>>>>>>>
>>>>>>>> @@ -43,6 +44,8 @@
>>>>>>>>     * --------------------------------------------------------------------
>>>>>>>>     */
>>>>>>>>
>>>>>>>> +#define KVM_BAD_PTR ((void*)(long)(0x6b6b6b6b6b6b6b6bull))
>>>>>>>> +
>>>>>>>>    struct _irqfd {
>>>>>>>>    	struct kvm               *kvm;
>>>>>>>>    	struct eventfd_ctx       *eventfd;
>>>>>>>> @@ -61,6 +64,13 @@ irqfd_inject(struct work_struct *work)
>>>>>>>>    {
>>>>>>>>    	struct _irqfd *irqfd = container_of(work, struct _irqfd, inject);
>>>>>>>>    	struct kvm *kvm = irqfd->kvm;
>>>>>>>> +	if (kvm == KVM_BAD_PTR) {
>>>>>>>> +		printk(KERN_ERR "Eventfd bug detected!\n");
>>>>>>>> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
>>>>>>>> +			work, irqfd, kvm, irqfd->gsi);
>>>>>>>> +		trigger_all_cpu_backtrace();
>>>>>>>> +		return;
>>>>>>>> +	}
>>>>>>>>
>>>>>>>>    	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 1);
>>>>>>>>    	kvm_set_irq(kvm, KVM_USERSPACE_IRQ_SOURCE_ID, irqfd->gsi, 0);
>>>>>>>> @@ -75,6 +85,8 @@ irqfd_shutdown(struct work_struct *work)
>>>>>>>>    	struct _irqfd *irqfd = container_of(work, struct _irqfd, shutdown);
>>>>>>>>    	u64 cnt;
>>>>>>>>
>>>>>>>> +	printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>>>>>>> +	       work, irqfd, irqfd->kvm, irqfd->gsi);
>>>>>>>>    	/*
>>>>>>>>    	 * Synchronize with the wait-queue and unhook ourselves to prevent
>>>>>>>>    	 * further events.
>>>>>>>> @@ -91,6 +103,8 @@ irqfd_shutdown(struct work_struct *work)
>>>>>>>>    	 * It is now safe to release the object's resources
>>>>>>>>    	 */
>>>>>>>>    	eventfd_ctx_put(irqfd->eventfd);
>>>>>>>> +	printk(KERN_ERR "kfree at %s(work=%p,irqfd=%p)\n", __func__,
>>>>>>>> +	       work, irqfd);
>>>>>>>>    	kfree(irqfd);
>>>>>>>>    }
>>>>>>>>
>>>>>>>> @@ -111,6 +125,8 @@ static void
>>>>>>>>    irqfd_deactivate(struct _irqfd *irqfd)
>>>>>>>>    {
>>>>>>>>    	BUG_ON(!irqfd_is_active(irqfd));
>>>>>>>> +	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>>>>>>> +	       irqfd, irqfd->kvm, irqfd->gsi);
>>>>>>>>
>>>>>>>>    	list_del_init(&irqfd->list);
>>>>>>>>
>>>>>>>> @@ -178,6 +194,8 @@ kvm_irqfd_assign(struct kvm *kvm, int fd, int gsi)
>>>>>>>>
>>>>>>>>    	irqfd->kvm = kvm;
>>>>>>>>    	irqfd->gsi = gsi;
>>>>>>>> +	printk(KERN_ERR "%s(irqfd=%p,kvm=%p, gsi=%d)\n", __func__,
>>>>>>>> +	       irqfd, kvm, gsi);
>>>>>>>>    	INIT_LIST_HEAD(&irqfd->list);
>>>>>>>>    	INIT_WORK(&irqfd->inject, irqfd_inject);
>>>>>>>>    	INIT_WORK(&irqfd->shutdown, irqfd_shutdown);
>>>>>>>> @@ -264,6 +282,8 @@ kvm_irqfd_deassign(struct kvm *kvm, int fd, int gsi)
>>>>>>>>    	struct _irqfd *irqfd, *tmp;
>>>>>>>>    	struct eventfd_ctx *eventfd;
>>>>>>>>
>>>>>>>> +	printk(KERN_ERR "%s(kvm=%p, gsi=%d)\n", __func__,
>>>>>>>> +	       kvm, gsi);
>>>>>>>>    	eventfd = eventfd_ctx_fdget(fd);
>>>>>>>>    	if (IS_ERR(eventfd))
>>>>>>>>    		return PTR_ERR(eventfd);
>>>>>>>> @@ -305,6 +325,7 @@ void
>>>>>>>>    kvm_irqfd_release(struct kvm *kvm)
>>>>>>>>    {
>>>>>>>>    	struct _irqfd *irqfd, *tmp;
>>>>>>>> +	printk(KERN_ERR "%s(kvm=%p)\n", __func__, kvm);
>>>>>>>>
>>>>>>>>    	spin_lock_irq(&kvm->irqfds.lock);
>>>>>>>>
>>>>>>>> --
>>>>>>>> To unsubscribe from this list: send the line "unsubscribe netdev" in
>>>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>>>>> Hi,
>>>>>>>
>>>>>>> I boot the host with the patched kernel yesterday.
>>>>>>> No crach until now, but two "Eventfd bug detected!" in the log at
>>>>>>> "Mar  9 02:04:31" and "Mar  9 02:15:17"
>>>>>>> You can find part of the log at the following adress:
>>>>>>> http://filex.univ-nantes.fr/get?k=jL4Fe7yfSMN57toAH7V
>>>>>>>
>>>>>>> It a split file of the kern.log (1,4G), so if you need another part
>>>>>>> of the log, let me know.
>>>>>>>
>>>>>>> Thanks for all.
>>>>>>>
>>>>>>> Regards.
>>>>>> Downloading, it's big :)
>>>>>> What about some 1000 lines before and after Eventfd bug detected! line?
>>>>>> --
>>>>>> To unsubscribe from this list: send the line "unsubscribe kvm" in
>>>>>> the body of a message to majordomo@vger.kernel.org
>>>>>> More majordomo info at  http://vger.kernel.org/majordomo-info.html
>>>>> Yes, sorry about that.
>>>>> I could have split my log into a smaller file.
>>>>>
>>>>> I was a little afraid of not transmit enough informations, and i was
>>>>> a bit wide.
>>>>> I hope you can find usefull trace anyway.
>>>>>
>>>>> Regards.
>>>> OK, use after free.
>>>>
>>>>
>>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.593681]
>>>> kvm_irqfd_assign(irqfd=ffff88045e8d6230,kvm=ffff88085151c000, gsi=26)
>>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605359]
>>>> kvm_irqfd_deassign(kvm=ffff88085151c000, gsi=26)
>>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605388]
>>>> irqfd_deactivate(irqfd=ffff88045e8d6230,kvm=ffff88085151c000, gsi=26)
>>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605461]
>>>> irqfd_shutdown(work=ffff88045e8d62b0,irqfd=ffff88045e8d6230,kvm=ffff88085151c000,
>>>> gsi=26)
>>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605509]
>>>> kfree at irqfd_shutdown(work=ffff88045e8d62b0,irqfd=ffff88045e8d6230)
>>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605588]
>>>> Eventfd bug detected!
>>>> Mar  9 02:15:17 ayrshire.u06.univ-nantes.prive kernel: [37461.605612]
>>>> irqfd_inject(work=ffff88045e8d6290,irqfd=ffff88045e8d6230,kvm=6b6b6b6b6b6b6b6b,gsi=1802201963)
>>>>
>>>>
>>>> and 1802201963 is also 6b6b6b6b.
>>>>
>>>>
>>>> I suspect that somehow, we get an event from eventfd even
>>>> though we did eventfd_ctx_remove_wait_queue.
>>>> Could you please try the following patch on top?
>>>> When you see Eventfd bug or Wakeup bug, paste some
>>>> last lines.
>>>> For the full log file - better compress with xz.
>>>>
>>>>
>>>> diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
>>>> index 3cb679b..63aeba5 100644
>>>> --- a/virt/kvm/eventfd.c
>>>> +++ b/virt/kvm/eventfd.c
>>>> @@ -92,6 +92,8 @@ irqfd_shutdown(struct work_struct *work)
>>>>    	 * further events.
>>>>    	 */
>>>>    	eventfd_ctx_remove_wait_queue(irqfd->eventfd,&irqfd->wait,&cnt);
>>>> +	printk(KERN_ERR "remove wq at %s(work=%p,irqfd=%p)\n", __func__,
>>>> +	       work, irqfd);
>>>>
>>>>    	/*
>>>>    	 * We know no new events will be scheduled at this point, so block
>>>> @@ -142,6 +144,13 @@ irqfd_wakeup(wait_queue_t *wait, unsigned mode, int sync, void *key)
>>>>    	struct _irqfd *irqfd = container_of(wait, struct _irqfd, wait);
>>>>    	unsigned long flags = (unsigned long)key;
>>>>
>>>> +	if (irqfd->kvm == KVM_BAD_PTR) {
>>>> +		printk(KERN_ERR "Wakeup bug detected! flags 0x%lx\n", flags);
>>>> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d)\n", __func__,
>>>> +			&irqfd->inject, irqfd, irqfd->kvm, irqfd->gsi);
>>>> +		trigger_all_cpu_backtrace();
>>>> +		return 0;
>>>> +	}
>>>>    	if (flags&    POLLIN)
>>>>    		/* An event has been signaled, inject an interrupt */
>>>>    		schedule_work(&irqfd->inject);
>>>> @@ -153,6 +162,9 @@ irqfd_wakeup(wait_queue_t *wait, unsigned mode, int sync, void *key)
>>>>
>>>>    		spin_lock_irqsave(&kvm->irqfds.lock, flags);
>>>>
>>>> +		printk(KERN_ERR "%s(work=%p,irqfd=%p,kvm=%p,gsi=%d,active=%d)\n", __func__,
>>>> +			&irqfd->inject, irqfd, irqfd->kvm, irqfd->gsi,
>>>> +			irqfd_is_active(irqfd));
>>>>    		/*
>>>>    		 * We must check if someone deactivated the irqfd before
>>>>    		 * we could acquire the irqfds.lock since the item is
>>>>
>>> Hi,
>>>
>>> I noted seven "Eventfd bug detected" events during the night, and
>>> only one Wakeup event:
>>>
>>> fifth.ah:Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.105868] Eventfd bug detected!
>>> first.ad:Mar 10 01:08:15 ayrshire.u06.univ-nantes.prive kernel:
>>> [34729.771260] Eventfd bug detected!
>>> fourth.ad:Mar 10 02:54:41 ayrshire.u06.univ-nantes.prive kernel:
>>> [41115.140873] Eventfd bug detected!
>>> second.ab:Mar 10 02:41:55 ayrshire.u06.univ-nantes.prive kernel:
>>> [40348.967192] Eventfd bug detected!
>>> seventh.ab:Mar 10 07:52:29 ayrshire.u06.univ-nantes.prive kernel:
>>> [58983.145646] Eventfd bug detected!
>>> sixth.ab:Mar 10 05:19:54 ayrshire.u06.univ-nantes.prive kernel:
>>> [49828.785558] Eventfd bug detected!
>>> third.ae:Mar 10 02:54:07 ayrshire.u06.univ-nantes.prive kernel:
>>> [41081.638633] Eventfd bug detected!
>>>
>>> grep -i wakeup *
>>> seventh.ab:Mar 10 07:52:29 ayrshire.u06.univ-nantes.prive kernel:
>>> [58983.154161]  [<ffffffffa02cbf96>] vhost_poll_wakeup+0x16/0x20
>>> [vhost_net
>>>
>>>
>>> Here is a trace, for the thirst event:
>>>
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.101747]
>>> irqfd_deactivate(irqfd=ffff88042e0b5e00,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.101873] irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.101928] remove wq at
>>> irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.101990] kfree at
>>> irqfd_shutdown(work=ffff88042e0b5e80,irqfd=ffff88042e0b5e00)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.102381]
>>> kvm_irqfd_assign(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.103796] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.103833]
>>> irqfd_deactivate(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.103904] irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.103958] remove wq at
>>> irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.104023] kfree at
>>> irqfd_shutdown(work=ffff88080f7aa898,irqfd=ffff88080f7aa818)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.104311]
>>> kvm_irqfd_assign(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.104511] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.104549]
>>> irqfd_deactivate(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.104614] irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.104667] remove wq at
>>> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.104715] kfree at
>>> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.104911]
>>> kvm_irqfd_assign(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.105868] Eventfd bug detected!
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.105901] irqfd_inject(work=ffff88042e0b5e60,irqfd=ffff88042e0b5e00,kvm=6b6b6b6b6b6b6b6b,gsi=1802201963)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.105951] sending NMI to all CPUs:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.105961] NMI backtrace for cpu 0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.105986] CPU 0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.105992] Modules linked in: btrfs zlib_deflate crc32c
>>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>>> ehci_hcd [last unloaded: scsi_wait_sca
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.106557]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106581] Pid: 10, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106644] RIP: 0010:[<ffffffff8105fa4b>]  [<ffffffff8105fa4b>]
>>> default_send_IPI_mask_sequence_phys+0xbb/0xe0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106706] RSP: 0018:ffff88045fcb1d50  EFLAGS: 00000046
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106735] RAX: ffff88087fc00000 RBX: 0000000000000002 RCX:
>>> 0000000000000008
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106767] RDX: 0000000000000001 RSI: 0000000000000020 RDI:
>>> 0000000000000020
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106799] RBP: ffff88045fcb1d90 R08: ffffffff8159faf0 R09:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106831] R10: 0000000000000000 R11: 0000000000000006 R12:
>>> 000000000000c620
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106863] R13: ffffffff8159faf0 R14: 0000000000000400 R15:
>>> 0000000000000286
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106896] FS:  00007f66f7754720(0000) GS:ffff88007f800000(0000)
>>> knlGS:0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106944] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.106973] CR2: 0000000000e64048 CR3: 000000045ea45000 CR4:
>>> 00000000000006f0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.107005] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.107037] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>> 0000000000000400
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.107070] Process kworker/0:1 (pid: 10, threadinfo
>>> ffff88045fcb0000, task ffff88045fcaae70)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.107117] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.107138]  ffffffff00000000 0000000000000000 ffff88045fcb1d70
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  6b6b6b6b6b6b6b6b ffff88007f814e00 ffffffff81008ba0
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  ffff88045fcb1da0 ffffffff81062c12 ffff88045fcb1dc0
>>> ffffffff8105fb3c
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff8105fb3c>]
>>> arch_trigger_all_cpu_backtrace+0x3c/0x70
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810a971b>] process_one_work+0x11b/0x450
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810a9e97>] worker_thread+0x157/0x410
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81078519>] ? __wake_up_common+0x59/0x90
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810a9d40>] ? worker_thread+0x0/0x410
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810ad8f6>] kthread+0x96/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810ad860>] ? kthread+0x0/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011] Code: 83 fb 02 44 89 f0 0f 45 c3 89 04 25 00 c3 5f ff
>>> eb 9e 4c 89 ff 57 9d 66 66 90 66 90 48 83 c4 18 5b 41 5c 41 5d 41 5e
>>> 41 5f c9 c3<48>   8b 05 4e fb 53 00 48 89 55 c8 89 4d c0 ff 90 58 01
>>> 00 00 48
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff8105fb3c>]
>>> arch_trigger_all_cpu_backtrace+0x3c/0x70
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810a971b>] process_one_work+0x11b/0x450
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810a9e97>] worker_thread+0x157/0x410
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81078519>] ? __wake_up_common+0x59/0x90
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810a9d40>] ? worker_thread+0x0/0x410
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810ad8f6>] kthread+0x96/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810ad860>] ? kthread+0x0/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011] Pid: 10, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]<NMI>    [<ffffffff8104a786>] ? show_regs+0x26/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff813be5f0>] nmi+0x20/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff8105fa4b>] ?
>>> default_send_IPI_mask_sequence_phys+0xbb/0xe0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]<<EOE>>    [<ffffffff81008ba0>] ? irqfd_inject+0x0/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81062c12>] physflat_send_IPI_all+0x12/0x20
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff8105fb3c>]
>>> arch_trigger_all_cpu_backtrace+0x3c/0x70
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81008c2f>] irqfd_inject+0x8f/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810a971b>] process_one_work+0x11b/0x450
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810a9e97>] worker_thread+0x157/0x410
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81078519>] ? __wake_up_common+0x59/0x90
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810a9d40>] ? worker_thread+0x0/0x410
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810ad8f6>] kthread+0x96/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81041c64>] kernel_thread_helper+0x4/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff810ad860>] ? kthread+0x0/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108011]  [<ffffffff81041c60>] ? kernel_thread_helper+0x0/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110243] NMI backtrace for cpu 3
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110272] CPU 3
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110280] Modules linked in: btrfs zlib_deflate crc32c
>>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>>> ehci_hcd [last unloaded: scsi_wait_sca
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.110882]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110906] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110970] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>>> native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111030] RSP: 0018:ffff88045fcd3ea8  EFLAGS: 00000246
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111059] RAX: 0000000000000000 RBX: 0000000000000003 RCX:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111091] RDX: 0000000000000000 RSI: ffff88045fcd3ee4 RDI:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111123] RBP: ffff88045fcd3ea8 R08: 0000000000000000 R09:
>>> 0000000000000001
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111155] R10: 0000000000000000 R11: 0000000000000001 R12:
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111186] R13: 0000000000000003 R14: 0000000000000000 R15:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111220] FS:  00007fb1eafc6740(0000) GS:ffff88087fc40000(0000)
>>> knlGS:0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111268] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111297] CR2: 00007ff12a981de0 CR3: 000000045569f000 CR4:
>>> 00000000000006e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111329] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111362] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>> 0000000000000400
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111395] Process kworker/0:1 (pid: 0, threadinfo
>>> ffff88045fcd2000, task ffff88045fcca820)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111442] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111463]  ffff88045fcd3ec8 ffffffff8104a016 ffff88045fcd3ee4
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111515]  ffff88045fcd3ef8 ffffffff8104a168 ffff88045fcd3ee8
>>> 00000000810b3255
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111566]  ffff88045fcd2010 ffffffff8159faf0 ffff88045fcd3f28
>>> ffffffff8104003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111618] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111648]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111680]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111712]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111745]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111774] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>>> 89 e5 fb f4<c9>   c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>>> 0f 1f 84
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111982] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112007]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112038]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112069]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112099]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112131] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112176] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112198]<NMI>    [<ffffffff8104a786>] ? show_regs+0x26/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112238]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112272]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112303]  [<ffffffff813be5f0>] nmi+0x20/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112332]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112361]<<EOE>>    [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112399]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112430]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112460]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112024] NMI backtrace for cpu 2
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112024] CPU 2
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112024] Modules linked in: btrfs zlib_deflate crc32c
>>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>>> ehci_hcd [last unloaded: scsi_wait_sca
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>>> native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] RSP: 0018:ffff88045fcc5ea8  EFLAGS: 00000246
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] RAX: 0000000000000000 RBX: 0000000000000002 RCX:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] RDX: 0000000000000000 RSI: ffff88045fcc5ee4 RDI:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] RBP: ffff88045fcc5ea8 R08: 0000000000000000 R09:
>>> 0000000000000001
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] R10: 0000000000000000 R11: 0000000000000000 R12:
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] R13: 0000000000000002 R14: 0000000000000000 R15:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] FS:  00007f66f7754720(0000) GS:ffff88007f840000(0000)
>>> knlGS:0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] CR2: 00007f241ad1f0b8 CR3: 000000045ea45000 CR4:
>>> 00000000000006f0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>> 0000000000000400
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] Process kworker/0:1 (pid: 0, threadinfo
>>> ffff88045fcc4000, task ffff88045fcb87e0)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112616] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  ffff88045fcc5ec8 ffffffff8104a016 ffff88045fcc5ee4
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  ffff88045fcc5ef8 ffffffff8104a168 ffff88045fcc5ee8
>>> 00000000810b3255
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  ffff88045fcc4010 ffffffff8159faf0 ffff88045fcc5f28
>>> ffffffff8104003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>>> 89 e5 fb f4<c9>   c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>>> 0f 1f 84
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]<NMI>    [<ffffffff8104a786>] ? show_regs+0x26/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff813be5f0>] nmi+0x20/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]<<EOE>>    [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112616]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] NMI backtrace for cpu 1
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] CPU 1
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] Modules linked in: btrfs zlib_deflate crc32c
>>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>>> ehci_hcd [last unloaded: scsi_wait_sca
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] Pid: 0, comm: kworker/0:0 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>>> native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] RSP: 0018:ffff88045fcb3ea8  EFLAGS: 00000246
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] RAX: 0000000000000000 RBX: 0000000000000001 RCX:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] RDX: 0000000000000000 RSI: ffff88045fcb3ee4 RDI:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] RBP: ffff88045fcb3ea8 R08: 0000000000000000 R09:
>>> ffff88087fc0e408
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] R10: 000028ce70db0d2f R11: 0000000000000001 R12:
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] R13: 0000000000000001 R14: 0000000000000000 R15:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] FS:  00007fb8e1893710(0000) GS:ffff88087fc00000(0000)
>>> knlGS:0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] CR2: 00007f241aca71a0 CR3: 000000045ed50000 CR4:
>>> 00000000000006e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>> 0000000000000400
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] Process kworker/0:0 (pid: 0, threadinfo
>>> ffff88045fcb2000, task ffff88045fcaa7a0)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112285] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  ffff88045fcb3ec8 ffffffff8104a016 ffff88045fcb3ee4
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  ffff88045fcb3ef8 ffffffff8104a168 ffff88045fcb3ee8
>>> 00000000810b3255
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  ffff88045fcb2010 ffffffff8159faf0 ffff88045fcb3f28
>>> ffffffff8104003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>>> 89 e5 fb f4<c9>   c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>>> 0f 1f 84
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]<NMI>    [<ffffffff8104a786>] ? show_regs+0x26/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  [<ffffffff813be5f0>] nmi+0x20/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]<<EOE>>    [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112285]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896] Modules linked in: btrfs zlib_deflate crc32c
>>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>>> ehci_hcd [last unloaded: scsi_wait_sca
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896] RAX: 0000000000000000 RBX: 0000000000000005 RCX:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896] RDX: 0000000000000000 RSI: ffff88045fd11ee4 RDI:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896]  ffff88045fd11ef8 ffffffff8104a168 ffff88045fd11ee8
>>> 00000000810b3255
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896]  ffff88045fd10010 ffffffff8159faf0 ffff88045fd11f28
>>> ffffffff8104003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.110896] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>>> 89 e5 fb f4<c9>   c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>>> 0f 1f 84
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.119695] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.119695]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.119695]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.119695]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.119985]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.119985] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.119985] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.119985]<NMI>    [<ffffffff8104a786>] ? show_regs+0x26/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120119]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120164]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018] CR2: 00007f241ad1f0b8 CR3: 000000045ed50000 CR4:
>>> 00000000000006e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>> 0000000000000400
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018] Process kworker/0:1 (pid: 0, threadinfo
>>> ffff88045fd00000, task ffff88045fcd8860)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.112018] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018]  ffff88045fd01ec8 ffffffff8104a016 ffff88045fd01ee4
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018]  ffff88045fd01ef8 ffffffff8104a168 ffff88045fd01ee8
>>> 00000000810b3255
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018]  ffff88045fd00010 ffffffff8159faf0 ffff88045fd01f28
>>> ffffffff8104003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018]  [<ffffffff813be5f0>] nmi+0x20/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.112018]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.123585] NMI backtrace for cpu 7
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.124502] RAX: 0000000000000000 RBX: 0000000000000007 RCX:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.125007] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.125206] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015] Modules linked in: btrfs zlib_deflate crc32c
>>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>>> ehci_hcd [last unloaded: scsi_wait_sca
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>>> native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015] RSP: 0018:ffff88045fd23ea8  EFLAGS: 00000246
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015] RAX: 0000000000000000 RBX: 0000000000000006 RCX:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015] RDX: 0000000000000000 RSI: ffff88045fd23ee4 RDI:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015] RBP: ffff88045fd23ea8 R08: 0000000000000000 R09:
>>> ffff88007f8ce408
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015] R10: 0000000000000000 R11: 0000000000000001 R12:
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108015] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015]  ffff88045fd23ec8 ffffffff8104a016 ffff88045fd23ee4
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015]  [<ffffffff813be5f0>] nmi+0x20/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108015]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] Modules linked in: btrfs zlib_deflate crc32c
>>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>>> ehci_hcd [last unloaded: scsi_wait_sca
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] R10: 000028ce766a74a3 R11: 0000000000000001 R12:
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] R13: 0000000000000009 R14: 0000000000000000 R15:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] FS:  00007fa0cb316710(0000) GS:ffff88087fd00000(0000)
>>> knlGS:0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] CR2: 0000000000e64048 CR3: 000000045ea45000 CR4:
>>> 00000000000006e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>> 0000000000000400
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] Process kworker/0:1 (pid: 0, threadinfo
>>> ffff88045fd6e000, task ffff88045fd669a0)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.126621] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  ffff88045fd6fec8 ffffffff8104a016 ffff88045fd6fee4
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  ffff88045fd6fef8 ffffffff8104a168 ffff88045fd6fee8
>>> 00000000810b3255
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  ffff88045fd6e010 ffffffff8159faf0 ffff88045fd6ff28
>>> ffffffff8104003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>>> 89 e5 fb f4<c9>   c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>>> 0f 1f 84
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]<NMI>    [<ffffffff8104a786>] ? show_regs+0x26/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff813be5f0>] nmi+0x20/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]<<EOE>>    [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.126621]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] NMI backtrace for cpu 11
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] CPU 11
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] Modules linked in: btrfs zlib_deflate crc32c
>>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>>> ehci_hcd [last unloaded: scsi_wait_sca
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>>> native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] RSP: 0018:ffff88045fd8fea8  EFLAGS: 00000246
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] RAX: 0000000000000000 RBX: 000000000000000b RCX:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] RDX: 0000000000000000 RSI: ffff88045fd8fee4 RDI:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] RBP: ffff88045fd8fea8 R08: 0000000000000000 R09:
>>> ffff88087fd4e408
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] R10: 000028ce71c3578e R11: 0000000000000001 R12:
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] R13: 000000000000000b R14: 0000000000000000 R15:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] FS:  00007fa0ce156740(0000) GS:ffff88087fd40000(0000)
>>> knlGS:0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] CR2: 00007f2421c3eae0 CR3: 000000045ea45000 CR4:
>>> 00000000000006e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>> 0000000000000400
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] Process kworker/0:1 (pid: 0, threadinfo
>>> ffff88045fd8e000, task ffff88045fd86a20)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.111333] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  ffff88045fd8fec8 ffffffff8104a016 ffff88045fd8fee4
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  ffff88045fd8fef8 ffffffff8104a168 ffff88045fd8fee8
>>> 00000000810b3255
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  ffff88045fd8e010 ffffffff8159faf0 ffff88045fd8ff28
>>> ffffffff8104003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>>> 89 e5 fb f4<c9>   c3 0f 1f 84 00 00 00 00 00 55 48 89 e5 f4 c9 c3 66
>>> 0f 1f 84
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]<NMI>    [<ffffffff8104a786>] ? show_regs+0x26/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff813be5f0>] nmi+0x20/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]<<EOE>>    [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.111333]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] NMI backtrace for cpu 8
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] CPU 8
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] Modules linked in: btrfs zlib_deflate crc32c
>>> libcrc32c ufs qnx4 hfsplus hfs minix ntfs vfat msdos fat jfs
>>> reiserfs ext4 jbd2 crc16 ext3 jbd vhost_net macvtap macvlan tun veth
>>> powernow_k8 mperf cpufreq_userspace cpufreq_stats cpufreq_powersave
>>> cpufreq_ondemand freq_table cpufreq_conservative fuse xt_physdev
>>> ip6t_LOG ip6table_filter ip6_tables ipt_LOG xt_multiport xt_limit
>>> xt_tcpudp xt_state iptable_filter ip_tables x_tables
>>> nf_conntrack_tftp nf_conntrack_ftp nf_conntrack_ipv4 nf_defrag_ipv4
>>> 8021q bridge stp ext2 mbcache dm_round_robin dm_multipath
>>> nf_conntrack_ipv6 nf_conntrack nf_defrag_ipv6 ipv6 snd_pcm snd_timer
>>> snd soundcore snd_page_alloc shpchp i2c_nforce2 tpm_tis tpm
>>> pci_hotplug psmouse evdev i2c_core tpm_bios dcdbas pcspkr joydev
>>> ghes serio_raw processor thermal_sys hed button xfs exportfs dm_mod
>>> sg sr_mod cdrom usbhid hid usb_storage ses sd_mod enclosure lpfc
>>> scsi_transport_fc ohci_hcd scsi_tgt megaraid_sas scsi_mod bnx2
>>> ehci_hcd [last unloaded: scsi_wait_sca
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: n]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010]
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17 Dell Inc. PowerEdge M605/0K543T
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] RIP: 0010:[<ffffffff81066716>]  [<ffffffff81066716>]
>>> native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] RSP: 0018:ffff88045fd63ea8  EFLAGS: 00000246
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] RAX: 0000000000000000 RBX: 0000000000000008 RCX:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] RDX: 0000000000000000 RSI: ffff88045fd63ee4 RDI:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] RBP: ffff88045fd63ea8 R08: 0000000000000000 R09:
>>> ffff88007f90e408
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] R10: 0000000000000000 R11: 0000000000000001 R12:
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] R13: 0000000000000008 R14: 0000000000000000 R15:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] FS:  00007fb8e0891710(0000) GS:ffff88007f900000(0000)
>>> knlGS:0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] CR2: 0000000000e63f28 CR3: 000000045ed50000 CR4:
>>> 00000000000006e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>> 0000000000000400
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] Process kworker/0:1 (pid: 0, threadinfo
>>> ffff88045fd62000, task ffff88045fd34960)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.108010] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010]  ffff88045fd63ec8 ffffffff8104a016 ffff88045fd63ee4
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010]  ffff88045fd63ef8 ffffffff8104a168 ffff88045fd63ee8
>>> 00000000810b3255
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010]  ffff88045fd62010 ffffffff8159faf0 ffff88045fd63f28
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136088] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136098]
>>> irqfd_deactivate(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] Code: 00 00 00 00 00 55 48 89 e5 fa c9 c3 66 0f 1f 84
>>> 00 00 00 00 00 55 48 89 e5 fb c9 c3 66 0f 1f 84 00 00 00 00 00 55 48
>>> 89 e5 fb f4<c9>   c3 0f
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136661] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136665]
>>> irqfd_deactivate(irqfd=ffff880810a21e00,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136702] irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136709] remove wq at
>>> irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136715] kfree at
>>> irqfd_shutdown(work=ffff880810a21e80,irqfd=ffff880810a21e00)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] 1f 84 00 00 00
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136910]
>>> kvm_irqfd_assign(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] 00 00 55 48 89 e5 f4 c9 c3 66 0f 1f 84
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010]  [<ffffffff8104a168>] c1e_idle+0x58/0x120
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.108010]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136975] Pid: 0, comm: kworker/0:1 Not tainted
>>> 2.6.37.2-patchjp-110308-c+ #17
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136975] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136975]<NMI>    [<ffffffff8104a786>] ? show_regs+0x26/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136975]  [<ffffffff8105fde1>] nmi_watchdog_tick+0x191/0x1b0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136975]  [<ffffffff813be5f0>] nmi+0x20/0x30
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.136975]  [<ffffffff81066716>] ? native_safe_halt+0x6/0x10
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004] FS:  00007f2787814700(0000) GS:ffff88007f940000(0000)
>>> knlGS:0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004] CR2: 0000000000e63f28 CR3: 000000045ea45000 CR4:
>>> 00000000000006e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
>>> 0000000000000000
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
>>> 0000000000000400
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004] Process kworker/0:1 (pid: 0, threadinfo
>>> ffff88045fd80000, task ffff88045fd769e0)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel: [44867.120004] Stack:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004]  ffff88045fd81ec8 ffffffff8104a016 ffff88045fd81ee4
>>> ffffffff8159faf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004]  ffff88045fd81ef8 ffffffff8104a168 ffff88045fd81ee8
>>> 00000000810b3255
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004]  ffff88045fd80010 ffffffff8159faf0 ffff88045fd81f28
>>> ffffffff8104003b
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004] Call Trace:
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004]  [<ffffffff8104a016>] default_idle+0x46/0xa0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004]  [<ffffffff8104003b>] cpu_idle+0x6b/0xf0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004]  [<ffffffff81042ef1>] do_nmi+0x1c1/0x2e0
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.120004]  [<ffffffff813b7247>] start_secondary+0x1b9/0x1be
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.148658] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.148687]
>>> irqfd_deactivate(irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.148759] irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.148814] remove wq at
>>> irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.148862] kfree at
>>> irqfd_shutdown(work=ffff880853b8cb20,irqfd=ffff880853b8caa0)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.149086]
>>> kvm_irqfd_assign(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.149379] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=48)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.149416]
>>> irqfd_deactivate(irqfd=ffff88045efd3740,kvm=ffff8804542d0000,
>>> gsi=48)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.149540] irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740,kvm=ffff8804542d0000,
>>> gsi=48)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.149594] remove wq at
>>> irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.149643] kfree at
>>> irqfd_shutdown(work=ffff88045efd37c0,irqfd=ffff88045efd3740)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.149922]
>>> kvm_irqfd_assign(irqfd=ffff88080f7aa818,kvm=ffff8804542d0000,
>>> gsi=48)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.171869] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.171907]
>>> irqfd_deactivate(irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.171989] irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.172111] remove wq at
>>> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.172160] kfree at
>>> irqfd_shutdown(work=ffff88081a190bf8,irqfd=ffff88081a190b78)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.172493]
>>> kvm_irqfd_assign(irqfd=ffff88083b062308,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.172672] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.172710]
>>> irqfd_deactivate(irqfd=ffff88083b062308,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.172782] irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.172836] remove wq at
>>> irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.172884] kfree at
>>> irqfd_shutdown(work=ffff88083b062388,irqfd=ffff88083b062308)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.173074]
>>> kvm_irqfd_assign(irqfd=ffff88081a190230,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.175303] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.175339]
>>> irqfd_deactivate(irqfd=ffff88081a190230,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.175466] irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.175521] remove wq at
>>> irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.175569] kfree at
>>> irqfd_shutdown(work=ffff88081a1902b0,irqfd=ffff88081a190230)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.175769]
>>> kvm_irqfd_assign(irqfd=ffff88045eabb668,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.176002] kvm_irqfd_deassign(kvm=ffff8804542d0000, gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.176058]
>>> irqfd_deactivate(irqfd=ffff88045eabb668,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.176122] irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668,kvm=ffff8804542d0000,
>>> gsi=24)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.176177] remove wq at
>>> irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.176225] kfree at
>>> irqfd_shutdown(work=ffff88045eabb6e8,irqfd=ffff88045eabb668)
>>> Mar 10 03:57:13 ayrshire.u06.univ-nantes.prive kernel:
>>> [44867.176427]
>>> kvm_irqfd_assign(irqfd=ffff88045ed96c50,kvm=ffff8804542d0000, gsi=24
>>>
>>>
>>> You can find all the trace at the following adress:
>>> http://filex.univ-nantes.fr/get?k=R94kna5sckVmdvCoKsn
>>>
>>> It's a tar.gz of seven file, from 100k to 200k each ;)
>>>
>>> Again, thanks a lot for the time you spent on this.
>>>
>>> Regards.
>> Are you running a preemptible kernel?
>> Does the following help at all?
>>
>> diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
>> index 2ca4535..cdf51c9 100644
>> --- a/virt/kvm/eventfd.c
>> +++ b/virt/kvm/eventfd.c
>> @@ -90,7 +90,7 @@ irqfd_shutdown(struct work_struct *work)
>>    	 * We know no new events will be scheduled at this point, so block
>>    	 * until all previously outstanding events have completed
>>    	 */
>> -	flush_work(&irqfd->inject);
>> +	flush_work_sync(&irqfd->inject);
>>
>>    	/*
>>    	 * It is now safe to release the object's resources
>>
> Hi,
>
> thanks for the response.
>
> root@ayrshire:~# zcat /proc/config.gz | grep -i preempt
> # CONFIG_PREEMPT_RCU is not set
> CONFIG_PREEMPT_NOTIFIERS=y
> CONFIG_PREEMPT_NONE=y
> # CONFIG_PREEMPT_VOLUNTARY is not set
> # CONFIG_PREEMPT is not set
>
> It does not seem to be a preemptible kernel.
>
> I will test tour patch, and report the result.
>
> Regards.
>
Hi,

i reboot the host with the "flush_work_sync", yesterday at lunchtime.
I haven't see "Eventfd bug detected" or  "Wakeup bug detected" until now.

The modification seem to do the trick.

So, if my understand is correct, flush_work flush the last irqfd, but in 
my case, antoher irqfd was still queued to a cpu?
Is that right?

Regards.

-- 
Jean-Philippe Menil - Pôle réseau Service IRTS
DSI Université de Nantes
jean-philippe.menil@univ-nantes.fr
Tel : 02.53.48.49.27 - Fax : 02.53.48.49.09


^ permalink raw reply	[flat|nested] 27+ messages in thread

* Re: Bug inkvm_set_irq
  2011-03-17  8:00                                               ` Jean-Philippe Menil
@ 2011-03-17  8:21                                                 ` Michael S. Tsirkin
  0 siblings, 0 replies; 27+ messages in thread
From: Michael S. Tsirkin @ 2011-03-17  8:21 UTC (permalink / raw)
  To: Jean-Philippe Menil; +Cc: netdev, kvm, virtualization

On Thu, Mar 17, 2011 at 09:00:30AM +0100, Jean-Philippe Menil wrote:
> >>Are you running a preemptible kernel?
> >>Does the following help at all?
> >>
> >>diff --git a/virt/kvm/eventfd.c b/virt/kvm/eventfd.c
> >>index 2ca4535..cdf51c9 100644
> >>--- a/virt/kvm/eventfd.c
> >>+++ b/virt/kvm/eventfd.c
> >>@@ -90,7 +90,7 @@ irqfd_shutdown(struct work_struct *work)
> >>   	 * We know no new events will be scheduled at this point, so block
> >>   	 * until all previously outstanding events have completed
> >>   	 */
> >>-	flush_work(&irqfd->inject);
> >>+	flush_work_sync(&irqfd->inject);
> >>
> >>   	/*
> >>   	 * It is now safe to release the object's resources
> >>
> >Hi,
> >
> >thanks for the response.
> >
> >root@ayrshire:~# zcat /proc/config.gz | grep -i preempt
> ># CONFIG_PREEMPT_RCU is not set
> >CONFIG_PREEMPT_NOTIFIERS=y
> >CONFIG_PREEMPT_NONE=y
> ># CONFIG_PREEMPT_VOLUNTARY is not set
> ># CONFIG_PREEMPT is not set
> >
> >It does not seem to be a preemptible kernel.
> >
> >I will test tour patch, and report the result.
> >
> >Regards.
> >
> Hi,
> 
> i reboot the host with the "flush_work_sync", yesterday at lunchtime.
> I haven't see "Eventfd bug detected" or  "Wakeup bug detected" until now.
> 
> The modification seem to do the trick.
> 
> So, if my understand is correct, flush_work flush the last irqfd,
> but in my case, antoher irqfd was still queued to a cpu?
> Is that right?
> 
> Regards.

Yes, it says:

 * flush_work - wait for a work to finish executing the last queueing instance
 * @work: the work to flush
 *
 * Wait until @work has finished execution.  This function considers
 * only the last queueing instance of @work.  If @work has been
 * enqueued across different CPUs on a non-reentrant workqueue or on
 * multiple workqueues, @work might still be executing on return on
 * some of the CPUs from earlier queueing.
 *
 * If @work was queued only on a non-reentrant, ordered or unbound
 * workqueue, @work is guaranteed to be idle on return if it hasn't
 * been requeued since flush started.

kvm uses the default workqueue which is non-reentrant.
Thanks to Gleb for the suggestion!

-- 
MST

^ permalink raw reply	[flat|nested] 27+ messages in thread

end of thread, other threads:[~2011-03-17  8:21 UTC | newest]

Thread overview: 27+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2011-02-25  9:07 Bug inkvm_set_irq Jean-Philippe Menil
2011-02-25 10:36 ` Gleb Natapov
2011-02-27 17:00 ` Michael S. Tsirkin
2011-02-28  8:56   ` Jean-Philippe Menil
2011-02-28 10:11     ` Michael S. Tsirkin
2011-02-28 10:40       ` Jean-Philippe Menil
2011-02-28 11:39         ` Michael S. Tsirkin
2011-02-28 15:13           ` Jean-Philippe Menil
2011-02-28 22:34             ` Jean-Philippe Menil
2011-03-01  7:03               ` Michael S. Tsirkin
2011-03-01 14:39                 ` Jean-Philippe Menil
2011-03-03 14:47                   ` Michael S. Tsirkin
2011-03-03 15:26                     ` Jean-Philippe Menil
2011-03-03 15:55                       ` Michael S. Tsirkin
2011-03-04  9:22                         ` Jean-Philippe Menil
2011-03-04  9:35                           ` Michael S. Tsirkin
2011-03-04  9:39                             ` Jean-Philippe Menil
2011-03-08 11:13                               ` Michael S. Tsirkin
2011-03-09 12:28                                 ` Jean-Philippe Menil
2011-03-09 13:00                                   ` Michael S. Tsirkin
2011-03-09 13:12                                     ` Jean-Philippe Menil
2011-03-09 13:59                                       ` Michael S. Tsirkin
2011-03-10  8:42                                         ` Jean-Philippe Menil
2011-03-15 14:32                                           ` Michael S. Tsirkin
2011-03-15 14:58                                             ` Jean-Philippe Menil
2011-03-17  8:00                                               ` Jean-Philippe Menil
2011-03-17  8:21                                                 ` Michael S. Tsirkin

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).