All of lore.kernel.org
 help / color / mirror / Atom feed
* kernel BUG at mm/page_alloc.c:424!
  2009-08-04 18:36 main.c:674: undefined reference to `xen_init_mtrr' Nathan Stratton
@ 2009-08-04 19:04 ` Nathan Stratton
  0 siblings, 0 replies; 11+ messages in thread
From: Nathan Stratton @ 2009-08-04 19:04 UTC (permalink / raw)
  To: xen-devel


[root@cbridge1 etc]# ------------[ cut here ]------------
kernel BUG at mm/page_alloc.c:424!
invalid opcode: 0000 [#1] SMP
last sysfs file: /sys/devices/vif-0/net/eth0/tx_queue_len
CPU 2
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last 
unloaded: scsi_wait_scan]
Pid: 1182, comm: texgrid Tainted: G        W  2.6.29.4-167.fc11.x86_64 #1
RIP: e030:[<ffffffff810a2eb1>]  [<ffffffff810a2eb1>] 
__free_one_page+0x146/0x1e6
RSP: e02b:ffff88007ddc3a38  EFLAGS: 00010002
RAX: ffffe2000194d290 RBX: ffffe2000194d2c8 RCX: ffffe2000194d290
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff880000008880
RBP: ffff88007ddc3a88 R08: 000000000000001e R09: 0000000000000006
R10: 0000000000000000 R11: 0000000000009f20 R12: 0000000000000000
R13: ffff880000008880 R14: 000000000000029f R15: 0000000000000002
FS:  00007f8b5cbb8910(0000) GS:ffff88007e84c700(0000) 
knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f8b50bb3da8 CR3: 000000007b19d000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process texgrid (pid: 1182, threadinfo ffff88007ddc2000, task 
ffff88007db41700)
Stack:
  ffffe2000194d638 0000000000000004 ffffe20001948868 0000000100000018
  ffff88007e84c590 ffff880000008880 0000000000000002 ffff88007e84c590
  ffffe2000194d2c8 0000000000000000 ffff88007ddc3ab8 ffffffff810a4187
Call Trace:
  [<ffffffff810a4187>] free_pages_bulk.clone.2+0x57/0x72
  [<ffffffff810a4290>] free_hot_cold_page+0xee/0x130
  [<ffffffff810a4338>] free_hot_page+0x10/0x12
  [<ffffffff810a7d49>] put_page+0x91/0x9e
  [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb
  [<ffffffff81308c5a>] skb_release_data+0x77/0xce
  [<ffffffff81308919>] __kfree_skb+0x1e/0x81
  [<ffffffff813089a9>] consume_skb+0x2d/0x2f
  [<ffffffff8130b39b>] skb_free_datagram+0x19/0x3f
  [<ffffffff8135987c>] udp_recvmsg+0x1dc/0x262
  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
  [<ffffffff81303f22>] sock_common_recvmsg+0x39/0x4a
  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
  [<ffffffff81301e71>] __sock_recvmsg+0x71/0x7d
  [<ffffffff81302544>] sock_recvmsg+0xcf/0xe8
  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
  [<ffffffff8105ca4b>] ? autoremove_wake_function+0x0/0x39
  [<ffffffff8100e86f>] ? __xen_spin_lock+0xb7/0xcd
  [<ffffffff8104de90>] ? __local_bh_disable+0xa7/0xaf
  [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb
  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
  [<ffffffff8136092d>] ? inet_ioctl+0xa5/0xa7
  [<ffffffff81301c74>] ? sock_ioctl+0x1f3/0x216
  [<ffffffff81301fb5>] ? sockfd_lookup_light+0x20/0x58
  [<ffffffff813036a1>] sys_recvfrom+0xad/0xf7
  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
  [<ffffffff8100dad7>] ? xen_clocksource_read+0x21/0x23
  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b
Code: 10 48 89 d6 48 c1 ee 35 39 f1 75 29 f7 c2 00 00 04 00 74 21 49 63 cc 
48 39 48 10 75 18 80 e6 40 48 0f 44 c8 8b 51 08 85 d2 74 43 <0f> 0b eb fe 
41 83 fc 09 76 a5 49 63 c4 48 89 43 10 0f ba 2b 12
RIP  [<ffffffff810a2eb1>] __free_one_page+0x146/0x1e6
  RSP <ffff88007ddc3a38>
---[ end trace 7d5f534b65d69935 ]---

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:------------[ cut here ]------------

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:invalid opcode: 0000 [#1] SMP

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:last sysfs file: /sys/devices/vif-0/net/eth0/tx_queue_len

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:Stack:

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: ffff88007e84c590 ffff880000008880 0000000000000002 
ffff88007e84c590

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: ffffe2000194d2c8 0000000000000000 ffff88007ddc3ab8 
ffffffff810a4187

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:Call Trace:

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff810a4187>] free_pages_bulk.clone.2+0x57/0x72

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff810a4290>] free_hot_cold_page+0xee/0x130

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff810a4338>] free_hot_page+0x10/0x12

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff810a7d49>] put_page+0x91/0x9e

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81308c5a>] skb_release_data+0x77/0xce

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81308919>] __kfree_skb+0x1e/0x81

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff813089a9>] consume_skb+0x2d/0x2f

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8130b39b>] skb_free_datagram+0x19/0x3f

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8135987c>] udp_recvmsg+0x1dc/0x262

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81303f22>] sock_common_recvmsg+0x39/0x4a

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81301e71>] __sock_recvmsg+0x71/0x7d

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81302544>] sock_recvmsg+0xcf/0xe8

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8105ca4b>] ? autoremove_wake_function+0x0/0x39

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8100e86f>] ? __xen_spin_lock+0xb7/0xcd

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8104de90>] ? __local_bh_disable+0xa7/0xaf

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8136092d>] ? inet_ioctl+0xa5/0xa7

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81301c74>] ? sock_ioctl+0x1f3/0x216

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81301fb5>] ? sockfd_lookup_light+0x20/0x58

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff813036a1>] sys_recvfrom+0xad/0xf7

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8100dad7>] ? xen_clocksource_read+0x21/0x23

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:Code: 10 48 89 d6 48 c1 ee 35 39 f1 75 29 f7 c2 00 00 04 00 74 21 
49 63 cc 48 39 48 10 75 18 80 e6 40 48 0f 44 c8 8b 51 08 85 d2 74 43 <0f> 
0b eb fe 41 83 fc 09 76 a5 49 63 c4 48 89 43 10 0f ba 2b 12
BUG: soft lockup - CPU#1 stuck for 61s! [rsyslogd:945]
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last 
unloaded: scsi_wait_scan]
CPU 1:
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last 
unloaded: scsi_wait_scan]
Pid: 945, comm: rsyslogd Tainted: G      D W  2.6.29.4-167.fc11.x86_64 #1
RIP: e030:[<ffffffff810093aa>]  [<ffffffff810093aa>] _stext+0x3aa/0x1000
RSP: e02b:ffff88007b069b28  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff880000008ad0 RCX: ffffffff810093aa
RDX: ffff88007b069b5c RSI: ffff88007b069b40 RDI: 0000000000000003
RBP: ffff88007b069b60 R08: 0000000000000000 R09: 0000000000000001
R10: 000000000000037b R11: 0000000000000206 R12: 0000000000000007
R13: 0000000000000001 R14: 0000000000000000 R15: 000000000000fd60
FS:  00007fca23fff910(0000) GS:ffff88007f3ab400(0000) 
knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000001657000 CR3: 000000007b05b000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
  [<ffffffff81220cff>] ? xen_poll_irq+0x44/0x4e
  [<ffffffff8100e70e>] xen_spin_lock_slow+0xdf/0x189
  [<ffffffff8100e851>] __xen_spin_lock+0x99/0xcd
  [<ffffffff8100e895>] xen_spin_lock_flags+0x10/0x12
  [<ffffffff813abd6c>] _spin_lock_irqsave+0x32/0x3b
  [<ffffffff810a4a12>] get_page_from_freelist+0x368/0x699
  [<ffffffff810a4e35>] __alloc_pages_internal+0xf2/0x429
  [<ffffffff8100ac98>] ? xen_mc_issue+0x62/0x67
  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
  [<ffffffff810c7355>] alloc_pages_current+0xb7/0xc0
  [<ffffffff810a3789>] __get_free_pages+0x13/0x4e
  [<ffffffff81046c5a>] copy_process+0xbb/0x1332
  [<ffffffff81301f93>] ? fput_light+0x12/0x14
  [<ffffffff813036d5>] ? sys_recvfrom+0xe1/0xf7
  [<ffffffff8100e5dc>] ? xen_spin_unlock+0x11/0x2d
  [<ffffffff8104801c>] do_fork+0x14b/0x313
  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
  [<ffffffff813ab88d>] ? trace_hardirqs_off_thunk+0x3a/0x6c
  [<ffffffff8100f605>] sys_clone+0x28/0x2a
  [<ffffffff810117e3>] stub_clone+0x13/0x20
  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b
BUG: soft lockup - CPU#1 stuck for 61s! [rsyslogd:945]
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last 
unloaded: scsi_wait_scan]
CPU 1:
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last 
unloaded: scsi_wait_scan]
Pid: 945, comm: rsyslogd Tainted: G      D W  2.6.29.4-167.fc11.x86_64 #1
RIP: e030:[<ffffffff810093aa>]  [<ffffffff810093aa>] _stext+0x3aa/0x1000
RSP: e02b:ffff88007b069b28  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff880000008ad0 RCX: ffffffff810093aa
RDX: ffff88007b069b5c RSI: ffff88007b069b40 RDI: 0000000000000003
RBP: ffff88007b069b60 R08: 0000000000000000 R09: 0000000000000001
R10: 000000000000037b R11: 0000000000000206 R12: 0000000000000007
R13: 0000000000000001 R14: 0000000000000000 R15: 000000000001fd5b
FS:  00007fca23fff910(0000) GS:ffff88007f3ab400(0000) 
knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000001657000 CR3: 000000007b05b000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
  [<ffffffff81220cff>] ? xen_poll_irq+0x44/0x4e
  [<ffffffff8100e70e>] xen_spin_lock_slow+0xdf/0x189
  [<ffffffff8100e851>] __xen_spin_lock+0x99/0xcd
  [<ffffffff8100e895>] xen_spin_lock_flags+0x10/0x12
  [<ffffffff813abd6c>] _spin_lock_irqsave+0x32/0x3b
  [<ffffffff810a4a12>] get_page_from_freelist+0x368/0x699
  [<ffffffff810a4e35>] __alloc_pages_internal+0xf2/0x429
  [<ffffffff8100ac98>] ? xen_mc_issue+0x62/0x67
  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
  [<ffffffff810c7355>] alloc_pages_current+0xb7/0xc0
  [<ffffffff810a3789>] __get_free_pages+0x13/0x4e
  [<ffffffff81046c5a>] copy_process+0xbb/0x1332
  [<ffffffff81301f93>] ? fput_light+0x12/0x14
  [<ffffffff813036d5>] ? sys_recvfrom+0xe1/0xf7
  [<ffffffff8100e5dc>] ? xen_spin_unlock+0x11/0x2d
  [<ffffffff8104801c>] do_fork+0x14b/0x313
  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
  [<ffffffff813ab88d>] ? trace_hardirqs_off_thunk+0x3a/0x6c
  [<ffffffff8100f605>] sys_clone+0x28/0x2a
  [<ffffffff810117e3>] stub_clone+0x13/0x20
  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b
BUG: soft lockup - CPU#1 stuck for 61s! [rsyslogd:945]
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last 
unloaded: scsi_wait_scan]
CPU 1:
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last 
unloaded: scsi_wait_scan]
Pid: 945, comm: rsyslogd Tainted: G      D W  2.6.29.4-167.fc11.x86_64 #1
RIP: e030:[<ffffffff810093aa>]  [<ffffffff810093aa>] _stext+0x3aa/0x1000
RSP: e02b:ffff88007b069b28  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff880000008ad0 RCX: ffffffff810093aa
RDX: ffff88007b069b5c RSI: ffff88007b069b40 RDI: 0000000000000003
RBP: ffff88007b069b60 R08: 0000000000000000 R09: 0000000000000001
R10: 000000000000037b R11: 0000000000000206 R12: 0000000000000007
R13: 0000000000000001 R14: 0000000000000000 R15: 000000000002fd5a
FS:  00007fca23fff910(0000) GS:ffff88007f3ab400(0000) 
knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000001657000 CR3: 000000007b05b000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
  [<ffffffff81220cff>] ? xen_poll_irq+0x44/0x4e
  [<ffffffff8100e70e>] xen_spin_lock_slow+0xdf/0x189
  [<ffffffff8100e851>] __xen_spin_lock+0x99/0xcd
  [<ffffffff8100e895>] xen_spin_lock_flags+0x10/0x12
  [<ffffffff813abd6c>] _spin_lock_irqsave+0x32/0x3b
  [<ffffffff810a4a12>] get_page_from_freelist+0x368/0x699
  [<ffffffff810a4e35>] __alloc_pages_internal+0xf2/0x429
  [<ffffffff8100ac98>] ? xen_mc_issue+0x62/0x67
  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
  [<ffffffff810c7355>] alloc_pages_current+0xb7/0xc0
  [<ffffffff810a3789>] __get_free_pages+0x13/0x4e
  [<ffffffff81046c5a>] copy_process+0xbb/0x1332
  [<ffffffff81301f93>] ? fput_light+0x12/0x14
  [<ffffffff813036d5>] ? sys_recvfrom+0xe1/0xf7
  [<ffffffff8100e5dc>] ? xen_spin_unlock+0x11/0x2d
  [<ffffffff8104801c>] do_fork+0x14b/0x313
  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
  [<ffffffff813ab88d>] ? trace_hardirqs_off_thunk+0x3a/0x6c
  [<ffffffff8100f605>] sys_clone+0x28/0x2a
  [<ffffffff810117e3>] stub_clone+0x13/0x20
  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b


><>
Nathan Stratton                                CTO, BlinkMind, Inc.
nathan at robotics.net                         nathan at blinkmind.com
http://www.robotics.net                        http://www.blinkmind.com

^ permalink raw reply	[flat|nested] 11+ messages in thread

* kernel BUG at mm/page_alloc.c:424!
@ 2009-08-05  0:38 Nathan Stratton
  2009-08-05 13:54 ` Konrad Rzeszutek Wilk
  0 siblings, 1 reply; 11+ messages in thread
From: Nathan Stratton @ 2009-08-05  0:38 UTC (permalink / raw)
  To: xen-devel


[root@cbridge1 etc]# ------------[ cut here ]------------
kernel BUG at mm/page_alloc.c:424!
invalid opcode: 0000 [#1] SMP
last sysfs file: /sys/devices/vif-0/net/eth0/tx_queue_len
CPU 2
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last unloaded: 
scsi_wait_scan]
Pid: 1182, comm: texgrid Tainted: G        W  2.6.29.4-167.fc11.x86_64 #1
RIP: e030:[<ffffffff810a2eb1>]  [<ffffffff810a2eb1>] 
__free_one_page+0x146/0x1e6
RSP: e02b:ffff88007ddc3a38  EFLAGS: 00010002
RAX: ffffe2000194d290 RBX: ffffe2000194d2c8 RCX: ffffe2000194d290
RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff880000008880
RBP: ffff88007ddc3a88 R08: 000000000000001e R09: 0000000000000006
R10: 0000000000000000 R11: 0000000000009f20 R12: 0000000000000000
R13: ffff880000008880 R14: 000000000000029f R15: 0000000000000002
FS:  00007f8b5cbb8910(0000) GS:ffff88007e84c700(0000) knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 00007f8b50bb3da8 CR3: 000000007b19d000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process texgrid (pid: 1182, threadinfo ffff88007ddc2000, task ffff88007db41700)
Stack:
  ffffe2000194d638 0000000000000004 ffffe20001948868 0000000100000018
  ffff88007e84c590 ffff880000008880 0000000000000002 ffff88007e84c590
  ffffe2000194d2c8 0000000000000000 ffff88007ddc3ab8 ffffffff810a4187
Call Trace:
  [<ffffffff810a4187>] free_pages_bulk.clone.2+0x57/0x72
  [<ffffffff810a4290>] free_hot_cold_page+0xee/0x130
  [<ffffffff810a4338>] free_hot_page+0x10/0x12
  [<ffffffff810a7d49>] put_page+0x91/0x9e
  [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb
  [<ffffffff81308c5a>] skb_release_data+0x77/0xce
  [<ffffffff81308919>] __kfree_skb+0x1e/0x81
  [<ffffffff813089a9>] consume_skb+0x2d/0x2f
  [<ffffffff8130b39b>] skb_free_datagram+0x19/0x3f
  [<ffffffff8135987c>] udp_recvmsg+0x1dc/0x262
  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
  [<ffffffff81303f22>] sock_common_recvmsg+0x39/0x4a
  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
  [<ffffffff81301e71>] __sock_recvmsg+0x71/0x7d
  [<ffffffff81302544>] sock_recvmsg+0xcf/0xe8
  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
  [<ffffffff8105ca4b>] ? autoremove_wake_function+0x0/0x39
  [<ffffffff8100e86f>] ? __xen_spin_lock+0xb7/0xcd
  [<ffffffff8104de90>] ? __local_bh_disable+0xa7/0xaf
  [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb
  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
  [<ffffffff8136092d>] ? inet_ioctl+0xa5/0xa7
  [<ffffffff81301c74>] ? sock_ioctl+0x1f3/0x216
  [<ffffffff81301fb5>] ? sockfd_lookup_light+0x20/0x58
  [<ffffffff813036a1>] sys_recvfrom+0xad/0xf7
  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
  [<ffffffff8100dad7>] ? xen_clocksource_read+0x21/0x23
  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b
Code: 10 48 89 d6 48 c1 ee 35 39 f1 75 29 f7 c2 00 00 04 00 74 21 49 63 cc 48 
39 48 10 75 18 80 e6 40 48 0f 44 c8 8b 51 08 85 d2 74 43 <0f> 0b eb fe 41 83 fc 
09 76 a5 49 63 c4 48 89 43 10 0f ba 2b 12
RIP  [<ffffffff810a2eb1>] __free_one_page+0x146/0x1e6
  RSP <ffff88007ddc3a38>
---[ end trace 7d5f534b65d69935 ]---

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:------------[ cut here ]------------

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:invalid opcode: 0000 [#1] SMP

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:last sysfs file: /sys/devices/vif-0/net/eth0/tx_queue_len

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:Stack:

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: ffff88007e84c590 ffff880000008880 0000000000000002 ffff88007e84c590

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: ffffe2000194d2c8 0000000000000000 ffff88007ddc3ab8 ffffffff810a4187

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:Call Trace:

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff810a4187>] free_pages_bulk.clone.2+0x57/0x72

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff810a4290>] free_hot_cold_page+0xee/0x130

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff810a4338>] free_hot_page+0x10/0x12

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff810a7d49>] put_page+0x91/0x9e

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81308c5a>] skb_release_data+0x77/0xce

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81308919>] __kfree_skb+0x1e/0x81

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff813089a9>] consume_skb+0x2d/0x2f

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8130b39b>] skb_free_datagram+0x19/0x3f

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8135987c>] udp_recvmsg+0x1dc/0x262

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81303f22>] sock_common_recvmsg+0x39/0x4a

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81301e71>] __sock_recvmsg+0x71/0x7d

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81302544>] sock_recvmsg+0xcf/0xe8

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8105ca4b>] ? autoremove_wake_function+0x0/0x39

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8100e86f>] ? __xen_spin_lock+0xb7/0xcd

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8104de90>] ? __local_bh_disable+0xa7/0xaf

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8136092d>] ? inet_ioctl+0xa5/0xa7

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81301c74>] ? sock_ioctl+0x1f3/0x216

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81301fb5>] ? sockfd_lookup_light+0x20/0x58

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff813036a1>] sys_recvfrom+0xad/0xf7

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8100dad7>] ? xen_clocksource_read+0x21/0x23

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel: [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b

Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
  kernel:Code: 10 48 89 d6 48 c1 ee 35 39 f1 75 29 f7 c2 00 00 04 00 74 21 49 63 
cc 48 39 48 10 75 18 80 e6 40 48 0f 44 c8 8b 51 08 85 d2 74 43 <0f> 0b eb fe 41 
83 fc 09 76 a5 49 63 c4 48 89 43 10 0f ba 2b 12
BUG: soft lockup - CPU#1 stuck for 61s! [rsyslogd:945]
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last unloaded: 
scsi_wait_scan]
CPU 1:
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last unloaded: 
scsi_wait_scan]
Pid: 945, comm: rsyslogd Tainted: G      D W  2.6.29.4-167.fc11.x86_64 #1
RIP: e030:[<ffffffff810093aa>]  [<ffffffff810093aa>] _stext+0x3aa/0x1000
RSP: e02b:ffff88007b069b28  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff880000008ad0 RCX: ffffffff810093aa
RDX: ffff88007b069b5c RSI: ffff88007b069b40 RDI: 0000000000000003
RBP: ffff88007b069b60 R08: 0000000000000000 R09: 0000000000000001
R10: 000000000000037b R11: 0000000000000206 R12: 0000000000000007
R13: 0000000000000001 R14: 0000000000000000 R15: 000000000000fd60
FS:  00007fca23fff910(0000) GS:ffff88007f3ab400(0000) knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000001657000 CR3: 000000007b05b000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
  [<ffffffff81220cff>] ? xen_poll_irq+0x44/0x4e
  [<ffffffff8100e70e>] xen_spin_lock_slow+0xdf/0x189
  [<ffffffff8100e851>] __xen_spin_lock+0x99/0xcd
  [<ffffffff8100e895>] xen_spin_lock_flags+0x10/0x12
  [<ffffffff813abd6c>] _spin_lock_irqsave+0x32/0x3b
  [<ffffffff810a4a12>] get_page_from_freelist+0x368/0x699
  [<ffffffff810a4e35>] __alloc_pages_internal+0xf2/0x429
  [<ffffffff8100ac98>] ? xen_mc_issue+0x62/0x67
  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
  [<ffffffff810c7355>] alloc_pages_current+0xb7/0xc0
  [<ffffffff810a3789>] __get_free_pages+0x13/0x4e
  [<ffffffff81046c5a>] copy_process+0xbb/0x1332
  [<ffffffff81301f93>] ? fput_light+0x12/0x14
  [<ffffffff813036d5>] ? sys_recvfrom+0xe1/0xf7
  [<ffffffff8100e5dc>] ? xen_spin_unlock+0x11/0x2d
  [<ffffffff8104801c>] do_fork+0x14b/0x313
  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
  [<ffffffff813ab88d>] ? trace_hardirqs_off_thunk+0x3a/0x6c
  [<ffffffff8100f605>] sys_clone+0x28/0x2a
  [<ffffffff810117e3>] stub_clone+0x13/0x20
  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b
BUG: soft lockup - CPU#1 stuck for 61s! [rsyslogd:945]
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last unloaded: 
scsi_wait_scan]
CPU 1:
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last unloaded: 
scsi_wait_scan]
Pid: 945, comm: rsyslogd Tainted: G      D W  2.6.29.4-167.fc11.x86_64 #1
RIP: e030:[<ffffffff810093aa>]  [<ffffffff810093aa>] _stext+0x3aa/0x1000
RSP: e02b:ffff88007b069b28  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff880000008ad0 RCX: ffffffff810093aa
RDX: ffff88007b069b5c RSI: ffff88007b069b40 RDI: 0000000000000003
RBP: ffff88007b069b60 R08: 0000000000000000 R09: 0000000000000001
R10: 000000000000037b R11: 0000000000000206 R12: 0000000000000007
R13: 0000000000000001 R14: 0000000000000000 R15: 000000000001fd5b
FS:  00007fca23fff910(0000) GS:ffff88007f3ab400(0000) knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000001657000 CR3: 000000007b05b000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
  [<ffffffff81220cff>] ? xen_poll_irq+0x44/0x4e
  [<ffffffff8100e70e>] xen_spin_lock_slow+0xdf/0x189
  [<ffffffff8100e851>] __xen_spin_lock+0x99/0xcd
  [<ffffffff8100e895>] xen_spin_lock_flags+0x10/0x12
  [<ffffffff813abd6c>] _spin_lock_irqsave+0x32/0x3b
  [<ffffffff810a4a12>] get_page_from_freelist+0x368/0x699
  [<ffffffff810a4e35>] __alloc_pages_internal+0xf2/0x429
  [<ffffffff8100ac98>] ? xen_mc_issue+0x62/0x67
  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
  [<ffffffff810c7355>] alloc_pages_current+0xb7/0xc0
  [<ffffffff810a3789>] __get_free_pages+0x13/0x4e
  [<ffffffff81046c5a>] copy_process+0xbb/0x1332
  [<ffffffff81301f93>] ? fput_light+0x12/0x14
  [<ffffffff813036d5>] ? sys_recvfrom+0xe1/0xf7
  [<ffffffff8100e5dc>] ? xen_spin_unlock+0x11/0x2d
  [<ffffffff8104801c>] do_fork+0x14b/0x313
  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
  [<ffffffff813ab88d>] ? trace_hardirqs_off_thunk+0x3a/0x6c
  [<ffffffff8100f605>] sys_clone+0x28/0x2a
  [<ffffffff810117e3>] stub_clone+0x13/0x20
  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b
BUG: soft lockup - CPU#1 stuck for 61s! [rsyslogd:945]
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last unloaded: 
scsi_wait_scan]
CPU 1:
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last unloaded: 
scsi_wait_scan]
Pid: 945, comm: rsyslogd Tainted: G      D W  2.6.29.4-167.fc11.x86_64 #1
RIP: e030:[<ffffffff810093aa>]  [<ffffffff810093aa>] _stext+0x3aa/0x1000
RSP: e02b:ffff88007b069b28  EFLAGS: 00000206
RAX: 0000000000000000 RBX: ffff880000008ad0 RCX: ffffffff810093aa
RDX: ffff88007b069b5c RSI: ffff88007b069b40 RDI: 0000000000000003
RBP: ffff88007b069b60 R08: 0000000000000000 R09: 0000000000000001
R10: 000000000000037b R11: 0000000000000206 R12: 0000000000000007
R13: 0000000000000001 R14: 0000000000000000 R15: 000000000002fd5a
FS:  00007fca23fff910(0000) GS:ffff88007f3ab400(0000) knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: 0000000001657000 CR3: 000000007b05b000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Call Trace:
  [<ffffffff81220cff>] ? xen_poll_irq+0x44/0x4e
  [<ffffffff8100e70e>] xen_spin_lock_slow+0xdf/0x189
  [<ffffffff8100e851>] __xen_spin_lock+0x99/0xcd
  [<ffffffff8100e895>] xen_spin_lock_flags+0x10/0x12
  [<ffffffff813abd6c>] _spin_lock_irqsave+0x32/0x3b
  [<ffffffff810a4a12>] get_page_from_freelist+0x368/0x699
  [<ffffffff810a4e35>] __alloc_pages_internal+0xf2/0x429
  [<ffffffff8100ac98>] ? xen_mc_issue+0x62/0x67
  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
  [<ffffffff810c7355>] alloc_pages_current+0xb7/0xc0
  [<ffffffff810a3789>] __get_free_pages+0x13/0x4e
  [<ffffffff81046c5a>] copy_process+0xbb/0x1332
  [<ffffffff81301f93>] ? fput_light+0x12/0x14
  [<ffffffff813036d5>] ? sys_recvfrom+0xe1/0xf7
  [<ffffffff8100e5dc>] ? xen_spin_unlock+0x11/0x2d
  [<ffffffff8104801c>] do_fork+0x14b/0x313
  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
  [<ffffffff813ab88d>] ? trace_hardirqs_off_thunk+0x3a/0x6c
  [<ffffffff8100f605>] sys_clone+0x28/0x2a
  [<ffffffff810117e3>] stub_clone+0x13/0x20
  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b


> <>
Nathan Stratton                                CTO, BlinkMind, Inc.
nathan at robotics.net                         nathan at blinkmind.com
http://www.robotics.net                        http://www.blinkmind.com

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: kernel BUG at mm/page_alloc.c:424!
  2009-08-05 13:54 ` Konrad Rzeszutek Wilk
@ 2009-08-05 13:50   ` Nathan Stratton
  2009-08-06 19:26     ` Jeremy Fitzhardinge
  0 siblings, 1 reply; 11+ messages in thread
From: Nathan Stratton @ 2009-08-05 13:50 UTC (permalink / raw)
  To: Konrad Rzeszutek Wilk; +Cc: xen-devel

On Wed, 5 Aug 2009, Konrad Rzeszutek Wilk wrote:

> On Tue, Aug 04, 2009 at 07:38:10PM -0500, Nathan Stratton wrote:
>>
>> [root@cbridge1 etc]# ------------[ cut here ]------------
>> kernel BUG at mm/page_alloc.c:424!
>> invalid opcode: 0000 [#1] SMP
>> last sysfs file: /sys/devices/vif-0/net/eth0/tx_queue_len
>> CPU 2
>> Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last
>> unloaded: scsi_wait_scan]
>> Pid: 1182, comm: texgrid Tainted: G        W  2.6.29.4-167.fc11.x86_64 #1
>> RIP: e030:[<ffffffff810a2eb1>]  [<ffffffff810a2eb1>]
>> __free_one_page+0x146/0x1e6
>> RSP: e02b:ffff88007ddc3a38  EFLAGS: 00010002
>> RAX: ffffe2000194d290 RBX: ffffe2000194d2c8 RCX: ffffe2000194d290
>> RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff880000008880
>> RBP: ffff88007ddc3a88 R08: 000000000000001e R09: 0000000000000006
>> R10: 0000000000000000 R11: 0000000000009f20 R12: 0000000000000000
>> R13: ffff880000008880 R14: 000000000000029f R15: 0000000000000002
>> FS:  00007f8b5cbb8910(0000) GS:ffff88007e84c700(0000) knlGS:0000000000000000
>> CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
>> CR2: 00007f8b50bb3da8 CR3: 000000007b19d000 CR4: 0000000000002660
>> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>> Process texgrid (pid: 1182, threadinfo ffff88007ddc2000, task ffff88007db41700)
>> Stack:
>>  ffffe2000194d638 0000000000000004 ffffe20001948868 0000000100000018
>>  ffff88007e84c590 ffff880000008880 0000000000000002 ffff88007e84c590
>>  ffffe2000194d2c8 0000000000000000 ffff88007ddc3ab8 ffffffff810a4187
>> Call Trace:
>>  [<ffffffff810a4187>] free_pages_bulk.clone.2+0x57/0x72
>>  [<ffffffff810a4290>] free_hot_cold_page+0xee/0x130
>>  [<ffffffff810a4338>] free_hot_page+0x10/0x12
>>  [<ffffffff810a7d49>] put_page+0x91/0x9e
>>  [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb
>>  [<ffffffff81308c5a>] skb_release_data+0x77/0xce
>>  [<ffffffff81308919>] __kfree_skb+0x1e/0x81
>>  [<ffffffff813089a9>] consume_skb+0x2d/0x2f
>>  [<ffffffff8130b39b>] skb_free_datagram+0x19/0x3f
>>  [<ffffffff8135987c>] udp_recvmsg+0x1dc/0x262
>>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>>  [<ffffffff81303f22>] sock_common_recvmsg+0x39/0x4a
>>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>>  [<ffffffff81301e71>] __sock_recvmsg+0x71/0x7d
>>  [<ffffffff81302544>] sock_recvmsg+0xcf/0xe8
>>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>>  [<ffffffff8105ca4b>] ? autoremove_wake_function+0x0/0x39
>>  [<ffffffff8100e86f>] ? __xen_spin_lock+0xb7/0xcd
>>  [<ffffffff8104de90>] ? __local_bh_disable+0xa7/0xaf
>>  [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb
>>  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
>>  [<ffffffff8136092d>] ? inet_ioctl+0xa5/0xa7
>>  [<ffffffff81301c74>] ? sock_ioctl+0x1f3/0x216
>>  [<ffffffff81301fb5>] ? sockfd_lookup_light+0x20/0x58
>>  [<ffffffff813036a1>] sys_recvfrom+0xad/0xf7
>>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>>  [<ffffffff8100dad7>] ? xen_clocksource_read+0x21/0x23
>>  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
>>  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b
>> Code: 10 48 89 d6 48 c1 ee 35 39 f1 75 29 f7 c2 00 00 04 00 74 21 49 63
>> cc 48 39 48 10 75 18 80 e6 40 48 0f 44 c8 8b 51 08 85 d2 74 43 <0f> 0b eb
>> fe 41 83 fc 09 76 a5 49 63 c4 48 89 43 10 0f ba 2b 12
>> RIP  [<ffffffff810a2eb1>] __free_one_page+0x146/0x1e6
>>  RSP <ffff88007ddc3a38>
>> ---[ end trace 7d5f534b65d69935 ]---
>>
>> Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
>>  kernel:------------[ cut here ]------------
>
> How did you accomplish this? Could you be specific on how this occured?
> What version of Xen are you using (I presume xen-unstable + 2.6-pvops (xen-tip/master))?

We were running our video conference server on a DomU after about 15 video 
calls it crashed, it's very repeatable.

Dom0 is Centos 5.2 linux 2.6.18-128.2.1.el5xen xen 3.4.0 from 
http://www.gitco.de/repo/xen3.4.0

DomU is Stock Fedora 11


><>
Nathan Stratton                                CTO, BlinkMind, Inc.
nathan at robotics.net                         nathan at blinkmind.com
http://www.robotics.net                        http://www.blinkmind.com

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: kernel BUG at mm/page_alloc.c:424!
  2009-08-05  0:38 kernel BUG at mm/page_alloc.c:424! Nathan Stratton
@ 2009-08-05 13:54 ` Konrad Rzeszutek Wilk
  2009-08-05 13:50   ` Nathan Stratton
  0 siblings, 1 reply; 11+ messages in thread
From: Konrad Rzeszutek Wilk @ 2009-08-05 13:54 UTC (permalink / raw)
  To: Nathan Stratton; +Cc: xen-devel

On Tue, Aug 04, 2009 at 07:38:10PM -0500, Nathan Stratton wrote:
>
> [root@cbridge1 etc]# ------------[ cut here ]------------
> kernel BUG at mm/page_alloc.c:424!
> invalid opcode: 0000 [#1] SMP
> last sysfs file: /sys/devices/vif-0/net/eth0/tx_queue_len
> CPU 2
> Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last 
> unloaded: scsi_wait_scan]
> Pid: 1182, comm: texgrid Tainted: G        W  2.6.29.4-167.fc11.x86_64 #1
> RIP: e030:[<ffffffff810a2eb1>]  [<ffffffff810a2eb1>]  
> __free_one_page+0x146/0x1e6
> RSP: e02b:ffff88007ddc3a38  EFLAGS: 00010002
> RAX: ffffe2000194d290 RBX: ffffe2000194d2c8 RCX: ffffe2000194d290
> RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff880000008880
> RBP: ffff88007ddc3a88 R08: 000000000000001e R09: 0000000000000006
> R10: 0000000000000000 R11: 0000000000009f20 R12: 0000000000000000
> R13: ffff880000008880 R14: 000000000000029f R15: 0000000000000002
> FS:  00007f8b5cbb8910(0000) GS:ffff88007e84c700(0000) knlGS:0000000000000000
> CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
> CR2: 00007f8b50bb3da8 CR3: 000000007b19d000 CR4: 0000000000002660
> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
> Process texgrid (pid: 1182, threadinfo ffff88007ddc2000, task ffff88007db41700)
> Stack:
>  ffffe2000194d638 0000000000000004 ffffe20001948868 0000000100000018
>  ffff88007e84c590 ffff880000008880 0000000000000002 ffff88007e84c590
>  ffffe2000194d2c8 0000000000000000 ffff88007ddc3ab8 ffffffff810a4187
> Call Trace:
>  [<ffffffff810a4187>] free_pages_bulk.clone.2+0x57/0x72
>  [<ffffffff810a4290>] free_hot_cold_page+0xee/0x130
>  [<ffffffff810a4338>] free_hot_page+0x10/0x12
>  [<ffffffff810a7d49>] put_page+0x91/0x9e
>  [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb
>  [<ffffffff81308c5a>] skb_release_data+0x77/0xce
>  [<ffffffff81308919>] __kfree_skb+0x1e/0x81
>  [<ffffffff813089a9>] consume_skb+0x2d/0x2f
>  [<ffffffff8130b39b>] skb_free_datagram+0x19/0x3f
>  [<ffffffff8135987c>] udp_recvmsg+0x1dc/0x262
>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>  [<ffffffff81303f22>] sock_common_recvmsg+0x39/0x4a
>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>  [<ffffffff81301e71>] __sock_recvmsg+0x71/0x7d
>  [<ffffffff81302544>] sock_recvmsg+0xcf/0xe8
>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>  [<ffffffff8105ca4b>] ? autoremove_wake_function+0x0/0x39
>  [<ffffffff8100e86f>] ? __xen_spin_lock+0xb7/0xcd
>  [<ffffffff8104de90>] ? __local_bh_disable+0xa7/0xaf
>  [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb
>  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
>  [<ffffffff8136092d>] ? inet_ioctl+0xa5/0xa7
>  [<ffffffff81301c74>] ? sock_ioctl+0x1f3/0x216
>  [<ffffffff81301fb5>] ? sockfd_lookup_light+0x20/0x58
>  [<ffffffff813036a1>] sys_recvfrom+0xad/0xf7
>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>  [<ffffffff8100dad7>] ? xen_clocksource_read+0x21/0x23
>  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
>  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b
> Code: 10 48 89 d6 48 c1 ee 35 39 f1 75 29 f7 c2 00 00 04 00 74 21 49 63 
> cc 48 39 48 10 75 18 80 e6 40 48 0f 44 c8 8b 51 08 85 d2 74 43 <0f> 0b eb 
> fe 41 83 fc 09 76 a5 49 63 c4 48 89 43 10 0f ba 2b 12
> RIP  [<ffffffff810a2eb1>] __free_one_page+0x146/0x1e6
>  RSP <ffff88007ddc3a38>
> ---[ end trace 7d5f534b65d69935 ]---
>
> Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
>  kernel:------------[ cut here ]------------

How did you accomplish this? Could you be specific on how this occured?
What version of Xen are you using (I presume xen-unstable + 2.6-pvops (xen-tip/master))?

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: kernel BUG at mm/page_alloc.c:424!
  2009-08-05 13:50   ` Nathan Stratton
@ 2009-08-06 19:26     ` Jeremy Fitzhardinge
  2009-08-06 21:22       ` Nathan Stratton
  0 siblings, 1 reply; 11+ messages in thread
From: Jeremy Fitzhardinge @ 2009-08-06 19:26 UTC (permalink / raw)
  To: Nathan Stratton; +Cc: xen-devel, Konrad Rzeszutek Wilk

On 08/05/09 06:50, Nathan Stratton wrote:
> On Wed, 5 Aug 2009, Konrad Rzeszutek Wilk wrote:
>
>> On Tue, Aug 04, 2009 at 07:38:10PM -0500, Nathan Stratton wrote:
>>>
>>> [root@cbridge1 etc]# ------------[ cut here ]------------
>>> kernel BUG at mm/page_alloc.c:424!
>>> invalid opcode: 0000 [#1] SMP
>>> last sysfs file: /sys/devices/vif-0/net/eth0/tx_queue_len
>>> CPU 2
>>> Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last
>>> unloaded: scsi_wait_scan]
>>> Pid: 1182, comm: texgrid Tainted: G        W 
>>> 2.6.29.4-167.fc11.x86_64 #1
>>> RIP: e030:[<ffffffff810a2eb1>]  [<ffffffff810a2eb1>]
>>> __free_one_page+0x146/0x1e6
>>> RSP: e02b:ffff88007ddc3a38  EFLAGS: 00010002
>>> RAX: ffffe2000194d290 RBX: ffffe2000194d2c8 RCX: ffffe2000194d290
>>> RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff880000008880
>>> RBP: ffff88007ddc3a88 R08: 000000000000001e R09: 0000000000000006
>>> R10: 0000000000000000 R11: 0000000000009f20 R12: 0000000000000000
>>> R13: ffff880000008880 R14: 000000000000029f R15: 0000000000000002
>>> FS:  00007f8b5cbb8910(0000) GS:ffff88007e84c700(0000)
>>> knlGS:0000000000000000
>>> CS:  e033 DS: 0000 ES: 0000 CR0: 000000008005003b
>>> CR2: 00007f8b50bb3da8 CR3: 000000007b19d000 CR4: 0000000000002660
>>> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>>> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>>> Process texgrid (pid: 1182, threadinfo ffff88007ddc2000, task
>>> ffff88007db41700)
>>> Stack:
>>>  ffffe2000194d638 0000000000000004 ffffe20001948868 0000000100000018
>>>  ffff88007e84c590 ffff880000008880 0000000000000002 ffff88007e84c590
>>>  ffffe2000194d2c8 0000000000000000 ffff88007ddc3ab8 ffffffff810a4187
>>> Call Trace:
>>>  [<ffffffff810a4187>] free_pages_bulk.clone.2+0x57/0x72
>>>  [<ffffffff810a4290>] free_hot_cold_page+0xee/0x130
>>>  [<ffffffff810a4338>] free_hot_page+0x10/0x12
>>>  [<ffffffff810a7d49>] put_page+0x91/0x9e
>>>  [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb
>>>  [<ffffffff81308c5a>] skb_release_data+0x77/0xce
>>>  [<ffffffff81308919>] __kfree_skb+0x1e/0x81
>>>  [<ffffffff813089a9>] consume_skb+0x2d/0x2f
>>>  [<ffffffff8130b39b>] skb_free_datagram+0x19/0x3f
>>>  [<ffffffff8135987c>] udp_recvmsg+0x1dc/0x262
>>>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>>>  [<ffffffff81303f22>] sock_common_recvmsg+0x39/0x4a
>>>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>>>  [<ffffffff81301e71>] __sock_recvmsg+0x71/0x7d
>>>  [<ffffffff81302544>] sock_recvmsg+0xcf/0xe8
>>>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>>>  [<ffffffff8105ca4b>] ? autoremove_wake_function+0x0/0x39
>>>  [<ffffffff8100e86f>] ? __xen_spin_lock+0xb7/0xcd
>>>  [<ffffffff8104de90>] ? __local_bh_disable+0xa7/0xaf
>>>  [<ffffffff8104df91>] ? _local_bh_enable_ip+0xe5/0xeb
>>>  [<ffffffff8103fe31>] ? __might_sleep+0x2d/0x110
>>>  [<ffffffff8136092d>] ? inet_ioctl+0xa5/0xa7
>>>  [<ffffffff81301c74>] ? sock_ioctl+0x1f3/0x216
>>>  [<ffffffff81301fb5>] ? sockfd_lookup_light+0x20/0x58
>>>  [<ffffffff813036a1>] sys_recvfrom+0xad/0xf7
>>>  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
>>>  [<ffffffff8100dad7>] ? xen_clocksource_read+0x21/0x23
>>>  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
>>>  [<ffffffff8101133a>] system_call_fastpath+0x16/0x1b
>>> Code: 10 48 89 d6 48 c1 ee 35 39 f1 75 29 f7 c2 00 00 04 00 74 21 49 63
>>> cc 48 39 48 10 75 18 80 e6 40 48 0f 44 c8 8b 51 08 85 d2 74 43 <0f>
>>> 0b eb
>>> fe 41 83 fc 09 76 a5 49 63 c4 48 89 43 10 0f ba 2b 12
>>> RIP  [<ffffffff810a2eb1>] __free_one_page+0x146/0x1e6
>>>  RSP <ffff88007ddc3a38>
>>> ---[ end trace 7d5f534b65d69935 ]---
>>>
>>> Message from syslogd@cbridge1 at Aug  4 11:00:25 ...
>>>  kernel:------------[ cut here ]------------
>>
>> How did you accomplish this? Could you be specific on how this occured?
>> What version of Xen are you using (I presume xen-unstable + 2.6-pvops
>> (xen-tip/master))?
>
> We were running our video conference server on a DomU after about 15
> video calls it crashed, it's very repeatable.

Does disabling GRO/LRO and/or checksumming change anything?

    J

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: kernel BUG at mm/page_alloc.c:424!
  2009-08-06 19:26     ` Jeremy Fitzhardinge
@ 2009-08-06 21:22       ` Nathan Stratton
  2009-08-06 21:26         ` Jeremy Fitzhardinge
  0 siblings, 1 reply; 11+ messages in thread
From: Nathan Stratton @ 2009-08-06 21:22 UTC (permalink / raw)
  To: Jeremy Fitzhardinge; +Cc: xen-devel, Konrad Rzeszutek Wilk

On Thu, 6 Aug 2009, Jeremy Fitzhardinge wrote:

> Does disabling GRO/LRO and/or checksumming change anything?

I am sorry, how would I do that?

-Nathan

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: kernel BUG at mm/page_alloc.c:424!
  2009-08-06 21:22       ` Nathan Stratton
@ 2009-08-06 21:26         ` Jeremy Fitzhardinge
  2009-08-06 23:31           ` Nathan Stratton
  0 siblings, 1 reply; 11+ messages in thread
From: Jeremy Fitzhardinge @ 2009-08-06 21:26 UTC (permalink / raw)
  To: Nathan Stratton; +Cc: xen-devel, Konrad Rzeszutek Wilk

On 08/06/09 14:22, Nathan Stratton wrote:
> On Thu, 6 Aug 2009, Jeremy Fitzhardinge wrote:
>
>> Does disabling GRO/LRO and/or checksumming change anything?
>
> I am sorry, how would I do that?

Using ethtool.  Something like "ethtool --offload eth0 gro off lro off",
I think.

    J

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: kernel BUG at mm/page_alloc.c:424!
  2009-08-06 21:26         ` Jeremy Fitzhardinge
@ 2009-08-06 23:31           ` Nathan Stratton
  2009-08-06 23:38             ` Jeremy Fitzhardinge
  0 siblings, 1 reply; 11+ messages in thread
From: Nathan Stratton @ 2009-08-06 23:31 UTC (permalink / raw)
  To: Jeremy Fitzhardinge; +Cc: xen-devel, Konrad Rzeszutek Wilk

On Thu, 6 Aug 2009, Jeremy Fitzhardinge wrote:

> On 08/06/09 14:22, Nathan Stratton wrote:
>> On Thu, 6 Aug 2009, Jeremy Fitzhardinge wrote:
>>
>>> Does disabling GRO/LRO and/or checksumming change anything?
>>
>> I am sorry, how would I do that?
>
> Using ethtool.  Something like "ethtool --offload eth0 gro off lro off",
> I think.

They both were already off:

[root@cbridge1 ~]# ethtool -k eth0
Offload parameters for eth0:
Cannot get device rx csum settings: Operation not supported
Cannot get device flags: Operation not supported
rx-checksumming: off
tx-checksumming: on
scatter-gather: on
tcp-segmentation-offload: on
udp-fragmentation-offload: off
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off

-Nathan

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: kernel BUG at mm/page_alloc.c:424!
  2009-08-06 23:31           ` Nathan Stratton
@ 2009-08-06 23:38             ` Jeremy Fitzhardinge
  2009-08-07  0:03               ` Nathan Stratton
  0 siblings, 1 reply; 11+ messages in thread
From: Jeremy Fitzhardinge @ 2009-08-06 23:38 UTC (permalink / raw)
  To: Nathan Stratton; +Cc: xen-devel, Konrad Rzeszutek Wilk

On 08/06/09 16:31, Nathan Stratton wrote:
> On Thu, 6 Aug 2009, Jeremy Fitzhardinge wrote:
>
>> On 08/06/09 14:22, Nathan Stratton wrote:
>>> On Thu, 6 Aug 2009, Jeremy Fitzhardinge wrote:
>>>
>>>> Does disabling GRO/LRO and/or checksumming change anything?
>>>
>>> I am sorry, how would I do that?
>>
>> Using ethtool.  Something like "ethtool --offload eth0 gro off lro off",
>> I think.
>
> They both were already off:
>
> [root@cbridge1 ~]# ethtool -k eth0
> Offload parameters for eth0:
> Cannot get device rx csum settings: Operation not supported
> Cannot get device flags: Operation not supported
> rx-checksumming: off
> tx-checksumming: on
> scatter-gather: on
> tcp-segmentation-offload: on

Try turning tso off too.

    J

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: kernel BUG at mm/page_alloc.c:424!
  2009-08-06 23:38             ` Jeremy Fitzhardinge
@ 2009-08-07  0:03               ` Nathan Stratton
  2009-08-07  0:20                 ` Jeremy Fitzhardinge
  0 siblings, 1 reply; 11+ messages in thread
From: Nathan Stratton @ 2009-08-07  0:03 UTC (permalink / raw)
  To: Jeremy Fitzhardinge; +Cc: xen-devel, Konrad Rzeszutek Wilk


On Thu, 6 Aug 2009, Jeremy Fitzhardinge wrote:

> Try turning tso off too.

[root@cbridge1 ~]# ethtool -k eth0
Offload parameters for eth0:
Cannot get device rx csum settings: Operation not supported
Cannot get device flags: Operation not supported
rx-checksumming: off
tx-checksumming: off
scatter-gather: off
tcp-segmentation-offload: off
udp-fragmentation-offload: off
generic-segmentation-offload: off
generic-receive-offload: off
large-receive-offload: off


# BUG: unable to handle kernel paging request at 0000000000100100
IP: [<ffffffff810a49b7>] get_page_from_freelist+0x30d/0x699
PGD 6c5b9067 PUD 6c55a067 PMD 0
Oops: 0000 [#1] SMP
last sysfs file: /sys/devices/vif-0/net/eth0/broadcast
CPU 3
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last 
unloaded: scsi_wait_scan]
Pid: 13905, comm: texgrid Tainted: G        W  2.6.29.4-167.fc11.x86_64 #1
RIP: e030:[<ffffffff810a49b7>]  [<ffffffff810a49b7>] 
get_page_from_freelist+0x30d/0x699
RSP: e02b:ffff88006500fb68  EFLAGS: 00010093
RAX: ffff88006e84d890 RBX: ffff88006e84d880 RCX: ffffe2000136cc90
RDX: 0000000000100100 RSI: 0000000000000000 RDI: 0000000000000002
RBP: ffff88006500fc48 R08: 0000000000000000 R09: 0000000000000001
R10: 0000000000000681 R11: 0000000000053379 R12: 00000000001000d8
R13: ffff880000008880 R14: 0000000000000002 R15: 0000000000000000
FS:  00007fd514017910(0000) GS:ffff88006e84da00(0000) 
knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000100100 CR3: 000000006d525000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process texgrid (pid: 13905, threadinfo ffff88006500e000, task 
ffff88006c70c500)
Stack:
  0000000100000000 0000000000000001 00000000022f9420 ffff880000008880
  0000004000000001 0000000000000002 ffff880000008ad0 000000006500fbe8
  ffffffff8177e860 000000038100be86 0000000000000000 ffff88000000a200
Call Trace:
  [<ffffffff810a4e35>] __alloc_pages_internal+0xf2/0x429
  [<ffffffff8100fa94>] ? __switch_to+0x379/0x38b
  [<ffffffff81042a19>] ? finish_task_switch+0x58/0xb5
  [<ffffffff813a9ef2>] ? thread_return+0x3d/0xdf
  [<ffffffff810c79a8>] alloc_page_vma+0xcc/0xce
  [<ffffffff810bd3ce>] ? anon_vma_prepare+0x2d/0xd7
  [<ffffffff810b444c>] handle_mm_fault+0x1a0/0x7c5
  [<ffffffff813ae3f5>] do_page_fault+0x5b5/0x9e9
  [<ffffffff8100be86>] ? xen_mc_flush+0x191/0x1e8
  [<ffffffff8100ac7d>] ? xen_mc_issue+0x47/0x67
  [<ffffffff8100aec1>] ? xen_clts+0x3d/0x3f
  [<ffffffff8100e5dc>] ? xen_spin_unlock+0x11/0x2d
  [<ffffffff813ab88d>] ? trace_hardirqs_off_thunk+0x3a/0x6c
  [<ffffffff813abf55>] page_fault+0x25/0x30
Code: 49 8d 4c 24 28 48 39 c8 0f 18 0a 75 dc eb 2e 4c 8b 63 10 49 83 ec 28 
eb 12 48 8b bd 48 ff ff ff 49 39 7c 24 10 74 16 4c 8d 62 d8 <49> 8b 54 24 
28 49 8d 4c 24 28 48 39 c8 0f 18 0a 75 dc 49 8d 54
RIP  [<ffffffff810a49b7>] get_page_from_freelist+0x30d/0x699
  RSP <ffff88006500fb68>
CR2: 0000000000100100
---[ end trace a76d3b919d8183ef ]---
BUG: unable to handle kernel paging request at 0000000000100100
IP: [<ffffffff810a49b7>] get_page_from_freelist+0x30d/0x699
PGD 6dce4067 PUD 6c49a067 PMD 0
Oops: 0000 [#2] SMP
last sysfs file: /sys/devices/vif-0/net/eth0/broadcast
CPU 3
Modules linked in: ipv6 joydev pcspkr xen_netfront xen_blkfront [last 
unloaded: scsi_wait_scan]
Pid: 957, comm: rsyslogd Tainted: G      D W  2.6.29.4-167.fc11.x86_64 #1
RIP: e030:[<ffffffff810a49b7>]  [<ffffffff810a49b7>] 
get_page_from_freelist+0x30d/0x699
RSP: e02b:ffff88006d435b68  EFLAGS: 00010093
RAX: ffff88006e84d890 RBX: ffff88006e84d880 RCX: ffffe2000136cc90
RDX: 0000000000100100 RSI: 0000000000000000 RDI: 0000000000000002
RBP: ffff88006d435c48 R08: 0000000000000000 R09: 0000000000000001
R10: 0000000000000681 R11: 0000000000053379 R12: 00000000001000d8
R13: ffff880000008880 R14: 0000000000000002 R15: 0000000000000000
FS:  00007f9f15357910(0000) GS:ffff88006e84da00(0000) 
knlGS:0000000000000000
CS:  e033 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 0000000000100100 CR3: 000000006d54c000 CR4: 0000000000002660
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process rsyslogd (pid: 957, threadinfo ffff88006d434000, task 
ffff88006d475c00)
Stack:
  0000000100000000 0000000000000001 0000000000000001 ffff880000008880
  000000406d435ba8 0000000000000002 ffff880000008ad0 000000006d435bc8
  ffffffff8177e860 00000003814d5bee 0000000000000000 ffff88000000a200
Call Trace:
  [<ffffffff810a4e35>] __alloc_pages_internal+0xf2/0x429
  [<ffffffff8109ee50>] ? unlock_page+0x14/0x16
  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
  [<ffffffff810c79a8>] alloc_page_vma+0xcc/0xce
  [<ffffffff810bd3ce>] ? anon_vma_prepare+0x2d/0xd7
  [<ffffffff810b444c>] handle_mm_fault+0x1a0/0x7c5
  [<ffffffff813ae3f5>] do_page_fault+0x5b5/0x9e9
  [<ffffffff8102a181>] ? pvclock_clocksource_read+0x47/0x83
  [<ffffffff8100dad7>] ? xen_clocksource_read+0x21/0x23
  [<ffffffff81062f7c>] ? clocksource_read+0xc/0xe
  [<ffffffff813ab88d>] ? trace_hardirqs_off_thunk+0x3a/0x6c
  [<ffffffff813abf55>] page_fault+0x25/0x30
Code: 49 8d 4c 24 28 48 39 c8 0f 18 0a 75 dc eb 2e 4c 8b 63 10 49 83 ec 28 
eb 12 48 8b bd 48 ff ff ff 49 39 7c 24 10 74 16 4c 8d 62 d8 <49> 8b 54 24 
28 49 8d 4c 24 28 48 39 c8 0f 18 0a 75 dc 49 8d 54
RIP  [<ffffffff810a49b7>] get_page_from_freelist+0x30d/0x699
  RSP <ffff88006d435b68>
CR2: 0000000000100100
---[ end trace a76d3b919d8183f0 ]---

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: kernel BUG at mm/page_alloc.c:424!
  2009-08-07  0:03               ` Nathan Stratton
@ 2009-08-07  0:20                 ` Jeremy Fitzhardinge
  0 siblings, 0 replies; 11+ messages in thread
From: Jeremy Fitzhardinge @ 2009-08-07  0:20 UTC (permalink / raw)
  To: Nathan Stratton; +Cc: xen-devel, Konrad Rzeszutek Wilk

On 08/06/09 17:03, Nathan Stratton wrote:
>
> On Thu, 6 Aug 2009, Jeremy Fitzhardinge wrote:
>
>> Try turning tso off too.
>
> [root@cbridge1 ~]# ethtool -k eth0
> Offload parameters for eth0:
> Cannot get device rx csum settings: Operation not supported
> Cannot get device flags: Operation not supported
> rx-checksumming: off
> tx-checksumming: off
> scatter-gather: off
> tcp-segmentation-offload: off
> udp-fragmentation-offload: off
> generic-segmentation-offload: off
> generic-receive-offload: off
> large-receive-offload: off
>
>
> # BUG: unable to handle kernel paging request at 0000000000100100
> IP: [<ffffffff810a49b7>] get_page_from_freelist+0x30d/0x699
> PGD 6c5b9067 PUD 6c55a067 PMD 0
> Oops: 0000 [#1] SMP

So it changed the crash...  That address is LIST_POISON1.  Hm.

    J

^ permalink raw reply	[flat|nested] 11+ messages in thread

end of thread, other threads:[~2009-08-07  0:20 UTC | newest]

Thread overview: 11+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2009-08-05  0:38 kernel BUG at mm/page_alloc.c:424! Nathan Stratton
2009-08-05 13:54 ` Konrad Rzeszutek Wilk
2009-08-05 13:50   ` Nathan Stratton
2009-08-06 19:26     ` Jeremy Fitzhardinge
2009-08-06 21:22       ` Nathan Stratton
2009-08-06 21:26         ` Jeremy Fitzhardinge
2009-08-06 23:31           ` Nathan Stratton
2009-08-06 23:38             ` Jeremy Fitzhardinge
2009-08-07  0:03               ` Nathan Stratton
2009-08-07  0:20                 ` Jeremy Fitzhardinge
  -- strict thread matches above, loose matches on Subject: below --
2009-08-04 18:36 main.c:674: undefined reference to `xen_init_mtrr' Nathan Stratton
2009-08-04 19:04 ` kernel BUG at mm/page_alloc.c:424! Nathan Stratton

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.