From: Chris Boot <bootc@bootc.net>
To: lkml <linux-kernel@vger.kernel.org>
Subject: BUG: unable to handle kernel NULL pointer dereference in ipv6_select_ident
Date: Wed, 21 Dec 2011 15:52:27 +0000 [thread overview]
Message-ID: <4EF200BB.7000209@bootc.net> (raw)
Hi folks,
I'm working on getting a 2-node VM cluster up and running, with DRBD and
Corosync/Pacemaker, running KVM VMs.
I can trigger a kernel panic in either _host_ system when running an
rsync on a _guest_ VM. The rsync is simply SSH over IPv6 from a remote
mail store (containing maildirs) to a local filesystem. I'm basically
working on migrating a physical IMAP server to one inside a VM.
After a few seconds of fairly heavy IPv6 traffic, I get the panic below.
You'll notice the panic refers to vhost_net, but I tried without that
and the kernel panics at exactly the same call point.
Panic:
[ 461.232932] BUG: unable to handle kernel NULL pointer dereference at
0000000000000298
[ 461.240790] IP: [<ffffffff812dde61>] ipv6_select_ident+0x31/0xa7
[ 461.246916] PGD 42d3e8067 PUD 41facf067 PMD 0
[ 461.251537] Oops: 0000 [#1] SMP
[ 461.254795] CPU 4
[ 461.256648] Modules linked in: sha1_generic hmac sha256_generic dlm
configfs ebtable_nat ebtables acpi_cpufreq mperf cpufreq_stats
cpufreq_conservative cpufreq_powersave cpufreq_userspace microcode
xt_NOTRACK ip_set_hash_net act_police cls_basic cls_flow cls_fw cls_u32 sch_
tbf sch_prio sch_htb sch_hfsc sch_ingress sch_sfq xt_realm xt_connlimit
xt_addrtype ip_set_hash_ip iptable_raw xt_comment xt_recent ipt_ULOG
ipt_REJECT ipt_REDIRECT ip6_queue ipt_NETMAP ipt_MASQUERADE ipt_ECN
ipt_ecn nf_conntrack_proto_udplite ipt_CLUSTERIP ipt_ah xt_time xt_s
et xt_TCPMSS ip_set xt_sctp xt_policy nf_nat_tftp nf_nat_snmp_basic
nf_conntrack_snmp nf_nat_sip nf_nat_pptp nf_nat_proto_gre nf_nat_irc
nf_nat_h323 nf_nat_ftp nf_nat_amanda ip6t_LOG ts_kmp ip6t_REJECT
nf_conntrack_amanda nf_conntrack_sane nf_conntrack_tftp nf_conntrack_sip nf
_conntrack_proto_sctp nf_conntrack_pptp nf_conntrack_proto_gre
nf_conntrack_netlink nf_conntrack_netbios_ns nf_conntrack_broadcast
nf_conntrack_irc nf_conntrack_h323 nf_conntrack_ftp xt_TPROXY
nf_tproxy_core xt_tcpmss xt_pkttype xt_physdev xt_owner xt_NFQUEUE
xt_NFLOG nfnetlin
k_log xt_multiport xt_mark xt_mac xt_limit xt_length xt_iprange
xt_helper xt_hashlimit xt_DSCP xt_dscp xt_dccp xt_connmark xt_CLASSIFY
xt_AUDIT ipt_LOG xt_tcpudp xt_state nf_conntrack_ipv6 nf_defrag_ipv6
iptable_nat nf_nat xt_conntrack nf_conntrack_ipv4 nf_defrag_ipv4 ip6table
_raw nf_conntrack ip6table_mangle iptable_mangle nfnetlink
iptable_filter ip_tables ip6table_filter ip6_tables x_tables bridge stp
bonding w83627ehf hwmon_vid coretemp crc32c_intel aesni_intel cryptd
aes_x86_64 aes_generic ipmi_poweroff ipmi_devintf ipmi_si
ipmi_msghandler vho
st_net macvtap macvlan tun drbd lru_cache cn loop kvm_intel kvm snd_pcm
snd_timer snd soundcore snd_page_alloc psmouse i2c_i801 processor
iTCO_wdt iTCO_vendor_support i2c_core evdev thermal_sys joydev serio_raw
pcspkr button ext4 mbcache jbd2 crc16 dm_mod raid1 md_mod sd_mod c
rc_t10dif usb_storage uas usbhid hid ahci libahci libata igb ehci_hcd
scsi_mod usbcore e1000e dca [last unloaded: scsi_wait_scan]
[ 461.446246]
[ 461.447812] Pid: 5756, comm: vhost-5753 Not tainted 3.1.0-1-amd64 #1
Supermicro X9SCL/X9SCM/X9SCL/X9SCM
[ 461.457562] RIP: 0010:[<ffffffff812dde61>] [<ffffffff812dde61>]
ipv6_select_ident+0x31/0xa7
[ 461.466271] RSP: 0018:ffff88043fd03758 EFLAGS: 00010202
[ 461.471708] RAX: ffff8803f7159038 RBX: 00000000000001f4 RCX:
0000000000000000
[ 461.478979] RDX: 0000000000000016 RSI: ffff88042dadcf30 RDI:
ffff8803f715906e
[ 461.486207] RBP: ffff8803f715906e R08: 0ea8c9feff005256 R09:
00000000000080fe
[ 461.493542] R10: 5256000000000000 R11: 80fe4e6fdcfeff00 R12:
0000000040115ba9
[ 461.500851] R13: ffffffff8168ed11 R14: 0000000000000011 R15:
ffff8803f7159880
[ 461.508167] FS: 0000000000000000(0000) GS:ffff88043fd00000(0000)
knlGS:0000000000000000
[ 461.516444] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 461.522317] CR2: 0000000000000298 CR3: 000000042d87e000 CR4:
00000000000426e0
[ 461.529607] DR0: 0000000000000000 DR1: 0000000000000000 DR2:
0000000000000000
[ 461.536916] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7:
0000000000000400
[ 461.544267] Process vhost-5753 (pid: 5756, threadinfo
ffff88042cb4a000, task ffff88042d13c970)
[ 461.553108] Stack:
[ 461.555202] ffff8803f7159038 ffff88042be0e280 0000000000000028
ffffffff812efa7f
[ 461.562840] 0000000000000246 ffff8803f7159054 ffff88042be0e318
ffff88042be0e280
[ 461.570544] ffffffffffffffa3 0000000040115ba9 ffffffff8168edc0
ffffffff812dbfe0
[ 461.578229] Call Trace:
[ 461.580742] <IRQ>
[ 461.582870] [<ffffffff812efa7f>] ? udp6_ufo_fragment+0x124/0x1a2
[ 461.589054] [<ffffffff812dbfe0>] ? ipv6_gso_segment+0xc0/0x155
[ 461.595140] [<ffffffff812700c6>] ? skb_gso_segment+0x208/0x28b
[ 461.601198] [<ffffffffa03f236b>] ? ipv6_confirm+0x146/0x15e
[nf_conntrack_ipv6]
[ 461.608786] [<ffffffff81291c4d>] ? nf_iterate+0x41/0x77
[ 461.614227] [<ffffffff81271d64>] ? dev_hard_start_xmit+0x357/0x543
[ 461.620659] [<ffffffff81291cf6>] ? nf_hook_slow+0x73/0x111
[ 461.626440] [<ffffffffa0379745>] ? br_parse_ip_options+0x19a/0x19a
[bridge]
[ 461.633581] [<ffffffff812722ff>] ? dev_queue_xmit+0x3af/0x459
[ 461.639577] [<ffffffffa03747d2>] ? br_dev_queue_push_xmit+0x72/0x76
[bridge]
[ 461.646887] [<ffffffffa03791e3>] ? br_nf_post_routing+0x17d/0x18f
[bridge]
[ 461.653997] [<ffffffff81291c4d>] ? nf_iterate+0x41/0x77
[ 461.659473] [<ffffffffa0374760>] ? br_flood+0xfa/0xfa [bridge]
[ 461.665485] [<ffffffff81291cf6>] ? nf_hook_slow+0x73/0x111
[ 461.671234] [<ffffffffa0374760>] ? br_flood+0xfa/0xfa [bridge]
[ 461.677299] [<ffffffffa0379215>] ?
nf_bridge_update_protocol+0x20/0x20 [bridge]
[ 461.684891] [<ffffffffa03bb0e5>] ? nf_ct_zone+0xa/0x17 [nf_conntrack]
[ 461.691520] [<ffffffffa0374760>] ? br_flood+0xfa/0xfa [bridge]
[ 461.697572] [<ffffffffa0374812>] ? NF_HOOK.constprop.8+0x3c/0x56
[bridge]
[ 461.704616] [<ffffffffa0379031>] ?
nf_bridge_push_encap_header+0x1c/0x26 [bridge]
[ 461.712329] [<ffffffffa037929f>] ? br_nf_forward_finish+0x8a/0x95
[bridge]
[ 461.719490] [<ffffffffa037900a>] ?
nf_bridge_pull_encap_header+0x1c/0x27 [bridge]
[ 461.727223] [<ffffffffa0379974>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge]
[ 461.734292] [<ffffffff81291c4d>] ? nf_iterate+0x41/0x77
[ 461.739758] [<ffffffffa03748cc>] ? __br_deliver+0xa0/0xa0 [bridge]
[ 461.746203] [<ffffffff81291cf6>] ? nf_hook_slow+0x73/0x111
[ 461.751950] [<ffffffffa03748cc>] ? __br_deliver+0xa0/0xa0 [bridge]
[ 461.758378] [<ffffffffa037533a>] ? NF_HOOK.constprop.4+0x56/0x56
[bridge]
[ 461.765454] [<ffffffffa03748cc>] ? __br_deliver+0xa0/0xa0 [bridge]
[ 461.771881] [<ffffffffa0374812>] ? NF_HOOK.constprop.8+0x3c/0x56
[bridge]
[ 461.778908] [<ffffffffa03749a6>] ? br_forward+0x16/0x5a [bridge]
[ 461.785041] [<ffffffffa03754db>] ?
br_handle_frame_finish+0x1a1/0x20f [bridge]
[ 461.792604] [<ffffffffa0379333>] ?
br_nf_pre_routing_finish_ipv6+0x89/0x92 [bridge]
[ 461.800513] [<ffffffffa0378e7b>] ? setup_pre_routing+0x38/0x5d [bridge]
[ 461.807440] [<ffffffffa0379e65>] ? br_nf_pre_routing+0x3e8/0x3f5
[bridge]
[ 461.814463] [<ffffffff81291c4d>] ? nf_iterate+0x41/0x77
[ 461.819908] [<ffffffff8103f89d>] ? select_task_rq_fair+0x369/0x610
[ 461.826347] [<ffffffffa037533a>] ? NF_HOOK.constprop.4+0x56/0x56
[bridge]
[ 461.833463] [<ffffffffa037533a>] ? NF_HOOK.constprop.4+0x56/0x56
[bridge]
[ 461.840532] [<ffffffff81291cf6>] ? nf_hook_slow+0x73/0x111
[ 461.846134] [<ffffffffa037533a>] ? NF_HOOK.constprop.4+0x56/0x56
[bridge]
[ 461.853222] [<ffffffff81036010>] ? test_tsk_need_resched+0xa/0x13
[ 461.859601] [<ffffffffa037533a>] ? NF_HOOK.constprop.4+0x56/0x56
[bridge]
[ 461.866650] [<ffffffffa0375320>] ? NF_HOOK.constprop.4+0x3c/0x56
[bridge]
[ 461.873686] [<ffffffffa03756ed>] ? br_handle_frame+0x1a4/0x1bb [bridge]
[ 461.880569] [<ffffffffa0375549>] ?
br_handle_frame_finish+0x20f/0x20f [bridge]
[ 461.888042] [<ffffffff8126f132>] ? __netif_receive_skb+0x2d6/0x415
[ 461.894467] [<ffffffff8126f2dd>] ? process_backlog+0x6c/0x123
[ 461.900414] [<ffffffff81026b37>] ? native_apic_msr_write+0x2c/0x2f
[ 461.906790] [<ffffffff81271034>] ? net_rx_action+0xa1/0x1af
[ 461.912625] [<ffffffff81036010>] ? test_tsk_need_resched+0xa/0x13
[ 461.919010] [<ffffffff8104ad04>] ? __do_softirq+0xb9/0x177
[ 461.924796] [<ffffffff8133452c>] ? call_softirq+0x1c/0x30
[ 461.930474] <EOI>
[ 461.932684] [<ffffffff8100f845>] ? do_softirq+0x3c/0x7b
[ 461.938106] [<ffffffff81271324>] ? netif_rx_ni+0x1e/0x27
[ 461.943610] [<ffffffffa0298721>] ? tun_get_user+0x39a/0x3c2 [tun]
[ 461.949923] [<ffffffffa0298766>] ? tun_sendmsg+0x1d/0x1f [tun]
[ 461.955938] [<ffffffffa02a6b50>] ? handle_tx+0x340/0x3de [vhost_net]
[ 461.962609] [<ffffffffa02a46cb>] ? vhost_worker+0x10b/0x121 [vhost_net]
[ 461.969447] [<ffffffffa02a45c0>] ?
vhost_attach_cgroups_work+0x1b/0x1b [vhost_net]
[ 461.977274] [<ffffffff8105e5d1>] ? kthread+0x76/0x7e
[ 461.982440] [<ffffffff81334434>] ? kernel_thread_helper+0x4/0x10
[ 461.988667] [<ffffffff8105e55b>] ? kthread_worker_fn+0x139/0x139
[ 461.994940] [<ffffffff81334430>] ? gs_change+0x13/0x13
[ 462.000283] Code: fd 53 48 89 f3 50 74 70 48 83 be 10 01 00 00 00 75
0d be 01 00 00 00 48 89 df e8 be 9d 00 00 48 8b 9b 10 01 00 00 48 85 db
74 4d <8b> 83 a4 00 00 00 85 c0 7f 21 80 3d 2e e5 51 00 01 74 18 be 68
[ 462.021671] RIP [<ffffffff812dde61>] ipv6_select_ident+0x31/0xa7
[ 462.027977] RSP <ffff88043fd03758>
[ 462.031554] CR2: 0000000000000298
[ 462.034892] ---[ end trace d158e8d429419372 ]---
[ 462.039878] Kernel panic - not syncing: Fatal exception in interrupt
Any insight will be gratefully received.
Thanks,
Chris
--
Chris Boot
bootc@bootc.net
next reply other threads:[~2011-12-21 16:00 UTC|newest]
Thread overview: 24+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-12-21 15:52 Chris Boot [this message]
2011-12-21 16:29 ` BUG: unable to handle kernel NULL pointer dereference in ipv6_select_ident Eric Dumazet
2011-12-21 17:03 ` Chris Boot
2011-12-21 17:36 ` Eric Dumazet
2011-12-21 18:00 ` Eric Dumazet
2011-12-21 20:05 ` Chris Boot
2011-12-21 20:28 ` Eric Dumazet
2011-12-21 20:52 ` Eric Dumazet
2011-12-21 21:58 ` Chris Boot
2011-12-21 23:12 ` Chris Boot
2011-12-22 4:37 ` Eric Dumazet
2011-12-22 6:00 ` [PATCH] bridge: provide a mtu() method for fake_dst_ops Eric Dumazet
2011-12-22 7:05 ` Steffen Klassert
2011-12-22 6:38 ` BUG: unable to handle kernel NULL pointer dereference in ipv6_select_ident Steffen Klassert
2011-12-22 7:51 ` Eric Dumazet
2011-12-22 7:58 ` Steffen Klassert
2011-12-22 8:05 ` Eric Dumazet
2011-12-22 10:01 ` Steffen Klassert
2011-12-22 10:04 ` Chris Boot
2011-12-22 14:15 ` Eric Dumazet
2011-12-22 15:54 ` Chris Boot
2011-12-22 17:41 ` Eric Dumazet
2011-12-22 18:29 ` David Miller
2011-12-23 3:38 ` David Miller
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4EF200BB.7000209@bootc.net \
--to=bootc@bootc.net \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.