* Bridged networking panics @ 2012-06-28 13:57 Massimo Cetra 2012-07-04 10:42 ` Massimo Cetra 0 siblings, 1 reply; 4+ messages in thread From: Massimo Cetra @ 2012-06-28 13:57 UTC (permalink / raw) To: netdev, linux-kernel [-- Attachment #1: Type: text/plain, Size: 629 bytes --] Hi all, i'm attaching 3 panics of a 3.2.X kernel. The panics were obtained with a 3.2.20 from debian testing and from a vanilla compile of 3.2.21. Those panics have been already posted some months ago [1] but are not fixed. The problems seems related to bridged networking. Whenever there is a bridged aliased interface (like br0:1 br0:2 etcc), the server will panic after some time. The more the network load, the shortest the uptime. Removing (ifconfig br0:1 down) or adding back an interface seems to help the panic to appear. Any more hints ? MC [1] for example http://comments.gmane.org/gmane.linux.network/226912 [-- Attachment #2: 3.2.20.2-1.txt --] [-- Type: text/plain, Size: 16034 bytes --] Jun 28 13:18:35 172.30.1.2 [ 295.504843] BUG: unable to handle kernel Jun 28 13:18:35 172.30.1.2 [ 295.520628] IP: Jun 28 13:18:35 172.30.1.2 [ 295.534792] PGD 0 Jun 28 13:18:35 172.30.1.2 Jun 28 13:18:35 172.30.1.2 [ 295.538889] Oops: 0000 [#1] Jun 28 13:18:35 172.30.1.2 SMP Jun 28 13:18:35 172.30.1.2 Jun 28 13:18:35 172.30.1.2 [ 295.545471] CPU 0 Jun 28 13:18:35 172.30.1.2 Jun 28 13:18:35 172.30.1.2 [ 295.549169] Modules linked in: Jun 28 13:18:35 172.30.1.2 Jun 28 13:18:35 172.30.1.2 [ 295.691502] Jun 28 13:18:35 172.30.1.2 [ 295.694506] Pid: 7754, comm: kvm Not tainted 3.2.0-2-amd64 #1 Jun 28 13:18:35 172.30.1.2 /0N051F Jun 28 13:18:35 172.30.1.2 Jun 28 13:18:35 172.30.1.2 [ 295.711720] RIP: 0010:[<ffffffffa01c333d>] Jun 28 13:18:35 172.30.1.2 [ 295.730738] RSP: 0018:ffff88042fc03b18 EFLAGS: 00010293 Jun 28 13:18:35 172.30.1.2 [ 295.741389] RAX: 0000000000000000 RBX: ffff880411b9eec0 RCX: 00000000fffffba0 Jun 28 13:18:35 172.30.1.2 [ 295.755682] RDX: ffffffffa01c330f RSI: 0000000000000282 RDI: ffff880411b9eec0 Jun 28 13:18:35 172.30.1.2 [ 295.769975] RBP: ffff880226688000 R08: 0000000000000000 R09: ffff88042fc03ad0 Jun 28 13:18:35 172.30.1.2 [ 295.784268] R10: ffffffff8165ab00 R11: ffffffff8165ab00 R12: 0000000000000000 Jun 28 13:18:35 172.30.1.2 [ 295.798561] R13: ffff880225bec002 R14: ffff8804131987c0 R15: ffff880225bec000 Jun 28 13:18:35 172.30.1.2 [ 295.812854] FS: 00007fc06177d900(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000 Jun 28 13:18:35 172.30.1.2 [ 295.829070] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jun 28 13:18:35 172.30.1.2 [ 295.840587] CR2: 0000000000000018 CR3: 0000000409d7b000 CR4: 00000000000026e0 Jun 28 13:18:35 172.30.1.2 [ 295.854880] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jun 28 13:18:35 172.30.1.2 [ 295.869175] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Jun 28 13:18:35 172.30.1.2 [ 295.883469] Process kvm (pid: 7754, threadinfo ffff88040bcc6000, task ffff880424ca2100) Jun 28 13:18:35 172.30.1.2 [ 295.899512] Stack: Jun 28 13:18:35 172.30.1.2 [ 295.903571] ffffffff80000000 Jun 28 13:18:35 172.30.1.2 Jun 28 13:18:35 172.30.1.2 [ 295.918613] ffff880425367000 Jun 28 13:18:35 172.30.1.2 Jun 28 13:18:35 172.30.1.2 [ 295.933657] ffff880411b9eec0 Jun 28 13:18:35 172.30.1.2 Jun 28 13:18:35 172.30.1.2 [ 295.948699] Call Trace: Jun 28 13:18:35 172.30.1.2 [ 295.953626] <IRQ> Jun 28 13:18:35 172.30.1.2 Jun 28 13:18:35 172.30.1.2 [ 295.957918] [<ffffffffa01c3714>] ? br_parse_ip_options+0x3d/0x19a [bridge] Jun 28 13:18:35 172.30.1.2 [ 295.971866] [<ffffffffa01c3aa0>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge] Jun 28 13:18:36 172.30.1.2 [ 295.985469] [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77 Jun 28 13:18:36 172.30.1.2 [ 295.996123] [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.008687] [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.021245] [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101 Jun 28 13:18:36 172.30.1.2 [ 296.032418] [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.044981] [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.058757] [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.071319] [<ffffffffa01be887>] ? NF_HOOK.constprop.10+0x3c/0x56 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.085267] [<ffffffffa01bea1b>] ? br_forward+0x16/0x5a [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.097480] [<ffffffffa01bf543>] ? br_handle_frame_finish+0x1a1/0x20f [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.112141] [<ffffffffa01c3638>] ? br_nf_pre_routing_finish+0x1ee/0x1fb [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.127146] [<ffffffffa01c2ff7>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.140055] [<ffffffffa01c3f91>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.153828] [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77 Jun 28 13:18:36 172.30.1.2 [ 296.164482] [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.178255] [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101 Jun 28 13:18:36 172.30.1.2 [ 296.189430] [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.203206] [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.216982] [<ffffffffa01bf388>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.230757] [<ffffffff810135ad>] ? paravirt_read_tsc+0x5/0x8 Jun 28 13:18:36 172.30.1.2 [ 296.242274] [<ffffffff81013622>] ? read_tsc+0x5/0x14 Jun 28 13:18:36 172.30.1.2 [ 296.252409] [<ffffffffa01bf764>] ? br_handle_frame+0x1b3/0x1cb [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.265837] [<ffffffffa01bf5b1>] ? br_handle_frame_finish+0x20f/0x20f [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.280498] [<ffffffff8128a306>] ? __netif_receive_skb+0x324/0x41f Jun 28 13:18:36 172.30.1.2 [ 296.293058] [<ffffffff8128a46d>] ? process_backlog+0x6c/0x123 Jun 28 13:18:36 172.30.1.2 [ 296.304751] [<ffffffff8128c351>] ? net_rx_action+0xa1/0x1af Jun 28 13:18:36 172.30.1.2 [ 296.316098] [<ffffffff8103703b>] ? test_tsk_need_resched+0xa/0x13 Jun 28 13:18:36 172.30.1.2 [ 296.328486] [<ffffffff8104bee4>] ? __do_softirq+0xb9/0x177 Jun 28 13:18:36 172.30.1.2 [ 296.339662] [<ffffffff8135162c>] ? call_softirq+0x1c/0x30 Jun 28 13:18:36 172.30.1.2 [ 296.350656] <EOI> Jun 28 13:18:36 172.30.1.2 Jun 28 13:18:36 172.30.1.2 [ 296.354946] [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b Jun 28 13:18:36 172.30.1.2 [ 296.365597] [<ffffffff8128c641>] ? netif_rx_ni+0x1e/0x27 Jun 28 13:18:36 172.30.1.2 [ 296.376425] [<ffffffffa028b721>] ? tun_get_user+0x39a/0x3c2 [tun] Jun 28 13:18:36 172.30.1.2 [ 296.388811] [<ffffffffa028ba66>] ? tun_chr_poll+0xcd/0xcd [tun] Jun 28 13:18:36 172.30.1.2 [ 296.400851] [<ffffffffa028bac4>] ? tun_chr_aio_write+0x5e/0x79 [tun] Jun 28 13:18:36 172.30.1.2 [ 296.413760] [<ffffffff810f97f8>] ? do_sync_readv_writev+0x9a/0xd7 Jun 28 13:18:36 172.30.1.2 [ 296.426145] [<ffffffff81036457>] ? should_resched+0x5/0x23 Jun 28 13:18:36 172.30.1.2 [ 296.437316] [<ffffffff81036457>] ? should_resched+0x5/0x23 Jun 28 13:18:36 172.30.1.2 [ 296.448491] [<ffffffff81162ea1>] ? security_file_permission+0x16/0x2d Jun 28 13:18:36 172.30.1.2 [ 296.461569] [<ffffffff810f9a5c>] ? do_readv_writev+0xaf/0x11c Jun 28 13:18:36 172.30.1.2 [ 296.473266] [<ffffffff8112aebe>] ? eventfd_ctx_read+0x162/0x174 Jun 28 13:18:36 172.30.1.2 [ 296.485310] [<ffffffff8103f48f>] ? try_to_wake_up+0x197/0x197 Jun 28 13:18:36 172.30.1.2 [ 296.497001] [<ffffffff810f9c31>] ? sys_writev+0x45/0x90 Jun 28 13:18:36 172.30.1.2 [ 296.507653] [<ffffffff8134f3d2>] ? system_call_fastpath+0x16/0x1b Jun 28 13:18:36 172.30.1.2 [ 296.520038] Code: Jun 28 13:18:36 172.30.1.2 53 Jun 28 13:18:36 172.30.1.2 48 Jun 28 13:18:36 172.30.1.2 89 Jun 28 13:18:36 172.30.1.2 fb Jun 28 13:18:36 172.30.1.2 48 Jun 28 13:18:36 172.30.1.2 83 Jun 28 13:18:36 172.30.1.2 ec Jun 28 13:18:36 172.30.1.2 10 Jun 28 13:18:36 172.30.1.2 66 Jun 28 13:18:36 172.30.1.2 81 Jun 28 13:18:36 172.30.1.2 7f Jun 28 13:18:36 172.30.1.2 7e Jun 28 13:18:36 172.30.1.2 08 Jun 28 13:18:36 172.30.1.2 06 Jun 28 13:18:36 172.30.1.2 4c Jun 28 13:18:36 172.30.1.2 8b Jun 28 13:18:36 172.30.1.2 a7 Jun 28 13:18:36 172.30.1.2 98 Jun 28 13:18:36 172.30.1.2 00 Jun 28 13:18:36 172.30.1.2 00 Jun 28 13:18:36 172.30.1.2 00 Jun 28 13:18:36 172.30.1.2 74 Jun 28 13:18:36 172.30.1.2 3d Jun 28 13:18:36 172.30.1.2 e8 Jun 28 13:18:36 172.30.1.2 07 Jun 28 13:18:36 172.30.1.2 fe Jun 28 13:18:36 172.30.1.2 ff Jun 28 13:18:36 172.30.1.2 ff Jun 28 13:18:36 172.30.1.2 66 Jun 28 13:18:36 172.30.1.2 3d Jun 28 13:18:36 172.30.1.2 08 Jun 28 13:18:36 172.30.1.2 06 Jun 28 13:18:36 172.30.1.2 75 Jun 28 13:18:36 172.30.1.2 09 Jun 28 13:18:36 172.30.1.2 83 Jun 28 13:18:36 172.30.1.2 3d Jun 28 13:18:36 172.30.1.2 91 Jun 28 13:18:36 172.30.1.2 6a Jun 28 13:18:36 172.30.1.2 00 Jun 28 13:18:36 172.30.1.2 00 Jun 28 13:18:36 172.30.1.2 00 Jun 28 13:18:36 172.30.1.2 75 Jun 28 13:18:36 172.30.1.2 29 Jun 28 13:18:36 172.30.1.2 Jun 28 13:18:36 172.30.1.2 f6 Jun 28 13:18:36 172.30.1.2 44 Jun 28 13:18:36 172.30.1.2 24 Jun 28 13:18:36 172.30.1.2 18 Jun 28 13:18:36 172.30.1.2 01 Jun 28 13:18:36 172.30.1.2 49 Jun 28 13:18:36 172.30.1.2 8b Jun 28 13:18:36 172.30.1.2 6c Jun 28 13:18:36 172.30.1.2 24 Jun 28 13:18:36 172.30.1.2 08 Jun 28 13:18:36 172.30.1.2 74 Jun 28 13:18:36 172.30.1.2 12 Jun 28 13:18:36 172.30.1.2 8a Jun 28 13:18:36 172.30.1.2 43 Jun 28 13:18:36 172.30.1.2 7d Jun 28 13:18:36 172.30.1.2 83 Jun 28 13:18:36 172.30.1.2 e0 Jun 28 13:18:36 172.30.1.2 f8 Jun 28 13:18:36 172.30.1.2 83 Jun 28 13:18:36 172.30.1.2 c8 Jun 28 13:18:36 172.30.1.2 Jun 28 13:18:36 172.30.1.2 [ 296.561479] RIP Jun 28 13:18:36 172.30.1.2 [ 296.575830] RSP <ffff88042fc03b18> Jun 28 13:18:36 172.30.1.2 [ 296.582838] CR2: 0000000000000018 Jun 28 13:18:36 172.30.1.2 [ 296.589912] ---[ end trace c5e13ce92514d70f ]--- Jun 28 13:18:36 172.30.1.2 [ 296.599302] Kernel panic - not syncing: Fatal exception in interrupt Jun 28 13:18:36 172.30.1.2 [ 296.612171] Pid: 7754, comm: kvm Tainted: G D 3.2.0-2-amd64 #1 Jun 28 13:18:36 172.30.1.2 [ 296.625731] Call Trace: Jun 28 13:18:36 172.30.1.2 [ 296.630786] <IRQ> Jun 28 13:18:36 172.30.1.2 [ 296.642245] [<ffffffff8134b246>] ? oops_end+0xa9/0xb6 Jun 28 13:18:36 172.30.1.2 [ 296.652680] [<ffffffff8134362d>] ? no_context+0x1ff/0x20e Jun 28 13:18:36 172.30.1.2 [ 296.663873] [<ffffffff81052316>] ? __mod_timer+0x139/0x14b Jun 28 13:18:36 172.30.1.2 [ 296.675175] [<ffffffff8134d259>] ? do_page_fault+0x1a8/0x337 Jun 28 13:18:36 172.30.1.2 [ 296.686892] [<ffffffffa03caf06>] ? ip_vs_conn_put+0x28/0x32 [ip_vs] Jun 28 13:18:36 172.30.1.2 [ 296.699794] [<ffffffffa03cd0e0>] ? ip_vs_out+0x2bd/0x432 [ip_vs] Jun 28 13:18:36 172.30.1.2 [ 296.712179] [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101 Jun 28 13:18:36 172.30.1.2 [ 296.723614] [<ffffffff8134a9b5>] ? page_fault+0x25/0x30 Jun 28 13:18:36 172.30.1.2 [ 296.734519] [<ffffffffa01c330f>] ? nf_bridge_update_protocol+0x20/0x20 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.749474] [<ffffffffa01c333d>] ? br_nf_forward_finish+0x2e/0x95 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.763549] [<ffffffffa01c332e>] ? br_nf_forward_finish+0x1f/0x95 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.777632] [<ffffffffa01c3714>] ? br_parse_ip_options+0x3d/0x19a [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.791715] [<ffffffffa01c3aa0>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.805450] [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77 Jun 28 13:18:36 172.30.1.2 [ 296.816247] [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.829003] [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.841695] [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101 Jun 28 13:18:36 172.30.1.2 [ 296.852992] [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.865687] [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.879725] [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.892411] [<ffffffffa01be887>] ? NF_HOOK.constprop.10+0x3c/0x56 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.906483] [<ffffffffa01bea1b>] ? br_forward+0x16/0x5a [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.918889] [<ffffffffa01bf543>] ? br_handle_frame_finish+0x1a1/0x20f [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.933723] [<ffffffffa01c3638>] ? br_nf_pre_routing_finish+0x1ee/0x1fb [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.948918] [<ffffffffa01c2ff7>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.962024] [<ffffffffa01c3f91>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge] Jun 28 13:18:36 172.30.1.2 [ 296.975994] [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77 Jun 28 13:18:37 172.30.1.2 [ 296.986837] [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 13:18:37 172.30.1.2 [ 297.000802] [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101 Jun 28 13:18:37 172.30.1.2 [ 297.012107] [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 13:18:37 172.30.1.2 [ 297.026146] [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 13:18:37 172.30.1.2 [ 297.040021] [<ffffffffa01bf388>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge] Jun 28 13:18:37 172.30.1.2 [ 297.053999] [<ffffffff810135ad>] ? paravirt_read_tsc+0x5/0x8 Jun 28 13:18:37 172.30.1.2 [ 297.065638] [<ffffffff81013622>] ? read_tsc+0x5/0x14 Jun 28 13:18:37 172.30.1.2 [ 297.075900] [<ffffffffa01bf764>] ? br_handle_frame+0x1b3/0x1cb [bridge] Jun 28 13:18:37 172.30.1.2 [ 297.089449] [<ffffffffa01bf5b1>] ? br_handle_frame_finish+0x20f/0x20f [bridge] Jun 28 13:18:37 172.30.1.2 [ 297.104301] [<ffffffff8128a306>] ? __netif_receive_skb+0x324/0x41f Jun 28 13:18:37 172.30.1.2 [ 297.116984] [<ffffffff8128a46d>] ? process_backlog+0x6c/0x123 Jun 28 13:18:37 172.30.1.2 [ 297.128799] [<ffffffff8128c351>] ? net_rx_action+0xa1/0x1af Jun 28 13:18:37 172.30.1.2 [ 297.140267] [<ffffffff8103703b>] ? test_tsk_need_resched+0xa/0x13 Jun 28 13:18:37 172.30.1.2 [ 297.152847] [<ffffffff8104bee4>] ? __do_softirq+0xb9/0x177 Jun 28 13:18:37 172.30.1.2 [ 297.164227] [<ffffffff8135162c>] ? call_softirq+0x1c/0x30 Jun 28 13:18:37 172.30.1.2 [ 297.175344] <EOI> Jun 28 13:18:37 172.30.1.2 [ 297.187521] [<ffffffff8128c641>] ? netif_rx_ni+0x1e/0x27 Jun 28 13:18:37 172.30.1.2 [ 297.198537] [<ffffffffa028b721>] ? tun_get_user+0x39a/0x3c2 [tun] Jun 28 13:18:37 172.30.1.2 [ 297.211100] [<ffffffffa028ba66>] ? tun_chr_poll+0xcd/0xcd [tun] Jun 28 13:18:37 172.30.1.2 [ 297.223376] [<ffffffffa028bac4>] ? tun_chr_aio_write+0x5e/0x79 [tun] Jun 28 13:18:37 172.30.1.2 [ 297.236417] [<ffffffff810f97f8>] ? do_sync_readv_writev+0x9a/0xd7 Jun 28 13:18:37 172.30.1.2 [ 297.248994] [<ffffffff81036457>] ? should_resched+0x5/0x23 Jun 28 13:18:37 172.30.1.2 [ 297.260291] [<ffffffff81036457>] ? should_resched+0x5/0x23 Jun 28 13:18:37 172.30.1.2 [ 297.271594] [<ffffffff81162ea1>] ? security_file_permission+0x16/0x2d Jun 28 13:18:37 172.30.1.2 [ 297.284804] [<ffffffff810f9a5c>] ? do_readv_writev+0xaf/0x11c Jun 28 13:18:37 172.30.1.2 [ 297.296692] [<ffffffff8112aebe>] ? eventfd_ctx_read+0x162/0x174 Jun 28 13:18:37 172.30.1.2 [ 297.308933] [<ffffffff8103f48f>] ? try_to_wake_up+0x197/0x197 Jun 28 13:18:37 172.30.1.2 [ 297.320754] [<ffffffff810f9c31>] ? sys_writev+0x45/0x90 Jun 28 13:18:37 172.30.1.2 [ 297.331532] [<ffffffff8134f3d2>] ? system_call_fastpath+0x16/0x1b Jun 28 13:18:37 mork mach_down[22201]: [22388]: info: Taking over resource group 172.30.1.99/24/br1/172.30.1.255 Jun 28 13:18:37 mork ResourceManager[22392]: [22414]: info: Acquiring resource group: mindy 172.30.1.99/24/br1/172.30.1.255 Jun 28 13:19:24 mork mon[12667]: failure for mail2 mxmon 1340882364 172.30.1.22 Jun 28 13:19:24 mork mon[12667]: calling alert marksolmail.down.alert for mail2/mxmon (/usr/lib/mon/alert.d/marksolmail.down.alert,-h) 172.30.1.22 Jun 28 13:20:25 mork mon[12667]: failure for mail2 mxmon 1340882425 172.30.1.22 Jun 28 13:21:25 mork mon[12667]: failure for mail2 mxmon 1340882485 172.30.1.22 Jun 28 13:22:25 mork mon[12667]: failure for mail2 mxmon 1340882545 172.30.1.22 Jun 28 13:23:12 mork ResourceManager[22956]: [22966]: info: Releasing resource group: mindy 172.30.1.99/24/br1/172.30.1.255 Jun 28 13:23:12 mork ResourceManager[22956]: [22983]: info: Running /etc/ha.d/resource.d/IPaddr 172.30.1.99/24/br1/172.30.1.255 stop Jun 28 13:23:12 mork ResourceManager[22956]: [22984]: debug: Starting /etc/ha.d/resource.d/IPaddr 172.30.1.99/24/br1/172.30.1.255 stop Jun 28 13:23:12 mork ResourceManager[22956]: [23030]: debug: /etc/ha.d/resource.d/IPaddr 172.30.1.99/24/br1/172.30.1.255 stop done. RC=0 Jun 28 13:23:25 mork mon[12667]: failure for mail2 mxmon 1340882605 172.30.1.22 [-- Attachment #3: 3.2.20.2-2.txt --] [-- Type: text/plain, Size: 17032 bytes --] Jun 28 14:16:03 172.30.1.2 [ 3193.846371] BUG: unable to handle kernel Jun 28 14:16:03 172.30.1.2 [ 3193.862035] IP: Jun 28 14:16:03 172.30.1.2 [ 3193.876118] PGD 0 Jun 28 14:16:03 172.30.1.2 Jun 28 14:16:03 172.30.1.2 [ 3193.880134] Oops: 0000 [#1] Jun 28 14:16:03 172.30.1.2 SMP Jun 28 14:16:03 172.30.1.2 Jun 28 14:16:03 172.30.1.2 [ 3193.886590] CPU 0 Jun 28 14:16:03 172.30.1.2 Jun 28 14:16:03 172.30.1.2 [ 3193.890246] Modules linked in: Jun 28 14:16:03 172.30.1.2 Jun 28 14:16:03 172.30.1.2 [ 3194.029137] Jun 28 14:16:03 172.30.1.2 [ 3194.032099] Pid: 0, comm: swapper/0 Not tainted 3.2.0-2-amd64 #1 Jun 28 14:16:03 172.30.1.2 /0N051F Jun 28 14:16:03 172.30.1.2 Jun 28 14:16:03 172.30.1.2 [ 3194.049664] RIP: 0010:[<ffffffffa01dc33d>] Jun 28 14:16:03 172.30.1.2 [ 3194.068599] RSP: 0018:ffff88042fc039b0 EFLAGS: 00010293 Jun 28 14:16:03 172.30.1.2 [ 3194.079206] RAX: 0000000000000000 RBX: ffff8802f335f980 RCX: 0000000000000006 Jun 28 14:16:03 172.30.1.2 [ 3194.093456] RDX: ffffffffa01dc30f RSI: 00000001000b4640 RDI: ffff8802f335f980 Jun 28 14:16:03 172.30.1.2 [ 3194.107706] RBP: ffff880424ce6000 R08: 0000000000000000 R09: ffff88042fc03968 Jun 28 14:16:03 172.30.1.2 [ 3194.121957] R10: ffffffff8165ab00 R11: ffffffff8165ab00 R12: 0000000000000000 Jun 28 14:16:03 172.30.1.2 [ 3194.136206] R13: ffff880426cc1002 R14: ffff8802e094f140 R15: ffff880426cc1000 Jun 28 14:16:03 172.30.1.2 [ 3194.150456] FS: 0000000000000000(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000 Jun 28 14:16:03 172.30.1.2 [ 3194.166629] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Jun 28 14:16:03 172.30.1.2 [ 3194.178104] CR2: 0000000000000018 CR3: 00000001c304d000 CR4: 00000000000026e0 Jun 28 14:16:03 172.30.1.2 [ 3194.192353] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jun 28 14:16:03 172.30.1.2 [ 3194.206602] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Jun 28 14:16:03 172.30.1.2 [ 3194.220852] Process swapper/0 (pid: 0, threadinfo ffffffff81600000, task ffffffff8160d020) Jun 28 14:16:03 172.30.1.2 [ 3194.237370] Stack: Jun 28 14:16:03 172.30.1.2 [ 3194.241387] ffffffff80000000 Jun 28 14:16:03 172.30.1.2 Jun 28 14:16:03 172.30.1.2 [ 3194.256222] ffff880424d4c000 Jun 28 14:16:03 172.30.1.2 Jun 28 14:16:03 172.30.1.2 [ 3194.271056] ffff8802f335f980 Jun 28 14:16:03 172.30.1.2 Jun 28 14:16:03 172.30.1.2 [ 3194.285891] Call Trace: Jun 28 14:16:03 172.30.1.2 [ 3194.290776] <IRQ> Jun 28 14:16:03 172.30.1.2 Jun 28 14:16:03 172.30.1.2 [ 3194.294987] [<ffffffffa01dc714>] ? br_parse_ip_options+0x3d/0x19a [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.308893] [<ffffffffa01dcaa0>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.322456] [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77 Jun 28 14:16:03 172.30.1.2 [ 3194.333067] [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.345586] [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.358104] [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101 Jun 28 14:16:03 172.30.1.2 [ 3194.369235] [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.381756] [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.395489] [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.408007] [<ffffffffa01d7887>] ? NF_HOOK.constprop.10+0x3c/0x56 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.421913] [<ffffffffa01d7a1b>] ? br_forward+0x16/0x5a [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.434086] [<ffffffffa01d8543>] ? br_handle_frame_finish+0x1a1/0x20f [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.448703] [<ffffffffa01dc638>] ? br_nf_pre_routing_finish+0x1ee/0x1fb [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.463664] [<ffffffffa01dbff7>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.476529] [<ffffffffa01dcf91>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.490260] [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77 Jun 28 14:16:03 172.30.1.2 [ 3194.500871] [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.514600] [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101 Jun 28 14:16:03 172.30.1.2 [ 3194.525732] [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.539466] [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.553200] [<ffffffffa01d8388>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.566933] [<ffffffff812bd793>] ? tcp_gro_receive+0x83/0x1d8 Jun 28 14:16:03 172.30.1.2 [ 3194.578586] [<ffffffffa01d8764>] ? br_handle_frame+0x1b3/0x1cb [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.591971] [<ffffffffa01d85b1>] ? br_handle_frame_finish+0x20f/0x20f [bridge] Jun 28 14:16:03 172.30.1.2 [ 3194.606588] [<ffffffff8128a306>] ? __netif_receive_skb+0x324/0x41f Jun 28 14:16:03 172.30.1.2 [ 3194.619106] [<ffffffff8128bd61>] ? netif_receive_skb+0x63/0x69 Jun 28 14:16:03 172.30.1.2 [ 3194.630927] [<ffffffff8128c233>] ? napi_gro_receive+0x1d/0x2b Jun 28 14:16:03 172.30.1.2 [ 3194.642577] [<ffffffff8128bddd>] ? napi_skb_finish+0x1c/0x31 Jun 28 14:16:03 172.30.1.2 [ 3194.654057] [<ffffffffa00b6460>] ? bnx2_poll_work+0x84a/0x95d [bnx2] Jun 28 14:16:03 172.30.1.2 [ 3194.666926] [<ffffffff8103f47f>] ? try_to_wake_up+0x187/0x197 Jun 28 14:16:03 172.30.1.2 [ 3194.678579] [<ffffffffa00b6716>] ? bnx2_poll+0xf6/0x1c4 [bnx2] Jun 28 14:16:03 172.30.1.2 [ 3194.690402] [<ffffffff8128c351>] ? net_rx_action+0xa1/0x1af Jun 28 14:16:03 172.30.1.2 [ 3194.701706] [<ffffffff81037d6e>] ? __wake_up+0x35/0x46 Jun 28 14:16:03 172.30.1.2 [ 3194.712143] [<ffffffff8104bee4>] ? __do_softirq+0xb9/0x177 Jun 28 14:16:03 172.30.1.2 [ 3194.723276] [<ffffffff8106a8e7>] ? clockevents_program_event+0xaa/0xce Jun 28 14:16:04 172.30.1.2 [ 3194.736491] [<ffffffff8135162c>] ? call_softirq+0x1c/0x30 Jun 28 14:16:04 172.30.1.2 [ 3194.747450] [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b Jun 28 14:16:04 172.30.1.2 [ 3194.758059] [<ffffffff8104c14c>] ? irq_exit+0x3c/0x9a Jun 28 14:16:04 172.30.1.2 [ 3194.768320] [<ffffffff8100f615>] ? do_IRQ+0x82/0x98 Jun 28 14:16:04 172.30.1.2 [ 3194.778239] [<ffffffff8134a6ee>] ? common_interrupt+0x6e/0x6e Jun 28 14:16:04 172.30.1.2 [ 3194.789886] <EOI> Jun 28 14:16:04 172.30.1.2 Jun 28 14:16:04 172.30.1.2 [ 3194.794091] [<ffffffff811aed74>] ? timerqueue_add+0x80/0xa0 Jun 28 14:16:04 172.30.1.2 [ 3194.805397] [<ffffffff811ec569>] ? intel_idle+0xea/0x119 Jun 28 14:16:04 172.30.1.2 [ 3194.816179] [<ffffffff811ec548>] ? intel_idle+0xc9/0x119 Jun 28 14:16:04 172.30.1.2 [ 3194.826966] [<ffffffff8126c573>] ? cpuidle_idle_call+0xec/0x179 Jun 28 14:16:04 172.30.1.2 [ 3194.838963] [<ffffffff8100d248>] ? cpu_idle+0xa5/0xf2 Jun 28 14:16:04 172.30.1.2 [ 3194.849225] [<ffffffff816aab33>] ? start_kernel+0x3b3/0x3be Jun 28 14:16:04 172.30.1.2 [ 3194.860528] [<ffffffff816aa140>] ? early_idt_handlers+0x140/0x140 Jun 28 14:16:04 172.30.1.2 [ 3194.872870] [<ffffffff816aa3c4>] ? x86_64_start_kernel+0x104/0x111 Jun 28 14:16:04 172.30.1.2 [ 3194.885386] Code: Jun 28 14:16:04 172.30.1.2 53 Jun 28 14:16:04 172.30.1.2 48 Jun 28 14:16:04 172.30.1.2 89 Jun 28 14:16:04 172.30.1.2 fb Jun 28 14:16:04 172.30.1.2 48 Jun 28 14:16:04 172.30.1.2 83 Jun 28 14:16:04 172.30.1.2 ec Jun 28 14:16:04 172.30.1.2 10 Jun 28 14:16:04 172.30.1.2 66 Jun 28 14:16:04 172.30.1.2 81 Jun 28 14:16:04 172.30.1.2 7f Jun 28 14:16:04 172.30.1.2 7e Jun 28 14:16:04 172.30.1.2 08 Jun 28 14:16:04 172.30.1.2 06 Jun 28 14:16:04 172.30.1.2 4c Jun 28 14:16:04 172.30.1.2 8b Jun 28 14:16:04 172.30.1.2 a7 Jun 28 14:16:04 172.30.1.2 98 Jun 28 14:16:04 172.30.1.2 00 Jun 28 14:16:04 172.30.1.2 00 Jun 28 14:16:04 172.30.1.2 00 Jun 28 14:16:04 172.30.1.2 74 Jun 28 14:16:04 172.30.1.2 3d Jun 28 14:16:04 172.30.1.2 e8 Jun 28 14:16:04 172.30.1.2 07 Jun 28 14:16:04 172.30.1.2 fe Jun 28 14:16:04 172.30.1.2 ff Jun 28 14:16:04 172.30.1.2 ff Jun 28 14:16:04 172.30.1.2 66 Jun 28 14:16:04 172.30.1.2 3d Jun 28 14:16:04 172.30.1.2 08 Jun 28 14:16:04 172.30.1.2 06 Jun 28 14:16:04 172.30.1.2 75 Jun 28 14:16:04 172.30.1.2 09 Jun 28 14:16:04 172.30.1.2 83 Jun 28 14:16:04 172.30.1.2 3d Jun 28 14:16:04 172.30.1.2 91 Jun 28 14:16:04 172.30.1.2 6a Jun 28 14:16:04 172.30.1.2 00 Jun 28 14:16:04 172.30.1.2 00 Jun 28 14:16:04 172.30.1.2 00 Jun 28 14:16:04 172.30.1.2 75 Jun 28 14:16:04 172.30.1.2 29 Jun 28 14:16:04 172.30.1.2 Jun 28 14:16:04 172.30.1.2 f6 Jun 28 14:16:04 172.30.1.2 44 Jun 28 14:16:04 172.30.1.2 24 Jun 28 14:16:04 172.30.1.2 18 Jun 28 14:16:04 172.30.1.2 01 Jun 28 14:16:04 172.30.1.2 49 Jun 28 14:16:04 172.30.1.2 8b Jun 28 14:16:04 172.30.1.2 6c Jun 28 14:16:04 172.30.1.2 24 Jun 28 14:16:04 172.30.1.2 08 Jun 28 14:16:04 172.30.1.2 74 Jun 28 14:16:04 172.30.1.2 12 Jun 28 14:16:04 172.30.1.2 8a Jun 28 14:16:04 172.30.1.2 43 Jun 28 14:16:04 172.30.1.2 7d Jun 28 14:16:04 172.30.1.2 83 Jun 28 14:16:04 172.30.1.2 e0 Jun 28 14:16:04 172.30.1.2 f8 Jun 28 14:16:04 172.30.1.2 83 Jun 28 14:16:04 172.30.1.2 c8 Jun 28 14:16:04 172.30.1.2 Jun 28 14:16:04 172.30.1.2 [ 3194.924067] RIP Jun 28 14:16:04 172.30.1.2 [ 3194.938333] RSP <ffff88042fc039b0> Jun 28 14:16:04 172.30.1.2 [ 3194.945299] CR2: 0000000000000018 Jun 28 14:16:04 172.30.1.2 [ 3194.952668] ---[ end trace c28d39074732fa49 ]--- Jun 28 14:16:04 172.30.1.2 [ 3194.962197] Kernel panic - not syncing: Fatal exception in interrupt Jun 28 14:16:04 172.30.1.2 [ 3194.975155] Pid: 0, comm: swapper/0 Tainted: G D 3.2.0-2-amd64 #1 Jun 28 14:16:04 172.30.1.2 [ 3194.989324] Call Trace: Jun 28 14:16:04 172.30.1.2 [ 3194.994443] <IRQ> Jun 28 14:16:04 172.30.1.2 [ 3195.006177] [<ffffffff8134b246>] ? oops_end+0xa9/0xb6 Jun 28 14:16:04 172.30.1.2 [ 3195.016744] [<ffffffff8134362d>] ? no_context+0x1ff/0x20e Jun 28 14:16:04 172.30.1.2 [ 3195.028010] [<ffffffff810e9e7c>] ? virt_to_slab+0x6/0x16 Jun 28 14:16:04 172.30.1.2 [ 3195.039098] [<ffffffff810e9f1f>] ? __cache_free.isra.41+0x3d/0x198 Jun 28 14:16:04 172.30.1.2 [ 3195.051922] [<ffffffff8134d259>] ? do_page_fault+0x1a8/0x337 Jun 28 14:16:04 172.30.1.2 [ 3195.063621] [<ffffffffa03cbf06>] ? ip_vs_conn_put+0x28/0x32 [ip_vs] Jun 28 14:16:04 172.30.1.2 [ 3195.076593] [<ffffffffa03ce0e0>] ? ip_vs_out+0x2bd/0x432 [ip_vs] Jun 28 14:16:04 172.30.1.2 [ 3195.089052] [<ffffffffa01d7847>] ? br_dev_queue_push_xmit+0x9b/0x9f [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.103656] [<ffffffff8134a9b5>] ? page_fault+0x25/0x30 Jun 28 14:16:04 172.30.1.2 [ 3195.114563] [<ffffffffa01dc30f>] ? nf_bridge_update_protocol+0x20/0x20 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.129719] [<ffffffffa01dc33d>] ? br_nf_forward_finish+0x2e/0x95 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.143939] [<ffffffffa01dc714>] ? br_parse_ip_options+0x3d/0x19a [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.158197] [<ffffffffa01dcaa0>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.172126] [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77 Jun 28 14:16:04 172.30.1.2 [ 3195.183162] [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.195973] [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.208757] [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101 Jun 28 14:16:04 172.30.1.2 [ 3195.220300] [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.233150] [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.247306] [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.260078] [<ffffffffa01d7887>] ? NF_HOOK.constprop.10+0x3c/0x56 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.274354] [<ffffffffa01d7a1b>] ? br_forward+0x16/0x5a [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.286828] [<ffffffffa01d8543>] ? br_handle_frame_finish+0x1a1/0x20f [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.301718] [<ffffffffa01dc638>] ? br_nf_pre_routing_finish+0x1ee/0x1fb [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.317041] [<ffffffffa01dbff7>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.330274] [<ffffffffa01dcf91>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.344275] [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77 Jun 28 14:16:04 172.30.1.2 [ 3195.355232] [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.369214] [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101 Jun 28 14:16:04 172.30.1.2 [ 3195.380687] [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.394806] [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.408906] [<ffffffffa01d8388>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.423003] [<ffffffff812bd793>] ? tcp_gro_receive+0x83/0x1d8 Jun 28 14:16:04 172.30.1.2 [ 3195.434976] [<ffffffffa01d8764>] ? br_handle_frame+0x1b3/0x1cb [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.448742] [<ffffffffa01d85b1>] ? br_handle_frame_finish+0x20f/0x20f [bridge] Jun 28 14:16:04 172.30.1.2 [ 3195.463742] [<ffffffff8128a306>] ? __netif_receive_skb+0x324/0x41f Jun 28 14:16:04 172.30.1.2 [ 3195.476522] [<ffffffff8128bd61>] ? netif_receive_skb+0x63/0x69 Jun 28 14:16:04 172.30.1.2 [ 3195.488591] [<ffffffff8128c233>] ? napi_gro_receive+0x1d/0x2b Jun 28 14:16:04 172.30.1.2 [ 3195.500581] [<ffffffff8128bddd>] ? napi_skb_finish+0x1c/0x31 Jun 28 14:16:04 172.30.1.2 [ 3195.512350] [<ffffffffa00b6460>] ? bnx2_poll_work+0x84a/0x95d [bnx2] Jun 28 14:16:04 172.30.1.2 [ 3195.525547] [<ffffffff8103f47f>] ? try_to_wake_up+0x187/0x197 Jun 28 14:16:04 172.30.1.2 [ 3195.537480] [<ffffffffa00b6716>] ? bnx2_poll+0xf6/0x1c4 [bnx2] Jun 28 14:16:04 172.30.1.2 [ 3195.549671] [<ffffffff8128c351>] ? net_rx_action+0xa1/0x1af Jun 28 14:16:04 172.30.1.2 [ 3195.561264] [<ffffffff81037d6e>] ? __wake_up+0x35/0x46 Jun 28 14:16:04 172.30.1.2 [ 3195.572052] [<ffffffff8104bee4>] ? __do_softirq+0xb9/0x177 Jun 28 14:16:04 172.30.1.2 [ 3195.583508] [<ffffffff8106a8e7>] ? clockevents_program_event+0xaa/0xce Jun 28 14:16:04 172.30.1.2 [ 3195.597050] [<ffffffff8135162c>] ? call_softirq+0x1c/0x30 Jun 28 14:16:04 172.30.1.2 [ 3195.608366] [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b Jun 28 14:16:04 172.30.1.2 [ 3195.619247] [<ffffffff8104c14c>] ? irq_exit+0x3c/0x9a Jun 28 14:16:04 172.30.1.2 [ 3195.629829] [<ffffffff8100f615>] ? do_IRQ+0x82/0x98 Jun 28 14:16:04 172.30.1.2 [ 3195.640035] [<ffffffff8134a6ee>] ? common_interrupt+0x6e/0x6e Jun 28 14:16:04 172.30.1.2 [ 3195.652030] <EOI> Jun 28 14:16:04 172.30.1.2 [ 3195.665050] [<ffffffff811ec569>] ? intel_idle+0xea/0x119 Jun 28 14:16:04 172.30.1.2 [ 3195.676195] [<ffffffff811ec548>] ? intel_idle+0xc9/0x119 Jun 28 14:16:04 172.30.1.2 [ 3195.687278] [<ffffffff8126c573>] ? cpuidle_idle_call+0xec/0x179 Jun 28 14:16:04 172.30.1.2 [ 3195.699551] [<ffffffff8100d248>] ? cpu_idle+0xa5/0xf2 Jun 28 14:16:04 172.30.1.2 [ 3195.710072] [<ffffffff816aab33>] ? start_kernel+0x3b3/0x3be Jun 28 14:16:04 172.30.1.2 [ 3195.721740] [<ffffffff816aa140>] ? early_idt_handlers+0x140/0x140 Jun 28 14:16:05 172.30.1.2 [ 3195.734358] [<ffffffff816aa3c4>] ? x86_64_start_kernel+0x104/0x111 Jun 28 14:16:05 172.30.1.2 [ 3195.747405] ------------[ cut here ]------------ Jun 28 14:16:05 172.30.1.2 [ 3195.756678] WARNING: at /build/buildd-linux_3.2.20-1-amd64-lTzScn/linux-3.2.20/arch/x86/kernel/smp.c:119 try_to_wake_up+0x158/0x197() Jun 28 14:16:05 172.30.1.2 [ 3195.780697] Hardware name: PowerEdge R410 Jun 28 14:16:05 172.30.1.2 [ 3195.788744] Modules linked in: Jun 28 14:16:05 172.30.1.2 Jun 28 14:16:05 172.30.1.2 [ 3195.930822] Pid: 4659, comm: kvm Tainted: G D 3.2.0-2-amd64 #1 Jun 28 14:16:05 172.30.1.2 [ 3195.944245] Call Trace: Jun 28 14:16:05 172.30.1.2 [ 3195.949175] [<ffffffff810468fd>] ? warn_slowpath_common+0x78/0x8c Jun 28 14:16:05 172.30.1.2 [ 3195.961562] [<ffffffff8103f450>] ? try_to_wake_up+0x158/0x197 Jun 28 14:16:05 172.30.1.2 [ 3195.973256] [<ffffffff811071e2>] ? pollwake+0x4d/0x52 Jun 28 14:16:05 172.30.1.2 [ 3195.983560] [<ffffffff8103f48f>] ? try_to_wake_up+0x197/0x197 Jun 28 14:16:05 172.30.1.2 [ 3195.995254] [<ffffffff810360b2>] ? __wake_up_common+0x40/0x77 Jun 28 14:16:05 172.30.1.2 [ 3196.006949] [<ffffffff8112ad43>] ? eventfd_write+0x1a3/0x1bc Jun 28 14:16:05 172.30.1.2 [ 3196.018467] [<ffffffff8103f48f>] ? try_to_wake_up+0x197/0x197 Jun 28 14:16:05 172.30.1.2 [ 3196.030162] [<ffffffff810f947f>] ? vfs_write+0xa2/0xe9 Jun 28 14:16:05 172.30.1.2 [ 3196.040649] [<ffffffffa022a5fb>] ? kvm_on_user_return+0x36/0x5c [kvm] Jun 28 14:16:05 172.30.1.2 [ 3196.053728] [<ffffffff810f965c>] ? sys_write+0x45/0x6b Jun 28 14:16:05 172.30.1.2 [ 3196.064206] [<ffffffff8134f3d2>] ? system_call_fastpath+0x16/0x1b Jun 28 14:16:05 172.30.1.2 [ 3196.076589] ---[ end trace c28d39074732fa4a ]--- [-- Attachment #4: 3.2.21-1.txt --] [-- Type: text/plain, Size: 23789 bytes --] Jun 28 15:29:19 172.30.1.2 [ 304.578777] BUG: unable to handle kernel Jun 28 15:29:19 172.30.1.2 [ 304.594562] IP: Jun 28 15:29:19 172.30.1.2 [ 304.608732] PGD 0 Jun 28 15:29:19 172.30.1.2 Jun 28 15:29:19 172.30.1.2 [ 304.612831] Oops: 0000 [#1] Jun 28 15:29:19 172.30.1.2 SMP Jun 28 15:29:19 172.30.1.2 Jun 28 15:29:19 172.30.1.2 [ 304.619414] CPU 0 Jun 28 15:29:19 172.30.1.2 Jun 28 15:29:19 172.30.1.2 [ 304.623112] Modules linked in: Jun 28 15:29:19 172.30.1.2 Jun 28 15:29:19 172.30.1.2 [ 304.765458] Jun 28 15:29:19 172.30.1.2 [ 304.768463] Pid: 4486, comm: kvm Not tainted 3.2.21 #1 Jun 28 15:29:19 172.30.1.2 /0N051F Jun 28 15:29:19 172.30.1.2 Jun 28 15:29:19 172.30.1.2 [ 304.784464] RIP: 0010:[<ffffffffa01d09d0>] Jun 28 15:29:19 172.30.1.2 [ 304.803483] RSP: 0018:ffff88042fc03960 EFLAGS: 00010287 Jun 28 15:29:19 172.30.1.2 [ 304.814133] RAX: 0000000000000008 RBX: ffff880422148d80 RCX: ffff88042fc03706 Jun 28 15:29:19 172.30.1.2 [ 304.828426] RDX: 0000000000000000 RSI: 0000000100003f40 RDI: ffff880422148d80 Jun 28 15:29:19 172.30.1.2 [ 304.842719] RBP: ffff880221d2c000 R08: 0000000000000000 R09: ffff88042fc03918 Jun 28 15:29:19 172.30.1.2 [ 304.857012] R10: ffffffff8180b240 R11: ffff880422148d80 R12: ffff880221bc8000 Jun 28 15:29:19 172.30.1.2 [ 304.871303] R13: ffff880418d91500 R14: ffff880221bc8002 R15: ffff880420cdf000 Jun 28 15:29:19 172.30.1.2 [ 304.885595] FS: 00007f8d47807900(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000 Jun 28 15:29:19 172.30.1.2 [ 304.901811] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 Jun 28 15:29:19 172.30.1.2 [ 304.913328] CR2: 0000000000000018 CR3: 000000041c3d1000 CR4: 00000000000026e0 Jun 28 15:29:19 172.30.1.2 [ 304.927620] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jun 28 15:29:19 172.30.1.2 [ 304.941912] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Jun 28 15:29:19 172.30.1.2 [ 304.956205] Process kvm (pid: 4486, threadinfo ffff88040f24e000, task ffff8804215f9510) Jun 28 15:29:19 172.30.1.2 [ 304.972247] Stack: Jun 28 15:29:19 172.30.1.2 [ 304.976307] 0000000080000000 Jun 28 15:29:19 172.30.1.2 Jun 28 15:29:19 172.30.1.2 [ 304.991349] ffff880221d2c000 Jun 28 15:29:19 172.30.1.2 Jun 28 15:29:19 172.30.1.2 [ 305.006392] ffff880422148d80 Jun 28 15:29:19 172.30.1.2 Jun 28 15:29:19 172.30.1.2 [ 305.021434] Call Trace: Jun 28 15:29:19 172.30.1.2 [ 305.026360] <IRQ> Jun 28 15:29:19 172.30.1.2 Jun 28 15:29:19 172.30.1.2 [ 305.030651] [<ffffffffa01d0c91>] ? br_nf_forward_ip+0x214/0x231 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.044255] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jun 28 15:29:19 172.30.1.2 [ 305.054909] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.067122] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.079336] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jun 28 15:29:19 172.30.1.2 [ 305.090336] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.102552] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.113898] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.126113] [<ffffffffa01cb96e>] ? T.963+0x3c/0x56 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.137460] [<ffffffffa01ca753>] ? __br_fdb_get+0x10/0x83 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.150021] [<ffffffffa01cc61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.164680] [<ffffffffa01d1598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.179685] [<ffffffffa01d03b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.192593] [<ffffffffa01d135b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.206366] [<ffffffff812ce172>] ? T.1028+0x4f/0x4f Jun 28 15:29:19 172.30.1.2 [ 305.216322] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jun 28 15:29:19 172.30.1.2 [ 305.226975] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.238320] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jun 28 15:29:19 172.30.1.2 [ 305.249320] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.260669] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.272015] [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.283363] [<ffffffffa01cc84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.296790] [<ffffffffa01cc687>] ? br_handle_frame_finish+0x211/0x211 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.311448] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jun 28 15:29:19 172.30.1.2 [ 305.324009] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jun 28 15:29:19 172.30.1.2 [ 305.334139] [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d Jun 28 15:29:19 172.30.1.2 [ 305.346005] [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d Jun 28 15:29:19 172.30.1.2 [ 305.357697] [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31 Jun 28 15:29:19 172.30.1.2 [ 305.369220] [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2] Jun 28 15:29:19 172.30.1.2 [ 305.382128] [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2] Jun 28 15:29:19 172.30.1.2 [ 305.395036] [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge] Jun 28 15:29:19 172.30.1.2 [ 305.406383] [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2] Jun 28 15:29:19 172.30.1.2 [ 305.418421] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jun 28 15:29:19 172.30.1.2 [ 305.430980] [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207 Jun 28 15:29:19 172.30.1.2 [ 305.442327] [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a Jun 28 15:29:19 172.30.1.2 [ 305.455060] [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0 Jun 28 15:29:19 172.30.1.2 [ 305.466234] [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184 Jun 28 15:29:19 172.30.1.2 [ 305.479490] [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30 Jun 28 15:29:19 172.30.1.2 [ 305.490492] [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79 Jun 28 15:29:19 172.30.1.2 [ 305.501142] [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5 Jun 28 15:29:19 172.30.1.2 [ 305.511446] [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa Jun 28 15:29:19 172.30.1.2 [ 305.521407] [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e Jun 28 15:29:19 172.30.1.2 [ 305.533098] <EOI> Jun 28 15:29:19 172.30.1.2 Jun 28 15:29:20 172.30.1.2 [ 305.537386] [<ffffffff81364498>] ? _raw_spin_unlock_irqrestore+0xb/0x11 Jun 28 15:29:20 172.30.1.2 [ 305.550816] [<ffffffff81045f07>] ? try_to_wake_up+0x181/0x190 Jun 28 15:29:20 172.30.1.2 [ 305.562510] [<ffffffff81071764>] ? wake_futex+0x2b/0x47 Jun 28 15:29:20 172.30.1.2 [ 305.573161] [<ffffffff81073949>] ? do_futex+0x3de/0x84a Jun 28 15:29:20 172.30.1.2 [ 305.583814] [<ffffffff810dfff1>] ? do_brk+0x2ca/0x326 Jun 28 15:29:20 172.30.1.2 [ 305.594119] [<ffffffff81073ee4>] ? sys_futex+0x12f/0x147 Jun 28 15:29:20 172.30.1.2 [ 305.604945] [<ffffffff81369b12>] ? system_call_fastpath+0x16/0x1b Jun 28 15:29:20 172.30.1.2 [ 305.617329] Code: Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 10 Jun 28 15:29:20 172.30.1.2 75 Jun 28 15:29:20 172.30.1.2 25 Jun 28 15:29:20 172.30.1.2 66 Jun 28 15:29:20 172.30.1.2 3d Jun 28 15:29:20 172.30.1.2 81 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 75 Jun 28 15:29:20 172.30.1.2 1f Jun 28 15:29:20 172.30.1.2 8b Jun 28 15:29:20 172.30.1.2 87 Jun 28 15:29:20 172.30.1.2 c8 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 48 Jun 28 15:29:20 172.30.1.2 8b Jun 28 15:29:20 172.30.1.2 8f Jun 28 15:29:20 172.30.1.2 d8 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 66 Jun 28 15:29:20 172.30.1.2 81 Jun 28 15:29:20 172.30.1.2 7c Jun 28 15:29:20 172.30.1.2 01 Jun 28 15:29:20 172.30.1.2 10 Jun 28 15:29:20 172.30.1.2 08 Jun 28 15:29:20 172.30.1.2 06 Jun 28 15:29:20 172.30.1.2 75 Jun 28 15:29:20 172.30.1.2 09 Jun 28 15:29:20 172.30.1.2 83 Jun 28 15:29:20 172.30.1.2 3d Jun 28 15:29:20 172.30.1.2 f2 Jun 28 15:29:20 172.30.1.2 63 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 00 Jun 28 15:29:20 172.30.1.2 75 Jun 28 15:29:20 172.30.1.2 3c Jun 28 15:29:20 172.30.1.2 f6> Jun 28 15:29:20 172.30.1.2 42 Jun 28 15:29:20 172.30.1.2 18 Jun 28 15:29:20 172.30.1.2 01 Jun 28 15:29:20 172.30.1.2 48 Jun 28 15:29:20 172.30.1.2 8b Jun 28 15:29:20 172.30.1.2 6a Jun 28 15:29:20 172.30.1.2 08 Jun 28 15:29:20 172.30.1.2 74 Jun 28 15:29:20 172.30.1.2 10 Jun 28 15:29:20 172.30.1.2 8a Jun 28 15:29:20 172.30.1.2 Jun 28 15:29:20 172.30.1.2 [ 305.652454] ------------[ cut here ]------------ Jun 28 15:29:20 172.30.1.2 [ 305.652457] WARNING: at kernel/softirq.c:159 _local_bh_enable_ip+0x41/0x8b() Jun 28 15:29:20 172.30.1.2 [ 305.652459] Hardware name: PowerEdge R410 Jun 28 15:29:20 172.30.1.2 [ 305.652460] Modules linked in: ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 ip6table_filter ip6_tables iptable_filter ip_tables x_tables ip_vs_rr ip_vs nf_conntrack crc32c libcrc32c drbd lru_cache cn tun virtio_net virtio_blk virtio_rng rng_core virtio_pci virtio_ring virtio kvm_intel kvm ipmi_devintf ipmi_poweroff ipmi_si ipmi_watchdog ipmi_msghandler netconsole configfs loop bridge stp snd_pcm i7core_edac dcdbas edac_core iTCO_wdt iTCO_vendor_support processor psmouse snd_timer snd soundcore snd_page_alloc pcspkr serio_raw joydev thermal_sys button evdev ext3 mbcache jbd dm_mod sr_mod cdrom sd_mod ses usbhid hid crc_t10dif enclosure ata_generic uhci_hcd ata_piix ehci_hcd libata megaraid_sas usbcore scsi_mod usb_common bnx2 [last unloaded: scsi_wait_scan] Jun 28 15:29:20 172.30.1.2 [ 305.652495] Pid: 4486, comm: kvm Not tainted 3.2.21 #1 Jun 28 15:29:20 172.30.1.2 [ 305.652496] Call Trace: Jun 28 15:29:20 172.30.1.2 [ 305.652497] <IRQ> [<ffffffff81049810>] ? warn_slowpath_common+0x78/0x8c Jun 28 15:29:20 172.30.1.2 [ 305.652503] [<ffffffff8104efa0>] ? _local_bh_enable_ip+0x41/0x8b Jun 28 15:29:20 172.30.1.2 [ 305.652508] [<ffffffffa0000648>] ? bnx2_reg_rd_ind+0x31/0x38 [bnx2] Jun 28 15:29:20 172.30.1.2 [ 305.652514] [<ffffffffa0009dc8>] ? bnx2_poll+0x1e2/0x1f2 [bnx2] Jun 28 15:29:20 172.30.1.2 [ 305.652520] [<ffffffff812b6b62>] ? netpoll_poll_dev+0xab/0x4ad Jun 28 15:29:20 172.30.1.2 [ 305.652525] [<ffffffffa0006ba0>] ? bnx2_start_xmit+0x411/0x55d [bnx2] Jun 28 15:29:20 172.30.1.2 [ 305.652531] [<ffffffff810f693e>] ? ____cache_alloc+0xc6/0x20d Jun 28 15:29:20 172.30.1.2 [ 305.652535] [<ffffffff812b7075>] ? netpoll_send_skb_on_dev+0x111/0x215 Jun 28 15:29:20 172.30.1.2 [ 305.652541] [<ffffffffa01ca6d2>] ? br_dev_xmit+0x136/0x150 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652544] [<ffffffff812b7033>] ? netpoll_send_skb_on_dev+0xcf/0x215 Jun 28 15:29:20 172.30.1.2 [ 305.652551] [<ffffffff811c3157>] ? delay_tsc+0x2b/0x74 Jun 28 15:29:20 172.30.1.2 [ 305.652555] [<ffffffffa0167272>] ? write_msg+0x9f/0x102 [netconsole] Jun 28 15:29:20 172.30.1.2 [ 305.652558] [<ffffffff810499e6>] ? __call_console_drivers+0x75/0x86 Jun 28 15:29:20 172.30.1.2 [ 305.652561] [<ffffffff8104a084>] ? console_unlock+0x13d/0x1e8 Jun 28 15:29:20 172.30.1.2 [ 305.652564] [<ffffffff8104a707>] ? vprintk+0x39e/0x3e5 Jun 28 15:29:20 172.30.1.2 [ 305.652570] [<ffffffffa01d09db>] ? br_nf_forward_finish+0x53/0xc0 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652576] [<ffffffffa01d09a5>] ? br_nf_forward_finish+0x1d/0xc0 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652579] [<ffffffff81362842>] ? printk+0x40/0x46 Jun 28 15:29:20 172.30.1.2 [ 305.652583] [<ffffffff8100fff9>] ? show_registers+0x1e2/0x211 Jun 28 15:29:20 172.30.1.2 [ 305.652586] [<ffffffff813652dd>] ? __die+0x8e/0xc9 Jun 28 15:29:20 172.30.1.2 [ 305.652589] [<ffffffff8102fcd0>] ? no_context+0x1d6/0x20c Jun 28 15:29:20 172.30.1.2 [ 305.652592] [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c Jun 28 15:29:20 172.30.1.2 [ 305.652595] [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c Jun 28 15:29:20 172.30.1.2 [ 305.652601] [<ffffffffa03fcd93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs] Jun 28 15:29:20 172.30.1.2 [ 305.652606] [<ffffffffa03fbdec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs] Jun 28 15:29:20 172.30.1.2 [ 305.652610] [<ffffffffa03fde1a>] ? ip_vs_out+0x33c/0x49d [ip_vs] Jun 28 15:29:20 172.30.1.2 [ 305.652613] [<ffffffff812a896b>] ? dev_hard_start_xmit+0x3fd/0x571 Jun 28 15:29:20 172.30.1.2 [ 305.652617] [<ffffffff81364ab5>] ? page_fault+0x25/0x30 Jun 28 15:29:20 172.30.1.2 [ 305.652623] [<ffffffffa01d09d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652628] [<ffffffffa01d0c91>] ? br_nf_forward_ip+0x214/0x231 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652631] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jun 28 15:29:20 172.30.1.2 [ 305.652636] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652641] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652644] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jun 28 15:29:20 172.30.1.2 [ 305.652648] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652654] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652658] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652663] [<ffffffffa01cb96e>] ? T.963+0x3c/0x56 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652668] [<ffffffffa01ca753>] ? __br_fdb_get+0x10/0x83 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652673] [<ffffffffa01cc61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652678] [<ffffffffa01d1598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652684] [<ffffffffa01d03b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652689] [<ffffffffa01d135b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652692] [<ffffffff812ce172>] ? T.1028+0x4f/0x4f Jun 28 15:29:20 172.30.1.2 [ 305.652695] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jun 28 15:29:20 172.30.1.2 [ 305.652700] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652703] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jun 28 15:29:20 172.30.1.2 [ 305.652708] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652713] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652718] [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652723] [<ffffffffa01cc84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652728] [<ffffffffa01cc687>] ? br_handle_frame_finish+0x211/0x211 [bridge] Jun 28 15:29:20 172.30.1.2 [ 305.652731] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jun 28 15:29:20 172.30.1.2 [ 305.652734] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jun 28 15:29:20 172.30.1.2 [ 305.652736] [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d Jun 28 15:29:20 172.30.1.2 [ 305.652739] [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d Jun 28 15:29:20 172.30.1.2 [ 305.652742] [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31 Jun 28 15:29:21 172.30.1.2 [ 305.652747] [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2] Jun 28 15:29:21 172.30.1.2 [ 305.652752] [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2] Jun 28 15:29:21 172.30.1.2 [ 305.652757] [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge] Jun 28 15:29:21 172.30.1.2 [ 305.652762] [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2] Jun 28 15:29:21 172.30.1.2 [ 305.652765] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jun 28 15:29:21 172.30.1.2 [ 305.652768] [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207 Jun 28 15:29:21 172.30.1.2 [ 305.652771] [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a Jun 28 15:29:21 172.30.1.2 [ 305.652774] [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0 Jun 28 15:29:21 172.30.1.2 [ 305.652776] [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184 Jun 28 15:29:21 172.30.1.2 [ 305.652780] [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30 Jun 28 15:29:21 172.30.1.2 [ 305.652782] [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79 Jun 28 15:29:21 172.30.1.2 [ 305.652785] [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5 Jun 28 15:29:21 172.30.1.2 [ 305.652787] [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa Jun 28 15:29:21 172.30.1.2 [ 305.652790] [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e Jun 28 15:29:21 172.30.1.2 [ 305.652792] <EOI> [<ffffffff81364498>] ? _raw_spin_unlock_irqrestore+0xb/0x11 Jun 28 15:29:21 172.30.1.2 [ 305.652797] [<ffffffff81045f07>] ? try_to_wake_up+0x181/0x190 Jun 28 15:29:21 172.30.1.2 [ 305.652799] [<ffffffff81071764>] ? wake_futex+0x2b/0x47 Jun 28 15:29:21 172.30.1.2 [ 305.652802] [<ffffffff81073949>] ? do_futex+0x3de/0x84a Jun 28 15:29:21 172.30.1.2 [ 305.652804] [<ffffffff810dfff1>] ? do_brk+0x2ca/0x326 Jun 28 15:29:21 172.30.1.2 [ 305.652807] [<ffffffff81073ee4>] ? sys_futex+0x12f/0x147 Jun 28 15:29:21 172.30.1.2 [ 305.652810] [<ffffffff81369b12>] ? system_call_fastpath+0x16/0x1b Jun 28 15:29:21 172.30.1.2 [ 305.652812] ---[ end trace 33ba304ebe73322b ]--- Jun 28 15:29:21 172.30.1.2 [ 306.782187] 43 Jun 28 15:29:21 172.30.1.2 7d Jun 28 15:29:21 172.30.1.2 83 Jun 28 15:29:21 172.30.1.2 e0 Jun 28 15:29:21 172.30.1.2 f8 Jun 28 15:29:21 172.30.1.2 83 Jun 28 15:29:21 172.30.1.2 c8 Jun 28 15:29:21 172.30.1.2 03 Jun 28 15:29:21 172.30.1.2 88 Jun 28 15:29:21 172.30.1.2 43 Jun 28 15:29:21 172.30.1.2 Jun 28 15:29:21 172.30.1.2 [ 306.790953] RIP Jun 28 15:29:21 172.30.1.2 [ 306.805304] RSP <ffff88042fc03960> Jun 28 15:29:21 172.30.1.2 [ 306.817583] CR2: 0000000000000018 Jun 28 15:29:21 172.30.1.2 [ 306.824706] ---[ end trace 33ba304ebe73322c ]--- Jun 28 15:29:21 172.30.1.2 [ 306.834283] Kernel panic - not syncing: Fatal exception in interrupt Jun 28 15:29:21 172.30.1.2 [ 306.847312] Pid: 4486, comm: kvm Tainted: G D W 3.2.21 #1 Jun 28 15:29:21 172.30.1.2 [ 306.859837] Call Trace: Jun 28 15:29:21 172.30.1.2 [ 306.865093] <IRQ> Jun 28 15:29:21 172.30.1.2 [ 306.876993] [<ffffffff81049da9>] ? kmsg_dump+0xb2/0xdd Jun 28 15:29:21 172.30.1.2 [ 306.887798] [<ffffffff813653c1>] ? oops_end+0xa9/0xb6 Jun 28 15:29:21 172.30.1.2 [ 306.898438] [<ffffffff8102fcf9>] ? no_context+0x1ff/0x20c Jun 28 15:29:21 172.30.1.2 [ 306.909769] [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c Jun 28 15:29:21 172.30.1.2 [ 306.920924] [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c Jun 28 15:29:21 172.30.1.2 [ 306.932780] [<ffffffffa03fcd93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs] Jun 28 15:29:21 172.30.1.2 [ 306.945675] [<ffffffffa03fbdec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs] Jun 28 15:29:21 172.30.1.2 [ 306.958743] [<ffffffffa03fde1a>] ? ip_vs_out+0x33c/0x49d [ip_vs] Jun 28 15:29:21 172.30.1.2 [ 306.971339] [<ffffffff812a896b>] ? dev_hard_start_xmit+0x3fd/0x571 Jun 28 15:29:21 172.30.1.2 [ 306.984312] [<ffffffff81364ab5>] ? page_fault+0x25/0x30 Jun 28 15:29:21 172.30.1.2 [ 306.995300] [<ffffffffa01d09d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.009564] [<ffffffffa01d0c91>] ? br_nf_forward_ip+0x214/0x231 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.023567] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jun 28 15:29:21 172.30.1.2 [ 307.034624] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.047239] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.059782] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jun 28 15:29:21 172.30.1.2 [ 307.071240] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.083788] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.095464] [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.108227] [<ffffffffa01cb96e>] ? T.963+0x3c/0x56 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.119901] [<ffffffffa01ca753>] ? __br_fdb_get+0x10/0x83 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.132796] [<ffffffffa01cc61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.147785] [<ffffffffa01d1598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.163124] [<ffffffffa01d03b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.176369] [<ffffffffa01d135b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.190541] [<ffffffff812ce172>] ? T.1028+0x4f/0x4f Jun 28 15:29:21 172.30.1.2 [ 307.200832] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jun 28 15:29:21 172.30.1.2 [ 307.211813] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.223490] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jun 28 15:29:21 172.30.1.2 [ 307.234827] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.246623] [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.258233] [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.269846] [<ffffffffa01cc84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.283539] [<ffffffffa01cc687>] ? br_handle_frame_finish+0x211/0x211 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.298466] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jun 28 15:29:21 172.30.1.2 [ 307.311298] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jun 28 15:29:21 172.30.1.2 [ 307.321743] [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d Jun 28 15:29:21 172.30.1.2 [ 307.334023] [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d Jun 28 15:29:21 172.30.1.2 [ 307.346044] [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31 Jun 28 15:29:21 172.30.1.2 [ 307.357884] [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2] Jun 28 15:29:21 172.30.1.2 [ 307.371057] [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2] Jun 28 15:29:21 172.30.1.2 [ 307.384236] [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge] Jun 28 15:29:21 172.30.1.2 [ 307.395847] [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2] Jun 28 15:29:21 172.30.1.2 [ 307.408147] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jun 28 15:29:21 172.30.1.2 [ 307.421034] [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207 Jun 28 15:29:21 172.30.1.2 [ 307.432644] [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a Jun 28 15:29:21 172.30.1.2 [ 307.445688] [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0 Jun 28 15:29:21 172.30.1.2 [ 307.457118] [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184 Jun 28 15:29:21 172.30.1.2 [ 307.470749] [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30 Jun 28 15:29:21 172.30.1.2 [ 307.482114] [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79 Jun 28 15:29:21 172.30.1.2 [ 307.493077] [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5 Jun 28 15:29:21 172.30.1.2 [ 307.503654] [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa Jun 28 15:29:21 172.30.1.2 [ 307.513875] [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e Jun 28 15:29:21 172.30.1.2 [ 307.525807] <EOI> Jun 28 15:29:22 172.30.1.2 [ 307.541012] [<ffffffff81045f07>] ? try_to_wake_up+0x181/0x190 Jun 28 15:29:22 172.30.1.2 [ 307.552919] [<ffffffff81071764>] ? wake_futex+0x2b/0x47 Jun 28 15:29:22 172.30.1.2 [ 307.563873] [<ffffffff81073949>] ? do_futex+0x3de/0x84a Jun 28 15:29:22 172.30.1.2 [ 307.574792] [<ffffffff810dfff1>] ? do_brk+0x2ca/0x326 Jun 28 15:29:22 172.30.1.2 [ 307.585363] [<ffffffff81073ee4>] ? sys_futex+0x12f/0x147 Jun 28 15:29:22 172.30.1.2 [ 307.596418] [<ffffffff81369b12>] ? system_call_fastpath+0x16/0x1b ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Bridged networking panics 2012-06-28 13:57 Bridged networking panics Massimo Cetra @ 2012-07-04 10:42 ` Massimo Cetra 2012-07-04 13:24 ` Eric Dumazet 0 siblings, 1 reply; 4+ messages in thread From: Massimo Cetra @ 2012-07-04 10:42 UTC (permalink / raw) To: netdev; +Cc: linux-kernel [-- Attachment #1: Type: text/plain, Size: 1111 bytes --] On 28/06/2012 15:57, Massimo Cetra wrote: > Hi all, > > i'm attaching 3 panics of a 3.2.X kernel. > The panics were obtained with a 3.2.20 from debian testing and from a > vanilla compile of 3.2.21. > > Those panics have been already posted some months ago [1] but are not > fixed. > > The problems seems related to bridged networking. > Whenever there is a bridged aliased interface (like br0:1 br0:2 etcc), > the server will panic after some time. The more the network load, the > shortest the uptime. > Removing (ifconfig br0:1 down) or adding back an interface seems to help > the panic to appear. Ok, waiting for an answer (sincerely i don't understand why no ones cares for months) i'm attaching 3 more panics happened this morning on a vanilla 3.2.21. The problem is related to heavy network traffic. I'm not a kernel hacker but I see that net_rx_action() is in the backtrace. So (probably reaching wrong conclusions) if those panics are triggered by incoming network traffic, can an attacker use this to crash a machine ? Anyone willing to reply or at least tell me what's going on ? Thanks MC [-- Attachment #2: more-panics-1.txt --] [-- Type: text/plain, Size: 57265 bytes --] ************************* PANIC 1 Jul 4 09:50:25 172.30.1.2 [ 97.644194] BUG: unable to handle kernel Jul 4 09:50:25 172.30.1.2 [ 97.659980] IP: Jul 4 09:50:25 172.30.1.2 [ 97.674146] PGD 0 Jul 4 09:50:25 172.30.1.2 Jul 4 09:50:25 172.30.1.2 [ 97.678245] Oops: 0000 [#1] Jul 4 09:50:25 172.30.1.2 SMP Jul 4 09:50:25 172.30.1.2 Jul 4 09:50:25 172.30.1.2 [ 97.684824] CPU 0 Jul 4 09:50:25 172.30.1.2 Jul 4 09:50:25 172.30.1.2 [ 97.688522] Modules linked in: Jul 4 09:50:26 172.30.1.2 Jul 4 09:50:26 172.30.1.2 [ 97.830819] Jul 4 09:50:26 172.30.1.2 [ 97.833823] Pid: 0, comm: swapper/0 Not tainted 3.2.21 #1 Jul 4 09:50:26 172.30.1.2 /0N051F Jul 4 09:50:26 172.30.1.2 Jul 4 09:50:26 172.30.1.2 [ 97.850339] RIP: 0010:[<ffffffffa01c89d0>] Jul 4 09:50:26 172.30.1.2 [ 97.869355] RSP: 0018:ffff88042fc03960 EFLAGS: 00010287 Jul 4 09:50:26 172.30.1.2 [ 97.880006] RAX: 0000000000000008 RBX: ffff880421ea6980 RCX: ffff88042fc03708 Jul 4 09:50:26 172.30.1.2 [ 97.894295] RDX: 0000000000000000 RSI: 00000000ffff7500 RDI: ffff880421ea6980 Jul 4 09:50:26 172.30.1.2 [ 97.908586] RBP: ffff880420d88000 R08: 0000000000000000 R09: ffff88042fc03918 Jul 4 09:50:26 172.30.1.2 [ 97.922876] R10: ffffffff8180b240 R11: ffff880421ea6980 R12: ffff8804215b0000 Jul 4 09:50:26 172.30.1.2 [ 97.937166] R13: ffff8804217a1fc0 R14: ffff8804215b0002 R15: ffff880223a19000 Jul 4 09:50:26 172.30.1.2 [ 97.951459] FS: 0000000000000000(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000 Jul 4 09:50:26 172.30.1.2 [ 97.967673] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Jul 4 09:50:26 172.30.1.2 [ 97.979187] CR2: 0000000000000018 CR3: 00000002239eb000 CR4: 00000000000026e0 Jul 4 09:50:26 172.30.1.2 [ 97.993479] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jul 4 09:50:26 172.30.1.2 [ 98.007769] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Jul 4 09:50:26 172.30.1.2 [ 98.022061] Process swapper/0 (pid: 0, threadinfo ffffffff81600000, task ffffffff8160d020) Jul 4 09:50:26 172.30.1.2 [ 98.038621] Stack: Jul 4 09:50:26 172.30.1.2 [ 98.042680] 0000000080000000 Jul 4 09:50:26 172.30.1.2 Jul 4 09:50:26 172.30.1.2 [ 98.057721] ffff880420d88000 Jul 4 09:50:26 172.30.1.2 Jul 4 09:50:26 172.30.1.2 [ 98.072764] ffff880421ea6980 Jul 4 09:50:26 172.30.1.2 Jul 4 09:50:26 172.30.1.2 [ 98.087804] Call Trace: Jul 4 09:50:26 172.30.1.2 [ 98.092730] <IRQ> Jul 4 09:50:26 172.30.1.2 Jul 4 09:50:26 172.30.1.2 [ 98.097020] [<ffffffffa01c8c91>] ? br_nf_forward_ip+0x214/0x231 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.110621] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 09:50:26 172.30.1.2 [ 98.121274] [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.133488] [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.145699] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 09:50:26 172.30.1.2 [ 98.156696] [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.168911] [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.180258] [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.192471] [<ffffffffa01c396e>] ? T.963+0x3c/0x56 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.203817] [<ffffffffa01c2753>] ? __br_fdb_get+0x10/0x83 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.216376] [<ffffffffa01c461d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.231035] [<ffffffffa01c9598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.246038] [<ffffffffa01c83b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.258945] [<ffffffffa01c935b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.272715] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 09:50:26 172.30.1.2 [ 98.283365] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 09:50:26 172.30.1.2 [ 98.294016] [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.305360] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 09:50:26 172.30.1.2 [ 98.316360] [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.327706] [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.339053] [<ffffffffa01c445c>] ? T.947+0x3c/0x56 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.350399] [<ffffffffa01c484a>] ? br_handle_frame+0x1c3/0x1d9 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.363828] [<ffffffffa01c4687>] ? br_handle_frame_finish+0x211/0x211 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.378483] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 09:50:26 172.30.1.2 [ 98.391043] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 09:50:26 172.30.1.2 [ 98.401171] [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d Jul 4 09:50:26 172.30.1.2 [ 98.413037] [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d Jul 4 09:50:26 172.30.1.2 [ 98.424728] [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31 Jul 4 09:50:26 172.30.1.2 [ 98.436249] [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2] Jul 4 09:50:26 172.30.1.2 [ 98.449156] [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2] Jul 4 09:50:26 172.30.1.2 [ 98.462066] [<ffffffffa01c445c>] ? T.947+0x3c/0x56 [bridge] Jul 4 09:50:26 172.30.1.2 [ 98.473413] [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2] Jul 4 09:50:26 172.30.1.2 [ 98.485451] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 09:50:26 172.30.1.2 [ 98.498007] [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207 Jul 4 09:50:26 172.30.1.2 [ 98.509356] [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a Jul 4 09:50:26 172.30.1.2 [ 98.522089] [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0 Jul 4 09:50:26 172.30.1.2 [ 98.533260] [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184 Jul 4 09:50:26 172.30.1.2 [ 98.546511] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 09:50:26 172.30.1.2 [ 98.556648] [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30 Jul 4 09:50:26 172.30.1.2 [ 98.567647] [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79 Jul 4 09:50:26 172.30.1.2 [ 98.578295] [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5 Jul 4 09:50:26 172.30.1.2 [ 98.588597] [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa Jul 4 09:50:26 172.30.1.2 [ 98.598555] [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e Jul 4 09:50:26 172.30.1.2 [ 98.610244] <EOI> Jul 4 09:50:26 172.30.1.2 Jul 4 09:50:26 172.30.1.2 [ 98.614533] [<ffffffff8106f2f0>] ? clockevents_program_event+0x99/0xb8 Jul 4 09:50:26 172.30.1.2 [ 98.627789] [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117 Jul 4 09:50:26 172.30.1.2 [ 98.638611] [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117 Jul 4 09:50:26 172.30.1.2 [ 98.649437] [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af Jul 4 09:50:26 172.30.1.2 [ 98.661474] [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef Jul 4 09:50:26 172.30.1.2 [ 98.671777] [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd Jul 4 09:50:26 172.30.1.2 [ 98.683121] [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f Jul 4 09:50:26 172.30.1.2 [ 98.695677] Code: Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 10 Jul 4 09:50:26 172.30.1.2 75 Jul 4 09:50:26 172.30.1.2 25 Jul 4 09:50:26 172.30.1.2 66 Jul 4 09:50:26 172.30.1.2 3d Jul 4 09:50:26 172.30.1.2 81 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 75 Jul 4 09:50:26 172.30.1.2 1f Jul 4 09:50:26 172.30.1.2 8b Jul 4 09:50:26 172.30.1.2 87 Jul 4 09:50:26 172.30.1.2 c8 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 48 Jul 4 09:50:26 172.30.1.2 8b Jul 4 09:50:26 172.30.1.2 8f Jul 4 09:50:26 172.30.1.2 d8 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 66 Jul 4 09:50:26 172.30.1.2 81 Jul 4 09:50:26 172.30.1.2 7c Jul 4 09:50:26 172.30.1.2 01 Jul 4 09:50:26 172.30.1.2 10 Jul 4 09:50:26 172.30.1.2 08 Jul 4 09:50:26 172.30.1.2 06 Jul 4 09:50:26 172.30.1.2 75 Jul 4 09:50:26 172.30.1.2 09 Jul 4 09:50:26 172.30.1.2 83 Jul 4 09:50:26 172.30.1.2 3d Jul 4 09:50:26 172.30.1.2 f2 Jul 4 09:50:26 172.30.1.2 63 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 00 Jul 4 09:50:26 172.30.1.2 75 Jul 4 09:50:26 172.30.1.2 3c Jul 4 09:50:26 172.30.1.2 f6> Jul 4 09:50:26 172.30.1.2 42 Jul 4 09:50:26 172.30.1.2 18 Jul 4 09:50:26 172.30.1.2 01 Jul 4 09:50:26 172.30.1.2 48 Jul 4 09:50:26 172.30.1.2 8b Jul 4 09:50:26 172.30.1.2 6a Jul 4 09:50:26 172.30.1.2 08 Jul 4 09:50:26 172.30.1.2 74 Jul 4 09:50:26 172.30.1.2 10 Jul 4 09:50:26 172.30.1.2 8a Jul 4 09:50:26 172.30.1.2 43 Jul 4 09:50:26 172.30.1.2 7d Jul 4 09:50:26 172.30.1.2 83 Jul 4 09:50:26 172.30.1.2 e0 Jul 4 09:50:26 172.30.1.2 f8 Jul 4 09:50:26 172.30.1.2 83 Jul 4 09:50:26 172.30.1.2 c8 Jul 4 09:50:26 172.30.1.2 03 Jul 4 09:50:26 172.30.1.2 88 Jul 4 09:50:26 172.30.1.2 43 Jul 4 09:50:26 172.30.1.2 Jul 4 09:50:26 172.30.1.2 [ 98.737065] RIP Jul 4 09:50:27 172.30.1.2 [ 98.751412] RSP <ffff88042fc03960> Jul 4 09:50:27 172.30.1.2 [ 98.758419] CR2: 0000000000000018 Jul 4 09:50:27 172.30.1.2 [ 98.765491] ---[ end trace 2dcc1511ba6f55d2 ]--- Jul 4 09:50:27 172.30.1.2 [ 98.774916] Kernel panic - not syncing: Fatal exception in interrupt Jul 4 09:50:27 172.30.1.2 [ 98.787814] Pid: 0, comm: swapper/0 Tainted: G D 3.2.21 #1 Jul 4 09:50:27 172.30.1.2 [ 98.800748] Call Trace: Jul 4 09:50:27 172.30.1.2 [ 98.805850] <IRQ> Jul 4 09:50:27 172.30.1.2 [ 98.817329] [<ffffffff81049da9>] ? kmsg_dump+0xb2/0xdd Jul 4 09:50:27 172.30.1.2 [ 98.827875] [<ffffffff813653c1>] ? oops_end+0xa9/0xb6 Jul 4 09:50:27 172.30.1.2 [ 98.838246] [<ffffffff8102fcf9>] ? no_context+0x1ff/0x20c Jul 4 09:50:27 172.30.1.2 [ 98.849321] [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c Jul 4 09:50:27 172.30.1.2 [ 98.860218] [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c Jul 4 09:50:27 172.30.1.2 [ 98.871813] [<ffffffffa03ead93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs] Jul 4 09:50:27 172.30.1.2 [ 98.884441] [<ffffffffa03e9dec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs] Jul 4 09:50:27 172.30.1.2 [ 98.897309] [<ffffffffa03ebe1a>] ? ip_vs_out+0x33c/0x49d [ip_vs] Jul 4 09:50:27 172.30.1.2 [ 98.909584] [<ffffffff81364ab5>] ? page_fault+0x25/0x30 Jul 4 09:50:27 172.30.1.2 [ 98.920311] [<ffffffffa01c89d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge] Jul 4 09:50:27 172.30.1.2 [ 98.934330] [<ffffffffa01c8c91>] ? br_nf_forward_ip+0x214/0x231 [bridge] Jul 4 09:50:27 172.30.1.2 [ 98.948181] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 09:50:27 172.30.1.2 [ 98.958965] [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 09:50:27 172.30.1.2 [ 98.971248] [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 09:50:27 172.30.1.2 [ 98.983586] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 09:50:27 172.30.1.2 [ 98.994652] [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.006931] [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.018347] [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.030633] [<ffffffffa01c396e>] ? T.963+0x3c/0x56 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.042045] [<ffffffffa01c2753>] ? __br_fdb_get+0x10/0x83 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.054673] [<ffffffffa01c461d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.069397] [<ffffffffa01c9598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.084472] [<ffffffffa01c83b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.097508] [<ffffffffa01c935b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.111348] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 09:50:27 172.30.1.2 [ 99.122074] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 09:50:27 172.30.1.2 [ 99.132792] [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.144191] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 09:50:27 172.30.1.2 [ 99.155263] [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.166871] [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.178287] [<ffffffffa01c445c>] ? T.947+0x3c/0x56 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.189827] [<ffffffffa01c484a>] ? br_handle_frame+0x1c3/0x1d9 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.203365] [<ffffffffa01c4687>] ? br_handle_frame_finish+0x211/0x211 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.218150] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 09:50:27 172.30.1.2 [ 99.230775] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 09:50:27 172.30.1.2 [ 99.240975] [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d Jul 4 09:50:27 172.30.1.2 [ 99.252906] [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d Jul 4 09:50:27 172.30.1.2 [ 99.264639] [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31 Jul 4 09:50:27 172.30.1.2 [ 99.276297] [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2] Jul 4 09:50:27 172.30.1.2 [ 99.289333] [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2] Jul 4 09:50:27 172.30.1.2 [ 99.302373] [<ffffffffa01c445c>] ? T.947+0x3c/0x56 [bridge] Jul 4 09:50:27 172.30.1.2 [ 99.313851] [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2] Jul 4 09:50:27 172.30.1.2 [ 99.326024] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 09:50:27 172.30.1.2 [ 99.338653] [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207 Jul 4 09:50:27 172.30.1.2 [ 99.350072] [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a Jul 4 09:50:27 172.30.1.2 [ 99.362877] [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0 Jul 4 09:50:27 172.30.1.2 [ 99.374116] [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184 Jul 4 09:50:27 172.30.1.2 [ 99.387434] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 09:50:27 172.30.1.2 [ 99.397635] [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30 Jul 4 09:50:27 172.30.1.2 [ 99.408705] [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79 Jul 4 09:50:27 172.30.1.2 [ 99.419425] [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5 Jul 4 09:50:27 172.30.1.2 [ 99.429857] [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa Jul 4 09:50:27 172.30.1.2 [ 99.439903] [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e Jul 4 09:50:27 172.30.1.2 [ 99.451662] <EOI> Jul 4 09:50:27 172.30.1.2 [ 99.466410] [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117 Jul 4 09:50:27 172.30.1.2 [ 99.477365] [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117 Jul 4 09:50:27 172.30.1.2 [ 99.488261] [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af Jul 4 09:50:27 172.30.1.2 [ 99.500367] [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef Jul 4 09:50:27 172.30.1.2 [ 99.510737] [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd Jul 4 09:50:27 172.30.1.2 [ 99.522158] [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f ************************* PANIC 2 Jul 4 10:16:32 172.30.1.2 [ 1229.844850] BUG: unable to handle kernel Jul 4 10:16:32 172.30.1.2 [ 1229.860508] IP: Jul 4 10:16:32 172.30.1.2 [ 1229.874590] PGD 0 Jul 4 10:16:32 172.30.1.2 Jul 4 10:16:32 172.30.1.2 [ 1229.878604] Oops: 0000 [#1] Jul 4 10:16:32 172.30.1.2 SMP Jul 4 10:16:32 172.30.1.2 Jul 4 10:16:32 172.30.1.2 [ 1229.885057] CPU 0 Jul 4 10:16:32 172.30.1.2 Jul 4 10:16:32 172.30.1.2 [ 1229.888712] Modules linked in: Jul 4 10:16:32 172.30.1.2 Jul 4 10:16:32 172.30.1.2 [ 1230.027585] Jul 4 10:16:32 172.30.1.2 [ 1230.030548] Pid: 0, comm: swapper/0 Not tainted 3.2.21 #1 Jul 4 10:16:32 172.30.1.2 /0N051F Jul 4 10:16:32 172.30.1.2 Jul 4 10:16:32 172.30.1.2 [ 1230.046900] RIP: 0010:[<ffffffffa01bf9d0>] Jul 4 10:16:32 172.30.1.2 [ 1230.065834] RSP: 0018:ffff88042fc03960 EFLAGS: 00010287 Jul 4 10:16:32 172.30.1.2 [ 1230.076441] RAX: 0000000000000008 RBX: ffff8804215fa180 RCX: ffff88042fc03706 Jul 4 10:16:32 172.30.1.2 [ 1230.090691] RDX: 0000000000000000 RSI: 000000010003c740 RDI: ffff8804215fa180 Jul 4 10:16:32 172.30.1.2 [ 1230.104941] RBP: ffff880421d52000 R08: 0000000000000000 R09: ffff88042fc03918 Jul 4 10:16:32 172.30.1.2 [ 1230.119191] R10: ffffffff8180b240 R11: ffff8804215fa180 R12: ffff8804210d8000 Jul 4 10:16:32 172.30.1.2 [ 1230.133441] R13: ffff880406031300 R14: ffff8804210d8002 R15: ffff8804225bb000 Jul 4 10:16:32 172.30.1.2 [ 1230.147692] FS: 0000000000000000(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000 Jul 4 10:16:32 172.30.1.2 [ 1230.163863] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Jul 4 10:16:32 172.30.1.2 [ 1230.175338] CR2: 0000000000000018 CR3: 00000001efa5a000 CR4: 00000000000026e0 Jul 4 10:16:32 172.30.1.2 [ 1230.189586] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jul 4 10:16:32 172.30.1.2 [ 1230.203835] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Jul 4 10:16:32 172.30.1.2 [ 1230.218084] Process swapper/0 (pid: 0, threadinfo ffffffff81600000, task ffffffff8160d020) Jul 4 10:16:32 172.30.1.2 [ 1230.234604] Stack: Jul 4 10:16:32 172.30.1.2 [ 1230.238620] 0000000080000000 Jul 4 10:16:32 172.30.1.2 Jul 4 10:16:32 172.30.1.2 [ 1230.253452] ffff880421d52000 Jul 4 10:16:32 172.30.1.2 Jul 4 10:16:32 172.30.1.2 [ 1230.268289] ffff8804215fa180 Jul 4 10:16:32 172.30.1.2 Jul 4 10:16:32 172.30.1.2 [ 1230.283123] Call Trace: Jul 4 10:16:32 172.30.1.2 [ 1230.288006] <IRQ> Jul 4 10:16:32 172.30.1.2 Jul 4 10:16:32 172.30.1.2 [ 1230.292217] [<ffffffffa01bfc91>] ? br_nf_forward_ip+0x214/0x231 [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.305777] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 10:16:32 172.30.1.2 [ 1230.316390] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.328560] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.340728] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 10:16:32 172.30.1.2 [ 1230.351686] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.363857] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.375161] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.387332] [<ffffffffa01ba96e>] ? T.963+0x3c/0x56 [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.398638] [<ffffffffa01b9753>] ? __br_fdb_get+0x10/0x83 [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.411155] [<ffffffffa01bb61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.425771] [<ffffffffa01c0598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.440732] [<ffffffffa01bf3b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.453598] [<ffffffffa01c035b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge] Jul 4 10:16:32 172.30.1.2 [ 1230.467328] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 10:16:32 172.30.1.2 [ 1230.477936] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 10:16:32 172.30.1.2 [ 1230.488548] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.499850] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 10:16:33 172.30.1.2 [ 1230.510807] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.522111] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.533415] [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.544720] [<ffffffffa01bb84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.558107] [<ffffffffa01bb687>] ? br_handle_frame_finish+0x211/0x211 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.572722] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 10:16:33 172.30.1.2 [ 1230.585240] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 10:16:33 172.30.1.2 [ 1230.595328] [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d Jul 4 10:16:33 172.30.1.2 [ 1230.607151] [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d Jul 4 10:16:33 172.30.1.2 [ 1230.618800] [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31 Jul 4 10:16:33 172.30.1.2 [ 1230.630280] [<ffffffffa0046a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2] Jul 4 10:16:33 172.30.1.2 [ 1230.643146] [<ffffffffa00462f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2] Jul 4 10:16:33 172.30.1.2 [ 1230.656012] [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.667316] [<ffffffffa0046cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2] Jul 4 10:16:33 172.30.1.2 [ 1230.679313] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 10:16:33 172.30.1.2 [ 1230.691827] [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207 Jul 4 10:16:33 172.30.1.2 [ 1230.703130] [<ffffffff812a76f4>] ? process_backlog+0xec/0x1c7 Jul 4 10:16:33 172.30.1.2 [ 1230.714780] [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0 Jul 4 10:16:33 172.30.1.2 [ 1230.725912] [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184 Jul 4 10:16:33 172.30.1.2 [ 1230.739127] [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30 Jul 4 10:16:33 172.30.1.2 [ 1230.750085] [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79 Jul 4 10:16:33 172.30.1.2 [ 1230.760693] [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5 Jul 4 10:16:33 172.30.1.2 [ 1230.770954] [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa Jul 4 10:16:33 172.30.1.2 [ 1230.780871] [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e Jul 4 10:16:33 172.30.1.2 [ 1230.792517] <EOI> Jul 4 10:16:33 172.30.1.2 Jul 4 10:16:33 172.30.1.2 [ 1230.796721] [<ffffffff810665a4>] ? enqueue_hrtimer+0x43/0x6a Jul 4 10:16:33 172.30.1.2 [ 1230.808200] [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117 Jul 4 10:16:33 172.30.1.2 [ 1230.818982] [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117 Jul 4 10:16:33 172.30.1.2 [ 1230.829765] [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af Jul 4 10:16:33 172.30.1.2 [ 1230.841761] [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef Jul 4 10:16:33 172.30.1.2 [ 1230.852023] [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd Jul 4 10:16:33 172.30.1.2 [ 1230.863324] [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f Jul 4 10:16:33 172.30.1.2 [ 1230.875840] Code: Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 10 Jul 4 10:16:33 172.30.1.2 75 Jul 4 10:16:33 172.30.1.2 25 Jul 4 10:16:33 172.30.1.2 66 Jul 4 10:16:33 172.30.1.2 3d Jul 4 10:16:33 172.30.1.2 81 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 75 Jul 4 10:16:33 172.30.1.2 1f Jul 4 10:16:33 172.30.1.2 8b Jul 4 10:16:33 172.30.1.2 87 Jul 4 10:16:33 172.30.1.2 c8 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 48 Jul 4 10:16:33 172.30.1.2 8b Jul 4 10:16:33 172.30.1.2 8f Jul 4 10:16:33 172.30.1.2 d8 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 66 Jul 4 10:16:33 172.30.1.2 81 Jul 4 10:16:33 172.30.1.2 7c Jul 4 10:16:33 172.30.1.2 01 Jul 4 10:16:33 172.30.1.2 10 Jul 4 10:16:33 172.30.1.2 08 Jul 4 10:16:33 172.30.1.2 06 Jul 4 10:16:33 172.30.1.2 75 Jul 4 10:16:33 172.30.1.2 09 Jul 4 10:16:33 172.30.1.2 83 Jul 4 10:16:33 172.30.1.2 3d Jul 4 10:16:33 172.30.1.2 f2 Jul 4 10:16:33 172.30.1.2 63 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 00 Jul 4 10:16:33 172.30.1.2 75 Jul 4 10:16:33 172.30.1.2 3c Jul 4 10:16:33 172.30.1.2 f6> Jul 4 10:16:33 172.30.1.2 42 Jul 4 10:16:33 172.30.1.2 18 Jul 4 10:16:33 172.30.1.2 01 Jul 4 10:16:33 172.30.1.2 48 Jul 4 10:16:33 172.30.1.2 8b Jul 4 10:16:33 172.30.1.2 6a Jul 4 10:16:33 172.30.1.2 08 Jul 4 10:16:33 172.30.1.2 74 Jul 4 10:16:33 172.30.1.2 10 Jul 4 10:16:33 172.30.1.2 8a Jul 4 10:16:33 172.30.1.2 43 Jul 4 10:16:33 172.30.1.2 Jul 4 10:16:33 172.30.1.2 [ 1230.909204] ------------[ cut here ]------------ Jul 4 10:16:33 172.30.1.2 [ 1230.909207] WARNING: at kernel/softirq.c:159 _local_bh_enable_ip+0x41/0x8b() Jul 4 10:16:33 172.30.1.2 [ 1230.909208] Hardware name: PowerEdge R410 Jul 4 10:16:33 172.30.1.2 [ 1230.909209] Modules linked in: ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 ip6table_filter ip6_tables iptable_filter ip_tables x_tables ip_vs_rr ip_vs nf_conntrack crc32c libcrc32c drbd lru_cache cn tun virtio_net virtio_blk virtio_rng rng_core virtio_pci virtio_ring virtio kvm_intel kvm ipmi_devintf ipmi_poweroff ipmi_si ipmi_watchdog ipmi_msghandler netconsole configfs loop snd_pcm bridge stp snd_timer i7core_edac edac_core dcdbas snd joydev psmouse iTCO_wdt iTCO_vendor_support soundcore snd_page_alloc pcspkr serio_raw processor evdev button thermal_sys ext3 mbcache jbd dm_mod usbhid hid sr_mod cdrom sd_mod ses crc_t10dif enclosure ata_generic uhci_hcd ata_piix libata ehci_hcd usbcore usb_common megaraid_sas scsi_mod bnx2 [last unloaded: scsi_wait_scan] Jul 4 10:16:33 172.30.1.2 [ 1230.909244] Pid: 0, comm: swapper/0 Not tainted 3.2.21 #1 Jul 4 10:16:33 172.30.1.2 [ 1230.909245] Call Trace: Jul 4 10:16:33 172.30.1.2 [ 1230.909246] <IRQ> [<ffffffff81049810>] ? warn_slowpath_common+0x78/0x8c Jul 4 10:16:33 172.30.1.2 [ 1230.909253] [<ffffffff8104efa0>] ? _local_bh_enable_ip+0x41/0x8b Jul 4 10:16:33 172.30.1.2 [ 1230.909259] [<ffffffffa003d648>] ? bnx2_reg_rd_ind+0x31/0x38 [bnx2] Jul 4 10:16:33 172.30.1.2 [ 1230.909264] [<ffffffffa0046dc8>] ? bnx2_poll+0x1e2/0x1f2 [bnx2] Jul 4 10:16:33 172.30.1.2 [ 1230.909270] [<ffffffff812b6b62>] ? netpoll_poll_dev+0xab/0x4ad Jul 4 10:16:33 172.30.1.2 [ 1230.909275] [<ffffffffa0043ba0>] ? bnx2_start_xmit+0x411/0x55d [bnx2] Jul 4 10:16:33 172.30.1.2 [ 1230.909282] [<ffffffff810f693e>] ? ____cache_alloc+0xc6/0x20d Jul 4 10:16:33 172.30.1.2 [ 1230.909286] [<ffffffff812b7075>] ? netpoll_send_skb_on_dev+0x111/0x215 Jul 4 10:16:33 172.30.1.2 [ 1230.909292] [<ffffffffa01b96d2>] ? br_dev_xmit+0x136/0x150 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.909295] [<ffffffff812b7033>] ? netpoll_send_skb_on_dev+0xcf/0x215 Jul 4 10:16:33 172.30.1.2 [ 1230.909301] [<ffffffff811c3157>] ? delay_tsc+0x2b/0x74 Jul 4 10:16:33 172.30.1.2 [ 1230.909305] [<ffffffffa01a3272>] ? write_msg+0x9f/0x102 [netconsole] Jul 4 10:16:33 172.30.1.2 [ 1230.909309] [<ffffffff810499e6>] ? __call_console_drivers+0x75/0x86 Jul 4 10:16:33 172.30.1.2 [ 1230.909312] [<ffffffff8104a084>] ? console_unlock+0x13d/0x1e8 Jul 4 10:16:33 172.30.1.2 [ 1230.909315] [<ffffffff8104a707>] ? vprintk+0x39e/0x3e5 Jul 4 10:16:33 172.30.1.2 [ 1230.909321] [<ffffffffa01bf9dc>] ? br_nf_forward_finish+0x54/0xc0 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.909326] [<ffffffffa01bf9a5>] ? br_nf_forward_finish+0x1d/0xc0 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.909330] [<ffffffff81362842>] ? printk+0x40/0x46 Jul 4 10:16:33 172.30.1.2 [ 1230.909333] [<ffffffff8100fff9>] ? show_registers+0x1e2/0x211 Jul 4 10:16:33 172.30.1.2 [ 1230.909336] [<ffffffff813652dd>] ? __die+0x8e/0xc9 Jul 4 10:16:33 172.30.1.2 [ 1230.909339] [<ffffffff8102fcd0>] ? no_context+0x1d6/0x20c Jul 4 10:16:33 172.30.1.2 [ 1230.909342] [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c Jul 4 10:16:33 172.30.1.2 [ 1230.909345] [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c Jul 4 10:16:33 172.30.1.2 [ 1230.909351] [<ffffffffa03f4d93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs] Jul 4 10:16:33 172.30.1.2 [ 1230.909355] [<ffffffffa03f3dec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs] Jul 4 10:16:33 172.30.1.2 [ 1230.909360] [<ffffffffa03f5e1a>] ? ip_vs_out+0x33c/0x49d [ip_vs] Jul 4 10:16:33 172.30.1.2 [ 1230.909364] [<ffffffff81364ab5>] ? page_fault+0x25/0x30 Jul 4 10:16:33 172.30.1.2 [ 1230.909369] [<ffffffffa01bf9d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.909375] [<ffffffffa01bfc91>] ? br_nf_forward_ip+0x214/0x231 [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.909378] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 10:16:33 172.30.1.2 [ 1230.909383] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.909388] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:33 172.30.1.2 [ 1230.909391] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 10:16:33 172.30.1.2 [ 1230.909395] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909401] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909405] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909410] [<ffffffffa01ba96e>] ? T.963+0x3c/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909415] [<ffffffffa01b9753>] ? __br_fdb_get+0x10/0x83 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909420] [<ffffffffa01bb61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909425] [<ffffffffa01c0598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909431] [<ffffffffa01bf3b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909436] [<ffffffffa01c035b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909439] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 10:16:34 172.30.1.2 [ 1230.909442] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 10:16:34 172.30.1.2 [ 1230.909448] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909450] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 10:16:34 172.30.1.2 [ 1230.909455] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909461] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909466] [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909471] [<ffffffffa01bb84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909476] [<ffffffffa01bb687>] ? br_handle_frame_finish+0x211/0x211 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909479] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 10:16:34 172.30.1.2 [ 1230.909482] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 10:16:34 172.30.1.2 [ 1230.909485] [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d Jul 4 10:16:34 172.30.1.2 [ 1230.909487] [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d Jul 4 10:16:34 172.30.1.2 [ 1230.909490] [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31 Jul 4 10:16:34 172.30.1.2 [ 1230.909495] [<ffffffffa0046a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2] Jul 4 10:16:34 172.30.1.2 [ 1230.909500] [<ffffffffa00462f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2] Jul 4 10:16:34 172.30.1.2 [ 1230.909506] [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1230.909511] [<ffffffffa0046cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2] Jul 4 10:16:34 172.30.1.2 [ 1230.909514] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 10:16:34 172.30.1.2 [ 1230.909517] [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207 Jul 4 10:16:34 172.30.1.2 [ 1230.909519] [<ffffffff812a76f4>] ? process_backlog+0xec/0x1c7 Jul 4 10:16:34 172.30.1.2 [ 1230.909522] [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0 Jul 4 10:16:34 172.30.1.2 [ 1230.909525] [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184 Jul 4 10:16:34 172.30.1.2 [ 1230.909528] [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30 Jul 4 10:16:34 172.30.1.2 [ 1230.909531] [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79 Jul 4 10:16:34 172.30.1.2 [ 1230.909533] [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5 Jul 4 10:16:34 172.30.1.2 [ 1230.909535] [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa Jul 4 10:16:34 172.30.1.2 [ 1230.909538] [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e Jul 4 10:16:34 172.30.1.2 [ 1230.909540] <EOI> [<ffffffff810665a4>] ? enqueue_hrtimer+0x43/0x6a Jul 4 10:16:34 172.30.1.2 [ 1230.909545] [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117 Jul 4 10:16:34 172.30.1.2 [ 1230.909547] [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117 Jul 4 10:16:34 172.30.1.2 [ 1230.909550] [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af Jul 4 10:16:34 172.30.1.2 [ 1230.909552] [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef Jul 4 10:16:34 172.30.1.2 [ 1230.909555] [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd Jul 4 10:16:34 172.30.1.2 [ 1230.909557] [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f Jul 4 10:16:34 172.30.1.2 [ 1230.909559] ---[ end trace fc194823a33da07a ]--- Jul 4 10:16:34 172.30.1.2 [ 1232.022328] 7d Jul 4 10:16:34 172.30.1.2 83 Jul 4 10:16:34 172.30.1.2 e0 Jul 4 10:16:34 172.30.1.2 f8 Jul 4 10:16:34 172.30.1.2 83 Jul 4 10:16:34 172.30.1.2 c8 Jul 4 10:16:34 172.30.1.2 03 Jul 4 10:16:34 172.30.1.2 88 Jul 4 10:16:34 172.30.1.2 43 Jul 4 10:16:34 172.30.1.2 Jul 4 10:16:34 172.30.1.2 [ 1232.030096] RIP Jul 4 10:16:34 172.30.1.2 [ 1232.044362] RSP <ffff88042fc03960> Jul 4 10:16:34 172.30.1.2 [ 1232.051328] CR2: 0000000000000018 Jul 4 10:16:34 172.30.1.2 [ 1232.058766] ---[ end trace fc194823a33da07b ]--- Jul 4 10:16:34 172.30.1.2 [ 1232.073596] Kernel panic - not syncing: Fatal exception in interrupt Jul 4 10:16:34 172.30.1.2 [ 1232.086687] Pid: 0, comm: swapper/0 Tainted: G D W 3.2.21 #1 Jul 4 10:16:34 172.30.1.2 [ 1232.099762] Call Trace: Jul 4 10:16:34 172.30.1.2 [ 1232.104997] <IRQ> Jul 4 10:16:34 172.30.1.2 [ 1232.116921] [<ffffffff81049da9>] ? kmsg_dump+0xb2/0xdd Jul 4 10:16:34 172.30.1.2 [ 1232.127737] [<ffffffff813653c1>] ? oops_end+0xa9/0xb6 Jul 4 10:16:34 172.30.1.2 [ 1232.138297] [<ffffffff8102fcf9>] ? no_context+0x1ff/0x20c Jul 4 10:16:34 172.30.1.2 [ 1232.149634] [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c Jul 4 10:16:34 172.30.1.2 [ 1232.160799] [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c Jul 4 10:16:34 172.30.1.2 [ 1232.172660] [<ffffffffa03f4d93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs] Jul 4 10:16:34 172.30.1.2 [ 1232.185561] [<ffffffffa03f3dec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs] Jul 4 10:16:34 172.30.1.2 [ 1232.198619] [<ffffffffa03f5e1a>] ? ip_vs_out+0x33c/0x49d [ip_vs] Jul 4 10:16:34 172.30.1.2 [ 1232.211157] [<ffffffff81364ab5>] ? page_fault+0x25/0x30 Jul 4 10:16:34 172.30.1.2 [ 1232.222227] [<ffffffffa01bf9d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.236573] [<ffffffffa01bfc91>] ? br_nf_forward_ip+0x214/0x231 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.250640] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 10:16:34 172.30.1.2 [ 1232.261680] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.274300] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.286840] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 10:16:34 172.30.1.2 [ 1232.298164] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.310775] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.322461] [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.335018] [<ffffffffa01ba96e>] ? T.963+0x3c/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.346693] [<ffffffffa01b9753>] ? __br_fdb_get+0x10/0x83 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.359583] [<ffffffffa01bb61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.374567] [<ffffffffa01c0598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.389895] [<ffffffffa01bf3b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.403127] [<ffffffffa01c035b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.417307] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 10:16:34 172.30.1.2 [ 1232.428288] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 10:16:34 172.30.1.2 [ 1232.439232] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.450848] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 10:16:34 172.30.1.2 [ 1232.462237] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.473984] [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge] Jul 4 10:16:34 172.30.1.2 [ 1232.485708] [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge] Jul 4 10:16:35 172.30.1.2 [ 1232.497434] [<ffffffffa01bb84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge] Jul 4 10:16:35 172.30.1.2 [ 1232.511205] [<ffffffffa01bb687>] ? br_handle_frame_finish+0x211/0x211 [bridge] Jul 4 10:16:35 172.30.1.2 [ 1232.526211] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 10:16:35 172.30.1.2 [ 1232.539100] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 10:16:35 172.30.1.2 [ 1232.549564] [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d Jul 4 10:16:35 172.30.1.2 [ 1232.561885] [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d Jul 4 10:16:35 172.30.1.2 [ 1232.573955] [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31 Jul 4 10:16:35 172.30.1.2 [ 1232.585819] [<ffffffffa0046a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2] Jul 4 10:16:35 172.30.1.2 [ 1232.599057] [<ffffffffa00462f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2] Jul 4 10:16:35 172.30.1.2 [ 1232.612295] [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge] Jul 4 10:16:35 172.30.1.2 [ 1232.624033] [<ffffffffa0046cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2] Jul 4 10:16:35 172.30.1.2 [ 1232.636400] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 10:16:35 172.30.1.2 [ 1232.649290] [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207 Jul 4 10:16:35 172.30.1.2 [ 1232.660969] [<ffffffff812a76f4>] ? process_backlog+0xec/0x1c7 Jul 4 10:16:35 172.30.1.2 [ 1232.673051] [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0 Jul 4 10:16:35 172.30.1.2 [ 1232.684544] [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184 Jul 4 10:16:35 172.30.1.2 [ 1232.698181] [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30 Jul 4 10:16:35 172.30.1.2 [ 1232.709517] [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79 Jul 4 10:16:35 172.30.1.2 [ 1232.720570] [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5 Jul 4 10:16:35 172.30.1.2 [ 1232.731213] [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa Jul 4 10:16:35 172.30.1.2 [ 1232.741520] [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e Jul 4 10:16:35 172.30.1.2 [ 1232.753540] <EOI> Jul 4 10:16:35 172.30.1.2 [ 1232.766995] [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117 Jul 4 10:16:35 172.30.1.2 [ 1232.778212] [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117 Jul 4 10:16:35 172.30.1.2 [ 1232.789365] [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af Jul 4 10:16:35 172.30.1.2 [ 1232.801743] [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef Jul 4 10:16:35 172.30.1.2 [ 1232.812429] [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd Jul 4 10:16:35 172.30.1.2 [ 1232.824103] [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f Jul 4 10:16:35 172.30.1.2 [ 1232.837153] ------------[ cut here ]------------ Jul 4 10:16:35 172.30.1.2 [ 1232.846424] WARNING: at arch/x86/kernel/smp.c:119 try_to_wake_up+0x152/0x190() Jul 4 10:16:35 172.30.1.2 [ 1232.860904] Hardware name: PowerEdge R410 Jul 4 10:16:35 172.30.1.2 [ 1232.868951] Modules linked in: Jul 4 10:16:35 172.30.1.2 Jul 4 10:16:35 172.30.1.2 [ 1233.011185] Pid: 5081, comm: kvm Tainted: G D W 3.2.21 #1 Jul 4 10:16:35 172.30.1.2 [ 1233.023394] Call Trace: Jul 4 10:16:35 172.30.1.2 [ 1233.028322] [<ffffffff81049810>] ? warn_slowpath_common+0x78/0x8c Jul 4 10:16:35 172.30.1.2 [ 1233.040707] [<ffffffff81045ed8>] ? try_to_wake_up+0x152/0x190 Jul 4 10:16:35 172.30.1.2 [ 1233.052400] [<ffffffff81063786>] ? autoremove_wake_function+0x9/0x2a Jul 4 10:16:35 172.30.1.2 [ 1233.065304] [<ffffffff8103878a>] ? __wake_up_common+0x41/0x78 Jul 4 10:16:35 172.30.1.2 [ 1233.076998] [<ffffffff8103dbbb>] ? __wake_up+0x35/0x46 Jul 4 10:16:35 172.30.1.2 [ 1233.087485] [<ffffffffa024866c>] ? kvm_vcpu_kick+0x31/0x82 [kvm] Jul 4 10:16:35 172.30.1.2 [ 1233.099699] [<ffffffff81113d58>] ? __pollwait+0xd0/0xd0 Jul 4 10:16:35 172.30.1.2 [ 1233.110355] [<ffffffffa0261978>] ? __apic_accept_irq+0x1c1/0x1e4 [kvm] Jul 4 10:16:35 172.30.1.2 [ 1233.123613] [<ffffffffa023f4ee>] ? ioapic_service+0x9a/0xb8 [kvm] Jul 4 10:16:35 172.30.1.2 [ 1233.136002] [<ffffffffa023f87c>] ? kvm_ioapic_set_irq+0x7d/0xd1 [kvm] Jul 4 10:16:35 172.30.1.2 [ 1233.149084] [<ffffffffa02401f5>] ? kvm_set_irq+0xae/0xd7 [kvm] Jul 4 10:16:35 172.30.1.2 [ 1233.160953] [<ffffffffa023fce7>] ? kvm_free_irq_routing+0x11/0x11 [kvm] Jul 4 10:16:35 172.30.1.2 [ 1233.174384] [<ffffffffa023fd28>] ? kvm_set_ioapic_irq+0x41/0x41 [kvm] Jul 4 10:16:35 172.30.1.2 [ 1233.187464] [<ffffffff812a83c3>] ? netif_rx_ni+0x1e/0x27 Jul 4 10:16:35 172.30.1.2 [ 1233.198292] [<ffffffffa024c566>] ? kvm_arch_vm_ioctl+0x391/0x8b5 [kvm] Jul 4 10:16:35 172.30.1.2 [ 1233.211545] [<ffffffffa02b7e40>] ? tun_sendmsg+0x23/0x23 [tun] Jul 4 10:16:35 172.30.1.2 [ 1233.223409] [<ffffffffa02b7eac>] ? tun_chr_aio_write+0x6c/0x7f [tun] Jul 4 10:16:35 172.30.1.2 [ 1233.236315] [<ffffffff81105818>] ? do_sync_readv_writev+0x9a/0xd5 Jul 4 10:16:35 172.30.1.2 [ 1233.248701] [<ffffffff81132c72>] ? fsnotify+0x24b/0x278 Jul 4 10:16:35 172.30.1.2 [ 1233.259357] [<ffffffffa023e2e4>] ? kvm_vm_ioctl+0x358/0x39a [kvm] Jul 4 10:16:35 172.30.1.2 [ 1233.271742] [<ffffffff81105ec3>] ? do_readv_writev+0x110/0x125 Jul 4 10:16:35 172.30.1.2 [ 1233.283608] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 10:16:35 172.30.1.2 [ 1233.293739] [<ffffffff811134f7>] ? do_vfs_ioctl+0x464/0x4b1 Jul 4 10:16:35 172.30.1.2 [ 1233.305082] [<ffffffff8111358f>] ? sys_ioctl+0x4b/0x70 Jul 4 10:16:35 172.30.1.2 [ 1233.315558] [<ffffffff8110601d>] ? sys_writev+0x62/0x93 Jul 4 10:16:35 172.30.1.2 [ 1233.326208] [<ffffffff81369b12>] ? system_call_fastpath+0x16/0x1b Jul 4 10:16:35 172.30.1.2 [ 1233.338592] ---[ end trace fc194823a33da07c ]--- ************************* PANIC 3 Jul 4 12:02:44 172.30.1.2 [ 4919.504700] BUG: unable to handle kernel Jul 4 12:02:44 172.30.1.2 [ 4919.520358] IP: Jul 4 12:02:44 172.30.1.2 [ 4919.534442] PGD 0 Jul 4 12:02:44 172.30.1.2 Jul 4 12:02:44 172.30.1.2 [ 4919.538456] Oops: 0000 [#1] Jul 4 12:02:44 172.30.1.2 SMP Jul 4 12:02:44 172.30.1.2 Jul 4 12:02:44 172.30.1.2 [ 4919.544912] CPU 0 Jul 4 12:02:44 172.30.1.2 Jul 4 12:02:44 172.30.1.2 [ 4919.548565] Modules linked in: Jul 4 12:02:44 172.30.1.2 Jul 4 12:02:44 172.30.1.2 [ 4919.687452] Jul 4 12:02:44 172.30.1.2 [ 4919.690415] Pid: 0, comm: swapper/0 Not tainted 3.2.21 #1 Jul 4 12:02:44 172.30.1.2 /0N051F Jul 4 12:02:44 172.30.1.2 Jul 4 12:02:44 172.30.1.2 [ 4919.706766] RIP: 0010:[<ffffffffa018d9d0>] Jul 4 12:02:44 172.30.1.2 [ 4919.725700] RSP: 0018:ffff88042fc03960 EFLAGS: 00010287 Jul 4 12:02:44 172.30.1.2 [ 4919.736310] RAX: 0000000000000008 RBX: ffff88040cf5a7c0 RCX: ffff88042fc03707 Jul 4 12:02:44 172.30.1.2 [ 4919.750561] RDX: 0000000000000000 RSI: 000000010011dc80 RDI: ffff88040cf5a7c0 Jul 4 12:02:44 172.30.1.2 [ 4919.764809] RBP: ffff88042164a000 R08: 0000000000000000 R09: ffff88042fc03918 Jul 4 12:02:44 172.30.1.2 [ 4919.779057] R10: ffffffff8180b240 R11: ffff88040cf5a7c0 R12: ffff880221038000 Jul 4 12:02:44 172.30.1.2 [ 4919.793305] R13: ffff8803f58eb1c0 R14: ffff880221038002 R15: ffff880223a61000 Jul 4 12:02:44 172.30.1.2 [ 4919.807555] FS: 0000000000000000(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000 Jul 4 12:02:44 172.30.1.2 [ 4919.823728] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b Jul 4 12:02:44 172.30.1.2 [ 4919.835204] CR2: 0000000000000018 CR3: 0000000001605000 CR4: 00000000000026e0 Jul 4 12:02:44 172.30.1.2 [ 4919.849453] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 Jul 4 12:02:44 172.30.1.2 [ 4919.863703] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Jul 4 12:02:44 172.30.1.2 [ 4919.877952] Process swapper/0 (pid: 0, threadinfo ffffffff81600000, task ffffffff8160d020) Jul 4 12:02:44 172.30.1.2 [ 4919.894470] Stack: Jul 4 12:02:44 172.30.1.2 [ 4919.898488] 0000000080000000 Jul 4 12:02:44 172.30.1.2 Jul 4 12:02:44 172.30.1.2 [ 4919.913320] ffff88042164a000 Jul 4 12:02:44 172.30.1.2 Jul 4 12:02:44 172.30.1.2 [ 4919.928150] ffff88040cf5a7c0 Jul 4 12:02:44 172.30.1.2 Jul 4 12:02:44 172.30.1.2 [ 4919.942983] Call Trace: Jul 4 12:02:44 172.30.1.2 [ 4919.947869] <IRQ> Jul 4 12:02:44 172.30.1.2 Jul 4 12:02:44 172.30.1.2 [ 4919.952076] [<ffffffffa018dc91>] ? br_nf_forward_ip+0x214/0x231 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4919.965638] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 12:02:44 172.30.1.2 [ 4919.976250] [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 12:02:44 172.30.1.2 [ 4919.988421] [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.000591] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 12:02:44 172.30.1.2 [ 4920.011549] [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.023721] [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.035025] [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.047197] [<ffffffffa018896e>] ? T.963+0x3c/0x56 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.058501] [<ffffffffa0187753>] ? __br_fdb_get+0x10/0x83 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.071019] [<ffffffffa018961d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.085635] [<ffffffffa018e598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.100597] [<ffffffffa018d3b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.113463] [<ffffffffa018e35b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.127192] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 12:02:44 172.30.1.2 [ 4920.137804] [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.149107] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 12:02:44 172.30.1.2 [ 4920.160065] [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.171370] [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.182674] [<ffffffffa018945c>] ? T.947+0x3c/0x56 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.193979] [<ffffffffa018984a>] ? br_handle_frame+0x1c3/0x1d9 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.207365] [<ffffffffa0189687>] ? br_handle_frame_finish+0x211/0x211 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.221979] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 12:02:44 172.30.1.2 [ 4920.234498] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 12:02:44 172.30.1.2 [ 4920.244587] [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d Jul 4 12:02:44 172.30.1.2 [ 4920.256409] [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d Jul 4 12:02:44 172.30.1.2 [ 4920.268056] [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31 Jul 4 12:02:44 172.30.1.2 [ 4920.279537] [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2] Jul 4 12:02:44 172.30.1.2 [ 4920.292403] [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2] Jul 4 12:02:44 172.30.1.2 [ 4920.305268] [<ffffffffa018945c>] ? T.947+0x3c/0x56 [bridge] Jul 4 12:02:44 172.30.1.2 [ 4920.316576] [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2] Jul 4 12:02:44 172.30.1.2 [ 4920.328573] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 12:02:44 172.30.1.2 [ 4920.341089] [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207 Jul 4 12:02:44 172.30.1.2 [ 4920.352394] [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a Jul 4 12:02:44 172.30.1.2 [ 4920.365085] [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0 Jul 4 12:02:44 172.30.1.2 [ 4920.376214] [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184 Jul 4 12:02:44 172.30.1.2 [ 4920.389425] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 12:02:44 172.30.1.2 [ 4920.399518] [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30 Jul 4 12:02:44 172.30.1.2 [ 4920.410477] [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79 Jul 4 12:02:44 172.30.1.2 [ 4920.421086] [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5 Jul 4 12:02:45 172.30.1.2 [ 4920.431348] [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa Jul 4 12:02:45 172.30.1.2 [ 4920.441265] [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e Jul 4 12:02:45 172.30.1.2 [ 4920.452913] <EOI> Jul 4 12:02:45 172.30.1.2 Jul 4 12:02:45 172.30.1.2 [ 4920.457120] [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117 Jul 4 12:02:45 172.30.1.2 [ 4920.467900] [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117 Jul 4 12:02:45 172.30.1.2 [ 4920.478683] [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af Jul 4 12:02:45 172.30.1.2 [ 4920.490679] [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef Jul 4 12:02:45 172.30.1.2 [ 4920.500941] [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd Jul 4 12:02:45 172.30.1.2 [ 4920.512242] [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f Jul 4 12:02:45 172.30.1.2 [ 4920.524758] Code: Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 10 Jul 4 12:02:45 172.30.1.2 75 Jul 4 12:02:45 172.30.1.2 25 Jul 4 12:02:45 172.30.1.2 66 Jul 4 12:02:45 172.30.1.2 3d Jul 4 12:02:45 172.30.1.2 81 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 75 Jul 4 12:02:45 172.30.1.2 1f Jul 4 12:02:45 172.30.1.2 8b Jul 4 12:02:45 172.30.1.2 87 Jul 4 12:02:45 172.30.1.2 c8 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 48 Jul 4 12:02:45 172.30.1.2 8b Jul 4 12:02:45 172.30.1.2 8f Jul 4 12:02:45 172.30.1.2 d8 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 66 Jul 4 12:02:45 172.30.1.2 81 Jul 4 12:02:45 172.30.1.2 7c Jul 4 12:02:45 172.30.1.2 01 Jul 4 12:02:45 172.30.1.2 10 Jul 4 12:02:45 172.30.1.2 08 Jul 4 12:02:45 172.30.1.2 06 Jul 4 12:02:45 172.30.1.2 75 Jul 4 12:02:45 172.30.1.2 09 Jul 4 12:02:45 172.30.1.2 83 Jul 4 12:02:45 172.30.1.2 3d Jul 4 12:02:45 172.30.1.2 f2 Jul 4 12:02:45 172.30.1.2 63 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 00 Jul 4 12:02:45 172.30.1.2 75 Jul 4 12:02:45 172.30.1.2 3c Jul 4 12:02:45 172.30.1.2 f6> Jul 4 12:02:45 172.30.1.2 42 Jul 4 12:02:45 172.30.1.2 18 Jul 4 12:02:45 172.30.1.2 01 Jul 4 12:02:45 172.30.1.2 48 Jul 4 12:02:45 172.30.1.2 8b Jul 4 12:02:45 172.30.1.2 6a Jul 4 12:02:45 172.30.1.2 08 Jul 4 12:02:45 172.30.1.2 74 Jul 4 12:02:45 172.30.1.2 10 Jul 4 12:02:45 172.30.1.2 8a Jul 4 12:02:45 172.30.1.2 43 Jul 4 12:02:45 172.30.1.2 7d Jul 4 12:02:45 172.30.1.2 83 Jul 4 12:02:45 172.30.1.2 e0 Jul 4 12:02:45 172.30.1.2 f8 Jul 4 12:02:45 172.30.1.2 83 Jul 4 12:02:45 172.30.1.2 c8 Jul 4 12:02:45 172.30.1.2 03 Jul 4 12:02:45 172.30.1.2 88 Jul 4 12:02:45 172.30.1.2 43 Jul 4 12:02:45 172.30.1.2 Jul 4 12:02:45 172.30.1.2 [ 4920.563389] RIP Jul 4 12:02:45 172.30.1.2 [ 4920.577654] RSP <ffff88042fc03960> Jul 4 12:02:45 172.30.1.2 [ 4920.584619] CR2: 0000000000000018 Jul 4 12:02:45 172.30.1.2 [ 4920.592042] ---[ end trace 805a74073bda97f9 ]--- Jul 4 12:02:45 172.30.1.2 [ 4920.601505] Kernel panic - not syncing: Fatal exception in interrupt Jul 4 12:02:45 172.30.1.2 [ 4920.614475] Pid: 0, comm: swapper/0 Tainted: G D 3.2.21 #1 Jul 4 12:02:45 172.30.1.2 [ 4920.627702] Call Trace: Jul 4 12:02:45 172.30.1.2 [ 4920.633035] <IRQ> Jul 4 12:02:45 172.30.1.2 [ 4920.644916] [<ffffffff81049da9>] ? kmsg_dump+0xb2/0xdd Jul 4 12:02:45 172.30.1.2 [ 4920.655929] [<ffffffff813653c1>] ? oops_end+0xa9/0xb6 Jul 4 12:02:45 172.30.1.2 [ 4920.666668] [<ffffffff8102fcf9>] ? no_context+0x1ff/0x20c Jul 4 12:02:45 172.30.1.2 [ 4920.678144] [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c Jul 4 12:02:45 172.30.1.2 [ 4920.689436] [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c Jul 4 12:02:45 172.30.1.2 [ 4920.701419] [<ffffffffa037fd93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs] Jul 4 12:02:45 172.30.1.2 [ 4920.714461] [<ffffffffa037edec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs] Jul 4 12:02:45 172.30.1.2 [ 4920.727675] [<ffffffffa0380e1a>] ? ip_vs_out+0x33c/0x49d [ip_vs] Jul 4 12:02:45 172.30.1.2 [ 4920.740372] [<ffffffff81364ab5>] ? page_fault+0x25/0x30 Jul 4 12:02:45 172.30.1.2 [ 4920.751466] [<ffffffffa018d9d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.765898] [<ffffffffa018dc91>] ? br_nf_forward_ip+0x214/0x231 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.779982] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 12:02:45 172.30.1.2 [ 4920.791169] [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.803865] [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.816556] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 12:02:45 172.30.1.2 [ 4920.828013] [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.840706] [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.852517] [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.865188] [<ffffffffa018896e>] ? T.963+0x3c/0x56 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.877086] [<ffffffffa0187753>] ? __br_fdb_get+0x10/0x83 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.890132] [<ffffffffa018961d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.905258] [<ffffffffa018e598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.920749] [<ffffffffa018d3b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.934195] [<ffffffffa018e35b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.948452] [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77 Jul 4 12:02:45 172.30.1.2 [ 4920.959567] [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.971398] [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd Jul 4 12:02:45 172.30.1.2 [ 4920.982865] [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4920.994697] [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4921.006530] [<ffffffffa018945c>] ? T.947+0x3c/0x56 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4921.018419] [<ffffffffa018984a>] ? br_handle_frame+0x1c3/0x1d9 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4921.032318] [<ffffffffa0189687>] ? br_handle_frame_finish+0x211/0x211 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4921.047475] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 12:02:45 172.30.1.2 [ 4921.060525] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 12:02:45 172.30.1.2 [ 4921.071137] [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d Jul 4 12:02:45 172.30.1.2 [ 4921.083469] [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d Jul 4 12:02:45 172.30.1.2 [ 4921.095625] [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31 Jul 4 12:02:45 172.30.1.2 [ 4921.107617] [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2] Jul 4 12:02:45 172.30.1.2 [ 4921.120997] [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2] Jul 4 12:02:45 172.30.1.2 [ 4921.134376] [<ffffffffa018945c>] ? T.947+0x3c/0x56 [bridge] Jul 4 12:02:45 172.30.1.2 [ 4921.146099] [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2] Jul 4 12:02:45 172.30.1.2 [ 4921.158667] [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490 Jul 4 12:02:45 172.30.1.2 [ 4921.171708] [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207 Jul 4 12:02:45 172.30.1.2 [ 4921.183521] [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a Jul 4 12:02:45 172.30.1.2 [ 4921.196735] [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0 Jul 4 12:02:45 172.30.1.2 [ 4921.208397] [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184 Jul 4 12:02:45 172.30.1.2 [ 4921.222112] [<ffffffff81013a01>] ? read_tsc+0x5/0x16 Jul 4 12:02:45 172.30.1.2 [ 4921.232737] [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30 Jul 4 12:02:45 172.30.1.2 [ 4921.244138] [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79 Jul 4 12:02:45 172.30.1.2 [ 4921.255184] [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5 Jul 4 12:02:45 172.30.1.2 [ 4921.265887] [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa Jul 4 12:02:45 172.30.1.2 [ 4921.276237] [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e Jul 4 12:02:45 172.30.1.2 [ 4921.288328] <EOI> Jul 4 12:02:45 172.30.1.2 [ 4921.301304] [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117 Jul 4 12:02:45 172.30.1.2 [ 4921.312527] [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af Jul 4 12:02:45 172.30.1.2 [ 4921.324969] [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef Jul 4 12:02:45 172.30.1.2 [ 4921.335671] [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd Jul 4 12:02:45 172.30.1.2 [ 4921.347411] [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Bridged networking panics 2012-07-04 10:42 ` Massimo Cetra @ 2012-07-04 13:24 ` Eric Dumazet 2012-07-04 13:50 ` Massimo Cetra 0 siblings, 1 reply; 4+ messages in thread From: Eric Dumazet @ 2012-07-04 13:24 UTC (permalink / raw) To: Massimo Cetra; +Cc: netdev, linux-kernel On Wed, 2012-07-04 at 12:42 +0200, Massimo Cetra wrote: > Ok, waiting for an answer (sincerely i don't understand why no ones > cares for months) i'm attaching 3 more panics happened this morning on a > vanilla 3.2.21. > > The problem is related to heavy network traffic. > > I'm not a kernel hacker but I see that net_rx_action() is in the backtrace. > So (probably reaching wrong conclusions) if those panics are triggered > by incoming network traffic, can an attacker use this to crash a machine ? > > Anyone willing to reply or at least tell me what's going on ? Posting a bug report is not enough to get people working for free on the problem. Apparently your configuration is kind of special if nobody but you hits the problem so often. So it would help if you can reproduce the bug using current kernel and provide all necessary steps to reproduce the bug. Ideally a script.sh file doing all the configuration you use to trigger the bug, assuming a basic machine freshly booted with no special config already done. The panics dont happen in the bridge code itself, but in the BRIDGE_NETFILTER one. Do you need it, and why ? Are you using vlans ? Please try following patch net/bridge/br_netfilter.c | 20 +++++++++++++++----- 1 file changed, 15 insertions(+), 5 deletions(-) diff --git a/net/bridge/br_netfilter.c b/net/bridge/br_netfilter.c index e41456b..a73a8cb 100644 --- a/net/bridge/br_netfilter.c +++ b/net/bridge/br_netfilter.c @@ -173,9 +173,13 @@ static inline struct rtable *bridge_parent_rtable(const struct net_device *dev) static inline struct net_device *bridge_parent(const struct net_device *dev) { struct net_bridge_port *port; + struct net_device *parent; port = br_port_get_rcu(dev); - return port ? port->br->dev : NULL; + parent = port ? port->br->dev : NULL; + if (parent && !(parent->flags & IFF_UP)) + parent = NULL; + return parent; } static inline struct nf_bridge_info *nf_bridge_alloc(struct sk_buff *skb) @@ -510,6 +514,8 @@ static struct net_device *brnf_get_logical_dev(struct sk_buff *skb, const struct struct net_device *vlan, *br; br = bridge_parent(dev); + if (!br) + return NULL; if (brnf_pass_vlan_indev == 0 || !vlan_tx_tag_present(skb)) return br; @@ -748,7 +754,7 @@ static unsigned int br_nf_forward_ip(unsigned int hook, struct sk_buff *skb, int (*okfn)(struct sk_buff *)) { struct nf_bridge_info *nf_bridge; - struct net_device *parent; + struct net_device *parent, *ldev; u_int8_t pf; if (!skb->nf_bridge) @@ -789,8 +795,11 @@ static unsigned int br_nf_forward_ip(unsigned int hook, struct sk_buff *skb, else skb->protocol = htons(ETH_P_IPV6); - NF_HOOK(pf, NF_INET_FORWARD, skb, brnf_get_logical_dev(skb, in), parent, - br_nf_forward_finish); + ldev = brnf_get_logical_dev(skb, in); + if (!ldev) + return NF_DROP; + + NF_HOOK(pf, NF_INET_FORWARD, skb, ldev, parent, br_nf_forward_finish); return NF_STOLEN; } @@ -861,12 +870,13 @@ static unsigned int br_nf_post_routing(unsigned int hook, struct sk_buff *skb, int (*okfn)(struct sk_buff *)) { struct nf_bridge_info *nf_bridge = skb->nf_bridge; - struct net_device *realoutdev = bridge_parent(skb->dev); + struct net_device *realoutdev; u_int8_t pf; if (!nf_bridge || !(nf_bridge->mask & BRNF_BRIDGED)) return NF_ACCEPT; + realoutdev = bridge_parent(skb->dev); if (!realoutdev) return NF_DROP; ^ permalink raw reply related [flat|nested] 4+ messages in thread
* Re: Bridged networking panics 2012-07-04 13:24 ` Eric Dumazet @ 2012-07-04 13:50 ` Massimo Cetra 0 siblings, 0 replies; 4+ messages in thread From: Massimo Cetra @ 2012-07-04 13:50 UTC (permalink / raw) To: Eric Dumazet; +Cc: Massimo Cetra, netdev, linux-kernel On 04/07/2012 15:24, Eric Dumazet wrote: > Posting a bug report is not enough to get people working for free on the > problem. Thanks for the reply. I'd like to point out that without a reply of what is need of what i'm doing wrong i cannot provide anything useful. > Apparently your configuration is kind of special if nobody but you hits > the problem so often. > So it would help if you can reproduce the bug using current kernel and > provide all necessary steps to reproduce the bug. Ideally a script.sh > file doing all the configuration you use to trigger the bug, assuming > a basic machine freshly booted with no special config already done. I can try to setup a fresh KVM image and see if the bug is reproduceable there. Would it be ok ? > The panics dont happen in the bridge code itself, but in the > BRIDGE_NETFILTER one. Do you need it, and why ? > > Are you using vlans ? No, no VLANS. I have 2 real network cards (Broadcom Corporation NetXtreme II BCM5716) configured as bridges. Each bridge (br0 and br1) has an ip address which is fixed (does never change). The server(s) run KVM machines which are attached to tun interfaces (created with "vde_tunctl -u $user -t $IFACE) Each virtual KVM server has an IP address that is forwarded through the bridge and has as gateway the router of the main server. Up to this point there is nothing strange in the configuration and if the system is used this way, there are no panics. The (maybe) peculiar configs are: 1) heartbeat is installed and creates alias interfaces for the bridge and assigns them an IP address. So the server has br0:1 and br1:1 that are associated with a couple of IP addresses. 2) the server runs ipvs (to redirect HTTP requests to two KVM servers that are natted behind the br0:1 br1:1 addresses). IF i remove the br0:1 and br1:1 interfaces (that are configured with the ip addresses used by IPVS i don't have any single problem and the crash (at least with 3.2.21) doesn't happen. So, if i turn off heartbeat (and the alias ip addresses used by IPVSare switched to the other host) there are no panics. The more the traffic, the quicker the panic happens. Note that up to 2.6.36 this configuration was working without problems. Ah, the last setting that i modified is disabling tcp_sack in sysctl.conf. > Please try following patch I will try on the latest 3.2.y for now, trying to replicate the problem. Thanks again, MC ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2012-07-04 13:50 UTC | newest] Thread overview: 4+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2012-06-28 13:57 Bridged networking panics Massimo Cetra 2012-07-04 10:42 ` Massimo Cetra 2012-07-04 13:24 ` Eric Dumazet 2012-07-04 13:50 ` Massimo Cetra
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).