From mboxrd@z Thu Jan 1 00:00:00 1970 From: dann frazier Subject: [bisect] 3.18 oops in tcp_v4_send_reset() Date: Tue, 9 Dec 2014 09:00:50 -0700 Message-ID: <20141209160023.GA31520@fluid.dannf> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: Eric Dumazet , Alexander Duyck , "David S. Miller" To: netdev@vger.kernel.org Return-path: Received: from complete.lackof.org ([198.49.126.79]:50351 "EHLO complete.lackof.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754242AbaLIQGZ (ORCPT ); Tue, 9 Dec 2014 11:06:25 -0500 Content-Disposition: inline Sender: netdev-owner@vger.kernel.org List-ID: I'm observing a very reproducible oops which I have bisected down to commit ca777ef: tcp: remove dst refcount false sharing for prequeue mode I'm reproducing using the juju application, and this occurs when tearing down a local lxc container (juju bootstrap/juju destroy-environment local). Also worth noting that I'm on an arm64 system. I'll follow up w/ results once I've attempted to reproduce on x86, and if I'm able to create a simpler reproducer. [ 540.914174] Unable to handle kernel NULL pointer dereference at virtual address 00000018 [ 540.922254] pgd = ffffffc3ea9bb000 [ 540.925646] [00000018] *pgd=00000043e7bfb003, *pud=00000043e7bfb003, *pmd=0000000000000000 [ 540.933902] Internal error: Oops: 96000006 [#1] SMP [ 540.938754] Modules linked in: veth xt_CHECKSUM xt_tcpudp iptable_mangle ipt_MASQUERADE nf_nat_masquerade_ipv4 iptable_nat nf _conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat nf_conntrack bridge stp llc ip_tables x_tables ahci_xgene libahci_platform lib ahci xgene_enet [ 540.962592] CPU: 4 PID: 2788 Comm: mongod Not tainted 3.18.0 #65 [ 540.968566] task: ffffffc0fe45d400 ti: ffffffc3e6510000 task.ti: ffffffc3e6510000 [ 540.976014] PC is at tcp_v4_send_reset+0x2ec/0x3e4 [ 540.980778] LR is at tcp_v4_send_reset+0x3c8/0x3e4 [ 540.985542] pc : [] lr : [] pstate: 80000145 [ 540.992897] sp : ffffffc3e6513a60 [ 540.996192] x29: ffffffc3e6513a60 x28: ffffffc3e7a8c600 [ 541.001494] x27: 0000000000000000 x26: ffffffc3e6510000 [ 541.006796] x25: 0000000000000000 x24: ffffffc3e6513ab8 [ 541.012099] x23: 0000000000000000 x22: 0000000000000000 [ 541.017401] x21: ffffffc3e7a8c600 x20: ffffffc000b65000 [ 541.022703] x19: ffffffc3e655e6e0 x18: 000000000000000d [ 541.028005] x17: 0000007fb2735e10 x16: ffffffc00012052c [ 541.033306] x15: 0000007fb2728590 x14: 282039363638333a [ 541.038608] x13: 0000000062df7dbf x12: 206e6f697463656e [ 541.043910] x11: 0000000000000000 x10: 0000000000000000 [ 541.049212] x9 : 00000000000012d1 x8 : 00000000000346db [ 541.054515] x7 : 0000000000000018 x6 : 0000000000000014 [ 541.059817] x5 : ffffffc3e6513ae0 x4 : 0000000000000000 [ 541.065118] x3 : ffffffc0fe6d70ac x2 : ffffffc3e655e71c [ 541.070420] x1 : ffffffc3e655e6e0 x0 : 00000000000000ac [ 541.075722] [ 541.077202] Process mongod (pid: 2788, stack limit = 0xffffffc3e6510058) [ 541.083868] Stack: (0xffffffc3e6513a60 to 0xffffffc3e6514000) [ 541.089585] 3a60: e6513b20 ffffffc3 0069bc08 ffffffc0 e655e6e0 ffffffc3 e7a8c600 ffffffc3 [ 541.097720] 3a80: 00000000 00000000 00000001 00000000 009be3c0 ffffffc0 e7a8cacc ffffffc3 [ 541.105855] 3aa0: e7a8c690 ffffffc3 e7a8c600 ffffffc3 00000000 00000000 bccb9990 bf7ddf62 [ 541.113990] 3ac0: 00000000 00000450 00000000 00000000 00000000 00000000 00000000 00000000 [ 541.122124] 3ae0: e6513ab8 ffffffc3 00000014 00000000 00000000 02001afe 00000008 00000000 [ 541.130259] 3b00: 00000000 00000000 00628130 ffffffc0 e6513b40 ffffffc3 dc8cb000 cb88537f [ 541.138394] 3b20: e6513b80 ffffffc3 00686ff4 ffffffc0 e7a8c600 ffffffc3 e7a8cb08 ffffffc3 [ 541.146528] 3b40: 00000000 00000000 00000001 00000000 009be3c0 ffffffc0 e7a8cacc ffffffc3 [ 541.154662] 3b60: 00000000 00000000 00628130 ffffffc0 e7a8c600 ffffffc3 00000000 00000000 [ 541.162797] 3b80: e6513ba0 ffffffc3 006880d0 ffffffc0 00000000 00000000 00000005 00000000 [ 541.170931] 3ba0: e6513c50 ffffffc3 006b1f14 ffffffc0 e6513d20 ffffffc3 e6513de8 ffffffc3 [ 541.179066] 3bc0: 00000000 00000000 e6513de8 ffffffc3 efc54f00 ffffffc3 00000005 00000000 [ 541.187200] 3be0: 00000119 00000000 0000003f 00000000 00ab8000 ffffffc0 e6510000 ffffffc3 [ 541.195335] 3c00: efc54f00 ffffffc3 0000003d 00000000 e6513ba0 ffffffc3 00000040 00000000 [ 541.203469] 3c20: e6513d20 ffffffc3 009be400 ffffffc0 92000007 00000000 fe45d400 ffffffc0 [ 541.211604] 3c40: eb2fc7e0 ffffffc3 ffffffff 7fffffff e6513ca0 ffffffc3 006241ac ffffffc0 [ 541.219738] 3c60: 00000005 00000000 e6513d20 ffffffc3 e6513ca0 ffffffc3 efc54f00 ffffffc3 [ 541.227873] 3c80: 00000005 00000000 ffffffff 00000000 e6513d20 ffffffc3 00000005 00000000 [ 541.236009] 3ca0: e6513d60 ffffffc3 0062421c ffffffc0 e6513de8 ffffffc3 e99e1d00 ffffffc3 [ 541.244144] 3cc0: 00000005 00000000 18006fe3 0000007f 80000000 00000000 00000015 00000000 [ 541.252278] 3ce0: e6513ec8 ffffffc3 e99e1d00 ffffffc3 0000003d 00000000 00000000 00000005 [ 541.260413] 3d00: efc54f00 ffffffc3 00000015 00000000 00000000 00000000 e6513d20 ffffffc3 [ 541.268547] 3d20: 00000000 00000000 00000000 ffffffc3 e6513dd8 ffffffc3 00000001 00000000 [ 541.276682] 3d40: 00000000 00000000 00000000 00000000 00000000 00000000 e6513de8 ffffffc3 [ 541.284817] 3d60: e6513da0 ffffffc3 002006c0 ffffffc0 e6513ec8 ffffffc3 00364ea0 ffffffc0 [ 541.292952] 3d80: e99e1d00 ffffffc3 e6513dd8 ffffffc3 00000001 00000000 00000000 00000000 [ 541.301086] 3da0: e6513e40 ffffffc3 00201294 ffffffc0 00000005 00000000 e99e1d00 ffffffc3 [ 541.309221] 3dc0: 18006fe3 0000007f e6513ec8 ffffffc3 e6513e00 ffffffc3 18006fe3 0000007f [ 541.317355] 3de0: 00000005 00000000 e99e1d00 ffffffc3 00000000 00000000 00000000 00000000 [ 541.325490] 3e00: e6513ce8 ffffffc3 fe45d400 ffffffc0 00000000 00000000 00000000 00000000 [ 541.333624] 3e20: 00000005 00000000 00000000 00000000 00000000 00000000 00000000 00000000 [ 541.341758] 3e40: e6513e80 ffffffc3 00201c38 ffffffc0 e99e1d01 ffffffc3 e99e1d00 ffffffc3 [ 541.349893] 3e60: ffffffff ffffffff b273b864 0000007f 80000000 00000000 b2737188 0000007f [ 541.358027] 3e80: 841faef0 0000007f 0008425c ffffffc0 00000000 00000000 00000005 00000000 [ 541.366162] 3ea0: ffffffff ffffffff 00000001 00000000 18006fe3 0000007f 00000005 00000000 [ 541.374296] 3ec0: 00000000 00000000 00000000 00000000 00000024 00000000 18006fe3 0000007f [ 541.382431] 3ee0: 00000005 00000000 841fbeb8 0000007f 841faeac 0000007f 841fc4a0 0000007f [ 541.390565] 3f00: ffffffbb 00000000 00000000 00000000 0000003f 00000000 93ccf8ed 00e370ef [ 541.398700] 3f20: 0000009e 00000000 00000070 00000000 93ccf8ed 000000ef 00000009 00000000 [ 541.406834] 3f40: 0000009b 00000000 00000095 00000000 00000000 00000000 b273b810 0000007f [ 541.414968] 3f60: 000000aa 00000000 180016b0 0000007f 00000005 00000000 18006fe3 0000007f [ 541.423103] 3f80: 00000005 00000000 00000005 00000000 18006fe3 0000007f 00000000 00000000 [ 541.431237] 3fa0: 841fc900 0000007f 0000feff 00000000 180012e0 0000007f 841faef0 0000007f [ 541.439372] 3fc0: b273b84c 0000007f 841faee0 0000007f b273b864 0000007f 80000000 00000000 [ 541.447506] 3fe0: 00000024 00000000 0000003f 00000000 ed238e70 ffffffbe ed238ea8 ffffffbe [ 541.455640] Call trace: [ 541.458074] [] tcp_v4_send_reset+0x2ec/0x3e4 [ 541.463877] [] tcp_v4_do_rcv+0xfc/0x350 [ 541.469247] [] tcp_prequeue_process+0x98/0xdc [ 541.475134] [] tcp_recvmsg+0x4c8/0xa0c [ 541.480419] [] inet_recvmsg+0x98/0xb4 [ 541.485618] [] sock_aio_read.part.12+0xf0/0x118 [ 541.491679] [] sock_aio_read+0x48/0x74 [ 541.496964] [] do_sync_read+0x8c/0xd0 [ 541.502161] [] vfs_read+0x128/0x1a8 [ 541.507185] [] SyS_read+0x50/0xb0 [ 541.512037] Code: 927ff884 b9408ba6 910203a5 8b000063 (f9400c80) [ 541.518108] ---[ end trace 524a277a323ba5bd ]---