From mboxrd@z Thu Jan 1 00:00:00 1970 From: Dave Jones Subject: decnet triggered lockup Date: Sat, 15 Jun 2013 14:49:08 -0400 Message-ID: <20130615184908.GB19439@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii To: netdev@vger.kernel.org Return-path: Received: from mx1.redhat.com ([209.132.183.28]:35806 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754213Ab3FOStQ (ORCPT ); Sat, 15 Jun 2013 14:49:16 -0400 Received: from int-mx10.intmail.prod.int.phx2.redhat.com (int-mx10.intmail.prod.int.phx2.redhat.com [10.5.11.23]) by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id r5FInFNe007585 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK) for ; Sat, 15 Jun 2013 14:49:15 -0400 Received: from gelk.kernelslacker.org (ovpn-113-67.phx2.redhat.com [10.3.113.67]) by int-mx10.intmail.prod.int.phx2.redhat.com (8.14.4/8.14.4) with ESMTP id r5FIn9Pf003469 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO) for ; Sat, 15 Jun 2013 14:49:15 -0400 Received: from gelk.kernelslacker.org (localhost [127.0.0.1]) by gelk.kernelslacker.org (8.14.7/8.14.5) with ESMTP id r5FIn942019704 for ; Sat, 15 Jun 2013 14:49:09 -0400 Received: (from davej@localhost) by gelk.kernelslacker.org (8.14.7/8.14.7/Submit) id r5FIn8Bg019703 for netdev@vger.kernel.org; Sat, 15 Jun 2013 14:49:08 -0400 Content-Disposition: inline Sender: netdev-owner@vger.kernel.org List-ID: Mistakenly left CONFIG_DECNET enabled, and got this followed by a total lockup. BUG: soft lockup - CPU#1 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 3487531 hardirqs last enabled at (3487530): [] restore_args+0x0/0x30 hardirqs last disabled at (3487531): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (3153202): [] __do_softirq+0x194/0x440 softirqs last disabled at (3153209): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irqrestore+0x67/0x80 RSP: 0018:ffff880244a03d90 EFLAGS: 00000286 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000002 RDX: 0000000000004340 RSI: ffff8801684fd1f8 RDI: ffff8801684fca40 RBP: ffff880244a03da0 R08: 0000000010000103 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03d08 R13: ffffffff816f5cef R14: ffff880244a03da0 R15: ffff8802432ec000 FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000003850abc720 CR3: 000000022c843000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff880219ec0de8 ffff8802432ec000 ffff880244a03de0 ffffffff8105dc39 0000000000000286 ffff880219ec09c0 ffff880219ec0a10 0000000010000101 ffffffffa04c21d0 ffff880219ec09c0 ffff880244a03df8 ffffffff81594a88 Call Trace: [] mod_timer+0x119/0x320 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] sk_reset_timer+0x18/0x30 [] dn_slow_timer+0x7c/0x110 [decnet] [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? free_hot_cold_page+0xff/0x180 [] __free_pages+0x47/0x70 [] free_pages+0x51/0x60 [] pgd_free+0x53/0x60 [] __mmdrop+0x29/0xb0 [] finish_task_switch+0xfd/0x130 [] ? finish_task_switch+0x47/0x130 [] __schedule+0x444/0x9c0 [] preempt_schedule_irq+0x53/0x90 [] ? release_sock+0x193/0x1f0 [] retint_kernel+0x26/0x30 [] ? local_bh_enable_ip+0x82/0xf0 [] _raw_spin_unlock_bh+0x3a/0x40 [] release_sock+0x193/0x1f0 [] llcp_sock_listen+0x71/0xd0 [nfc] [] SyS_listen+0x85/0x90 [] tracesys+0xdd/0xe2 Code: 00 e8 9e 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff a8 08 75 13 5b 41 5c 5d c3 0f 1f 44 00 00 e8 fb ad 9c ff 53 9d cf 0f 1f 80 00 00 00 00 e8 bb ea ff ff eb df 66 0f 1f 84 00 BUG: soft lockup - CPU#1 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 4605143 hardirqs last enabled at (4605142): [] restore_args+0x0/0x30 hardirqs last disabled at (4605143): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (4331570): [] __do_softirq+0x194/0x440 softirqs last disabled at (4331581): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 RSP: 0018:ffff880244a03dc0 EFLAGS: 00000246 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000010e00000 RDX: ffffffff8216fe60 RSI: 0000000000000000 RDI: ffffffffef200438 RBP: ffff880244a03e18 R08: ffff8801684fd1c0 R09: 0000000000000001 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03d38 R13: ffffffff816f5cef R14: ffff880244a03e18 R15: 0000000000000000 FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000003850abc720 CR3: 000000022c843000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: 0000000000000000 ffffffff8105c9e5 ffff880200000000 0000000000000246 0000000000000002 ffff880244a03e30 ffff8802432ec000 ffff88022a4c5228 0000000010000102 ffffffffa04c21d0 ffff88022a4c4e00 ffff880244a03e88 Call Trace: [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] call_timer_fn+0x7f/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? _raw_spin_unlock_irqrestore+0x67/0x80 [] __slab_free+0x5f/0x39f [] ? _raw_spin_unlock_irqrestore+0x75/0x80 [] ? debug_check_no_obj_freed+0x14e/0x250 [] ? kmem_cache_free+0x95/0x300 [] kmem_cache_free+0x2ec/0x300 [] ? __mmdrop+0x72/0xb0 [] __mmdrop+0x72/0xb0 [] finish_task_switch+0xfd/0x130 [] ? finish_task_switch+0x47/0x130 [] __schedule+0x444/0x9c0 [] preempt_schedule_irq+0x53/0x90 [] ? release_sock+0x193/0x1f0 [] retint_kernel+0x26/0x30 [] ? local_bh_enable_ip+0x82/0xf0 [] _raw_spin_unlock_bh+0x3a/0x40 [] release_sock+0x193/0x1f0 [] llcp_sock_listen+0x71/0xd0 [nfc] [] SyS_listen+0x85/0x90 [] tracesys+0xdd/0xe2 Code: 49 c1 e9 09 48 89 44 24 08 49 83 f1 01 41 83 e1 01 e8 5f dd ff ff 65 48 8b 04 25 00 ba 00 00 c7 80 7c 07 00 00 00 00 00 00 53 9d <48> 83 c4 30 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 00 65 48 8b BUG: soft lockup - CPU#1 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 10864695 hardirqs last enabled at (10864694): [] restore_args+0x0/0x30 hardirqs last disabled at (10864695): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (9770178): [] __do_softirq+0x194/0x440 softirqs last disabled at (9770181): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244a03e80 EFLAGS: 00000202 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000001 RBP: ffff880244a03e88 R08: 0000000010000101 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03df8 R13: ffffffff816f5cef R14: ffff880244a03e88 R15: ffff88020232ab28 FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 000000022c843000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff8802432ec000 ffff880244a03ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88020232a700 ffff8801f23b34e8 ffff88020a54c868 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? wait_for_completion_interruptible+0x180/0x180 [] ? preempt_schedule_irq+0x53/0x90 [] retint_kernel+0x26/0x30 [] ? user_enter+0x87/0xd0 [] syscall_trace_leave+0x78/0x140 [] int_check_syscall_exit_work+0x34/0x3d Code: 01 00 00 00 48 89 e5 53 48 89 fb 48 8b 55 08 48 8d 7f 18 e8 01 d8 9c ff 48 89 df e8 19 55 c2 ff e8 b4 ad 9c ff fb bf 01 00 00 00 29 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff BUG: soft lockup - CPU#1 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 18101305 hardirqs last enabled at (18101304): [] restore_args+0x0/0x30 hardirqs last disabled at (18101305): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (17715300): [] __do_softirq+0x194/0x440 softirqs last disabled at (17715303): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irqrestore+0x67/0x80 RSP: 0018:ffff880244a03d90 EFLAGS: 00000286 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000002 RDX: 0000000000004340 RSI: ffff8801684fd1f8 RDI: ffff8801684fca40 RBP: ffff880244a03da0 R08: 0000000010000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03d08 R13: ffffffff816f5cef R14: ffff880244a03da0 R15: ffff8802432ec000 FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 000000022c843000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff88018ca62168 ffff8802432ec000 ffff880244a03de0 ffffffff8105dc39 0000000000000286 ffff88018ca61d40 ffff88018ca61d90 0000000010000100 ffffffffa04c21d0 ffff88018ca61d40 ffff880244a03df8 ffffffff81594a88 Call Trace: [] mod_timer+0x119/0x320 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] sk_reset_timer+0x18/0x30 [] dn_slow_timer+0x7c/0x110 [decnet] [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? wait_for_completion_interruptible+0x180/0x180 [] ? preempt_schedule_irq+0x53/0x90 [] retint_kernel+0x26/0x30 [] ? user_enter+0x87/0xd0 [] syscall_trace_leave+0x78/0x140 [] int_check_syscall_exit_work+0x34/0x3d Code: 00 e8 9e 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff a8 08 75 13 5b 41 5c 5d c3 0f 1f 44 00 00 e8 fb ad 9c ff 53 9d cf 0f 1f 80 00 00 00 00 e8 bb ea ff ff eb df 66 0f 1f 84 00 BUG: soft lockup - CPU#1 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 30921163 hardirqs last enabled at (30921162): [] restore_args+0x0/0x30 hardirqs last disabled at (30921163): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (29829218): [] __do_softirq+0x194/0x440 softirqs last disabled at (29829621): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irqrestore+0x67/0x80 RSP: 0018:ffff880244a03d90 EFLAGS: 00000286 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000002 RDX: 0000000000004340 RSI: ffff8801684fd1f8 RDI: ffff8801684fca40 RBP: ffff880244a03da0 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03d08 R13: ffffffff816f5cef R14: ffff880244a03da0 R15: ffff8802432ec000 FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000003850abc720 CR3: 000000022c843000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff880219ec34e8 ffff8802432ec000 ffff880244a03de0 ffffffff8105dc39 0000000000000286 ffff880219ec30c0 ffff880219ec3110 0000000000000100 ffffffffa04c21d0 ffff880219ec30c0 ffff880244a03df8 ffffffff81594a88 Call Trace: [] mod_timer+0x119/0x320 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] sk_reset_timer+0x18/0x30 [] dn_slow_timer+0x7c/0x110 [decnet] [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? user_enter+0x87/0xd0 [] syscall_trace_leave+0x78/0x140 [] int_check_syscall_exit_work+0x34/0x3d Code: 00 e8 9e 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff a8 08 75 13 5b 41 5c 5d c3 0f 1f 44 00 00 e8 fb ad 9c ff 53 9d cf 0f 1f 80 00 00 00 00 e8 bb ea ff ff eb df 66 0f 1f 84 00 BUG: soft lockup - CPU#1 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 36540201 hardirqs last enabled at (36540200): [] restore_args+0x0/0x30 hardirqs last disabled at (36540201): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (36329390): [] __do_softirq+0x194/0x440 softirqs last disabled at (36329393): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244a03e80 EFLAGS: 00000216 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000001 RBP: ffff880244a03e88 R08: 0000000010000101 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03df8 R13: ffffffff816f5cef R14: ffff880244a03e88 R15: ffff880184d8ef68 FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 000000022c843000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff8802432ec000 ffff880244a03ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff880184d8eb40 ffff880184d8e5a8 ffff88020232ef68 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? wait_for_completion_interruptible+0x180/0x180 [] ? preempt_schedule_irq+0x53/0x90 [] retint_kernel+0x26/0x30 [] ? user_enter+0x87/0xd0 [] syscall_trace_leave+0x78/0x140 [] int_check_syscall_exit_work+0x34/0x3d Code: 01 00 00 00 48 89 e5 53 48 89 fb 48 8b 55 08 48 8d 7f 18 e8 01 d8 9c ff 48 89 df e8 19 55 c2 ff e8 b4 ad 9c ff fb bf 01 00 00 00 29 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff BUG: soft lockup - CPU#0 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 42158897 hardirqs last enabled at (42158896): [] restore_args+0x0/0x30 hardirqs last disabled at (42158897): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (41212430): [] __do_softirq+0x194/0x440 softirqs last disabled at (41212433): [] irq_exit+0xcd/0xe0 CPU: 0 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244803e80 EFLAGS: 00000206 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000001 RBP: ffff880244803e88 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244803df8 R13: ffffffff816f5cef R14: ffff880244803e88 R15: ffff88020236e5a8 FS: 00007fbed31ba740(0000) GS:ffff880244800000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 000000023cbdd000 CR4: 00000000001407f0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffffffff820fe240 ffff880244803ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88020236e180 ffff88022a4c17a8 ffff8802023fc868 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irqrestore+0x67/0x80 [] debug_check_no_obj_freed+0x14e/0x250 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] free_pages_prepare+0x193/0x2a0 [] free_compound_page+0x29/0x40 [] __put_compound_page+0x1f/0x30 [] put_compound_page+0x55/0x200 [] release_pages+0x1cf/0x1e0 [] free_pages_and_swap_cache+0xad/0xd0 [] tlb_flush_mmu.part.69+0x4c/0x90 [] tlb_finish_mmu+0x55/0x60 [] exit_mmap+0xf0/0x170 [] mmput+0x6f/0x100 [] do_exit+0x27c/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 01 00 00 00 48 89 e5 53 48 89 fb 48 8b 55 08 48 8d 7f 18 e8 01 d8 9c ff 48 89 df e8 19 55 c2 ff e8 b4 ad 9c ff fb bf 01 00 00 00 29 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff BUG: soft lockup - CPU#0 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 43337155 hardirqs last enabled at (43337154): [] restore_args+0x0/0x30 hardirqs last disabled at (43337155): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (42835484): [] __do_softirq+0x194/0x440 softirqs last disabled at (42835487): [] irq_exit+0xcd/0xe0 CPU: 0 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] lock_acquire+0xa6/0x1f0 RSP: 0018:ffff880244803d78 EFLAGS: 00000246 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000021c10cc0000 RDX: ffffffff8216fe80 RSI: 0000000000000038 RDI: fffffde3efbb0433 RBP: ffff880244803dd0 R08: ffff8801684fd1f8 R09: 0000000000000001 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244803ce8 R13: ffffffff816f5cef R14: ffff880244803dd0 R15: 0000000000000000 FS: 00007fbed31ba740(0000) GS:ffff880244800000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 000000023cbdd000 CR4: 00000000001407f0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: 0000000000000000 ffffffffa04c21eb 0000000000000000 0000000000000246 0000000000000000 ffff8801f23b13e8 ffff8801f23b13d0 ffff8801f23b13e8 0000000000000101 ffffffffa04c21d0 ffff8801f23b1380 ffff880244803df8 Call Trace: [] ? dn_slow_timer+0x1b/0x110 [decnet] [] ? dn_neigh_elist+0x40/0x40 [decnet] [] _raw_spin_lock+0x40/0x80 [] ? dn_slow_timer+0x1b/0x110 [decnet] [] dn_slow_timer+0x1b/0x110 [decnet] [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irqrestore+0x67/0x80 [] debug_check_no_obj_freed+0x14e/0x250 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] free_pages_prepare+0x193/0x2a0 [] free_compound_page+0x29/0x40 [] __put_compound_page+0x1f/0x30 [] put_compound_page+0x55/0x200 [] release_pages+0x1cf/0x1e0 [] free_pages_and_swap_cache+0xad/0xd0 [] tlb_flush_mmu.part.69+0x4c/0x90 [] tlb_finish_mmu+0x55/0x60 [] exit_mmap+0xf0/0x170 [] mmput+0x6f/0x100 [] do_exit+0x27c/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 49 c1 e9 09 48 89 44 24 08 49 83 f1 01 41 83 e1 01 e8 5f dd ff ff 65 48 8b 04 25 00 ba 00 00 c7 80 7c 07 00 00 00 00 00 00 53 9d <48> 83 c4 30 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 00 65 48 8b BUG: soft lockup - CPU#1 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 44507153 hardirqs last enabled at (44507152): [] restore_args+0x0/0x30 hardirqs last disabled at (44507153): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (43774438): [] __do_softirq+0x194/0x440 softirqs last disabled at (43774441): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244a03e80 EFLAGS: 00000202 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000001 RBP: ffff880244a03e88 R08: 0000000010000103 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03df8 R13: ffffffff816f5cef R14: ffff880244a03e88 R15: ffff88017796a168 FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff8802432ec000 ffff880244a03ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff880177969d40 ffff8802023f8428 ffff880219ec34e8 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irq+0x32/0x60 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] finish_task_switch+0x85/0x130 [] ? finish_task_switch+0x47/0x130 [] __schedule+0x444/0x9c0 [] preempt_schedule+0x44/0x60 [] _raw_spin_unlock_irqrestore+0x75/0x80 [] debug_check_no_obj_freed+0x14e/0x250 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] free_pages_prepare+0x193/0x2a0 [] free_compound_page+0x29/0x40 [] __put_compound_page+0x1f/0x30 [] put_compound_page+0x55/0x200 [] release_pages+0x1cf/0x1e0 [] free_pages_and_swap_cache+0xad/0xd0 [] tlb_flush_mmu.part.69+0x4c/0x90 [] tlb_finish_mmu+0x55/0x60 [] exit_mmap+0xf0/0x170 [] mmput+0x6f/0x100 [] do_exit+0x27c/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 01 00 00 00 48 89 e5 53 48 89 fb 48 8b 55 08 48 8d 7f 18 e8 01 d8 9c ff 48 89 df e8 19 55 c2 ff e8 b4 ad 9c ff fb bf 01 00 00 00 29 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff BUG: soft lockup - CPU#1 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 45673559 hardirqs last enabled at (45673558): [] restore_args+0x0/0x30 hardirqs last disabled at (45673559): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (43774438): [] __do_softirq+0x194/0x440 softirqs last disabled at (43774441): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] rcu_lockdep_current_cpu_online+0x66/0xa0 RSP: 0018:ffff880244a03b50 EFLAGS: 00000202 RAX: ffff880244bcdd80 RBX: ffffffff816ed1e0 RCX: 0000000000000001 RDX: 000000000000000f RSI: 0000000010000104 RDI: 0000000000000001 RBP: ffff880244a03b58 R08: 0000000010000104 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03ac8 R13: ffffffff816f5cef R14: ffff880244a03b58 R15: ffffffffa01b287d FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffffffffa01e0568 ffff880244a03b80 ffffffff810c4de5 ffffffffa01e0568 ffffffffa01b287d ffff880244a03fc0 ffff880244a03b98 ffffffff810c4e52 ffffffffa01b287d ffff880244a03bb0 ffffffff810c96cf ffffffffa01b287d Call Trace: [] __module_address+0xd5/0x130 [] ? e1000e_poll+0x6d/0x310 [e1000e] [] __module_text_address+0x12/0x60 [] ? e1000e_poll+0x6d/0x310 [e1000e] [] is_module_text_address+0x1f/0x60 [] ? e1000e_poll+0x6d/0x310 [e1000e] [] __kernel_text_address+0x58/0x80 [] ? e1000e_poll+0x6d/0x310 [e1000e] [] print_context_stack+0x8f/0x100 [] dump_trace+0x12d/0x2f0 [] ? trace_hardirqs_on_caller+0xa7/0x1c0 [] save_stack_trace+0x2b/0x50 [] dma_entry_alloc+0x59/0x90 [] debug_dma_map_page+0x91/0x140 [] e1000_alloc_rx_buffers+0x1ab/0x2c0 [e1000e] [] e1000_clean_rx_irq+0x2a6/0x440 [e1000e] [] e1000e_poll+0x6d/0x310 [e1000e] [] net_rx_action+0x16a/0x370 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irq+0x32/0x60 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] finish_task_switch+0x85/0x130 [] ? finish_task_switch+0x47/0x130 [] __schedule+0x444/0x9c0 [] preempt_schedule+0x44/0x60 [] _raw_spin_unlock_irqrestore+0x75/0x80 [] debug_check_no_obj_freed+0x14e/0x250 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] free_pages_prepare+0x193/0x2a0 [] free_compound_page+0x29/0x40 [] __put_compound_page+0x1f/0x30 [] put_compound_page+0x55/0x200 [] release_pages+0x1cf/0x1e0 [] free_pages_and_swap_cache+0xad/0xd0 [] tlb_flush_mmu.part.69+0x4c/0x90 [] tlb_finish_mmu+0x55/0x60 [] exit_mmap+0xf0/0x170 [] mmput+0x6f/0x100 [] do_exit+0x27c/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 01 6f 21 00 48 c7 c3 80 dd 1c 00 89 c0 48 03 1c c5 80 50 cf 81 48 8b 53 18 48 89 d8 bb 01 00 00 00 48 8b 52 68 48 85 50 20 74 2a 01 00 00 00 e8 10 48 5f 00 65 48 8b 04 25 f0 b9 00 00 48 8b BUG: soft lockup - CPU#0 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 47896723 hardirqs last enabled at (47896722): [] restore_args+0x0/0x30 hardirqs last disabled at (47896723): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (46750802): [] __do_softirq+0x194/0x440 softirqs last disabled at (46750805): [] irq_exit+0xcd/0xe0 CPU: 0 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244803e80 EFLAGS: 00000202 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000001 RBP: ffff880244803e88 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244803df8 R13: ffffffff816f5cef R14: ffff880244803e88 R15: ffff8801ddd54868 FS: 00007fbed31ba740(0000) GS:ffff880244800000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 000000023cbdd000 CR4: 00000000001407f0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffffffff820fe240 ffff880244803ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff8801ddd54440 ffff88022a4c34e8 ffff88016872f928 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irqrestore+0x67/0x80 [] debug_check_no_obj_freed+0x14e/0x250 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] free_pages_prepare+0x193/0x2a0 [] free_compound_page+0x29/0x40 [] __put_compound_page+0x1f/0x30 [] put_compound_page+0x55/0x200 [] release_pages+0x1cf/0x1e0 [] free_pages_and_swap_cache+0xad/0xd0 [] tlb_flush_mmu.part.69+0x4c/0x90 [] tlb_finish_mmu+0x55/0x60 [] exit_mmap+0xf0/0x170 [] mmput+0x6f/0x100 [] do_exit+0x27c/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 01 00 00 00 48 89 e5 53 48 89 fb 48 8b 55 08 48 8d 7f 18 e8 01 d8 9c ff 48 89 df e8 19 55 c2 ff e8 b4 ad 9c ff fb bf 01 00 00 00 29 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff BUG: soft lockup - CPU#0 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 49079765 hardirqs last enabled at (49079764): [] restore_args+0x0/0x30 hardirqs last disabled at (49079765): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (48511516): [] __do_softirq+0x194/0x440 softirqs last disabled at (48511519): [] irq_exit+0xcd/0xe0 CPU: 0 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244803e80 EFLAGS: 00000206 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000001 RBP: ffff880244803e88 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244803df8 R13: ffffffff816f5cef R14: ffff880244803e88 R15: ffff880184d8d228 FS: 00007fbed31ba740(0000) GS:ffff880244800000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 000000023cbdd000 CR4: 00000000001407f0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffffffff820fe240 ffff880244803ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff880184d8ce00 ffff8801ddd53ea8 ffff8801ddd53ea8 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irqrestore+0x67/0x80 [] debug_check_no_obj_freed+0x14e/0x250 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] free_pages_prepare+0x193/0x2a0 [] free_compound_page+0x29/0x40 [] __put_compound_page+0x1f/0x30 [] put_compound_page+0x55/0x200 [] release_pages+0x1cf/0x1e0 [] free_pages_and_swap_cache+0xad/0xd0 [] tlb_flush_mmu.part.69+0x4c/0x90 [] tlb_finish_mmu+0x55/0x60 [] exit_mmap+0xf0/0x170 [] mmput+0x6f/0x100 [] do_exit+0x27c/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 01 00 00 00 48 89 e5 53 48 89 fb 48 8b 55 08 48 8d 7f 18 e8 01 d8 9c ff 48 89 df e8 19 55 c2 ff e8 b4 ad 9c ff fb bf 01 00 00 00 29 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff BUG: soft lockup - CPU#1 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 53654177 hardirqs last enabled at (53654176): [] restore_args+0x0/0x30 hardirqs last disabled at (53654177): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (52893084): [] __do_softirq+0x194/0x440 softirqs last disabled at (52893087): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] __slab_alloc+0x45c/0x507 RSP: 0018:ffff880244a03af8 EFLAGS: 00000292 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff8801684fca40 RBP: ffff880244a03bc0 R08: 0000000000000001 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03a68 R13: ffffffff816f5cef R14: ffff880244a03bc0 R15: ffff88024085c300 FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffffffff8100a384 0000000000000006 ffff880244a03b30 ffffffff81091985 0000000000000006 0000000000000000 ffff88024085c300 00000002ffffffff ffffffff8158736a 0000002000000000 0000000000000292 ffffffff81091985 Call Trace: [] ? native_sched_clock+0x24/0x80 [] ? sched_clock_cpu+0xb5/0x100 [] ? alloc_iova_mem+0x1a/0x20 [] ? sched_clock_cpu+0xb5/0x100 [] kmem_cache_alloc+0x257/0x320 [] ? alloc_iova_mem+0x1a/0x20 [] alloc_iova_mem+0x1a/0x20 [] alloc_iova+0x2e/0x250 [] ? sched_clock_cpu+0xb5/0x100 [] intel_alloc_iova+0x95/0xd0 [] __intel_map_single+0x9b/0x1a0 [] ? __intel_map_single+0x1a0/0x1a0 [] intel_map_page+0x33/0x40 [] e1000_alloc_rx_buffers+0x167/0x2c0 [e1000e] [] e1000_clean_rx_irq+0x2ff/0x440 [e1000e] [] e1000e_poll+0x6d/0x310 [e1000e] [] net_rx_action+0x16a/0x370 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? wait_for_completion_interruptible+0x180/0x180 [] ? preempt_schedule_irq+0x53/0x90 [] retint_kernel+0x26/0x30 [] ? task_work_run+0x91/0xe0 [] ? exit_fs+0x78/0x90 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 24 50 00 02 00 00 49 c7 07 00 00 00 00 75 12 ff 74 24 50 9d e8 93 10 9d ff 4c 89 e0 e9 a6 00 00 00 e8 36 48 9d ff ff 74 24 50 9d <4c> 89 e0 e9 94 00 00 00 8b 74 24 4c 48 89 df e8 aa f1 ff ff 84 BUG: soft lockup - CPU#1 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 57087367 hardirqs last enabled at (57087366): [] restore_args+0x0/0x30 hardirqs last disabled at (57087367): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (55972350): [] __do_softirq+0x194/0x440 softirqs last disabled at (55972773): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244a03e80 EFLAGS: 00000216 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000001 RBP: ffff880244a03e88 R08: 0000000000000101 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03df8 R13: ffffffff816f5cef R14: ffff880244a03e88 R15: ffff88022a4c5228 FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff8802432ec000 ffff880244a03ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88022a4c4e00 ffff88022a4c2168 ffff88020236d228 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? __slab_alloc+0x45c/0x507 [] ? __debug_object_init+0x445/0x460 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] ? trace_hardirqs_on+0xd/0x10 [] kmem_cache_alloc+0x257/0x320 [] ? __debug_object_init+0x445/0x460 [] __debug_object_init+0x445/0x460 [] debug_object_init+0x1b/0x20 [] rcuhead_fixup_activate+0x2c/0xc0 [] debug_object_activate+0x121/0x1e0 [] ? shmem_destroy_inode+0x40/0x40 [] __call_rcu+0x3f/0x840 [] ? fsnotify_clear_marks_by_inode+0xa2/0x130 [] call_rcu+0x1d/0x20 [] shmem_destroy_inode+0x2d/0x40 [] destroy_inode+0x38/0x60 [] evict+0x10e/0x1a0 [] iput+0xf5/0x190 [] dput+0x208/0x2f0 [] __fput+0x198/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 01 00 00 00 48 89 e5 53 48 89 fb 48 8b 55 08 48 8d 7f 18 e8 01 d8 9c ff 48 89 df e8 19 55 c2 ff e8 b4 ad 9c ff fb bf 01 00 00 00 29 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff BUG: soft lockup - CPU#1 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 60135409 hardirqs last enabled at (60135408): [] restore_args+0x0/0x30 hardirqs last disabled at (60135409): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (59184328): [] __do_softirq+0x194/0x440 softirqs last disabled at (59184331): [] irq_exit+0xcd/0xe0 CPU: 1 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] __slab_alloc+0x45c/0x507 RSP: 0018:ffff880244a03af8 EFLAGS: 00000292 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffff8801684fca40 RBP: ffff880244a03bc0 R08: 0000000000000001 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244a03a68 R13: ffffffff816f5cef R14: ffff880244a03bc0 R15: ffff880234e8a000 FS: 00007fbed31ba740(0000) GS:ffff880244a00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00000000020ad8b8 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffffffff8100a384 0000000000000006 ffff880244a03b30 ffffffff81091985 0000000000000006 0000000000000000 ffff880234e8a000 00000002ffffffff ffffffff8158736a 0000002000000000 0000000000000292 ffffffff81091985 Call Trace: [] ? native_sched_clock+0x24/0x80 [] ? sched_clock_cpu+0xb5/0x100 [] ? alloc_iova_mem+0x1a/0x20 [] ? sched_clock_cpu+0xb5/0x100 [] kmem_cache_alloc+0x257/0x320 [] ? alloc_iova_mem+0x1a/0x20 [] alloc_iova_mem+0x1a/0x20 [] alloc_iova+0x2e/0x250 [] ? sched_clock_cpu+0xb5/0x100 [] intel_alloc_iova+0x95/0xd0 [] __intel_map_single+0x9b/0x1a0 [] ? __intel_map_single+0x1a0/0x1a0 [] intel_map_page+0x33/0x40 [] e1000_alloc_rx_buffers+0x167/0x2c0 [e1000e] [] e1000_clean_rx_irq+0x2ff/0x440 [e1000e] [] e1000e_poll+0x6d/0x310 [e1000e] [] net_rx_action+0x16a/0x370 [] ? fsnotify_clear_marks_by_inode+0xa2/0x130 [] __do_softirq+0xff/0x440 [] ? fsnotify_clear_marks_by_inode+0xa2/0x130 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? lock_release+0xb0/0x320 [] _raw_spin_unlock+0x1f/0x60 [] fsnotify_clear_marks_by_inode+0xa2/0x130 [] __fsnotify_inode_delete+0xe/0x10 [] __destroy_inode+0x2a/0xf0 [] destroy_inode+0x22/0x60 [] evict+0x10e/0x1a0 [] iput+0xf5/0x190 [] dput+0x208/0x2f0 [] __fput+0x198/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 24 50 00 02 00 00 49 c7 07 00 00 00 00 75 12 ff 74 24 50 9d e8 93 10 9d ff 4c 89 e0 e9 a6 00 00 00 e8 36 48 9d ff ff 74 24 50 9d <4c> 89 e0 e9 94 00 00 00 8b 74 24 4c 48 89 df e8 aa f1 ff ff 84 BUG: soft lockup - CPU#0 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 66190657 hardirqs last enabled at (66190656): [] restore_args+0x0/0x30 hardirqs last disabled at (66190657): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (65542138): [] __do_softirq+0x194/0x440 softirqs last disabled at (65542141): [] irq_exit+0xcd/0xe0 CPU: 0 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irqrestore+0x67/0x80 RSP: 0018:ffff880244803d90 EFLAGS: 00000286 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000002 RDX: 0000000000004340 RSI: ffff8801684fd1f8 RDI: ffff8801684fca40 RBP: ffff880244803da0 R08: 0000000000000103 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244803d08 R13: ffffffff816f5cef R14: ffff880244803da0 R15: ffffffff820fe240 FS: 00007fbed31ba740(0000) GS:ffff880244800000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407f0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff8801f23b0428 ffffffff820fe240 ffff880244803de0 ffffffff8105dc39 0000000000000286 ffff8801f23b0000 ffff8801f23b0050 0000000000000101 ffffffffa04c21d0 ffff8801f23b0000 ffff880244803df8 ffffffff81594a88 Call Trace: [] mod_timer+0x119/0x320 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] sk_reset_timer+0x18/0x30 [] dn_slow_timer+0x7c/0x110 [decnet] [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irqrestore+0x67/0x80 [] debug_object_activate+0x10a/0x1e0 [] ? get_max_files+0x20/0x20 [] __call_rcu+0x3f/0x840 [] ? get_parent_ip+0xd/0x50 [] ? sub_preempt_count+0x71/0x100 [] call_rcu+0x1d/0x20 [] __fput+0x190/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 00 e8 9e 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff a8 08 75 13 5b 41 5c 5d c3 0f 1f 44 00 00 e8 fb ad 9c ff 53 9d cf 0f 1f 80 00 00 00 00 e8 bb ea ff ff eb df 66 0f 1f 84 00 BUG: soft lockup - CPU#3 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 69303803 hardirqs last enabled at (69303802): [] restore_args+0x0/0x30 hardirqs last disabled at (69303803): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (67857358): [] __do_softirq+0x194/0x440 softirqs last disabled at (67857361): [] irq_exit+0xcd/0xe0 CPU: 3 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244e03e80 EFLAGS: 00000206 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000001 RBP: ffff880244e03e88 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244e03df8 R13: ffffffff816f5cef R14: ffff880244e03e88 R15: ffff8802417b97a8 FS: 00007fbed31ba740(0000) GS:ffff880244e00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000000e54000 CR3: 0000000182086000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff8802433b0000 ffff880244e03ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff8802417b9380 ffff8801ddd55be8 ffff88022a4c3ea8 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irqrestore+0x67/0x80 [] __slab_free+0x5f/0x39f [] ? sub_preempt_count+0x71/0x100 [] ? _raw_spin_unlock_irqrestore+0x42/0x80 [] ? debug_check_no_obj_freed+0x14e/0x250 [] ? kmem_cache_free+0x95/0x300 [] kmem_cache_free+0x2ec/0x300 [] ? __d_free+0x42/0x60 [] __d_free+0x42/0x60 [] d_free+0x55/0x60 [] dput+0x1a0/0x2f0 [] __fput+0x198/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 01 00 00 00 48 89 e5 53 48 89 fb 48 8b 55 08 48 8d 7f 18 e8 01 d8 9c ff 48 89 df e8 19 55 c2 ff e8 b4 ad 9c ff fb bf 01 00 00 00 29 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff BUG: soft lockup - CPU#3 stuck for 22s! [trinity-child3:15395] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 37598 hardirqs last enabled at (37597): [] tick_nohz_task_switch+0x2a/0x80 hardirqs last disabled at (37598): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (37590): [] __do_softirq+0x194/0x440 softirqs last disabled at (37567): [] irq_exit+0xcd/0xe0 CPU: 3 PID: 15395 Comm: trinity-child3 Not tainted 3.10.0-rc5+ #13 task: ffff8802362a8000 ti: ffff880233ffc000 task.ti: ffff880233ffc000 RIP: 0010:[] [] delay_tsc+0x2f/0xe0 RSP: 0018:ffff880233ffdd50 EFLAGS: 00000202 RAX: 000000006d318952 RBX: ffffffff824d4920 RCX: 000000000000b910 RDX: 0000000000006ea1 RSI: ffff880244e00000 RDI: 0000000000000001 RBP: ffff880233ffdd78 R08: 0000000000000001 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff88016026ee88 R13: ffff880233ffdd20 R14: ffffffff810b72dd R15: 0000000000000000 FS: 00007fbed31ba740(0000) GS:ffff880244e00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000002c0b228 CR3: 00000001758f7000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffffffff81c04640 000000000001e67c 0000000088c7d2c8 ffff88016026ee00 ffff88016026f010 ffff880233ffdd88 ffffffff8130944f ffff880233ffddb0 ffffffff81311a61 ffffffff81c04640 ffffffff81c04658 ffff88023c8e4630 Call Trace: [] __delay+0xf/0x20 [] do_raw_spin_lock+0xe1/0x130 [] _raw_spin_lock+0x60/0x80 [] ? sync_inodes_sb+0x228/0x2a0 [] sync_inodes_sb+0x228/0x2a0 [] ? wait_for_completion+0xdf/0x110 [] ? get_parent_ip+0xd/0x50 [] ? generic_write_sync+0x70/0x70 [] sync_inodes_one_sb+0x19/0x20 [] iterate_supers+0xb2/0x110 [] sys_sync+0x35/0x90 [] tracesys+0xdd/0xe2 Code: 00 55 48 89 e5 41 57 41 56 41 55 41 54 41 89 fc bf 01 00 00 00 53 e8 21 77 3e 00 e8 cc 9e 00 00 41 89 c5 0f 1f 00 0f ae e8 0f 31 <65> 4c 8b 3c 25 f0 b9 00 00 89 c3 eb 2f 0f 1f 40 00 bf 01 00 00 BUG: soft lockup - CPU#3 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 83776047 hardirqs last enabled at (83776046): [] restore_args+0x0/0x30 hardirqs last disabled at (83776047): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (83242260): [] __do_softirq+0x194/0x440 softirqs last disabled at (83242263): [] irq_exit+0xcd/0xe0 CPU: 3 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244e03e80 EFLAGS: 00000202 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000002 RDX: 0000000000004800 RSI: ffff8801684fd1c0 RDI: 0000000000000001 RBP: ffff880244e03e88 R08: 0000000010000103 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244e03df8 R13: ffffffff816f5cef R14: ffff880244e03e88 R15: ffff88020a54b4e8 FS: 00007fbed31ba740(0000) GS:ffff880244e00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fea4f695000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff8802433b0000 ffff880244e03ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88020a54b0c0 ffff88022d52d228 ffff880184d8dbe8 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irq+0x32/0x60 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] finish_task_switch+0x85/0x130 [] ? finish_task_switch+0x47/0x130 [] __schedule+0x444/0x9c0 [] preempt_schedule_irq+0x53/0x90 [] ? atalk_release+0x68/0x1a0 [appletalk] [] retint_kernel+0x26/0x30 [] ? local_bh_enable_ip+0x82/0xf0 [] ? local_bh_enable_ip+0x78/0xf0 [] _raw_write_unlock_bh+0x3a/0x40 [] atalk_release+0x68/0x1a0 [appletalk] [] sock_release+0x1f/0x90 [] sock_close+0x12/0x20 [] __fput+0xf5/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 01 00 00 00 48 89 e5 53 48 89 fb 48 8b 55 08 48 8d 7f 18 e8 01 d8 9c ff 48 89 df e8 19 55 c2 ff e8 b4 ad 9c ff fb bf 01 00 00 00 29 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff BUG: soft lockup - CPU#2 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 84929899 hardirqs last enabled at (84929898): [] restore_args+0x0/0x30 hardirqs last disabled at (84929899): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (83776352): [] __do_softirq+0x194/0x440 softirqs last disabled at (83776373): [] irq_exit+0xcd/0xe0 CPU: 2 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244c03e80 EFLAGS: 00000202 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000002 RDX: 0000000000004800 RSI: ffff8801684fd1c0 RDI: 0000000000000001 RBP: ffff880244c03e88 R08: 0000000010000103 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244c03df8 R13: ffffffff816f5cef R14: ffff880244c03e88 R15: ffff8802417b8de8 FS: 00007fbed31ba740(0000) GS:ffff880244c00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff880243390000 ffff880244c03ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff8802417b89c0 ffff88020236ab28 ffff8801779197a8 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irq+0x32/0x60 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] finish_task_switch+0x85/0x130 [] ? finish_task_switch+0x47/0x130 [] __schedule+0x444/0x9c0 [] preempt_schedule_irq+0x53/0x90 [] ? atalk_release+0x68/0x1a0 [appletalk] [] retint_kernel+0x26/0x30 [] ? local_bh_enable_ip+0x82/0xf0 [] ? local_bh_enable_ip+0x78/0xf0 [] _raw_write_unlock_bh+0x3a/0x40 [] atalk_release+0x68/0x1a0 [appletalk] [] sock_release+0x1f/0x90 ] BUG: soft lockup - CPU#2 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 90253915 hardirqs last enabled at (90253914): [] restore_args+0x0/0x30 hardirqs last disabled at (90253915): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (89186016): [] __do_softirq+0x194/0x440 softirqs last disabled at (89186419): [] irq_exit+0xcd/0xe0 CPU: 2 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] preempt_schedule+0x13/0x60 RSP: 0018:ffff880244c03de8 EFLAGS: 00000202 RAX: ffff88018c89dfd8 RBX: ffffffff816ed1e0 RCX: 000000000000b910 RDX: ffff880244c485c0 RSI: 0000000000000101 RDI: 0000000000000001 RBP: ffff880244c03df8 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244c03d58 R13: ffffffff816f5cef R14: ffff880244c03df8 R15: ffff8802417be1d0 FS: 00007fbed31ba740(0000) GS:ffff880244c00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffffffff816ec4ed ffff8802417be180 ffff880244c03e18 ffffffffa04c2254 ffff880243390000 ffff8802417be5a8 ffff880244c03e88 ffffffff8105ca6a ffffffff8105c9e5 ffffffffa04c7c98 ffffffff8254f1e0 0000000000000000 Call Trace: [] ? _raw_spin_unlock+0x4d/0x60 [] dn_slow_timer+0x84/0x110 [decnet] [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? lg_local_lock+0x5d/0x80 [] ? lg_local_lock+0x46/0x80 [] ? mntput_no_expire+0x21/0x120 [] mntput_no_expire+0x21/0x120 [] mntput+0x26/0x40 [] __fput+0x1a0/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 84851] BUG: soft lockup - CPU#2 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 91383033 hardirqs last enabled at (91383032): [] restore_args+0x0/0x30 hardirqs last disabled at (91383033): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (89186016): [] __do_softirq+0x194/0x440 softirqs last disabled at (89186419): [] irq_exit+0xcd/0xe0 CPU: 2 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irqrestore+0x67/0x80 RSP: 0018:ffff880244c03df0 EFLAGS: 00000282 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000002 RDX: 00000000000022b0 RSI: ffff8801684fd1f8 RDI: ffff8801684fca40 RBP: ffff880244c03e00 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244c03d68 R13: ffffffff816f5cef R14: ffff880244c03e00 R15: ffffffff81cc4140 FS: 00007fbed31ba740(0000) GS:ffff880244c00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: 0000000000000282 ffffffff81cc41a0 ffff880244c03e18 ffffffff81584a2d ffff880243390000 ffff880244c03e88 ffffffff8105ca6a ffffffff8105c9e5 ffffffff82d05d5d ffffffff8250f6c0 0000000000000000 ffffffff81a6b5a5 Call Trace: [] flush_unmaps_timeout+0x2d/0x30 [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? flush_unmaps+0x170/0x170 [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? lg_local_lock+0x5d/0x80 [] ? lg_local_lock+0x46/0x80 [] ? mntput_no_expire+0x21/0x120 [] mntput_no_expire+0x21/0x120 [] mntput+0x26/0x40 [] __fput+0x1a0/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 50] INFO: rcu_preempt self-detected stall on CPU { 2} (t=6500 jiffies g=1306728 c=1306727 q=0) sending NMI to all CPUs: NMI backtrace for cpu 2 CPU: 2 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] __x2apic_send_IPI_mask+0x188/0x1c0 RSP: 0018:ffff880244c03b38 EFLAGS: 00000046 RAX: 0000000000000004 RBX: 0000000000000001 RCX: 000000000000003c RDX: 000000000000000f RSI: 0000000000000004 RDI: 0000000000000000 RBP: ffff880244c03b88 R08: ffff8802432a98f0 R09: 0000000000000001 R10: 0000000000000000 R11: 0000000000000001 R12: ffff8802432a98f0 R13: ffff8802437ea3f0 R14: 0000000000080000 R15: 000000000000cfd0 FS: 00007fbed31ba740(0000) GS:ffff880244c00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: 0000000000000092 000000000000cfc8 0000000200000002 0000000000000004 0000000000000002 0000000000002710 ffffffff81c4fa40 ffffffff81c4fa40 ffff880244dcd9c0 0000000000000000 ffff880244c03b98 ffffffff8102a4bc Call Trace: [] x2apic_send_IPI_all+0x1c/0x20 [] arch_trigger_all_cpu_backtrace+0x65/0xa0 [] rcu_check_callbacks+0x331/0x8e0 [] ? hrtimer_run_queues+0x20/0x180 [] ? sched_clock_cpu+0xb5/0x100 [] update_process_times+0x47/0x80 [] tick_sched_handle.isra.16+0x25/0x60 [] tick_sched_timer+0x41/0x60 [] __run_hrtimer+0x81/0x4e0 [] ? tick_sched_do_timer+0x60/0x60 [] hrtimer_interrupt+0xff/0x240 [] ? call_timer_fn+0x95/0x370 [] smp_apic_timer_interrupt+0x66/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? lock_release+0xb0/0x320 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] call_timer_fn+0xaa/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? lg_local_lock+0x5d/0x80 [] ? lg_local_lock+0x46/0x80 [] ? mntput_no_expire+0x21/0x120 [] mntput_no_expire+0x21/0x120 [] mntput+0x26/0x40 [] __fput+0x1a0/0x2d0 [] ____fput+0xe/0x10 [] restore_args+0x0/0x30 hardirqs last disabled at (92829001): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (92526040): [] __do_softirq+0x194/0x440 softirqs last disabled at (92526043): [] irq_exit+0xcd/0xe0 CPU: 2 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] lock_release+0x22/0x320 RSP: 0018:ffff880244c03dd0 EFLAGS: 00000246 RAX: 0000000000000000 RBX: ffffffff816ed1e0 RCX: 0000000000000002 RDX: ffffffffa04c2254 RSI: 0000000000000001 RDI: ffff880241083128 RBP: ffff880244c03de0 R08: 0000000000000103 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244c03d48 R13: ffffffff816f5cef R14: ffff880244c03de0 R15: ffff880241083110 FS: 00007fbed31ba740(0000) GS:ffff880244c00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffffffffa04c21d0 ffff8802410830c0 ffff880244c03df8 ffffffff816ec4bf ffff8802410830c0 ffff880244c03e18 ffffffffa04c2254 ffff880243390000 ffff8802410834e8 ffff880244c03e88 ffffffff8105ca6a ffffffff8105c9e5 Call Trace: [] ? dn_neigh_elist+0x40/0x40 [decnet] [] _raw_spin_unlock+0x1f/0x60 [] dn_slow_timer+0x84/0x110 [decnet] [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? lg_local_lock+0x5d/0x80 [] ? lg_local_lock+0x46/0x80 [] ? mntput_no_expire+0x21/0x120 [] mntput_no_expire+0x21/0x120 [] mntput+0x26/0x40 [] __fput+0x1a0/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0x[53534.549138] BUG: soft lockup - CPU#2 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 93962231 hardirqs last enabled at (93962230): [] restore_args+0x0/0x30 hardirqs last disabled at (93962231): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (92526040): [] __do_softirq+0x194/0x440 softirqs last disabled at (92526043): [] irq_exit+0xcd/0xe0 CPU: 2 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244c03e80 EFLAGS: 00000206 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000003 RDX: 0000000000000470 RSI: ffff8801684fd1c0 RDI: 0000000000000001 RBP: ffff880244c03e88 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244c03df8 R13: ffffffff816f5cef R14: ffff880244c03e88 R15: ffff88020232f928 FS: 00007fbed31ba740(0000) GS:ffff880244c00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff880243390000 ffff880244c03ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88020232f500 ffff880219ec5228 ffff88020a54bea8 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? lg_local_lock+0x5d/0x80 [] ? lg_local_lock+0x46/0x80 [] ? mntput_no_expire+0x21/0x120 [] mntput_no_expire+0x21/0x120 [] mntput+0x26/0x40 [] __fput+0x1a0/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 33496] BUG: soft lockup - CPU#2 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 95094981 hardirqs last enabled at (95094980): [] restore_args+0x0/0x30 hardirqs last disabled at (95094981): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (92526040): [] __do_softirq+0x194/0x440 softirqs last disabled at (92526043): [] irq_exit+0xcd/0xe0 CPU: 2 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irqrestore+0x67/0x80 RSP: 0018:ffff880244c03d90 EFLAGS: 00000286 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000002 RDX: 0000000000004340 RSI: ffff8801684fd230 RDI: ffff8801684fca40 RBP: ffff880244c03da0 R08: 0000000000000103 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244c03d08 R13: ffffffff816f5cef R14: ffff880244c03da0 R15: ffff880243390000 FS: 00007fbed31ba740(0000) GS:ffff880244c00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f748879c000 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff88022d528428 ffff880243390000 ffff880244c03de0 ffffffff8105dc39 0000000000000286 ffff88022d528000 ffff88022d528050 0000000000000101 ffffffffa04c21d0 ffff88022d528000 ffff880244c03df8 ffffffff81594a88 Call Trace: [] mod_timer+0x119/0x320 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] sk_reset_timer+0x18/0x30 [] dn_slow_timer+0x7c/0x110 [decnet] [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? lg_local_lock+0x5d/0x80 [] ? lg_local_lock+0x46/0x80 [] ? mntput_no_expire+0x21/0x120 [] mntput_no_expire+0x21/0x120 [] mntput+0x26/0x40 [] __fput+0x1a0/0x2d0 [] ____f[53654.512179] BUG: soft lockup - CPU#3 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 99648941 hardirqs last enabled at (99648940): [] restore_args+0x0/0x30 hardirqs last disabled at (99648941): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (98576516): [] __do_softirq+0x194/0x440 softirqs last disabled at (98577051): [] irq_exit+0xcd/0xe0 CPU: 3 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] lock_acquired+0x105/0x3f0 RSP: 0018:ffff880244e03d98 EFLAGS: 00000246 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000003 RDX: 0000000000004340 RSI: 0000000000000102 RDI: 0000000000000001 RBP: ffff880244e03dd0 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244e03d08 R13: ffffffff816f5cef R14: ffff880244e03dd0 R15: ffff8801684fca40 FS: 00007fbed31ba740(0000) GS:ffff880244e00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000000003b5ab28 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: 0000000300000000 ffffffffa04c21eb ffff880241082750 ffff880241082768 0000000000000101 ffffffffa04c21d0 ffff880241082700 ffff880244e03df8 ffffffff816ec16c ffffffffa04c21eb ffff880241082700 ffff880241082750 Call Trace: [] ? dn_slow_timer+0x1b/0x110 [decnet] [] ? dn_neigh_elist+0x40/0x40 [decnet] [] _raw_spin_lock+0x6c/0x80 [] ? dn_slow_timer+0x1b/0x110 [decnet] [] dn_slow_timer+0x1b/0x110 [decnet] [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? lock_acquire+0xa6/0x1f0 [] ? mntput_no_expire+0x21/0x120 [] lg_local_lock+0x3e/0x80 [] ? mntput_no_expire+0x21/0x120 [] mntput_no_expire+0x21/0x120 [] mntput+0x26/0x40 [] __fput+0x1a0/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 89 ff e8 7f e1 ff ff 85 c0 74 b3 4d 3b 6f 10 0f 84 a1 00 00 00 65 48 8b 04 25 00 ba 00 00 c7 80 7c 07 00 00 00 00 00 00 41 56 9d <48> 83 c4 10 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 40 00 85 db BUG: soft lockup - CPU#2 stuck for 22s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 102175341 hardirqs last enabled at (102175340): [] restore_args+0x0/0x30 hardirqs last disabled at (102175341): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (101559798): [] __do_softirq+0x194/0x440 softirqs last disabled at (101559801): [] irq_exit+0xcd/0xe0 CPU: 2 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] lock_acquire+0xa6/0x1f0 RSP: 0018:ffff880244c03dc0 EFLAGS: 00000246 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000010e00000 RDX: ffffffff8216fe60 RSI: 0000000000000000 RDI: ffffffffef200438 RBP: ffff880244c03e18 R08: ffff8801684fd1c0 R09: 0000000000000001 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244c03d38 R13: ffffffff816f5cef R14: ffff880244c03e18 R15: 0000000000000000 FS: 00007fbed31ba740(0000) GS:ffff880244c00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 0000003850abc720 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: 0000000000000000 ffffffff8105c9e5 ffff880200000000 0000000000000246 0000000000000002 ffff880244c03e30 ffff880243390000 ffff880228ef0428 0000000000000101 ffffffffa04c21d0 ffff880228ef0000 ffff880244c03e88 Call Trace: [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] call_timer_fn+0x7f/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irqrestore+0x67/0x80 [] debug_check_no_obj_freed+0x14e/0x250 [] ? kmem_cache_free+0x95/0x300 [] kmem_cache_free+0xad/0x300 [] ? __d_free+0x42/0x60 [] ? lock_release_holdtime.part.30+0xee/0x170 [] __d_free+0x42/0x60 [] d_free+0x55/0x60 [] restore_args+0x0/0x30 hardirqs last disabled at (104442709): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (103416536): [] __do_softirq+0x194/0x440 softirqs last disabled at (103416953): [] irq_exit+0xcd/0xe0 CPU: 3 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] lock_release+0xb0/0x320 RSP: 0018:ffff880244e03db8 EFLAGS: 00000246 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 000000000000b910 RDX: ffff880244e485c0 RSI: 0000000000000102 RDI: 0000000000000001 RBP: ffff880244e03de0 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244e03d28 R13: ffffffff816f5cef R14: ffff880244e03de0 R15: ffff88020208bae8 FS: 00007fbed31ba740(0000) GS:ffff880244e00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f00268fc068 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff88020208bad0 ffff88020208bad0 0000000000000101 ffffffffa04c21d0 ffff88020208ba80 ffff880244e03df8 ffffffff816ec4bf ffff88020208ba80 ffff880244e03e18 ffffffffa04c2254 ffff8802433b0000 ffff88020208bea8 Call Trace: [] ? dn_neigh_elist+0x40/0x40 [decnet] [] _raw_spin_unlock+0x1f/0x60 [] dn_slow_timer+0x84/0x110 [decnet] [] call_timer_fn+0x8a/0x370 [] ? call_timer_fn+0x5/0x370 [] ? dn_neigh_elist+0x40/0x40 [decnet] [] run_timer_softirq+0x23c/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irqrestore+0x67/0x80 [] debug_object_active_state+0x133/0x180 [] ? get_max_files+0x20/0x20 [] __call_rcu+0x55/0x840 [] ? get_parent_ip+0xd/0x50 [] ? sub_preempt_count+0x71/0x100 [] call_rcu+0x1d/0x20 [] __fput+0x190/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: ff 0f 85 b4 00 00 00 4c 89 ea 4c 89 e6 48 89 df e8 16 fc ff ff 65 48 8b 04 25 00 ba 00 00 c7 80 7c 07 00 00 00 00 00 00 41 56 9d <5b> 41 5c 41 5d 41 5e 41 5f 5d f3 c3 0f 1f 40 00 65 48 8b 04 25 BUG: soft lockup - CPU#3 stuck for 23s! [trinity-child2:9278] Modules linked in: 8021q garp bridge stp fuse tun snd_seq_dummy hidp rfcomm ipt_ULOG nfnetlink can_raw can_bcm llc2 decnet netrom scsi_transport_iscsi pppoe pppox ppp_generic slhc appletalk irda phonet af_802154 bnep af_key ipx p8023 psnap p8022 llc rose can af_rxrpc caif_socket caif nfc crc_ccitt atm ax25 bluetooth rfkill x25 rds coretemp hwmon kvm_intel snd_hda_codec_realtek kvm crc32c_intel ghash_clmulni_intel snd_hda_codec_hdmi microcode pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_seq snd_seq_device e1000e usb_debug snd_pcm snd_page_alloc snd_timer ptp snd pps_core soundcore xfs libcrc32c irq event stamp: 105596253 hardirqs last enabled at (105596252): [] restore_args+0x0/0x30 hardirqs last disabled at (105596253): [] apic_timer_interrupt+0x6a/0x80 softirqs last enabled at (103416536): [] __do_softirq+0x194/0x440 softirqs last disabled at (103416953): [] irq_exit+0xcd/0xe0 CPU: 3 PID: 9278 Comm: trinity-child2 Not tainted 3.10.0-rc5+ #13 task: ffff8801684fca40 ti: ffff88018c89c000 task.ti: ffff88018c89c000 RIP: 0010:[] [] _raw_spin_unlock_irq+0x32/0x60 RSP: 0018:ffff880244e03e80 EFLAGS: 00000202 RAX: ffff8801684fca40 RBX: ffffffff816ed1e0 RCX: 0000000000000000 RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000001 RBP: ffff880244e03e88 R08: 0000000000000102 R09: 0000000000000000 R10: 0000000000000000 R11: 0000000000000001 R12: ffff880244e03df8 R13: ffffffff816f5cef R14: ffff880244e03e88 R15: ffff88020232e5a8 FS: 00007fbed31ba740(0000) GS:ffff880244e00000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007f00268fc068 CR3: 0000000001c0b000 CR4: 00000000001407e0 DR0: 0000000001717000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000600 Stack: ffff8802433b0000 ffff880244e03ef8 ffffffff8105cf7d ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88018c89dfd8 ffff88020232e180 ffff8802023fd228 ffff88022d52d228 0000000000000001 0000000000000001 Call Trace: [] run_timer_softirq+0x22d/0x390 [] __do_softirq+0xff/0x440 [] irq_exit+0xcd/0xe0 [] smp_apic_timer_interrupt+0x6b/0x9b [] apic_timer_interrupt+0x6f/0x80 [] ? retint_restore_args+0xe/0xe [] ? _raw_spin_unlock_irqrestore+0x67/0x80 [] debug_object_active_state+0x133/0x180 [] ? get_max_files+0x20/0x20 [] __call_rcu+0x55/0x840 [] ? get_parent_ip+0xd/0x50 [] ? sub_preempt_count+0x71/0x100 [] call_rcu+0x1d/0x20 [] __fput+0x190/0x2d0 [] ____fput+0xe/0x10 [] task_work_run+0xac/0xe0 [] do_exit+0x2b3/0xcd0 [] ? _raw_spin_unlock_irq+0x2c/0x60 [] do_group_exit+0x4c/0xc0 [] get_signal_to_deliver+0x2e1/0x940 [] do_signal+0x48/0x5a0 [] ? put_lock_stats.isra.29+0xe/0x40 [] ? get_parent_ip+0xd/0x50 [] ? user_exit+0x45/0x90 [] ? trace_hardirqs_on_caller+0xfd/0x1c0 [] do_notify_resume+0x78/0x90 [] int_signal+0x12/0x17 Code: 01 00 00 00 48 89 e5 53 48 89 fb 48 8b 55 08 48 8d 7f 18 e8 01 d8 9c ff 48 89 df e8 19 55 c2 ff e8 b4 ad 9c ff fb bf 01 00 00 00 29 47 00 00 65 48 8b 04 25 f0 b9 00 00 48 8b 80 38 e0 ff ff