From: Chris Mason <clm@fb.com>
To: Dave Jones <davej@redhat.com>
Cc: "Linus Torvalds" <torvalds@linux-foundation.org>,
"Mike Galbraith" <umgwanakikbuti@gmail.com>,
"Ingo Molnar" <mingo@kernel.org>,
"Peter Zijlstra" <peterz@infradead.org>,
"Dâniel Fraga" <fragabr@gmail.com>,
"Sasha Levin" <sasha.levin@oracle.com>,
"Paul E. McKenney" <paulmck@linux.vnet.ibm.com>,
"Linux Kernel Mailing List" <linux-kernel@vger.kernel.org>,
"Suresh Siddha" <sbsiddha@gmail.com>,
"Oleg Nesterov" <oleg@redhat.com>,
"Peter Anvin" <hpa@linux.intel.com>
Subject: Re: frequent lockups in 3.18rc4
Date: Thu, 18 Dec 2014 10:54:19 -0500 [thread overview]
Message-ID: <1418918059.17358.6@mail.thefacebook.com> (raw)
In-Reply-To: <20141218051327.GA31988@redhat.com>
On Thu, Dec 18, 2014 at 12:13 AM, Dave Jones <davej@redhat.com> wrote:
> On Mon, Dec 15, 2014 at 03:46:41PM -0800, Linus Torvalds wrote:
> > On Mon, Dec 15, 2014 at 10:21 AM, Linus Torvalds
> > <torvalds@linux-foundation.org> wrote:
> > >
> > > So let's just fix it. Here's a completely untested patch.
> >
> > So after looking at this more, I'm actually really convinced that
> this
> > was a pretty nasty bug.
> >
> > I'm *not* convinced that it's necessarily *your* bug, but I still
> > think it could be.
>
> Bah, I was getting all optimistic.
> I came home this evening to a locked up machine.
> Serial console had a *lot* more traces than usual though.
> Full log below. The 12xxx.xxxxxx traces we seemed to recover from,
> followed by silence for a while, before the real fun begins at
> 157xx.xxxxxx
CPU 2 seems to be the one making the least progress. I think he's
calling fork and then trying to allocate a debug object for his
hrtimer, eventually wandering into fill_pool from __debug_object_init():
static void fill_pool(void)
{
gfp_t gfp = GFP_ATOMIC | __GFP_NORETRY | __GFP_NOWARN;
struct debug_obj *new;
unsigned long flags;
if (likely(obj_pool_free >= ODEBUG_POOL_MIN_LEVEL))
return;
if (unlikely(!obj_cache))
return;
while (obj_pool_free < ODEBUG_POOL_MIN_LEVEL) {
new = kmem_cache_zalloc(obj_cache, gfp);
if (!new)
return;
raw_spin_lock_irqsave(&pool_lock, flags);
hlist_add_head(&new->node, &obj_pool);
obj_pool_free++;
raw_spin_unlock_irqrestore(&pool_lock, flags);
}
}
It doesn't seem to be making progress out of __slab_alloc+0x52f/0x58f,
but maybe the slab code is just a victim of being called in a while
loop with GFP_ATOMIC set from a starvation prone loop. Can you please
line up where 0x52f is in __slab_alloc?
It might be fun to run with CONFIG_DEBUG_OBJECTS off...Linus' patch
clearly helped, I think we're off in a different bug now.
> [12669.359905] Code: 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 41 57
> 41 56 41 55 41 54 53 48 83 ec 48 44 8b 25 48 80 be 00 65 48 8b 1c 25
> 00 aa 00 00 <45> 85 e4 0f 84 ef 00 00 00 44 8b 1d e7 32 ab 01 49 89
> fe 41 89
> [12669.361354] INFO: NMI handler
> (arch_trigger_all_cpu_backtrace_handler) took too long to run: 88.798
> msecs
> [15739.449422] NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s!
> [kworker/u16:3:14112]
> [15739.450087] Modules linked in: bridge 8021q garp stp snd_seq_dummy
> dlci tun fuse rfcomm hidp bnep af_key llc2 nfnetlink can_bcm
> scsi_transport_iscsi can_raw sctp libcrc32c nfc caif_socket caif
> af_802154 ieee802154 phonet af_rxrpc bluetooth can pppoe pppox
> ppp_generic slhc irda crc_ccitt rds rose x25 atm netrom appletalk ipx
> p8023 psnap p8022 llc ax25 usb_debug cfg80211 rfkill coretemp hwmon
> x86_pkg_temp_thermal kvm_intel kvm crct10dif_pclmul crc32c_intel
> ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic microcode serio_raw pcspkr snd_hda_intel
> snd_hda_controller snd_hda_codec snd_hwdep snd_seq snd_seq_device
> snd_pcm e1000e ptp pps_core snd_timer snd soundcore shpchp nfsd
> auth_rpcgss oid_registry nfs_acl lockd grace sunrpc
> [15739.454475] CPU: 2 PID: 14112 Comm: kworker/u16:3 Tainted: G
> L 3.18.0+ #106
> [15739.456686] Workqueue: khelper __call_usermodehelper
> [15739.457473] task: ffff8801c95f0000 ti: ffff880227eac000 task.ti:
> ffff880227eac000
> [15739.458231] RIP: 0010:[<ffffffff817c3407>] [<ffffffff817c3407>]
> __slab_alloc+0x52f/0x58f
> [15739.459015] RSP: 0018:ffff880227eaf8f8 EFLAGS: 00000246
> [15739.459794] RAX: 0000000000000002 RBX: ffff8802304cf5c8 RCX:
> 00000000000002e0
> [15739.460570] RDX: ffff88024520d7e0 RSI: 0000000000000000 RDI:
> ffff880244802000
> [15739.461343] RBP: ffff880227eaf9e8 R08: 0000000000000000 R09:
> 0000000000000000
> [15739.462113] R10: 0000000000000092 R11: 0000000000000000 R12:
> ffffffff810135bf
> [15739.462885] R13: ffff880227eaf878 R14: 0000000100160015 R15:
> ffffffff8138278d
> [15739.463648] FS: 0000000000000000(0000) GS:ffff880245200000(0000)
> knlGS:0000000000000000
> [15739.464431] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15739.465203] CR2: 0000000000000008 CR3: 0000000225ab9000 CR4:
> 00000000001407e0
> [15739.465985] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15739.466766] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15739.467542] Stack:
> [15739.468308] 000000000000005c ffff880240f8d790 ffff880240f8d790
> ffff880240f8dd00
> [15739.469106] 0000000180230020 000000010000000f ffffffff8112ee12
> 0000000000000000
> [15739.469912] ffff8802453d7260 000000020023001f ffff880227eaf968
> ffffffff8138278d
> [15739.470717] Call Trace:
> [15739.471511] [<ffffffff8112ee12>] ? __delayacct_tsk_init+0x22/0x50
> [15739.472325] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15739.473138] [<ffffffff811ce860>] ? set_track+0x70/0x140
> [15739.473947] [<ffffffff811cf35d>] ? init_object+0x3d/0x70
> [15739.474757] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15739.475571] [<ffffffff811d295b>] kmem_cache_alloc+0x1cb/0x1f0
> [15739.476374] [<ffffffff8138278d>] __debug_object_init+0x43d/0x450
> [15739.477174] [<ffffffff813827bb>] debug_object_init+0x1b/0x20
> [15739.477983] [<ffffffff810e66d5>] hrtimer_init+0x25/0xb0
> [15739.478781] [<ffffffff8109f069>] __sched_fork+0x99/0x230
> [15739.479590] [<ffffffff810a59c9>] sched_fork+0x29/0x200
> [15739.480387] [<ffffffff8107568c>] copy_process.part.26+0x65c/0x1a40
> [15739.481184] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15739.481983] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15739.482797] [<ffffffff8108e340>] ? call_helper+0x20/0x20
> [15739.483598] [<ffffffff81076c37>] do_fork+0xe7/0x490
> [15739.484382] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15739.485160] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15739.485922] [<ffffffff81077006>] kernel_thread+0x26/0x30
> [15739.486669] [<ffffffff8108e1b4>] __call_usermodehelper+0x64/0x80
> [15739.487407] [<ffffffff8109301a>] process_one_work+0x1fa/0x550
> [15739.488126] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15739.488834] [<ffffffff8109348b>] worker_thread+0x11b/0x490
> [15739.489529] [<ffffffff81093370>] ? process_one_work+0x550/0x550
> [15739.490197] [<ffffffff81098c89>] kthread+0xf9/0x110
> [15739.490845] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15739.491474] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15739.492092] [<ffffffff817cfe6c>] ret_from_fork+0x7c/0xb0
> [15739.492689] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15739.493288] Code: 00 02 00 00 49 c7 45 00 00 00 00 00 75 11 ff b5
> 78 ff ff ff 9d e8 7a 6d 98 ff 4c 89 e0 eb 0f e8 70 6e 98 ff ff b5 78
> ff ff ff 9d <4c> 89 e0 48 8b 55 c8 65 48 33 14 25 28 00 00 00 74 3c
> e8 22 46
> [15739.494617] sending NMI to other CPUs:
> [15739.495221] NMI backtrace for cpu 3
> [15739.495787] CPU: 3 PID: 1650 Comm: trinity-c76 Tainted: G
> L 3.18.0+ #106
> [15739.497539] task: ffff8801adac4470 ti: ffff880180e04000 task.ti:
> ffff880180e04000
> [15739.498153] RIP: 0010:[<ffffffff810c6014>] [<ffffffff810c6014>]
> lock_acquire+0xb4/0x120
> [15739.498772] RSP: 0018:ffff880180e07dd8 EFLAGS: 00000246
> [15739.499382] RAX: ffff8801adac4470 RBX: 0000000000000246 RCX:
> ffff8802455cff98
> [15739.499994] RDX: 00000000000006a0 RSI: 0000000000000000 RDI:
> 0000000000000000
> [15739.500609] RBP: ffff880180e07e38 R08: 0000000000000000 R09:
> 0000000000000000
> [15739.501224] R10: 0000000000000000 R11: 0000000000000000 R12:
> 0000000000000000
> [15739.501829] R13: 0000000000000000 R14: 0000000000000002 R15:
> 0000000000000000
> [15739.502422] FS: 00007f79977d8740(0000) GS:ffff880245400000(0000)
> knlGS:0000000000000000
> [15739.503021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15739.503621] CR2: 0000000000000001 CR3: 00000001c9593000 CR4:
> 00000000001407e0
> [15739.504217] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15739.504812] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15739.505403] Stack:
> [15739.505988] ffffffff8107a8e9 0000000000000000 ffff8801adac4470
> 0000000000000246
> [15739.506603] 0000000127cc4da0 ffffffff81c0a098 ffff8801adac4470
> ffffffff81c0a080
> [15739.507220] ffffffff81c0a098 ffff8801adac4470 ffff8801adac4470
> ffff8801adac4470
> [15739.507839] Call Trace:
> [15739.508448] [<ffffffff8107a8e9>] ? do_wait+0xd9/0x280
> [15739.509064] [<ffffffff817cf3d1>] _raw_read_lock+0x41/0x80
> [15739.509678] [<ffffffff8107a8e9>] ? do_wait+0xd9/0x280
> [15739.510293] [<ffffffff8107a8e9>] do_wait+0xd9/0x280
> [15739.510907] [<ffffffff8107aeb0>] SyS_wait4+0x80/0x110
> [15739.511518] [<ffffffff81078990>] ? task_stopped_code+0x60/0x60
> [15739.512130] [<ffffffff817d0109>] tracesys_phase2+0xd4/0xd9
> [15739.512739] Code: d8 49 c1 e8 09 48 89 04 24 49 83 f0 01 41 83 e0
> 01 e8 01 ef ff ff 65 48 8b 04 25 00 aa 00 00 c7 80 6c 07 00 00 00 00
> 00 00 53 9d <48> 83 c4 38 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 44
> 00 00 65
> [15739.514121] NMI backtrace for cpu 1
> [15739.514769] CPU: 1 PID: 2849 Comm: trinity-c95 Tainted: G
> L 3.18.0+ #106
> [15739.516771] task: ffff880096b4c470 ti: ffff880153a4c000 task.ti:
> ffff880153a4c000
> [15739.517467] RIP: 0010:[<ffffffff810961f9>] [<ffffffff810961f9>]
> find_pid_ns+0x39/0x90
> [15739.518177] RSP: 0018:ffff880153a4fe78 EFLAGS: 00000207
> [15739.518884] RAX: ffff88024e517120 RBX: 0000000000000d7f RCX:
> 0000000000000034
> [15739.519599] RDX: ffff880094be6500 RSI: ffffffff81c486c0 RDI:
> 0000000000000d7f
> [15739.520316] RBP: ffff880153a4fe78 R08: 0000000000000000 R09:
> 0000000000000000
> [15739.521036] R10: 0000000000000000 R11: 0000000000000000 R12:
> 0000000000000000
> [15739.521752] R13: ffff880096b4c470 R14: 0000000000000000 R15:
> 0000000000000000
> [15739.522464] FS: 00007f79977d8740(0000) GS:ffff880245000000(0000)
> knlGS:0000000000000000
> [15739.523181] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15739.523882] CR2: 00007f7996f24220 CR3: 00000002251b4000 CR4:
> 00000000001407e0
> [15739.524580] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15739.525269] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15739.525957] Stack:
> [15739.526632] ffff880153a4fe88 ffffffff8109627f ffff880153a4ff68
> ffffffff81086e2a
> [15739.527319] ffffffff81086df8 0000000000000000 ffff880096b4c840
> 0000000000000000
> [15739.527992] ffff880100000000 000003e800000b21 ffff880094be64c0
> 00007fff123fb870
> [15739.528656] Call Trace:
> [15739.529301] [<ffffffff8109627f>] find_vpid+0x2f/0x50
> [15739.529947] [<ffffffff81086e2a>] SYSC_kill+0xba/0x240
> [15739.530587] [<ffffffff81086df8>] ? SYSC_kill+0x88/0x240
> [15739[15763.435537] NMI watchdog: BUG: soft lockup - CPU#2 stuck for
> 22s! [kworker/u16:3:14112]
> [15763.436252] Modules linked in: bridge 8021q garp stp snd_seq_dummy
> dlci tun fuse rfcomm hidp bnep af_key llc2 nfnetlink can_bcm
> scsi_transport_iscsi can_raw sctp libcrc32c nfc caif_socket caif
> af_802154 ieee802154 phonet af_rxrpc bluetooth can pppoe pppox
> ppp_generic slhc irda crc_ccitt rds rose x25 atm netrom appletalk ipx
> p8023 psnap p8022 llc ax25 usb_debug cfg80211 rfkill coretemp hwmon
> x86_pkg_temp_thermal kvm_intel kvm crct10dif_pclmul crc32c_intel
> ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic microcode serio_raw pcspkr snd_hda_intel
> snd_hda_controller snd_hda_codec snd_hwdep snd_seq snd_seq_device
> snd_pcm e1000e ptp pps_core snd_timer snd soundcore shpchp nfsd
> auth_rpcgss oid_registry nfs_acl lockd grace sunrpc
> [15763.441025] CPU: 2 PID: 14112 Comm: kworker/u16:3 Tainted: G
> L 3.18.0+ #106
> [15763.443320] Workqueue: khelper __call_usermodehelper
> [15763.444090] task: ffff8801c95f0000 ti: ffff880227eac000 task.ti:
> ffff880227eac000
> [15763.444861] RIP: 0010:[<ffffffff817c3407>] [<ffffffff817c3407>]
> __slab_alloc+0x52f/0x58f
> [15763.445654] RSP: 0018:ffff880227eaf8f8 EFLAGS: 00000246
> [15763.446422] RAX: 0000000000000002 RBX: ffff8802304cf5c8 RCX:
> 00000000000002e0
> [15763.447201] RDX: ffff88024520d7e0 RSI: 0000000000000000 RDI:
> ffff880244802000
> [15763.447985] RBP: ffff880227eaf9e8 R08: 0000000000000000 R09:
> 0000000000000000
> [15763.448764] R10: 0000000000000092 R11: 0000000000000000 R12:
> ffffffff810135bf
> [15763.449545] R13: ffff880227eaf878 R14: 0000000100160015 R15:
> ffffffff8138278d
> [15763.450319] FS: 0000000000000000(0000) GS:ffff880245200000(0000)
> knlGS:0000000000000000
> [15763.451100] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15763.451876] CR2: 0000000000000008 CR3: 0000000225ab9000 CR4:
> 00000000001407e0
> [15763.452662] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15763.453451] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15763.454230] Stack:
> [15763.455003] 000000000000005c ffff880240f8d790 ffff880240f8d790
> ffff880240f8dd00
> [15763.455818] 0000000180230020 000000010000000f ffffffff8112ee12
> 0000000000000000
> [15763.456608] ffff8802453d7260 000000020023001f ffff880227eaf968
> ffffffff8138278d
> [15763.457393] Call Trace:
> [15763.458166] [<ffffffff8112ee12>] ? __delayacct_tsk_init+0x22/0x50
> [15763.458960] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15763.459753] [<ffffffff811ce860>] ? set_track+0x70/0x140
> [15763.460544] [<ffffffff811cf35d>] ? init_object+0x3d/0x70
> [15763.461338] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15763.462127] [<ffffffff811d295b>] kmem_cache_alloc+0x1cb/0x1f0
> [15763.462921] [<ffffffff8138278d>] __debug_object_init+0x43d/0x450
> [15763.463707] [<ffffffff813827bb>] debug_object_init+0x1b/0x20
> [15763.464503] [<ffffffff810e66d5>] hrtimer_init+0x25/0xb0
> [15763.465294] [<ffffffff8109f069>] __sched_fork+0x99/0x230
> [15763.466086] [<ffffffff810a59c9>] sched_fork+0x29/0x200
> [15763.466875] [<ffffffff8107568c>] copy_process.part.26+0x65c/0x1a40
> [15763.467664] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15763.468458] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15763.469251] [<ffffffff8108e340>] ? call_helper+0x20/0x20
> [15763.470041] [<ffffffff81076c37>] do_fork+0xe7/0x490
> [15763.470828] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15763.471603] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15763.472371] [<ffffffff81077006>] kernel_thread+0x26/0x30
> [15763.473120] [<ffffffff8108e1b4>] __call_usermodehelper+0x64/0x80
> [15763.473854] [<ffffffff8109301a>] process_one_work+0x1fa/0x550
> [15763.474578] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15763.475287] [<ffffffff8109348b>] worker_thread+0x11b/0x490
> [15763.475975] [<ffffffff81093370>] ? process_one_work+0x550/0x550
> [15763.476640] [<ffffffff81098c89>] kthread+0xf9/0x110
> [15763.477285] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15763.477915] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15763.478532] [<ffffffff817cfe6c>] ret_from_fork+0x7c/0xb0
> [15763.479131] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15763.479741] Code: 00 02 00 00 49 c7 45 00 00 00 00 00 75 11 ff b5
> 78 ff ff ff 9d e8 7a 6d 98 ff 4c 89 e0 eb 0f e8 70 6e 98 ff ff b5 78
> ff ff ff 9d <4c> 89 e0 48 8b 55 c8 65 48 33 14 25 28 00 00 00 74 3c
> e8 22 46
> [15763.481087] sending NMI to other CPUs:
> [15763.481693] NMI backtrace for cpu 3
> [15763.482255] CPU: 3 PID: 1650 Comm: trinity-c76 Tainted: G
> L 3.18.0+ #106
> [15763.484005] task: ffff8801adac4470 ti: ffff880180e04000 task.ti:
> ffff880180e04000
> [15763.484618] RIP: 0010:[<ffffffff810c47f5>] [<ffffffff810c47f5>]
> lock_acquired+0x45/0x370
> [15763.485234] RSP: 0018:ffff880180e07db8 EFLAGS: 00000046
> [15763.485841] RAX: 0000000000000001 RBX: ffff880227cc4da0 RCX:
> 0000000000000001
> [15763.486453] RDX: 000000000000dbdb RSI: ffffffff810bcc8d RDI:
> ffff880227cc4db8
> [15763.487068] RBP: ffff880180e07df8 R08: 0000000000000000 R09:
> 0000000000000001
> [15763.487687] R10: 0000000000000000 R11: 0000000000000000 R12:
> ffff8801adac4470
> [15763.488303] R13: ffff880227cc4db8 R14: 0000000000000046 R15:
> ffff8801adac4460
> [15763.488909] FS: 00007f79977d8740(0000) GS:ffff880245400000(0000)
> knlGS:0000000000000000
> [15763.489522] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15763.490133] CR2: 0000000000000001 CR3: 00000001c9593000 CR4:
> 00000000001407e0
> [15763.490747] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15763.491356] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15763.491964] Stack:
> [15763.492564] 0000000100000002 ffffffff810bcc8d ffff880180e07dd8
> ffff880227cc4da0
> [15763.493194] ffff880227cc4db8 0000000000000292 ffff8801adac4470
> ffff8801adac4460
> [15763.493828] ffff880180e07e38 ffffffff817cf0d5 ffffffff810bcc8d
> 0000000000000296
> [15763.494464] Call Trace:
> [15763.495088] [<ffffffff810bcc8d>] ? remove_wait_queue+0x1d/0x40
> [15763.495726] [<ffffffff817cf0d5>] _raw_spin_lock_irqsave+0x75/0x90
> [15763.496364] [<ffffffff810bcc8d>] ? remove_wait_queue+0x1d/0x40
> [15763.497005] [<ffffffff810bcc8d>] remove_wait_queue+0x1d/0x40
> [15763.497645] [<ffffffff8107a95b>] do_wait+0x14b/0x280
> [15763.498283] [<ffffffff8107aeb0>] SyS_wait4+0x80/0x110
> [15763.498917] [<ffffffff81078990>] ? task_stopped_code+0x60/0x60
> [15763.499551] [<ffffffff817d0109>] tracesys_phase2+0xd4/0xd9
> [15763.500183] Code: b8 00 45 85 c9 0f 84 d8 00 00 00 65 4c 8b 24 25
> 00 aa 00 00 45 8b 84 24 6c 07 00 00 45 85 c0 0f 85 be 00 00 00 49 89
> fd 9c 41 5e <fa> 8b 35 1c 3a ab 01 41 c7 84 24 6c 07 00 00 01 00 00
> 00 41 8b
> [15763.501611] NMI backtrace for cpu 1
> [15763.502274] CPU: 1 PID: 3298 Comm: trinity-c183 Tainted: G
> L 3.18.0+ #106
> [15763.504345] task: ffff880227de16d0 ti: ffff880071060000 task.ti:
> ffff880071060000
> [15763.505065] RIP: 0033:[<000000336eebc2fc>] [<000000336eebc2fc>]
> 0x336eebc2fc
> [15763.505796] RSP: 002b:00007fff123fb868 EFLAGS: 00000246
> [15763.506522] RAX: 0000000000000000 RBX: 0000000000000d7b RCX:
> ffffffffffffffff
> [15763.507257] RDX: 000000000000000b RSI: 00007fff123fb870 RDI:
> 0000000000000d7b
> [15763.507994] RBP: 0000000000000000 R08: 00007f79977d8740 R09:
> 0000000000000000
> [15763.508729] R10: 0000000000000000 R11: 0000000000000246 R12:
> 00007f7996cf6000
> [15763.509460] R13: 00007f7996cf6068 R14: 0000000000000000 R15:
> 0000000000000000
> [15763.510188] FS: 00007f79977d8740(0000) GS:ffff880245000000(0000)
> knlGS:0000000000000000
> [15763.510908] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15763.511612] CR2: 00007f7996f24220 CR3: 000000009a646000 CR4:
> 00000000001407e0
> [15763.512319] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15763.513027] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15763.513727]
> [15763.514403] NMI backtrace for cpu 0
> [15763.515067] CPU: 0 PID: 1876 Comm: trinity-c189 Tainted: G
> L 3.18.0+ #106
> [15763.517087] task: ffff880096b4ada0 ti: ffff8802253d0000 task.ti:
> ffff8802253d0000
> [15763.517776] RIP: 0010:[<[15779.306349] INFO: rcu_sched detected
> stalls on CPUs/tasks:
> [15779.307024] (detected by 0, t=6002 jiffies, g=481360, c=481359,
> q=0)
> [15779.307662] INFO: Stall ended before state dump start
> [15787.421647] NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s!
> [kworker/u16:3:14112]
> [15787.422333] Modules linked in: bridge 8021q garp stp snd_seq_dummy
> dlci tun fuse rfcomm hidp bnep af_key llc2 nfnetlink can_bcm
> scsi_transport_iscsi can_raw sctp libcrc32c nfc caif_socket caif
> af_802154 ieee802154 phonet af_rxrpc bluetooth can pppoe pppox
> ppp_generic slhc irda crc_ccitt rds rose x25 atm netrom appletalk ipx
> p8023 psnap p8022 llc ax25 usb_debug cfg80211 rfkill coretemp hwmon
> x86_pkg_temp_thermal kvm_intel kvm crct10dif_pclmul crc32c_intel
> ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic microcode serio_raw pcspkr snd_hda_intel
> snd_hda_controller snd_hda_codec snd_hwdep snd_seq snd_seq_device
> snd_pcm e1000e ptp pps_core snd_timer snd soundcore shpchp nfsd
> auth_rpcgss oid_registry nfs_acl lockd grace sunrpc
> [15787.426946] CPU: 2 PID: 14112 Comm: kworker/u16:3 Tainted: G
> L 3.18.0+ #106
> [15787.429181] Workqueue: khelper __call_usermodehelper
> [15787.429945] task: ffff8801c95f0000 ti: ffff880227eac000 task.ti:
> ffff880227eac000
> [15787.430719] RIP: 0010:[<ffffffff817c3407>] [<ffffffff817c3407>]
> __slab_alloc+0x52f/0x58f
> [15787.431507] RSP: 0018:ffff880227eaf8f8 EFLAGS: 00000246
> [15787.432297] RAX: 0000000000000002 RBX: ffff8802304cf5c8 RCX:
> 00000000000002e0
> [15787.433094] RDX: ffff88024520d7e0 RSI: 0000000000000000 RDI:
> ffff880244802000
> [15787.433886] RBP: ffff880227eaf9e8 R08: 0000000000000000 R09:
> 0000000000000000
> [15787.434671] R10: 0000000000000092 R11: 0000000000000000 R12:
> ffffffff810135bf
> [15787.435452] R13: ffff880227eaf878 R14: 0000000100160015 R15:
> ffffffff8138278d
> [15787.436234] FS: 0000000000000000(0000) GS:ffff880245200000(0000)
> knlGS:0000000000000000
> [15787.437028] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15787.437816] CR2: 0000000000000008 CR3: 0000000225ab9000 CR4:
> 00000000001407e0
> [15787.438605] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15787.439400] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15787.440183] Stack:
> [15787.440959] 000000000000005c ffff880240f8d790 ffff880240f8d790
> ffff880240f8dd00
> [15787.441792] 0000000180230020 000000010000000f ffffffff8112ee12
> 0000000000000000
> [15787.442615] ffff8802453d7260 000000020023001f ffff880227eaf968
> ffffffff8138278d
> [15787.443422] Call Trace:
> [15787.444217] [<ffffffff8112ee12>] ? __delayacct_tsk_init+0x22/0x50
> [15787.445027] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15787.445833] [<ffffffff811ce860>] ? set_track+0x70/0x140
> [15787.446647] [<ffffffff811cf35d>] ? init_object+0x3d/0x70
> [15787.447449] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15787.448258] [<ffffffff811d295b>] kmem_cache_alloc+0x1cb/0x1f0
> [15787.449067] [<ffffffff8138278d>] __debug_object_init+0x43d/0x450
> [15787.449879] [<ffffffff813827bb>] debug_object_init+0x1b/0x20
> [15787.450688] [<ffffffff810e66d5>] hrtimer_init+0x25/0xb0
> [15787.451497] [<ffffffff8109f069>] __sched_fork+0x99/0x230
> [15787.452307] [<ffffffff810a59c9>] sched_fork+0x29/0x200
> [15787.453122] [<ffffffff8107568c>] copy_process.part.26+0x65c/0x1a40
> [15787.453928] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15787.454733] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15787.455524] [<ffffffff8108e340>] ? call_helper+0x20/0x20
> [15787.456299] [<ffffffff81076c37>] do_fork+0xe7/0x490
> [15787.457062] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15787.457826] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15787.458587] [<ffffffff81077006>] kernel_thread+0x26/0x30
> [15787.459336] [<ffffffff8108e1b4>] __call_usermodehelper+0x64/0x80
> [15787.460078] [<ffffffff8109301a>] process_one_work+0x1fa/0x550
> [15787.460794] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15787.461495] [<ffffffff8109348b>] worker_thread+0x11b/0x490
> [15787.462182] [<ffffffff81093370>] ? process_one_work+0x550/0x550
> [15787.462850] [<ffffffff81098c89>] kthread+0xf9/0x110
> [15787.463496] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15787.464124] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15787.464742] [<ffffffff817cfe6c>] ret_from_fork+0x7c/0xb0
> [15787.465341] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15787.465947] Code: 00 02 00 00 49 c7 45 00 00 00 00 00 75 11 ff b5
> 78 ff ff ff 9d e8 7a 6d 98 ff 4c 89 e0 eb 0f e8 70 6e 98 ff ff b5 78
> ff ff ff 9d <4c> 89 e0 48 8b 55 c8 65 48 33 14 25 28 00 00 00 74 3c
> e8 22 46
> [15787.467291] sending NMI to other CPUs:
> [15787.467904] NMI backtrace for cpu 3
> [15787.468463] CPU: 3 PID: 1650 Comm: trinity-c76 Tainted: G
> L 3.18.0+ #106
> [15787.470211] task: ffff8801adac4470 ti: ffff880180e04000 task.ti:
> ffff880180e04000
> [15787.470824] RIP: 0033:[<000000336eebc2fc>] [<000000336eebc2fc>]
> 0x336eebc2fc
> [15787.471440] RSP: 002b:00007fff123fb868 EFLAGS: 00000246
> [15787.472043] RAX: 0000000000000000 RBX: 0000000000000d7e RCX:
> ffffffffffffffff
> [15787.472652] RDX: 000000000000000b RSI: 00007fff123fb870 RDI:
> 0000000000000d7e
> [15787.473259] RBP: 0000000000000000 R08: 00007f79977d8740 R09:
> 0000000000000000
> [15787.473868] R10: 0000000000000000 R11: 0000000000000246 R12:
> 00007f7997265000
> [15787.474468] R13: 00007f7997265068 R14: 0000000000000000 R15:
> 0000000000000000
> [15787.475063] FS: 00007f79977d8740(0000) GS:ffff880245400000(0000)
> knlGS:0000000000000000
> [15787.475660] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15787.476254] CR2: 0000000000000001 CR3: 00000001c9593000 CR4:
> 00000000001407e0
> [15787.476851] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15787.477442] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15787.478032]
> [15787.478615] NMI backtrace for cpu 1
> [15787.479205] CPU: 1 PID: 2849 Comm: trinity-c95 Tainted: G
> L 3.18.0+ #106
> [15787.481052] task: ffff880096b4c470 ti: ffff880153a4c000 task.ti:
> ffff880153a4c000
> [15787.481696] RIP: 0010:[<ffffffff817cfea0>] [<ffffffff817cfea0>]
> system_call+0x0/0x3
> [15787.482351] RSP: 0018:00007fff123fb868 EFLAGS: 00000046
> [15787.483007] RAX: 000000000000003d RBX: 0000000000000d7f RCX:
> 000000336eebc2fc
> [15787.483674] RDX: 000000000000000b RSI: 00007fff123fb870 RDI:
> 0000000000000d7f
> [15787.484338] RBP: 0000000000000000 R08: 00007f79977d8740 R09:
> 0000000000000000
> [15787.485000] R10: 0000000000000000 R11: 0000000000000246 R12:
> 00007f799716e000
> [15787.485658] R13: 00007f799716e068 R14: 0000000000000000 R15:
> 0000000000000000
> [15787.486314] FS: 00007f79977d8740(0000) GS:ffff880245000000(0000)
> knlGS:0000000000000000
> [15787.486979] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15787.487641] CR2: 00007f7996f24220 CR3: 00000002251b4000 CR4:
> 00000000001407e0
> [15787.488311] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15787.488982] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15787.489650] Stack:
> [15787.490312] 000000000041401b 00007f79976944e8 00007f799716e000
> 0000000000000001
> [15787.490999] 00007f799716e07c 00007f799716e000 0000000000000000
> 00007f799716e07c
> [15787.491690] 0000000000416c03 00000000000066b2 0000000000000155
> 00000000cccccccd
> [15787.492383] Call Trace:
> [15787.493063] <UNK>
> [15787.493070] Code: 8b 3c 24 4c 8b 74 24 08 4c 8b 6c 24 10 4c 8b 64
> 24 18 48 8b 6c 24 20 48 8b 5c 24 28 48 83 c4 30 e9 74 02 00 00 66 0f
> 1f 44 00 00 <0f> 01 f8 65 48 89 24 25 80 a0 00 00 65 48 8b 24 25 08
> aa 00 00
> [15787.495270] NMI backtrace for cpu 0
> [15787.495987] CPU: 0 PID: 1876 Comm: trinity-c189 Tainted: G
> L 3.18.0+ #106
> [15787.498136] task: ffff880096b4ada0 ti: ffff8802253d0000 task.ti:
> ffff8802253d0000
> [15787.498870] RIP: 0010:[<ffffffff810c9698>] [<ffffffff810c9698>]
> do_raw_spin_trylock+0x8/0x50
> [15787.499618] RSP: 0018:ffff880244e03d00 EFLAGS: 00000092
> [15787.500344] RAX: ffff880096b4ada0 RBX: ffff880240c51578 RCX:
> ffff880244fcff98
> [15787.501064] RDX: 0000000000004a4a RSI: 0000000000000018 RDI:
> ffff880240c51578
> [15787.501780] RBP: ffff880244e03d38 R08: 0000000000000001 R09:
> 0000000000000000
> [15787.502487] R10: 0000000000000000 R11: 0000000000000000 R12:
> ffff880240c51590
> [15787.503190] R13: 0000000000000092 R14: ff[15811.407761] NMI
> watchdog: BUG: soft lockup - CPU#2 stuck for 22s!
> [kworker/u16:3:14112]
> [15811.408334] Modules linked in: bridge 8021q garp stp snd_seq_dummy
> dlci tun fuse rfcomm hidp bnep af_key llc2 nfnetlink can_bcm
> scsi_transport_iscsi can_raw sctp libcrc32c nfc caif_socket caif
> af_802154 ieee802154 phonet af_rxrpc bluetooth can pppoe pppox
> ppp_generic slhc irda crc_ccitt rds rose x25 atm netrom appletalk ipx
> p8023 psnap p8022 llc ax25 usb_debug cfg80211 rfkill coretemp hwmon
> x86_pkg_temp_thermal kvm_intel kvm crct10dif_pclmul crc32c_intel
> ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic microcode serio_raw pcspkr snd_hda_intel
> snd_hda_controller snd_hda_codec snd_hwdep snd_seq snd_seq_device
> snd_pcm e1000e ptp pps_core snd_timer snd soundcore shpchp nfsd
> auth_rpcgss oid_registry nfs_acl lockd grace sunrpc
> [15811.412296] CPU: 2 PID: 14112 Comm: kworker/u16:3 Tainted: G
> L 3.18.0+ #106
> [15811.414324] Workqueue: khelper __call_usermodehelper
> [15811.415025] task: ffff8801c95f0000 ti: ffff880227eac000 task.ti:
> ffff880227eac000
> [15811.415733] RIP: 0010:[<ffffffff817c3407>] [<ffffffff817c3407>]
> __slab_alloc+0x52f/0x58f
> [15811.416455] RSP: 0018:ffff880227eaf8f8 EFLAGS: 00000246
> [15811.417171] RAX: 0000000000000002 RBX: ffff8802304cf5c8 RCX:
> 00000000000002e0
> [15811.417913] RDX: ffff88024520d7e0 RSI: 0000000000000000 RDI:
> ffff880244802000
> [15811.418645] RBP: ffff880227eaf9e8 R08: 0000000000000000 R09:
> 0000000000000000
> [15811.419374] R10: 0000000000000092 R11: 0000000000000000 R12:
> ffffffff810135bf
> [15811.420102] R13: ffff880227eaf878 R14: 0000000100160015 R15:
> ffffffff8138278d
> [15811.420831] FS: 0000000000000000(0000) GS:ffff880245200000(0000)
> knlGS:0000000000000000
> [15811.421572] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15811.422317] CR2: 0000000000000008 CR3: 0000000225ab9000 CR4:
> 00000000001407e0
> [15811.423070] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15811.423828] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15811.424583] Stack:
> [15811.425327] 000000000000005c ffff880240f8d790 ffff880240f8d790
> ffff880240f8dd00
> [15811.426099] 0000000180230020 000000010000000f ffffffff8112ee12
> 0000000000000000
> [15811.426872] ffff8802453d7260 000000020023001f ffff880227eaf968
> ffffffff8138278d
> [15811.427657] Call Trace:
> [15811.428437] [<ffffffff8112ee12>] ? __delayacct_tsk_init+0x22/0x50
> [15811.429231] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15811.430025] [<ffffffff811ce860>] ? set_track+0x70/0x140
> [15811.430814] [<ffffffff811cf35d>] ? init_object+0x3d/0x70
> [15811.431600] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15811.432394] [<ffffffff811d295b>] kmem_cache_alloc+0x1cb/0x1f0
> [15811.433180] [<ffffffff8138278d>] __debug_object_init+0x43d/0x450
> [15811.433972] [<ffffffff813827bb>] debug_object_init+0x1b/0x20
> [15811.434768] [<ffffffff810e66d5>] hrtimer_init+0x25/0xb0
> [15811.435559] [<ffffffff8109f069>] __sched_fork+0x99/0x230
> [15811.436349] [<ffffffff810a59c9>] sched_fork+0x29/0x200
> [15811.437141] [<ffffffff8107568c>] copy_process.part.26+0x65c/0x1a40
> [15811.437937] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15811.438725] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15811.439519] [<ffffffff8108e340>] ? call_helper+0x20/0x20
> [15811.440307] [<ffffffff81076c37>] do_fork+0xe7/0x490
> [15811.441094] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15811.441871] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15811.442637] [<ffffffff81077006>] kernel_thread+0x26/0x30
> [15811.443385] [<ffffffff8108e1b4>] __call_usermodehelper+0x64/0x80
> [15811.444121] [<ffffffff8109301a>] process_one_work+0x1fa/0x550
> [15811.444838] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15811.445538] [<ffffffff8109348b>] worker_thread+0x11b/0x490
> [15811.446219] [<ffffffff81093370>] ? process_one_work+0x550/0x550
> [15811.446883] [<ffffffff81098c89>] kthread+0xf9/0x110
> [15811.447527] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15811.448159] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15811.448776] [<ffffffff817cfe6c>] ret_from_fork+0x7c/0xb0
> [15811.449371] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15811.449968] Code: 00 02 00 00 49 c7 45 00 00 00 00 00 75 11 ff b5
> 78 ff ff ff 9d e8 7a 6d 98 ff 4c 89 e0 eb 0f e8 70 6e 98 ff ff b5 78
> ff ff ff 9d <4c> 89 e0 48 8b 55 c8 65 48 33 14 25 28 00 00 00 74 3c
> e8 22 46
> [15811.451292] sending NMI to other CPUs:
> [15811.451901] NMI backtrace for cpu 3
> [15811.452459] CPU: 3 PID: 1650 Comm: trinity-c76 Tainted: G
> L 3.18.0+ #106
> [15811.454206] task: ffff8801adac4470 ti: ffff880180e04000 task.ti:
> ffff880180e04000
> [15811.454817] RIP: 0010:[<ffffffff810c511a>] [<ffffffff810c511a>]
> __lock_acquire.isra.31+0x21a/0x9f0
> [15811.455437] RSP: 0018:ffff880180e07d18 EFLAGS: 00000002
> [15811.456045] RAX: 0000000000000008 RBX: ffff8801adac4470 RCX:
> 0000000000000000
> [15811.456660] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
> 0000000000000000
> [15811.457274] RBP: ffff880180e07d88 R08: 0000000000000001 R09:
> 0000000000000000
> [15811.457889] R10: 0000000000000000 R11: 0000000000000000 R12:
> 000000000000014e
> [15811.458493] R13: 0000000000000000 R14: ffff880227cc4db8 R15:
> ffff8801adac4be0
> [15811.459092] FS: 00007f79977d8740(0000) GS:ffff880245400000(0000)
> knlGS:0000000000000000
> [15811.459699] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15811.460303] CR2: 0000000000000001 CR3: 00000001c9593000 CR4:
> 00000000001407e0
> [15811.460907] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15811.461507] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15811.462108] Stack:
> [15811.462702] ffff880180e07d98 ffffffff810c512c 0000000000000102
> 0000000000000000
> [15811.463325] ffff880180e07d48 ffffffff810abaf5 ffff880180e07dc8
> 0000000000000000
> [15811.463945] ffff880180e07dd8 0000000000000046 0000000000000000
> 0000000000000000
> [15811.464564] Call Trace:
> [15811.465173] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15811.465797] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15811.466421] [<ffffffff810c5fff>] lock_acquire+0x9f/0x120
> [15811.467047] [<ffffffff810bcc8d>] ? remove_wait_queue+0x1d/0x40
> [15811.467672] [<ffffffff817cf0a9>] _raw_spin_lock_irqsave+0x49/0x90
> [15811.468300] [<ffffffff810bcc8d>] ? remove_wait_queue+0x1d/0x40
> [15811.468924] [<ffffffff810bcc8d>] remove_wait_queue+0x1d/0x40
> [15811.469546] [<ffffffff8107a95b>] do_wait+0x14b/0x280
> [15811.470166] [<ffffffff8107aeb0>] SyS_wait4+0x80/0x110
> [15811.470782] [<ffffffff81078990>] ? task_stopped_code+0x60/0x60
> [15811.471398] [<ffffffff817d0109>] tracesys_phase2+0xd4/0xd9
> [15811.472011] Code: e0 7f 44 09 d0 41 88 47 31 41 0f b6 47 32 83 e0
> f0 45 85 c0 0f 95 c2 09 c8 c1 e2 03 09 d0 41 88 47 32 0f b7 55 18 41
> 0f b7 47 32 <c1> e2 04 83 e0 0f 09 d0 66 41 89 47 32 e8 a4 69 fe ff
> 4c 8b 4d
> [15811.473409] NMI backtrace for cpu 1
> [15811.474061] CPU: 1 PID: 2849 Comm: trinity-c95 Tainted: G
> L 3.18.0+ #106
> [15811.476098] task: ffff880096b4c470 ti: ffff880153a4c000 task.ti:
> ffff880153a4c000
> [15811.476808] RIP: 0010:[<ffffffff810c63cf>] [<ffffffff810c63cf>]
> lock_release+0x1f/0x240
> [15811.477535] RSP: 0018:ffff880153a4fe40 EFLAGS: 00000246
> [15811.478253] RAX: ffff880096b4c470 RBX: 0000000000000000 RCX:
> 00000000000003a0
> [15811.478982] RDX: ffffffff81086d0c RSI: 0000000000000001 RDI:
> ffffffff81c50e20
> [15811.479707] RBP: ffff880153a4fe48 R08: 0000000000000000 R09:
> 0000000000000000
> [15811.480419] R10: 0000000000000000 R11: 0000000000000000 R12:
> ffff880094be64c0
> [15811.481115] R13: ffff880153a4feb0 R14: 0000000000000000 R15:
> 0000000000000000
> [15811.481803] FS: 00007f79977d8740(0000) GS:ffff880245000000(0000)
> knlGS:0000000000000000
> [15811.482504] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15811.483200] CR2: 00007f7996f24220 CR3: 00000002251b4000 CR4:
> 00000000001407e0
> [15811.483890] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15811.484562] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15811.485221] Stack:
> [15811.485862] 0000000000000000 ffff880153a4fe88 ffffffff81086d24
> ffffffff81086ca5
> [15811.486521] 0000000000000d7f 0000000000000d7f 0000000000000000
> ffff880096[15835.393872] NMI watchdog: BUG: soft lockup - CPU#2 stuck
> for 22s! [kworker/u16:3:14112]
> [15835.394432] Modules linked in: bridge 8021q garp stp snd_seq_dummy
> dlci tun fuse rfcomm hidp bnep af_key llc2 nfnetlink can_bcm
> scsi_transport_iscsi can_raw sctp libcrc32c nfc caif_socket caif
> af_802154 ieee802154 phonet af_rxrpc bluetooth can pppoe pppox
> ppp_generic slhc irda crc_ccitt rds rose x25 atm netrom appletalk ipx
> p8023 psnap p8022 llc ax25 usb_debug cfg80211 rfkill coretemp hwmon
> x86_pkg_temp_thermal kvm_intel kvm crct10dif_pclmul crc32c_intel
> ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic microcode serio_raw pcspkr snd_hda_intel
> snd_hda_controller snd_hda_codec snd_hwdep snd_seq snd_seq_device
> snd_pcm e1000e ptp pps_core snd_timer snd soundcore shpchp nfsd
> auth_rpcgss oid_registry nfs_acl lockd grace sunrpc
> [15835.398378] CPU: 2 PID: 14112 Comm: kworker/u16:3 Tainted: G
> L 3.18.0+ #106
> [15835.400379] Workqueue: khelper __call_usermodehelper
> [15835.401080] task: ffff8801c95f0000 ti: ffff880227eac000 task.ti:
> ffff880227eac000
> [15835.401795] RIP: 0010:[<ffffffff817c3407>] [<ffffffff817c3407>]
> __slab_alloc+0x52f/0x58f
> [15835.402534] RSP: 0018:ffff880227eaf8f8 EFLAGS: 00000246
> [15835.403252] RAX: 0000000000000002 RBX: ffff8802304cf5c8 RCX:
> 00000000000002e0
> [15835.403995] RDX: ffff88024520d7e0 RSI: 0000000000000000 RDI:
> ffff880244802000
> [15835.404727] RBP: ffff880227eaf9e8 R08: 0000000000000000 R09:
> 0000000000000000
> [15835.405456] R10: 0000000000000092 R11: 0000000000000000 R12:
> ffffffff810135bf
> [15835.406185] R13: ffff880227eaf878 R14: 0000000100160015 R15:
> ffffffff8138278d
> [15835.406916] FS: 0000000000000000(0000) GS:ffff880245200000(0000)
> knlGS:0000000000000000
> [15835.407667] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15835.408410] CR2: 0000000000000008 CR3: 0000000225ab9000 CR4:
> 00000000001407e0
> [15835.409165] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15835.409924] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15835.410679] Stack:
> [15835.411433] 000000000000005c ffff880240f8d790 ffff880240f8d790
> ffff880240f8dd00
> [15835.412226] 0000000180230020 000000010000000f ffffffff8112ee12
> 0000000000000000
> [15835.413002] ffff8802453d7260 000000020023001f ffff880227eaf968
> ffffffff8138278d
> [15835.413784] Call Trace:
> [15835.414563] [<ffffffff8112ee12>] ? __delayacct_tsk_init+0x22/0x50
> [15835.415358] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15835.416162] [<ffffffff811ce860>] ? set_track+0x70/0x140
> [15835.416952] [<ffffffff811cf35d>] ? init_object+0x3d/0x70
> [15835.417745] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15835.418533] [<ffffffff811d295b>] kmem_cache_alloc+0x1cb/0x1f0
> [15835.419328] [<ffffffff8138278d>] __debug_object_init+0x43d/0x450
> [15835.420114] [<ffffffff813827bb>] debug_object_init+0x1b/0x20
> [15835.420904] [<ffffffff810e66d5>] hrtimer_init+0x25/0xb0
> [15835.421701] [<ffffffff8109f069>] __sched_fork+0x99/0x230
> [15835.422491] [<ffffffff810a59c9>] sched_fork+0x29/0x200
> [15835.423282] [<ffffffff8107568c>] copy_process.part.26+0x65c/0x1a40
> [15835.424077] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15835.424865] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15835.425658] [<ffffffff8108e340>] ? call_helper+0x20/0x20
> [15835.426447] [<ffffffff81076c37>] do_fork+0xe7/0x490
> [15835.427239] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15835.428018] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15835.428776] [<ffffffff81077006>] kernel_thread+0x26/0x30
> [15835.429525] [<ffffffff8108e1b4>] __call_usermodehelper+0x64/0x80
> [15835.430259] [<ffffffff8109301a>] process_one_work+0x1fa/0x550
> [15835.430986] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15835.431694] [<ffffffff8109348b>] worker_thread+0x11b/0x490
> [15835.432374] [<ffffffff81093370>] ? process_one_work+0x550/0x550
> [15835.433049] [<ffffffff81098c89>] kthread+0xf9/0x110
> [15835.433694] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15835.434328] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15835.434947] [<ffffffff817cfe6c>] ret_from_fork+0x7c/0xb0
> [15835.435543] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15835.436148] Code: 00 02 00 00 49 c7 45 00 00 00 00 00 75 11 ff b5
> 78 ff ff ff 9d e8 7a 6d 98 ff 4c 89 e0 eb 0f e8 70 6e 98 ff ff b5 78
> ff ff ff 9d <4c> 89 e0 48 8b 55 c8 65 48 33 14 25 28 00 00 00 74 3c
> e8 22 46
> [15835.437494] sending NMI to other CPUs:
>
>
next prev parent reply other threads:[~2014-12-18 15:55 UTC|newest]
Thread overview: 488+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-11-14 21:31 frequent lockups in 3.18rc4 Dave Jones
2014-11-14 22:01 ` Linus Torvalds
2014-11-14 22:30 ` Dave Jones
2014-11-14 22:55 ` Thomas Gleixner
2014-11-14 23:32 ` Dave Jones
2014-11-15 0:36 ` Thomas Gleixner
2014-11-15 2:40 ` Dave Jones
2014-11-16 12:16 ` Thomas Gleixner
2014-11-15 1:59 ` Linus Torvalds
2014-11-17 21:22 ` Linus Torvalds
2014-11-17 22:31 ` Thomas Gleixner
2014-11-17 22:43 ` Thomas Gleixner
2014-11-17 22:58 ` Jens Axboe
2014-11-17 23:59 ` Linus Torvalds
2014-11-18 0:15 ` Thomas Gleixner
2014-11-17 23:04 ` Jens Axboe
2014-11-17 23:17 ` Thomas Gleixner
2014-11-18 2:23 ` Jens Axboe
2014-11-15 21:34 ` Dave Jones
2014-11-16 1:40 ` Dave Jones
2014-11-16 6:33 ` Linus Torvalds
2014-11-16 10:06 ` Markus Trippelsdorf
2014-11-16 18:33 ` Linus Torvalds
2014-11-17 17:03 ` Dave Jones
2014-11-17 19:59 ` Linus Torvalds
2014-11-18 2:09 ` Dave Jones
2014-11-18 2:21 ` Linus Torvalds
2014-11-18 2:39 ` Dave Jones
2014-11-18 2:51 ` Linus Torvalds
2014-11-18 14:52 ` Dave Jones
2014-11-18 17:20 ` Linus Torvalds
2014-11-18 19:28 ` Thomas Gleixner
2014-11-18 21:25 ` Don Zickus
2014-11-18 21:31 ` Dave Jones
2014-11-18 18:54 ` Thomas Gleixner
2014-11-18 21:55 ` Don Zickus
2014-11-18 22:02 ` Dave Jones
2014-11-19 14:41 ` Don Zickus
2014-11-19 15:03 ` Vivek Goyal
2014-11-19 15:38 ` Dave Jones
2014-11-19 16:28 ` Vivek Goyal
2014-11-20 16:10 ` Dave Jones
2014-11-20 16:48 ` Vivek Goyal
2014-11-20 17:38 ` Dave Jones
2014-11-21 9:46 ` Dave Young
2014-11-20 16:54 ` Vivek Goyal
2014-11-20 9:54 ` Dave Young
2014-11-19 2:19 ` Dave Jones
2014-11-19 4:40 ` Linus Torvalds
2014-11-19 4:59 ` Dave Jones
2014-11-19 5:15 ` Dave Jones
2014-11-20 14:36 ` Frederic Weisbecker
2014-11-19 14:59 ` Dave Jones
2014-11-19 17:22 ` Linus Torvalds
2014-11-19 17:40 ` Linus Torvalds
2014-11-19 19:02 ` Frederic Weisbecker
2014-11-19 19:03 ` Andy Lutomirski
2014-11-19 23:00 ` Frederic Weisbecker
2014-11-19 23:07 ` Andy Lutomirski
2014-11-19 23:13 ` Frederic Weisbecker
2014-11-19 21:56 ` Thomas Gleixner
2014-11-19 22:56 ` Frederic Weisbecker
2014-11-19 22:59 ` Andy Lutomirski
2014-11-19 23:07 ` Frederic Weisbecker
2014-11-19 23:09 ` Thomas Gleixner
2014-11-19 23:50 ` Frederic Weisbecker
2014-11-20 12:23 ` Tejun Heo
2014-11-20 21:58 ` Thomas Gleixner
2014-11-20 22:06 ` Andy Lutomirski
2014-11-20 22:11 ` Tejun Heo
2014-11-20 22:42 ` Thomas Gleixner
2014-11-20 23:05 ` Tejun Heo
2014-11-20 23:08 ` Andy Lutomirski
2014-11-20 23:34 ` Linus Torvalds
2014-11-20 23:39 ` Tejun Heo
2014-11-20 23:55 ` Andy Lutomirski
2014-11-21 16:27 ` Tejun Heo
2014-11-21 16:38 ` Andy Lutomirski
2014-11-21 16:48 ` Linus Torvalds
2014-11-21 17:08 ` Steven Rostedt
2014-11-21 17:19 ` Linus Torvalds
2014-11-21 17:22 ` Andy Lutomirski
2014-11-21 18:22 ` Linus Torvalds
2014-11-21 18:28 ` Andy Lutomirski
2014-11-21 19:06 ` Linus Torvalds
2014-11-21 19:23 ` Steven Rostedt
2014-11-21 19:34 ` Linus Torvalds
2014-11-21 19:46 ` Linus Torvalds
2014-11-21 19:52 ` Andy Lutomirski
2014-11-21 20:14 ` Josh Boyer
2014-11-21 20:16 ` Andy Lutomirski
2014-11-21 20:23 ` Josh Boyer
2014-11-24 18:48 ` Konrad Rzeszutek Wilk
2014-11-24 19:07 ` Josh Boyer
2014-11-25 5:36 ` Jürgen Groß
2014-11-25 17:22 ` Linus Torvalds
2014-11-21 20:00 ` Dave Jones
2014-11-21 20:02 ` Andy Lutomirski
2014-11-21 19:51 ` Thomas Gleixner
2014-11-21 20:00 ` Linus Torvalds
2014-11-21 20:16 ` Thomas Gleixner
2014-11-21 20:41 ` Linus Torvalds
2014-11-21 21:11 ` Thomas Gleixner
2014-11-21 22:55 ` Linus Torvalds
2014-11-21 23:03 ` Andy Lutomirski
2014-11-21 23:33 ` Linus Torvalds
2014-12-16 19:28 ` Peter Zijlstra
2014-12-16 20:46 ` Linus Torvalds
2014-12-16 21:19 ` Mel Gorman
2014-12-16 23:02 ` Peter Zijlstra
2014-12-17 0:00 ` Linus Torvalds
2014-12-17 0:41 ` Andy Lutomirski
2014-12-17 17:01 ` Konrad Rzeszutek Wilk
2014-12-17 17:14 ` Peter Zijlstra
2014-11-21 22:33 ` Konrad Rzeszutek Wilk
2014-11-21 22:33 ` Konrad Rzeszutek Wilk
2014-11-22 1:17 ` Thomas Gleixner
2014-11-22 1:17 ` Thomas Gleixner
2014-11-21 17:34 ` Steven Rostedt
2014-11-21 18:24 ` Linus Torvalds
2014-11-21 22:10 ` Frederic Weisbecker
2014-11-21 2:33 ` Steven Rostedt
2014-11-21 0:54 ` Thomas Gleixner
2014-11-21 14:13 ` Frederic Weisbecker
2014-11-21 16:25 ` Tejun Heo
2014-11-21 17:01 ` Steven Rostedt
2014-11-21 17:11 ` Steven Rostedt
2014-11-21 21:32 ` Frederic Weisbecker
2014-11-21 21:34 ` Andy Lutomirski
2014-11-21 21:50 ` Frederic Weisbecker
2014-11-21 22:45 ` Steven Rostedt
2014-11-21 21:44 ` Frederic Weisbecker
2014-11-22 0:11 ` Tejun Heo
2014-11-22 0:18 ` Linus Torvalds
2014-11-22 0:41 ` Andy Lutomirski
2014-11-19 23:54 ` Andy Lutomirski
2014-11-20 0:00 ` Thomas Gleixner
2014-11-20 0:30 ` Andy Lutomirski
2014-11-20 0:40 ` Linus Torvalds
2014-11-20 0:49 ` Andy Lutomirski
2014-11-20 1:07 ` Linus Torvalds
2014-11-20 1:16 ` Andy Lutomirski
2014-11-20 2:42 ` Linus Torvalds
2014-11-20 6:16 ` Andy Lutomirski
2014-11-19 19:15 ` Andy Lutomirski
2014-11-19 19:38 ` Linus Torvalds
2014-11-19 22:18 ` Dave Jones
2014-11-19 21:01 ` Andy Lutomirski
2014-11-19 21:47 ` Dave Jones
2014-11-19 21:58 ` Borislav Petkov
2014-11-19 22:18 ` Dave Jones
2014-11-20 10:33 ` Borislav Petkov
2014-11-19 21:56 ` [PATCH] x86, syscall: Fix _TIF_NOHZ handling in syscall_trace_enter_phase1 Andy Lutomirski
2014-11-19 22:13 ` Thomas Gleixner
2014-11-20 20:33 ` Linus Torvalds
2014-11-20 22:07 ` Thomas Gleixner
2014-11-20 22:04 ` [tip:x86/urgent] " tip-bot for Andy Lutomirski
2014-11-20 15:25 ` frequent lockups in 3.18rc4 Dave Jones
2014-11-20 19:43 ` Linus Torvalds
2014-11-20 20:06 ` Dave Jones
2014-11-20 20:37 ` Don Zickus
2014-11-20 20:51 ` Linus Torvalds
2014-11-21 6:37 ` Ingo Molnar
2014-11-21 14:50 ` Dave Jones
2014-11-25 12:22 ` Will Deacon
2014-12-01 11:48 ` Will Deacon
2014-12-01 17:05 ` Linus Torvalds
2014-12-01 17:10 ` Will Deacon
2014-12-01 17:53 ` Linus Torvalds
2014-12-01 18:25 ` Kirill A. Shutemov
2014-12-01 18:36 ` Linus Torvalds
2014-12-04 10:51 ` Will Deacon
2014-12-04 14:56 ` Dave Jones
2014-12-05 13:49 ` Will Deacon
2014-11-20 15:04 ` Frederic Weisbecker
2014-11-20 15:08 ` Frederic Weisbecker
2014-11-20 16:19 ` Dave Jones
2014-11-20 16:42 ` Frederic Weisbecker
2014-11-26 0:25 ` Dave Jones
2014-11-26 1:48 ` Linus Torvalds
2014-11-26 2:40 ` Dave Jones
2014-11-26 22:57 ` Dave Jones
2014-11-27 0:46 ` Linus Torvalds
2014-11-27 19:17 ` Linus Torvalds
2014-11-27 22:56 ` Dave Jones
2014-11-29 20:38 ` Dâniel Fraga
2014-11-30 20:45 ` Linus Torvalds
2014-11-30 21:21 ` Dâniel Fraga
2014-12-01 0:21 ` Linus Torvalds
2014-12-01 1:02 ` Dâniel Fraga
2014-12-01 19:14 ` Paul E. McKenney
2014-12-01 20:28 ` Dâniel Fraga
2014-12-01 20:36 ` Linus Torvalds
2014-12-01 23:08 ` Chris Mason
2014-12-01 23:25 ` Linus Torvalds
2014-12-01 23:44 ` Chris Mason
2014-12-02 0:39 ` Linus Torvalds
2014-12-02 14:13 ` Mike Galbraith
2014-12-02 16:33 ` Linus Torvalds
2014-12-02 17:14 ` Chris Mason
2014-12-03 18:41 ` Dave Jones
2014-12-03 18:45 ` Linus Torvalds
2014-12-03 19:00 ` Dave Jones
2014-12-03 19:25 ` Linus Torvalds
2014-12-03 19:30 ` Dave Jones
2014-12-03 19:48 ` Linus Torvalds
2014-12-03 20:09 ` Dave Jones
2014-12-03 20:37 ` Linus Torvalds
2014-12-03 20:55 ` Thomas Gleixner
2014-12-03 21:14 ` Linus Torvalds
2014-12-03 22:19 ` Thomas Gleixner
2014-12-03 23:21 ` Dave Jones
2014-12-03 23:49 ` Thomas Gleixner
2014-12-04 0:19 ` Linus Torvalds
2014-12-04 1:02 ` Thomas Gleixner
2014-12-04 0:20 ` Dave Jones
2014-12-04 0:59 ` Thomas Gleixner
2014-12-04 1:32 ` Dave Jones
2014-12-04 3:45 ` Dave Jones
2014-12-03 19:56 ` John Stultz
2014-12-03 20:37 ` Thomas Gleixner
2014-12-03 20:44 ` Dave Jones
2014-12-03 20:59 ` Thomas Gleixner
2014-12-03 21:05 ` Dave Jones
2014-12-03 21:48 ` Thomas Gleixner
2014-12-03 20:39 ` Thomas Gleixner
2014-12-04 3:15 ` Chris Mason
2014-12-04 5:49 ` Linus Torvalds
2014-12-04 14:57 ` Chris Mason
2014-12-04 15:22 ` Dave Hansen
2014-12-04 15:30 ` Chris Mason
2014-12-03 19:59 ` Chris Mason
2014-12-03 20:11 ` Dave Jones
2014-12-03 20:56 ` Chris Mason
2014-12-04 0:27 ` Dave Jones
2014-12-05 17:15 ` Dave Jones
2014-12-05 18:38 ` Linus Torvalds
2014-12-05 18:48 ` Dave Jones
2014-12-05 19:31 ` Linus Torvalds
2014-12-05 19:37 ` Dave Jones
2014-12-06 22:38 ` Thomas Gleixner
2014-12-06 9:37 ` Chuck Ebbert
2014-12-06 16:22 ` Martin van Es
2014-12-06 20:09 ` Linus Torvalds
2014-12-06 20:41 ` Linus Torvalds
2014-12-06 21:14 ` Martin van Es
2014-12-12 12:58 ` Martin van Es
2014-12-15 12:07 ` Martin van Es
2014-12-06 22:14 ` Thomas Gleixner
2014-12-05 19:04 ` Chris Mason
2014-12-05 19:29 ` Linus Torvalds
2014-12-11 14:54 ` Dave Jones
2014-12-11 21:49 ` Linus Torvalds
2014-12-11 21:52 ` Sasha Levin
2014-12-11 21:57 ` Chris Mason
2014-12-11 22:00 ` Sasha Levin
2014-12-11 22:36 ` Linus Torvalds
2014-12-11 22:57 ` Sasha Levin
2014-12-12 6:54 ` Ingo Molnar
2014-12-12 23:54 ` Sasha Levin
2014-12-13 0:23 ` Linus Torvalds
2014-12-13 0:34 ` Sasha Levin
2014-12-13 0:44 ` Linus Torvalds
2014-12-13 16:28 ` Jeff Chua
2014-12-13 2:32 ` Dave Jones
2014-12-11 21:57 ` Borislav Petkov
2014-12-12 3:03 ` Dave Jones
2014-12-12 4:45 ` Dave Jones
2014-12-12 14:38 ` Dave Jones
2014-12-12 18:24 ` Paul E. McKenney
2014-12-12 18:10 ` Paul E. McKenney
2014-12-12 18:42 ` Dave Jones
2014-12-12 18:54 ` Dave Jones
2014-12-12 19:14 ` Linus Torvalds
2014-12-12 19:23 ` Dave Jones
2014-12-12 19:58 ` David Lang
2014-12-12 20:20 ` Linus Torvalds
2014-12-13 7:43 ` Ingo Molnar
2014-12-12 20:34 ` Paul E. McKenney
2014-12-12 21:23 ` Sasha Levin
2014-12-13 0:58 ` Paul E. McKenney
2014-12-13 12:08 ` Paul E. McKenney
2014-12-13 8:30 ` Ingo Molnar
2014-12-13 15:53 ` Sasha Levin
2014-12-13 18:07 ` Paul E. McKenney
2014-12-14 17:50 ` Paul E. McKenney
2014-12-14 23:46 ` Sasha Levin
2014-12-15 0:11 ` Paul E. McKenney
2014-12-15 1:20 ` Sasha Levin
2014-12-15 6:33 ` Paul E. McKenney
2014-12-15 12:56 ` Paul E. McKenney
2014-12-15 13:16 ` Sasha Levin
2014-12-16 3:40 ` Paul E. McKenney
2014-12-13 7:36 ` [PATCH] sched: Fix lost reschedule in __cond_resched() Ingo Molnar
2014-12-14 18:04 ` Frederic Weisbecker
2014-12-14 19:43 ` Ingo Molnar
2014-12-14 19:50 ` Linus Torvalds
2014-12-14 20:30 ` Frederic Weisbecker
2014-12-13 8:19 ` frequent lockups in 3.18rc4 Ingo Molnar
2014-12-13 8:27 ` Ingo Molnar
2014-12-13 14:15 ` Sasha Levin
2014-12-13 16:59 ` Dave Jones
2014-12-13 18:04 ` Paul E. McKenney
2014-12-13 20:41 ` Dave Jones
2014-12-14 4:04 ` Paul E. McKenney
2014-12-13 22:36 ` Dave Jones
2014-12-13 22:40 ` Linus Torvalds
2014-12-13 22:59 ` Linus Torvalds
2014-12-13 23:09 ` Linus Torvalds
2014-12-13 23:35 ` Al Viro
2014-12-13 23:38 ` Linus Torvalds
2014-12-13 23:47 ` Al Viro
2014-12-14 0:14 ` Linus Torvalds
2014-12-14 0:33 ` Al Viro
2014-12-14 1:35 ` Linus Torvalds
2014-12-14 3:14 ` Al Viro
2014-12-15 0:18 ` Al Viro
2014-12-13 23:39 ` Al Viro
2014-12-14 23:46 ` Dave Jones
2014-12-15 0:38 ` Linus Torvalds
2014-12-15 0:42 ` Dave Jones
2014-12-15 5:47 ` Linus Torvalds
2014-12-15 5:57 ` Dave Jones
2014-12-15 18:21 ` Linus Torvalds
2014-12-15 23:46 ` Linus Torvalds
2014-12-18 2:42 ` Sasha Levin
2014-12-18 2:45 ` Linus Torvalds
2014-12-18 5:13 ` Dave Jones
2014-12-18 15:54 ` Chris Mason [this message]
2014-12-18 16:12 ` Dave Jones
2014-12-19 2:45 ` Dave Jones
2014-12-19 3:49 ` Linus Torvalds
2014-12-19 3:58 ` Dave Jones
2014-12-19 4:03 ` Dave Jones
2014-12-19 4:48 ` Linus Torvalds
2014-12-19 11:35 ` Peter Zijlstra
2014-12-19 14:55 ` Dave Jones
2014-12-19 15:14 ` Chris Mason
2014-12-19 19:15 ` Linus Torvalds
2014-12-19 19:44 ` Peter Zijlstra
2014-12-19 19:51 ` Linus Torvalds
2014-12-19 20:46 ` Linus Torvalds
2014-12-19 20:54 ` Dave Jones
2014-12-19 22:05 ` Linus Torvalds
2014-12-20 16:49 ` Dave Jones
2014-12-19 20:31 ` Chris Mason
2014-12-19 20:36 ` Dave Jones
2014-12-19 23:22 ` Thomas Gleixner
2014-12-20 0:12 ` Chris Mason
2014-12-20 1:06 ` Thomas Gleixner
2014-12-19 23:14 ` Thomas Gleixner
2014-12-19 23:55 ` Linus Torvalds
2014-12-20 1:00 ` Thomas Gleixner
2014-12-20 1:57 ` Linus Torvalds
2014-12-20 18:25 ` Linus Torvalds
2014-12-20 21:16 ` Linus Torvalds
2014-12-21 3:52 ` Paul E. McKenney
2014-12-21 21:22 ` Linus Torvalds
2014-12-21 22:19 ` Linus Torvalds
2014-12-21 22:32 ` Dave Jones
2014-12-21 23:58 ` Linus Torvalds
2014-12-22 0:41 ` Linus Torvalds
2014-12-22 0:52 ` Linus Torvalds
2014-12-22 1:22 ` Dave Jones
2014-12-22 3:11 ` Paul E. McKenney
2014-12-22 19:47 ` Linus Torvalds
2014-12-22 20:06 ` Linus Torvalds
2014-12-22 22:57 ` Dave Jones
2014-12-22 23:59 ` Linus Torvalds
2014-12-23 14:56 ` Dave Jones
2014-12-24 13:58 ` Sasha Levin
2014-12-24 3:01 ` Dave Jones
2014-12-26 16:34 ` Dave Jones
2014-12-26 18:12 ` Dave Jones
2014-12-26 20:57 ` Linus Torvalds
2014-12-26 21:20 ` Dave Jones
2014-12-26 22:57 ` Dave Jones
2014-12-26 23:16 ` Linus Torvalds
2014-12-27 0:36 ` Dave Jones
2014-12-27 3:14 ` Linus Torvalds
2014-12-27 16:48 ` Dave Jones
2014-12-26 23:30 ` Linus Torvalds
2014-12-27 0:39 ` Dave Jones
2014-12-27 2:53 ` Dave Jones
2015-01-03 0:27 ` John Stultz
2015-01-03 14:58 ` Sasha Levin
2015-01-04 19:46 ` Linus Torvalds
2015-01-06 1:17 ` John Stultz
2015-01-06 1:25 ` Linus Torvalds
2015-01-06 2:05 ` John Stultz
2014-12-22 23:59 ` John Stultz
2014-12-23 0:46 ` Linus Torvalds
2014-12-27 20:33 ` Paul E. McKenney
2015-01-12 10:05 ` Thomas Gleixner
2014-12-19 14:30 ` Chris Mason
2014-12-19 15:12 ` Dave Jones
2014-12-18 18:54 ` Linus Torvalds
2014-12-15 14:00 ` Borislav Petkov
2014-12-18 21:17 ` save_xstate_sig (Re: frequent lockups in 3.18rc4) Andy Lutomirski
2014-12-18 21:34 ` Linus Torvalds
2014-12-18 21:41 ` Andy Lutomirski
2014-12-18 21:37 ` Dave Jones
2014-12-17 18:22 ` frequent lockups in 3.18rc4 Dave Jones
2014-12-17 18:57 ` Dave Jones
2014-12-17 19:24 ` Dave Jones
2014-12-17 19:51 ` Linus Torvalds
2014-12-17 20:16 ` Dave Jones
2014-12-17 19:41 ` Linus Torvalds
2014-12-06 5:04 ` Gene Heskett
2014-12-02 17:47 ` Mike Galbraith
2014-12-13 8:11 ` Ingo Molnar
2014-12-13 9:57 ` Mike Galbraith
2014-12-17 11:13 ` Peter Zijlstra
2014-12-02 19:32 ` Dave Jones
2014-12-02 23:32 ` Sasha Levin
2014-12-03 0:09 ` Linus Torvalds
2014-12-03 0:25 ` Sasha Levin
2014-12-05 5:00 ` Sasha Levin
2014-12-05 6:38 ` Linus Torvalds
2014-12-05 15:03 ` Sasha Levin
2014-12-05 18:15 ` Linus Torvalds
2014-12-07 14:58 ` Sasha Levin
2014-12-07 18:24 ` Paul E. McKenney
2014-12-07 19:43 ` Paul E. McKenney
2014-12-07 23:28 ` Sasha Levin
2014-12-08 5:20 ` Paul E. McKenney
2014-12-08 14:33 ` Sasha Levin
2014-12-08 15:28 ` Sasha Levin
2014-12-08 15:57 ` Paul E. McKenney
2014-12-08 16:34 ` Sasha Levin
2014-12-08 15:56 ` Paul E. McKenney
2014-12-07 23:53 ` Linus Torvalds
2014-12-02 19:31 ` Dave Jones
2014-12-02 21:17 ` Linus Torvalds
2014-12-02 20:30 ` Dave Jones
2014-12-02 20:48 ` Paul E. McKenney
2014-12-01 23:08 ` Paul E. McKenney
2014-12-02 16:43 ` Dâniel Fraga
2014-12-02 17:04 ` Paul E. McKenney
2014-12-02 17:14 ` Dâniel Fraga
2014-12-02 18:42 ` Paul E. McKenney
2014-12-02 18:47 ` Dâniel Fraga
2014-12-02 19:11 ` Paul E. McKenney
2014-12-02 19:24 ` Dâniel Fraga
2014-12-02 20:56 ` Paul E. McKenney
2014-12-02 22:01 ` Dâniel Fraga
2014-12-02 22:10 ` Paul E. McKenney
2014-12-02 22:18 ` Dâniel Fraga
2014-12-02 22:35 ` Paul E. McKenney
2014-12-02 22:10 ` Linus Torvalds
2014-12-02 22:16 ` Dâniel Fraga
2014-12-03 3:21 ` Dâniel Fraga
2014-12-03 4:14 ` Linus Torvalds
2014-12-03 4:51 ` Dâniel Fraga
2014-12-03 6:02 ` Chris Rorvick
2014-12-03 15:22 ` Linus Torvalds
2014-12-04 8:43 ` Dâniel Fraga
2014-12-04 16:18 ` Linus Torvalds
2014-12-04 16:52 ` Frederic Weisbecker
2014-12-04 17:25 ` Dâniel Fraga
2014-12-04 17:47 ` Linus Torvalds
2014-12-04 18:07 ` Dâniel Fraga
2014-12-03 14:54 ` Tejun Heo
2014-12-02 18:09 ` Paul E. McKenney
2014-12-02 18:41 ` Dâniel Fraga
2014-12-02 17:08 ` Linus Torvalds
2014-12-02 17:16 ` Dâniel Fraga
2014-12-02 8:40 ` Lai Jiangshan
2014-12-02 16:58 ` Paul E. McKenney
2014-12-02 16:58 ` Dâniel Fraga
2014-12-02 17:17 ` Paul E. McKenney
2014-12-03 2:03 ` Lai Jiangshan
2014-12-03 5:22 ` Paul E. McKenney
2014-12-01 16:56 ` Don Zickus
2014-11-26 4:39 ` Jürgen Groß
[not found] ` <CA+55aFx1SiFBzmA=k9jHxi3cZE3Ei_+2NHepujgf86KEvkz8eQ@mail.gmail.com>
2014-11-26 5:11 ` Dave Jones
2014-11-26 5:24 ` Juergen Gross
2014-11-26 5:52 ` Linus Torvalds
2014-11-26 6:21 ` Linus Torvalds
2014-11-26 6:52 ` Juergen Gross
2014-11-26 9:44 ` Juergen Gross
2014-11-26 14:34 ` Dave Jones
2014-11-26 17:37 ` Linus Torvalds
2014-11-20 15:28 ` Frederic Weisbecker
2014-11-17 15:07 ` Don Zickus
-- strict thread matches above, loose matches on Subject: below --
2014-12-16 3:04 Hillf Danton
2015-02-12 11:09 Martin van Es
2015-02-12 16:01 ` Linus Torvalds
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1418918059.17358.6@mail.thefacebook.com \
--to=clm@fb.com \
--cc=davej@redhat.com \
--cc=fragabr@gmail.com \
--cc=hpa@linux.intel.com \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@kernel.org \
--cc=oleg@redhat.com \
--cc=paulmck@linux.vnet.ibm.com \
--cc=peterz@infradead.org \
--cc=sasha.levin@oracle.com \
--cc=sbsiddha@gmail.com \
--cc=torvalds@linux-foundation.org \
--cc=umgwanakikbuti@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.