From: Chris Mason <clm@fb.com>
To: Dave Jones <davej@redhat.com>
Cc: "Linus Torvalds" <torvalds@linux-foundation.org>,
"Mike Galbraith" <umgwanakikbuti@gmail.com>,
"Ingo Molnar" <mingo@kernel.org>,
"Peter Zijlstra" <peterz@infradead.org>,
"Dâniel Fraga" <fragabr@gmail.com>,
"Sasha Levin" <sasha.levin@oracle.com>,
"Paul E. McKenney" <paulmck@linux.vnet.ibm.com>,
"Linux Kernel Mailing List" <linux-kernel@vger.kernel.org>,
"Suresh Siddha" <sbsiddha@gmail.com>,
"Oleg Nesterov" <oleg@redhat.com>,
"Peter Anvin" <hpa@linux.intel.com>
Subject: Re: frequent lockups in 3.18rc4
Date: Thu, 18 Dec 2014 10:54:19 -0500 [thread overview]
Message-ID: <1418918059.17358.6@mail.thefacebook.com> (raw)
In-Reply-To: <20141218051327.GA31988@redhat.com>
On Thu, Dec 18, 2014 at 12:13 AM, Dave Jones <davej@redhat.com> wrote:
> On Mon, Dec 15, 2014 at 03:46:41PM -0800, Linus Torvalds wrote:
> > On Mon, Dec 15, 2014 at 10:21 AM, Linus Torvalds
> > <torvalds@linux-foundation.org> wrote:
> > >
> > > So let's just fix it. Here's a completely untested patch.
> >
> > So after looking at this more, I'm actually really convinced that
> this
> > was a pretty nasty bug.
> >
> > I'm *not* convinced that it's necessarily *your* bug, but I still
> > think it could be.
>
> Bah, I was getting all optimistic.
> I came home this evening to a locked up machine.
> Serial console had a *lot* more traces than usual though.
> Full log below. The 12xxx.xxxxxx traces we seemed to recover from,
> followed by silence for a while, before the real fun begins at
> 157xx.xxxxxx
CPU 2 seems to be the one making the least progress. I think he's
calling fork and then trying to allocate a debug object for his
hrtimer, eventually wandering into fill_pool from __debug_object_init():
static void fill_pool(void)
{
gfp_t gfp = GFP_ATOMIC | __GFP_NORETRY | __GFP_NOWARN;
struct debug_obj *new;
unsigned long flags;
if (likely(obj_pool_free >= ODEBUG_POOL_MIN_LEVEL))
return;
if (unlikely(!obj_cache))
return;
while (obj_pool_free < ODEBUG_POOL_MIN_LEVEL) {
new = kmem_cache_zalloc(obj_cache, gfp);
if (!new)
return;
raw_spin_lock_irqsave(&pool_lock, flags);
hlist_add_head(&new->node, &obj_pool);
obj_pool_free++;
raw_spin_unlock_irqrestore(&pool_lock, flags);
}
}
It doesn't seem to be making progress out of __slab_alloc+0x52f/0x58f,
but maybe the slab code is just a victim of being called in a while
loop with GFP_ATOMIC set from a starvation prone loop. Can you please
line up where 0x52f is in __slab_alloc?
It might be fun to run with CONFIG_DEBUG_OBJECTS off...Linus' patch
clearly helped, I think we're off in a different bug now.
> [12669.359905] Code: 66 2e 0f 1f 84 00 00 00 00 00 55 48 89 e5 41 57
> 41 56 41 55 41 54 53 48 83 ec 48 44 8b 25 48 80 be 00 65 48 8b 1c 25
> 00 aa 00 00 <45> 85 e4 0f 84 ef 00 00 00 44 8b 1d e7 32 ab 01 49 89
> fe 41 89
> [12669.361354] INFO: NMI handler
> (arch_trigger_all_cpu_backtrace_handler) took too long to run: 88.798
> msecs
> [15739.449422] NMI watchdog: BUG: soft lockup - CPU#2 stuck for 22s!
> [kworker/u16:3:14112]
> [15739.450087] Modules linked in: bridge 8021q garp stp snd_seq_dummy
> dlci tun fuse rfcomm hidp bnep af_key llc2 nfnetlink can_bcm
> scsi_transport_iscsi can_raw sctp libcrc32c nfc caif_socket caif
> af_802154 ieee802154 phonet af_rxrpc bluetooth can pppoe pppox
> ppp_generic slhc irda crc_ccitt rds rose x25 atm netrom appletalk ipx
> p8023 psnap p8022 llc ax25 usb_debug cfg80211 rfkill coretemp hwmon
> x86_pkg_temp_thermal kvm_intel kvm crct10dif_pclmul crc32c_intel
> ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic microcode serio_raw pcspkr snd_hda_intel
> snd_hda_controller snd_hda_codec snd_hwdep snd_seq snd_seq_device
> snd_pcm e1000e ptp pps_core snd_timer snd soundcore shpchp nfsd
> auth_rpcgss oid_registry nfs_acl lockd grace sunrpc
> [15739.454475] CPU: 2 PID: 14112 Comm: kworker/u16:3 Tainted: G
> L 3.18.0+ #106
> [15739.456686] Workqueue: khelper __call_usermodehelper
> [15739.457473] task: ffff8801c95f0000 ti: ffff880227eac000 task.ti:
> ffff880227eac000
> [15739.458231] RIP: 0010:[<ffffffff817c3407>] [<ffffffff817c3407>]
> __slab_alloc+0x52f/0x58f
> [15739.459015] RSP: 0018:ffff880227eaf8f8 EFLAGS: 00000246
> [15739.459794] RAX: 0000000000000002 RBX: ffff8802304cf5c8 RCX:
> 00000000000002e0
> [15739.460570] RDX: ffff88024520d7e0 RSI: 0000000000000000 RDI:
> ffff880244802000
> [15739.461343] RBP: ffff880227eaf9e8 R08: 0000000000000000 R09:
> 0000000000000000
> [15739.462113] R10: 0000000000000092 R11: 0000000000000000 R12:
> ffffffff810135bf
> [15739.462885] R13: ffff880227eaf878 R14: 0000000100160015 R15:
> ffffffff8138278d
> [15739.463648] FS: 0000000000000000(0000) GS:ffff880245200000(0000)
> knlGS:0000000000000000
> [15739.464431] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15739.465203] CR2: 0000000000000008 CR3: 0000000225ab9000 CR4:
> 00000000001407e0
> [15739.465985] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15739.466766] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15739.467542] Stack:
> [15739.468308] 000000000000005c ffff880240f8d790 ffff880240f8d790
> ffff880240f8dd00
> [15739.469106] 0000000180230020 000000010000000f ffffffff8112ee12
> 0000000000000000
> [15739.469912] ffff8802453d7260 000000020023001f ffff880227eaf968
> ffffffff8138278d
> [15739.470717] Call Trace:
> [15739.471511] [<ffffffff8112ee12>] ? __delayacct_tsk_init+0x22/0x50
> [15739.472325] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15739.473138] [<ffffffff811ce860>] ? set_track+0x70/0x140
> [15739.473947] [<ffffffff811cf35d>] ? init_object+0x3d/0x70
> [15739.474757] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15739.475571] [<ffffffff811d295b>] kmem_cache_alloc+0x1cb/0x1f0
> [15739.476374] [<ffffffff8138278d>] __debug_object_init+0x43d/0x450
> [15739.477174] [<ffffffff813827bb>] debug_object_init+0x1b/0x20
> [15739.477983] [<ffffffff810e66d5>] hrtimer_init+0x25/0xb0
> [15739.478781] [<ffffffff8109f069>] __sched_fork+0x99/0x230
> [15739.479590] [<ffffffff810a59c9>] sched_fork+0x29/0x200
> [15739.480387] [<ffffffff8107568c>] copy_process.part.26+0x65c/0x1a40
> [15739.481184] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15739.481983] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15739.482797] [<ffffffff8108e340>] ? call_helper+0x20/0x20
> [15739.483598] [<ffffffff81076c37>] do_fork+0xe7/0x490
> [15739.484382] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15739.485160] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15739.485922] [<ffffffff81077006>] kernel_thread+0x26/0x30
> [15739.486669] [<ffffffff8108e1b4>] __call_usermodehelper+0x64/0x80
> [15739.487407] [<ffffffff8109301a>] process_one_work+0x1fa/0x550
> [15739.488126] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15739.488834] [<ffffffff8109348b>] worker_thread+0x11b/0x490
> [15739.489529] [<ffffffff81093370>] ? process_one_work+0x550/0x550
> [15739.490197] [<ffffffff81098c89>] kthread+0xf9/0x110
> [15739.490845] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15739.491474] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15739.492092] [<ffffffff817cfe6c>] ret_from_fork+0x7c/0xb0
> [15739.492689] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15739.493288] Code: 00 02 00 00 49 c7 45 00 00 00 00 00 75 11 ff b5
> 78 ff ff ff 9d e8 7a 6d 98 ff 4c 89 e0 eb 0f e8 70 6e 98 ff ff b5 78
> ff ff ff 9d <4c> 89 e0 48 8b 55 c8 65 48 33 14 25 28 00 00 00 74 3c
> e8 22 46
> [15739.494617] sending NMI to other CPUs:
> [15739.495221] NMI backtrace for cpu 3
> [15739.495787] CPU: 3 PID: 1650 Comm: trinity-c76 Tainted: G
> L 3.18.0+ #106
> [15739.497539] task: ffff8801adac4470 ti: ffff880180e04000 task.ti:
> ffff880180e04000
> [15739.498153] RIP: 0010:[<ffffffff810c6014>] [<ffffffff810c6014>]
> lock_acquire+0xb4/0x120
> [15739.498772] RSP: 0018:ffff880180e07dd8 EFLAGS: 00000246
> [15739.499382] RAX: ffff8801adac4470 RBX: 0000000000000246 RCX:
> ffff8802455cff98
> [15739.499994] RDX: 00000000000006a0 RSI: 0000000000000000 RDI:
> 0000000000000000
> [15739.500609] RBP: ffff880180e07e38 R08: 0000000000000000 R09:
> 0000000000000000
> [15739.501224] R10: 0000000000000000 R11: 0000000000000000 R12:
> 0000000000000000
> [15739.501829] R13: 0000000000000000 R14: 0000000000000002 R15:
> 0000000000000000
> [15739.502422] FS: 00007f79977d8740(0000) GS:ffff880245400000(0000)
> knlGS:0000000000000000
> [15739.503021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15739.503621] CR2: 0000000000000001 CR3: 00000001c9593000 CR4:
> 00000000001407e0
> [15739.504217] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15739.504812] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15739.505403] Stack:
> [15739.505988] ffffffff8107a8e9 0000000000000000 ffff8801adac4470
> 0000000000000246
> [15739.506603] 0000000127cc4da0 ffffffff81c0a098 ffff8801adac4470
> ffffffff81c0a080
> [15739.507220] ffffffff81c0a098 ffff8801adac4470 ffff8801adac4470
> ffff8801adac4470
> [15739.507839] Call Trace:
> [15739.508448] [<ffffffff8107a8e9>] ? do_wait+0xd9/0x280
> [15739.509064] [<ffffffff817cf3d1>] _raw_read_lock+0x41/0x80
> [15739.509678] [<ffffffff8107a8e9>] ? do_wait+0xd9/0x280
> [15739.510293] [<ffffffff8107a8e9>] do_wait+0xd9/0x280
> [15739.510907] [<ffffffff8107aeb0>] SyS_wait4+0x80/0x110
> [15739.511518] [<ffffffff81078990>] ? task_stopped_code+0x60/0x60
> [15739.512130] [<ffffffff817d0109>] tracesys_phase2+0xd4/0xd9
> [15739.512739] Code: d8 49 c1 e8 09 48 89 04 24 49 83 f0 01 41 83 e0
> 01 e8 01 ef ff ff 65 48 8b 04 25 00 aa 00 00 c7 80 6c 07 00 00 00 00
> 00 00 53 9d <48> 83 c4 38 5b 41 5c 41 5d 41 5e 41 5f 5d c3 0f 1f 44
> 00 00 65
> [15739.514121] NMI backtrace for cpu 1
> [15739.514769] CPU: 1 PID: 2849 Comm: trinity-c95 Tainted: G
> L 3.18.0+ #106
> [15739.516771] task: ffff880096b4c470 ti: ffff880153a4c000 task.ti:
> ffff880153a4c000
> [15739.517467] RIP: 0010:[<ffffffff810961f9>] [<ffffffff810961f9>]
> find_pid_ns+0x39/0x90
> [15739.518177] RSP: 0018:ffff880153a4fe78 EFLAGS: 00000207
> [15739.518884] RAX: ffff88024e517120 RBX: 0000000000000d7f RCX:
> 0000000000000034
> [15739.519599] RDX: ffff880094be6500 RSI: ffffffff81c486c0 RDI:
> 0000000000000d7f
> [15739.520316] RBP: ffff880153a4fe78 R08: 0000000000000000 R09:
> 0000000000000000
> [15739.521036] R10: 0000000000000000 R11: 0000000000000000 R12:
> 0000000000000000
> [15739.521752] R13: ffff880096b4c470 R14: 0000000000000000 R15:
> 0000000000000000
> [15739.522464] FS: 00007f79977d8740(0000) GS:ffff880245000000(0000)
> knlGS:0000000000000000
> [15739.523181] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15739.523882] CR2: 00007f7996f24220 CR3: 00000002251b4000 CR4:
> 00000000001407e0
> [15739.524580] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15739.525269] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15739.525957] Stack:
> [15739.526632] ffff880153a4fe88 ffffffff8109627f ffff880153a4ff68
> ffffffff81086e2a
> [15739.527319] ffffffff81086df8 0000000000000000 ffff880096b4c840
> 0000000000000000
> [15739.527992] ffff880100000000 000003e800000b21 ffff880094be64c0
> 00007fff123fb870
> [15739.528656] Call Trace:
> [15739.529301] [<ffffffff8109627f>] find_vpid+0x2f/0x50
> [15739.529947] [<ffffffff81086e2a>] SYSC_kill+0xba/0x240
> [15739.530587] [<ffffffff81086df8>] ? SYSC_kill+0x88/0x240
> [15739[15763.435537] NMI watchdog: BUG: soft lockup - CPU#2 stuck for
> 22s! [kworker/u16:3:14112]
> [15763.436252] Modules linked in: bridge 8021q garp stp snd_seq_dummy
> dlci tun fuse rfcomm hidp bnep af_key llc2 nfnetlink can_bcm
> scsi_transport_iscsi can_raw sctp libcrc32c nfc caif_socket caif
> af_802154 ieee802154 phonet af_rxrpc bluetooth can pppoe pppox
> ppp_generic slhc irda crc_ccitt rds rose x25 atm netrom appletalk ipx
> p8023 psnap p8022 llc ax25 usb_debug cfg80211 rfkill coretemp hwmon
> x86_pkg_temp_thermal kvm_intel kvm crct10dif_pclmul crc32c_intel
> ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic microcode serio_raw pcspkr snd_hda_intel
> snd_hda_controller snd_hda_codec snd_hwdep snd_seq snd_seq_device
> snd_pcm e1000e ptp pps_core snd_timer snd soundcore shpchp nfsd
> auth_rpcgss oid_registry nfs_acl lockd grace sunrpc
> [15763.441025] CPU: 2 PID: 14112 Comm: kworker/u16:3 Tainted: G
> L 3.18.0+ #106
> [15763.443320] Workqueue: khelper __call_usermodehelper
> [15763.444090] task: ffff8801c95f0000 ti: ffff880227eac000 task.ti:
> ffff880227eac000
> [15763.444861] RIP: 0010:[<ffffffff817c3407>] [<ffffffff817c3407>]
> __slab_alloc+0x52f/0x58f
> [15763.445654] RSP: 0018:ffff880227eaf8f8 EFLAGS: 00000246
> [15763.446422] RAX: 0000000000000002 RBX: ffff8802304cf5c8 RCX:
> 00000000000002e0
> [15763.447201] RDX: ffff88024520d7e0 RSI: 0000000000000000 RDI:
> ffff880244802000
> [15763.447985] RBP: ffff880227eaf9e8 R08: 0000000000000000 R09:
> 0000000000000000
> [15763.448764] R10: 0000000000000092 R11: 0000000000000000 R12:
> ffffffff810135bf
> [15763.449545] R13: ffff880227eaf878 R14: 0000000100160015 R15:
> ffffffff8138278d
> [15763.450319] FS: 0000000000000000(0000) GS:ffff880245200000(0000)
> knlGS:0000000000000000
> [15763.451100] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15763.451876] CR2: 0000000000000008 CR3: 0000000225ab9000 CR4:
> 00000000001407e0
> [15763.452662] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15763.453451] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15763.454230] Stack:
> [15763.455003] 000000000000005c ffff880240f8d790 ffff880240f8d790
> ffff880240f8dd00
> [15763.455818] 0000000180230020 000000010000000f ffffffff8112ee12
> 0000000000000000
> [15763.456608] ffff8802453d7260 000000020023001f ffff880227eaf968
> ffffffff8138278d
> [15763.457393] Call Trace:
> [15763.458166] [<ffffffff8112ee12>] ? __delayacct_tsk_init+0x22/0x50
> [15763.458960] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15763.459753] [<ffffffff811ce860>] ? set_track+0x70/0x140
> [15763.460544] [<ffffffff811cf35d>] ? init_object+0x3d/0x70
> [15763.461338] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15763.462127] [<ffffffff811d295b>] kmem_cache_alloc+0x1cb/0x1f0
> [15763.462921] [<ffffffff8138278d>] __debug_object_init+0x43d/0x450
> [15763.463707] [<ffffffff813827bb>] debug_object_init+0x1b/0x20
> [15763.464503] [<ffffffff810e66d5>] hrtimer_init+0x25/0xb0
> [15763.465294] [<ffffffff8109f069>] __sched_fork+0x99/0x230
> [15763.466086] [<ffffffff810a59c9>] sched_fork+0x29/0x200
> [15763.466875] [<ffffffff8107568c>] copy_process.part.26+0x65c/0x1a40
> [15763.467664] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15763.468458] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15763.469251] [<ffffffff8108e340>] ? call_helper+0x20/0x20
> [15763.470041] [<ffffffff81076c37>] do_fork+0xe7/0x490
> [15763.470828] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15763.471603] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15763.472371] [<ffffffff81077006>] kernel_thread+0x26/0x30
> [15763.473120] [<ffffffff8108e1b4>] __call_usermodehelper+0x64/0x80
> [15763.473854] [<ffffffff8109301a>] process_one_work+0x1fa/0x550
> [15763.474578] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15763.475287] [<ffffffff8109348b>] worker_thread+0x11b/0x490
> [15763.475975] [<ffffffff81093370>] ? process_one_work+0x550/0x550
> [15763.476640] [<ffffffff81098c89>] kthread+0xf9/0x110
> [15763.477285] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15763.477915] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15763.478532] [<ffffffff817cfe6c>] ret_from_fork+0x7c/0xb0
> [15763.479131] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15763.479741] Code: 00 02 00 00 49 c7 45 00 00 00 00 00 75 11 ff b5
> 78 ff ff ff 9d e8 7a 6d 98 ff 4c 89 e0 eb 0f e8 70 6e 98 ff ff b5 78
> ff ff ff 9d <4c> 89 e0 48 8b 55 c8 65 48 33 14 25 28 00 00 00 74 3c
> e8 22 46
> [15763.481087] sending NMI to other CPUs:
> [15763.481693] NMI backtrace for cpu 3
> [15763.482255] CPU: 3 PID: 1650 Comm: trinity-c76 Tainted: G
> L 3.18.0+ #106
> [15763.484005] task: ffff8801adac4470 ti: ffff880180e04000 task.ti:
> ffff880180e04000
> [15763.484618] RIP: 0010:[<ffffffff810c47f5>] [<ffffffff810c47f5>]
> lock_acquired+0x45/0x370
> [15763.485234] RSP: 0018:ffff880180e07db8 EFLAGS: 00000046
> [15763.485841] RAX: 0000000000000001 RBX: ffff880227cc4da0 RCX:
> 0000000000000001
> [15763.486453] RDX: 000000000000dbdb RSI: ffffffff810bcc8d RDI:
> ffff880227cc4db8
> [15763.487068] RBP: ffff880180e07df8 R08: 0000000000000000 R09:
> 0000000000000001
> [15763.487687] R10: 0000000000000000 R11: 0000000000000000 R12:
> ffff8801adac4470
> [15763.488303] R13: ffff880227cc4db8 R14: 0000000000000046 R15:
> ffff8801adac4460
> [15763.488909] FS: 00007f79977d8740(0000) GS:ffff880245400000(0000)
> knlGS:0000000000000000
> [15763.489522] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15763.490133] CR2: 0000000000000001 CR3: 00000001c9593000 CR4:
> 00000000001407e0
> [15763.490747] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15763.491356] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15763.491964] Stack:
> [15763.492564] 0000000100000002 ffffffff810bcc8d ffff880180e07dd8
> ffff880227cc4da0
> [15763.493194] ffff880227cc4db8 0000000000000292 ffff8801adac4470
> ffff8801adac4460
> [15763.493828] ffff880180e07e38 ffffffff817cf0d5 ffffffff810bcc8d
> 0000000000000296
> [15763.494464] Call Trace:
> [15763.495088] [<ffffffff810bcc8d>] ? remove_wait_queue+0x1d/0x40
> [15763.495726] [<ffffffff817cf0d5>] _raw_spin_lock_irqsave+0x75/0x90
> [15763.496364] [<ffffffff810bcc8d>] ? remove_wait_queue+0x1d/0x40
> [15763.497005] [<ffffffff810bcc8d>] remove_wait_queue+0x1d/0x40
> [15763.497645] [<ffffffff8107a95b>] do_wait+0x14b/0x280
> [15763.498283] [<ffffffff8107aeb0>] SyS_wait4+0x80/0x110
> [15763.498917] [<ffffffff81078990>] ? task_stopped_code+0x60/0x60
> [15763.499551] [<ffffffff817d0109>] tracesys_phase2+0xd4/0xd9
> [15763.500183] Code: b8 00 45 85 c9 0f 84 d8 00 00 00 65 4c 8b 24 25
> 00 aa 00 00 45 8b 84 24 6c 07 00 00 45 85 c0 0f 85 be 00 00 00 49 89
> fd 9c 41 5e <fa> 8b 35 1c 3a ab 01 41 c7 84 24 6c 07 00 00 01 00 00
> 00 41 8b
> [15763.501611] NMI backtrace for cpu 1
> [15763.502274] CPU: 1 PID: 3298 Comm: trinity-c183 Tainted: G
> L 3.18.0+ #106
> [15763.504345] task: ffff880227de16d0 ti: ffff880071060000 task.ti:
> ffff880071060000
> [15763.505065] RIP: 0033:[<000000336eebc2fc>] [<000000336eebc2fc>]
> 0x336eebc2fc
> [15763.505796] RSP: 002b:00007fff123fb868 EFLAGS: 00000246
> [15763.506522] RAX: 0000000000000000 RBX: 0000000000000d7b RCX:
> ffffffffffffffff
> [15763.507257] RDX: 000000000000000b RSI: 00007fff123fb870 RDI:
> 0000000000000d7b
> [15763.507994] RBP: 0000000000000000 R08: 00007f79977d8740 R09:
> 0000000000000000
> [15763.508729] R10: 0000000000000000 R11: 0000000000000246 R12:
> 00007f7996cf6000
> [15763.509460] R13: 00007f7996cf6068 R14: 0000000000000000 R15:
> 0000000000000000
> [15763.510188] FS: 00007f79977d8740(0000) GS:ffff880245000000(0000)
> knlGS:0000000000000000
> [15763.510908] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15763.511612] CR2: 00007f7996f24220 CR3: 000000009a646000 CR4:
> 00000000001407e0
> [15763.512319] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15763.513027] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15763.513727]
> [15763.514403] NMI backtrace for cpu 0
> [15763.515067] CPU: 0 PID: 1876 Comm: trinity-c189 Tainted: G
> L 3.18.0+ #106
> [15763.517087] task: ffff880096b4ada0 ti: ffff8802253d0000 task.ti:
> ffff8802253d0000
> [15763.517776] RIP: 0010:[<[15779.306349] INFO: rcu_sched detected
> stalls on CPUs/tasks:
> [15779.307024] (detected by 0, t=6002 jiffies, g=481360, c=481359,
> q=0)
> [15779.307662] INFO: Stall ended before state dump start
> [15787.421647] NMI watchdog: BUG: soft lockup - CPU#2 stuck for 23s!
> [kworker/u16:3:14112]
> [15787.422333] Modules linked in: bridge 8021q garp stp snd_seq_dummy
> dlci tun fuse rfcomm hidp bnep af_key llc2 nfnetlink can_bcm
> scsi_transport_iscsi can_raw sctp libcrc32c nfc caif_socket caif
> af_802154 ieee802154 phonet af_rxrpc bluetooth can pppoe pppox
> ppp_generic slhc irda crc_ccitt rds rose x25 atm netrom appletalk ipx
> p8023 psnap p8022 llc ax25 usb_debug cfg80211 rfkill coretemp hwmon
> x86_pkg_temp_thermal kvm_intel kvm crct10dif_pclmul crc32c_intel
> ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic microcode serio_raw pcspkr snd_hda_intel
> snd_hda_controller snd_hda_codec snd_hwdep snd_seq snd_seq_device
> snd_pcm e1000e ptp pps_core snd_timer snd soundcore shpchp nfsd
> auth_rpcgss oid_registry nfs_acl lockd grace sunrpc
> [15787.426946] CPU: 2 PID: 14112 Comm: kworker/u16:3 Tainted: G
> L 3.18.0+ #106
> [15787.429181] Workqueue: khelper __call_usermodehelper
> [15787.429945] task: ffff8801c95f0000 ti: ffff880227eac000 task.ti:
> ffff880227eac000
> [15787.430719] RIP: 0010:[<ffffffff817c3407>] [<ffffffff817c3407>]
> __slab_alloc+0x52f/0x58f
> [15787.431507] RSP: 0018:ffff880227eaf8f8 EFLAGS: 00000246
> [15787.432297] RAX: 0000000000000002 RBX: ffff8802304cf5c8 RCX:
> 00000000000002e0
> [15787.433094] RDX: ffff88024520d7e0 RSI: 0000000000000000 RDI:
> ffff880244802000
> [15787.433886] RBP: ffff880227eaf9e8 R08: 0000000000000000 R09:
> 0000000000000000
> [15787.434671] R10: 0000000000000092 R11: 0000000000000000 R12:
> ffffffff810135bf
> [15787.435452] R13: ffff880227eaf878 R14: 0000000100160015 R15:
> ffffffff8138278d
> [15787.436234] FS: 0000000000000000(0000) GS:ffff880245200000(0000)
> knlGS:0000000000000000
> [15787.437028] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15787.437816] CR2: 0000000000000008 CR3: 0000000225ab9000 CR4:
> 00000000001407e0
> [15787.438605] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15787.439400] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15787.440183] Stack:
> [15787.440959] 000000000000005c ffff880240f8d790 ffff880240f8d790
> ffff880240f8dd00
> [15787.441792] 0000000180230020 000000010000000f ffffffff8112ee12
> 0000000000000000
> [15787.442615] ffff8802453d7260 000000020023001f ffff880227eaf968
> ffffffff8138278d
> [15787.443422] Call Trace:
> [15787.444217] [<ffffffff8112ee12>] ? __delayacct_tsk_init+0x22/0x50
> [15787.445027] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15787.445833] [<ffffffff811ce860>] ? set_track+0x70/0x140
> [15787.446647] [<ffffffff811cf35d>] ? init_object+0x3d/0x70
> [15787.447449] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15787.448258] [<ffffffff811d295b>] kmem_cache_alloc+0x1cb/0x1f0
> [15787.449067] [<ffffffff8138278d>] __debug_object_init+0x43d/0x450
> [15787.449879] [<ffffffff813827bb>] debug_object_init+0x1b/0x20
> [15787.450688] [<ffffffff810e66d5>] hrtimer_init+0x25/0xb0
> [15787.451497] [<ffffffff8109f069>] __sched_fork+0x99/0x230
> [15787.452307] [<ffffffff810a59c9>] sched_fork+0x29/0x200
> [15787.453122] [<ffffffff8107568c>] copy_process.part.26+0x65c/0x1a40
> [15787.453928] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15787.454733] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15787.455524] [<ffffffff8108e340>] ? call_helper+0x20/0x20
> [15787.456299] [<ffffffff81076c37>] do_fork+0xe7/0x490
> [15787.457062] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15787.457826] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15787.458587] [<ffffffff81077006>] kernel_thread+0x26/0x30
> [15787.459336] [<ffffffff8108e1b4>] __call_usermodehelper+0x64/0x80
> [15787.460078] [<ffffffff8109301a>] process_one_work+0x1fa/0x550
> [15787.460794] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15787.461495] [<ffffffff8109348b>] worker_thread+0x11b/0x490
> [15787.462182] [<ffffffff81093370>] ? process_one_work+0x550/0x550
> [15787.462850] [<ffffffff81098c89>] kthread+0xf9/0x110
> [15787.463496] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15787.464124] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15787.464742] [<ffffffff817cfe6c>] ret_from_fork+0x7c/0xb0
> [15787.465341] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15787.465947] Code: 00 02 00 00 49 c7 45 00 00 00 00 00 75 11 ff b5
> 78 ff ff ff 9d e8 7a 6d 98 ff 4c 89 e0 eb 0f e8 70 6e 98 ff ff b5 78
> ff ff ff 9d <4c> 89 e0 48 8b 55 c8 65 48 33 14 25 28 00 00 00 74 3c
> e8 22 46
> [15787.467291] sending NMI to other CPUs:
> [15787.467904] NMI backtrace for cpu 3
> [15787.468463] CPU: 3 PID: 1650 Comm: trinity-c76 Tainted: G
> L 3.18.0+ #106
> [15787.470211] task: ffff8801adac4470 ti: ffff880180e04000 task.ti:
> ffff880180e04000
> [15787.470824] RIP: 0033:[<000000336eebc2fc>] [<000000336eebc2fc>]
> 0x336eebc2fc
> [15787.471440] RSP: 002b:00007fff123fb868 EFLAGS: 00000246
> [15787.472043] RAX: 0000000000000000 RBX: 0000000000000d7e RCX:
> ffffffffffffffff
> [15787.472652] RDX: 000000000000000b RSI: 00007fff123fb870 RDI:
> 0000000000000d7e
> [15787.473259] RBP: 0000000000000000 R08: 00007f79977d8740 R09:
> 0000000000000000
> [15787.473868] R10: 0000000000000000 R11: 0000000000000246 R12:
> 00007f7997265000
> [15787.474468] R13: 00007f7997265068 R14: 0000000000000000 R15:
> 0000000000000000
> [15787.475063] FS: 00007f79977d8740(0000) GS:ffff880245400000(0000)
> knlGS:0000000000000000
> [15787.475660] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15787.476254] CR2: 0000000000000001 CR3: 00000001c9593000 CR4:
> 00000000001407e0
> [15787.476851] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15787.477442] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15787.478032]
> [15787.478615] NMI backtrace for cpu 1
> [15787.479205] CPU: 1 PID: 2849 Comm: trinity-c95 Tainted: G
> L 3.18.0+ #106
> [15787.481052] task: ffff880096b4c470 ti: ffff880153a4c000 task.ti:
> ffff880153a4c000
> [15787.481696] RIP: 0010:[<ffffffff817cfea0>] [<ffffffff817cfea0>]
> system_call+0x0/0x3
> [15787.482351] RSP: 0018:00007fff123fb868 EFLAGS: 00000046
> [15787.483007] RAX: 000000000000003d RBX: 0000000000000d7f RCX:
> 000000336eebc2fc
> [15787.483674] RDX: 000000000000000b RSI: 00007fff123fb870 RDI:
> 0000000000000d7f
> [15787.484338] RBP: 0000000000000000 R08: 00007f79977d8740 R09:
> 0000000000000000
> [15787.485000] R10: 0000000000000000 R11: 0000000000000246 R12:
> 00007f799716e000
> [15787.485658] R13: 00007f799716e068 R14: 0000000000000000 R15:
> 0000000000000000
> [15787.486314] FS: 00007f79977d8740(0000) GS:ffff880245000000(0000)
> knlGS:0000000000000000
> [15787.486979] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15787.487641] CR2: 00007f7996f24220 CR3: 00000002251b4000 CR4:
> 00000000001407e0
> [15787.488311] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15787.488982] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15787.489650] Stack:
> [15787.490312] 000000000041401b 00007f79976944e8 00007f799716e000
> 0000000000000001
> [15787.490999] 00007f799716e07c 00007f799716e000 0000000000000000
> 00007f799716e07c
> [15787.491690] 0000000000416c03 00000000000066b2 0000000000000155
> 00000000cccccccd
> [15787.492383] Call Trace:
> [15787.493063] <UNK>
> [15787.493070] Code: 8b 3c 24 4c 8b 74 24 08 4c 8b 6c 24 10 4c 8b 64
> 24 18 48 8b 6c 24 20 48 8b 5c 24 28 48 83 c4 30 e9 74 02 00 00 66 0f
> 1f 44 00 00 <0f> 01 f8 65 48 89 24 25 80 a0 00 00 65 48 8b 24 25 08
> aa 00 00
> [15787.495270] NMI backtrace for cpu 0
> [15787.495987] CPU: 0 PID: 1876 Comm: trinity-c189 Tainted: G
> L 3.18.0+ #106
> [15787.498136] task: ffff880096b4ada0 ti: ffff8802253d0000 task.ti:
> ffff8802253d0000
> [15787.498870] RIP: 0010:[<ffffffff810c9698>] [<ffffffff810c9698>]
> do_raw_spin_trylock+0x8/0x50
> [15787.499618] RSP: 0018:ffff880244e03d00 EFLAGS: 00000092
> [15787.500344] RAX: ffff880096b4ada0 RBX: ffff880240c51578 RCX:
> ffff880244fcff98
> [15787.501064] RDX: 0000000000004a4a RSI: 0000000000000018 RDI:
> ffff880240c51578
> [15787.501780] RBP: ffff880244e03d38 R08: 0000000000000001 R09:
> 0000000000000000
> [15787.502487] R10: 0000000000000000 R11: 0000000000000000 R12:
> ffff880240c51590
> [15787.503190] R13: 0000000000000092 R14: ff[15811.407761] NMI
> watchdog: BUG: soft lockup - CPU#2 stuck for 22s!
> [kworker/u16:3:14112]
> [15811.408334] Modules linked in: bridge 8021q garp stp snd_seq_dummy
> dlci tun fuse rfcomm hidp bnep af_key llc2 nfnetlink can_bcm
> scsi_transport_iscsi can_raw sctp libcrc32c nfc caif_socket caif
> af_802154 ieee802154 phonet af_rxrpc bluetooth can pppoe pppox
> ppp_generic slhc irda crc_ccitt rds rose x25 atm netrom appletalk ipx
> p8023 psnap p8022 llc ax25 usb_debug cfg80211 rfkill coretemp hwmon
> x86_pkg_temp_thermal kvm_intel kvm crct10dif_pclmul crc32c_intel
> ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic microcode serio_raw pcspkr snd_hda_intel
> snd_hda_controller snd_hda_codec snd_hwdep snd_seq snd_seq_device
> snd_pcm e1000e ptp pps_core snd_timer snd soundcore shpchp nfsd
> auth_rpcgss oid_registry nfs_acl lockd grace sunrpc
> [15811.412296] CPU: 2 PID: 14112 Comm: kworker/u16:3 Tainted: G
> L 3.18.0+ #106
> [15811.414324] Workqueue: khelper __call_usermodehelper
> [15811.415025] task: ffff8801c95f0000 ti: ffff880227eac000 task.ti:
> ffff880227eac000
> [15811.415733] RIP: 0010:[<ffffffff817c3407>] [<ffffffff817c3407>]
> __slab_alloc+0x52f/0x58f
> [15811.416455] RSP: 0018:ffff880227eaf8f8 EFLAGS: 00000246
> [15811.417171] RAX: 0000000000000002 RBX: ffff8802304cf5c8 RCX:
> 00000000000002e0
> [15811.417913] RDX: ffff88024520d7e0 RSI: 0000000000000000 RDI:
> ffff880244802000
> [15811.418645] RBP: ffff880227eaf9e8 R08: 0000000000000000 R09:
> 0000000000000000
> [15811.419374] R10: 0000000000000092 R11: 0000000000000000 R12:
> ffffffff810135bf
> [15811.420102] R13: ffff880227eaf878 R14: 0000000100160015 R15:
> ffffffff8138278d
> [15811.420831] FS: 0000000000000000(0000) GS:ffff880245200000(0000)
> knlGS:0000000000000000
> [15811.421572] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15811.422317] CR2: 0000000000000008 CR3: 0000000225ab9000 CR4:
> 00000000001407e0
> [15811.423070] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15811.423828] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15811.424583] Stack:
> [15811.425327] 000000000000005c ffff880240f8d790 ffff880240f8d790
> ffff880240f8dd00
> [15811.426099] 0000000180230020 000000010000000f ffffffff8112ee12
> 0000000000000000
> [15811.426872] ffff8802453d7260 000000020023001f ffff880227eaf968
> ffffffff8138278d
> [15811.427657] Call Trace:
> [15811.428437] [<ffffffff8112ee12>] ? __delayacct_tsk_init+0x22/0x50
> [15811.429231] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15811.430025] [<ffffffff811ce860>] ? set_track+0x70/0x140
> [15811.430814] [<ffffffff811cf35d>] ? init_object+0x3d/0x70
> [15811.431600] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15811.432394] [<ffffffff811d295b>] kmem_cache_alloc+0x1cb/0x1f0
> [15811.433180] [<ffffffff8138278d>] __debug_object_init+0x43d/0x450
> [15811.433972] [<ffffffff813827bb>] debug_object_init+0x1b/0x20
> [15811.434768] [<ffffffff810e66d5>] hrtimer_init+0x25/0xb0
> [15811.435559] [<ffffffff8109f069>] __sched_fork+0x99/0x230
> [15811.436349] [<ffffffff810a59c9>] sched_fork+0x29/0x200
> [15811.437141] [<ffffffff8107568c>] copy_process.part.26+0x65c/0x1a40
> [15811.437937] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15811.438725] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15811.439519] [<ffffffff8108e340>] ? call_helper+0x20/0x20
> [15811.440307] [<ffffffff81076c37>] do_fork+0xe7/0x490
> [15811.441094] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15811.441871] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15811.442637] [<ffffffff81077006>] kernel_thread+0x26/0x30
> [15811.443385] [<ffffffff8108e1b4>] __call_usermodehelper+0x64/0x80
> [15811.444121] [<ffffffff8109301a>] process_one_work+0x1fa/0x550
> [15811.444838] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15811.445538] [<ffffffff8109348b>] worker_thread+0x11b/0x490
> [15811.446219] [<ffffffff81093370>] ? process_one_work+0x550/0x550
> [15811.446883] [<ffffffff81098c89>] kthread+0xf9/0x110
> [15811.447527] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15811.448159] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15811.448776] [<ffffffff817cfe6c>] ret_from_fork+0x7c/0xb0
> [15811.449371] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15811.449968] Code: 00 02 00 00 49 c7 45 00 00 00 00 00 75 11 ff b5
> 78 ff ff ff 9d e8 7a 6d 98 ff 4c 89 e0 eb 0f e8 70 6e 98 ff ff b5 78
> ff ff ff 9d <4c> 89 e0 48 8b 55 c8 65 48 33 14 25 28 00 00 00 74 3c
> e8 22 46
> [15811.451292] sending NMI to other CPUs:
> [15811.451901] NMI backtrace for cpu 3
> [15811.452459] CPU: 3 PID: 1650 Comm: trinity-c76 Tainted: G
> L 3.18.0+ #106
> [15811.454206] task: ffff8801adac4470 ti: ffff880180e04000 task.ti:
> ffff880180e04000
> [15811.454817] RIP: 0010:[<ffffffff810c511a>] [<ffffffff810c511a>]
> __lock_acquire.isra.31+0x21a/0x9f0
> [15811.455437] RSP: 0018:ffff880180e07d18 EFLAGS: 00000002
> [15811.456045] RAX: 0000000000000008 RBX: ffff8801adac4470 RCX:
> 0000000000000000
> [15811.456660] RDX: 0000000000000000 RSI: 0000000000000000 RDI:
> 0000000000000000
> [15811.457274] RBP: ffff880180e07d88 R08: 0000000000000001 R09:
> 0000000000000000
> [15811.457889] R10: 0000000000000000 R11: 0000000000000000 R12:
> 000000000000014e
> [15811.458493] R13: 0000000000000000 R14: ffff880227cc4db8 R15:
> ffff8801adac4be0
> [15811.459092] FS: 00007f79977d8740(0000) GS:ffff880245400000(0000)
> knlGS:0000000000000000
> [15811.459699] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15811.460303] CR2: 0000000000000001 CR3: 00000001c9593000 CR4:
> 00000000001407e0
> [15811.460907] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15811.461507] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15811.462108] Stack:
> [15811.462702] ffff880180e07d98 ffffffff810c512c 0000000000000102
> 0000000000000000
> [15811.463325] ffff880180e07d48 ffffffff810abaf5 ffff880180e07dc8
> 0000000000000000
> [15811.463945] ffff880180e07dd8 0000000000000046 0000000000000000
> 0000000000000000
> [15811.464564] Call Trace:
> [15811.465173] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15811.465797] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15811.466421] [<ffffffff810c5fff>] lock_acquire+0x9f/0x120
> [15811.467047] [<ffffffff810bcc8d>] ? remove_wait_queue+0x1d/0x40
> [15811.467672] [<ffffffff817cf0a9>] _raw_spin_lock_irqsave+0x49/0x90
> [15811.468300] [<ffffffff810bcc8d>] ? remove_wait_queue+0x1d/0x40
> [15811.468924] [<ffffffff810bcc8d>] remove_wait_queue+0x1d/0x40
> [15811.469546] [<ffffffff8107a95b>] do_wait+0x14b/0x280
> [15811.470166] [<ffffffff8107aeb0>] SyS_wait4+0x80/0x110
> [15811.470782] [<ffffffff81078990>] ? task_stopped_code+0x60/0x60
> [15811.471398] [<ffffffff817d0109>] tracesys_phase2+0xd4/0xd9
> [15811.472011] Code: e0 7f 44 09 d0 41 88 47 31 41 0f b6 47 32 83 e0
> f0 45 85 c0 0f 95 c2 09 c8 c1 e2 03 09 d0 41 88 47 32 0f b7 55 18 41
> 0f b7 47 32 <c1> e2 04 83 e0 0f 09 d0 66 41 89 47 32 e8 a4 69 fe ff
> 4c 8b 4d
> [15811.473409] NMI backtrace for cpu 1
> [15811.474061] CPU: 1 PID: 2849 Comm: trinity-c95 Tainted: G
> L 3.18.0+ #106
> [15811.476098] task: ffff880096b4c470 ti: ffff880153a4c000 task.ti:
> ffff880153a4c000
> [15811.476808] RIP: 0010:[<ffffffff810c63cf>] [<ffffffff810c63cf>]
> lock_release+0x1f/0x240
> [15811.477535] RSP: 0018:ffff880153a4fe40 EFLAGS: 00000246
> [15811.478253] RAX: ffff880096b4c470 RBX: 0000000000000000 RCX:
> 00000000000003a0
> [15811.478982] RDX: ffffffff81086d0c RSI: 0000000000000001 RDI:
> ffffffff81c50e20
> [15811.479707] RBP: ffff880153a4fe48 R08: 0000000000000000 R09:
> 0000000000000000
> [15811.480419] R10: 0000000000000000 R11: 0000000000000000 R12:
> ffff880094be64c0
> [15811.481115] R13: ffff880153a4feb0 R14: 0000000000000000 R15:
> 0000000000000000
> [15811.481803] FS: 00007f79977d8740(0000) GS:ffff880245000000(0000)
> knlGS:0000000000000000
> [15811.482504] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15811.483200] CR2: 00007f7996f24220 CR3: 00000002251b4000 CR4:
> 00000000001407e0
> [15811.483890] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15811.484562] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15811.485221] Stack:
> [15811.485862] 0000000000000000 ffff880153a4fe88 ffffffff81086d24
> ffffffff81086ca5
> [15811.486521] 0000000000000d7f 0000000000000d7f 0000000000000000
> ffff880096[15835.393872] NMI watchdog: BUG: soft lockup - CPU#2 stuck
> for 22s! [kworker/u16:3:14112]
> [15835.394432] Modules linked in: bridge 8021q garp stp snd_seq_dummy
> dlci tun fuse rfcomm hidp bnep af_key llc2 nfnetlink can_bcm
> scsi_transport_iscsi can_raw sctp libcrc32c nfc caif_socket caif
> af_802154 ieee802154 phonet af_rxrpc bluetooth can pppoe pppox
> ppp_generic slhc irda crc_ccitt rds rose x25 atm netrom appletalk ipx
> p8023 psnap p8022 llc ax25 usb_debug cfg80211 rfkill coretemp hwmon
> x86_pkg_temp_thermal kvm_intel kvm crct10dif_pclmul crc32c_intel
> ghash_clmulni_intel snd_hda_codec_hdmi snd_hda_codec_realtek
> snd_hda_codec_generic microcode serio_raw pcspkr snd_hda_intel
> snd_hda_controller snd_hda_codec snd_hwdep snd_seq snd_seq_device
> snd_pcm e1000e ptp pps_core snd_timer snd soundcore shpchp nfsd
> auth_rpcgss oid_registry nfs_acl lockd grace sunrpc
> [15835.398378] CPU: 2 PID: 14112 Comm: kworker/u16:3 Tainted: G
> L 3.18.0+ #106
> [15835.400379] Workqueue: khelper __call_usermodehelper
> [15835.401080] task: ffff8801c95f0000 ti: ffff880227eac000 task.ti:
> ffff880227eac000
> [15835.401795] RIP: 0010:[<ffffffff817c3407>] [<ffffffff817c3407>]
> __slab_alloc+0x52f/0x58f
> [15835.402534] RSP: 0018:ffff880227eaf8f8 EFLAGS: 00000246
> [15835.403252] RAX: 0000000000000002 RBX: ffff8802304cf5c8 RCX:
> 00000000000002e0
> [15835.403995] RDX: ffff88024520d7e0 RSI: 0000000000000000 RDI:
> ffff880244802000
> [15835.404727] RBP: ffff880227eaf9e8 R08: 0000000000000000 R09:
> 0000000000000000
> [15835.405456] R10: 0000000000000092 R11: 0000000000000000 R12:
> ffffffff810135bf
> [15835.406185] R13: ffff880227eaf878 R14: 0000000100160015 R15:
> ffffffff8138278d
> [15835.406916] FS: 0000000000000000(0000) GS:ffff880245200000(0000)
> knlGS:0000000000000000
> [15835.407667] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [15835.408410] CR2: 0000000000000008 CR3: 0000000225ab9000 CR4:
> 00000000001407e0
> [15835.409165] DR0: 00007fbe591ef000 DR1: 0000000000000000 DR2:
> 0000000000000000
> [15835.409924] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7:
> 0000000000000600
> [15835.410679] Stack:
> [15835.411433] 000000000000005c ffff880240f8d790 ffff880240f8d790
> ffff880240f8dd00
> [15835.412226] 0000000180230020 000000010000000f ffffffff8112ee12
> 0000000000000000
> [15835.413002] ffff8802453d7260 000000020023001f ffff880227eaf968
> ffffffff8138278d
> [15835.413784] Call Trace:
> [15835.414563] [<ffffffff8112ee12>] ? __delayacct_tsk_init+0x22/0x50
> [15835.415358] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15835.416162] [<ffffffff811ce860>] ? set_track+0x70/0x140
> [15835.416952] [<ffffffff811cf35d>] ? init_object+0x3d/0x70
> [15835.417745] [<ffffffff8138278d>] ? __debug_object_init+0x43d/0x450
> [15835.418533] [<ffffffff811d295b>] kmem_cache_alloc+0x1cb/0x1f0
> [15835.419328] [<ffffffff8138278d>] __debug_object_init+0x43d/0x450
> [15835.420114] [<ffffffff813827bb>] debug_object_init+0x1b/0x20
> [15835.420904] [<ffffffff810e66d5>] hrtimer_init+0x25/0xb0
> [15835.421701] [<ffffffff8109f069>] __sched_fork+0x99/0x230
> [15835.422491] [<ffffffff810a59c9>] sched_fork+0x29/0x200
> [15835.423282] [<ffffffff8107568c>] copy_process.part.26+0x65c/0x1a40
> [15835.424077] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15835.424865] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15835.425658] [<ffffffff8108e340>] ? call_helper+0x20/0x20
> [15835.426447] [<ffffffff81076c37>] do_fork+0xe7/0x490
> [15835.427239] [<ffffffff810c512c>] ?
> __lock_acquire.isra.31+0x22c/0x9f0
> [15835.428018] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15835.428776] [<ffffffff81077006>] kernel_thread+0x26/0x30
> [15835.429525] [<ffffffff8108e1b4>] __call_usermodehelper+0x64/0x80
> [15835.430259] [<ffffffff8109301a>] process_one_work+0x1fa/0x550
> [15835.430986] [<ffffffff81092f98>] ? process_one_work+0x178/0x550
> [15835.431694] [<ffffffff8109348b>] worker_thread+0x11b/0x490
> [15835.432374] [<ffffffff81093370>] ? process_one_work+0x550/0x550
> [15835.433049] [<ffffffff81098c89>] kthread+0xf9/0x110
> [15835.433694] [<ffffffff810abaf5>] ? local_clock+0x25/0x30
> [15835.434328] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15835.434947] [<ffffffff817cfe6c>] ret_from_fork+0x7c/0xb0
> [15835.435543] [<ffffffff81098b90>] ?
> kthread_create_on_node+0x250/0x250
> [15835.436148] Code: 00 02 00 00 49 c7 45 00 00 00 00 00 75 11 ff b5
> 78 ff ff ff 9d e8 7a 6d 98 ff 4c 89 e0 eb 0f e8 70 6e 98 ff ff b5 78
> ff ff ff 9d <4c> 89 e0 48 8b 55 c8 65 48 33 14 25 28 00 00 00 74 3c
> e8 22 46
> [15835.437494] sending NMI to other CPUs:
>
>
next prev parent reply other threads:[~2014-12-18 15:55 UTC|newest]
Thread overview: 486+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-11-14 21:31 frequent lockups in 3.18rc4 Dave Jones
2014-11-14 22:01 ` Linus Torvalds
2014-11-14 22:30 ` Dave Jones
2014-11-14 22:55 ` Thomas Gleixner
2014-11-14 23:32 ` Dave Jones
2014-11-15 0:36 ` Thomas Gleixner
2014-11-15 2:40 ` Dave Jones
2014-11-16 12:16 ` Thomas Gleixner
2014-11-15 1:59 ` Linus Torvalds
2014-11-17 21:22 ` Linus Torvalds
2014-11-17 22:31 ` Thomas Gleixner
2014-11-17 22:43 ` Thomas Gleixner
2014-11-17 22:58 ` Jens Axboe
2014-11-17 23:59 ` Linus Torvalds
2014-11-18 0:15 ` Thomas Gleixner
2014-11-17 23:04 ` Jens Axboe
2014-11-17 23:17 ` Thomas Gleixner
2014-11-18 2:23 ` Jens Axboe
2014-11-15 21:34 ` Dave Jones
2014-11-16 1:40 ` Dave Jones
2014-11-16 6:33 ` Linus Torvalds
2014-11-16 10:06 ` Markus Trippelsdorf
2014-11-16 18:33 ` Linus Torvalds
2014-11-17 17:03 ` Dave Jones
2014-11-17 19:59 ` Linus Torvalds
2014-11-18 2:09 ` Dave Jones
2014-11-18 2:21 ` Linus Torvalds
2014-11-18 2:39 ` Dave Jones
2014-11-18 2:51 ` Linus Torvalds
2014-11-18 14:52 ` Dave Jones
2014-11-18 17:20 ` Linus Torvalds
2014-11-18 19:28 ` Thomas Gleixner
2014-11-18 21:25 ` Don Zickus
2014-11-18 21:31 ` Dave Jones
2014-11-18 18:54 ` Thomas Gleixner
2014-11-18 21:55 ` Don Zickus
2014-11-18 22:02 ` Dave Jones
2014-11-19 14:41 ` Don Zickus
2014-11-19 15:03 ` Vivek Goyal
2014-11-19 15:38 ` Dave Jones
2014-11-19 16:28 ` Vivek Goyal
2014-11-20 16:10 ` Dave Jones
2014-11-20 16:48 ` Vivek Goyal
2014-11-20 17:38 ` Dave Jones
2014-11-21 9:46 ` Dave Young
2014-11-20 16:54 ` Vivek Goyal
2014-11-20 9:54 ` Dave Young
2014-11-19 2:19 ` Dave Jones
2014-11-19 4:40 ` Linus Torvalds
2014-11-19 4:59 ` Dave Jones
2014-11-19 5:15 ` Dave Jones
2014-11-20 14:36 ` Frederic Weisbecker
2014-11-19 14:59 ` Dave Jones
2014-11-19 17:22 ` Linus Torvalds
2014-11-19 17:40 ` Linus Torvalds
2014-11-19 19:02 ` Frederic Weisbecker
2014-11-19 19:03 ` Andy Lutomirski
2014-11-19 23:00 ` Frederic Weisbecker
2014-11-19 23:07 ` Andy Lutomirski
2014-11-19 23:13 ` Frederic Weisbecker
2014-11-19 21:56 ` Thomas Gleixner
2014-11-19 22:56 ` Frederic Weisbecker
2014-11-19 22:59 ` Andy Lutomirski
2014-11-19 23:07 ` Frederic Weisbecker
2014-11-19 23:09 ` Thomas Gleixner
2014-11-19 23:50 ` Frederic Weisbecker
2014-11-20 12:23 ` Tejun Heo
2014-11-20 21:58 ` Thomas Gleixner
2014-11-20 22:06 ` Andy Lutomirski
2014-11-20 22:11 ` Tejun Heo
2014-11-20 22:42 ` Thomas Gleixner
2014-11-20 23:05 ` Tejun Heo
2014-11-20 23:08 ` Andy Lutomirski
2014-11-20 23:34 ` Linus Torvalds
2014-11-20 23:39 ` Tejun Heo
2014-11-20 23:55 ` Andy Lutomirski
2014-11-21 16:27 ` Tejun Heo
2014-11-21 16:38 ` Andy Lutomirski
2014-11-21 16:48 ` Linus Torvalds
2014-11-21 17:08 ` Steven Rostedt
2014-11-21 17:19 ` Linus Torvalds
2014-11-21 17:22 ` Andy Lutomirski
2014-11-21 18:22 ` Linus Torvalds
2014-11-21 18:28 ` Andy Lutomirski
2014-11-21 19:06 ` Linus Torvalds
2014-11-21 19:23 ` Steven Rostedt
2014-11-21 19:34 ` Linus Torvalds
2014-11-21 19:46 ` Linus Torvalds
2014-11-21 19:52 ` Andy Lutomirski
2014-11-21 20:14 ` Josh Boyer
2014-11-21 20:16 ` Andy Lutomirski
2014-11-21 20:23 ` Josh Boyer
2014-11-24 18:48 ` Konrad Rzeszutek Wilk
2014-11-24 19:07 ` Josh Boyer
2014-11-25 5:36 ` Jürgen Groß
2014-11-25 17:22 ` Linus Torvalds
2014-11-21 20:00 ` Dave Jones
2014-11-21 20:02 ` Andy Lutomirski
2014-11-21 19:51 ` Thomas Gleixner
2014-11-21 20:00 ` Linus Torvalds
2014-11-21 20:16 ` Thomas Gleixner
2014-11-21 20:41 ` Linus Torvalds
2014-11-21 21:11 ` Thomas Gleixner
2014-11-21 22:55 ` Linus Torvalds
2014-11-21 23:03 ` Andy Lutomirski
2014-11-21 23:33 ` Linus Torvalds
2014-12-16 19:28 ` Peter Zijlstra
2014-12-16 20:46 ` Linus Torvalds
2014-12-16 21:19 ` Mel Gorman
2014-12-16 23:02 ` Peter Zijlstra
2014-12-17 0:00 ` Linus Torvalds
2014-12-17 0:41 ` Andy Lutomirski
2014-12-17 17:01 ` Konrad Rzeszutek Wilk
2014-12-17 17:14 ` Peter Zijlstra
2014-11-21 22:33 ` Konrad Rzeszutek Wilk
2014-11-22 1:17 ` Thomas Gleixner
2014-11-21 17:34 ` Steven Rostedt
2014-11-21 18:24 ` Linus Torvalds
2014-11-21 22:10 ` Frederic Weisbecker
2014-11-21 2:33 ` Steven Rostedt
2014-11-21 0:54 ` Thomas Gleixner
2014-11-21 14:13 ` Frederic Weisbecker
2014-11-21 16:25 ` Tejun Heo
2014-11-21 17:01 ` Steven Rostedt
2014-11-21 17:11 ` Steven Rostedt
2014-11-21 21:32 ` Frederic Weisbecker
2014-11-21 21:34 ` Andy Lutomirski
2014-11-21 21:50 ` Frederic Weisbecker
2014-11-21 22:45 ` Steven Rostedt
2014-11-21 21:44 ` Frederic Weisbecker
2014-11-22 0:11 ` Tejun Heo
2014-11-22 0:18 ` Linus Torvalds
2014-11-22 0:41 ` Andy Lutomirski
2014-11-19 23:54 ` Andy Lutomirski
2014-11-20 0:00 ` Thomas Gleixner
2014-11-20 0:30 ` Andy Lutomirski
2014-11-20 0:40 ` Linus Torvalds
2014-11-20 0:49 ` Andy Lutomirski
2014-11-20 1:07 ` Linus Torvalds
2014-11-20 1:16 ` Andy Lutomirski
2014-11-20 2:42 ` Linus Torvalds
2014-11-20 6:16 ` Andy Lutomirski
2014-11-19 19:15 ` Andy Lutomirski
2014-11-19 19:38 ` Linus Torvalds
2014-11-19 22:18 ` Dave Jones
2014-11-19 21:01 ` Andy Lutomirski
2014-11-19 21:47 ` Dave Jones
2014-11-19 21:58 ` Borislav Petkov
2014-11-19 22:18 ` Dave Jones
2014-11-20 10:33 ` Borislav Petkov
2014-11-19 21:56 ` [PATCH] x86, syscall: Fix _TIF_NOHZ handling in syscall_trace_enter_phase1 Andy Lutomirski
2014-11-19 22:13 ` Thomas Gleixner
2014-11-20 20:33 ` Linus Torvalds
2014-11-20 22:07 ` Thomas Gleixner
2014-11-20 22:04 ` [tip:x86/urgent] " tip-bot for Andy Lutomirski
2014-11-20 15:25 ` frequent lockups in 3.18rc4 Dave Jones
2014-11-20 19:43 ` Linus Torvalds
2014-11-20 20:06 ` Dave Jones
2014-11-20 20:37 ` Don Zickus
2014-11-20 20:51 ` Linus Torvalds
2014-11-21 6:37 ` Ingo Molnar
2014-11-21 14:50 ` Dave Jones
2014-11-25 12:22 ` Will Deacon
2014-12-01 11:48 ` Will Deacon
2014-12-01 17:05 ` Linus Torvalds
2014-12-01 17:10 ` Will Deacon
2014-12-01 17:53 ` Linus Torvalds
2014-12-01 18:25 ` Kirill A. Shutemov
2014-12-01 18:36 ` Linus Torvalds
2014-12-04 10:51 ` Will Deacon
2014-12-04 14:56 ` Dave Jones
2014-12-05 13:49 ` Will Deacon
2014-11-20 15:04 ` Frederic Weisbecker
2014-11-20 15:08 ` Frederic Weisbecker
2014-11-20 16:19 ` Dave Jones
2014-11-20 16:42 ` Frederic Weisbecker
2014-11-26 0:25 ` Dave Jones
2014-11-26 1:48 ` Linus Torvalds
2014-11-26 2:40 ` Dave Jones
2014-11-26 22:57 ` Dave Jones
2014-11-27 0:46 ` Linus Torvalds
2014-11-27 19:17 ` Linus Torvalds
2014-11-27 22:56 ` Dave Jones
2014-11-29 20:38 ` Dâniel Fraga
2014-11-30 20:45 ` Linus Torvalds
2014-11-30 21:21 ` Dâniel Fraga
2014-12-01 0:21 ` Linus Torvalds
2014-12-01 1:02 ` Dâniel Fraga
2014-12-01 19:14 ` Paul E. McKenney
2014-12-01 20:28 ` Dâniel Fraga
2014-12-01 20:36 ` Linus Torvalds
2014-12-01 23:08 ` Chris Mason
2014-12-01 23:25 ` Linus Torvalds
2014-12-01 23:44 ` Chris Mason
2014-12-02 0:39 ` Linus Torvalds
2014-12-02 14:13 ` Mike Galbraith
2014-12-02 16:33 ` Linus Torvalds
2014-12-02 17:14 ` Chris Mason
2014-12-03 18:41 ` Dave Jones
2014-12-03 18:45 ` Linus Torvalds
2014-12-03 19:00 ` Dave Jones
2014-12-03 19:25 ` Linus Torvalds
2014-12-03 19:30 ` Dave Jones
2014-12-03 19:48 ` Linus Torvalds
2014-12-03 20:09 ` Dave Jones
2014-12-03 20:37 ` Linus Torvalds
2014-12-03 20:55 ` Thomas Gleixner
2014-12-03 21:14 ` Linus Torvalds
2014-12-03 22:19 ` Thomas Gleixner
2014-12-03 23:21 ` Dave Jones
2014-12-03 23:49 ` Thomas Gleixner
2014-12-04 0:19 ` Linus Torvalds
2014-12-04 1:02 ` Thomas Gleixner
2014-12-04 0:20 ` Dave Jones
2014-12-04 0:59 ` Thomas Gleixner
2014-12-04 1:32 ` Dave Jones
2014-12-04 3:45 ` Dave Jones
2014-12-03 19:56 ` John Stultz
2014-12-03 20:37 ` Thomas Gleixner
2014-12-03 20:44 ` Dave Jones
2014-12-03 20:59 ` Thomas Gleixner
2014-12-03 21:05 ` Dave Jones
2014-12-03 21:48 ` Thomas Gleixner
2014-12-03 20:39 ` Thomas Gleixner
2014-12-04 3:15 ` Chris Mason
2014-12-04 5:49 ` Linus Torvalds
2014-12-04 14:57 ` Chris Mason
2014-12-04 15:22 ` Dave Hansen
2014-12-04 15:30 ` Chris Mason
2014-12-03 19:59 ` Chris Mason
2014-12-03 20:11 ` Dave Jones
2014-12-03 20:56 ` Chris Mason
2014-12-04 0:27 ` Dave Jones
2014-12-05 17:15 ` Dave Jones
2014-12-05 18:38 ` Linus Torvalds
2014-12-05 18:48 ` Dave Jones
2014-12-05 19:31 ` Linus Torvalds
2014-12-05 19:37 ` Dave Jones
2014-12-06 22:38 ` Thomas Gleixner
2014-12-06 9:37 ` Chuck Ebbert
2014-12-06 16:22 ` Martin van Es
2014-12-06 20:09 ` Linus Torvalds
2014-12-06 20:41 ` Linus Torvalds
2014-12-06 21:14 ` Martin van Es
2014-12-12 12:58 ` Martin van Es
2014-12-15 12:07 ` Martin van Es
2014-12-06 22:14 ` Thomas Gleixner
2014-12-05 19:04 ` Chris Mason
2014-12-05 19:29 ` Linus Torvalds
2014-12-11 14:54 ` Dave Jones
2014-12-11 21:49 ` Linus Torvalds
2014-12-11 21:52 ` Sasha Levin
2014-12-11 21:57 ` Chris Mason
2014-12-11 22:00 ` Sasha Levin
2014-12-11 22:36 ` Linus Torvalds
2014-12-11 22:57 ` Sasha Levin
2014-12-12 6:54 ` Ingo Molnar
2014-12-12 23:54 ` Sasha Levin
2014-12-13 0:23 ` Linus Torvalds
2014-12-13 0:34 ` Sasha Levin
2014-12-13 0:44 ` Linus Torvalds
2014-12-13 16:28 ` Jeff Chua
2014-12-13 2:32 ` Dave Jones
2014-12-11 21:57 ` Borislav Petkov
2014-12-12 3:03 ` Dave Jones
2014-12-12 4:45 ` Dave Jones
2014-12-12 14:38 ` Dave Jones
2014-12-12 18:24 ` Paul E. McKenney
2014-12-12 18:10 ` Paul E. McKenney
2014-12-12 18:42 ` Dave Jones
2014-12-12 18:54 ` Dave Jones
2014-12-12 19:14 ` Linus Torvalds
2014-12-12 19:23 ` Dave Jones
2014-12-12 19:58 ` David Lang
2014-12-12 20:20 ` Linus Torvalds
2014-12-13 7:43 ` Ingo Molnar
2014-12-12 20:34 ` Paul E. McKenney
2014-12-12 21:23 ` Sasha Levin
2014-12-13 0:58 ` Paul E. McKenney
2014-12-13 12:08 ` Paul E. McKenney
2014-12-13 8:30 ` Ingo Molnar
2014-12-13 15:53 ` Sasha Levin
2014-12-13 18:07 ` Paul E. McKenney
2014-12-14 17:50 ` Paul E. McKenney
2014-12-14 23:46 ` Sasha Levin
2014-12-15 0:11 ` Paul E. McKenney
2014-12-15 1:20 ` Sasha Levin
2014-12-15 6:33 ` Paul E. McKenney
2014-12-15 12:56 ` Paul E. McKenney
2014-12-15 13:16 ` Sasha Levin
2014-12-16 3:40 ` Paul E. McKenney
2014-12-13 7:36 ` [PATCH] sched: Fix lost reschedule in __cond_resched() Ingo Molnar
2014-12-14 18:04 ` Frederic Weisbecker
2014-12-14 19:43 ` Ingo Molnar
2014-12-14 19:50 ` Linus Torvalds
2014-12-14 20:30 ` Frederic Weisbecker
2014-12-13 8:19 ` frequent lockups in 3.18rc4 Ingo Molnar
2014-12-13 8:27 ` Ingo Molnar
2014-12-13 14:15 ` Sasha Levin
2014-12-13 16:59 ` Dave Jones
2014-12-13 18:04 ` Paul E. McKenney
2014-12-13 20:41 ` Dave Jones
2014-12-14 4:04 ` Paul E. McKenney
2014-12-13 22:36 ` Dave Jones
2014-12-13 22:40 ` Linus Torvalds
2014-12-13 22:59 ` Linus Torvalds
2014-12-13 23:09 ` Linus Torvalds
2014-12-13 23:35 ` Al Viro
2014-12-13 23:38 ` Linus Torvalds
2014-12-13 23:47 ` Al Viro
2014-12-14 0:14 ` Linus Torvalds
2014-12-14 0:33 ` Al Viro
2014-12-14 1:35 ` Linus Torvalds
2014-12-14 3:14 ` Al Viro
2014-12-15 0:18 ` Al Viro
2014-12-13 23:39 ` Al Viro
2014-12-14 23:46 ` Dave Jones
2014-12-15 0:38 ` Linus Torvalds
2014-12-15 0:42 ` Dave Jones
2014-12-15 5:47 ` Linus Torvalds
2014-12-15 5:57 ` Dave Jones
2014-12-15 18:21 ` Linus Torvalds
2014-12-15 23:46 ` Linus Torvalds
2014-12-18 2:42 ` Sasha Levin
2014-12-18 2:45 ` Linus Torvalds
2014-12-18 5:13 ` Dave Jones
2014-12-18 15:54 ` Chris Mason [this message]
2014-12-18 16:12 ` Dave Jones
2014-12-19 2:45 ` Dave Jones
2014-12-19 3:49 ` Linus Torvalds
2014-12-19 3:58 ` Dave Jones
2014-12-19 4:03 ` Dave Jones
2014-12-19 4:48 ` Linus Torvalds
2014-12-19 11:35 ` Peter Zijlstra
2014-12-19 14:55 ` Dave Jones
2014-12-19 15:14 ` Chris Mason
2014-12-19 19:15 ` Linus Torvalds
2014-12-19 19:44 ` Peter Zijlstra
2014-12-19 19:51 ` Linus Torvalds
2014-12-19 20:46 ` Linus Torvalds
2014-12-19 20:54 ` Dave Jones
2014-12-19 22:05 ` Linus Torvalds
2014-12-20 16:49 ` Dave Jones
2014-12-19 20:31 ` Chris Mason
2014-12-19 20:36 ` Dave Jones
2014-12-19 23:22 ` Thomas Gleixner
2014-12-20 0:12 ` Chris Mason
2014-12-20 1:06 ` Thomas Gleixner
2014-12-19 23:14 ` Thomas Gleixner
2014-12-19 23:55 ` Linus Torvalds
2014-12-20 1:00 ` Thomas Gleixner
2014-12-20 1:57 ` Linus Torvalds
2014-12-20 18:25 ` Linus Torvalds
2014-12-20 21:16 ` Linus Torvalds
2014-12-21 3:52 ` Paul E. McKenney
2014-12-21 21:22 ` Linus Torvalds
2014-12-21 22:19 ` Linus Torvalds
2014-12-21 22:32 ` Dave Jones
2014-12-21 23:58 ` Linus Torvalds
2014-12-22 0:41 ` Linus Torvalds
2014-12-22 0:52 ` Linus Torvalds
2014-12-22 1:22 ` Dave Jones
2014-12-22 3:11 ` Paul E. McKenney
2014-12-22 19:47 ` Linus Torvalds
2014-12-22 20:06 ` Linus Torvalds
2014-12-22 22:57 ` Dave Jones
2014-12-22 23:59 ` Linus Torvalds
2014-12-23 14:56 ` Dave Jones
2014-12-24 13:58 ` Sasha Levin
2014-12-24 3:01 ` Dave Jones
2014-12-26 16:34 ` Dave Jones
2014-12-26 18:12 ` Dave Jones
2014-12-26 20:57 ` Linus Torvalds
2014-12-26 21:20 ` Dave Jones
2014-12-26 22:57 ` Dave Jones
2014-12-26 23:16 ` Linus Torvalds
2014-12-27 0:36 ` Dave Jones
2014-12-27 3:14 ` Linus Torvalds
2014-12-27 16:48 ` Dave Jones
2014-12-26 23:30 ` Linus Torvalds
2014-12-27 0:39 ` Dave Jones
2014-12-27 2:53 ` Dave Jones
2015-01-03 0:27 ` John Stultz
2015-01-03 14:58 ` Sasha Levin
2015-01-04 19:46 ` Linus Torvalds
2015-01-06 1:17 ` John Stultz
2015-01-06 1:25 ` Linus Torvalds
2015-01-06 2:05 ` John Stultz
2014-12-22 23:59 ` John Stultz
2014-12-23 0:46 ` Linus Torvalds
2014-12-27 20:33 ` Paul E. McKenney
2015-01-12 10:05 ` Thomas Gleixner
2014-12-19 14:30 ` Chris Mason
2014-12-19 15:12 ` Dave Jones
2014-12-18 18:54 ` Linus Torvalds
2014-12-15 14:00 ` Borislav Petkov
2014-12-18 21:17 ` save_xstate_sig (Re: frequent lockups in 3.18rc4) Andy Lutomirski
2014-12-18 21:34 ` Linus Torvalds
2014-12-18 21:41 ` Andy Lutomirski
2014-12-18 21:37 ` Dave Jones
2014-12-17 18:22 ` frequent lockups in 3.18rc4 Dave Jones
2014-12-17 18:57 ` Dave Jones
2014-12-17 19:24 ` Dave Jones
2014-12-17 19:51 ` Linus Torvalds
2014-12-17 20:16 ` Dave Jones
2014-12-17 19:41 ` Linus Torvalds
2014-12-06 5:04 ` Gene Heskett
2014-12-02 17:47 ` Mike Galbraith
2014-12-13 8:11 ` Ingo Molnar
2014-12-13 9:57 ` Mike Galbraith
2014-12-17 11:13 ` Peter Zijlstra
2014-12-02 19:32 ` Dave Jones
2014-12-02 23:32 ` Sasha Levin
2014-12-03 0:09 ` Linus Torvalds
2014-12-03 0:25 ` Sasha Levin
2014-12-05 5:00 ` Sasha Levin
2014-12-05 6:38 ` Linus Torvalds
2014-12-05 15:03 ` Sasha Levin
2014-12-05 18:15 ` Linus Torvalds
2014-12-07 14:58 ` Sasha Levin
2014-12-07 18:24 ` Paul E. McKenney
2014-12-07 19:43 ` Paul E. McKenney
2014-12-07 23:28 ` Sasha Levin
2014-12-08 5:20 ` Paul E. McKenney
2014-12-08 14:33 ` Sasha Levin
2014-12-08 15:28 ` Sasha Levin
2014-12-08 15:57 ` Paul E. McKenney
2014-12-08 16:34 ` Sasha Levin
2014-12-08 15:56 ` Paul E. McKenney
2014-12-07 23:53 ` Linus Torvalds
2014-12-02 19:31 ` Dave Jones
2014-12-02 21:17 ` Linus Torvalds
2014-12-02 20:30 ` Dave Jones
2014-12-02 20:48 ` Paul E. McKenney
2014-12-01 23:08 ` Paul E. McKenney
2014-12-02 16:43 ` Dâniel Fraga
2014-12-02 17:04 ` Paul E. McKenney
2014-12-02 17:14 ` Dâniel Fraga
2014-12-02 18:42 ` Paul E. McKenney
2014-12-02 18:47 ` Dâniel Fraga
2014-12-02 19:11 ` Paul E. McKenney
2014-12-02 19:24 ` Dâniel Fraga
2014-12-02 20:56 ` Paul E. McKenney
2014-12-02 22:01 ` Dâniel Fraga
2014-12-02 22:10 ` Paul E. McKenney
2014-12-02 22:18 ` Dâniel Fraga
2014-12-02 22:35 ` Paul E. McKenney
2014-12-02 22:10 ` Linus Torvalds
2014-12-02 22:16 ` Dâniel Fraga
2014-12-03 3:21 ` Dâniel Fraga
2014-12-03 4:14 ` Linus Torvalds
2014-12-03 4:51 ` Dâniel Fraga
2014-12-03 6:02 ` Chris Rorvick
2014-12-03 15:22 ` Linus Torvalds
2014-12-04 8:43 ` Dâniel Fraga
2014-12-04 16:18 ` Linus Torvalds
2014-12-04 16:52 ` Frederic Weisbecker
2014-12-04 17:25 ` Dâniel Fraga
2014-12-04 17:47 ` Linus Torvalds
2014-12-04 18:07 ` Dâniel Fraga
2014-12-03 14:54 ` Tejun Heo
2014-12-02 18:09 ` Paul E. McKenney
2014-12-02 18:41 ` Dâniel Fraga
2014-12-02 17:08 ` Linus Torvalds
2014-12-02 17:16 ` Dâniel Fraga
2014-12-02 8:40 ` Lai Jiangshan
2014-12-02 16:58 ` Paul E. McKenney
2014-12-02 16:58 ` Dâniel Fraga
2014-12-02 17:17 ` Paul E. McKenney
2014-12-03 2:03 ` Lai Jiangshan
2014-12-03 5:22 ` Paul E. McKenney
2014-12-01 16:56 ` Don Zickus
2014-11-26 4:39 ` Jürgen Groß
[not found] ` <CA+55aFx1SiFBzmA=k9jHxi3cZE3Ei_+2NHepujgf86KEvkz8eQ@mail.gmail.com>
2014-11-26 5:11 ` Dave Jones
2014-11-26 5:24 ` Juergen Gross
2014-11-26 5:52 ` Linus Torvalds
2014-11-26 6:21 ` Linus Torvalds
2014-11-26 6:52 ` Juergen Gross
2014-11-26 9:44 ` Juergen Gross
2014-11-26 14:34 ` Dave Jones
2014-11-26 17:37 ` Linus Torvalds
2014-11-20 15:28 ` Frederic Weisbecker
2014-11-17 15:07 ` Don Zickus
-- strict thread matches above, loose matches on Subject: below --
2014-12-16 3:04 Hillf Danton
2015-02-12 11:09 Martin van Es
2015-02-12 16:01 ` Linus Torvalds
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1418918059.17358.6@mail.thefacebook.com \
--to=clm@fb.com \
--cc=davej@redhat.com \
--cc=fragabr@gmail.com \
--cc=hpa@linux.intel.com \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@kernel.org \
--cc=oleg@redhat.com \
--cc=paulmck@linux.vnet.ibm.com \
--cc=peterz@infradead.org \
--cc=sasha.levin@oracle.com \
--cc=sbsiddha@gmail.com \
--cc=torvalds@linux-foundation.org \
--cc=umgwanakikbuti@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).