From: Simon Kirby <sim@hostway.ca>
To: Linus Torvalds <torvalds@linux-foundation.org>,
Peter Zijlstra <a.p.zijlstra@chello.nl>,
Ingo Molnar <mingo@elte.hu>
Cc: Thomas Gleixner <tglx@linutronix.de>,
Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
Dave Jones <davej@redhat.com>,
Martin Schwidefsky <schwidefsky@de.ibm.com>,
Ingo Molnar <mingo@elte.hu>, David Miller <davem@davemloft.net>
Subject: Re: Linux 3.1-rc9
Date: Tue, 25 Oct 2011 08:26:31 -0700 [thread overview]
Message-ID: <20111025152631.GA17008@hostway.ca> (raw)
In-Reply-To: <CA+55aFyk50v0hRNbtfF3cskAH7U-yWpHQzA+tRDFZVa6n-F_yw@mail.gmail.com>
On Tue, Oct 18, 2011 at 01:12:41PM -0700, Linus Torvalds wrote:
> On Tue, Oct 18, 2011 at 12:48 PM, Thomas Gleixner <tglx@linutronix.de> wrote:
> >
> > It does not look related.
>
> Yeah, the only lock held there seems to be the socket lock, and it
> looks like all CPU's are spinning on it.
>
> > Could you try to reproduce that problem with
> > lockdep enabled? lockdep might make it go away, but it's definitely
> > worth a try.
>
> And DEBUG_SPINLOCK / DEBUG_SPINLOCK_SLEEP too. Maybe you're triggering
> some odd networking thing. It sounds unlikely, but maybe some error
> case you get into doesn't release the socket lock.
>
> I think PROVE_LOCKING already enables DEBUG_SPINLOCK, but the sleeping
> lock thing is separate, iirc.
I think the config option you were trying to think of is
CONFIG_DEBUG_ATOMIC_SLEEP, which enables CONFIG_PREEMPT_COUNT.
By the way, we got this WARN_ON_ONCE while running lockdep elsewhere:
/*
* We can walk the hash lockfree, because the hash only
* grows, and we are careful when adding entries to the end:
*/
list_for_each_entry(class, hash_head, hash_entry) {
if (class->key == key) {
WARN_ON_ONCE(class->name != lock->name);
return class;
}
}
[19274.691090] ------------[ cut here ]------------
[19274.691107] WARNING: at kernel/lockdep.c:690 __lock_acquire+0xfd6/0x2180()
[19274.691112] Hardware name: PowerEdge 2950
[19274.691115] Modules linked in: drbd lru_cache cn ipmi_devintf ipmi_si ipmi_msghandler sata_sil24 bnx2
[19274.691137] Pid: 4416, comm: heartbeat Not tainted 3.1.0-hw-lockdep+ #52
[19274.691141] Call Trace:
[19274.691149] [<ffffffff81098f96>] ? __lock_acquire+0xfd6/0x2180
[19274.691156] [<ffffffff8105c4f0>] warn_slowpath_common+0x80/0xc0
[19274.691163] [<ffffffff8105c545>] warn_slowpath_null+0x15/0x20
[19274.691169] [<ffffffff81098f96>] __lock_acquire+0xfd6/0x2180
[19274.691175] [<ffffffff8109a2e9>] ? lock_release_non_nested+0x1a9/0x340
[19274.691181] [<ffffffff8109a7b9>] lock_acquire+0x109/0x140
[19274.691185] [<ffffffff8104a302>] ? double_rq_lock+0x52/0x80
[19274.691191] [<ffffffff813a4f8a>] ? __delay+0xa/0x10
[19274.691197] [<ffffffff816f55fa>] _raw_spin_lock_nested+0x3a/0x50
[19274.691201] [<ffffffff8104a302>] ? double_rq_lock+0x52/0x80
[19274.691205] [<ffffffff8104a302>] double_rq_lock+0x52/0x80
[19274.691210] [<ffffffff81058167>] load_balance+0x897/0x16e0
[19274.691215] [<ffffffff81058199>] ? load_balance+0x8c9/0x16e0
[19274.691219] [<ffffffff8104d172>] ? update_shares+0xd2/0x150
[19274.691226] [<ffffffff816f2572>] ? __schedule+0x842/0xa20
[19274.691232] [<ffffffff816f2608>] __schedule+0x8d8/0xa20
[19274.691238] [<ffffffff816f2572>] ? __schedule+0x842/0xa20
[19274.691243] [<ffffffff81063e87>] ? local_bh_enable+0xa7/0x110
[19274.691249] [<ffffffff8169c008>] ? unix_stream_recvmsg+0x1d8/0x7f0
[19274.691254] [<ffffffff81614c88>] ? dev_queue_xmit+0x1a8/0x8a0
[19274.691258] [<ffffffff816f282a>] schedule+0x3a/0x60
[19274.691265] [<ffffffff816f4515>] schedule_hrtimeout_range_clock+0x105/0x120
[19274.691270] [<ffffffff81096c9d>] ? trace_hardirqs_on+0xd/0x10
[19274.691276] [<ffffffff81080d89>] ? add_wait_queue+0x49/0x60
[19274.691282] [<ffffffff816f453e>] schedule_hrtimeout_range+0xe/0x10
[19274.691291] [<ffffffff8113dc04>] poll_schedule_timeout+0x44/0x70
[19274.691297] [<ffffffff8113e29c>] do_sys_poll+0x33c/0x4f0
[19274.691303] [<ffffffff8113dcf0>] ? poll_freewait+0xc0/0xc0
[19274.691309] [<ffffffff8113ddf0>] ? __pollwait+0x100/0x100
[19274.691317] [<ffffffff81602c3d>] ? sock_update_classid+0xfd/0x140
[19274.691323] [<ffffffff81602bb0>] ? sock_update_classid+0x70/0x140
[19274.691330] [<ffffffff815ff1f7>] ? sock_recvmsg+0xf7/0x130
[19274.691336] [<ffffffff81098450>] ? __lock_acquire+0x490/0x2180
[19274.691343] [<ffffffff8110427e>] ? might_fault+0x4e/0xa0
[19274.691351] [<ffffffff8101a129>] ? sched_clock+0x9/0x10
[19274.691356] [<ffffffff810944cd>] ? trace_hardirqs_off+0xd/0x10
[19274.691363] [<ffffffff815ffb0b>] ? sys_recvfrom+0xbb/0x120
[19274.691370] [<ffffffff81082540>] ? process_cpu_clock_getres+0x10/0x10
[19274.691376] [<ffffffff8110427e>] ? might_fault+0x4e/0xa0
[19274.691383] [<ffffffff8110427e>] ? might_fault+0x4e/0xa0
[19274.691390] [<ffffffff816fe0ca>] ? sysret_check+0x2e/0x69
[19274.691396] [<ffffffff8113e647>] sys_poll+0x77/0x110
[19274.691402] [<ffffffff816fe092>] system_call_fastpath+0x16/0x1b
[19274.691407] ---[ end trace 74fbaae9066aadcc ]---
Simon-
next prev parent reply other threads:[~2011-10-25 15:26 UTC|newest]
Thread overview: 98+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-10-05 1:40 Linux 3.1-rc9 Linus Torvalds
2011-10-07 7:08 ` Simon Kirby
2011-10-07 17:48 ` Simon Kirby
2011-10-07 18:01 ` Peter Zijlstra
2011-10-08 0:33 ` Simon Kirby
2011-10-08 0:50 ` Simon Kirby
2011-10-08 7:55 ` Peter Zijlstra
2011-10-12 21:35 ` Simon Kirby
2011-10-13 23:25 ` Simon Kirby
2011-10-17 1:39 ` Linus Torvalds
2011-10-17 4:58 ` Ingo Molnar
2011-10-17 9:03 ` Thomas Gleixner
2011-10-17 10:40 ` Peter Zijlstra
2011-10-17 11:40 ` Alan Cox
2011-10-17 18:49 ` Ingo Molnar
2011-10-17 20:35 ` H. Peter Anvin
2011-10-17 21:19 ` Ingo Molnar
2011-10-17 21:22 ` H. Peter Anvin
2011-10-17 21:39 ` Ingo Molnar
2011-10-17 22:03 ` Ingo Molnar
2011-10-17 22:04 ` Ingo Molnar
2011-10-17 22:08 ` H. Peter Anvin
2011-10-18 6:01 ` Ingo Molnar
2011-10-18 7:12 ` Geert Uytterhoeven
2011-10-18 18:50 ` H. Peter Anvin
2011-10-17 21:31 ` Ingo Molnar
2011-10-17 7:55 ` Martin Schwidefsky
2011-10-17 9:12 ` Peter Zijlstra
2011-10-17 9:18 ` Martin Schwidefsky
2011-10-17 20:48 ` H. Peter Anvin
2011-10-18 7:20 ` Martin Schwidefsky
2011-10-17 10:34 ` Peter Zijlstra
2011-10-17 14:07 ` Martin Schwidefsky
2011-10-17 14:57 ` Linus Torvalds
2011-10-17 17:54 ` Peter Zijlstra
2011-10-17 18:31 ` Linus Torvalds
2011-10-17 19:23 ` Peter Zijlstra
2011-10-17 21:00 ` Thomas Gleixner
2011-10-18 8:39 ` Thomas Gleixner
2011-10-18 9:05 ` Peter Zijlstra
2011-10-18 14:59 ` Linus Torvalds
2011-10-18 15:26 ` Thomas Gleixner
2011-10-18 18:07 ` Ingo Molnar
2011-10-18 18:14 ` [GIT PULL] timer fix Ingo Molnar
2011-10-18 16:13 ` Linux 3.1-rc9 Dave Jones
2011-10-18 18:20 ` Simon Kirby
2011-10-18 19:48 ` Thomas Gleixner
2011-10-18 20:12 ` Linus Torvalds
2011-10-25 15:26 ` Simon Kirby [this message]
2011-10-26 1:47 ` Yong Zhang
2011-10-24 19:02 ` Simon Kirby
2011-10-25 7:13 ` Linus Torvalds
2011-10-25 9:01 ` David Miller
2011-10-25 12:30 ` Thomas Gleixner
2011-10-25 23:18 ` David Miller
2011-10-25 20:20 ` Simon Kirby
2011-10-31 17:32 ` Simon Kirby
2011-11-02 16:40 ` Thomas Gleixner
2011-11-02 17:27 ` Eric Dumazet
2011-11-02 17:46 ` Linus Torvalds
2011-11-02 17:53 ` Eric Dumazet
2011-11-02 18:00 ` Linus Torvalds
2011-11-02 18:05 ` Eric Dumazet
2011-11-02 18:10 ` Linus Torvalds
2011-11-02 17:49 ` Eric Dumazet
2011-11-02 17:58 ` Eric Dumazet
2011-11-02 19:16 ` Simon Kirby
2011-11-02 22:42 ` Eric Dumazet
2011-11-03 0:24 ` Thomas Gleixner
2011-11-03 0:52 ` Simon Kirby
2011-11-03 22:07 ` David Miller
2011-11-03 6:06 ` Jörg-Volker Peetz
2011-11-03 6:26 ` Eric Dumazet
2011-11-03 6:43 ` David Miller
2011-11-02 17:54 ` Thomas Gleixner
2011-11-02 18:04 ` Eric Dumazet
2011-11-02 18:28 ` Simon Kirby
2011-11-02 18:30 ` Thomas Gleixner
2011-11-02 22:10 ` Steven Rostedt
2011-11-02 23:00 ` Steven Rostedt
2011-11-03 0:09 ` Simon Kirby
2011-11-03 0:15 ` Steven Rostedt
2011-11-03 0:17 ` Simon Kirby
2011-11-18 23:11 ` [tip:perf/core] lockdep: Show subclass in pretty print of lockdep output tip-bot for Steven Rostedt
2011-10-20 14:36 ` Linux 3.1-rc9 Martin Schwidefsky
2011-10-23 11:34 ` Ingo Molnar
2011-10-24 7:48 ` Martin Schwidefsky
2011-10-24 7:51 ` Linus Torvalds
2011-10-24 8:08 ` Martin Schwidefsky
2011-10-18 5:40 ` Simon Kirby
2011-10-09 20:51 ` Arkadiusz Miśkiewicz
2011-10-10 2:29 ` [tpmdd-devel] " Stefan Berger
2011-10-10 16:23 ` Rajiv Andrade
2011-10-10 17:05 ` Arkadiusz Miśkiewicz
2011-10-10 17:22 ` Stefan Berger
2011-10-10 17:57 ` Arkadiusz Miśkiewicz
2011-10-10 21:08 ` Arkadiusz Miśkiewicz
2011-10-11 7:09 ` [tpmdd-devel] " Peter.Huewe
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20111025152631.GA17008@hostway.ca \
--to=sim@hostway.ca \
--cc=a.p.zijlstra@chello.nl \
--cc=davej@redhat.com \
--cc=davem@davemloft.net \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@elte.hu \
--cc=schwidefsky@de.ibm.com \
--cc=tglx@linutronix.de \
--cc=torvalds@linux-foundation.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).