From: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
To: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Frederic Weisbecker <fweisbec@gmail.com>,
Thomas Gleixner <tglx@linutronix.de>,
Ingo Molnar <mingo@kernel.org>,
Peter Zijlstra <peterz@infradead.org>,
Dave Jones <davej@redhat.com>, Hugh Dickins <hughd@google.com>,
Linux Kernel Mailing List <linux-kernel@vger.kernel.org>,
Paul McKenney <paul.mckenney@linaro.org>
Subject: Re: Debugging Thinkpad T430s occasional suspend failure.
Date: Sat, 16 Feb 2013 11:25:54 -0800 [thread overview]
Message-ID: <20130216192554.GB7035@linux.vnet.ibm.com> (raw)
In-Reply-To: <CA+55aFyXo89LQ0mboxVYB5SJ08D8=Kv0=cqYHAd6-H7nmp=S-w@mail.gmail.com>
On Fri, Feb 15, 2013 at 10:50:31AM -0800, Linus Torvalds wrote:
> On Fri, Feb 15, 2013 at 10:35 AM, Linus Torvalds
> <torvalds@linux-foundation.org> wrote:
> > On Fri, Feb 15, 2013 at 10:34 AM, Linus Torvalds
> > <torvalds@linux-foundation.org> wrote:
> >>
> >> Something like this ENTIRELY UNTESTED patch.
> >
> > .. and let's actually attach the patch this time.
>
> That's odd. I got a "server error" from gmail. And again no attachment.
>
> Maybe THIS time.
Sorry for the delay in testing this, but there was a need to upgrade
my laptop, and bozo here figured "why not go to 64 bits while I am at
it?" -- and then proceeded to learn the hard way that it is necessary
to do "make mrproper" before doing a build in 64-bit mode. :-/
The kernel build system's way of telling you this at the moment is:
arch/x86/built-in.o:(.rodata+0x4990): undefined reference to `stub32_sigaltstack'
Anyway, with this patch, I see CPU stall warnings when running rcutorture
as shown below. This is not a hard failure:
[ 32.553647] rcu-torture: rtc: ffffffff836a57a0 ver: 131 tfle: 0 rta: 131 rtaf: 0 rtf: 93 rtmbe: 0 rtbke: 0 rtbre: 0 rtbf: 0 rtb: 0 nt: 27 onoff: 0/0:0/0 -1,0:-1,0 0:0 (HZ=1000) barrier: 6/7:0
Note the "ver: 131", which means that rcutorture successfully did 131
grace periods before the failure. It manages to offline a CPU subsequently,
but then appears to hang while onlining it.
Thanx, Paul
[ 23.706051] INFO: rcu_preempt self-detected stall on CPU[ 23.707053] INFO: rcu_preempt self-detected stall on CPU
[ 23.707053] 1: (20976 ticks this GP) idle=883/140000000000001/0 drain=5 . timer not pending
[ 23.707053] (t=21000 jiffies g=85 c=84 q=6756)
[ 23.707053] Pid: 606, comm: rcu_torture_rea Not tainted 3.8.0-rc7+ #2
[ 23.707053] Call Trace:
[ 23.707053] <IRQ> [<ffffffff810c12b2>] rcu_pending+0x192/0x7a0
[ 23.707053] [<ffffffff810c590b>] rcu_check_callbacks+0xbb/0x220
[ 23.707053] [<ffffffff8104c193>] update_process_times+0x43/0x80
[ 23.707053] [<ffffffff8108f901>] tick_sched_handle.isra.8+0x31/0x40
[ 23.707053] [<ffffffff8108f9f7>] tick_sched_timer+0x47/0x70
[ 23.707053] [<ffffffff8106619c>] __run_hrtimer+0x7c/0x240
[ 23.707053] [<ffffffff8108f9b0>] ? tick_nohz_handler+0xa0/0xa0
[ 23.707053] [<ffffffff81089617>] ? ktime_get_update_offsets+0x47/0xd0
[ 23.707053] [<ffffffff81066a37>] hrtimer_interrupt+0xf7/0x240
[ 23.707053] [<ffffffff81025883>] smp_apic_timer_interrupt+0x63/0xa0
[ 23.707053] [<ffffffff817b6e8a>] apic_timer_interrupt+0x6a/0x70
[ 23.707053] <EOI> [<ffffffff817af17d>] ? _raw_spin_unlock_irq+0xd/0x40
[ 23.707053] [<ffffffff817ae2aa>] __schedule+0x68a/0x790
[ 23.707053] [<ffffffff817ae4c4>] schedule+0x24/0x70
[ 23.707053] [<ffffffff810c05b7>] rcu_torture_reader+0xd7/0x2d0
[ 23.707053] [<ffffffff810c07b0>] ? rcu_torture_reader+0x2d0/0x2d0
[ 23.707053] [<ffffffff810c04e0>] ? rcutorture_trace_dump+0x50/0x50
[ 23.707053] [<ffffffff81061e6b>] kthread+0xbb/0xc0
[ 23.707053] [<ffffffff817a0000>] ? timer_cpu_notify+0x1e9/0x300
[ 23.707053] [<ffffffff81061db0>] ? flush_kthread_worker+0xa0/0xa0
[ 23.707053] [<ffffffff817b626c>] ret_from_fork+0x7c/0xb0
[ 23.707053] [<ffffffff81061db0>] ? flush_kthread_worker+0xa0/0xa0
[ 23.706051]
[ 23.706051] 0: (1 GPs behind) idle=429/140000000000001/0 drain=5 . timer not pending
[ 23.706051] (t=21000 jiffies g=85 c=84 q=6756)
[ 23.706051] Pid: 603, comm: rcu_torture_rea Not tainted 3.8.0-rc7+ #2
[ 23.706051] Call Trace:
[ 23.706051] <IRQ> [<ffffffff810c12b2>] rcu_pending+0x192/0x7a0
[ 23.706051] [<ffffffff810c590b>] rcu_check_callbacks+0xbb/0x220
[ 23.706051] [<ffffffff8104c193>] update_process_times+0x43/0x80
[ 23.706051] [<ffffffff8108f901>] tick_sched_handle.isra.8+0x31/0x40
[ 23.706051] [<ffffffff8108f9f7>] tick_sched_timer+0x47/0x70
[ 23.706051] [<ffffffff8106619c>] __run_hrtimer+0x7c/0x240
[ 23.706051] [<ffffffff8108f9b0>] ? tick_nohz_handler+0xa0/0xa0
[ 23.706051] [<ffffffff81089617>] ? ktime_get_update_offsets+0x47/0xd0
[ 23.706051] [<ffffffff81066a37>] hrtimer_interrupt+0xf7/0x240
[ 23.706051] [<ffffffff81025883>] smp_apic_timer_interrupt+0x63/0xa0
[ 23.706051] [<ffffffff817b6e8a>] apic_timer_interrupt+0x6a/0x70
[ 23.706051] <EOI> [<ffffffff817b2ae0>] ? add_preempt_count+0x30/0x90
[ 23.706051] [<ffffffff817adc5d>] __schedule+0x3d/0x790
[ 23.706051] [<ffffffff817ae4c4>] schedule+0x24/0x70
[ 23.706051] [<ffffffff810c05b7>] rcu_torture_reader+0xd7/0x2d0
[ 23.706051] [<ffffffff810c07b0>] ? rcu_torture_reader+0x2d0/0x2d0
[ 23.706051] [<ffffffff810c04e0>] ? rcutorture_trace_dump+0x50/0x50
[ 23.706051] [<ffffffff81061e6b>] kthread+0xbb/0xc0
[ 23.706051] [<ffffffff817a0000>] ? timer_cpu_notify+0x1e9/0x300
[ 23.706051] [<ffffffff81061db0>] ? flush_kthread_worker+0xa0/0xa0
[ 23.706051] [<ffffffff817b626c>] ret_from_fork+0x7c/0xb0
[ 23.706051] [<ffffffff81061db0>] ? flush_kthread_worker+0xa0/0xa0
next prev parent reply other threads:[~2013-02-16 19:26 UTC|newest]
Thread overview: 50+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-02-12 19:39 Debugging Thinkpad T430s occasional suspend failure Dave Jones
2013-02-12 20:13 ` Linus Torvalds
2013-02-13 0:26 ` Hugh Dickins
2013-02-13 0:40 ` Dave Jones
2013-02-13 0:56 ` Hugh Dickins
2013-02-13 4:16 ` Dave Jones
2013-02-13 5:37 ` Hugh Dickins
2013-02-13 19:34 ` Dave Jones
2013-02-13 19:56 ` Linus Torvalds
2013-02-13 20:53 ` Dave Jones
2013-02-16 20:54 ` Paul E. McKenney
2013-02-15 1:15 ` Dave Jones
2013-02-15 2:09 ` Linus Torvalds
2013-02-15 15:50 ` Ingo Molnar
2013-02-15 22:33 ` Dave Jones
2013-02-15 17:44 ` Paul E. McKenney
2013-02-15 18:34 ` Linus Torvalds
2013-02-15 18:35 ` Linus Torvalds
2013-02-15 18:50 ` Linus Torvalds
2013-02-16 19:25 ` Paul E. McKenney [this message]
2013-02-16 19:46 ` Linus Torvalds
2013-02-16 21:07 ` Paul E. McKenney
2013-02-16 21:53 ` H. Peter Anvin
2013-02-17 22:49 ` H. Peter Anvin
2013-02-18 8:41 ` Ingo Molnar
2013-02-19 8:50 ` Paul E. McKenney
2013-02-19 8:56 ` Ingo Molnar
2013-02-17 15:11 ` Frederic Weisbecker
2013-02-17 17:32 ` Linus Torvalds
2013-02-17 18:17 ` Frederic Weisbecker
2013-02-17 20:58 ` Frederic Weisbecker
2013-02-17 21:02 ` Frederic Weisbecker
2013-02-18 15:53 ` Frederic Weisbecker
2013-02-18 18:12 ` Linus Torvalds
2013-02-19 10:08 ` Frederic Weisbecker
2013-02-18 19:58 ` Thomas Gleixner
2013-02-19 10:38 ` Frederic Weisbecker
2013-02-19 10:44 ` Thomas Gleixner
2013-02-15 2:09 ` Hugh Dickins
2013-02-15 2:15 ` Linus Torvalds
2013-02-16 21:45 ` Hugh Dickins
2013-02-16 23:02 ` Linus Torvalds
2013-02-17 0:01 ` Hugh Dickins
2013-02-17 2:21 ` Hugh Dickins
2013-02-17 13:38 ` Daniel Vetter
2013-02-17 14:54 ` Daniel Vetter
2013-02-17 16:31 ` Hugh Dickins
2013-02-17 17:28 ` Daniel Vetter
2013-02-17 17:28 ` Daniel Vetter
2013-02-13 2:17 ` Dave Jones
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20130216192554.GB7035@linux.vnet.ibm.com \
--to=paulmck@linux.vnet.ibm.com \
--cc=davej@redhat.com \
--cc=fweisbec@gmail.com \
--cc=hughd@google.com \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@kernel.org \
--cc=paul.mckenney@linaro.org \
--cc=peterz@infradead.org \
--cc=tglx@linutronix.de \
--cc=torvalds@linux-foundation.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.