From: Ingo Molnar <mingo@elte.hu>
To: ath9k-devel@lists.ath9k.org
Subject: [ath9k-devel] ath9k: massive unexplained latency in 2.6.27 (rc5, rc6, probably others)
Date: Fri, 19 Sep 2008 10:51:06 +0200 [thread overview]
Message-ID: <20080919085105.GG17592@elte.hu> (raw)
In-Reply-To: <f488382f0809190145s1b5407d4s9d97ae594bcc3379@mail.gmail.com>
* Steven Noonan <steven@uplinklabs.net> wrote:
> On Fri, Sep 19, 2008 at 1:22 AM, Steven Noonan <steven@uplinklabs.net> wrote:
> > On Fri, Sep 19, 2008 at 1:17 AM, Ingo Molnar <mingo@elte.hu> wrote:
> >> in tip/master there's an ftrace_printk() facility. You can just replace
> >> the verbose printk()s with ftrace_printk() and see the result in
> >> /debug/tracing/trace.
> >>
> >> This sort of tracing has very low overhead and can be used in an easy
> >> ad-hoc manner with no extra infrastructure. Here's a few quick-start
> >> links about how to enable the scheduler tracer:
> >>
> >> http://redhat.com/~mingo/sched-devel.git/readme-tracer.txt
> >> http://redhat.com/~mingo/sched-devel.git/howto-trace-latencies.txt
> >>
> >> any ftrace_printk() you add in the kernel will show up in that trace.
> >>
> >> (If the scheduling events are uninteresting and clutter the output then
> >> you might want to remove the scheduler tracing entries from kernel/*.c
> >> by removing the trace_sched_*() calls or use a less noisy tracer.)
> >>
> >> to get enough of a trace history you might want to increase the number
> >> of trace entries in /debug/tracing/trace_entries from 16K to 128K or so.
> >>
> >
> > Thanks for the suggestion, I'll do that. :)
> >
>
> It'd be extremely convenient to have a tracer that did absolutely
> nothing but display ftrace_printk()s.
yeah, had the same thought.
Could you please contribute one? :) I'd suggest you take the smallest
tracer as a template: trace_sched_switch.c and turn that into
trace_nop.c - and change all the function names and ASCII and kconfig
glue to 'nop'/'NOP'?
That can then be used as a basis for additional ftrace plugins, or for
ad-hoc temporary tracing.
Ingo
WARNING: multiple messages have this Message-ID (diff)
From: Ingo Molnar <mingo@elte.hu>
To: Steven Noonan <steven@uplinklabs.net>
Cc: "Luis R. Rodriguez" <lrodriguez@atheros.com>,
Luis Rodriguez <Luis.Rodriguez@atheros.com>,
"ath9k-devel@lists.ath9k.org" <ath9k-devel@lists.ath9k.org>,
linux-wireless <linux-wireless@vger.kernel.org>,
LKML <linux-kernel@vger.kernel.org>,
Steven Rostedt <rostedt@goodmis.org>
Subject: Re: [ath9k-devel] ath9k: massive unexplained latency in 2.6.27 (rc5, rc6, probably others)
Date: Fri, 19 Sep 2008 10:51:06 +0200 [thread overview]
Message-ID: <20080919085105.GG17592@elte.hu> (raw)
In-Reply-To: <f488382f0809190145s1b5407d4s9d97ae594bcc3379@mail.gmail.com>
* Steven Noonan <steven@uplinklabs.net> wrote:
> On Fri, Sep 19, 2008 at 1:22 AM, Steven Noonan <steven@uplinklabs.net> wrote:
> > On Fri, Sep 19, 2008 at 1:17 AM, Ingo Molnar <mingo@elte.hu> wrote:
> >> in tip/master there's an ftrace_printk() facility. You can just replace
> >> the verbose printk()s with ftrace_printk() and see the result in
> >> /debug/tracing/trace.
> >>
> >> This sort of tracing has very low overhead and can be used in an easy
> >> ad-hoc manner with no extra infrastructure. Here's a few quick-start
> >> links about how to enable the scheduler tracer:
> >>
> >> http://redhat.com/~mingo/sched-devel.git/readme-tracer.txt
> >> http://redhat.com/~mingo/sched-devel.git/howto-trace-latencies.txt
> >>
> >> any ftrace_printk() you add in the kernel will show up in that trace.
> >>
> >> (If the scheduling events are uninteresting and clutter the output then
> >> you might want to remove the scheduler tracing entries from kernel/*.c
> >> by removing the trace_sched_*() calls or use a less noisy tracer.)
> >>
> >> to get enough of a trace history you might want to increase the number
> >> of trace entries in /debug/tracing/trace_entries from 16K to 128K or so.
> >>
> >
> > Thanks for the suggestion, I'll do that. :)
> >
>
> It'd be extremely convenient to have a tracer that did absolutely
> nothing but display ftrace_printk()s.
yeah, had the same thought.
Could you please contribute one? :) I'd suggest you take the smallest
tracer as a template: trace_sched_switch.c and turn that into
trace_nop.c - and change all the function names and ASCII and kconfig
glue to 'nop'/'NOP'?
That can then be used as a basis for additional ftrace plugins, or for
ad-hoc temporary tracing.
Ingo
WARNING: multiple messages have this Message-ID (diff)
From: Ingo Molnar <mingo@elte.hu>
To: Steven Noonan <steven@uplinklabs.net>
Cc: "Luis R. Rodriguez" <lrodriguez@atheros.com>,
Luis Rodriguez <Luis.Rodriguez@atheros.com>,
"ath9k-devel@lists.ath9k.org" <ath9k-devel@venema.h4ckr.net>,
linux-wireless <linux-wireless@vger.kernel.org>,
LKML <linux-kernel@vger.kernel.org>,
Steven Rostedt <rostedt@goodmis.org>
Subject: Re: [ath9k-devel] ath9k: massive unexplained latency in 2.6.27 (rc5, rc6, probably others)
Date: Fri, 19 Sep 2008 10:51:06 +0200 [thread overview]
Message-ID: <20080919085105.GG17592@elte.hu> (raw)
In-Reply-To: <f488382f0809190145s1b5407d4s9d97ae594bcc3379@mail.gmail.com>
* Steven Noonan <steven@uplinklabs.net> wrote:
> On Fri, Sep 19, 2008 at 1:22 AM, Steven Noonan <steven@uplinklabs.net> wrote:
> > On Fri, Sep 19, 2008 at 1:17 AM, Ingo Molnar <mingo@elte.hu> wrote:
> >> in tip/master there's an ftrace_printk() facility. You can just replace
> >> the verbose printk()s with ftrace_printk() and see the result in
> >> /debug/tracing/trace.
> >>
> >> This sort of tracing has very low overhead and can be used in an easy
> >> ad-hoc manner with no extra infrastructure. Here's a few quick-start
> >> links about how to enable the scheduler tracer:
> >>
> >> http://redhat.com/~mingo/sched-devel.git/readme-tracer.txt
> >> http://redhat.com/~mingo/sched-devel.git/howto-trace-latencies.txt
> >>
> >> any ftrace_printk() you add in the kernel will show up in that trace.
> >>
> >> (If the scheduling events are uninteresting and clutter the output then
> >> you might want to remove the scheduler tracing entries from kernel/*.c
> >> by removing the trace_sched_*() calls or use a less noisy tracer.)
> >>
> >> to get enough of a trace history you might want to increase the number
> >> of trace entries in /debug/tracing/trace_entries from 16K to 128K or so.
> >>
> >
> > Thanks for the suggestion, I'll do that. :)
> >
>
> It'd be extremely convenient to have a tracer that did absolutely
> nothing but display ftrace_printk()s.
yeah, had the same thought.
Could you please contribute one? :) I'd suggest you take the smallest
tracer as a template: trace_sched_switch.c and turn that into
trace_nop.c - and change all the function names and ASCII and kconfig
glue to 'nop'/'NOP'?
That can then be used as a basis for additional ftrace plugins, or for
ad-hoc temporary tracing.
Ingo
next prev parent reply other threads:[~2008-09-19 8:51 UTC|newest]
Thread overview: 192+ messages / expand[flat|nested] mbox.gz Atom feed top
2008-09-18 18:23 [ath9k-devel] ath9k: massive unexplained latency in 2.6.27 (rc5, rc6, probably others) Steven Noonan
2008-09-18 18:23 ` Steven Noonan
2008-09-18 18:23 ` Steven Noonan
2008-09-18 18:30 ` Johannes Berg
2008-09-18 18:34 ` [ath9k-devel] " Luis R. Rodriguez
2008-09-18 18:34 ` Luis R. Rodriguez
2008-09-18 18:34 ` Luis R. Rodriguez
2008-09-18 18:42 ` Luis R. Rodriguez
2008-09-18 18:42 ` Luis R. Rodriguez
2008-09-18 18:42 ` Luis R. Rodriguez
2008-09-18 19:00 ` Steven Noonan
2008-09-18 19:00 ` Steven Noonan
2008-09-18 19:00 ` Steven Noonan
2008-09-18 19:23 ` Steven Noonan
2008-09-18 19:23 ` Steven Noonan
2008-09-18 19:23 ` Steven Noonan
2008-09-18 20:18 ` Justin Mattock
2008-09-18 20:18 ` Justin Mattock
2008-09-18 20:18 ` Justin Mattock
2008-09-18 20:25 ` Steven Noonan
2008-09-18 20:25 ` Steven Noonan
2008-09-18 20:25 ` Steven Noonan
2008-09-18 20:44 ` Luis R. Rodriguez
2008-09-18 20:44 ` Luis R. Rodriguez
2008-09-18 20:44 ` Luis R. Rodriguez
2008-09-18 21:31 ` Justin Mattock
2008-09-18 21:31 ` Justin Mattock
2008-09-18 21:31 ` Justin Mattock
2008-09-18 21:49 ` Steven Noonan
2008-09-18 21:49 ` Steven Noonan
2008-09-18 21:49 ` Steven Noonan
2008-09-18 22:01 ` Luis R. Rodriguez
2008-09-18 22:01 ` Luis R. Rodriguez
2008-09-18 22:01 ` Luis R. Rodriguez
2008-09-18 22:08 ` Luis R. Rodriguez
2008-09-18 22:08 ` Luis R. Rodriguez
2008-09-18 22:08 ` Luis R. Rodriguez
2008-09-18 23:04 ` Steven Noonan
2008-09-18 23:04 ` Steven Noonan
2008-09-18 23:04 ` Steven Noonan
2008-09-18 23:10 ` Luis R. Rodriguez
2008-09-18 23:10 ` Luis R. Rodriguez
2008-09-18 23:10 ` Luis R. Rodriguez
2008-09-18 23:16 ` Johannes Berg
2008-09-18 23:16 ` Johannes Berg
2008-09-18 23:16 ` Johannes Berg
2008-09-19 2:52 ` Steven Noonan
2008-09-19 2:52 ` Steven Noonan
2008-09-19 2:52 ` Steven Noonan
2008-09-19 3:01 ` Luis R. Rodriguez
2008-09-19 3:01 ` Luis R. Rodriguez
2008-09-19 3:01 ` Luis R. Rodriguez
2008-09-19 7:29 ` Steven Noonan
2008-09-19 7:29 ` Steven Noonan
2008-09-19 7:29 ` Steven Noonan
2008-09-19 8:17 ` Ingo Molnar
2008-09-19 8:17 ` Ingo Molnar
2008-09-19 8:17 ` Ingo Molnar
2008-09-19 8:22 ` Steven Noonan
2008-09-19 8:22 ` Steven Noonan
2008-09-19 8:22 ` Steven Noonan
2008-09-19 8:32 ` Ingo Molnar
2008-09-19 8:32 ` Ingo Molnar
2008-09-19 8:32 ` Ingo Molnar
2008-09-27 1:23 ` Steven Rostedt
2008-09-27 1:23 ` Steven Rostedt
2008-09-27 1:23 ` Steven Rostedt
2008-09-27 19:20 ` Ingo Molnar
2008-09-27 19:20 ` Ingo Molnar
2008-09-27 19:20 ` Ingo Molnar
2008-09-27 19:28 ` Steven Rostedt
2008-09-27 19:28 ` Steven Rostedt
2008-09-27 19:28 ` Steven Rostedt
2008-09-19 8:45 ` Steven Noonan
2008-09-19 8:45 ` Steven Noonan
2008-09-19 8:45 ` Steven Noonan
2008-09-19 8:51 ` Ingo Molnar [this message]
2008-09-19 8:51 ` Ingo Molnar
2008-09-19 8:51 ` Ingo Molnar
2008-09-19 8:22 ` Steven Noonan
2008-09-19 8:22 ` Steven Noonan
2008-09-19 8:22 ` Steven Noonan
2008-09-19 14:28 ` Senthil Balasubramanian
2008-09-19 14:28 ` Senthil Balasubramanian
2008-09-19 14:28 ` Senthil Balasubramanian
2008-09-19 16:42 ` Steven Noonan
2008-09-19 16:42 ` Steven Noonan
2008-09-19 16:42 ` Steven Noonan
2008-09-19 17:58 ` Senthil Balasubramanian
2008-09-19 17:58 ` Senthil Balasubramanian
2008-09-19 17:58 ` Senthil Balasubramanian
2008-09-19 18:23 ` Luis R. Rodriguez
2008-09-19 18:23 ` Luis R. Rodriguez
2008-09-19 18:23 ` Luis R. Rodriguez
2008-09-19 23:31 ` Steven Noonan
2008-09-19 23:31 ` Steven Noonan
2008-09-19 23:31 ` Steven Noonan
2008-09-19 23:53 ` Luis R. Rodriguez
2008-09-19 23:53 ` Luis R. Rodriguez
2008-09-19 23:53 ` Luis R. Rodriguez
2008-09-20 0:01 ` Steven Noonan
2008-09-20 0:01 ` Steven Noonan
2008-09-20 0:01 ` Steven Noonan
2008-09-20 1:13 ` Luis R. Rodriguez
2008-09-20 1:13 ` Luis R. Rodriguez
2008-09-20 1:13 ` Luis R. Rodriguez
2008-09-20 1:15 ` Luis R. Rodriguez
2008-09-20 1:15 ` Luis R. Rodriguez
2008-09-20 1:15 ` Luis R. Rodriguez
2008-09-20 3:29 ` Steven Noonan
2008-09-20 3:29 ` Steven Noonan
2008-09-20 3:29 ` Steven Noonan
2008-09-20 3:40 ` Steven Noonan
2008-09-20 3:40 ` Steven Noonan
2008-09-20 3:40 ` Steven Noonan
2008-09-20 20:56 ` Luis R. Rodriguez
2008-09-20 20:56 ` Luis R. Rodriguez
2008-09-20 20:56 ` Luis R. Rodriguez
2008-09-20 15:21 ` Steven Noonan
2008-09-20 15:21 ` Steven Noonan
2008-09-20 15:21 ` Steven Noonan
2008-09-20 20:57 ` Luis R. Rodriguez
2008-09-20 20:57 ` Luis R. Rodriguez
2008-09-20 20:57 ` Luis R. Rodriguez
2008-09-20 20:58 ` Johannes Berg
2008-09-20 20:58 ` Johannes Berg
2008-09-20 20:58 ` Johannes Berg
2008-09-20 21:03 ` Luis R. Rodriguez
2008-09-20 21:03 ` Luis R. Rodriguez
2008-09-20 21:03 ` Luis R. Rodriguez
2008-09-20 21:22 ` Steven Noonan
2008-09-20 21:22 ` Steven Noonan
2008-09-20 21:22 ` Steven Noonan
2008-09-20 21:26 ` Luis R. Rodriguez
2008-09-20 21:26 ` Luis R. Rodriguez
2008-09-20 21:26 ` Luis R. Rodriguez
2008-09-20 21:48 ` Steven Noonan
2008-09-20 21:48 ` Steven Noonan
2008-09-20 21:48 ` Steven Noonan
2008-09-21 1:48 ` Steven Noonan
2008-09-21 1:48 ` Steven Noonan
2008-09-21 1:48 ` Steven Noonan
2008-09-21 15:33 ` Jean Schurger
2008-09-21 17:01 ` Steven Noonan
2008-09-22 6:54 ` Luis R. Rodriguez
2008-09-22 6:54 ` Luis R. Rodriguez
2008-09-22 6:54 ` Luis R. Rodriguez
2008-09-22 7:14 ` Luis R. Rodriguez
2008-09-22 7:14 ` Luis R. Rodriguez
2008-09-22 7:14 ` Luis R. Rodriguez
2008-09-22 7:26 ` Steven Noonan
2008-09-22 7:26 ` Steven Noonan
2008-09-22 7:26 ` Steven Noonan
2008-09-22 8:06 ` Luis R. Rodriguez
2008-09-22 8:06 ` Luis R. Rodriguez
2008-09-22 8:06 ` Luis R. Rodriguez
2008-09-22 15:11 ` Steven Noonan
2008-09-22 15:11 ` Steven Noonan
2008-09-22 15:11 ` Steven Noonan
2008-09-22 16:01 ` Luis R. Rodriguez
2008-09-22 16:01 ` Luis R. Rodriguez
2008-09-22 16:01 ` Luis R. Rodriguez
2008-09-23 7:22 ` Steven Noonan
2008-09-23 7:22 ` Steven Noonan
2008-09-23 7:22 ` Steven Noonan
2008-09-23 7:55 ` Steven Noonan
2008-09-23 7:55 ` Steven Noonan
2008-09-23 7:55 ` Steven Noonan
2008-09-23 16:20 ` Steven Noonan
2008-09-23 16:20 ` Steven Noonan
2008-09-23 16:20 ` Steven Noonan
2008-09-23 19:22 ` Luis R. Rodriguez
2008-09-23 19:22 ` Luis R. Rodriguez
2008-09-23 19:22 ` Luis R. Rodriguez
2008-09-20 21:18 ` Steven Noonan
2008-09-20 21:18 ` Steven Noonan
2008-09-20 21:18 ` Steven Noonan
2008-09-20 21:24 ` Luis R. Rodriguez
2008-09-20 21:24 ` Luis R. Rodriguez
2008-09-20 21:24 ` Luis R. Rodriguez
2008-09-18 23:08 ` Steven Noonan
2008-09-18 23:08 ` Steven Noonan
2008-09-18 23:08 ` Steven Noonan
2008-09-18 23:12 ` Luis R. Rodriguez
2008-09-18 23:12 ` Luis R. Rodriguez
2008-09-18 23:12 ` Luis R. Rodriguez
[not found] <fa.jQQm4Iwb0lkAWxV+5FAfTMHY4m4@ifi.uio.no>
[not found] ` <fa.zGA6t2p+jJeMRIaZFOqy1I8En1c@ifi.uio.no>
[not found] ` <fa.AGi3s2gpyC3T3KuCJ8cYQ30teak@ifi.uio.no>
[not found] ` <fa.59AlSLNBuMx/BjQSvR6whwGydbU@ifi.uio.no>
[not found] ` <fa.NwYDTAB59VZjr1quzgR4OU0+8eQ@ifi.uio.no>
[not found] ` <fa.tRre/FoeQKwChGwdusnYJgwjRmw@ifi.uio.no>
2008-09-19 14:46 ` Robert Hancock
2008-09-19 14:46 ` Robert Hancock
2008-09-19 14:46 ` Robert Hancock
2008-09-19 16:27 ` Steven Noonan
2008-09-19 16:27 ` Steven Noonan
2008-09-19 16:27 ` Steven Noonan
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20080919085105.GG17592@elte.hu \
--to=mingo@elte.hu \
--cc=ath9k-devel@lists.ath9k.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.