From: Steven Rostedt <rostedt@goodmis.org>
To: Mark Brown <broonie@kernel.org>
Cc: linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org,
bpf@vger.kernel.org, Masami Hiramatsu <mhiramat@kernel.org>,
Mark Rutland <mark.rutland@arm.com>,
Mathieu Desnoyers <mathieu.desnoyers@efficios.com>,
Andrew Morton <akpm@linux-foundation.org>,
Sven Schnelle <svens@linux.ibm.com>,
Paul Walmsley <paul.walmsley@sifive.com>,
Palmer Dabbelt <palmer@dabbelt.com>,
Albert Ou <aou@eecs.berkeley.edu>, Guo Ren <guoren@kernel.org>,
Donglin Peng <dolinux.peng@gmail.com>,
Zheng Yejian <zhengyejian@huaweicloud.com>,
Aishwarya.TCV@arm.com
Subject: Re: [PATCH v4 2/4] ftrace: Add support for function argument to graph tracer
Date: Fri, 11 Apr 2025 12:45:52 -0400 [thread overview]
Message-ID: <20250411124552.36564a07@gandalf.local.home> (raw)
In-Reply-To: <c41e5ee7-18ba-40cf-8a31-19062d94f7b9@sirena.org.uk>
On Fri, 11 Apr 2025 14:00:40 +0100
Mark Brown <broonie@kernel.org> wrote:
> On Thu, Apr 10, 2025 at 01:17:45PM -0400, Steven Rostedt wrote:
> > Mark Brown <broonie@kernel.org> wrote:
>
> > > We've been seeing the PID filters selftest failing for a while on
> > > several arm64 systems, a bisect I managed to run without running into
> > > any confounding issues pointed to this patch which is in mainline as
> > > ff5c9c576e75. It's in the ftrace code, but I'm not immediately seeing
> > > the relevance. Output from a failing run:
>
> > Hmm, I wonder if there's junk being added into the trace.
>
> > Can you add this patch, and show me the output when it fails again?
>
Can you show the information before this output, to see what it is actually
testing?
> # # + cat trace
> # # # tracer: function_graph
> # # #
> # # # CPU TASK/PID DURATION FUNCTION CALLS
> # # # | | | | | | | | |
> # # 0) ftracet-5190 | ! 537.633 us | kernel_clone(); /* ret=0x1470 */
> # #
> # # 0) ftracet-5190 | ! 508.253 us | kernel_clone(); /* ret=0x1471 */
> # #
> # # 0) ftracet-5190 | ! 215.716 us | kernel_clone(); /* ret=0x1476 */
> # #
> # # 0) ftracet-5190 | ! 493.890 us | kernel_clone(); /* ret=0x147b */
> # #
> # # + fail PID filtering not working?
>
> ...
>
> # # + cat trace
> # # # tracer: function_graph
> # # #
> # # # CPU TASK/PID DURATION FUNCTION CALLS
> # # # | | | | | | | | |
> # # 0) ftracet-12279 | ! 598.118 us | kernel_clone(); /* ret=0x301f */
> # #
> # # 0) ftracet-12279 | ! 492.539 us | kernel_clone(); /* ret=0x3020 */
> # #
> # # 0) ftracet-12279 | ! 231.104 us | kernel_clone(); /* ret=0x3025 */
> # #
> # # 0) ftracet-12279 | ! 555.566 us | kernel_clone(); /* ret=0x302a */
> # #
> # # + fail PID filtering not working?
Also, is it possible to just enable function_graph tarcing and see if it
adds these blank lines between events?
-- Steve
next prev parent reply other threads:[~2025-04-11 16:44 UTC|newest]
Thread overview: 30+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-02-27 18:58 [PATCH v4 0/4] ftrace: Add function arguments to function tracers Steven Rostedt
2025-02-27 18:58 ` [PATCH v4 1/4] ftrace: Add print_function_args() Steven Rostedt
2025-02-27 18:58 ` [PATCH v4 2/4] ftrace: Add support for function argument to graph tracer Steven Rostedt
2025-04-09 22:34 ` Mark Brown
2025-04-10 17:17 ` Steven Rostedt
2025-04-11 13:00 ` Mark Brown
2025-04-11 16:45 ` Steven Rostedt [this message]
2025-04-11 16:48 ` Steven Rostedt
2025-04-11 17:02 ` Steven Rostedt
2025-04-11 17:33 ` Steven Rostedt
2025-04-11 16:58 ` Mark Brown
2025-04-11 17:12 ` Steven Rostedt
2025-04-11 17:39 ` Mark Brown
2025-04-11 18:16 ` Mark Brown
2025-04-11 18:24 ` Steven Rostedt
2025-04-11 18:29 ` Mark Brown
2025-04-11 18:31 ` Steven Rostedt
2025-04-11 19:13 ` Steven Rostedt
2025-04-11 19:26 ` Steven Rostedt
2025-04-11 19:27 ` Steven Rostedt
2025-04-14 3:00 ` Masami Hiramatsu
2025-04-14 3:08 ` Masami Hiramatsu
2025-04-14 13:31 ` Steven Rostedt
2025-04-15 17:40 ` Steven Rostedt
2025-08-09 2:24 ` Sasha Levin
2025-08-13 23:53 ` Steven Rostedt
2025-08-14 17:05 ` Sasha Levin
2025-08-19 22:21 ` Steven Rostedt
2025-02-27 18:58 ` [PATCH v4 3/4] ftrace: Have funcgraph-args take affect during tracing Steven Rostedt
2025-02-27 18:58 ` [PATCH v4 4/4] ftrace: Add arguments to function tracer Steven Rostedt
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20250411124552.36564a07@gandalf.local.home \
--to=rostedt@goodmis.org \
--cc=Aishwarya.TCV@arm.com \
--cc=akpm@linux-foundation.org \
--cc=aou@eecs.berkeley.edu \
--cc=bpf@vger.kernel.org \
--cc=broonie@kernel.org \
--cc=dolinux.peng@gmail.com \
--cc=guoren@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-trace-kernel@vger.kernel.org \
--cc=mark.rutland@arm.com \
--cc=mathieu.desnoyers@efficios.com \
--cc=mhiramat@kernel.org \
--cc=palmer@dabbelt.com \
--cc=paul.walmsley@sifive.com \
--cc=svens@linux.ibm.com \
--cc=zhengyejian@huaweicloud.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).