From: Peter Zijlstra <peterz@infradead.org>
To: Steven Rostedt <rostedt@goodmis.org>
Cc: linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org,
linux-kbuild@vger.kernel.org, bpf <bpf@vger.kernel.org>,
Masami Hiramatsu <mhiramat@kernel.org>,
Mark Rutland <mark.rutland@arm.com>,
Mathieu Desnoyers <mathieu.desnoyers@efficios.com>,
Andrew Morton <akpm@linux-foundation.org>,
Linus Torvalds <torvalds@linux-foundation.org>,
Masahiro Yamada <masahiroy@kernel.org>,
Nathan Chancellor <nathan@kernel.org>,
Nicolas Schier <nicolas@fjasle.eu>,
Zheng Yejian <zhengyejian1@huawei.com>,
Martin Kelly <martin.kelly@crowdstrike.com>,
Christophe Leroy <christophe.leroy@csgroup.eu>,
Josh Poimboeuf <jpoimboe@redhat.com>
Subject: Re: [PATCH 14/14] scripts/sorttable: ftrace: Do not add weak functions to available_filter_functions
Date: Thu, 2 Jan 2025 21:32:00 +0100 [thread overview]
Message-ID: <20250102203200.GE7274@noisy.programming.kicks-ass.net> (raw)
In-Reply-To: <20250102150356.1372a947@gandalf.local.home>
On Thu, Jan 02, 2025 at 03:03:56PM -0500, Steven Rostedt wrote:
> Maybe I misunderstood you, if you are not talking about kallsyms, but for
> static calls or anything else that references weak functions.
>
> The reference is not a problem I'm trying to address. The problem with
> mcount_loc, is that it is used to create the ftrace_table that is exposed
> to user space, and I can't remove entries once they are added.
>
> To set filter functions you echo names into set_ftrace_filter. If you want
> to enabled 5000 filters, that can take over a minute complete. That's
> because echoing in names to set_ftrace_filter is an O(n^2) operation. It
> has to search every address, call kallsyms on the address then compare it
> to every function passed in. If you have 40,000 functions total, and pass
> in 5,000 functions, that's 40,000 * 5,000 compares!
I'm pretty sure kallsyms has an option to use tree lookups, which would
make it ~ 16*5000.
> Since tooling is what does add these large number of filters, a shortcut
> was added. If a number written into set_ftrace_filter, it doesn't do a
> kallsyms lookup, it will enable the nth function in
> available_filter_functions. This turns into a O(1) operation.
>
> libtracefs() will read the available_filter_functions, figure out what to
> enable from that, and then write the indexes of all the functions it wants
> to enable. This is a much faster operation then echoing the names one at a
> time.
>
> This is where the weak functions becomes an issue. If I just ignore them,
> and do not add a place holder in the mcount section. Then the index will be
> off, and will break.
>
> When the issue first came about, I simply ignored the weak functions, but
> then my libtracefs self tests started to fail.
>
> So yes, this is just fixing mcount_loc, but I believe it's the only one
> that has a user interface issue.
This is quite the insane interface -- but whatever. I still feel
strongly you should fix kallsyms so that we can all deal more sanely
with the weak crap.
next prev parent reply other threads:[~2025-01-02 20:32 UTC|newest]
Thread overview: 36+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-01-02 18:58 [PATCH 00/14] scripts/sorttable: ftrace: Remove place holders for weak functions in available_filter_functions Steven Rostedt
2025-01-02 18:58 ` [PATCH 01/14] scripts/sorttable: Remove unused macro defines Steven Rostedt
2025-01-02 18:58 ` [PATCH 02/14] scripts/sorttable: Remove unused write functions Steven Rostedt
2025-01-02 18:58 ` [PATCH 03/14] scripts/sorttable: Remove unneeded Elf_Rel Steven Rostedt
2025-01-02 18:58 ` [PATCH 04/14] scripts/sorttable: Have the ORC code use the _r() functions to read Steven Rostedt
2025-01-02 18:58 ` [PATCH 05/14] scripts/sorttable: Make compare_extable() into two functions Steven Rostedt
2025-01-02 18:58 ` [PATCH 06/14] scripts/sorttable: Convert Elf_Ehdr to union Steven Rostedt
2025-01-02 18:58 ` [PATCH 07/14] scripts/sorttable: Replace Elf_Shdr Macro with a union Steven Rostedt
2025-01-02 18:58 ` [PATCH 08/14] scripts/sorttable: Convert Elf_Sym MACRO over to " Steven Rostedt
2025-01-02 18:58 ` [PATCH 09/14] scripts/sorttable: Add helper functions for Elf_Ehdr Steven Rostedt
2025-01-02 18:58 ` [PATCH 10/14] scripts/sorttable: Add helper functions for Elf_Shdr Steven Rostedt
2025-01-02 18:58 ` [PATCH 11/14] scripts/sorttable: Add helper functions for Elf_Sym Steven Rostedt
2025-01-02 18:58 ` [PATCH 12/14] scripts/sorttable: Use uint64_t for mcount sorting Steven Rostedt
2025-01-02 18:58 ` [PATCH 13/14] scripts/sorttable: Move code from sorttable.h into sorttable.c Steven Rostedt
2025-01-02 18:58 ` [PATCH 14/14] scripts/sorttable: ftrace: Do not add weak functions to available_filter_functions Steven Rostedt
2025-01-02 19:48 ` Peter Zijlstra
2025-01-02 19:55 ` Steven Rostedt
2025-01-02 20:03 ` Steven Rostedt
2025-01-02 20:32 ` Peter Zijlstra [this message]
2025-01-02 20:41 ` Steven Rostedt
2025-01-02 20:48 ` Peter Zijlstra
2025-01-02 20:53 ` Steven Rostedt
2025-01-02 20:24 ` Peter Zijlstra
2025-01-02 20:30 ` Steven Rostedt
2025-01-02 20:36 ` Peter Zijlstra
2025-01-02 20:45 ` Steven Rostedt
2025-01-03 11:10 ` Jiri Olsa
2025-01-03 11:41 ` Peter Zijlstra
2025-01-03 12:14 ` Steven Rostedt
2025-01-03 18:06 ` Jiri Olsa
2025-01-02 19:24 ` [PATCH 00/14] scripts/sorttable: ftrace: Remove place holders for weak functions in available_filter_functions Steven Rostedt
2025-01-02 19:30 ` Linus Torvalds
2025-01-02 19:45 ` Steven Rostedt
2025-01-02 19:47 ` Steven Rostedt
2025-01-02 21:44 ` Steven Rostedt
2025-01-02 22:14 ` Steven Rostedt
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20250102203200.GE7274@noisy.programming.kicks-ass.net \
--to=peterz@infradead.org \
--cc=akpm@linux-foundation.org \
--cc=bpf@vger.kernel.org \
--cc=christophe.leroy@csgroup.eu \
--cc=jpoimboe@redhat.com \
--cc=linux-kbuild@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-trace-kernel@vger.kernel.org \
--cc=mark.rutland@arm.com \
--cc=martin.kelly@crowdstrike.com \
--cc=masahiroy@kernel.org \
--cc=mathieu.desnoyers@efficios.com \
--cc=mhiramat@kernel.org \
--cc=nathan@kernel.org \
--cc=nicolas@fjasle.eu \
--cc=rostedt@goodmis.org \
--cc=torvalds@linux-foundation.org \
--cc=zhengyejian1@huawei.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).