From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id D310386126; Wed, 11 Sep 2024 23:49:32 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1726098572; cv=none; b=Zx2CCAy6NgZSvO8WwqUPDsw0QuQrdjM7+CzJqOBK3HKLtbpoa2tq91/LrBQXARd/+alYMzQsWfmqVyNMaTLkdSu6tZewA/IqBCOBsbrIOXhHunUOESyAWoj1Jv4EjGXETvfzT+rnGiHa1C0d2EKQ4oM6WUu3VMiXGiuEHHVqCDE= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1726098572; c=relaxed/simple; bh=sMCUlAfMkrhguEU3xLJqnBvQY1HzIxj4u+AORh90ylc=; h=Date:From:To:Cc:Subject:Message-Id:In-Reply-To:References: Mime-Version:Content-Type; b=KmsfxaFZsalr8O6JkrP3dnWgaRlyV8c+0EZ+9mZYEyv3W7PiW4KgY3jd4hzK111o1WkXqqkSyIvi0T6w2tJyB/n9PSOQoKjS00Fq4rFqbu31sb+kZs5oIjep/cSo3924IcAIoDiUfyjDQLbq/6cPqxv478K77W3GLI3i3ddXwD8= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=XPJI9msS; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="XPJI9msS" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 62972C4CEC0; Wed, 11 Sep 2024 23:49:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1726098572; bh=sMCUlAfMkrhguEU3xLJqnBvQY1HzIxj4u+AORh90ylc=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=XPJI9msSHZk0Qxp9qJH5Xhcv/zRgComwoMEbxAmaNnkVdjokXBld3+XhdlG6AJeoQ pFV4AE9oAZ/8vKvFVzpYD3BqreNQYo6UdfZr0+7AzXEBtIqNRXuALFvGEdGHAw9ia6 zLFs9QIj0o9ofbUQp6FL8tU4Sx10BgQE14XKsCR0Su4z2nWBpG6PyCbhUMkmS6te65 qf2qEZcdgDCJ3o6twaccCHSWh6aiI4FNEpIxLJoiCmVWVhc3sWWVVzBDLiOs2gBQTU dIvAgcgoRpvSOkrzCtCw4mjM4y+FkxpZHEoWrHkw7ACAlBxZKDTyABYUMTVQE+U64G 4USMNJhIvk4sg== Date: Thu, 12 Sep 2024 08:49:26 +0900 From: Masami Hiramatsu (Google) To: Masami Hiramatsu (Google) Cc: Alexei Starovoitov , Steven Rostedt , Florent Revest , linux-trace-kernel@vger.kernel.org, LKML , Martin KaFai Lau , bpf , Sven Schnelle , Alexei Starovoitov , Jiri Olsa , Arnaldo Carvalho de Melo , Daniel Borkmann , Alan Maguire , Mark Rutland , Peter Zijlstra , Thomas Gleixner , Guo Ren Subject: Re: [PATCH v13 00/20] tracing: fprobe: function_graph: Multi-function graph and fprobe on fgraph Message-Id: <20240912084926.6d4c5768a538fb5946e31bda@kernel.org> In-Reply-To: <20240911092434.76e33f1f44b077fd706f4520@kernel.org> References: <172398527264.293426.2050093948411376857.stgit@devnote2> <20240911092434.76e33f1f44b077fd706f4520@kernel.org> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; x86_64-pc-linux-gnu) Precedence: bulk X-Mailing-List: linux-trace-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit On Wed, 11 Sep 2024 09:24:34 +0900 Masami Hiramatsu (Google) wrote: > Let me gently ping :) > > Let me check it should be rebased on tracing/for-next again. But basically > this should be the same... I found a build error on riscv. Let me fix that. Thanks, > > On Sun, 18 Aug 2024 21:47:53 +0900 > "Masami Hiramatsu (Google)" wrote: > > > Hi, > > > > Here is the 13th version of the series to re-implement the fprobe on > > function-graph tracer. The previous version is; > > > > https://lore.kernel.org/all/172000134410.63468.13742222887213469474.stgit@devnote2/ > > > > This version is based on v6.11-rc3. > > In this version, I added a bugfix as [1/20], which should go to urgent > > branch, and dropped the performance improvement patch which was introduced > > in v12 because I found that does not work with new kernel. > > > > Overview > > -------- > > This series rewrites the fprobe on this function-graph. > > The purposes of this change are; > > > > 1) Remove dependency of the rethook from fprobe so that we can reduce > > the return hook code and shadow stack. > > > > 2) Make 'ftrace_regs' the common trace interface for the function > > boundary. > > > > 1) Currently we have 2(or 3) different function return hook codes, > > the function-graph tracer and rethook (and legacy kretprobe). > > But since this is redundant and needs double maintenance cost, > > I would like to unify those. From the user's viewpoint, function- > > graph tracer is very useful to grasp the execution path. For this > > purpose, it is hard to use the rethook in the function-graph > > tracer, but the opposite is possible. (Strictly speaking, kretprobe > > can not use it because it requires 'pt_regs' for historical reasons.) > > > > 2) Now the fprobe provides the 'pt_regs' for its handler, but that is > > wrong for the function entry and exit. Moreover, depending on the > > architecture, there is no way to accurately reproduce 'pt_regs' > > outside of interrupt or exception handlers. This means fprobe should > > not use 'pt_regs' because it does not use such exceptions. > > (Conversely, kprobe should use 'pt_regs' because it is an abstract > > interface of the software breakpoint exception.) > > > > This series changes fprobe to use function-graph tracer for tracing > > function entry and exit, instead of mixture of ftrace and rethook. > > Unlike the rethook which is a per-task list of system-wide allocated > > nodes, the function graph's ret_stack is a per-task shadow stack. > > Thus it does not need to set 'nr_maxactive' (which is the number of > > pre-allocated nodes). > > Also the handlers will get the 'ftrace_regs' instead of 'pt_regs'. > > Since eBPF mulit_kprobe/multi_kretprobe events still use 'pt_regs' as > > their register interface, this changes it to convert 'ftrace_regs' to > > 'pt_regs'. Of course this conversion makes an incomplete 'pt_regs', > > so users must access only registers for function parameters or > > return value. > > > > Design > > ------ > > Instead of using ftrace's function entry hook directly, the new fprobe > > is built on top of the function-graph's entry and return callbacks > > with 'ftrace_regs'. > > > > Since the fprobe requires access to 'ftrace_regs', the architecture > > must support CONFIG_HAVE_DYNAMIC_FTRACE_WITH_ARGS and > > CONFIG_HAVE_FTRACE_GRAPH_FUNC, which enables to call function-graph > > entry callback with 'ftrace_regs', and also > > CONFIG_HAVE_FUNCTION_GRAPH_FREGS, which passes the ftrace_regs to > > return_to_handler. > > > > All fprobes share a single function-graph ops (means shares a common > > ftrace filter) similar to the kprobe-on-ftrace. This needs another > > layer to find corresponding fprobe in the common function-graph > > callbacks, but has much better scalability, since the number of > > registered function-graph ops is limited. > > > > In the entry callback, the fprobe runs its entry_handler and saves the > > address of 'fprobe' on the function-graph's shadow stack as data. The > > return callback decodes the data to get the 'fprobe' address, and runs > > the exit_handler. > > > > The fprobe introduces two hash-tables, one is for entry callback which > > searches fprobes related to the given function address passed by entry > > callback. The other is for a return callback which checks if the given > > 'fprobe' data structure pointer is still valid. Note that it is > > possible to unregister fprobe before the return callback runs. Thus > > the address validation must be done before using it in the return > > callback. > > > > Download > > -------- > > This series can be applied against the ftrace/for-next branch in > > linux-trace tree. > > > > This series can also be found below branch. > > > > https://git.kernel.org/pub/scm/linux/kernel/git/mhiramat/linux.git/log/?h=topic/fprobe-on-fgraph > > > > Thank you, > > > > --- > > > > Masami Hiramatsu (Google) (20): > > tracing: fgraph: Fix to add new fgraph_ops to array after ftrace_startup_subops() > > tracing: Add a comment about ftrace_regs definition > > tracing: Rename ftrace_regs_return_value to ftrace_regs_get_return_value > > function_graph: Pass ftrace_regs to entryfunc > > function_graph: Replace fgraph_ret_regs with ftrace_regs > > function_graph: Pass ftrace_regs to retfunc > > fprobe: Use ftrace_regs in fprobe entry handler > > fprobe: Use ftrace_regs in fprobe exit handler > > tracing: Add ftrace_partial_regs() for converting ftrace_regs to pt_regs > > tracing: Add ftrace_fill_perf_regs() for perf event > > tracing/fprobe: Enable fprobe events with CONFIG_DYNAMIC_FTRACE_WITH_ARGS > > bpf: Enable kprobe_multi feature if CONFIG_FPROBE is enabled > > ftrace: Add CONFIG_HAVE_FTRACE_GRAPH_FUNC > > fprobe: Rewrite fprobe on function-graph tracer > > tracing: Fix function timing profiler to initialize hashtable > > tracing/fprobe: Remove nr_maxactive from fprobe > > selftests: ftrace: Remove obsolate maxactive syntax check > > selftests/ftrace: Add a test case for repeating register/unregister fprobe > > Documentation: probes: Update fprobe on function-graph tracer > > fgraph: Skip recording calltime/rettime if it is not nneeded > > > > > > Documentation/trace/fprobe.rst | 42 + > > arch/arm64/Kconfig | 2 > > arch/arm64/include/asm/ftrace.h | 47 + > > arch/arm64/kernel/asm-offsets.c | 12 > > arch/arm64/kernel/entry-ftrace.S | 32 + > > arch/arm64/kernel/ftrace.c | 20 + > > arch/loongarch/Kconfig | 4 > > arch/loongarch/include/asm/ftrace.h | 32 - > > arch/loongarch/kernel/asm-offsets.c | 12 > > arch/loongarch/kernel/ftrace_dyn.c | 10 > > arch/loongarch/kernel/mcount.S | 17 - > > arch/loongarch/kernel/mcount_dyn.S | 14 > > arch/powerpc/Kconfig | 1 > > arch/powerpc/include/asm/ftrace.h | 15 > > arch/powerpc/kernel/trace/ftrace.c | 2 > > arch/powerpc/kernel/trace/ftrace_64_pg.c | 10 > > arch/riscv/Kconfig | 3 > > arch/riscv/include/asm/ftrace.h | 26 - > > arch/riscv/kernel/ftrace.c | 17 + > > arch/riscv/kernel/mcount.S | 24 - > > arch/s390/Kconfig | 3 > > arch/s390/include/asm/ftrace.h | 39 + > > arch/s390/kernel/asm-offsets.c | 6 > > arch/s390/kernel/mcount.S | 9 > > arch/x86/Kconfig | 4 > > arch/x86/include/asm/ftrace.h | 37 + > > arch/x86/kernel/ftrace.c | 50 +- > > arch/x86/kernel/ftrace_32.S | 15 > > arch/x86/kernel/ftrace_64.S | 17 - > > include/linux/fprobe.h | 57 +- > > include/linux/ftrace.h | 136 ++++ > > kernel/trace/Kconfig | 23 + > > kernel/trace/bpf_trace.c | 19 - > > kernel/trace/fgraph.c | 127 +++- > > kernel/trace/fprobe.c | 638 ++++++++++++++------ > > kernel/trace/ftrace.c | 10 > > kernel/trace/trace.h | 6 > > kernel/trace/trace_fprobe.c | 147 ++--- > > kernel/trace/trace_functions_graph.c | 10 > > kernel/trace/trace_irqsoff.c | 6 > > kernel/trace/trace_probe_tmpl.h | 2 > > kernel/trace/trace_sched_wakeup.c | 6 > > kernel/trace/trace_selftest.c | 11 > > lib/test_fprobe.c | 51 -- > > samples/fprobe/fprobe_example.c | 4 > > .../test.d/dynevent/add_remove_fprobe_repeat.tc | 19 + > > .../ftrace/test.d/dynevent/fprobe_syntax_errors.tc | 4 > > 47 files changed, 1168 insertions(+), 630 deletions(-) > > create mode 100644 tools/testing/selftests/ftrace/test.d/dynevent/add_remove_fprobe_repeat.tc > > > > -- > > Masami Hiramatsu (Google) > > > > > -- > Masami Hiramatsu (Google) -- Masami Hiramatsu (Google)