BPF List
 help / color / mirror / Atom feed
From: Masami Hiramatsu (Google) <mhiramat@kernel.org>
To: Andrii Nakryiko <andrii.nakryiko@gmail.com>
Cc: Alexei Starovoitov <alexei.starovoitov@gmail.com>,
	Steven Rostedt <rostedt@goodmis.org>,
	Florent Revest <revest@chromium.org>,
	linux-trace-kernel@vger.kernel.org,
	LKML <linux-kernel@vger.kernel.org>,
	Martin KaFai Lau <martin.lau@linux.dev>,
	bpf <bpf@vger.kernel.org>, Sven Schnelle <svens@linux.ibm.com>,
	Alexei Starovoitov <ast@kernel.org>, Jiri Olsa <jolsa@kernel.org>,
	Arnaldo Carvalho de Melo <acme@kernel.org>,
	Daniel Borkmann <daniel@iogearbox.net>,
	Alan Maguire <alan.maguire@oracle.com>,
	Mark Rutland <mark.rutland@arm.com>,
	Peter Zijlstra <peterz@infradead.org>,
	Thomas Gleixner <tglx@linutronix.de>, Guo Ren <guoren@kernel.org>
Subject: Re: [PATCH v9 00/36] tracing: fprobe: function_graph: Multi-function graph and fprobe on fgraph
Date: Thu, 2 May 2024 11:06:10 +0900	[thread overview]
Message-ID: <20240502110610.412d54a0cf194293b82ee787@kernel.org> (raw)
In-Reply-To: <CAEf4BzZQLPL7419W1=yNw6gzB4gquiXfeANbUKbUL8bK+5if=w@mail.gmail.com>

[-- Attachment #1: Type: text/plain, Size: 4332 bytes --]

On Tue, 30 Apr 2024 09:29:40 -0700
Andrii Nakryiko <andrii.nakryiko@gmail.com> wrote:

> On Tue, Apr 30, 2024 at 6:32 AM Masami Hiramatsu <mhiramat@kernel.org> wrote:
> >
> > On Mon, 29 Apr 2024 13:25:04 -0700
> > Andrii Nakryiko <andrii.nakryiko@gmail.com> wrote:
> >
> > > On Mon, Apr 29, 2024 at 6:51 AM Masami Hiramatsu <mhiramat@kernel.org> wrote:
> > > >
> > > > Hi Andrii,
> > > >
> > > > On Thu, 25 Apr 2024 13:31:53 -0700
> > > > Andrii Nakryiko <andrii.nakryiko@gmail.com> wrote:
> > > >
> > > > > Hey Masami,
> > > > >
> > > > > I can't really review most of that code as I'm completely unfamiliar
> > > > > with all those inner workings of fprobe/ftrace/function_graph. I left
> > > > > a few comments where there were somewhat more obvious BPF-related
> > > > > pieces.
> > > > >
> > > > > But I also did run our BPF benchmarks on probes/for-next as a baseline
> > > > > and then with your series applied on top. Just to see if there are any
> > > > > regressions. I think it will be a useful data point for you.
> > > >
> > > > Thanks for testing!
> > > >
> > > > >
> > > > > You should be already familiar with the bench tool we have in BPF
> > > > > selftests (I used it on some other patches for your tree).
> > > >
> > > > What patches we need?
> > > >
> > >
> > > You mean for this `bench` tool? They are part of BPF selftests (under
> > > tools/testing/selftests/bpf), you can build them by running:
> > >
> > > $ make RELEASE=1 -j$(nproc) bench
> > >
> > > After that you'll get a self-container `bench` binary, which has all
> > > the self-contained benchmarks.
> > >
> > > You might also find a small script (benchs/run_bench_trigger.sh inside
> > > BPF selftests directory) helpful, it collects final summary of the
> > > benchmark run and optionally accepts a specific set of benchmarks. So
> > > you can use it like this:
> > >
> > > $ benchs/run_bench_trigger.sh kprobe kprobe-multi
> > > kprobe         :   18.731 ± 0.639M/s
> > > kprobe-multi   :   23.938 ± 0.612M/s
> > >
> > > By default it will run a wider set of benchmarks (no uprobes, but a
> > > bunch of extra fentry/fexit tests and stuff like this).
> >
> > origin:
> > # benchs/run_bench_trigger.sh
> > kretprobe :    1.329 ± 0.007M/s
> > kretprobe-multi:    1.341 ± 0.004M/s
> > # benchs/run_bench_trigger.sh
> > kretprobe :    1.288 ± 0.014M/s
> > kretprobe-multi:    1.365 ± 0.002M/s
> > # benchs/run_bench_trigger.sh
> > kretprobe :    1.329 ± 0.002M/s
> > kretprobe-multi:    1.331 ± 0.011M/s
> > # benchs/run_bench_trigger.sh
> > kretprobe :    1.311 ± 0.003M/s
> > kretprobe-multi:    1.318 ± 0.002M/s s
> >
> > patched:
> >
> > # benchs/run_bench_trigger.sh
> > kretprobe :    1.274 ± 0.003M/s
> > kretprobe-multi:    1.397 ± 0.002M/s
> > # benchs/run_bench_trigger.sh
> > kretprobe :    1.307 ± 0.002M/s
> > kretprobe-multi:    1.406 ± 0.004M/s
> > # benchs/run_bench_trigger.sh
> > kretprobe :    1.279 ± 0.004M/s
> > kretprobe-multi:    1.330 ± 0.014M/s
> > # benchs/run_bench_trigger.sh
> > kretprobe :    1.256 ± 0.010M/s
> > kretprobe-multi:    1.412 ± 0.003M/s
> >
> > Hmm, in my case, it seems smaller differences (~3%?).
> > I attached perf report results for those, but I don't see large difference.
> 
> I ran my benchmarks on bare metal machine (and quite powerful at that,
> you can see my numbers are almost 10x of yours), with mitigations
> disabled, no retpolines, etc. If you have any of those mitigations it
> might result in smaller differences, probably. If you are running
> inside QEMU/VM, the results might differ significantly as well.

I ran it on my bare metal machines again, but could not find any difference
between them. But I think I enabled intel mitigations on, so it might make
a difference from your result.

Can you run the benchmark with perf record? If there is such differences,
there should be recorded.
e.g. 

# perf record -g -o perf.data-kretprobe-nopatch-raw-bpf -- bench -w2 -d5 -a trig-kretprobe 
# perf report -G -i perf.data-kretprobe-nopatch-raw-bpf -k $VMLINUX --stdio > perf-out-kretprobe-nopatch-raw-bpf

I attached the results in my side.
The interesting point is, the functions int the result are not touched by
this series. Thus there may be another reason if you see the kretprobe
regression.

Thank you,
-- 
Masami Hiramatsu (Google) <mhiramat@kernel.org>

[-- Attachment #2: perf-out-kretprobe-nopatch-raw-bpf --]
[-- Type: application/octet-stream, Size: 78480 bytes --]

# To display the perf.data header info, please use --header/--header-only options.
#
#
# Total Lost Samples: 0
#
# Samples: 32K of event 'cycles:P'
# Event count (approx.): 34378649217
#
# Children      Self  Command  Shared Object                                      Symbol                                               
# ........  ........  .......  .................................................  .....................................................
#
    99.62%     0.00%  bench    libc.so.6                                          [.] start_thread
            |
            ---start_thread
               |          
                --99.54%--syscall
                          |          
                          |--55.14%--entry_SYSCALL_64
                          |          |          
                          |          |--36.05%--do_syscall_64
                          |          |          |          
                          |          |          |--19.84%--x64_sys_call
                          |          |          |          |          
                          |          |          |          |--14.45%--arch_rethook_trampoline
                          |          |          |          |          |          
                          |          |          |          |           --14.42%--arch_rethook_trampoline_callback
                          |          |          |          |                     |          
                          |          |          |          |                     |--11.64%--rethook_trampoline_handler
                          |          |          |          |                     |          |          
                          |          |          |          |                     |          |--7.77%--kretprobe_rethook_handler
                          |          |          |          |                     |          |          |          
                          |          |          |          |                     |          |           --7.63%--kretprobe_dispatcher
                          |          |          |          |                     |          |                     |          
                          |          |          |          |                     |          |                      --6.15%--kretprobe_perf_func
                          |          |          |          |                     |          |                                |          
                          |          |          |          |                     |          |                                |--3.14%--trace_call_bpf
                          |          |          |          |                     |          |                                |          |          
                          |          |          |          |                     |          |                                |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
                          |          |          |          |                     |          |                                |          
                          |          |          |          |                     |          |                                 --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
                          |          |          |          |                     |          |          
                          |          |          |          |                     |          |--1.71%--objpool_push.isra.0
                          |          |          |          |                     |          |          
                          |          |          |          |                     |           --0.79%--kretprobe_dispatcher
                          |          |          |          |                     |          
                          |          |          |          |                      --2.18%--kretprobe_rethook_handler
                          |          |          |          |          
                          |          |          |           --4.36%--__x64_sys_getpgid
                          |          |          |                     |          
                          |          |          |                     |--2.03%--do_getpgid
                          |          |          |                     |          |          
                          |          |          |                     |           --0.95%--find_task_by_vpid
                          |          |          |                     |          
                          |          |          |                     |--0.89%--ftrace_trampoline
                          |          |          |                     |          
                          |          |          |                      --0.80%--__rcu_read_unlock
                          |          |          |          
                          |          |          |--6.79%--__x64_sys_getpgid
                          |          |          |          |          
                          |          |          |           --5.92%--ftrace_trampoline
                          |          |          |                     |          
                          |          |          |                     |--5.13%--kprobe_ftrace_handler
                          |          |          |                     |          |          
                          |          |          |                     |           --3.02%--pre_handler_kretprobe
                          |          |          |                     |                     |          
                          |          |          |                     |                      --2.19%--rethook_try_get
                          |          |          |                     |          
                          |          |          |                      --0.67%--pre_handler_kretprobe
                          |          |          |          
                          |          |          |--3.31%--arch_rethook_trampoline
                          |          |          |          
                          |          |          |--1.70%--ftrace_trampoline
                          |          |          |          
                          |          |           --1.64%--syscall_exit_to_user_mode
                          |          |          
                          |           --1.28%--x64_sys_call
                          |          
                          |--23.38%--entry_SYSRETQ_unsafe_stack
                          |          
                          |--17.30%--syscall_return_via_sysret
                          |          
                          |--0.55%--do_syscall_64
                          |          
                           --0.53%--arch_rethook_trampoline

    99.61%     2.41%  bench    libc.so.6                                          [.] syscall
            |          
            |--97.20%--syscall
            |          |          
            |          |--53.42%--entry_SYSCALL_64
            |          |          |          
            |          |          |--36.11%--do_syscall_64
            |          |          |          |          
            |          |          |          |--19.90%--x64_sys_call
            |          |          |          |          |          
            |          |          |          |          |--14.45%--arch_rethook_trampoline
            |          |          |          |          |          |          
            |          |          |          |          |           --14.42%--arch_rethook_trampoline_callback
            |          |          |          |          |                     |          
            |          |          |          |          |                     |--11.64%--rethook_trampoline_handler
            |          |          |          |          |                     |          |          
            |          |          |          |          |                     |          |--7.77%--kretprobe_rethook_handler
            |          |          |          |          |                     |          |          |          
            |          |          |          |          |                     |          |           --7.63%--kretprobe_dispatcher
            |          |          |          |          |                     |          |                     |          
            |          |          |          |          |                     |          |                      --6.15%--kretprobe_perf_func
            |          |          |          |          |                     |          |                                |          
            |          |          |          |          |                     |          |                                |--3.14%--trace_call_bpf
            |          |          |          |          |                     |          |                                |          |          
            |          |          |          |          |                     |          |                                |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |          |          |                     |          |                                |          
            |          |          |          |          |                     |          |                                 --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |          |          |                     |          |          
            |          |          |          |          |                     |          |--1.71%--objpool_push.isra.0
            |          |          |          |          |                     |          |          
            |          |          |          |          |                     |           --0.79%--kretprobe_dispatcher
            |          |          |          |          |                     |          
            |          |          |          |          |                      --2.18%--kretprobe_rethook_handler
            |          |          |          |          |          
            |          |          |          |           --4.36%--__x64_sys_getpgid
            |          |          |          |                     |          
            |          |          |          |                     |--2.03%--do_getpgid
            |          |          |          |                     |          |          
            |          |          |          |                     |           --0.95%--find_task_by_vpid
            |          |          |          |                     |          
            |          |          |          |                     |--0.89%--ftrace_trampoline
            |          |          |          |                     |          
            |          |          |          |                      --0.80%--__rcu_read_unlock
            |          |          |          |          
            |          |          |          |--6.79%--__x64_sys_getpgid
            |          |          |          |          |          
            |          |          |          |           --5.92%--ftrace_trampoline
            |          |          |          |                     |          
            |          |          |          |                     |--5.13%--kprobe_ftrace_handler
            |          |          |          |                     |          |          
            |          |          |          |                     |           --3.02%--pre_handler_kretprobe
            |          |          |          |                     |                     |          
            |          |          |          |                     |                      --2.19%--rethook_try_get
            |          |          |          |                     |          
            |          |          |          |                      --0.67%--pre_handler_kretprobe
            |          |          |          |          
            |          |          |          |--3.31%--arch_rethook_trampoline
            |          |          |          |          
            |          |          |          |--1.70%--ftrace_trampoline
            |          |          |          |          
            |          |          |           --1.64%--syscall_exit_to_user_mode
            |          |          |          
            |          |           --1.28%--x64_sys_call
            |          |          
            |          |--23.38%--entry_SYSRETQ_unsafe_stack
            |          |          
            |          |--17.30%--syscall_return_via_sysret
            |          |          
            |          |--0.55%--do_syscall_64
            |          |          
            |           --0.53%--arch_rethook_trampoline
            |          
             --2.41%--start_thread
                       syscall
                       |          
                        --1.78%--entry_SYSCALL_64

    56.42%    16.71%  bench    [kernel.kallsyms]                                  [k] entry_SYSCALL_64
            |          
            |--39.70%--entry_SYSCALL_64
            |          |          
            |          |--36.19%--do_syscall_64
            |          |          |          
            |          |          |--19.98%--x64_sys_call
            |          |          |          |          
            |          |          |          |--14.45%--arch_rethook_trampoline
            |          |          |          |          |          
            |          |          |          |           --14.42%--arch_rethook_trampoline_callback
            |          |          |          |                     |          
            |          |          |          |                     |--11.64%--rethook_trampoline_handler
            |          |          |          |                     |          |          
            |          |          |          |                     |          |--7.77%--kretprobe_rethook_handler
            |          |          |          |                     |          |          |          
            |          |          |          |                     |          |           --7.63%--kretprobe_dispatcher
            |          |          |          |                     |          |                     |          
            |          |          |          |                     |          |                      --6.15%--kretprobe_perf_func
            |          |          |          |                     |          |                                |          
            |          |          |          |                     |          |                                |--3.14%--trace_call_bpf
            |          |          |          |                     |          |                                |          |          
            |          |          |          |                     |          |                                |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |          |                     |          |                                |          
            |          |          |          |                     |          |                                 --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |          |                     |          |          
            |          |          |          |                     |          |--1.71%--objpool_push.isra.0
            |          |          |          |                     |          |          
            |          |          |          |                     |           --0.79%--kretprobe_dispatcher
            |          |          |          |                     |          
            |          |          |          |                      --2.18%--kretprobe_rethook_handler
            |          |          |          |          
            |          |          |           --4.36%--__x64_sys_getpgid
            |          |          |                     |          
            |          |          |                     |--2.03%--do_getpgid
            |          |          |                     |          |          
            |          |          |                     |           --0.95%--find_task_by_vpid
            |          |          |                     |          
            |          |          |                     |--0.89%--ftrace_trampoline
            |          |          |                     |          
            |          |          |                      --0.80%--__rcu_read_unlock
            |          |          |          
            |          |          |--6.79%--__x64_sys_getpgid
            |          |          |          |          
            |          |          |           --5.92%--ftrace_trampoline
            |          |          |                     |          
            |          |          |                     |--5.13%--kprobe_ftrace_handler
            |          |          |                     |          |          
            |          |          |                     |           --3.02%--pre_handler_kretprobe
            |          |          |                     |                     |          
            |          |          |                     |                      --2.19%--rethook_try_get
            |          |          |                     |          
            |          |          |                      --0.67%--pre_handler_kretprobe
            |          |          |          
            |          |          |--3.31%--arch_rethook_trampoline
            |          |          |          
            |          |          |--1.70%--ftrace_trampoline
            |          |          |          
            |          |           --1.64%--syscall_exit_to_user_mode
            |          |          
            |           --1.28%--x64_sys_call
            |          
             --16.71%--start_thread
                       syscall
                       |          
                       |--15.58%--entry_SYSCALL_64
                       |          
                        --0.84%--syscall_return_via_sysret

    36.98%     2.62%  bench    [kernel.kallsyms]                                  [k] do_syscall_64
            |          
            |--34.35%--do_syscall_64
            |          |          
            |          |--19.98%--x64_sys_call
            |          |          |          
            |          |          |--14.45%--arch_rethook_trampoline
            |          |          |          |          
            |          |          |           --14.42%--arch_rethook_trampoline_callback
            |          |          |                     |          
            |          |          |                     |--11.64%--rethook_trampoline_handler
            |          |          |                     |          |          
            |          |          |                     |          |--7.77%--kretprobe_rethook_handler
            |          |          |                     |          |          |          
            |          |          |                     |          |           --7.63%--kretprobe_dispatcher
            |          |          |                     |          |                     |          
            |          |          |                     |          |                      --6.15%--kretprobe_perf_func
            |          |          |                     |          |                                |          
            |          |          |                     |          |                                |--3.14%--trace_call_bpf
            |          |          |                     |          |                                |          |          
            |          |          |                     |          |                                |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |                     |          |                                |          
            |          |          |                     |          |                                 --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |                     |          |          
            |          |          |                     |          |--1.71%--objpool_push.isra.0
            |          |          |                     |          |          
            |          |          |                     |           --0.79%--kretprobe_dispatcher
            |          |          |                     |          
            |          |          |                      --2.18%--kretprobe_rethook_handler
            |          |          |          
            |          |           --4.36%--__x64_sys_getpgid
            |          |                     |          
            |          |                     |--2.03%--do_getpgid
            |          |                     |          |          
            |          |                     |           --0.95%--find_task_by_vpid
            |          |                     |          
            |          |                     |--0.89%--ftrace_trampoline
            |          |                     |          
            |          |                      --0.80%--__rcu_read_unlock
            |          |          
            |          |--6.79%--__x64_sys_getpgid
            |          |          |          
            |          |           --5.92%--ftrace_trampoline
            |          |                     |          
            |          |                     |--5.13%--kprobe_ftrace_handler
            |          |                     |          |          
            |          |                     |           --3.02%--pre_handler_kretprobe
            |          |                     |                     |          
            |          |                     |                      --2.19%--rethook_try_get
            |          |                     |          
            |          |                      --0.67%--pre_handler_kretprobe
            |          |          
            |          |--3.31%--arch_rethook_trampoline
            |          |          
            |          |--1.70%--ftrace_trampoline
            |          |          
            |           --1.64%--syscall_exit_to_user_mode
            |          
             --2.62%--start_thread
                       syscall
                       |          
                        --2.37%--entry_SYSCALL_64
                                  |          
                                   --2.13%--do_syscall_64

    25.29%    25.13%  bench    [kernel.kallsyms]                                  [k] entry_SYSRETQ_unsafe_stack
            |          
             --25.12%--start_thread
                       syscall
                       |          
                        --23.22%--entry_SYSRETQ_unsafe_stack

    21.46%     1.81%  bench    [kernel.kallsyms]                                  [k] x64_sys_call
            |          
            |--19.65%--x64_sys_call
            |          |          
            |          |--14.45%--arch_rethook_trampoline
            |          |          |          
            |          |           --14.42%--arch_rethook_trampoline_callback
            |          |                     |          
            |          |                     |--11.64%--rethook_trampoline_handler
            |          |                     |          |          
            |          |                     |          |--7.77%--kretprobe_rethook_handler
            |          |                     |          |          |          
            |          |                     |          |           --7.63%--kretprobe_dispatcher
            |          |                     |          |                     |          
            |          |                     |          |                      --6.15%--kretprobe_perf_func
            |          |                     |          |                                |          
            |          |                     |          |                                |--3.14%--trace_call_bpf
            |          |                     |          |                                |          |          
            |          |                     |          |                                |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |                     |          |                                |          
            |          |                     |          |                                 --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |                     |          |          
            |          |                     |          |--1.71%--objpool_push.isra.0
            |          |                     |          |          
            |          |                     |           --0.79%--kretprobe_dispatcher
            |          |                     |          
            |          |                      --2.18%--kretprobe_rethook_handler
            |          |          
            |           --4.36%--__x64_sys_getpgid
            |                     |          
            |                     |--2.03%--do_getpgid
            |                     |          |          
            |                     |           --0.95%--find_task_by_vpid
            |                     |          
            |                     |--0.89%--ftrace_trampoline
            |                     |          
            |                      --0.80%--__rcu_read_unlock
            |          
             --1.81%--start_thread
                       syscall
                       entry_SYSCALL_64
                       |          
                       |--1.21%--x64_sys_call
                       |          
                        --0.59%--do_syscall_64

    18.62%     3.53%  bench    [kernel.kallsyms]                                  [k] arch_rethook_trampoline
            |          
            |--15.09%--arch_rethook_trampoline
            |          |          
            |           --14.85%--arch_rethook_trampoline_callback
            |                     |          
            |                     |--11.94%--rethook_trampoline_handler
            |                     |          |          
            |                     |          |--7.77%--kretprobe_rethook_handler
            |                     |          |          |          
            |                     |          |           --7.63%--kretprobe_dispatcher
            |                     |          |                     |          
            |                     |          |                      --6.15%--kretprobe_perf_func
            |                     |          |                                |          
            |                     |          |                                |--3.14%--trace_call_bpf
            |                     |          |                                |          |          
            |                     |          |                                |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |                     |          |                                |          
            |                     |          |                                 --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |                     |          |          
            |                     |          |--1.71%--objpool_push.isra.0
            |                     |          |          
            |                     |           --0.79%--kretprobe_dispatcher
            |                     |          
            |                      --2.18%--kretprobe_rethook_handler
            |          
             --3.53%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       |          
                        --3.20%--arch_rethook_trampoline

    17.47%    16.63%  bench    [kernel.kallsyms]                                  [k] syscall_return_via_sysret
            |          
            |--16.62%--start_thread
            |          syscall
            |          |          
            |           --16.46%--syscall_return_via_sysret
            |          
             --0.84%--syscall_return_via_sysret

    15.11%     0.40%  bench    [kernel.kallsyms]                                  [k] arch_rethook_trampoline_callback
            |          
             --14.71%--arch_rethook_trampoline_callback
                       |          
                       |--11.94%--rethook_trampoline_handler
                       |          |          
                       |          |--7.77%--kretprobe_rethook_handler
                       |          |          |          
                       |          |           --7.63%--kretprobe_dispatcher
                       |          |                     |          
                       |          |                      --6.15%--kretprobe_perf_func
                       |          |                                |          
                       |          |                                |--3.14%--trace_call_bpf
                       |          |                                |          |          
                       |          |                                |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
                       |          |                                |          
                       |          |                                 --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
                       |          |          
                       |          |--1.71%--objpool_push.isra.0
                       |          |          
                       |           --0.79%--kretprobe_dispatcher
                       |          
                        --2.18%--kretprobe_rethook_handler

    12.59%     2.12%  bench    [kernel.kallsyms]                                  [k] rethook_trampoline_handler
            |          
            |--10.47%--rethook_trampoline_handler
            |          |          
            |          |--7.77%--kretprobe_rethook_handler
            |          |          |          
            |          |           --7.63%--kretprobe_dispatcher
            |          |                     |          
            |          |                      --6.15%--kretprobe_perf_func
            |          |                                |          
            |          |                                |--3.14%--trace_call_bpf
            |          |                                |          |          
            |          |                                |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |                                |          
            |          |                                 --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          
            |          |--1.71%--objpool_push.isra.0
            |          |          
            |           --0.79%--kretprobe_dispatcher
            |          
             --2.12%--start_thread
                       syscall
                       |          
                        --1.76%--entry_SYSCALL_64
                                  do_syscall_64
                                  x64_sys_call
                                  arch_rethook_trampoline
                                  |          
                                   --1.73%--arch_rethook_trampoline_callback
                                             |          
                                              --1.22%--rethook_trampoline_handler

    11.33%     0.61%  bench    [kernel.kallsyms]                                  [k] __x64_sys_getpgid
            |          
            |--10.72%--__x64_sys_getpgid
            |          |          
            |          |--6.81%--ftrace_trampoline
            |          |          |          
            |          |          |--5.13%--kprobe_ftrace_handler
            |          |          |          |          
            |          |          |           --3.02%--pre_handler_kretprobe
            |          |          |                     |          
            |          |          |                      --2.19%--rethook_try_get
            |          |          |          
            |          |           --0.67%--pre_handler_kretprobe
            |          |          
            |          |--2.03%--do_getpgid
            |          |          |          
            |          |           --0.95%--find_task_by_vpid
            |          |          
            |           --0.80%--__rcu_read_unlock
            |          
             --0.61%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64

    10.00%     2.20%  bench    [kernel.kallsyms]                                  [k] kretprobe_rethook_handler
            |          
            |--7.80%--kretprobe_rethook_handler
            |          |          
            |           --7.63%--kretprobe_dispatcher
            |                     |          
            |                      --6.15%--kretprobe_perf_func
            |                                |          
            |                                |--3.14%--trace_call_bpf
            |                                |          |          
            |                                |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |                                |          
            |                                 --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          
             --2.20%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       |          
                        --2.14%--kretprobe_rethook_handler

     9.03%     3.01%  bench    ftrace_trampoline                                  [k] ftrace_trampoline
            |          
            |--6.02%--ftrace_trampoline
            |          |          
            |          |--5.13%--kprobe_ftrace_handler
            |          |          |          
            |          |           --3.02%--pre_handler_kretprobe
            |          |                     |          
            |          |                      --2.19%--rethook_try_get
            |          |          
            |           --0.67%--pre_handler_kretprobe
            |          
             --3.01%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       |          
                       |--1.60%--ftrace_trampoline
                       |          
                        --1.01%--x64_sys_call
                                  |          
                                   --0.89%--__x64_sys_getpgid
                                             ftrace_trampoline

     8.56%     2.20%  bench    [kernel.kallsyms]                                  [k] kretprobe_dispatcher
            |          
            |--6.37%--kretprobe_dispatcher
            |          |          
            |           --6.15%--kretprobe_perf_func
            |                     |          
            |                     |--3.14%--trace_call_bpf
            |                     |          |          
            |                     |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |                     |          
            |                      --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          
             --2.20%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       |          
                       |--1.45%--kretprobe_rethook_handler
                       |          |          
                       |           --1.32%--kretprobe_dispatcher
                       |          
                        --0.74%--kretprobe_dispatcher

     6.32%     0.98%  bench    [kernel.kallsyms]                                  [k] kretprobe_perf_func
            |          
            |--5.35%--kretprobe_perf_func
            |          |          
            |          |--3.14%--trace_call_bpf
            |          |          |          
            |          |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          
            |           --1.13%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          
             --0.98%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       kretprobe_rethook_handler
                       kretprobe_dispatcher
                       |          
                        --0.88%--kretprobe_perf_func

     5.36%     2.00%  bench    [kernel.kallsyms]                                  [k] kprobe_ftrace_handler
            |          
            |--3.37%--kprobe_ftrace_handler
            |          |          
            |           --3.02%--pre_handler_kretprobe
            |                     |          
            |                      --2.19%--rethook_try_get
            |          
             --2.00%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       |          
                        --1.89%--__x64_sys_getpgid
                                  ftrace_trampoline
                                  |          
                                   --1.82%--kprobe_ftrace_handler

     3.74%     1.32%  bench    [kernel.kallsyms]                                  [k] pre_handler_kretprobe
            |          
            |--2.42%--pre_handler_kretprobe
            |          |          
            |           --2.19%--rethook_try_get
            |          
             --1.32%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       __x64_sys_getpgid
                       ftrace_trampoline
                       |          
                       |--0.69%--kprobe_ftrace_handler
                       |          |          
                       |           --0.63%--pre_handler_kretprobe
                       |          
                        --0.63%--pre_handler_kretprobe

     3.51%     1.63%  bench    [kernel.kallsyms]                                  [k] trace_call_bpf
            |          
            |--1.88%--trace_call_bpf
            |          |          
            |           --1.21%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          
             --1.63%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       kretprobe_rethook_handler
                       kretprobe_dispatcher
                       |          
                        --1.57%--kretprobe_perf_func
                                  |          
                                   --1.26%--trace_call_bpf

     2.63%     1.00%  bench    [kernel.kallsyms]                                  [k] do_getpgid
            |          
            |--1.62%--do_getpgid
            |          |          
            |           --0.95%--find_task_by_vpid
            |          
             --1.00%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       |          
                        --0.83%--__x64_sys_getpgid

     2.34%     2.27%  bench    bpf_prog_21856463590f61f1_bench_trigger_kretprobe  [k] bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          
             --2.27%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       kretprobe_rethook_handler
                       kretprobe_dispatcher
                       kretprobe_perf_func
                       |          
                       |--1.21%--trace_call_bpf
                       |          bpf_prog_21856463590f61f1_bench_trigger_kretprobe
                       |          
                        --1.06%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe

     2.33%     2.28%  bench    [kernel.kallsyms]                                  [k] rethook_try_get
            |          
             --2.28%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       __x64_sys_getpgid
                       ftrace_trampoline
                       kprobe_ftrace_handler
                       |          
                        --2.19%--pre_handler_kretprobe
                                  rethook_try_get

     1.96%     1.61%  bench    [kernel.kallsyms]                                  [k] syscall_exit_to_user_mode
            |          
             --1.61%--start_thread
                       syscall
                       entry_SYSCALL_64
                       |          
                        --1.32%--do_syscall_64
                                  syscall_exit_to_user_mode

     1.81%     1.75%  bench    [kernel.kallsyms]                                  [k] objpool_push.isra.0
            |          
             --1.75%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       |          
                        --1.71%--objpool_push.isra.0

     1.44%     0.79%  bench    [kernel.kallsyms]                                  [k] find_task_by_vpid
            |          
            |--0.79%--start_thread
            |          syscall
            |          entry_SYSCALL_64
            |          do_syscall_64
            |          x64_sys_call
            |          __x64_sys_getpgid
            |          
             --0.65%--find_task_by_vpid

     1.10%     0.81%  bench    [kernel.kallsyms]                                  [k] __rcu_read_unlock
            |          
             --0.81%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       |          
                        --0.56%--__x64_sys_getpgid
                                  |          
                                   --0.53%--__rcu_read_unlock

     0.91%     0.36%  bench    [kernel.kallsyms]                                  [k] idr_find
            |          
             --0.54%--idr_find

     0.66%     0.56%  bench    [kernel.kallsyms]                                  [k] __rcu_read_lock
            |          
             --0.56%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call

     0.60%     0.20%  bench    [kernel.kallsyms]                                  [k] arch_rethook_fixup_return
     0.59%     0.55%  bench    [kernel.kallsyms]                                  [k] migrate_enable
            |          
             --0.55%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       kretprobe_rethook_handler
                       kretprobe_dispatcher
                       kretprobe_perf_func

     0.48%     0.44%  bench    [kernel.kallsyms]                                  [k] migrate_disable
     0.46%     0.11%  bench    [kernel.kallsyms]                                  [k] radix_tree_lookup
     0.44%     0.40%  bench    [kernel.kallsyms]                                  [k] __radix_tree_lookup
     0.44%     0.44%  bench    [kernel.kallsyms]                                  [k] fpregs_assert_state_consistent
     0.28%     0.00%  bench    libc.so.6                                          [.] __libc_start_call_main
     0.28%     0.00%  bench    bench                                              [.] main
     0.28%     0.00%  bench    bench                                              [.] setup_benchmark
     0.28%     0.00%  bench    bench                                              [.] trigger_kretprobe_setup
     0.25%     0.20%  bench    [kernel.kallsyms]                                  [k] rethook_hook
     0.22%     0.00%  bench    bench                                              [.] trigger_bench__open_and_load
     0.22%     0.00%  bench    bench                                              [.] bpf_object__load_skeleton
     0.22%     0.00%  bench    bench                                              [.] bpf_object__load
     0.22%     0.00%  bench    bench                                              [.] bpf_object_load
     0.18%     0.15%  bench    [kernel.kallsyms]                                  [k] get_kprobe
     0.14%     0.00%  bench    bench                                              [.] bpf_object__load_vmlinux_btf
     0.14%     0.00%  bench    bench                                              [.] libbpf_find_kernel_btf
     0.14%     0.00%  bench    bench                                              [.] btf__parse
     0.14%     0.00%  bench    bench                                              [.] btf_parse
     0.14%     0.00%  bench    bench                                              [.] btf_parse_raw
     0.13%     0.13%  bench    [kernel.kallsyms]                                  [k] amd_clear_divider
     0.13%     0.08%  bench    [kernel.kallsyms]                                  [k] arch_rethook_prepare
     0.11%     0.00%  bench    bench                                              [.] btf_new
     0.09%     0.06%  bench    bench                                              [.] syscall@plt
     0.08%     0.01%  bench    bench                                              [.] btf_sanity_check
     0.08%     0.08%  bench    bench                                              [.] trigger_producer
     0.08%     0.00%  bench    bench                                              [.] bpf_object__load_progs
     0.08%     0.00%  bench    bench                                              [.] bpf_object_load_prog
     0.07%     0.00%  bench    bench                                              [.] libbpf_prepare_prog_load
     0.07%     0.00%  bench    bench                                              [.] libbpf_find_attach_btf_id
     0.07%     0.00%  bench    bench                                              [.] find_kernel_btf_id
     0.07%     0.00%  bench    bench                                              [.] find_attach_btf_id
     0.07%     0.00%  bench    bench                                              [.] find_btf_by_prefix_kind
     0.07%     0.00%  bench    bench                                              [.] btf__find_by_name_kind
     0.06%     0.00%  bench    [kernel.kallsyms]                                  [k] kprobe_register
     0.06%     0.03%  bench    bench                                              [.] btf_validate_type
     0.06%     0.00%  bench    [kernel.kallsyms]                                  [k] arch_ftrace_update_code
     0.06%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_modify_all_code
     0.05%     0.00%  bench    bench                                              [.] bpf_program__attach
     0.05%     0.00%  bench    bench                                              [.] attach_kprobe
     0.05%     0.00%  bench    bench                                              [.] bpf_program__attach_kprobe_opts
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_perf_event_open
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] __do_sys_perf_event_open
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_event_alloc
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_try_init_event
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_kprobe_event_init
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_kprobe_init
     0.05%     0.04%  bench    [kernel.kallsyms]                                  [k] ftrace_replace_code
     0.05%     0.02%  bench    bench                                              [.] btf_find_by_name_kind
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] asm_sysvec_apic_timer_interrupt
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] sysvec_apic_timer_interrupt
     0.04%     0.00%  bench    [unknown]                                          [k] 0000000000000000
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] do_group_exit
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] do_exit
     0.04%     0.00%  bench    libc.so.6                                          [.] read
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] 0xffffffff8fac2f2c
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] task_work_run
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] ____fput
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] __fput
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_release
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_event_release_kernel
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] _free_event
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_kprobe_destroy
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_trace_event_unreg.isra.0
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_trace_event_init
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] enable_trace_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] enable_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] arm_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] register_ftrace_function
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_startup
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_shutdown.part.0
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] disable_trace_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] __disable_trace_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] disable_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] __disable_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] disarm_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] disarm_kprobe_ftrace
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] unregister_ftrace_function
     0.03%     0.01%  bench    bench                                              [.] btf_parse_type_sec
     0.03%     0.01%  bench    libc.so.6                                          [.] __memmove_avx_unaligned_erms
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_read
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] ksys_read
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] vfs_read
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] kernfs_fop_read_iter
     0.03%     0.01%  bench    bench                                              [.] btf__type_by_id
     0.03%     0.03%  bench    bench                                              [.] btf_kind
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] __sysvec_apic_timer_interrupt
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] hrtimer_interrupt
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] asm_exc_page_fault
     0.02%     0.02%  bench    bench                                              [.] btf_type_size
     0.02%     0.02%  bench    libc.so.6                                          [.] __strcmp_avx2
     0.02%     0.02%  bench    bench                                              [.] btf_type_by_id
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] __hrtimer_run_queues
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] tick_nohz_handler
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] asm_sysvec_thermal
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] create_local_trace_kprobe
     0.02%     0.01%  bench    [kernel.kallsyms]                                  [k] ftrace_test_record
     0.02%     0.01%  bench    bench                                              [.] btf_validate_str
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] exc_page_fault
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] do_user_addr_fault
     0.02%     0.01%  bench    bench                                              [.] btf__str_by_offset
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] sysvec_thermal
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] __sysvec_thermal
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] intel_thermal_interrupt
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_rec_iter_record
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __handle_mm_fault
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] handle_mm_fault
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] __irqentry_text_end
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __queue_work
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] irq_exit_rcu
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __irq_exit_rcu
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __do_softirq
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] run_timer_softirq
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] tmigr_handle_remote
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] timer_expire_remote
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __run_timers
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] call_timer_fn
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] delayed_work_timer_fn
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] native_read_msr
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] count_mod_symbols
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] module_kallsyms_on_each_symbol
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] update_process_times
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] scheduler_tick
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] rep_movs_alternative
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] native_irq_return_iret
     0.01%     0.01%  bench    bench                                              [.] btf_strs_data
     0.01%     0.00%  bench    bench                                              [.] btf_validate_id
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] tick_do_update_jiffies64
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] update_wall_time
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] timekeeping_advance
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] timekeeping_update
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] native_write_msr
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] folios_put_refs
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __tlb_batch_free_encoded_pages
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] free_pages_and_swap_cache
     0.01%     0.00%  bench    [x86_pkg_temp_thermal]                             [k] pkg_thermal_notify
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] vma_alloc_folio
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] alloc_pages_mpol
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __alloc_pages
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] smp_call_function_many_cond
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] on_each_cpu_cond_mask
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_rec_iter_next
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] ftrace_check_record
     0.01%     0.00%  bench    [unknown]                                          [k] 0x00007f64de4eb08b
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_execve
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] do_execveat_common.isra.0
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] bprm_execve
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] load_elf_binary
     0.01%     0.00%  bench    bench                                              [.] bpf_prog_load
     0.01%     0.00%  bench    bench                                              [.] sys_bpf_prog_load
     0.01%     0.00%  bench    bench                                              [.] sys_bpf_fd
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_bpf
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __sys_bpf
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] bpf_prog_load
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] bpf_check
     0.01%     0.00%  bench    libc.so.6                                          [.] __munmap
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_munmap
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __vm_munmap
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] do_vmi_munmap
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] do_vmi_align_munmap
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] unmap_region
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] tlb_finish_mmu
     0.01%     0.01%  bench    [kvm]                                              [k] pvclock_gtod_notify
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] raw_notifier_call_chain
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] x86_pmu_enable
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] intel_pmu_enable_all
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] strcmp
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_event_task_tick
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_adjust_freq_unthr_context
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] text_poke_bp_batch
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] clear_page_erms
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] rep_stos_alternative
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] do_fault
     0.01%     0.01%  bench    ld-linux-x86-64.so.2                               [.] _dl_relocate_object
     0.01%     0.00%  bench    [unknown]                                          [.] 0x0000000000000040
     0.01%     0.00%  bench    ld-linux-x86-64.so.2                               [.] _dl_sysdep_start
     0.01%     0.00%  bench    ld-linux-x86-64.so.2                               [.] dl_main
     0.01%     0.01%  bench    bench                                              [.] elf_sec_by_name
     0.01%     0.00%  bench    bench                                              [.] bpf_object__open_skeleton
     0.01%     0.00%  bench    bench                                              [.] bpf_object__open_mem
     0.01%     0.00%  bench    bench                                              [.] bpf_object_open
     0.01%     0.00%  bench    bench                                              [.] bpf_object__elf_collect
     0.01%     0.00%  bench    bench                                              [.] bpf_object__init_btf
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] memset_orig
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] kfree
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] memcpy_orig
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] sysfs_kf_bin_read
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __virt_addr_valid
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __rmqueue_pcplist
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] do_anonymous_page
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] get_page_from_freelist
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] down_read_trylock
     0.00%     0.00%  bench    bench                                              [.] btf_vlen
     0.00%     0.00%  bench    bench                                              [.] libbpf_add_mem
     0.00%     0.00%  bench    bench                                              [.] btf_add_type_idx_entry
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] mas_destroy
     0.00%     0.00%  bench    [unknown]                                          [k] 0x000000280000001c
     0.00%     0.00%  bench    libc.so.6                                          [.] __GI___mremap
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_mremap
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __do_sys_mremap
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] vma_merge_extend
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] vma_merge.isra.0
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] mas_store_prealloc
     0.00%     0.00%  bench    bench                                              [.] btf__name_by_offset
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] insert_vmap_area
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] resolve_pseudo_ldimm64
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] bpf_prog_calc_tag
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] vmalloc
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __vmalloc_node_range
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __get_vm_area_node
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] alloc_vmap_area
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __mod_lruvec_state
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __page_cache_release
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __vunmap_range_noflush
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] vfree
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] vfree.part.0
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] remove_vm_area
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] free_unref_folios
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] pwq_tryinc_nr_active
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __register_ftrace_function
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_update_trampoline
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] arch_ftrace_update_trampoline
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] set_memory_rox
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] change_page_attr_set_clr
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] cpa_flush
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] flush_tlb_all
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] update_fast_timekeeper
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] insn_get_prefixes.part.0
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __register_trace_kprobe
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] register_kretprobe
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] register_kprobe
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] jump_label_text_reserved
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] arch_jump_entry_size
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] insn_decode
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] insn_get_displacement
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] insn_get_modrm
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] hrtimer_active
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] arch_scale_freq_tick
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] sync_regs
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] _raw_spin_lock_irqsave
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] kick_pool
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] wake_up_process
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] try_to_wake_up
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] acct_collect
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] arch_do_signal_or_restart
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] get_signal
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] lapic_next_deadline
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] tick_program_event
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] clockevents_program_event
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] lock_timer_base
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] queue_delayed_work_on
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __queue_delayed_work
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] error_entry
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] native_apic_msr_eoi
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] text_poke_finish
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_update_ftrace_func
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] text_poke_bp
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] sched_clock_cpu
     0.00%     0.00%  bench    libc.so.6                                          [.] pthread_setaffinity_np@@GLIBC_2.34
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_sched_setaffinity
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] sched_setaffinity
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __sched_setaffinity
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __set_cpus_allowed_ptr
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __set_cpus_allowed_ptr_locked
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] update_rq_clock
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] mmput
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __mmput
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] exit_mmap
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] unmap_vmas
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] unmap_single_vma
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] unmap_page_range
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] tlb_flush_mmu
     0.00%     0.00%  bench    libc.so.6                                          [.] pthread_cond_wait@@GLIBC_2.3.2
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] pcpu_next_md_free_region
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] free_percpu
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] pcpu_free_area
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] pcpu_chunk_refresh_hint
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] chacha_block_generic
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] setup_arg_pages
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] arch_align_stack
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] get_random_u16
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] _get_random_bytes.part.0
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] crng_make_state
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] crng_fast_key_erasure
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] finish_task_switch.isra.0
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __perf_event_task_sched_in
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_ctx_enable
     0.00%     0.00%  bench    libc.so.6                                          [.] clone3
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] ret_from_fork_asm
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] ret_from_fork
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] schedule_tail
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] nmi_restore
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] schedule_timeout
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] synchronize_rcu
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __wait_rcu_gp
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] wait_for_completion
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __wait_for_common
     0.00%     0.00%  perf-ex  [unknown]                                          [k] 0x00007f64de4eb08b
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] entry_SYSCALL_64
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] do_syscall_64
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] x64_sys_call
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] __x64_sys_execve
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] perf_event_exec
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] do_execveat_common.isra.0
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] bprm_execve
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] load_elf_binary
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] begin_new_exec
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] schedule
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __schedule
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] native_write_msr
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] ctx_resched
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] perf_ctx_enable
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] x86_pmu_enable
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] intel_pmu_enable_all


#
# (Tip: Generate a script for your data: perf script -g <lang>)
#

[-- Attachment #3: perf-out-kretprobe-patched-raw-bpf --]
[-- Type: application/octet-stream, Size: 78599 bytes --]

# To display the perf.data header info, please use --header/--header-only options.
#
#
# Total Lost Samples: 0
#
# Samples: 32K of event 'cycles:P'
# Event count (approx.): 34983230838
#
# Children      Self  Command  Shared Object                                      Symbol                                               
# ........  ........  .......  .................................................  .....................................................
#
    99.66%     0.00%  bench    libc.so.6                                          [.] start_thread
            |
            ---start_thread
               |          
                --99.54%--syscall
                          |          
                          |--55.13%--entry_SYSCALL_64
                          |          |          
                          |          |--36.05%--do_syscall_64
                          |          |          |          
                          |          |          |--20.07%--x64_sys_call
                          |          |          |          |          
                          |          |          |          |--14.40%--arch_rethook_trampoline
                          |          |          |          |          |          
                          |          |          |          |           --14.36%--arch_rethook_trampoline_callback
                          |          |          |          |                     |          
                          |          |          |          |                     |--11.51%--rethook_trampoline_handler
                          |          |          |          |                     |          |          
                          |          |          |          |                     |          |--7.24%--kretprobe_rethook_handler
                          |          |          |          |                     |          |          |          
                          |          |          |          |                     |          |           --7.13%--kretprobe_dispatcher
                          |          |          |          |                     |          |                     |          
                          |          |          |          |                     |          |                      --5.74%--kretprobe_perf_func
                          |          |          |          |                     |          |                                |          
                          |          |          |          |                     |          |                                |--2.78%--trace_call_bpf
                          |          |          |          |                     |          |                                |          |          
                          |          |          |          |                     |          |                                |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
                          |          |          |          |                     |          |                                |          
                          |          |          |          |                     |          |                                 --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
                          |          |          |          |                     |          |          
                          |          |          |          |                     |          |--1.73%--objpool_push.isra.0
                          |          |          |          |                     |          |          
                          |          |          |          |                     |           --1.03%--kretprobe_dispatcher
                          |          |          |          |                     |          
                          |          |          |          |                      --2.31%--kretprobe_rethook_handler
                          |          |          |          |          
                          |          |          |           --4.56%--__x64_sys_getpgid
                          |          |          |                     |          
                          |          |          |                     |--2.14%--do_getpgid
                          |          |          |                     |          |          
                          |          |          |                     |           --0.99%--find_task_by_vpid
                          |          |          |                     |          
                          |          |          |                      --0.82%--__rcu_read_unlock
                          |          |          |          
                          |          |          |--6.88%--__x64_sys_getpgid
                          |          |          |          |          
                          |          |          |           --6.04%--0xffffffffc1bc50f9
                          |          |          |                     |          
                          |          |          |                     |--5.15%--kprobe_ftrace_handler
                          |          |          |                     |          |          
                          |          |          |                     |           --3.03%--pre_handler_kretprobe
                          |          |          |                     |                     |          
                          |          |          |                     |                      --2.30%--rethook_try_get
                          |          |          |                     |          
                          |          |          |                      --0.77%--pre_handler_kretprobe
                          |          |          |          
                          |          |          |--2.87%--arch_rethook_trampoline
                          |          |          |          
                          |          |          |--1.56%--syscall_exit_to_user_mode
                          |          |          |          
                          |          |           --0.67%--0xffffffffc1bc5178
                          |          |          
                          |           --1.21%--x64_sys_call
                          |          
                          |--23.48%--entry_SYSRETQ_unsafe_stack
                          |          
                          |--17.38%--syscall_return_via_sysret
                          |          
                          |--0.58%--do_syscall_64
                          |          
                           --0.57%--arch_rethook_trampoline

    99.60%     2.40%  bench    libc.so.6                                          [.] syscall
            |          
            |--97.20%--syscall
            |          |          
            |          |--53.41%--entry_SYSCALL_64
            |          |          |          
            |          |          |--36.11%--do_syscall_64
            |          |          |          |          
            |          |          |          |--20.13%--x64_sys_call
            |          |          |          |          |          
            |          |          |          |          |--14.40%--arch_rethook_trampoline
            |          |          |          |          |          |          
            |          |          |          |          |           --14.36%--arch_rethook_trampoline_callback
            |          |          |          |          |                     |          
            |          |          |          |          |                     |--11.51%--rethook_trampoline_handler
            |          |          |          |          |                     |          |          
            |          |          |          |          |                     |          |--7.24%--kretprobe_rethook_handler
            |          |          |          |          |                     |          |          |          
            |          |          |          |          |                     |          |           --7.13%--kretprobe_dispatcher
            |          |          |          |          |                     |          |                     |          
            |          |          |          |          |                     |          |                      --5.74%--kretprobe_perf_func
            |          |          |          |          |                     |          |                                |          
            |          |          |          |          |                     |          |                                |--2.78%--trace_call_bpf
            |          |          |          |          |                     |          |                                |          |          
            |          |          |          |          |                     |          |                                |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |          |          |                     |          |                                |          
            |          |          |          |          |                     |          |                                 --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |          |          |                     |          |          
            |          |          |          |          |                     |          |--1.73%--objpool_push.isra.0
            |          |          |          |          |                     |          |          
            |          |          |          |          |                     |           --1.03%--kretprobe_dispatcher
            |          |          |          |          |                     |          
            |          |          |          |          |                      --2.31%--kretprobe_rethook_handler
            |          |          |          |          |          
            |          |          |          |           --4.56%--__x64_sys_getpgid
            |          |          |          |                     |          
            |          |          |          |                     |--2.14%--do_getpgid
            |          |          |          |                     |          |          
            |          |          |          |                     |           --0.99%--find_task_by_vpid
            |          |          |          |                     |          
            |          |          |          |                      --0.82%--__rcu_read_unlock
            |          |          |          |          
            |          |          |          |--6.88%--__x64_sys_getpgid
            |          |          |          |          |          
            |          |          |          |           --6.04%--0xffffffffc1bc50f9
            |          |          |          |                     |          
            |          |          |          |                     |--5.15%--kprobe_ftrace_handler
            |          |          |          |                     |          |          
            |          |          |          |                     |           --3.03%--pre_handler_kretprobe
            |          |          |          |                     |                     |          
            |          |          |          |                     |                      --2.30%--rethook_try_get
            |          |          |          |                     |          
            |          |          |          |                      --0.77%--pre_handler_kretprobe
            |          |          |          |          
            |          |          |          |--2.87%--arch_rethook_trampoline
            |          |          |          |          
            |          |          |          |--1.56%--syscall_exit_to_user_mode
            |          |          |          |          
            |          |          |           --0.67%--0xffffffffc1bc5178
            |          |          |          
            |          |           --1.21%--x64_sys_call
            |          |          
            |          |--23.48%--entry_SYSRETQ_unsafe_stack
            |          |          
            |          |--17.38%--syscall_return_via_sysret
            |          |          
            |          |--0.58%--do_syscall_64
            |          |          
            |           --0.57%--arch_rethook_trampoline
            |          
             --2.40%--start_thread
                       syscall
                       |          
                        --1.79%--entry_SYSCALL_64

    56.47%    16.77%  bench    [kernel.kallsyms]                                  [k] entry_SYSCALL_64
            |          
            |--39.70%--entry_SYSCALL_64
            |          |          
            |          |--36.20%--do_syscall_64
            |          |          |          
            |          |          |--20.22%--x64_sys_call
            |          |          |          |          
            |          |          |          |--14.40%--arch_rethook_trampoline
            |          |          |          |          |          
            |          |          |          |           --14.36%--arch_rethook_trampoline_callback
            |          |          |          |                     |          
            |          |          |          |                     |--11.51%--rethook_trampoline_handler
            |          |          |          |                     |          |          
            |          |          |          |                     |          |--7.24%--kretprobe_rethook_handler
            |          |          |          |                     |          |          |          
            |          |          |          |                     |          |           --7.13%--kretprobe_dispatcher
            |          |          |          |                     |          |                     |          
            |          |          |          |                     |          |                      --5.74%--kretprobe_perf_func
            |          |          |          |                     |          |                                |          
            |          |          |          |                     |          |                                |--2.78%--trace_call_bpf
            |          |          |          |                     |          |                                |          |          
            |          |          |          |                     |          |                                |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |          |                     |          |                                |          
            |          |          |          |                     |          |                                 --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |          |                     |          |          
            |          |          |          |                     |          |--1.73%--objpool_push.isra.0
            |          |          |          |                     |          |          
            |          |          |          |                     |           --1.03%--kretprobe_dispatcher
            |          |          |          |                     |          
            |          |          |          |                      --2.31%--kretprobe_rethook_handler
            |          |          |          |          
            |          |          |           --4.56%--__x64_sys_getpgid
            |          |          |                     |          
            |          |          |                     |--2.14%--do_getpgid
            |          |          |                     |          |          
            |          |          |                     |           --0.99%--find_task_by_vpid
            |          |          |                     |          
            |          |          |                      --0.82%--__rcu_read_unlock
            |          |          |          
            |          |          |--6.88%--__x64_sys_getpgid
            |          |          |          |          
            |          |          |           --6.04%--0xffffffffc1bc50f9
            |          |          |                     |          
            |          |          |                     |--5.15%--kprobe_ftrace_handler
            |          |          |                     |          |          
            |          |          |                     |           --3.03%--pre_handler_kretprobe
            |          |          |                     |                     |          
            |          |          |                     |                      --2.30%--rethook_try_get
            |          |          |                     |          
            |          |          |                      --0.77%--pre_handler_kretprobe
            |          |          |          
            |          |          |--2.87%--arch_rethook_trampoline
            |          |          |          
            |          |          |--1.56%--syscall_exit_to_user_mode
            |          |          |          
            |          |           --0.67%--0xffffffffc1bc5178
            |          |          
            |           --1.21%--x64_sys_call
            |          
             --16.77%--start_thread
                       syscall
                       |          
                       |--15.59%--entry_SYSCALL_64
                       |          
                        --0.90%--syscall_return_via_sysret

    37.01%     2.71%  bench    [kernel.kallsyms]                                  [k] do_syscall_64
            |          
            |--34.30%--do_syscall_64
            |          |          
            |          |--20.22%--x64_sys_call
            |          |          |          
            |          |          |--14.40%--arch_rethook_trampoline
            |          |          |          |          
            |          |          |           --14.36%--arch_rethook_trampoline_callback
            |          |          |                     |          
            |          |          |                     |--11.51%--rethook_trampoline_handler
            |          |          |                     |          |          
            |          |          |                     |          |--7.24%--kretprobe_rethook_handler
            |          |          |                     |          |          |          
            |          |          |                     |          |           --7.13%--kretprobe_dispatcher
            |          |          |                     |          |                     |          
            |          |          |                     |          |                      --5.74%--kretprobe_perf_func
            |          |          |                     |          |                                |          
            |          |          |                     |          |                                |--2.78%--trace_call_bpf
            |          |          |                     |          |                                |          |          
            |          |          |                     |          |                                |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |                     |          |                                |          
            |          |          |                     |          |                                 --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          |                     |          |          
            |          |          |                     |          |--1.73%--objpool_push.isra.0
            |          |          |                     |          |          
            |          |          |                     |           --1.03%--kretprobe_dispatcher
            |          |          |                     |          
            |          |          |                      --2.31%--kretprobe_rethook_handler
            |          |          |          
            |          |           --4.56%--__x64_sys_getpgid
            |          |                     |          
            |          |                     |--2.14%--do_getpgid
            |          |                     |          |          
            |          |                     |           --0.99%--find_task_by_vpid
            |          |                     |          
            |          |                      --0.82%--__rcu_read_unlock
            |          |          
            |          |--6.88%--__x64_sys_getpgid
            |          |          |          
            |          |           --6.04%--0xffffffffc1bc50f9
            |          |                     |          
            |          |                     |--5.15%--kprobe_ftrace_handler
            |          |                     |          |          
            |          |                     |           --3.03%--pre_handler_kretprobe
            |          |                     |                     |          
            |          |                     |                      --2.30%--rethook_try_get
            |          |                     |          
            |          |                      --0.77%--pre_handler_kretprobe
            |          |          
            |          |--2.87%--arch_rethook_trampoline
            |          |          
            |          |--1.56%--syscall_exit_to_user_mode
            |          |          
            |           --0.67%--0xffffffffc1bc5178
            |          
             --2.71%--start_thread
                       syscall
                       |          
                        --2.42%--entry_SYSCALL_64
                                  |          
                                   --2.20%--do_syscall_64

    25.19%    25.03%  bench    [kernel.kallsyms]                                  [k] entry_SYSRETQ_unsafe_stack
            |          
             --25.03%--start_thread
                       syscall
                       |          
                        --23.32%--entry_SYSRETQ_unsafe_stack

    21.68%     1.87%  bench    [kernel.kallsyms]                                  [k] x64_sys_call
            |          
            |--19.81%--x64_sys_call
            |          |          
            |          |--14.40%--arch_rethook_trampoline
            |          |          |          
            |          |           --14.36%--arch_rethook_trampoline_callback
            |          |                     |          
            |          |                     |--11.51%--rethook_trampoline_handler
            |          |                     |          |          
            |          |                     |          |--7.24%--kretprobe_rethook_handler
            |          |                     |          |          |          
            |          |                     |          |           --7.13%--kretprobe_dispatcher
            |          |                     |          |                     |          
            |          |                     |          |                      --5.74%--kretprobe_perf_func
            |          |                     |          |                                |          
            |          |                     |          |                                |--2.78%--trace_call_bpf
            |          |                     |          |                                |          |          
            |          |                     |          |                                |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |                     |          |                                |          
            |          |                     |          |                                 --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |                     |          |          
            |          |                     |          |--1.73%--objpool_push.isra.0
            |          |                     |          |          
            |          |                     |           --1.03%--kretprobe_dispatcher
            |          |                     |          
            |          |                      --2.31%--kretprobe_rethook_handler
            |          |          
            |           --4.56%--__x64_sys_getpgid
            |                     |          
            |                     |--2.14%--do_getpgid
            |                     |          |          
            |                     |           --0.99%--find_task_by_vpid
            |                     |          
            |                      --0.82%--__rcu_read_unlock
            |          
             --1.87%--start_thread
                       syscall
                       entry_SYSCALL_64
                       |          
                       |--1.17%--x64_sys_call
                       |          
                        --0.70%--do_syscall_64

    18.25%     3.13%  bench    [kernel.kallsyms]                                  [k] arch_rethook_trampoline
            |          
            |--15.13%--arch_rethook_trampoline
            |          |          
            |           --14.83%--arch_rethook_trampoline_callback
            |                     |          
            |                     |--11.87%--rethook_trampoline_handler
            |                     |          |          
            |                     |          |--7.24%--kretprobe_rethook_handler
            |                     |          |          |          
            |                     |          |           --7.13%--kretprobe_dispatcher
            |                     |          |                     |          
            |                     |          |                      --5.74%--kretprobe_perf_func
            |                     |          |                                |          
            |                     |          |                                |--2.78%--trace_call_bpf
            |                     |          |                                |          |          
            |                     |          |                                |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |                     |          |                                |          
            |                     |          |                                 --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |                     |          |          
            |                     |          |--1.73%--objpool_push.isra.0
            |                     |          |          
            |                     |           --1.03%--kretprobe_dispatcher
            |                     |          
            |                      --2.31%--kretprobe_rethook_handler
            |          
             --3.13%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       |          
                        --2.71%--arch_rethook_trampoline

    17.54%    16.65%  bench    [kernel.kallsyms]                                  [k] syscall_return_via_sysret
            |          
            |--16.65%--start_thread
            |          syscall
            |          |          
            |           --16.49%--syscall_return_via_sysret
            |          
             --0.90%--syscall_return_via_sysret

    15.15%     0.41%  bench    [kernel.kallsyms]                                  [k] arch_rethook_trampoline_callback
            |          
             --14.74%--arch_rethook_trampoline_callback
                       |          
                       |--11.87%--rethook_trampoline_handler
                       |          |          
                       |          |--7.24%--kretprobe_rethook_handler
                       |          |          |          
                       |          |           --7.13%--kretprobe_dispatcher
                       |          |                     |          
                       |          |                      --5.74%--kretprobe_perf_func
                       |          |                                |          
                       |          |                                |--2.78%--trace_call_bpf
                       |          |                                |          |          
                       |          |                                |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
                       |          |                                |          
                       |          |                                 --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
                       |          |          
                       |          |--1.73%--objpool_push.isra.0
                       |          |          
                       |           --1.03%--kretprobe_dispatcher
                       |          
                        --2.31%--kretprobe_rethook_handler

    12.47%     2.33%  bench    [kernel.kallsyms]                                  [k] rethook_trampoline_handler
            |          
            |--10.14%--rethook_trampoline_handler
            |          |          
            |          |--7.24%--kretprobe_rethook_handler
            |          |          |          
            |          |           --7.13%--kretprobe_dispatcher
            |          |                     |          
            |          |                      --5.74%--kretprobe_perf_func
            |          |                                |          
            |          |                                |--2.78%--trace_call_bpf
            |          |                                |          |          
            |          |                                |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |                                |          
            |          |                                 --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          
            |          |--1.73%--objpool_push.isra.0
            |          |          
            |           --1.03%--kretprobe_dispatcher
            |          
             --2.33%--start_thread
                       syscall
                       |          
                        --1.92%--entry_SYSCALL_64
                                  do_syscall_64
                                  x64_sys_call
                                  arch_rethook_trampoline
                                  |          
                                   --1.88%--arch_rethook_trampoline_callback
                                             |          
                                              --1.41%--rethook_trampoline_handler

    11.67%     0.59%  bench    [kernel.kallsyms]                                  [k] __x64_sys_getpgid
            |          
            |--11.08%--__x64_sys_getpgid
            |          |          
            |          |--6.04%--0xffffffffc1bc50f9
            |          |          |          
            |          |          |--5.15%--kprobe_ftrace_handler
            |          |          |          |          
            |          |          |           --3.03%--pre_handler_kretprobe
            |          |          |                     |          
            |          |          |                      --2.30%--rethook_try_get
            |          |          |          
            |          |           --0.77%--pre_handler_kretprobe
            |          |          
            |          |--2.14%--do_getpgid
            |          |          |          
            |          |           --0.99%--find_task_by_vpid
            |          |          
            |           --0.82%--__rcu_read_unlock
            |          
             --0.59%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64

     9.61%     2.35%  bench    [kernel.kallsyms]                                  [k] kretprobe_rethook_handler
            |          
            |--7.26%--kretprobe_rethook_handler
            |          |          
            |           --7.13%--kretprobe_dispatcher
            |                     |          
            |                      --5.74%--kretprobe_perf_func
            |                                |          
            |                                |--2.78%--trace_call_bpf
            |                                |          |          
            |                                |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |                                |          
            |                                 --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          
             --2.35%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       |          
                        --2.29%--kretprobe_rethook_handler

     8.27%     2.34%  bench    [kernel.kallsyms]                                  [k] kretprobe_dispatcher
            |          
            |--5.93%--kretprobe_dispatcher
            |          |          
            |           --5.74%--kretprobe_perf_func
            |                     |          
            |                     |--2.78%--trace_call_bpf
            |                     |          |          
            |                     |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |                     |          
            |                      --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          
             --2.34%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       |          
                       |--1.37%--kretprobe_rethook_handler
                       |          |          
                       |           --1.27%--kretprobe_dispatcher
                       |          
                        --0.97%--kretprobe_dispatcher

     6.07%     0.03%  bench    [unknown]                                          [k] 0xffffffffc1bc50f9
            |          
             --6.04%--0xffffffffc1bc50f9
                       |          
                       |--5.15%--kprobe_ftrace_handler
                       |          |          
                       |           --3.03%--pre_handler_kretprobe
                       |                     |          
                       |                      --2.30%--rethook_try_get
                       |          
                        --0.77%--pre_handler_kretprobe

     5.86%     0.88%  bench    [kernel.kallsyms]                                  [k] kretprobe_perf_func
            |          
            |--4.99%--kretprobe_perf_func
            |          |          
            |          |--2.78%--trace_call_bpf
            |          |          |          
            |          |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          |          
            |           --1.15%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          
             --0.88%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       kretprobe_rethook_handler
                       |          
                        --0.87%--kretprobe_dispatcher
                                  |          
                                   --0.80%--kretprobe_perf_func

     5.40%     2.01%  bench    [kernel.kallsyms]                                  [k] kprobe_ftrace_handler
            |          
            |--3.38%--kprobe_ftrace_handler
            |          |          
            |           --3.03%--pre_handler_kretprobe
            |                     |          
            |                      --2.30%--rethook_try_get
            |          
             --2.01%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       |          
                        --1.90%--__x64_sys_getpgid
                                  0xffffffffc1bc50f9
                                  |          
                                   --1.83%--kprobe_ftrace_handler

     3.88%     1.30%  bench    [kernel.kallsyms]                                  [k] pre_handler_kretprobe
            |          
            |--2.59%--pre_handler_kretprobe
            |          |          
            |           --2.30%--rethook_try_get
            |          
             --1.30%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       __x64_sys_getpgid
                       0xffffffffc1bc50f9
                       |          
                       |--0.71%--pre_handler_kretprobe
                       |          
                        --0.58%--kprobe_ftrace_handler

     3.10%     1.49%  bench    [kernel.kallsyms]                                  [k] trace_call_bpf
            |          
            |--1.61%--trace_call_bpf
            |          |          
            |           --1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          
             --1.49%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       kretprobe_rethook_handler
                       kretprobe_dispatcher
                       |          
                        --1.44%--kretprobe_perf_func
                                  |          
                                   --1.17%--trace_call_bpf

     2.78%     1.15%  bench    [kernel.kallsyms]                                  [k] do_getpgid
            |          
            |--1.64%--do_getpgid
            |          |          
            |           --0.99%--find_task_by_vpid
            |          
             --1.15%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       |          
                        --0.95%--__x64_sys_getpgid
                                  |          
                                   --0.54%--do_getpgid

     2.45%     2.36%  bench    [kernel.kallsyms]                                  [k] rethook_try_get
            |          
             --2.36%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       __x64_sys_getpgid
                       0xffffffffc1bc50f9
                       kprobe_ftrace_handler
                       |          
                        --2.30%--pre_handler_kretprobe
                                  |          
                                   --2.30%--rethook_try_get

     2.23%     2.16%  bench    bpf_prog_21856463590f61f1_bench_trigger_kretprobe  [k] bpf_prog_21856463590f61f1_bench_trigger_kretprobe
            |          
             --2.16%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       kretprobe_rethook_handler
                       kretprobe_dispatcher
                       kretprobe_perf_func
                       |          
                       |--1.08%--bpf_prog_21856463590f61f1_bench_trigger_kretprobe
                       |          
                        --1.08%--trace_call_bpf
                                  bpf_prog_21856463590f61f1_bench_trigger_kretprobe

     1.91%     1.55%  bench    [kernel.kallsyms]                                  [k] syscall_exit_to_user_mode
            |          
             --1.55%--start_thread
                       syscall
                       entry_SYSCALL_64
                       |          
                        --1.24%--do_syscall_64
                                  syscall_exit_to_user_mode

     1.85%     1.77%  bench    [kernel.kallsyms]                                  [k] objpool_push.isra.0
            |          
             --1.77%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       arch_rethook_trampoline
                       arch_rethook_trampoline_callback
                       rethook_trampoline_handler
                       |          
                        --1.73%--objpool_push.isra.0

     1.49%     0.80%  bench    [kernel.kallsyms]                                  [k] find_task_by_vpid
            |          
            |--0.80%--start_thread
            |          syscall
            |          entry_SYSCALL_64
            |          do_syscall_64
            |          x64_sys_call
            |          __x64_sys_getpgid
            |          
             --0.69%--find_task_by_vpid

     1.21%     0.89%  bench    [kernel.kallsyms]                                  [k] __rcu_read_unlock
            |          
             --0.89%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       x64_sys_call
                       |          
                        --0.60%--__x64_sys_getpgid
                                  |          
                                   --0.55%--__rcu_read_unlock

     1.01%     0.33%  bench    [unknown]                                          [k] 0xffffffffc1bc5178
            |          
             --0.67%--0xffffffffc1bc5178

     0.88%     0.32%  bench    [kernel.kallsyms]                                  [k] idr_find
            |          
             --0.55%--idr_find

     0.71%     0.67%  bench    [unknown]                                          [k] 0xffffffffc1bc5177
            |          
             --0.67%--start_thread
                       syscall
                       entry_SYSCALL_64
                       do_syscall_64
                       0xffffffffc1bc5178

     0.56%     0.45%  bench    [kernel.kallsyms]                                  [k] __rcu_read_lock
     0.53%     0.50%  bench    [kernel.kallsyms]                                  [k] migrate_enable
     0.51%     0.16%  bench    [kernel.kallsyms]                                  [k] radix_tree_lookup
     0.48%     0.11%  bench    [kernel.kallsyms]                                  [k] arch_rethook_fixup_return
     0.47%     0.42%  bench    [kernel.kallsyms]                                  [k] migrate_disable
     0.47%     0.47%  bench    [kernel.kallsyms]                                  [k] fpregs_assert_state_consistent
     0.43%     0.39%  bench    [kernel.kallsyms]                                  [k] __radix_tree_lookup
     0.36%     0.15%  bench    [unknown]                                          [k] 0xffffffffc1bc500a
     0.29%     0.24%  bench    [kernel.kallsyms]                                  [k] rethook_hook
     0.24%     0.00%  bench    libc.so.6                                          [.] __libc_start_call_main
     0.24%     0.00%  bench    bench                                              [.] main
     0.24%     0.00%  bench    bench                                              [.] setup_benchmark
     0.24%     0.00%  bench    bench                                              [.] trigger_kretprobe_setup
     0.21%     0.21%  bench    [unknown]                                          [k] 0xffffffffc1bc5006
     0.19%     0.00%  bench    bench                                              [.] trigger_bench__open_and_load
     0.19%     0.00%  bench    bench                                              [.] bpf_object__load_skeleton
     0.19%     0.00%  bench    bench                                              [.] bpf_object__load
     0.19%     0.00%  bench    bench                                              [.] bpf_object_load
     0.18%     0.15%  bench    [kernel.kallsyms]                                  [k] get_kprobe
     0.15%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc500b
     0.15%     0.08%  bench    [kernel.kallsyms]                                  [k] arch_rethook_prepare
     0.14%     0.00%  bench    bench                                              [.] bpf_object__load_vmlinux_btf
     0.14%     0.00%  bench    bench                                              [.] libbpf_find_kernel_btf
     0.14%     0.00%  bench    bench                                              [.] btf__parse
     0.14%     0.00%  bench    bench                                              [.] btf_parse
     0.14%     0.00%  bench    bench                                              [.] btf_parse_raw
     0.14%     0.14%  bench    [kernel.kallsyms]                                  [k] amd_clear_divider
     0.13%     0.06%  bench    [unknown]                                          [k] 0xffffffffc1bc509a
     0.12%     0.06%  bench    [unknown]                                          [k] 0xffffffffc1bc509f
     0.12%     0.07%  bench    [unknown]                                          [k] 0xffffffffc1bc5095
     0.12%     0.12%  bench    bench                                              [.] trigger_producer
     0.12%     0.00%  bench    bench                                              [.] btf_new
     0.11%     0.11%  bench    [unknown]                                          [k] 0xffffffffc1bc5004
     0.11%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5005
     0.11%     0.08%  bench    [unknown]                                          [k] 0xffffffffc1bc5101
     0.11%     0.05%  bench    [unknown]                                          [k] 0xffffffffc1bc5090
     0.11%     0.05%  bench    [unknown]                                          [k] 0xffffffffc1bc5086
     0.11%     0.06%  bench    [unknown]                                          [k] 0xffffffffc1bc508b
     0.09%     0.04%  bench    bench                                              [.] syscall@plt
     0.09%     0.08%  bench    [unknown]                                          [k] 0xffffffffc1bc5022
     0.08%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5000
     0.08%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5027
     0.08%     0.01%  bench    [unknown]                                          [k] 0xffffffffc1bc5012
     0.08%     0.02%  bench    [unknown]                                          [k] 0xffffffffc1bc5161
     0.08%     0.00%  bench    bench                                              [.] btf_sanity_check
     0.08%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5109
     0.08%     0.08%  bench    [unknown]                                          [k] 0xffffffffc1bc500e
     0.07%     0.07%  bench    [unknown]                                          [k] 0xffffffffc1bc514d
     0.07%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5152
     0.07%     0.01%  bench    bench                                              [.] btf_validate_type
     0.07%     0.07%  bench    [unknown]                                          [k] 0xffffffffc1bc5066
     0.07%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc506e
     0.06%     0.06%  bench    [unknown]                                          [k] 0xffffffffc1bc513b
     0.06%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5143
     0.06%     0.06%  bench    [unknown]                                          [k] 0xffffffffc1bc515c
     0.06%     0.06%  bench    [unknown]                                          [k] 0xffffffffc1bc5082
     0.06%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc50a4
     0.06%     0.06%  bench    [unknown]                                          [k] 0xffffffffc1bc5111
     0.06%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5119
     0.06%     0.00%  bench    [kernel.kallsyms]                                  [k] kprobe_register
     0.06%     0.00%  bench    [kernel.kallsyms]                                  [k] arch_ftrace_update_code
     0.06%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_modify_all_code
     0.06%     0.06%  bench    [unknown]                                          [k] 0xffffffffc1bc50f4
     0.05%     0.05%  bench    [unknown]                                          [k] 0xffffffffc1bc50ca
     0.05%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc50d2
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] asm_sysvec_apic_timer_interrupt
     0.05%     0.05%  bench    [unknown]                                          [k] 0xffffffffc1bc5051
     0.05%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5056
     0.05%     0.00%  bench    bench                                              [.] bpf_program__attach
     0.05%     0.00%  bench    bench                                              [.] attach_kprobe
     0.05%     0.00%  bench    bench                                              [.] bpf_program__attach_kprobe_opts
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_perf_event_open
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] __do_sys_perf_event_open
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_event_alloc
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_try_init_event
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_kprobe_event_init
     0.05%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_kprobe_init
     0.05%     0.05%  bench    [unknown]                                          [k] 0xffffffffc1bc50bb
     0.05%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc50c3
     0.05%     0.00%  bench    bench                                              [.] bpf_object__load_progs
     0.05%     0.00%  bench    bench                                              [.] bpf_object_load_prog
     0.05%     0.04%  bench    [unknown]                                          [k] 0xffffffffc1bc5040
     0.05%     0.05%  bench    [unknown]                                          [k] 0xffffffffc1bc50da
     0.05%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc50e2
     0.05%     0.03%  bench    [unknown]                                          [k] 0xffffffffc1bc5036
     0.04%     0.00%  bench    [unknown]                                          [.] 0000000000000000
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] sysvec_apic_timer_interrupt
     0.04%     0.04%  bench    [unknown]                                          [k] 0xffffffffc1bc5127
     0.04%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc512c
     0.04%     0.02%  bench    bench                                              [.] btf__type_by_id
     0.04%     0.00%  bench    bench                                              [.] libbpf_prepare_prog_load
     0.04%     0.00%  bench    bench                                              [.] libbpf_find_attach_btf_id
     0.04%     0.00%  bench    bench                                              [.] find_kernel_btf_id
     0.04%     0.00%  bench    bench                                              [.] find_attach_btf_id
     0.04%     0.00%  bench    bench                                              [.] find_btf_by_prefix_kind
     0.04%     0.00%  bench    bench                                              [.] btf__find_by_name_kind
     0.04%     0.01%  bench    [unknown]                                          [k] 0xffffffffc1bc503b
     0.04%     0.02%  bench    [kernel.kallsyms]                                  [k] ftrace_replace_code
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] __sysvec_apic_timer_interrupt
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] hrtimer_interrupt
     0.04%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5049
     0.04%     0.00%  bench    bench                                              [.] btf_find_by_name_kind
     0.04%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc501d
     0.04%     0.02%  bench    [unknown]                                          [k] 0xffffffffc1bc5031
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] 0xffffffff8d2c3f2c
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] do_group_exit
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] do_exit
     0.04%     0.00%  bench    [kernel.kallsyms]                                  [k] asm_exc_page_fault
     0.03%     0.01%  bench    bench                                              [.] btf_validate_id
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] __hrtimer_run_queues
     0.03%     0.00%  bench    libc.so.6                                          [.] read
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_read
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] ksys_read
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] vfs_read
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] kernfs_fop_read_iter
     0.03%     0.03%  bench    [unknown]                                          [k] 0xffffffffc1bc5016
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] task_work_run
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] ____fput
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] __fput
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] tick_nohz_handler
     0.03%     0.03%  bench    [unknown]                                          [k] 0xffffffffc1bc5170
     0.03%     0.03%  bench    [unknown]                                          [k] 0xffffffffc1bc50ac
     0.03%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc50b4
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] asm_sysvec_thermal
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] sysvec_thermal
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] __sysvec_thermal
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] intel_thermal_interrupt
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_release
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_event_release_kernel
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] _free_event
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_kprobe_destroy
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_trace_event_unreg.isra.0
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] disable_trace_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] __disable_trace_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] disable_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] __disable_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] disarm_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] disarm_kprobe_ftrace
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] unregister_ftrace_function
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_shutdown.part.0
     0.03%     0.00%  bench    bench                                              [.] btf_parse_type_sec
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_trace_event_init
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] enable_trace_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] enable_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] arm_kprobe
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] register_ftrace_function
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_startup
     0.03%     0.02%  bench    libc.so.6                                          [.] __memmove_avx_unaligned_erms
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] rep_movs_alternative
     0.03%     0.00%  bench    [kernel.kallsyms]                                  [k] exc_page_fault
     0.02%     0.02%  bench    [kernel.kallsyms]                                  [k] native_read_msr
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] create_local_trace_kprobe
     0.02%     0.02%  bench    bench                                              [.] btf_type_by_id
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] handle_mm_fault
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] do_user_addr_fault
     0.02%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5166
     0.02%     0.02%  bench    [unknown]                                          [k] 0xffffffffc1bc502c
     0.02%     0.02%  bench    [kernel.kallsyms]                                  [k] ftrace_check_record
     0.02%     0.02%  bench    bench                                              [.] btf__str_by_offset
     0.02%     0.02%  bench    [kernel.kallsyms]                                  [k] ftrace_test_record
     0.02%     0.02%  bench    bench                                              [.] btf_kind
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] update_process_times
     0.02%     0.00%  bench    [kernel.kallsyms]                                  [k] __handle_mm_fault
     0.02%     0.01%  bench    bench                                              [.] btf_add_type_idx_entry
     0.02%     0.01%  bench    bench                                              [.] btf_type_size
     0.02%     0.01%  bench    bench                                              [.] btf_validate_str
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] timekeeping_advance
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] tick_do_update_jiffies64
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] update_wall_time
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] count_mod_symbols
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] scheduler_tick
     0.01%     0.00%  bench    bench                                              [.] sys_bpf_fd
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_bpf
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __sys_bpf
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] bpf_prog_load
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] bpf_check
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] do_anonymous_page
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] native_write_msr
     0.01%     0.00%  bench    bench                                              [.] btf__name_by_offset
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] ftrace_rec_iter_next
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] __irqentry_text_end
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] native_irq_return_iret
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] memcpy_orig
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] sysfs_kf_bin_read
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] unmap_vmas
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] unmap_single_vma
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_rec_iter_record
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] vma_alloc_folio
     0.01%     0.00%  bench    [unknown]                                          [k] 0x00007fb2140eb08b
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_execve
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] do_execveat_common.isra.0
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] bprm_execve
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] load_elf_binary
     0.01%     0.00%  bench    bench                                              [.] btf_add_type_offs_mem
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] sync_regs
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_adjust_freq_unthr_context
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_event_task_tick
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] module_kallsyms_on_each_symbol
     0.01%     0.00%  bench    libc.so.6                                          [.] __munmap
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_munmap
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __vm_munmap
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] do_vmi_munmap
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] do_vmi_align_munmap
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] unmap_region
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] update_fast_timekeeper
     0.01%     0.00%  bench    bench                                              [.] bpf_prog_load
     0.01%     0.00%  bench    bench                                              [.] sys_bpf_prog_load
     0.01%     0.00%  bench    bench                                              [.] btf_strs_data
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] arch_scale_freq_tick
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] irq_exit_rcu
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __irq_exit_rcu
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __do_softirq
     0.01%     0.00%  bench    [unknown]                                          [k] 0xffffffffc1bc5013
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] vm_area_alloc
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] elf_load
     0.01%     0.01%  bench    ld-linux-x86-64.so.2                               [.] do_lookup_x
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] vm_brk_flags
     0.01%     0.01%  bench    [kernel.kallsyms]                                  [k] alloc_vmap_area
     0.01%     0.00%  bench    bench                                              [.] bpf_object__probe_loading
     0.01%     0.00%  bench    bench                                              [.] bump_rlimit_memlock
     0.01%     0.00%  bench    bench                                              [.] feat_supported
     0.01%     0.00%  bench    bench                                              [.] probe_memcg_account
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] vzalloc
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __vmalloc_node_range
     0.01%     0.00%  bench    [kernel.kallsyms]                                  [k] __get_vm_area_node
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __mem_cgroup_charge
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] _compound_head
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __set_task_blocked
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] mmput
     0.00%     0.00%  bench    bench                                              [.] sigalarm_handler
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __mmput
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] exit_mmap
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] arch_do_signal_or_restart
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] pfn_pte
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] irqentry_enter
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] pte_offset_map_nolock
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] clear_page_erms
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] alloc_pages_mpol
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __alloc_pages
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] get_page_from_freelist
     0.00%     0.00%  bench    bench                                              [.] libbpf_add_mem
     0.00%     0.00%  bench    libc.so.6                                          [.] __memset_avx2_unaligned_erms
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] x86_pmu_enable
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] intel_pmu_enable_all
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] error_entry
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] _raw_spin_lock_irqsave
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] timekeeping_update
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] convert_ctx_accesses
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] insn_get_prefixes.part.0
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __register_trace_kprobe
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] register_kretprobe
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] register_kprobe
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] jump_label_text_reserved
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] arch_jump_entry_size
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] insn_decode
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] insn_get_displacement
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] insn_get_modrm
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __mem_cgroup_uncharge_folios
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] tlb_finish_mmu
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __tlb_batch_free_encoded_pages
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] free_pages_and_swap_cache
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] folios_put_refs
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] strcmp
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] folio_remove_rmap_ptes
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] unmap_page_range
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] smp_call_function_many_cond
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] ftrace_update_ftrace_func
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] text_poke_bp
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] text_poke_bp_batch
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] on_each_cpu_cond_mask
     0.00%     0.00%  bench    libc.so.6                                          [.] __strcmp_avx2
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] watchdog_timer_fn
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __fdget
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] native_read_msr_safe
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] notify_hwp_interrupt
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] update_rt_rq_load_avg
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] run_rebalance_domains
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] update_blocked_averages
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] tmigr_requires_handle_remote
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] therm_throt_process
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] clockevents_program_event
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] tick_program_event
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __memcg_slab_free_hook
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] dput
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __dentry_kill
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] dentry_free
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] kmem_cache_free
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] task_tick_fair
     0.00%     0.00%  bench    [x86_pkg_temp_thermal]                             [k] pkg_thermal_notify
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __run_timers
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] shift_arg_pages
     0.00%     0.00%  bench    libc.so.6                                          [.] _IO_file_overflow@@GLIBC_2.2.5
     0.00%     0.00%  bench    [unknown]                                          [.] 0x000056411ba752a0
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] finish_task_switch.isra.0
     0.00%     0.00%  bench    libc.so.6                                          [.] clone3
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] ret_from_fork_asm
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] ret_from_fork
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] schedule_tail
     0.00%     0.00%  perf-ex  [unknown]                                          [k] 0x00007fb2140eb08b
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] entry_SYSCALL_64
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] do_syscall_64
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] perf_ctx_enable
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] x64_sys_call
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] __x64_sys_execve
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] do_execveat_common.isra.0
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] bprm_execve
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] load_elf_binary
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] begin_new_exec
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] perf_event_exec
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] ctx_resched
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __perf_event_task_sched_in
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] perf_ctx_enable
     0.00%     0.00%  bench    libc.so.6                                          [.] pthread_setaffinity_np@@GLIBC_2.34
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __x64_sys_sched_setaffinity
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] sched_setaffinity
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __sched_setaffinity
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __set_cpus_allowed_ptr
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __set_cpus_allowed_ptr_locked
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] affine_move_task
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] wait_for_completion
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __wait_for_common
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] schedule_timeout
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] schedule
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] __schedule
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] nmi_restore
     0.00%     0.00%  bench    [kernel.kallsyms]                                  [k] intel_pmu_handle_irq
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] native_write_msr
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] x86_pmu_enable
     0.00%     0.00%  perf-ex  [kernel.kallsyms]                                  [k] intel_pmu_enable_all


#
# (Tip: Print event counts in CSV format with: perf stat -x,)
#

  reply	other threads:[~2024-05-02  2:06 UTC|newest]

Thread overview: 59+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-04-15 12:48 [PATCH v9 00/36] tracing: fprobe: function_graph: Multi-function graph and fprobe on fgraph Masami Hiramatsu (Google)
2024-04-15 12:49 ` [PATCH v9 01/36] tracing: Add a comment about ftrace_regs definition Masami Hiramatsu (Google)
2024-04-24 12:23   ` Florent Revest
2024-04-24 13:19     ` Florent Revest
2024-04-24 14:31       ` Masami Hiramatsu
2024-04-15 12:49 ` [PATCH v9 02/36] tracing: Rename ftrace_regs_return_value to ftrace_regs_get_return_value Masami Hiramatsu (Google)
2024-04-15 12:49 ` [PATCH v9 03/36] x86: tracing: Add ftrace_regs definition in the header Masami Hiramatsu (Google)
2024-04-15 12:49 ` [PATCH v9 04/36] function_graph: Convert ret_stack to a series of longs Masami Hiramatsu (Google)
2024-04-15 12:49 ` [PATCH v9 05/36] fgraph: Use BUILD_BUG_ON() to make sure we have structures divisible by long Masami Hiramatsu (Google)
2024-04-15 12:50 ` [PATCH v9 06/36] function_graph: Add an array structure that will allow multiple callbacks Masami Hiramatsu (Google)
2024-04-15 12:50 ` [PATCH v9 07/36] function_graph: Allow multiple users to attach to function graph Masami Hiramatsu (Google)
2024-04-20  3:52   ` Steven Rostedt
2024-04-20  8:56     ` Masami Hiramatsu
2024-04-15 12:50 ` [PATCH v9 08/36] function_graph: Remove logic around ftrace_graph_entry and return Masami Hiramatsu (Google)
2024-04-15 12:50 ` [PATCH v9 09/36] ftrace/function_graph: Pass fgraph_ops to function graph callbacks Masami Hiramatsu (Google)
2024-04-15 12:50 ` [PATCH v9 10/36] ftrace: Allow function_graph tracer to be enabled in instances Masami Hiramatsu (Google)
2024-04-15 12:51 ` [PATCH v9 11/36] ftrace: Allow ftrace startup flags exist without dynamic ftrace Masami Hiramatsu (Google)
2024-04-15 12:51 ` [PATCH v9 12/36] function_graph: Have the instances use their own ftrace_ops for filtering Masami Hiramatsu (Google)
2024-04-15 12:51 ` [PATCH v9 13/36] function_graph: Use a simple LRU for fgraph_array index number Masami Hiramatsu (Google)
2024-04-15 12:51 ` [PATCH v9 14/36] function_graph: Add "task variables" per task for fgraph_ops Masami Hiramatsu (Google)
2024-04-15 12:51 ` [PATCH v9 15/36] function_graph: Move set_graph_function tests to shadow stack global var Masami Hiramatsu (Google)
2024-04-15 12:52 ` [PATCH v9 16/36] function_graph: Move graph depth stored data " Masami Hiramatsu (Google)
2024-04-15 12:52 ` [PATCH v9 17/36] function_graph: Move graph notrace bit " Masami Hiramatsu (Google)
2024-04-15 12:52 ` [PATCH v9 18/36] function_graph: Implement fgraph_reserve_data() and fgraph_retrieve_data() Masami Hiramatsu (Google)
2024-04-15 12:52 ` [PATCH v9 19/36] function_graph: Add selftest for passing local variables Masami Hiramatsu (Google)
2024-04-15 12:52 ` [PATCH v9 20/36] ftrace: Add multiple fgraph storage selftest Masami Hiramatsu (Google)
2024-04-15 12:53 ` [PATCH v9 21/36] function_graph: Pass ftrace_regs to entryfunc Masami Hiramatsu (Google)
2024-04-15 12:53 ` [PATCH v9 22/36] function_graph: Replace fgraph_ret_regs with ftrace_regs Masami Hiramatsu (Google)
2024-04-15 12:53 ` [PATCH v9 23/36] function_graph: Pass ftrace_regs to retfunc Masami Hiramatsu (Google)
2024-04-15 12:53 ` [PATCH v9 24/36] fprobe: Use ftrace_regs in fprobe entry handler Masami Hiramatsu (Google)
2024-04-15 12:53 ` [PATCH v9 25/36] fprobe: Use ftrace_regs in fprobe exit handler Masami Hiramatsu (Google)
2024-04-15 12:54 ` [PATCH v9 26/36] tracing: Add ftrace_partial_regs() for converting ftrace_regs to pt_regs Masami Hiramatsu (Google)
2024-04-15 12:54 ` [PATCH v9 27/36] tracing: Add ftrace_fill_perf_regs() for perf event Masami Hiramatsu (Google)
2024-04-15 12:54 ` [PATCH v9 28/36] tracing/fprobe: Enable fprobe events with CONFIG_DYNAMIC_FTRACE_WITH_ARGS Masami Hiramatsu (Google)
2024-04-15 12:54 ` [PATCH v9 29/36] bpf: Enable kprobe_multi feature if CONFIG_FPROBE is enabled Masami Hiramatsu (Google)
2024-04-25 20:09   ` Andrii Nakryiko
2024-04-29 14:57     ` Masami Hiramatsu
2024-04-15 12:54 ` [PATCH v9 30/36] ftrace: Add CONFIG_HAVE_FTRACE_GRAPH_FUNC Masami Hiramatsu (Google)
2024-04-15 12:55 ` [PATCH v9 31/36] fprobe: Rewrite fprobe on function-graph tracer Masami Hiramatsu (Google)
2024-04-15 12:55 ` [PATCH v9 32/36] tracing/fprobe: Remove nr_maxactive from fprobe Masami Hiramatsu (Google)
2024-04-15 12:55 ` [PATCH v9 33/36] selftests: ftrace: Remove obsolate maxactive syntax check Masami Hiramatsu (Google)
2024-04-15 12:55 ` [PATCH v9 34/36] selftests/ftrace: Add a test case for repeating register/unregister fprobe Masami Hiramatsu (Google)
2024-04-15 12:55 ` [PATCH v9 35/36] Documentation: probes: Update fprobe on function-graph tracer Masami Hiramatsu (Google)
2024-04-15 12:55 ` [PATCH v9 36/36] fgraph: Skip recording calltime/rettime if it is not nneeded Masami Hiramatsu (Google)
2024-04-25 20:15   ` Andrii Nakryiko
2024-04-29 14:56     ` Masami Hiramatsu
2024-04-19  5:36 ` [PATCH v9 00/36] tracing: fprobe: function_graph: Multi-function graph and fprobe on fgraph Masami Hiramatsu
2024-04-19  8:01   ` Steven Rostedt
2024-04-24 13:35 ` Florent Revest
2024-04-25 15:10   ` Masami Hiramatsu
2024-04-25 20:31 ` Andrii Nakryiko
2024-04-28 23:25   ` Steven Rostedt
2024-04-29 20:28     ` Andrii Nakryiko
2024-04-29 13:51   ` Masami Hiramatsu
2024-04-29 20:25     ` Andrii Nakryiko
2024-04-30 13:32       ` Masami Hiramatsu
2024-04-30 16:29         ` Andrii Nakryiko
2024-05-02  2:06           ` Masami Hiramatsu [this message]
2024-05-07 21:04             ` Andrii Nakryiko

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20240502110610.412d54a0cf194293b82ee787@kernel.org \
    --to=mhiramat@kernel.org \
    --cc=acme@kernel.org \
    --cc=alan.maguire@oracle.com \
    --cc=alexei.starovoitov@gmail.com \
    --cc=andrii.nakryiko@gmail.com \
    --cc=ast@kernel.org \
    --cc=bpf@vger.kernel.org \
    --cc=daniel@iogearbox.net \
    --cc=guoren@kernel.org \
    --cc=jolsa@kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-trace-kernel@vger.kernel.org \
    --cc=mark.rutland@arm.com \
    --cc=martin.lau@linux.dev \
    --cc=peterz@infradead.org \
    --cc=revest@chromium.org \
    --cc=rostedt@goodmis.org \
    --cc=svens@linux.ibm.com \
    --cc=tglx@linutronix.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox