public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
* The same symbol is printed twice when use tracepoint to get stack
@ 2026-01-14 15:09 Tao Chen
  2026-01-14 17:35 ` Alan Maguire
  0 siblings, 1 reply; 4+ messages in thread
From: Tao Chen @ 2026-01-14 15:09 UTC (permalink / raw)
  To: Alexei Starovoitov, Andrii Nakryiko, Eduard Zingerman, Song Liu,
	Yonghong Song, Jiri Olsa, LKML, bpf

Hi guys,

When using tracepoints to retrieve stack information, I observed that 
perf_trace_sched_migrate_task was printed twice. And the issue also 
occurs with tools using libbpf.

sudo bpftrace -e '
tracepoint:sched:sched_migrate_task {
printf("Task %s migrated by:\n", args->comm);
print(kstack);
}'

Task kcompactd0 migrated by:

         perf_trace_sched_migrate_task+9
         perf_trace_sched_migrate_task+9
         set_task_cpu+353
         detach_task+77
         detach_tasks+281
         sched_balance_rq+452
         sched_balance_newidle+504
         pick_next_task_fair+84
         __pick_next_task+66
         pick_next_task+43
         __schedule+332
         schedule+41
         schedule_hrtimeout_range+239
         do_poll.constprop.0+668
         do_sys_poll+499
         __x64_sys_ppoll+220
         x64_sys_call+5722
         do_syscall_64+126
         entry_SYSCALL_64_after_hwframe+118

Task jbd2/sda2-8 migrated by:

         perf_trace_sched_migrate_task+9
         perf_trace_sched_migrate_task+9
         set_task_cpu+353
         try_to_wake_up+365
         default_wake_function+26
         autoremove_wake_function+18
         __wake_up_common+118
         __wake_up+55
         __jbd2_log_start_commit+195

env:
bpftrace v0.21.2
ubuntu24.04,6.14.0-36-generic

The issue is as follows:
https://github.com/bpftrace/bpftrace/issues/4949


It seems that there is no special handling in the kernel.
Does anyone has thoughts on this issue. Thanks.

BPF_CALL_4(bpf_get_stack_raw_tp, struct bpf_raw_tracepoint_args *, args,
            void *, buf, u32, size, u64, flags)
{
         struct pt_regs *regs = get_bpf_raw_tp_regs();
         int ret;

         if (IS_ERR(regs))
                 return PTR_ERR(regs);

         perf_fetch_caller_regs(regs);
         ret = bpf_get_stack((unsigned long) regs, (unsigned long) buf,
                             (unsigned long) size, flags, 0);
         put_bpf_raw_tp_regs();
         return ret;
}

-- 
Best Regards
Tao Chen


^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: The same symbol is printed twice when use tracepoint to get stack
  2026-01-14 15:09 The same symbol is printed twice when use tracepoint to get stack Tao Chen
@ 2026-01-14 17:35 ` Alan Maguire
  2026-01-14 21:06   ` Jiri Olsa
  0 siblings, 1 reply; 4+ messages in thread
From: Alan Maguire @ 2026-01-14 17:35 UTC (permalink / raw)
  To: Tao Chen, Alexei Starovoitov, Andrii Nakryiko, Eduard Zingerman,
	Song Liu, Yonghong Song, Jiri Olsa, LKML, bpf

On 14/01/2026 15:09, Tao Chen wrote:
> Hi guys,
> 
> When using tracepoints to retrieve stack information, I observed that perf_trace_sched_migrate_task was printed twice. And the issue also occurs with tools using libbpf.
>

You may need the fix Jiri provided for x86_64 [1]. Eugene mentioned that
the issue persists for arm64 however [2].

Alan

[1] https://lore.kernel.org/bpf/20251104215405.168643-2-jolsa@kernel.org/
[2] https://lore.kernel.org/all/a38fed68-67bc-98ce-8e12-743342121ae3@oracle.com/
 
> sudo bpftrace -e '
> tracepoint:sched:sched_migrate_task {
> printf("Task %s migrated by:\n", args->comm);
> print(kstack);
> }'
> 
> Task kcompactd0 migrated by:
> 
>         perf_trace_sched_migrate_task+9
>         perf_trace_sched_migrate_task+9
>         set_task_cpu+353
>         detach_task+77
>         detach_tasks+281
>         sched_balance_rq+452
>         sched_balance_newidle+504
>         pick_next_task_fair+84
>         __pick_next_task+66
>         pick_next_task+43
>         __schedule+332
>         schedule+41
>         schedule_hrtimeout_range+239
>         do_poll.constprop.0+668
>         do_sys_poll+499
>         __x64_sys_ppoll+220
>         x64_sys_call+5722
>         do_syscall_64+126
>         entry_SYSCALL_64_after_hwframe+118
> 
> Task jbd2/sda2-8 migrated by:
> 
>         perf_trace_sched_migrate_task+9
>         perf_trace_sched_migrate_task+9
>         set_task_cpu+353
>         try_to_wake_up+365
>         default_wake_function+26
>         autoremove_wake_function+18
>         __wake_up_common+118
>         __wake_up+55
>         __jbd2_log_start_commit+195
> 
> env:
> bpftrace v0.21.2
> ubuntu24.04,6.14.0-36-generic
> 
> The issue is as follows:
> https://github.com/bpftrace/bpftrace/issues/4949
> 
> 
> It seems that there is no special handling in the kernel.
> Does anyone has thoughts on this issue. Thanks.
> 
> BPF_CALL_4(bpf_get_stack_raw_tp, struct bpf_raw_tracepoint_args *, args,
>            void *, buf, u32, size, u64, flags)
> {
>         struct pt_regs *regs = get_bpf_raw_tp_regs();
>         int ret;
> 
>         if (IS_ERR(regs))
>                 return PTR_ERR(regs);
> 
>         perf_fetch_caller_regs(regs);
>         ret = bpf_get_stack((unsigned long) regs, (unsigned long) buf,
>                             (unsigned long) size, flags, 0);
>         put_bpf_raw_tp_regs();
>         return ret;
> }
> 


^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: The same symbol is printed twice when use tracepoint to get stack
  2026-01-14 17:35 ` Alan Maguire
@ 2026-01-14 21:06   ` Jiri Olsa
  2026-01-15  2:18     ` Tao Chen
  0 siblings, 1 reply; 4+ messages in thread
From: Jiri Olsa @ 2026-01-14 21:06 UTC (permalink / raw)
  To: Alan Maguire
  Cc: Tao Chen, Alexei Starovoitov, Andrii Nakryiko, Eduard Zingerman,
	Song Liu, Yonghong Song, LKML, bpf

On Wed, Jan 14, 2026 at 05:35:45PM +0000, Alan Maguire wrote:
> On 14/01/2026 15:09, Tao Chen wrote:
> > Hi guys,
> > 
> > When using tracepoints to retrieve stack information, I observed that perf_trace_sched_migrate_task was printed twice. And the issue also occurs with tools using libbpf.
> >
> 
> You may need the fix Jiri provided for x86_64 [1]. Eugene mentioned that
> the issue persists for arm64 however [2].

yep, there's also follow patchset up for kprobe multi [1]

jirka


[1] https://lore.kernel.org/bpf/20260112214940.1222115-1-jolsa@kernel.org/

> 
> Alan
> 
> [1] https://lore.kernel.org/bpf/20251104215405.168643-2-jolsa@kernel.org/
> [2] https://lore.kernel.org/all/a38fed68-67bc-98ce-8e12-743342121ae3@oracle.com/
>  
> > sudo bpftrace -e '
> > tracepoint:sched:sched_migrate_task {
> > printf("Task %s migrated by:\n", args->comm);
> > print(kstack);
> > }'
> > 
> > Task kcompactd0 migrated by:
> > 
> >         perf_trace_sched_migrate_task+9
> >         perf_trace_sched_migrate_task+9
> >         set_task_cpu+353
> >         detach_task+77
> >         detach_tasks+281
> >         sched_balance_rq+452
> >         sched_balance_newidle+504
> >         pick_next_task_fair+84
> >         __pick_next_task+66
> >         pick_next_task+43
> >         __schedule+332
> >         schedule+41
> >         schedule_hrtimeout_range+239
> >         do_poll.constprop.0+668
> >         do_sys_poll+499
> >         __x64_sys_ppoll+220
> >         x64_sys_call+5722
> >         do_syscall_64+126
> >         entry_SYSCALL_64_after_hwframe+118
> > 
> > Task jbd2/sda2-8 migrated by:
> > 
> >         perf_trace_sched_migrate_task+9
> >         perf_trace_sched_migrate_task+9
> >         set_task_cpu+353
> >         try_to_wake_up+365
> >         default_wake_function+26
> >         autoremove_wake_function+18
> >         __wake_up_common+118
> >         __wake_up+55
> >         __jbd2_log_start_commit+195
> > 
> > env:
> > bpftrace v0.21.2
> > ubuntu24.04,6.14.0-36-generic
> > 
> > The issue is as follows:
> > https://github.com/bpftrace/bpftrace/issues/4949
> > 
> > 
> > It seems that there is no special handling in the kernel.
> > Does anyone has thoughts on this issue. Thanks.
> > 
> > BPF_CALL_4(bpf_get_stack_raw_tp, struct bpf_raw_tracepoint_args *, args,
> >            void *, buf, u32, size, u64, flags)
> > {
> >         struct pt_regs *regs = get_bpf_raw_tp_regs();
> >         int ret;
> > 
> >         if (IS_ERR(regs))
> >                 return PTR_ERR(regs);
> > 
> >         perf_fetch_caller_regs(regs);
> >         ret = bpf_get_stack((unsigned long) regs, (unsigned long) buf,
> >                             (unsigned long) size, flags, 0);
> >         put_bpf_raw_tp_regs();
> >         return ret;
> > }
> > 
> 

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: The same symbol is printed twice when use tracepoint to get stack
  2026-01-14 21:06   ` Jiri Olsa
@ 2026-01-15  2:18     ` Tao Chen
  0 siblings, 0 replies; 4+ messages in thread
From: Tao Chen @ 2026-01-15  2:18 UTC (permalink / raw)
  To: Jiri Olsa, Alan Maguire
  Cc: Alexei Starovoitov, Andrii Nakryiko, Eduard Zingerman, Song Liu,
	Yonghong Song, LKML, bpf

在 2026/1/15 05:06, Jiri Olsa 写道:
> On Wed, Jan 14, 2026 at 05:35:45PM +0000, Alan Maguire wrote:
>> On 14/01/2026 15:09, Tao Chen wrote:
>>> Hi guys,
>>>
>>> When using tracepoints to retrieve stack information, I observed that perf_trace_sched_migrate_task was printed twice. And the issue also occurs with tools using libbpf.
>>>
>>
>> You may need the fix Jiri provided for x86_64 [1]. Eugene mentioned that
>> the issue persists for arm64 however [2].
> 
> yep, there's also follow patchset up for kprobe multi [1]
> 
> jirka
> 
> 
> [1] https://lore.kernel.org/bpf/20260112214940.1222115-1-jolsa@kernel.org/
> 
>>
>> Alan
>>
>> [1] https://lore.kernel.org/bpf/20251104215405.168643-2-jolsa@kernel.org/
>> [2] https://lore.kernel.org/all/a38fed68-67bc-98ce-8e12-743342121ae3@oracle.com/
>>   
>>> sudo bpftrace -e '
>>> tracepoint:sched:sched_migrate_task {
>>> printf("Task %s migrated by:\n", args->comm);
>>> print(kstack);
>>> }'
>>>
>>> Task kcompactd0 migrated by:
>>>
>>>          perf_trace_sched_migrate_task+9
>>>          perf_trace_sched_migrate_task+9
>>>          set_task_cpu+353
>>>          detach_task+77
>>>          detach_tasks+281
>>>          sched_balance_rq+452
>>>          sched_balance_newidle+504
>>>          pick_next_task_fair+84
>>>          __pick_next_task+66
>>>          pick_next_task+43
>>>          __schedule+332
>>>          schedule+41
>>>          schedule_hrtimeout_range+239
>>>          do_poll.constprop.0+668
>>>          do_sys_poll+499
>>>          __x64_sys_ppoll+220
>>>          x64_sys_call+5722
>>>          do_syscall_64+126
>>>          entry_SYSCALL_64_after_hwframe+118
>>>
>>> Task jbd2/sda2-8 migrated by:
>>>
>>>          perf_trace_sched_migrate_task+9
>>>          perf_trace_sched_migrate_task+9
>>>          set_task_cpu+353
>>>          try_to_wake_up+365
>>>          default_wake_function+26
>>>          autoremove_wake_function+18
>>>          __wake_up_common+118
>>>          __wake_up+55
>>>          __jbd2_log_start_commit+195
>>>
>>> env:
>>> bpftrace v0.21.2
>>> ubuntu24.04,6.14.0-36-generic
>>>
>>> The issue is as follows:
>>> https://github.com/bpftrace/bpftrace/issues/4949
>>>
>>>
>>> It seems that there is no special handling in the kernel.
>>> Does anyone has thoughts on this issue. Thanks.
>>>
>>> BPF_CALL_4(bpf_get_stack_raw_tp, struct bpf_raw_tracepoint_args *, args,
>>>             void *, buf, u32, size, u64, flags)
>>> {
>>>          struct pt_regs *regs = get_bpf_raw_tp_regs();
>>>          int ret;
>>>
>>>          if (IS_ERR(regs))
>>>                  return PTR_ERR(regs);
>>>
>>>          perf_fetch_caller_regs(regs);
>>>          ret = bpf_get_stack((unsigned long) regs, (unsigned long) buf,
>>>                              (unsigned long) size, flags, 0);
>>>          put_bpf_raw_tp_regs();
>>>          return ret;
>>> }
>>>
>>

Alan, Jiri

Thanks for your reply, i see.

-- 
Best Regards
Tao Chen

^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2026-01-15  2:19 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2026-01-14 15:09 The same symbol is printed twice when use tracepoint to get stack Tao Chen
2026-01-14 17:35 ` Alan Maguire
2026-01-14 21:06   ` Jiri Olsa
2026-01-15  2:18     ` Tao Chen

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox