* [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events
@ 2025-10-08 16:23 Ian Rogers
2025-10-09 5:58 ` Namhyung Kim
2025-10-09 7:52 ` Tengda Wu
0 siblings, 2 replies; 4+ messages in thread
From: Ian Rogers @ 2025-10-08 16:23 UTC (permalink / raw)
To: Peter Zijlstra, Ingo Molnar, Arnaldo Carvalho de Melo,
Namhyung Kim, Alexander Shishkin, Jiri Olsa, Ian Rogers,
Adrian Hunter, Tengda Wu, linux-perf-users, linux-kernel
The bperf BPF counter code doesn't handle "any"(-1) CPU events, always
wanting to aggregate a count against a CPU, which avoids the need for
atomics so let's not change that. Force evsels used for BPF counters
to require a CPU when not in system-wide mode so that the "any"(-1)
value isn't used during map propagation and evsel's CPU map matches
that of the PMU.
Fixes: b91917c0c6fa ("perf bpf_counter: Fix handling of cpumap fixing hybrid")
Signed-off-by: Ian Rogers <irogers@google.com>
---
tools/perf/builtin-stat.c | 13 +++++++++++++
tools/perf/util/bpf_counter.c | 1 +
2 files changed, 14 insertions(+)
diff --git a/tools/perf/builtin-stat.c b/tools/perf/builtin-stat.c
index 7006f848f87a..0fc6884c1bf1 100644
--- a/tools/perf/builtin-stat.c
+++ b/tools/perf/builtin-stat.c
@@ -2540,6 +2540,7 @@ int cmd_stat(int argc, const char **argv)
unsigned int interval, timeout;
const char * const stat_subcommands[] = { "record", "report" };
char errbuf[BUFSIZ];
+ struct evsel *counter;
setlocale(LC_ALL, "");
@@ -2797,6 +2798,18 @@ int cmd_stat(int argc, const char **argv)
evlist__warn_user_requested_cpus(evsel_list, target.cpu_list);
+ evlist__for_each_entry(evsel_list, counter) {
+ /*
+ * Setup BPF counters to require CPUs as any(-1) isn't
+ * supported. evlist__create_maps below will propagate this
+ * information to the evsels. Note, evsel__is_bperf isn't yet
+ * set up, and this change must happen early, so directly use
+ * the bpf_counter variable.
+ */
+ if (counter->bpf_counter)
+ counter->core.requires_cpu = true;
+ }
+
if (evlist__create_maps(evsel_list, &target) < 0) {
if (target__has_task(&target)) {
pr_err("Problems finding threads of monitor\n");
diff --git a/tools/perf/util/bpf_counter.c b/tools/perf/util/bpf_counter.c
index ca5d01b9017d..d3e5933b171b 100644
--- a/tools/perf/util/bpf_counter.c
+++ b/tools/perf/util/bpf_counter.c
@@ -495,6 +495,7 @@ static int bperf_reload_leader_program(struct evsel *evsel, int attr_map_fd,
* following evsel__open_per_cpu call
*/
evsel->leader_skel = skel;
+ assert(!perf_cpu_map__has_any_cpu_or_is_empty(evsel->core.cpus));
evsel__open(evsel, evsel->core.cpus, evsel->core.threads);
out:
--
2.51.0.710.ga91ca5db03-goog
^ permalink raw reply related [flat|nested] 4+ messages in thread
* Re: [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events
2025-10-08 16:23 [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events Ian Rogers
@ 2025-10-09 5:58 ` Namhyung Kim
2025-10-09 7:52 ` Tengda Wu
1 sibling, 0 replies; 4+ messages in thread
From: Namhyung Kim @ 2025-10-09 5:58 UTC (permalink / raw)
To: Ian Rogers
Cc: Peter Zijlstra, Ingo Molnar, Arnaldo Carvalho de Melo,
Alexander Shishkin, Jiri Olsa, Adrian Hunter, Tengda Wu,
linux-perf-users, linux-kernel
On Wed, Oct 08, 2025 at 09:23:47AM -0700, Ian Rogers wrote:
> The bperf BPF counter code doesn't handle "any"(-1) CPU events, always
> wanting to aggregate a count against a CPU, which avoids the need for
> atomics so let's not change that. Force evsels used for BPF counters
> to require a CPU when not in system-wide mode so that the "any"(-1)
> value isn't used during map propagation and evsel's CPU map matches
> that of the PMU.
>
> Fixes: b91917c0c6fa ("perf bpf_counter: Fix handling of cpumap fixing hybrid")
> Signed-off-by: Ian Rogers <irogers@google.com>
> ---
> tools/perf/builtin-stat.c | 13 +++++++++++++
> tools/perf/util/bpf_counter.c | 1 +
> 2 files changed, 14 insertions(+)
>
> diff --git a/tools/perf/builtin-stat.c b/tools/perf/builtin-stat.c
> index 7006f848f87a..0fc6884c1bf1 100644
> --- a/tools/perf/builtin-stat.c
> +++ b/tools/perf/builtin-stat.c
> @@ -2540,6 +2540,7 @@ int cmd_stat(int argc, const char **argv)
> unsigned int interval, timeout;
> const char * const stat_subcommands[] = { "record", "report" };
> char errbuf[BUFSIZ];
> + struct evsel *counter;
>
> setlocale(LC_ALL, "");
>
> @@ -2797,6 +2798,18 @@ int cmd_stat(int argc, const char **argv)
>
> evlist__warn_user_requested_cpus(evsel_list, target.cpu_list);
>
> + evlist__for_each_entry(evsel_list, counter) {
> + /*
> + * Setup BPF counters to require CPUs as any(-1) isn't
> + * supported. evlist__create_maps below will propagate this
> + * information to the evsels. Note, evsel__is_bperf isn't yet
> + * set up, and this change must happen early, so directly use
> + * the bpf_counter variable.
> + */
> + if (counter->bpf_counter)
Is it set for --bpf-counters as well?
What about this?
if ((counter->bpf_counter || target.use_bpf) &&
!target__has_cpu())
Thanks,
Namhyung
> + counter->core.requires_cpu = true;
> + }
> +
> if (evlist__create_maps(evsel_list, &target) < 0) {
> if (target__has_task(&target)) {
> pr_err("Problems finding threads of monitor\n");
> diff --git a/tools/perf/util/bpf_counter.c b/tools/perf/util/bpf_counter.c
> index ca5d01b9017d..d3e5933b171b 100644
> --- a/tools/perf/util/bpf_counter.c
> +++ b/tools/perf/util/bpf_counter.c
> @@ -495,6 +495,7 @@ static int bperf_reload_leader_program(struct evsel *evsel, int attr_map_fd,
> * following evsel__open_per_cpu call
> */
> evsel->leader_skel = skel;
> + assert(!perf_cpu_map__has_any_cpu_or_is_empty(evsel->core.cpus));
> evsel__open(evsel, evsel->core.cpus, evsel->core.threads);
>
> out:
> --
> 2.51.0.710.ga91ca5db03-goog
>
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events
2025-10-08 16:23 [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events Ian Rogers
2025-10-09 5:58 ` Namhyung Kim
@ 2025-10-09 7:52 ` Tengda Wu
2025-10-09 13:03 ` Ian Rogers
1 sibling, 1 reply; 4+ messages in thread
From: Tengda Wu @ 2025-10-09 7:52 UTC (permalink / raw)
To: Ian Rogers, Peter Zijlstra, Ingo Molnar, Arnaldo Carvalho de Melo,
Namhyung Kim, Alexander Shishkin, Jiri Olsa, Adrian Hunter,
linux-perf-users, linux-kernel
On 2025/10/9 0:23, Ian Rogers wrote:
> The bperf BPF counter code doesn't handle "any"(-1) CPU events, always
> wanting to aggregate a count against a CPU, which avoids the need for
> atomics so let's not change that. Force evsels used for BPF counters
> to require a CPU when not in system-wide mode so that the "any"(-1)
> value isn't used during map propagation and evsel's CPU map matches
> that of the PMU.
>
> Fixes: b91917c0c6fa ("perf bpf_counter: Fix handling of cpumap fixing hybrid")
> Signed-off-by: Ian Rogers <irogers@google.com>
> ---
> tools/perf/builtin-stat.c | 13 +++++++++++++
> tools/perf/util/bpf_counter.c | 1 +
> 2 files changed, 14 insertions(+)
>
> diff --git a/tools/perf/builtin-stat.c b/tools/perf/builtin-stat.c
> index 7006f848f87a..0fc6884c1bf1 100644
> --- a/tools/perf/builtin-stat.c
> +++ b/tools/perf/builtin-stat.c
> @@ -2540,6 +2540,7 @@ int cmd_stat(int argc, const char **argv)
> unsigned int interval, timeout;
> const char * const stat_subcommands[] = { "record", "report" };
> char errbuf[BUFSIZ];
> + struct evsel *counter;
>
> setlocale(LC_ALL, "");
>
> @@ -2797,6 +2798,18 @@ int cmd_stat(int argc, const char **argv)
>
> evlist__warn_user_requested_cpus(evsel_list, target.cpu_list);
>
> + evlist__for_each_entry(evsel_list, counter) {
> + /*
> + * Setup BPF counters to require CPUs as any(-1) isn't
> + * supported. evlist__create_maps below will propagate this
> + * information to the evsels. Note, evsel__is_bperf isn't yet
> + * set up, and this change must happen early, so directly use
> + * the bpf_counter variable.
> + */
> + if (counter->bpf_counter)
> + counter->core.requires_cpu = true;
> + }
> +
> if (evlist__create_maps(evsel_list, &target) < 0) {
> if (target__has_task(&target)) {
> pr_err("Problems finding threads of monitor\n");
> diff --git a/tools/perf/util/bpf_counter.c b/tools/perf/util/bpf_counter.c
> index ca5d01b9017d..d3e5933b171b 100644
> --- a/tools/perf/util/bpf_counter.c
> +++ b/tools/perf/util/bpf_counter.c
> @@ -495,6 +495,7 @@ static int bperf_reload_leader_program(struct evsel *evsel, int attr_map_fd,
> * following evsel__open_per_cpu call
> */
> evsel->leader_skel = skel;
> + assert(!perf_cpu_map__has_any_cpu_or_is_empty(evsel->core.cpus));
> evsel__open(evsel, evsel->core.cpus, evsel->core.threads);
>
> out:
I must point out that `requires_cpu + evsel__open(evsel, evsel->core.cpus, evsel->core.threads)`
is not equivalent to the original `evsel__open_per_cpu(evsel, all_cpu_map, -1)`. The former
specifies a pid, while the latter does not. This will lead to inaccurate final event counting.
For `evsel__open_per_cpu(evsel, all_cpu_map, -1)`:
$ ./perf stat -vv --bpf-counters -e task-clock ./perf test -w sqrtloop
sys_perf_event_open: pid -1 cpu 0 group_fd -1 flags 0x8 = 13
sys_perf_event_open: pid -1 cpu 1 group_fd -1 flags 0x8 = 14
sys_perf_event_open: pid -1 cpu 2 group_fd -1 flags 0x8 = 15
[...]
Performance counter stats for './perf test -w sqrtloop':
1,016,156,671 task-clock # 1.000 CPUs utilized
1.016294745 seconds time elapsed
1.005710000 seconds user
0.010637000 seconds sys
For `requires_cpu + evsel__open(evsel, evsel->core.cpus, evsel->core.threads)`:
$ ./perf stat -vv --bpf-counters -e task-clock ./perf test -w sqrtloop
sys_perf_event_open: pid 75099 cpu 0 group_fd -1 flags 0x8 = 13
sys_perf_event_open: pid 75099 cpu 1 group_fd -1 flags 0x8 = 14
sys_perf_event_open: pid 75099 cpu 2 group_fd -1 flags 0x8 = 15
[...]
Performance counter stats for './perf test -w sqrtloop':
16,184,507 task-clock # 0.016 CPUs utilized
1.018540734 seconds time elapsed
1.009143000 seconds user
0.009497000 seconds sys
As you can see, after specifying a pid, the task-clock count has significantly decreased.
So to correct the counting, we may also need to keep the pid as -1 without specifying it.
Thanks,
Tengda
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events
2025-10-09 7:52 ` Tengda Wu
@ 2025-10-09 13:03 ` Ian Rogers
0 siblings, 0 replies; 4+ messages in thread
From: Ian Rogers @ 2025-10-09 13:03 UTC (permalink / raw)
To: Tengda Wu
Cc: Peter Zijlstra, Ingo Molnar, Arnaldo Carvalho de Melo,
Namhyung Kim, Alexander Shishkin, Jiri Olsa, Adrian Hunter,
linux-perf-users, linux-kernel
On Thu, Oct 9, 2025 at 12:52 AM Tengda Wu <wutengda@huaweicloud.com> wrote:
> On 2025/10/9 0:23, Ian Rogers wrote:
> > The bperf BPF counter code doesn't handle "any"(-1) CPU events, always
> > wanting to aggregate a count against a CPU, which avoids the need for
> > atomics so let's not change that. Force evsels used for BPF counters
> > to require a CPU when not in system-wide mode so that the "any"(-1)
> > value isn't used during map propagation and evsel's CPU map matches
> > that of the PMU.
> >
> > Fixes: b91917c0c6fa ("perf bpf_counter: Fix handling of cpumap fixing hybrid")
> > Signed-off-by: Ian Rogers <irogers@google.com>
> > ---
> > tools/perf/builtin-stat.c | 13 +++++++++++++
> > tools/perf/util/bpf_counter.c | 1 +
> > 2 files changed, 14 insertions(+)
> >
> > diff --git a/tools/perf/builtin-stat.c b/tools/perf/builtin-stat.c
> > index 7006f848f87a..0fc6884c1bf1 100644
> > --- a/tools/perf/builtin-stat.c
> > +++ b/tools/perf/builtin-stat.c
> > @@ -2540,6 +2540,7 @@ int cmd_stat(int argc, const char **argv)
> > unsigned int interval, timeout;
> > const char * const stat_subcommands[] = { "record", "report" };
> > char errbuf[BUFSIZ];
> > + struct evsel *counter;
> >
> > setlocale(LC_ALL, "");
> >
> > @@ -2797,6 +2798,18 @@ int cmd_stat(int argc, const char **argv)
> >
> > evlist__warn_user_requested_cpus(evsel_list, target.cpu_list);
> >
> > + evlist__for_each_entry(evsel_list, counter) {
> > + /*
> > + * Setup BPF counters to require CPUs as any(-1) isn't
> > + * supported. evlist__create_maps below will propagate this
> > + * information to the evsels. Note, evsel__is_bperf isn't yet
> > + * set up, and this change must happen early, so directly use
> > + * the bpf_counter variable.
> > + */
> > + if (counter->bpf_counter)
> > + counter->core.requires_cpu = true;
> > + }
> > +
> > if (evlist__create_maps(evsel_list, &target) < 0) {
> > if (target__has_task(&target)) {
> > pr_err("Problems finding threads of monitor\n");
> > diff --git a/tools/perf/util/bpf_counter.c b/tools/perf/util/bpf_counter.c
> > index ca5d01b9017d..d3e5933b171b 100644
> > --- a/tools/perf/util/bpf_counter.c
> > +++ b/tools/perf/util/bpf_counter.c
> > @@ -495,6 +495,7 @@ static int bperf_reload_leader_program(struct evsel *evsel, int attr_map_fd,
> > * following evsel__open_per_cpu call
> > */
> > evsel->leader_skel = skel;
> > + assert(!perf_cpu_map__has_any_cpu_or_is_empty(evsel->core.cpus));
> > evsel__open(evsel, evsel->core.cpus, evsel->core.threads);
> >
> > out:
>
>
> I must point out that `requires_cpu + evsel__open(evsel, evsel->core.cpus, evsel->core.threads)`
> is not equivalent to the original `evsel__open_per_cpu(evsel, all_cpu_map, -1)`. The former
> specifies a pid, while the latter does not. This will lead to inaccurate final event counting.
>
>
> For `evsel__open_per_cpu(evsel, all_cpu_map, -1)`:
>
> $ ./perf stat -vv --bpf-counters -e task-clock ./perf test -w sqrtloop
> sys_perf_event_open: pid -1 cpu 0 group_fd -1 flags 0x8 = 13
> sys_perf_event_open: pid -1 cpu 1 group_fd -1 flags 0x8 = 14
> sys_perf_event_open: pid -1 cpu 2 group_fd -1 flags 0x8 = 15
> [...]
> Performance counter stats for './perf test -w sqrtloop':
>
> 1,016,156,671 task-clock # 1.000 CPUs utilized
>
> 1.016294745 seconds time elapsed
>
> 1.005710000 seconds user
> 0.010637000 seconds sys
>
>
> For `requires_cpu + evsel__open(evsel, evsel->core.cpus, evsel->core.threads)`:
>
> $ ./perf stat -vv --bpf-counters -e task-clock ./perf test -w sqrtloop
> sys_perf_event_open: pid 75099 cpu 0 group_fd -1 flags 0x8 = 13
> sys_perf_event_open: pid 75099 cpu 1 group_fd -1 flags 0x8 = 14
> sys_perf_event_open: pid 75099 cpu 2 group_fd -1 flags 0x8 = 15
> [...]
> Performance counter stats for './perf test -w sqrtloop':
>
> 16,184,507 task-clock # 0.016 CPUs utilized
>
> 1.018540734 seconds time elapsed
>
> 1.009143000 seconds user
> 0.009497000 seconds sys
>
>
> As you can see, after specifying a pid, the task-clock count has significantly decreased.
> So to correct the counting, we may also need to keep the pid as -1 without specifying it.
Yeah, it look like the running time is off and so the count is being scaled:
```
$ perf stat -e task-clock:b,task-clock /tmp/perf/perf test -w noploop
Performance counter stats for '/tmp/perf/perf test -w noploop':
3,776,663,297 task-clock:b # 3.701
CPUs utilized (26.96%)
1,017,400,438 task-clock # 0.997
CPUs utilized
1.020467405 seconds time elapsed
1.008409000 seconds user
0.012004000 seconds sys
```
will fix in v3.
Thanks,
Ian
> Thanks,
> Tengda
>
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2025-10-09 13:04 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2025-10-08 16:23 [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events Ian Rogers
2025-10-09 5:58 ` Namhyung Kim
2025-10-09 7:52 ` Tengda Wu
2025-10-09 13:03 ` Ian Rogers
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).