* [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events
@ 2025-10-08 16:23 Ian Rogers
2025-10-09 5:58 ` Namhyung Kim
2025-10-09 7:52 ` Tengda Wu
0 siblings, 2 replies; 4+ messages in thread
From: Ian Rogers @ 2025-10-08 16:23 UTC (permalink / raw)
To: Peter Zijlstra, Ingo Molnar, Arnaldo Carvalho de Melo,
Namhyung Kim, Alexander Shishkin, Jiri Olsa, Ian Rogers,
Adrian Hunter, Tengda Wu, linux-perf-users, linux-kernel
The bperf BPF counter code doesn't handle "any"(-1) CPU events, always
wanting to aggregate a count against a CPU, which avoids the need for
atomics so let's not change that. Force evsels used for BPF counters
to require a CPU when not in system-wide mode so that the "any"(-1)
value isn't used during map propagation and evsel's CPU map matches
that of the PMU.
Fixes: b91917c0c6fa ("perf bpf_counter: Fix handling of cpumap fixing hybrid")
Signed-off-by: Ian Rogers <irogers@google.com>
---
tools/perf/builtin-stat.c | 13 +++++++++++++
tools/perf/util/bpf_counter.c | 1 +
2 files changed, 14 insertions(+)
diff --git a/tools/perf/builtin-stat.c b/tools/perf/builtin-stat.c
index 7006f848f87a..0fc6884c1bf1 100644
--- a/tools/perf/builtin-stat.c
+++ b/tools/perf/builtin-stat.c
@@ -2540,6 +2540,7 @@ int cmd_stat(int argc, const char **argv)
unsigned int interval, timeout;
const char * const stat_subcommands[] = { "record", "report" };
char errbuf[BUFSIZ];
+ struct evsel *counter;
setlocale(LC_ALL, "");
@@ -2797,6 +2798,18 @@ int cmd_stat(int argc, const char **argv)
evlist__warn_user_requested_cpus(evsel_list, target.cpu_list);
+ evlist__for_each_entry(evsel_list, counter) {
+ /*
+ * Setup BPF counters to require CPUs as any(-1) isn't
+ * supported. evlist__create_maps below will propagate this
+ * information to the evsels. Note, evsel__is_bperf isn't yet
+ * set up, and this change must happen early, so directly use
+ * the bpf_counter variable.
+ */
+ if (counter->bpf_counter)
+ counter->core.requires_cpu = true;
+ }
+
if (evlist__create_maps(evsel_list, &target) < 0) {
if (target__has_task(&target)) {
pr_err("Problems finding threads of monitor\n");
diff --git a/tools/perf/util/bpf_counter.c b/tools/perf/util/bpf_counter.c
index ca5d01b9017d..d3e5933b171b 100644
--- a/tools/perf/util/bpf_counter.c
+++ b/tools/perf/util/bpf_counter.c
@@ -495,6 +495,7 @@ static int bperf_reload_leader_program(struct evsel *evsel, int attr_map_fd,
* following evsel__open_per_cpu call
*/
evsel->leader_skel = skel;
+ assert(!perf_cpu_map__has_any_cpu_or_is_empty(evsel->core.cpus));
evsel__open(evsel, evsel->core.cpus, evsel->core.threads);
out:
--
2.51.0.710.ga91ca5db03-goog
^ permalink raw reply related [flat|nested] 4+ messages in thread* Re: [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events 2025-10-08 16:23 [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events Ian Rogers @ 2025-10-09 5:58 ` Namhyung Kim 2025-10-09 7:52 ` Tengda Wu 1 sibling, 0 replies; 4+ messages in thread From: Namhyung Kim @ 2025-10-09 5:58 UTC (permalink / raw) To: Ian Rogers Cc: Peter Zijlstra, Ingo Molnar, Arnaldo Carvalho de Melo, Alexander Shishkin, Jiri Olsa, Adrian Hunter, Tengda Wu, linux-perf-users, linux-kernel On Wed, Oct 08, 2025 at 09:23:47AM -0700, Ian Rogers wrote: > The bperf BPF counter code doesn't handle "any"(-1) CPU events, always > wanting to aggregate a count against a CPU, which avoids the need for > atomics so let's not change that. Force evsels used for BPF counters > to require a CPU when not in system-wide mode so that the "any"(-1) > value isn't used during map propagation and evsel's CPU map matches > that of the PMU. > > Fixes: b91917c0c6fa ("perf bpf_counter: Fix handling of cpumap fixing hybrid") > Signed-off-by: Ian Rogers <irogers@google.com> > --- > tools/perf/builtin-stat.c | 13 +++++++++++++ > tools/perf/util/bpf_counter.c | 1 + > 2 files changed, 14 insertions(+) > > diff --git a/tools/perf/builtin-stat.c b/tools/perf/builtin-stat.c > index 7006f848f87a..0fc6884c1bf1 100644 > --- a/tools/perf/builtin-stat.c > +++ b/tools/perf/builtin-stat.c > @@ -2540,6 +2540,7 @@ int cmd_stat(int argc, const char **argv) > unsigned int interval, timeout; > const char * const stat_subcommands[] = { "record", "report" }; > char errbuf[BUFSIZ]; > + struct evsel *counter; > > setlocale(LC_ALL, ""); > > @@ -2797,6 +2798,18 @@ int cmd_stat(int argc, const char **argv) > > evlist__warn_user_requested_cpus(evsel_list, target.cpu_list); > > + evlist__for_each_entry(evsel_list, counter) { > + /* > + * Setup BPF counters to require CPUs as any(-1) isn't > + * supported. evlist__create_maps below will propagate this > + * information to the evsels. Note, evsel__is_bperf isn't yet > + * set up, and this change must happen early, so directly use > + * the bpf_counter variable. > + */ > + if (counter->bpf_counter) Is it set for --bpf-counters as well? What about this? if ((counter->bpf_counter || target.use_bpf) && !target__has_cpu()) Thanks, Namhyung > + counter->core.requires_cpu = true; > + } > + > if (evlist__create_maps(evsel_list, &target) < 0) { > if (target__has_task(&target)) { > pr_err("Problems finding threads of monitor\n"); > diff --git a/tools/perf/util/bpf_counter.c b/tools/perf/util/bpf_counter.c > index ca5d01b9017d..d3e5933b171b 100644 > --- a/tools/perf/util/bpf_counter.c > +++ b/tools/perf/util/bpf_counter.c > @@ -495,6 +495,7 @@ static int bperf_reload_leader_program(struct evsel *evsel, int attr_map_fd, > * following evsel__open_per_cpu call > */ > evsel->leader_skel = skel; > + assert(!perf_cpu_map__has_any_cpu_or_is_empty(evsel->core.cpus)); > evsel__open(evsel, evsel->core.cpus, evsel->core.threads); > > out: > -- > 2.51.0.710.ga91ca5db03-goog > ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events 2025-10-08 16:23 [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events Ian Rogers 2025-10-09 5:58 ` Namhyung Kim @ 2025-10-09 7:52 ` Tengda Wu 2025-10-09 13:03 ` Ian Rogers 1 sibling, 1 reply; 4+ messages in thread From: Tengda Wu @ 2025-10-09 7:52 UTC (permalink / raw) To: Ian Rogers, Peter Zijlstra, Ingo Molnar, Arnaldo Carvalho de Melo, Namhyung Kim, Alexander Shishkin, Jiri Olsa, Adrian Hunter, linux-perf-users, linux-kernel On 2025/10/9 0:23, Ian Rogers wrote: > The bperf BPF counter code doesn't handle "any"(-1) CPU events, always > wanting to aggregate a count against a CPU, which avoids the need for > atomics so let's not change that. Force evsels used for BPF counters > to require a CPU when not in system-wide mode so that the "any"(-1) > value isn't used during map propagation and evsel's CPU map matches > that of the PMU. > > Fixes: b91917c0c6fa ("perf bpf_counter: Fix handling of cpumap fixing hybrid") > Signed-off-by: Ian Rogers <irogers@google.com> > --- > tools/perf/builtin-stat.c | 13 +++++++++++++ > tools/perf/util/bpf_counter.c | 1 + > 2 files changed, 14 insertions(+) > > diff --git a/tools/perf/builtin-stat.c b/tools/perf/builtin-stat.c > index 7006f848f87a..0fc6884c1bf1 100644 > --- a/tools/perf/builtin-stat.c > +++ b/tools/perf/builtin-stat.c > @@ -2540,6 +2540,7 @@ int cmd_stat(int argc, const char **argv) > unsigned int interval, timeout; > const char * const stat_subcommands[] = { "record", "report" }; > char errbuf[BUFSIZ]; > + struct evsel *counter; > > setlocale(LC_ALL, ""); > > @@ -2797,6 +2798,18 @@ int cmd_stat(int argc, const char **argv) > > evlist__warn_user_requested_cpus(evsel_list, target.cpu_list); > > + evlist__for_each_entry(evsel_list, counter) { > + /* > + * Setup BPF counters to require CPUs as any(-1) isn't > + * supported. evlist__create_maps below will propagate this > + * information to the evsels. Note, evsel__is_bperf isn't yet > + * set up, and this change must happen early, so directly use > + * the bpf_counter variable. > + */ > + if (counter->bpf_counter) > + counter->core.requires_cpu = true; > + } > + > if (evlist__create_maps(evsel_list, &target) < 0) { > if (target__has_task(&target)) { > pr_err("Problems finding threads of monitor\n"); > diff --git a/tools/perf/util/bpf_counter.c b/tools/perf/util/bpf_counter.c > index ca5d01b9017d..d3e5933b171b 100644 > --- a/tools/perf/util/bpf_counter.c > +++ b/tools/perf/util/bpf_counter.c > @@ -495,6 +495,7 @@ static int bperf_reload_leader_program(struct evsel *evsel, int attr_map_fd, > * following evsel__open_per_cpu call > */ > evsel->leader_skel = skel; > + assert(!perf_cpu_map__has_any_cpu_or_is_empty(evsel->core.cpus)); > evsel__open(evsel, evsel->core.cpus, evsel->core.threads); > > out: I must point out that `requires_cpu + evsel__open(evsel, evsel->core.cpus, evsel->core.threads)` is not equivalent to the original `evsel__open_per_cpu(evsel, all_cpu_map, -1)`. The former specifies a pid, while the latter does not. This will lead to inaccurate final event counting. For `evsel__open_per_cpu(evsel, all_cpu_map, -1)`: $ ./perf stat -vv --bpf-counters -e task-clock ./perf test -w sqrtloop sys_perf_event_open: pid -1 cpu 0 group_fd -1 flags 0x8 = 13 sys_perf_event_open: pid -1 cpu 1 group_fd -1 flags 0x8 = 14 sys_perf_event_open: pid -1 cpu 2 group_fd -1 flags 0x8 = 15 [...] Performance counter stats for './perf test -w sqrtloop': 1,016,156,671 task-clock # 1.000 CPUs utilized 1.016294745 seconds time elapsed 1.005710000 seconds user 0.010637000 seconds sys For `requires_cpu + evsel__open(evsel, evsel->core.cpus, evsel->core.threads)`: $ ./perf stat -vv --bpf-counters -e task-clock ./perf test -w sqrtloop sys_perf_event_open: pid 75099 cpu 0 group_fd -1 flags 0x8 = 13 sys_perf_event_open: pid 75099 cpu 1 group_fd -1 flags 0x8 = 14 sys_perf_event_open: pid 75099 cpu 2 group_fd -1 flags 0x8 = 15 [...] Performance counter stats for './perf test -w sqrtloop': 16,184,507 task-clock # 0.016 CPUs utilized 1.018540734 seconds time elapsed 1.009143000 seconds user 0.009497000 seconds sys As you can see, after specifying a pid, the task-clock count has significantly decreased. So to correct the counting, we may also need to keep the pid as -1 without specifying it. Thanks, Tengda ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events 2025-10-09 7:52 ` Tengda Wu @ 2025-10-09 13:03 ` Ian Rogers 0 siblings, 0 replies; 4+ messages in thread From: Ian Rogers @ 2025-10-09 13:03 UTC (permalink / raw) To: Tengda Wu Cc: Peter Zijlstra, Ingo Molnar, Arnaldo Carvalho de Melo, Namhyung Kim, Alexander Shishkin, Jiri Olsa, Adrian Hunter, linux-perf-users, linux-kernel On Thu, Oct 9, 2025 at 12:52 AM Tengda Wu <wutengda@huaweicloud.com> wrote: > On 2025/10/9 0:23, Ian Rogers wrote: > > The bperf BPF counter code doesn't handle "any"(-1) CPU events, always > > wanting to aggregate a count against a CPU, which avoids the need for > > atomics so let's not change that. Force evsels used for BPF counters > > to require a CPU when not in system-wide mode so that the "any"(-1) > > value isn't used during map propagation and evsel's CPU map matches > > that of the PMU. > > > > Fixes: b91917c0c6fa ("perf bpf_counter: Fix handling of cpumap fixing hybrid") > > Signed-off-by: Ian Rogers <irogers@google.com> > > --- > > tools/perf/builtin-stat.c | 13 +++++++++++++ > > tools/perf/util/bpf_counter.c | 1 + > > 2 files changed, 14 insertions(+) > > > > diff --git a/tools/perf/builtin-stat.c b/tools/perf/builtin-stat.c > > index 7006f848f87a..0fc6884c1bf1 100644 > > --- a/tools/perf/builtin-stat.c > > +++ b/tools/perf/builtin-stat.c > > @@ -2540,6 +2540,7 @@ int cmd_stat(int argc, const char **argv) > > unsigned int interval, timeout; > > const char * const stat_subcommands[] = { "record", "report" }; > > char errbuf[BUFSIZ]; > > + struct evsel *counter; > > > > setlocale(LC_ALL, ""); > > > > @@ -2797,6 +2798,18 @@ int cmd_stat(int argc, const char **argv) > > > > evlist__warn_user_requested_cpus(evsel_list, target.cpu_list); > > > > + evlist__for_each_entry(evsel_list, counter) { > > + /* > > + * Setup BPF counters to require CPUs as any(-1) isn't > > + * supported. evlist__create_maps below will propagate this > > + * information to the evsels. Note, evsel__is_bperf isn't yet > > + * set up, and this change must happen early, so directly use > > + * the bpf_counter variable. > > + */ > > + if (counter->bpf_counter) > > + counter->core.requires_cpu = true; > > + } > > + > > if (evlist__create_maps(evsel_list, &target) < 0) { > > if (target__has_task(&target)) { > > pr_err("Problems finding threads of monitor\n"); > > diff --git a/tools/perf/util/bpf_counter.c b/tools/perf/util/bpf_counter.c > > index ca5d01b9017d..d3e5933b171b 100644 > > --- a/tools/perf/util/bpf_counter.c > > +++ b/tools/perf/util/bpf_counter.c > > @@ -495,6 +495,7 @@ static int bperf_reload_leader_program(struct evsel *evsel, int attr_map_fd, > > * following evsel__open_per_cpu call > > */ > > evsel->leader_skel = skel; > > + assert(!perf_cpu_map__has_any_cpu_or_is_empty(evsel->core.cpus)); > > evsel__open(evsel, evsel->core.cpus, evsel->core.threads); > > > > out: > > > I must point out that `requires_cpu + evsel__open(evsel, evsel->core.cpus, evsel->core.threads)` > is not equivalent to the original `evsel__open_per_cpu(evsel, all_cpu_map, -1)`. The former > specifies a pid, while the latter does not. This will lead to inaccurate final event counting. > > > For `evsel__open_per_cpu(evsel, all_cpu_map, -1)`: > > $ ./perf stat -vv --bpf-counters -e task-clock ./perf test -w sqrtloop > sys_perf_event_open: pid -1 cpu 0 group_fd -1 flags 0x8 = 13 > sys_perf_event_open: pid -1 cpu 1 group_fd -1 flags 0x8 = 14 > sys_perf_event_open: pid -1 cpu 2 group_fd -1 flags 0x8 = 15 > [...] > Performance counter stats for './perf test -w sqrtloop': > > 1,016,156,671 task-clock # 1.000 CPUs utilized > > 1.016294745 seconds time elapsed > > 1.005710000 seconds user > 0.010637000 seconds sys > > > For `requires_cpu + evsel__open(evsel, evsel->core.cpus, evsel->core.threads)`: > > $ ./perf stat -vv --bpf-counters -e task-clock ./perf test -w sqrtloop > sys_perf_event_open: pid 75099 cpu 0 group_fd -1 flags 0x8 = 13 > sys_perf_event_open: pid 75099 cpu 1 group_fd -1 flags 0x8 = 14 > sys_perf_event_open: pid 75099 cpu 2 group_fd -1 flags 0x8 = 15 > [...] > Performance counter stats for './perf test -w sqrtloop': > > 16,184,507 task-clock # 0.016 CPUs utilized > > 1.018540734 seconds time elapsed > > 1.009143000 seconds user > 0.009497000 seconds sys > > > As you can see, after specifying a pid, the task-clock count has significantly decreased. > So to correct the counting, we may also need to keep the pid as -1 without specifying it. Yeah, it look like the running time is off and so the count is being scaled: ``` $ perf stat -e task-clock:b,task-clock /tmp/perf/perf test -w noploop Performance counter stats for '/tmp/perf/perf test -w noploop': 3,776,663,297 task-clock:b # 3.701 CPUs utilized (26.96%) 1,017,400,438 task-clock # 0.997 CPUs utilized 1.020467405 seconds time elapsed 1.008409000 seconds user 0.012004000 seconds sys ``` will fix in v3. Thanks, Ian > Thanks, > Tengda > ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2025-10-09 13:04 UTC | newest] Thread overview: 4+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2025-10-08 16:23 [PATCH v2] perf bpf_counter: Fix opening of "any"(-1) CPU events Ian Rogers 2025-10-09 5:58 ` Namhyung Kim 2025-10-09 7:52 ` Tengda Wu 2025-10-09 13:03 ` Ian Rogers
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).