From: Namhyung Kim <namhyung@kernel.org>
To: Ian Rogers <irogers@google.com>
Cc: sashiko-reviews@lists.linux.dev,
linux-perf-users@vger.kernel.org, bpf@vger.kernel.org
Subject: Re: [PATCH v5 10/14] perf pmu-events: Split big_c_string storage into standalone compilation unit
Date: Sun, 17 May 2026 18:41:14 -0700 [thread overview]
Message-ID: <agpuOvZvo_HNnYsr@z2> (raw)
In-Reply-To: <CAP-5=fXM_bGY8uiVa-U9SiFrwY+Dxkrt=s66dfoL9YR7=14Edg@mail.gmail.com>
On Fri, May 15, 2026 at 04:25:29PM -0700, Ian Rogers wrote:
> On Fri, May 15, 2026 at 12:58 PM <sashiko-bot@kernel.org> wrote:
> >
> > Thank you for your contribution! Sashiko AI review found 1 potential issue(s) to consider:
> > - [Medium] Incremental build breakage and partial clean failure due to Makefile dependency chaining and Python file closing order.
> > --
> >
> > commit 6c014984ddc9092cbb7ef975a3904baefa427ed5
> > Author: Ian Rogers <irogers@google.com>
> >
> > perf pmu-events: Split big_c_string storage into standalone compilation unit
> >
> > This commit splits the large big_c_string literal into a dedicated
> > pmu-events-string.c file to allow parallel compilation during Kbuild.
> > It updates jevents.py to output both files and adjusts the Makefile
> > dependencies to ensure jevents.py is only executed once.
> >
> > > In jevents.py, defer closing output_string_file until
> > > the absolute tail of main() to guarantee identical modification timestamps
> > > with output_file, preventing redundant rebuilds during incremental runs.
> >
> > Is this guarantee accurate? Since output_file is never explicitly closed
> > in main(), it gets flushed and closed automatically during Python
> > interpreter shutdown, strictly after main() returns.
> >
> > Will this result in pmu-events.c having a slightly newer modification
> > timestamp than pmu-events-string.c on filesystems with nanosecond
> > resolution?
>
> So previously we were worried about the opposite scenario. Using &:
> for a group of generated files solves the problem but Linux builds
> only require GNU make 4.0 not 4.3, which added this group construct.
> We may need to drop this change as I don't see a way to satisfy
> Sashiko.
Isn't the message at the end a proposed solution by Sashiko to satisfy
the problem? See below ...
> > > diff --git a/tools/perf/pmu-events/Build b/tools/perf/pmu-events/Build
> > > --- a/tools/perf/pmu-events/Build
> > > +++ b/tools/perf/pmu-events/Build
> >
> > [ ... ]
> >
> > > @@ -224,6 +234,10 @@ endif
> > > # and inputs are dependencies.
> > > $(PMU_EVENTS_C): $(JEVENTS_DEPS)
> > > $(call rule_mkdir)
> > > - $(Q)$(call echo-cmd,gen)$(PYTHON) $(JEVENTS_PY) $(JEVENTS_ARCH) $(JEVENTS_MODEL) $(OUT_DIR) $@
> > > + $(Q)$(call echo-cmd,gen)$(PYTHON) $(JEVENTS_PY) $(JEVENTS_ARCH) $(JEVENTS_MODEL) \
> > > + $(OUT_DIR) $(PMU_EVENTS_C) $(PMU_EVENTS_STRING_C)
> > > +
> > > +$(PMU_EVENTS_STRING_C): $(PMU_EVENTS_C)
> > > + @:
> >
> > If pmu-events.c consistently ends up newer than pmu-events-string.c
> > due to the Python teardown order, won't Make permanently see
> > pmu-events-string.c as out-of-date?
> >
> > Could this silently trigger redundant recompilations of pmu-events-string.o
> > and relinking of perf on every incremental build?
> >
> > Additionally, if pmu-events-string.c is deleted while pmu-events.c
> > remains up-to-date, Make will execute this dummy recipe and then attempt
> > to compile a missing file. Does this pattern handle partial cleanups
> > gracefully without creating a build regression?
> >
> > > diff --git a/tools/perf/pmu-events/jevents.py b/tools/perf/pmu-events/jevents.py
> > > --- a/tools/perf/pmu-events/jevents.py
> > > +++ b/tools/perf/pmu-events/jevents.py
> >
> > [ ... ]
> >
> > > @@ -1476,6 +1488,8 @@ struct pmu_table_entry {
> > > print_mapping_table(archs)
> > > print_system_mapping_table()
> > > print_metricgroups()
> > > + if _args.output_string_file:
> > > + _args.output_string_file.close()
> > >
> > > if __name__ == '__main__':
> > > main()
> >
> > Should _args.output_file.close() be added here alongside
> > output_string_file.close() to ensure their final filesystem writes happen
> > simultaneously before interpreter shutdown?
... here. Or, maybe you can call os.utime().
Thanks,
Namhyung
next prev parent reply other threads:[~2026-05-18 1:41 UTC|newest]
Thread overview: 164+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-05-12 5:35 [PATCH v1 00/14] perf build: Reduce build time by one third Ian Rogers
2026-05-12 5:35 ` [PATCH v1 01/14] bpftool build: Restrict feature tests during bootstrap compilation Ian Rogers
2026-05-12 5:35 ` [PATCH v1 02/14] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-13 5:21 ` sashiko-bot
2026-05-12 5:35 ` [PATCH v1 03/14] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-12 5:35 ` [PATCH v1 04/14] perf build: Remove empty archheaders target Ian Rogers
2026-05-12 5:35 ` [PATCH v1 05/14] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-13 19:52 ` sashiko-bot
2026-05-12 5:35 ` [PATCH v1 06/14] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-13 20:09 ` sashiko-bot
2026-05-12 5:35 ` [PATCH v1 07/14] perf build: Move static libbpf dependency out of prepare step Ian Rogers
2026-05-13 20:36 ` sashiko-bot
2026-05-12 5:35 ` [PATCH v1 08/14] perf build: Pre-generate BPF skeletons during umbrella prepare phase Ian Rogers
2026-05-12 5:35 ` [PATCH v1 09/14] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-13 21:11 ` sashiko-bot
2026-05-12 5:35 ` [PATCH v1 10/14] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-12 5:35 ` [PATCH v1 11/14] tools build: Integrate libdebuginfod into test-all fast path Ian Rogers
2026-05-13 21:40 ` sashiko-bot
2026-05-12 5:35 ` [PATCH v1 12/14] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-13 21:56 ` sashiko-bot
2026-05-12 5:35 ` [PATCH v1 13/14] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-13 22:18 ` sashiko-bot
2026-05-12 5:35 ` [PATCH v1 14/14] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-12 17:46 ` [PATCH v2 00/18] perf build: Reduce build time by nearly half Ian Rogers
2026-05-12 17:46 ` [PATCH v2 01/18] bpftool build: Restrict feature tests during bootstrap compilation Ian Rogers
2026-05-12 17:46 ` [PATCH v2 02/18] tools build: Integrate libdebuginfod into test-all fast path Ian Rogers
2026-05-13 23:59 ` sashiko-bot
2026-05-12 17:46 ` [PATCH v2 03/18] tools build: Fix test-clang-bpf-co-re.bin to generate target file Ian Rogers
2026-05-14 0:15 ` sashiko-bot
2026-05-12 17:46 ` [PATCH v2 04/18] tools scripts: Short-circuit CC_NO_CLANG compiler probe in Makefile.include Ian Rogers
2026-05-14 0:28 ` sashiko-bot
2026-05-12 17:46 ` [PATCH v2 05/18] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-14 0:50 ` sashiko-bot
2026-05-12 17:46 ` [PATCH v2 06/18] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-12 17:46 ` [PATCH v2 07/18] perf build: Remove empty archheaders target Ian Rogers
2026-05-12 17:46 ` [PATCH v2 08/18] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-14 1:55 ` sashiko-bot
2026-05-12 17:46 ` [PATCH v2 09/18] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-12 17:46 ` [PATCH v2 10/18] perf build: Move static libbpf dependency out of prepare step Ian Rogers
2026-05-14 3:02 ` sashiko-bot
2026-05-12 17:46 ` [PATCH v2 11/18] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-14 3:39 ` sashiko-bot
2026-05-12 17:46 ` [PATCH v2 12/18] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-12 17:46 ` [PATCH v2 13/18] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-12 17:46 ` [PATCH v2 14/18] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-14 4:35 ` sashiko-bot
2026-05-12 17:46 ` [PATCH v2 15/18] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-14 5:06 ` sashiko-bot
2026-05-12 17:46 ` [PATCH v2 16/18] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-12 17:46 ` [PATCH v2 17/18] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-12 17:46 ` [PATCH v2 18/18] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-14 16:33 ` [PATCH v3 00/17] perf build: Reduce build time by nearly half Ian Rogers
2026-05-14 16:33 ` [PATCH v3 01/17] bpftool build: Restrict feature tests during bootstrap compilation Ian Rogers
2026-05-14 16:33 ` [PATCH v3 02/17] tools build: Integrate libdebuginfod into test-all fast path Ian Rogers
2026-05-14 20:55 ` sashiko-bot
2026-05-14 16:33 ` [PATCH v3 03/17] tools build: Fix test-clang-bpf-co-re.bin to generate target file Ian Rogers
2026-05-14 21:10 ` sashiko-bot
2026-05-14 16:33 ` [PATCH v3 04/17] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-14 16:33 ` [PATCH v3 05/17] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-14 16:33 ` [PATCH v3 06/17] perf build: Remove empty archheaders target Ian Rogers
2026-05-14 16:33 ` [PATCH v3 07/17] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-14 16:34 ` [PATCH v3 08/17] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-14 16:34 ` [PATCH v3 09/17] perf build: Move static libbpf dependency out of prepare step Ian Rogers
2026-05-14 23:35 ` sashiko-bot
2026-05-14 16:34 ` [PATCH v3 10/17] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-14 23:45 ` sashiko-bot
2026-05-14 16:34 ` [PATCH v3 11/17] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-14 16:34 ` [PATCH v3 12/17] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-14 16:34 ` [PATCH v3 13/17] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-15 0:39 ` sashiko-bot
2026-05-14 16:34 ` [PATCH v3 14/17] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-15 1:00 ` sashiko-bot
2026-05-14 16:34 ` [PATCH v3 15/17] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-14 16:34 ` [PATCH v3 16/17] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-14 16:34 ` [PATCH v3 17/17] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-14 22:06 ` [PATCH v3 00/17] perf build: Reduce build time by nearly half Namhyung Kim
2026-05-14 22:23 ` Ian Rogers
2026-05-15 16:20 ` Ian Rogers
2026-05-15 17:38 ` [PATCH v4 00/14] " Ian Rogers
2026-05-15 17:38 ` [PATCH v4 01/14] tools build: Fix feature checks to touch target files on success Ian Rogers
2026-05-15 18:04 ` sashiko-bot
2026-05-15 17:38 ` [PATCH v4 02/14] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-15 18:45 ` Namhyung Kim
2026-05-15 17:38 ` [PATCH v4 03/14] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-15 17:38 ` [PATCH v4 04/14] perf build: Remove empty archheaders target Ian Rogers
2026-05-15 17:38 ` [PATCH v4 05/14] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-15 17:38 ` [PATCH v4 06/14] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-15 17:38 ` [PATCH v4 07/14] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-15 17:38 ` [PATCH v4 08/14] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-15 18:30 ` sashiko-bot
2026-05-15 17:38 ` [PATCH v4 09/14] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-15 17:38 ` [PATCH v4 10/14] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-15 18:09 ` sashiko-bot
2026-05-15 17:38 ` [PATCH v4 11/14] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-15 18:32 ` sashiko-bot
2026-05-15 19:41 ` Namhyung Kim
2026-05-15 23:05 ` Ian Rogers
2026-05-18 0:52 ` Namhyung Kim
2026-05-18 2:33 ` Ian Rogers
2026-05-18 6:12 ` Namhyung Kim
2026-05-15 17:38 ` [PATCH v4 12/14] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-15 19:48 ` Namhyung Kim
2026-05-15 17:38 ` [PATCH v4 13/14] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-15 17:38 ` [PATCH v4 14/14] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-15 19:33 ` [PATCH v5 00/14] perf build: Reduce build time by nearly half Ian Rogers
2026-05-15 19:33 ` [PATCH v5 01/14] tools build: Fix feature checks to touch target files on success Ian Rogers
2026-05-15 19:33 ` [PATCH v5 02/14] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-15 19:33 ` [PATCH v5 03/14] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-15 19:33 ` [PATCH v5 04/14] perf build: Remove empty archheaders target Ian Rogers
2026-05-15 19:33 ` [PATCH v5 05/14] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-15 19:33 ` [PATCH v5 06/14] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-15 19:33 ` [PATCH v5 07/14] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-15 19:33 ` [PATCH v5 08/14] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-15 19:53 ` sashiko-bot
2026-05-15 23:27 ` Ian Rogers
2026-05-15 19:33 ` [PATCH v5 09/14] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-15 19:33 ` [PATCH v5 10/14] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-15 19:58 ` sashiko-bot
2026-05-15 23:25 ` Ian Rogers
2026-05-18 1:41 ` Namhyung Kim [this message]
2026-05-18 2:50 ` Ian Rogers
2026-05-15 19:33 ` [PATCH v5 11/14] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-15 20:22 ` sashiko-bot
2026-05-15 19:33 ` [PATCH v5 12/14] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-15 19:33 ` [PATCH v5 13/14] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-15 19:33 ` [PATCH v5 14/14] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-15 23:32 ` [PATCH v5 00/14] perf build: Reduce build time by nearly half Ian Rogers
2026-05-18 4:47 ` [PATCH v6 " Ian Rogers
2026-05-18 4:47 ` [PATCH v6 01/14] tools build: Fix feature checks to touch target files on success Ian Rogers
2026-05-18 4:47 ` [PATCH v6 02/14] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-18 4:47 ` [PATCH v6 03/14] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-18 4:47 ` [PATCH v6 04/14] perf build: Remove empty archheaders target Ian Rogers
2026-05-18 4:47 ` [PATCH v6 05/14] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-18 4:47 ` [PATCH v6 06/14] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-18 4:47 ` [PATCH v6 07/14] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-18 4:47 ` [PATCH v6 08/14] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-18 4:47 ` [PATCH v6 09/14] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-18 4:47 ` [PATCH v6 10/14] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-18 4:47 ` [PATCH v6 11/14] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-18 4:47 ` [PATCH v6 12/14] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-18 4:47 ` [PATCH v6 13/14] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-18 4:47 ` [PATCH v6 14/14] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-18 15:46 ` [PATCH v7 00/14] perf build: Reduce build time by nearly half Ian Rogers
2026-05-18 15:46 ` [PATCH v7 01/14] tools build: Fix feature checks to touch target files on success Ian Rogers
2026-05-18 15:46 ` [PATCH v7 02/14] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-18 15:46 ` [PATCH v7 03/14] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-18 15:46 ` [PATCH v7 04/14] perf build: Remove empty archheaders target Ian Rogers
2026-05-18 15:46 ` [PATCH v7 05/14] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-18 15:46 ` [PATCH v7 06/14] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-18 15:46 ` [PATCH v7 07/14] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-18 15:46 ` [PATCH v7 08/14] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-18 15:46 ` [PATCH v7 09/14] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-18 15:46 ` [PATCH v7 10/14] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-18 15:46 ` [PATCH v7 11/14] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-18 15:46 ` [PATCH v7 12/14] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-18 15:46 ` [PATCH v7 13/14] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-18 15:46 ` [PATCH v7 14/14] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-19 18:27 ` [PATCH v7 00/14] perf build: Reduce build time by nearly half Namhyung Kim
2026-05-19 18:47 ` Ian Rogers
2026-05-19 18:49 ` Arnaldo Carvalho de Melo
2026-05-19 18:53 ` Ian Rogers
2026-05-20 0:18 ` Namhyung Kim
2026-05-15 18:20 ` [PATCH v3 00/17] " Namhyung Kim
2026-05-12 9:36 ` [PATCH v1 00/14] perf build: Reduce build time by one third James Clark
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=agpuOvZvo_HNnYsr@z2 \
--to=namhyung@kernel.org \
--cc=bpf@vger.kernel.org \
--cc=irogers@google.com \
--cc=linux-perf-users@vger.kernel.org \
--cc=sashiko-reviews@lists.linux.dev \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox