BPF List
 help / color / mirror / Atom feed
From: Namhyung Kim <namhyung@kernel.org>
To: Ian Rogers <irogers@google.com>
Cc: sashiko-reviews@lists.linux.dev,
	linux-perf-users@vger.kernel.org, bpf@vger.kernel.org
Subject: Re: [PATCH v5 10/14] perf pmu-events: Split big_c_string storage into standalone compilation unit
Date: Sun, 17 May 2026 18:41:14 -0700	[thread overview]
Message-ID: <agpuOvZvo_HNnYsr@z2> (raw)
In-Reply-To: <CAP-5=fXM_bGY8uiVa-U9SiFrwY+Dxkrt=s66dfoL9YR7=14Edg@mail.gmail.com>

On Fri, May 15, 2026 at 04:25:29PM -0700, Ian Rogers wrote:
> On Fri, May 15, 2026 at 12:58 PM <sashiko-bot@kernel.org> wrote:
> >
> > Thank you for your contribution! Sashiko AI review found 1 potential issue(s) to consider:
> > - [Medium] Incremental build breakage and partial clean failure due to Makefile dependency chaining and Python file closing order.
> > --
> >
> > commit 6c014984ddc9092cbb7ef975a3904baefa427ed5
> > Author: Ian Rogers <irogers@google.com>
> >
> > perf pmu-events: Split big_c_string storage into standalone compilation unit
> >
> > This commit splits the large big_c_string literal into a dedicated
> > pmu-events-string.c file to allow parallel compilation during Kbuild.
> > It updates jevents.py to output both files and adjusts the Makefile
> > dependencies to ensure jevents.py is only executed once.
> >
> > > In jevents.py, defer closing output_string_file until
> > > the absolute tail of main() to guarantee identical modification timestamps
> > > with output_file, preventing redundant rebuilds during incremental runs.
> >
> > Is this guarantee accurate? Since output_file is never explicitly closed
> > in main(), it gets flushed and closed automatically during Python
> > interpreter shutdown, strictly after main() returns.
> >
> > Will this result in pmu-events.c having a slightly newer modification
> > timestamp than pmu-events-string.c on filesystems with nanosecond
> > resolution?
> 
> So previously we were worried about the opposite scenario. Using &:
> for a group of generated files solves the problem but Linux builds
> only require GNU make 4.0 not 4.3, which added this group construct.
> We may need to drop this change as I don't see a way to satisfy
> Sashiko.
 
Isn't the message at the end a proposed solution by Sashiko to satisfy
the problem?  See below ...


> > > diff --git a/tools/perf/pmu-events/Build b/tools/perf/pmu-events/Build
> > > --- a/tools/perf/pmu-events/Build
> > > +++ b/tools/perf/pmu-events/Build
> >
> > [ ... ]
> >
> > > @@ -224,6 +234,10 @@ endif
> > >  # and inputs are dependencies.
> > >  $(PMU_EVENTS_C): $(JEVENTS_DEPS)
> > >       $(call rule_mkdir)
> > > -     $(Q)$(call echo-cmd,gen)$(PYTHON) $(JEVENTS_PY) $(JEVENTS_ARCH) $(JEVENTS_MODEL) $(OUT_DIR) $@
> > > +     $(Q)$(call echo-cmd,gen)$(PYTHON) $(JEVENTS_PY) $(JEVENTS_ARCH) $(JEVENTS_MODEL) \
> > > +            $(OUT_DIR) $(PMU_EVENTS_C) $(PMU_EVENTS_STRING_C)
> > > +
> > > +$(PMU_EVENTS_STRING_C): $(PMU_EVENTS_C)
> > > +     @:
> >
> > If pmu-events.c consistently ends up newer than pmu-events-string.c
> > due to the Python teardown order, won't Make permanently see
> > pmu-events-string.c as out-of-date?
> >
> > Could this silently trigger redundant recompilations of pmu-events-string.o
> > and relinking of perf on every incremental build?
> >
> > Additionally, if pmu-events-string.c is deleted while pmu-events.c
> > remains up-to-date, Make will execute this dummy recipe and then attempt
> > to compile a missing file. Does this pattern handle partial cleanups
> > gracefully without creating a build regression?
> >
> > > diff --git a/tools/perf/pmu-events/jevents.py b/tools/perf/pmu-events/jevents.py
> > > --- a/tools/perf/pmu-events/jevents.py
> > > +++ b/tools/perf/pmu-events/jevents.py
> >
> > [ ... ]
> >
> > > @@ -1476,6 +1488,8 @@ struct pmu_table_entry {
> > >    print_mapping_table(archs)
> > >    print_system_mapping_table()
> > >    print_metricgroups()
> > > +  if _args.output_string_file:
> > > +    _args.output_string_file.close()
> > >
> > >  if __name__ == '__main__':
> > >    main()
> >
> > Should _args.output_file.close() be added here alongside
> > output_string_file.close() to ensure their final filesystem writes happen
> > simultaneously before interpreter shutdown?

... here.  Or, maybe you can call os.utime().

Thanks,
Namhyung


  reply	other threads:[~2026-05-18  1:41 UTC|newest]

Thread overview: 164+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-05-12  5:35 [PATCH v1 00/14] perf build: Reduce build time by one third Ian Rogers
2026-05-12  5:35 ` [PATCH v1 01/14] bpftool build: Restrict feature tests during bootstrap compilation Ian Rogers
2026-05-12  5:35 ` [PATCH v1 02/14] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-13  5:21   ` sashiko-bot
2026-05-12  5:35 ` [PATCH v1 03/14] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-12  5:35 ` [PATCH v1 04/14] perf build: Remove empty archheaders target Ian Rogers
2026-05-12  5:35 ` [PATCH v1 05/14] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-13 19:52   ` sashiko-bot
2026-05-12  5:35 ` [PATCH v1 06/14] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-13 20:09   ` sashiko-bot
2026-05-12  5:35 ` [PATCH v1 07/14] perf build: Move static libbpf dependency out of prepare step Ian Rogers
2026-05-13 20:36   ` sashiko-bot
2026-05-12  5:35 ` [PATCH v1 08/14] perf build: Pre-generate BPF skeletons during umbrella prepare phase Ian Rogers
2026-05-12  5:35 ` [PATCH v1 09/14] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-13 21:11   ` sashiko-bot
2026-05-12  5:35 ` [PATCH v1 10/14] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-12  5:35 ` [PATCH v1 11/14] tools build: Integrate libdebuginfod into test-all fast path Ian Rogers
2026-05-13 21:40   ` sashiko-bot
2026-05-12  5:35 ` [PATCH v1 12/14] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-13 21:56   ` sashiko-bot
2026-05-12  5:35 ` [PATCH v1 13/14] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-13 22:18   ` sashiko-bot
2026-05-12  5:35 ` [PATCH v1 14/14] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-12 17:46   ` [PATCH v2 00/18] perf build: Reduce build time by nearly half Ian Rogers
2026-05-12 17:46     ` [PATCH v2 01/18] bpftool build: Restrict feature tests during bootstrap compilation Ian Rogers
2026-05-12 17:46     ` [PATCH v2 02/18] tools build: Integrate libdebuginfod into test-all fast path Ian Rogers
2026-05-13 23:59       ` sashiko-bot
2026-05-12 17:46     ` [PATCH v2 03/18] tools build: Fix test-clang-bpf-co-re.bin to generate target file Ian Rogers
2026-05-14  0:15       ` sashiko-bot
2026-05-12 17:46     ` [PATCH v2 04/18] tools scripts: Short-circuit CC_NO_CLANG compiler probe in Makefile.include Ian Rogers
2026-05-14  0:28       ` sashiko-bot
2026-05-12 17:46     ` [PATCH v2 05/18] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-14  0:50       ` sashiko-bot
2026-05-12 17:46     ` [PATCH v2 06/18] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-12 17:46     ` [PATCH v2 07/18] perf build: Remove empty archheaders target Ian Rogers
2026-05-12 17:46     ` [PATCH v2 08/18] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-14  1:55       ` sashiko-bot
2026-05-12 17:46     ` [PATCH v2 09/18] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-12 17:46     ` [PATCH v2 10/18] perf build: Move static libbpf dependency out of prepare step Ian Rogers
2026-05-14  3:02       ` sashiko-bot
2026-05-12 17:46     ` [PATCH v2 11/18] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-14  3:39       ` sashiko-bot
2026-05-12 17:46     ` [PATCH v2 12/18] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-12 17:46     ` [PATCH v2 13/18] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-12 17:46     ` [PATCH v2 14/18] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-14  4:35       ` sashiko-bot
2026-05-12 17:46     ` [PATCH v2 15/18] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-14  5:06       ` sashiko-bot
2026-05-12 17:46     ` [PATCH v2 16/18] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-12 17:46     ` [PATCH v2 17/18] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-12 17:46     ` [PATCH v2 18/18] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-14 16:33     ` [PATCH v3 00/17] perf build: Reduce build time by nearly half Ian Rogers
2026-05-14 16:33       ` [PATCH v3 01/17] bpftool build: Restrict feature tests during bootstrap compilation Ian Rogers
2026-05-14 16:33       ` [PATCH v3 02/17] tools build: Integrate libdebuginfod into test-all fast path Ian Rogers
2026-05-14 20:55         ` sashiko-bot
2026-05-14 16:33       ` [PATCH v3 03/17] tools build: Fix test-clang-bpf-co-re.bin to generate target file Ian Rogers
2026-05-14 21:10         ` sashiko-bot
2026-05-14 16:33       ` [PATCH v3 04/17] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-14 16:33       ` [PATCH v3 05/17] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-14 16:33       ` [PATCH v3 06/17] perf build: Remove empty archheaders target Ian Rogers
2026-05-14 16:33       ` [PATCH v3 07/17] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-14 16:34       ` [PATCH v3 08/17] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-14 16:34       ` [PATCH v3 09/17] perf build: Move static libbpf dependency out of prepare step Ian Rogers
2026-05-14 23:35         ` sashiko-bot
2026-05-14 16:34       ` [PATCH v3 10/17] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-14 23:45         ` sashiko-bot
2026-05-14 16:34       ` [PATCH v3 11/17] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-14 16:34       ` [PATCH v3 12/17] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-14 16:34       ` [PATCH v3 13/17] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-15  0:39         ` sashiko-bot
2026-05-14 16:34       ` [PATCH v3 14/17] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-15  1:00         ` sashiko-bot
2026-05-14 16:34       ` [PATCH v3 15/17] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-14 16:34       ` [PATCH v3 16/17] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-14 16:34       ` [PATCH v3 17/17] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-14 22:06       ` [PATCH v3 00/17] perf build: Reduce build time by nearly half Namhyung Kim
2026-05-14 22:23         ` Ian Rogers
2026-05-15 16:20           ` Ian Rogers
2026-05-15 17:38             ` [PATCH v4 00/14] " Ian Rogers
2026-05-15 17:38               ` [PATCH v4 01/14] tools build: Fix feature checks to touch target files on success Ian Rogers
2026-05-15 18:04                 ` sashiko-bot
2026-05-15 17:38               ` [PATCH v4 02/14] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-15 18:45                 ` Namhyung Kim
2026-05-15 17:38               ` [PATCH v4 03/14] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-15 17:38               ` [PATCH v4 04/14] perf build: Remove empty archheaders target Ian Rogers
2026-05-15 17:38               ` [PATCH v4 05/14] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-15 17:38               ` [PATCH v4 06/14] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-15 17:38               ` [PATCH v4 07/14] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-15 17:38               ` [PATCH v4 08/14] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-15 18:30                 ` sashiko-bot
2026-05-15 17:38               ` [PATCH v4 09/14] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-15 17:38               ` [PATCH v4 10/14] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-15 18:09                 ` sashiko-bot
2026-05-15 17:38               ` [PATCH v4 11/14] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-15 18:32                 ` sashiko-bot
2026-05-15 19:41                 ` Namhyung Kim
2026-05-15 23:05                   ` Ian Rogers
2026-05-18  0:52                     ` Namhyung Kim
2026-05-18  2:33                       ` Ian Rogers
2026-05-18  6:12                         ` Namhyung Kim
2026-05-15 17:38               ` [PATCH v4 12/14] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-15 19:48                 ` Namhyung Kim
2026-05-15 17:38               ` [PATCH v4 13/14] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-15 17:38               ` [PATCH v4 14/14] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-15 19:33               ` [PATCH v5 00/14] perf build: Reduce build time by nearly half Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 01/14] tools build: Fix feature checks to touch target files on success Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 02/14] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 03/14] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 04/14] perf build: Remove empty archheaders target Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 05/14] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 06/14] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 07/14] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 08/14] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-15 19:53                   ` sashiko-bot
2026-05-15 23:27                     ` Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 09/14] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 10/14] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-15 19:58                   ` sashiko-bot
2026-05-15 23:25                     ` Ian Rogers
2026-05-18  1:41                       ` Namhyung Kim [this message]
2026-05-18  2:50                         ` Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 11/14] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-15 20:22                   ` sashiko-bot
2026-05-15 19:33                 ` [PATCH v5 12/14] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 13/14] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-15 19:33                 ` [PATCH v5 14/14] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-15 23:32                 ` [PATCH v5 00/14] perf build: Reduce build time by nearly half Ian Rogers
2026-05-18  4:47                 ` [PATCH v6 " Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 01/14] tools build: Fix feature checks to touch target files on success Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 02/14] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 03/14] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 04/14] perf build: Remove empty archheaders target Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 05/14] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 06/14] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 07/14] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 08/14] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 09/14] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 10/14] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 11/14] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 12/14] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 13/14] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-18  4:47                   ` [PATCH v6 14/14] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-18 15:46                   ` [PATCH v7 00/14] perf build: Reduce build time by nearly half Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 01/14] tools build: Fix feature checks to touch target files on success Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 02/14] perf trace beauty: Make beauty generated C code standalone .o files Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 03/14] perf build: Decouple pmu-events from prepare umbrella target Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 04/14] perf build: Remove empty archheaders target Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 05/14] perf build: Move BPF skeleton generation out of Makefile.perf Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 06/14] perf build: Encapsulate vmlinux.h and bpftool in bpf_skel.mak Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 07/14] perf build: Pre-generate BPF skeleton tooling during umbrella prepare phase Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 08/14] perf build: Move libsymbol dependency out of prepare step Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 09/14] perf build: Remove redundant libbpf feature check for static builds Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 10/14] perf pmu-events: Split big_c_string storage into standalone compilation unit Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 11/14] perf pmu-events: Parallelize JSON and metric pre-computation in jevents.py Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 12/14] perf build: Prefix SCRIPTS with output directory to fix continuous rebuilds Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 13/14] perf pmu-events: Convert recursive shell assignments and macros to Make built-ins Ian Rogers
2026-05-18 15:46                     ` [PATCH v7 14/14] perf build: Convert llvm-config shell queries to simply expanded variables Ian Rogers
2026-05-19 18:27                     ` [PATCH v7 00/14] perf build: Reduce build time by nearly half Namhyung Kim
2026-05-19 18:47                       ` Ian Rogers
2026-05-19 18:49                       ` Arnaldo Carvalho de Melo
2026-05-19 18:53                         ` Ian Rogers
2026-05-20  0:18                           ` Namhyung Kim
2026-05-15 18:20           ` [PATCH v3 00/17] " Namhyung Kim
2026-05-12  9:36 ` [PATCH v1 00/14] perf build: Reduce build time by one third James Clark

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=agpuOvZvo_HNnYsr@z2 \
    --to=namhyung@kernel.org \
    --cc=bpf@vger.kernel.org \
    --cc=irogers@google.com \
    --cc=linux-perf-users@vger.kernel.org \
    --cc=sashiko-reviews@lists.linux.dev \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox