public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Greg KH <gregkh@linuxfoundation.org>
To: Luis Augenstein <luis.augenstein@tngtech.com>
Cc: Nathan Chancellor <nathan@kernel.org>,
	nsc@kernel.org, linux-kbuild@vger.kernel.org,
	linux-kernel@vger.kernel.org, akpm@linux-foundation.org,
	kstewart@linuxfoundation.org, maximilian.huber@tngtech.com
Subject: Re: [PATCH 02/15] scripts/sbom: integrate script in make process
Date: Tue, 31 Mar 2026 07:15:35 +0200	[thread overview]
Message-ID: <2026033111-bolt-verse-4505@gregkh> (raw)
In-Reply-To: <9120907b-9568-4f0e-9757-c9e3b8d530f4@tngtech.com>

On Mon, Mar 30, 2026 at 10:32:00PM +0200, Luis Augenstein wrote:
> Hi Nathan,
> 
> thanks a lot for your recommendations.
> 
> > Does sbom-roots.txt need to be cleaned up as well?
> 
> This file is only required to pass the roots into the python script.
> We could also use a tmp file. Then we don't need to worry about clean
> up. Together with your other suggested changes something like this
> should work:
> 
> # Script to generate .spdx.json SBOM documents describing the build
> #
> ---------------------------------------------------------------------------
> 
> ifdef building_out_of_srctree
> sbom_targets := sbom-source.spdx.json
> endif
> sbom_targets += sbom-build.spdx.json sbom-output.spdx.json
> quiet_cmd_sbom = GEN     $(notdir $(sbom_targets))
>       cmd_sbom = roots_file=$$(mktemp); \
>                  printf "%s\n" "$(KBUILD_IMAGE)" >"$$roots_file"; \
>                  $(if $(CONFIG_MODULES),sed 's/\.o$$/.ko/'
> $(objtree)/modules.order >> "$$roots_file";) \
>                  $(PYTHON3) $(srctree)/scripts/sbom/sbom.py \
>                      --src-tree $(abspath $(srctree)) \
>                      --obj-tree $(abspath $(objtree)) \
>                      --roots-file "$$roots_file" \
>                      --output-directory $(abspath $(objtree)) \
>                      --generate-spdx \
>                      --package-license "GPL-2.0 WITH Linux-syscall-note" \
>                      --package-version "$(KERNELVERSION)" \
>                      --write-output-on-error;
>                  rm -f "$$roots_file"
> PHONY += sbom
> sbom: $(notdir $(KBUILD_IMAGE)) include/generated/autoconf.h $(if
> $(CONFIG_MODULES),modules modules.order)
> 	$(call cmd,sbom)
> 
> Note, I will also add the --write-output-on-error flag by default such
> that the .spdx.json documents are generated as much as possible even if
> some build commands are unknown to the parser.
> 
> > FWIW, I get errors like
> >
> >   $ make -kj"$(nproc)" ARCH=arm64 CROSS_COMPILE=aarch64-linux- O=build
> mrproper defconfig sbom
> >   ...
> >     GEN     sbom-source.spdx.json sbom-build.spdx.json
> sbom-output.spdx.json
> >   [ERROR] File "/src/scripts/sbom/sbom/cmd_graph/savedcmd_parser.py",
> line 630, in log_error_or_warning
> >   Skipped parsing command ccache aarch64-linux-gcc ... -o init/main.o
> /src/init/main.c because no matching parser was found
> >   [ERROR] File "/src/scripts/sbom/sbom/cmd_graph/savedcmd_parser.py",
> line 630, in log_error_or_warning
> >   Skipped parsing command ccache aarch64-linux-gcc ... -o
> arch/arm64/kernel/asm-offsets.s /src/arch/arm64/kernel/asm-offsets.c
> because no matching parser was found
> >   [ERROR] File "/src/scripts/sbom/sbom/cmd_graph/savedcmd_parser.py",
> line 630, in log_error_or_warning
> >   Skipped parsing command ccache aarch64-linux-gcc ... -o
> kernel/bounds.s /src/kernel/bounds.c because no matching parser was found
> >   ... (Found 10435 more instances of this error)
> >
> > when testing the whole series without any modifications, am I doing
> > something wrong?
> 
> I was not aware of ccache. If you rebuild without using ccache the gcc
> commands should be parsed correctly.
> 
> The parser expects gcc commands to be of the form
> 	"^([^\s]+-)?(gcc|clang)\b"
> When using tools like ccache this breaks. I will update the parser to
> look for
> 	"^(ccache\s+)?([^\s]+-)?(gcc|clang)\b"
> instead.
> 
> Feedback like this is very helpful—thanks! Do you know of any other
> commonly used tools that modify build commands in a similar way and
> should be considered?

Ick, this might get messy as you can modify the compiler with the CC=
option to be anything.  There are other build tools out there that do
much the same as ccache does (which I should have caught this as I use
ccache on my build systems), like distcc and friends, so this might just
want to look at the result of "CC" instead?

thanks,

greg k-h

  reply	other threads:[~2026-03-31  5:16 UTC|newest]

Thread overview: 27+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-02-10 20:54 [PATCH v4 00/15] add SPDX SBOM generation script Luis Augenstein
2026-02-10 20:54 ` [PATCH 01/15] scripts/sbom: add documentation Luis Augenstein
2026-02-10 20:54 ` [PATCH 02/15] scripts/sbom: integrate script in make process Luis Augenstein
2026-03-30  9:50   ` Nathan Chancellor
2026-03-30 20:32     ` Luis Augenstein
2026-03-31  5:15       ` Greg KH [this message]
2026-03-31 15:30         ` Nathan Chancellor
2026-03-31 16:04           ` Nicolas Schier
2026-04-01 11:09             ` Luis Augenstein
2026-04-02 20:57               ` Nicolas Schier
2026-04-01 11:12           ` Luis Augenstein
2026-02-10 20:54 ` [PATCH 03/15] scripts/sbom: setup sbom logging Luis Augenstein
2026-02-10 20:54 ` [PATCH 04/15] scripts/sbom: add command parsers Luis Augenstein
2026-02-10 20:54 ` [PATCH 05/15] scripts/sbom: add cmd graph generation Luis Augenstein
2026-02-10 20:54 ` [PATCH 06/15] scripts/sbom: add additional dependency sources for cmd graph Luis Augenstein
2026-02-10 20:54 ` [PATCH 07/15] scripts/sbom: add SPDX classes Luis Augenstein
2026-02-10 20:54 ` [PATCH 08/15] scripts/sbom: add JSON-LD serialization Luis Augenstein
2026-02-10 20:54 ` [PATCH 09/15] scripts/sbom: add shared SPDX elements Luis Augenstein
2026-02-10 20:54 ` [PATCH 10/15] scripts/sbom: collect file metadata Luis Augenstein
2026-02-10 20:54 ` [PATCH 11/15] scripts/sbom: add SPDX output graph Luis Augenstein
2026-02-10 20:54 ` [PATCH 12/15] scripts/sbom: add SPDX source graph Luis Augenstein
2026-02-10 20:54 ` [PATCH 13/15] scripts/sbom: add SPDX build graph Luis Augenstein
2026-02-10 20:54 ` [PATCH 14/15] scripts/sbom: add unit tests for command parsers Luis Augenstein
2026-02-10 20:54 ` [PATCH 15/15] scripts/sbom: add unit tests for SPDX-License-Identifier parsing Luis Augenstein
2026-03-23 13:39 ` [PATCH v4 00/15] add SPDX SBOM generation script Greg KH
2026-03-29  6:29 ` Greg KH
2026-03-30  5:50   ` Nathan Chancellor

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=2026033111-bolt-verse-4505@gregkh \
    --to=gregkh@linuxfoundation.org \
    --cc=akpm@linux-foundation.org \
    --cc=kstewart@linuxfoundation.org \
    --cc=linux-kbuild@vger.kernel.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=luis.augenstein@tngtech.com \
    --cc=maximilian.huber@tngtech.com \
    --cc=nathan@kernel.org \
    --cc=nsc@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox