From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtpout-04.galae.net (smtpout-04.galae.net [185.171.202.116]) by mx.groups.io with SMTP id smtpd.msgproc02-g2.13700.1795091687395250324 for ; Thu, 19 Nov 2026 04:34:48 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@bootlin.com header.s=dkim header.b=mCiu4otJ; spf=pass (domain: bootlin.com, ip: 185.171.202.116, mailfrom: mathieu.dubois-briand@bootlin.com) Received: from smtpout-01.galae.net (smtpout-01.galae.net [212.83.139.233]) by smtpout-04.galae.net (Postfix) with ESMTPS id 59341C4CBEF for ; Thu, 19 Nov 2026 12:34:50 +0000 (UTC) Received: from mail.galae.net (mail.galae.net [212.83.136.155]) by smtpout-01.galae.net (Postfix) with ESMTPS id 0C94F60237; Thu, 19 Nov 2026 12:34:45 +0000 (UTC) Received: from [127.0.0.1] (localhost [127.0.0.1]) by localhost (Mailerdaemon) with ESMTPSA id 27A1811BC0757; Thu, 19 Nov 2026 13:34:41 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bootlin.com; s=dkim; t=1795091684; h=from:subject:date:message-id:to:cc:mime-version:content-type: content-transfer-encoding:in-reply-to:references; bh=8kjEWIxmJKtvTaZBoYuJIscxXL+JjqABG/GeqCnAJSw=; b=mCiu4otJiWa1c5i+zFmrY41/StVC2bHa17HtM7IS8e943iJC5AuOmR/K46QuImQiGH/ZPF NgYrF7nRbOrGNwLoRJEVPTVzlQ+AWFap3bkZGDJ7dWTXtIevpVNctQLwRvJ4QOXK1L38wN jgWqb/DNcQlHoE0zDdBmebFSyEYG6Vx+VH3zPMvo8iSCCFnKqUwJrRe5ZXZTD610EC9tAn 8nbvXPael21AO5MHhnoPcYH9/xejfxfSm8A7n8+OBvpy8YURm3PeJp7toI2h8TSTjE4Krz OsfU/0J/9h3vBWR8nM+HiTveO+jSV4HKBda/kxk1+e6BxAJrVN/cOUR+MUUFAQ== Mime-Version: 1.0 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=UTF-8 Date: Thu, 19 Nov 2026 13:34:41 +0100 Message-Id: Subject: Re: [PATCH v2 0/4] spdx30: identity and purls of dependency downloads Cc: "Joshua Watt" , "Alexander Kanavin" , "Stefan Herbrechtsmeier" , From: "Mathieu Dubois-Briand" To: "Stefano Tondo" , X-Mailer: aerc 0.21.0-0-g5549850facc2 References: <20261118234425.3681880-1-stondo@gmail.com> In-Reply-To: <20261118234425.3681880-1-stondo@gmail.com> X-Last-TLS-Session-Version: TLSv1.3 List-Id: X-Webhook-Received: from 45-33-107-173.ip.linodeusercontent.com [45.33.107.173] by lin-tor-korg-lkml-alma10-1 with HTTPS for ; Thu, 19 Nov 2026 12:34:57 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/250666 On Thu Nov 19, 2026 at 12:44 AM CET, Stefano Tondo wrote: > Hi, > > This series implements the parts of the RFC "spdx30: name, version > and purl for dependency downloads" [1] that we agreed on. It needs > the bitbake series "fetch: package identity of crate, gomod and npm > URLs" [2]. > > 1. The SPDX of a crate, gomod or npm download gets the name, the > version and the purl from the fetcher. > 2. For Cargo recipes, a new do_cargo_metadata task writes the crate > dependency graph for the target. The build links to each crate > download with a runtime, build or test scope. A crate that is not > used on the target gets an annotation. > 3. Each output package gets the purls of its source downloads as > external identifiers, as Joshua proposed: a statically linked > dependency is part of the binary. A purl is left out only when the > cargo graph proves that the crate is not in the target. The > software_packageUrl of the package does not change. > 4. Selftests with python3-bcrypt. > > For python3-bcrypt, the output package gets the purls of 25 of its > 42 crates. The other 17 crates are not built into the target. > > Two points for review: > > - All output packages of a recipe get the purls, also -dbg and -src. > I have no proof per package, so I followed the rule "keep the purl > unless there is proof". > - Go recipes have no filter yet. go version -m can give the proof per > binary, and I can add it in a follow-up. > Hi Stefano, Thanks for the v2, it does look better in term of memory. Yet I can see this failure: ERROR: zip-native-3.0-r0 do_create_spdx: Error executing a python function = in exec_func_python() autogenerated: ... ERROR: zip-native-3.0-r0 do_create_spdx: Error executing a python function = in exec_func_python() autogenerated: The stack trace of python calls that resulted in this exception/failure was= : File: 'exec_func_python() autogenerated', lineno: 2, function: 0001: *** 0002:do_create_spdx(d) 0003: File: '/srv/pokybuild/yocto-worker/qemux86-world/build/layers/openembedded-= core/meta/classes/create-spdx-3.0.bbclass', lineno: 264, function: do_creat= e_spdx 0260:addtask do_create_recipe_spdx_setscene 0261: 0262:python do_create_spdx() { 0263: import oe.spdx30_tasks *** 0264: oe.spdx30_tasks.create_spdx(d) 0265:} 0266:addtask do_create_spdx after \ 0267: do_unpack \ 0268: do_patch \ File: '/srv/pokybuild/yocto-worker/qemux86-world/build/layers/openembedded-= core/meta/lib/oe/spdx30_tasks.py', lineno: 1077, function: create_spdx 1073: build_inputs =3D set() 1074: 1075: cpe_ids =3D oe.cve_check.get_cpe_ids(d.getVar("CVE_PRODUCT"),= d.getVar("CVE_VERSION")) 1076: *** 1077: source_files =3D add_download_files(d, build_objset) 1078: build_inputs |=3D source_files 1079: 1080: # The output packages inherit the PURLs of the downloads they= are built 1081: # from, as the code of statically linked dependencies is in t= hem. Only File: '/srv/pokybuild/yocto-worker/qemux86-world/build/layers/openembedded-= core/meta/lib/oe/spdx30_tasks.py', lineno: 642, function: add_download_file= s 0638: ) 0639: ) 0640: 0641: enrich_source_package(d, dl, fd, file_name, primary_p= urpose) *** 0642: set_package_identity(d, dl, fd) 0643: 0644: if release_date is not None: 0645: dl.releaseTime =3D release_date 0646: File: '/srv/pokybuild/yocto-worker/qemux86-world/build/layers/openembedded-= core/meta/lib/oe/spdx30_tasks.py', lineno: 472, function: set_package_ident= ity 0468: 0469: Fetchers of package registries (crate, gomod, npm) know which= package 0470: a URL downloads, see FetchMethod.package_identity() in bitbak= e. 0471: """ *** 0472: identity =3D fd.method.package_identity(fd, d) 0473: if identity: 0474: dl.name =3D identity["name"] 0475: dl.software_packageVersion =3D identity["version"] 0476: dl.software_packageUrl =3D identity["purl"] Exception: AttributeError: 'Wget' object has no attribute 'package_identity= ' ERROR: Logfile of failure stored in: /srv/pokybuild/yocto-worker/qemux86-wo= rld/build/build/tmp/work/x86-64-v3-poky-linux/gstreamer1.0-plugins-rs/0.15.= 4/temp/log.do_compile.1234281 Log data follows: | DEBUG: Executing shell function do_compile | NOTE: Using rust targets from /srv/pokybuild/yocto-worker/qemux86-world/b= uild/build/tmp/work/x86-64-v3-poky-linux/gstreamer1.0-plugins-rs/0.15.4/rus= t-targets/ | Error: CliError { error: Some(no matching package named `gstreamer` found | location searched: directory source `/srv/pokybuild/yocto-worker/qemux86-= world/build/build/tmp/work/x86-64-v3-poky-linux/gstreamer1.0-plugins-rs/0.1= 5.4/sources/cargo_home/bitbake` (which is replacing registry `crates-io`) | required by package `gst-plugin-tutorial v0.15.4 (/srv/pokybuild/yocto-wo= rker/qemux86-world/build/build/tmp/work/x86-64-v3-poky-linux/gstreamer1.0-p= lugins-rs/0.15.4/sources/gstreamer1.0-plugins-rs-0.15.4/tutorial)` | help: packages with similar names: bitreader | | note: offline mode (via `--offline`) can sometimes cause surprising resol= ution failures | help: if this error is too confusing you may wish to retry without `--off= line` | | Stack backtrace: | 0: | 1: | 2: | 3: | 4: | 5: | 6: | 7: | 8: | 9: | 10: | 11: | 12: | 13: | 14: __libc_start_call_main | 15: __libc_start_main@GLIBC_2.2.5 | 16: ), exit_code: 101 } | WARNING: exit code 1 from a shell command. And something similar later with lib32-lsb-release: ERROR: lib32-lsb-release-1.4-r0 do_create_spdx: Error executing a python fu= nction in exec_func_python() autogenerated: https://autobuilder.yoctoproject.org/valkyrie/#/builders/59/builds/5072 Can you have a look at the issue? Thanks, Mathieu --=20 Mathieu Dubois-Briand, Bootlin Embedded Linux and Kernel engineering https://bootlin.com