Openembedded Core Discussions
 help / color / mirror / Atom feed
From: "Mathieu Dubois-Briand" <mathieu.dubois-briand@bootlin.com>
To: <JPEWhacker@gmail.com>, <openembedded-core@lists.openembedded.org>
Subject: Re: [OE-core][PATCH v8 0/9] Implement SPDX for deploy tasks
Date: Thu, 05 Nov 2026 10:56:09 +0100	[thread overview]
Message-ID: <DMN6R5OD6K0L.KNE00WT6X3LP@bootlin.com> (raw)
In-Reply-To: <20261104153535.3184146-1-JPEWhacker@gmail.com>

On Wed Nov 4, 2026 at 4:33 PM CET, Joshua Watt via openembedded-core wrote:
> The SPDX use case for file system image has been well defined since SPDX
> was first implemented, however there has always been a desire to also
> express SPDX output for other non-image deliverables (primarily, those
> that have a do_deploy task or similar). These types of tasks cannot
> easily use the traditional method of having a separate SPDX task that
> runs to create their SPDX output as this causes lots of problems with
> the way dependencies are specified. Instead, it is desirable for these
> tasks to directly produce SPDX output that can be consumed by other
> tasks that depend on them.
>
> This patch series adds support for this. Any sstate task that starts
> with "do_deploy" can now be added to the SPDX_DEPLOY_TASKS list and it
> will run a postfunc to generate SPDX output that describes what is being
> deployed. For classical do_deploy tasks, this is setup to be easy by
> automatically capturing all the deployed output files in the SPDX data,
> but other tasks can be added as well.
>
> Finally, the do_create_image_spdx task is removed and replaced with a
> SPDX deploy postfunc using this new system. This means that any task
> that depends on do_image_complete will automatically also get the SPDX
> output for the image, simplifying the dependency handling.
>

Hi Joshua,

Sorry, it looks like one of the selftests is still failing:

2026-11-04 20:54:56,255 - oe-selftest - INFO - sstatetests.SStateHashSameSigs2.test_sstate_allarch_samesigs (subunit.RemotedTestCase)
2026-11-04 20:54:56,256 - oe-selftest - INFO -  ... FAIL
...
2026-11-04 20:54:56,257 - oe-selftest - INFO - 14: 40/74 566/796 (126.20s) (0 failed) (sstatetests.SStateHashSameSigs2.test_sstate_allarch_samesigs)
2026-11-04 20:54:56,257 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/sstatetests.py", line 474, in test_sstate_allarch_samesigs
    self.sstate_common_samesigs(configA, configB, allarch=True)
    ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/sstatetests.py", line 207, in sstate_common_samesigs
    self.assertEqual(files1, files2)
    ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/unittest/case.py", line 907, in assertEqual
    assertion_func(first, second, msg=msg)
    ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/unittest/case.py", line 1206, in assertDictEqual
    self.fail(self._formatMessage(msg, standardMsg))
    ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.13/unittest/case.py", line 732, in fail
    raise self.failureException(msg)
AssertionError: {'nat[270260 chars]do_package_qa': '857626b7bdd74c4b2507f085ec1d3[30298 chars]ccf'} != {'nat[270260 chars]do_patch': '58d5b3102c4ba7a2388712a2a7f962d88e[30298 chars]ccf'}
  {'adwaita-icon-theme/do_compile': '5390f85c42205bb5a14f7d92537a8420867861c0ef9adc409863aa1a1cd61709',
   'adwaita-icon-theme/do_configure': 'a280235b7d74824b3743f9490b3549add607d66c38976212ef67a5598819592e',
   'adwaita-icon-theme/do_create_package_spdx': 'e62d8265977d1a7e3ad698899be0f643a79e7a5a7b7b6f10292c8959a58fc267',
   'adwaita-icon-theme/do_create_recipe_spdx': 'efe776c196e9c591367785ce9a32d02228af827c2995ce26df1885b88065da9d',
   'adwaita-icon-theme/do_create_spdx': 'bde607fa1590084bb0b587b76f48bec54b0ecff13a4a437385558eeb7a5595dd',
   'adwaita-icon-theme/do_deploy_source_date_epoch': '8de41ddc1f7abb948c161ec6591dbe887186eafe18890b24a13568793ab8e897',
   'adwaita-icon-theme/do_fetch': '21febaeb8a75763a5eed0a68a22d15a4cb491f25c5d59a086c5d3a48c6ac7176',
   'adwaita-icon-theme/do_install': '7d74cc9d42787eb59d2185a92d974e5a61d7cb8e60a23319fdb947cb42389739',
   'adwaita-icon-theme/do_package': '435d8e3412602a492d7b016d3b8615f78fc4de88113bd8180ed8e2c420a55ca2',
   'adwaita-icon-theme/do_package_qa': '497742679e6ab012cb1050d1f6358737f312fe0520b3ab55a8329924af0b42a8',
   'adwaita-icon-theme/do_package_write_rpm': '7d5c34df18018681012fc3544d90fa227d311c18c0093459cf9082c9cddb9e6c',
   'adwaita-icon-theme/do_packagedata': 'eb4f146bb2fed70fb92c69bf02d1e4478429b02ea6a9354442cb1af3a34edd2b',
   'adwaita-icon-theme/do_patch': 'ee2331e00fd0a461aece4ec16f69cecb8463aac4b5a01e07858a515b85c39c53',
   'adwaita-icon-theme/do_populate_lic': 'e41b536e4515805e401b974e48c25168b7e95d523f38806bf101aa4b923d3dfc',
   'adwaita-icon-theme/do_populate_sysroot': 'b5ff360309b0769e840d56103b8036fa882da881d7bfcd0fc89d93a0e460b5d8',
   'adwaita-icon-theme/do_prepare_recipe_sysroot': 'd82174494f146d0936439e3c5bb1a3d85759fe369008ad968017194f4b03733e',
   'adwaita-icon-theme/do_recipe_qa': 'b63675adc7d32dfccfe8a0a8b3be5a5aa892fcfb7a09288714502274ca318d0f',
   'adwaita-icon-theme/do_unpack': '04087c36f3690f91199bbe4e6a61a01bbf32550f289cdccdbc382227566aa54e',
   'adwaita-icon-theme/do_write_config': '3a0d46da99ab5c777732a0143eaedf2319bc385163d544a538ab918bc10ef664',
   'alsa-topology-conf/do_compile': '310c99f93ad20956d61fff0b5a8a18d8b84a175c415110986f4a439023dba11b',
   ...

https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/5193
https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/5006
https://autobuilder.yoctoproject.org/valkyrie/#/builders/23/builds/5221

Can you have a look at the issue?

Thanks,
Mathieu

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com


      parent reply	other threads:[~2026-11-05  9:56 UTC|newest]

Thread overview: 92+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-06-09 22:15 [OE-core][PATCH 0/5] Implement SPDX for deploy tasks Joshua Watt
2026-06-09 22:15 ` [OE-core][PATCH 1/5] classes/baremetal-image: Remove "do_" prefix from image manifest Joshua Watt
2026-06-09 22:15 ` [OE-core][PATCH 2/5] spdx: Reformat Joshua Watt
2026-06-09 22:15 ` [OE-core][PATCH 3/5] spdx: Add ability for deploy tasks to create SPDX Joshua Watt
2026-06-09 22:15 ` [OE-core][PATCH 4/5] Add SPDX deploy tasks Joshua Watt
2026-06-09 22:31   ` Patchtest results for " patchtest
2026-06-10  6:17   ` Mikko Rapeli
2026-06-10  7:46   ` Richard Purdie
2026-06-09 22:15 ` [OE-core][PATCH 5/5] spdx: Replace do_create_image_spdx with deploy task Joshua Watt
2026-06-10 13:17 ` [OE-core][PATCH 0/5] Implement SPDX for deploy tasks Mathieu Dubois-Briand
2026-06-11 18:46   ` Joshua Watt
2026-06-18 15:38 ` [OE-core][PATCH v2 " Joshua Watt
2026-06-18 15:38   ` [OE-core][PATCH v2 1/5] spdx: Add ability for deploy tasks to create SPDX Joshua Watt
2026-06-18 15:38   ` [OE-core][PATCH v2 2/5] classes-global/sstate: Keep SPDX generating setscene dependencies Joshua Watt
2026-06-18 15:38   ` [OE-core][PATCH v2 3/5] Add SPDX deploy tasks to various recipes Joshua Watt
2026-06-18 17:07     ` Patchtest results for " patchtest
2026-06-18 15:38   ` [OE-core][PATCH v2 4/5] spdx: Replace do_create_image_spdx with deploy task Joshua Watt
2026-06-18 15:38   ` [OE-core][PATCH v2 5/5] grub-efi: Change to MACHINE_ARCH Joshua Watt
2026-06-21  5:45   ` [OE-core][PATCH v2 0/5] Implement SPDX for deploy tasks Mathieu Dubois-Briand
2026-06-22 21:14     ` Joshua Watt
2026-06-23  9:28       ` Mathieu Dubois-Briand
2026-06-24 14:15   ` [OE-core][PATCH v3 0/8] " Joshua Watt
2026-06-24 14:15     ` [OE-core][PATCH v3 1/8] spdx: Skip dependencies that are not in the taskhash Joshua Watt
2026-06-24 14:15     ` [OE-core][PATCH v3 2/8] spdx: Add ability for deploy tasks to create SPDX Joshua Watt
2026-06-24 14:15     ` [OE-core][PATCH v3 3/8] oeqa: Add SPDX deploy SBoM test Joshua Watt
2026-06-24 14:15     ` [OE-core][PATCH v3 4/8] classes-global/sstate: Keep SPDX generating setscene dependencies Joshua Watt
2026-06-24 14:15     ` [OE-core][PATCH v3 5/8] Add SPDX deploy tasks to various recipes Joshua Watt
2026-06-24 14:31       ` Patchtest results for " patchtest
2026-06-24 14:31       ` Mikko Rapeli
2026-06-24 16:05         ` Joshua Watt
2026-06-24 16:24           ` Mikko Rapeli
2026-06-24 16:30             ` Joshua Watt
2026-06-24 14:15     ` [OE-core][PATCH v3 6/8] spdx: Replace do_create_image_spdx with deploy task Joshua Watt
2026-06-24 14:15     ` [OE-core][PATCH v3 7/8] grub-efi: Change to MACHINE_ARCH Joshua Watt
2026-06-24 14:15     ` [OE-core][PATCH v3 8/8] systemd-boot: " Joshua Watt
2026-06-25  6:21     ` [OE-core][PATCH v3 0/8] Implement SPDX for deploy tasks Mathieu Dubois-Briand
2026-06-30 21:01     ` [OE-core][PATCH v4 00/10] " Joshua Watt
2026-06-30 21:01       ` [OE-core][PATCH v4 01/10] spdx: Skip dependencies that are not in the taskhash Joshua Watt
2026-06-30 21:01       ` [OE-core][PATCH v4 02/10] spdx: Add ability for deploy tasks to create SPDX Joshua Watt
2026-06-30 21:01       ` [OE-core][PATCH v4 03/10] oeqa: Add SPDX deploy SBoM test Joshua Watt
2026-06-30 21:01       ` [OE-core][PATCH v4 04/10] classes-global/sstate: Keep SPDX generating setscene dependencies Joshua Watt
2026-06-30 21:01       ` [OE-core][PATCH v4 05/10] Add SPDX deploy tasks to various recipes Joshua Watt
2026-06-30 21:01       ` [OE-core][PATCH v4 06/10] spdx: Replace do_create_image_spdx with deploy task Joshua Watt
2026-06-30 21:01       ` [OE-core][PATCH v4 07/10] grub-efi: Change to MACHINE_ARCH Joshua Watt
2026-06-30 21:01       ` [OE-core][PATCH v4 08/10] systemd-boot: " Joshua Watt
2026-06-30 21:01       ` [OE-core][PATCH v4 09/10] multilib: Add systemd-boot to NON_MULTILIB_RECIPES Joshua Watt
2026-06-30 21:01       ` [OE-core][PATCH v4 10/10] wic-tools: Change to MACHINE_ARCH Joshua Watt
2026-07-02  7:51       ` [OE-core][PATCH v4 00/10] Implement SPDX for deploy tasks Mathieu Dubois-Briand
2026-07-05  8:29       ` Richard Purdie
     [not found]       ` <18BF5783F1D47BA6.1336494@lists.openembedded.org>
2026-07-06 14:28         ` Richard Purdie
2026-10-26 21:45       ` [OE-core][PATCH v5 0/6] " Joshua Watt
2026-10-26 21:45         ` [OE-core][PATCH v5 1/6] spdx: Skip dependencies that are not in the taskhash Joshua Watt
2026-10-26 21:45         ` [OE-core][PATCH v5 2/6] spdx: Add ability for deploy tasks to create SPDX Joshua Watt
2026-10-26 21:45         ` [OE-core][PATCH v5 3/6] oeqa: Add SPDX deploy SBoM test Joshua Watt
2026-10-26 21:45         ` [OE-core][PATCH v5 4/6] classes-global/sstate: Keep SPDX generating setscene dependencies Joshua Watt
2026-10-26 21:45         ` [OE-core][PATCH v5 5/6] Add SPDX deploy tasks to various recipes Joshua Watt
2026-10-26 22:03           ` Patchtest results for " patchtest
2026-10-27  7:24           ` Mikko Rapeli
2026-10-27 12:03             ` Jose Quaresma
2026-10-27 14:20               ` Joshua Watt
2026-10-26 21:45         ` [OE-core][PATCH v5 6/6] spdx: Replace do_create_image_spdx with deploy task Joshua Watt
2026-10-27 14:39         ` [OE-core][PATCH v5 0/6] Implement SPDX for deploy tasks Mathieu Dubois-Briand
2026-10-27 22:47         ` [OE-core][PATCH v6 0/7] " Joshua Watt
2026-10-27 22:47           ` [OE-core][PATCH v6 1/7] spdx: Skip dependencies that are not in the taskhash Joshua Watt
2026-10-27 22:47           ` [OE-core][PATCH v6 2/7] spdx: Add ability for deploy tasks to create SPDX Joshua Watt
2026-10-27 22:47           ` [OE-core][PATCH v6 3/7] oeqa: Add SPDX deploy SBoM test Joshua Watt
2026-10-27 22:47           ` [OE-core][PATCH v6 4/7] classes-global/sstate: Keep SPDX generating setscene dependencies Joshua Watt
2026-10-27 22:47           ` [OE-core][PATCH v6 5/7] classes-recipe/deploy: Add do_deploy to SPDX_DEPLOY_TASKS Joshua Watt
2026-10-27 22:47           ` [OE-core][PATCH v6 6/7] spdx: Replace do_create_image_spdx with deploy task Joshua Watt
2026-10-27 22:47           ` [OE-core][PATCH v6 7/7] layer.conf: Fix initramfs-framework not knowing which udev it has Joshua Watt
2026-10-28 17:06           ` [OE-core][PATCH v6 0/7] Implement SPDX for deploy tasks Mathieu Dubois-Briand
2026-10-28 22:04           ` [OE-core][PATCH v7 0/8] " Joshua Watt
2026-10-28 22:04             ` [OE-core][PATCH v7 1/8] spdx: Skip dependencies that are not in the taskhash Joshua Watt
2026-10-28 22:04             ` [OE-core][PATCH v7 2/8] spdx: Add ability for deploy tasks to create SPDX Joshua Watt
2026-10-28 22:04             ` [OE-core][PATCH v7 3/8] oeqa: Add SPDX deploy SBoM test Joshua Watt
2026-10-28 22:04             ` [OE-core][PATCH v7 4/8] classes-global/sstate: Keep SPDX generating setscene dependencies Joshua Watt
2026-10-28 22:04             ` [OE-core][PATCH v7 5/8] classes-recipe/deploy: Add do_deploy to SPDX_DEPLOY_TASKS Joshua Watt
2026-10-28 22:04             ` [OE-core][PATCH v7 6/8] spdx: Replace do_create_image_spdx with deploy task Joshua Watt
2026-10-28 22:04             ` [OE-core][PATCH v7 7/8] layer.conf: Fix initramfs-framework not knowing which udev it has Joshua Watt
2026-10-29 19:20               ` Mathieu Dubois-Briand
2026-10-28 22:04             ` [OE-core][PATCH v7 8/8] ovmf: Allow empty SPDX deploy artifacts Joshua Watt
2026-11-04 15:33             ` [OE-core][PATCH v8 0/9] Implement SPDX for deploy tasks Joshua Watt
2026-11-04 15:33               ` [OE-core][PATCH v8 1/9] spdx: Skip dependencies that are not in the taskhash Joshua Watt
2026-11-04 15:33               ` [OE-core][PATCH v8 2/9] spdx: Add ability for deploy tasks to create SPDX Joshua Watt
2026-11-04 15:33               ` [OE-core][PATCH v8 3/9] oeqa: Add SPDX deploy SBoM test Joshua Watt
2026-11-04 15:33               ` [OE-core][PATCH v8 4/9] classes-global/sstate: Keep SPDX generating setscene dependencies Joshua Watt
2026-11-04 15:33               ` [OE-core][PATCH v8 5/9] classes-recipe/deploy: Add do_deploy to SPDX_DEPLOY_TASKS Joshua Watt
2026-11-04 15:33               ` [OE-core][PATCH v8 6/9] spdx: Replace do_create_image_spdx with deploy task Joshua Watt
2026-11-04 15:34               ` [OE-core][PATCH v8 7/9] layer.conf: Fix initramfs-framework not knowing which udev it has Joshua Watt
2026-11-04 15:34               ` [OE-core][PATCH v8 8/9] ovmf: Allow empty SPDX deploy artifacts Joshua Watt
2026-11-04 15:34               ` [OE-core][PATCH v8 9/9] linux-dummy: " Joshua Watt
2026-11-05  9:56               ` Mathieu Dubois-Briand [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=DMN6R5OD6K0L.KNE00WT6X3LP@bootlin.com \
    --to=mathieu.dubois-briand@bootlin.com \
    --cc=JPEWhacker@gmail.com \
    --cc=openembedded-core@lists.openembedded.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox