Re: [OE-core] [PATCH 0/3 v6] Oe-selftest for Clang, LLVM, LLD

["Mathieu Dubois-Briand" <mathieu.dubois-briand@bootlin.com>]

On Thu Jul 16, 2026 at 12:14 PM CEST, Deepesh Varatharajan wrote:
>
> On 16-07-2026 12:44, Mathieu Dubois-Briand wrote:
>> CAUTION: This email comes from a non Wind River email account!
>> Do not click links or open attachments unless you recognize the sender and know the content is safe.
>>
>> On Wed Jul 15, 2026 at 8:00 AM CEST, Deepesh via lists.openembedded.org Varatharajan wrote:
>>> From: Deepesh Varatharajan <Deepesh.Varatharajan@windriver.com>
>>>
>>> This patch series introduces a test framework to run selftests for
>>> target builds of Clang, LLVM, and LLD.
>>>
>> Hi Deepesh,
>>
>> Thanks for your patch.
>>
>> It looks like it does introduce reproducibility issues:
>>
>> AssertionError: The following deb packages are different and not in exclusion list:
>> /srv/pokybuild/yocto-worker/reproducible/build/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/rust-dbg_1.97.0-r0_amd64.deb
>> /srv/pokybuild/yocto-worker/reproducible/build/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/rust_1.97.0-r0_amd64.deb
>> The following ipk packages are different and not in exclusion list:
>> /srv/pokybuild/yocto-worker/reproducible/build/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/rust-dbg_1.97.0-r0_x86-64-v3.ipk
>> /srv/pokybuild/yocto-worker/reproducible/build/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/rust_1.97.0-r0_x86-64-v3.ipk
>>
>> https://autobuilder.yoctoproject.org/valkyrie/#/builders/37/builds/4386
>> https://valkyrie.yocto.io/pub/repro-fail/oe-reproducible-20260715-161pbdip/packages/diff-html/
>>
>> I did not really identified where the difference come from. Can you have
>> a look at the issue?
>>
>> Thanks,
>> Mathieu
> Hi Mathieu,
>
> I don't think the reproducibility issue is caused by the clang testsuite 
> changes.
> Those changes are guarded by the `CLANG_ENABLE_TESTSUITE` variable, so 
> they should
> not affect a normal Rust build. Before sending the patch, I also ran a 
> couple of
> tests, including reproducibility testing, and did not encounter any issues.
>
> I did a bit more digging into the AB builds and found the following:
>
> https://autobuilder.yoctoproject.org/valkyrie/#/builders/37/builds/4378
>
> It looks like the same Rust reproducibility failure occurred in your testing
> two days ago, when the clang-testsuite related changes were not yet present
> in your branch. I am not sure what is causing rust repro failures in AB.
>
> Could you please run the reproducibility test one more time and let me know
> if the failure occurs again?
>
> If the reproducibility issue doesn't occur again, we should consider filing
> a Yocto bug to track these intermittent Rust reproducibility failures.
>
> Regards,
> Deepesh
>>
>> --
>> Mathieu Dubois-Briand, Bootlin
>> Embedded Linux and Kernel engineering
>> https://bootlin.com
>>

After a few more builds, it might be and intermittent failure from
another patch. I will add back this series, in a few days; I first want
to get more data on the failure.

Thanks,
Mathieu

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com