Re: [OE-core] [PATCH V3 0/4] Oe-selftest for Clang, LLVM, LLD

["Mathieu Dubois-Briand" <mathieu.dubois-briand@bootlin.com>]

On Wed Mar 4, 2026 at 7:28 PM CET, Mathieu Dubois-Briand wrote:
> On Mon Mar 2, 2026 at 11:43 AM CET, Deepesh via lists.openembedded.org Varatharajan wrote:
>> From: Deepesh Varatharajan <Deepesh.Varatharajan@windriver.com>
>>
>> This patch series introduces a test framework to run selftests for
>> target builds of Clang, LLVM, and LLD.
>>
>> v3 changes:
>> - llvm_sysroot_preprocess_testsuite function needs be added to 
>>   llvm:class-target not llvm:class-nativesdk.
>>
>> v2 changes:
>> - Enable required CMake flags only when running the testsuite.
>> - Ensure default build time and package sizes remain unaffected.
>>
>> Summary of changes:
>> -Patch 1: Disable clang-tools-extra tests, as Clang's CMake cannot
>>           detect the llvm-bcanalyzer target.
>> -Patch 2: Enabled the necessary CMake flags for clang, llvm & lld tests
>>           when CLANG_ENABLE_TESTSUITE is set to "1".
>> -Patch 3: Selftest script for Clang, LLVM, and LLD including exclude list
>> -Patch 4: Fix rust build failure by replacing target llvm-config with native
>>
>
> Hi Deepesh,
>
> Thanks for the new version.
>
> While it runs correctly on the autobuilder, I'm noting it takes quite a
> bit of time to run the tests. I'm not really against merging them, I
> just want:
> - to make everybody aware of that.
> - to confirm with you these are some expected timings.
>
> Taking some random build in my branch:
>
> 2026-03-03 21:20:21,805 - oe-selftest - INFO - clang.LLDSelfTestSystemEmulated.test_lld (subunit.RemotedTestCase)
> 2026-03-03 21:20:21,805 - oe-selftest - INFO -  ... ok
> 2026-03-03 21:20:21,805 - oe-selftest - INFO - 2: 1/1 18/21 (7205.57s) (0 failed) (clang.LLDSelfTestSystemEmulated.test_lld)
> ...
> 2026-03-04 00:56:44,671 - oe-selftest - INFO - clang.ClangSelfTestSystemEmulated.test_clang (subunit.RemotedTestCase)
> 2026-03-04 00:56:44,671 - oe-selftest - INFO -  ... ok
> 2026-03-04 00:56:44,671 - oe-selftest - INFO - 1: 1/1 20/21 (20188.43s) (0 failed) (clang.ClangSelfTestSystemEmulated.test_clang)
> 2026-03-04 01:37:34,036 - oe-selftest - INFO - clang.LLVMSelfTestSystemEmulated.test_llvm (subunit.RemotedTestCase)
> 2026-03-04 01:37:34,036 - oe-selftest - INFO -  ... ok
> 2026-03-04 01:37:34,036 - oe-selftest - INFO - 3: 1/1 21/21 (22637.80s) (0 failed) (clang.LLVMSelfTestSystemEmulated.test_llvm)
>
> https://autobuilder.yoctoproject.org/valkyrie/#/builders/5/builds/3230
>
> So first, we only had a few builds so far, maybe we just were a bit
> unlucky (looking at the test, I believe sstate will not have any impact
> in later builds). Also we already had some quite long tests in there,
> but in some builds the test_clang / test_llvm really seems to take a
> longer time.
>
> Thanks,
> Mathieu

I'm only realizing now, this series is also linked with this intermitent
issue: https://bugzilla.yoctoproject.org/show_bug.cgi?id=16188.

We should probably keep it aside for a few days, until we get something
better.

Thanks,
Mathieu

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com