Re: [OE-core] [PATCH V3 0/4] Oe-selftest for Clang, LLVM, LLD

["Mathieu Dubois-Briand" <mathieu.dubois-briand@bootlin.com>]

On Mon Mar 2, 2026 at 11:43 AM CET, Deepesh via lists.openembedded.org Varatharajan wrote:
> From: Deepesh Varatharajan <Deepesh.Varatharajan@windriver.com>
>
> This patch series introduces a test framework to run selftests for
> target builds of Clang, LLVM, and LLD.
>
> v3 changes:
> - llvm_sysroot_preprocess_testsuite function needs be added to 
>   llvm:class-target not llvm:class-nativesdk.
>
> v2 changes:
> - Enable required CMake flags only when running the testsuite.
> - Ensure default build time and package sizes remain unaffected.
>
> Summary of changes:
> -Patch 1: Disable clang-tools-extra tests, as Clang's CMake cannot
>           detect the llvm-bcanalyzer target.
> -Patch 2: Enabled the necessary CMake flags for clang, llvm & lld tests
>           when CLANG_ENABLE_TESTSUITE is set to "1".
> -Patch 3: Selftest script for Clang, LLVM, and LLD including exclude list
> -Patch 4: Fix rust build failure by replacing target llvm-config with native
>

Hi Deepesh,

Thanks for the new version.

While it runs correctly on the autobuilder, I'm noting it takes quite a
bit of time to run the tests. I'm not really against merging them, I
just want:
- to make everybody aware of that.
- to confirm with you these are some expected timings.

Taking some random build in my branch:

2026-03-03 21:20:21,805 - oe-selftest - INFO - clang.LLDSelfTestSystemEmulated.test_lld (subunit.RemotedTestCase)
2026-03-03 21:20:21,805 - oe-selftest - INFO -  ... ok
2026-03-03 21:20:21,805 - oe-selftest - INFO - 2: 1/1 18/21 (7205.57s) (0 failed) (clang.LLDSelfTestSystemEmulated.test_lld)
...
2026-03-04 00:56:44,671 - oe-selftest - INFO - clang.ClangSelfTestSystemEmulated.test_clang (subunit.RemotedTestCase)
2026-03-04 00:56:44,671 - oe-selftest - INFO -  ... ok
2026-03-04 00:56:44,671 - oe-selftest - INFO - 1: 1/1 20/21 (20188.43s) (0 failed) (clang.ClangSelfTestSystemEmulated.test_clang)
2026-03-04 01:37:34,036 - oe-selftest - INFO - clang.LLVMSelfTestSystemEmulated.test_llvm (subunit.RemotedTestCase)
2026-03-04 01:37:34,036 - oe-selftest - INFO -  ... ok
2026-03-04 01:37:34,036 - oe-selftest - INFO - 3: 1/1 21/21 (22637.80s) (0 failed) (clang.LLVMSelfTestSystemEmulated.test_llvm)

https://autobuilder.yoctoproject.org/valkyrie/#/builders/5/builds/3230

So first, we only had a few builds so far, maybe we just were a bit
unlucky (looking at the test, I believe sstate will not have any impact
in later builds). Also we already had some quite long tests in there,
but in some builds the test_clang / test_llvm really seems to take a
longer time.

Thanks,
Mathieu

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com