Re: [OE-core] [PATCH 0/4 V2] Oe-selftest for Clang, LLVM, LLD

["Mathieu Dubois-Briand" <mathieu.dubois-briand@bootlin.com>]

On Mon Mar 2, 2026 at 7:49 AM CET, Deepesh via lists.openembedded.org Varatharajan wrote:
> From: Deepesh Varatharajan <Deepesh.Varatharajan@windriver.com>
>
> This patch series introduces a test framework to run selftests for
> target builds of Clang, LLVM, and LLD.
>
> v2 changes:
> - Enable required CMake flags only when running the testsuite.
> - Ensure default build time and package sizes remain unaffected.
>
> Summary of changes:
> -Patch 1: Disable clang-tools-extra tests, as Clang's CMake cannot
>           detect the llvm-bcanalyzer target.
> -Patch 2: Enabled the necessary CMake flags for clang, llvm & lld tests
>           when CLANG_ENABLE_TESTSUITE is set to "1".
> -Patch 3: Selftest script for Clang, LLVM, and LLD including exclude list
> -Patch 4: Fix rust build failure by replacing target llvm-config with native
>

Hi Deepesh,

Thanks for the new version, but it looks like we now have some failing
tests:

2026-03-02 09:52:32,943 - oe-selftest - INFO - clang.ClangSelfTestSystemEmulated.test_clang (subunit.RemotedTestCase)
2026-03-02 09:52:32,943 - oe-selftest - INFO -  ... FAIL
...
AssertionError: llvm-lit failed for Clang: llvm-lit: /srv/pokybuild/yocto-worker/qemuarm-tc/build/build-st-3082983/tmp/work-shared/llvm-project-source-21.1.8-r1/sources/llvm-project-21.1.8.src/llvm/utils/lit/lit/llvm/subst.py:133: fatal: Did not find FileCheck in /srv/pokybuild/yocto-worker/qemuarm-tc/build/build-st-3082983/tmp/work/cortexa15t2hf-neon-poky-linux-gnueabi/clang/21.1.8/recipe-sysroot/usr/bin
...
2026-03-02 09:54:51,485 - oe-selftest - INFO - clang.LLVMSelfTestSystemEmulated.test_llvm (subunit.RemotedTestCase)
2026-03-02 09:54:51,485 - oe-selftest - INFO -  ... FAIL
...
2026-03-02 09:55:49,997 - oe-selftest - INFO - clang.LLDSelfTestSystemEmulated.test_lld (subunit.RemotedTestCase)
2026-03-02 09:55:49,997 - oe-selftest - INFO -  ... FAIL

https://autobuilder.yoctoproject.org/valkyrie/#/builders/42/builds/3224
https://autobuilder.yoctoproject.org/valkyrie/#/builders/5/builds/3222
https://autobuilder.yoctoproject.org/valkyrie/#/builders/58/builds/1118

Can you have a look at these?

Thanks,
Mathieu

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com