Openembedded Core Discussions
 help / color / mirror / Atom feed
From: "Mathieu Dubois-Briand" <mathieu.dubois-briand@bootlin.com>
To: <deepesh.varatharajan@windriver.com>,
	<openembedded-core@lists.openembedded.org>
Cc: <Sundeep.Kokkonda@windriver.com>, <Deepesh.Varatharajan@windriver.com>
Subject: Re: [OE-core] [PATCH 0/3 v6] Oe-selftest for Clang, LLVM, LLD
Date: Sun, 19 Jul 2026 07:51:40 +0200	[thread overview]
Message-ID: <DK2BAKXVNU4Q.2RBGX6QVYNC1D@bootlin.com> (raw)
In-Reply-To: <20260715060021.579656-1-Deepesh.Varatharajan@windriver.com>

On Wed Jul 15, 2026 at 8:00 AM CEST, Deepesh via lists.openembedded.org Varatharajan wrote:
> From: Deepesh Varatharajan <Deepesh.Varatharajan@windriver.com>
>
> This patch series introduces a test framework to run selftests for
> target builds of Clang, LLVM, and LLD.
>

Hi Deepesh,

It looks like some tests are failing intermittently:

2026-07-18 18:06:49,355 - oe-selftest - INFO - 3: 1/1 20/21 (3039.16s) (0 failed) (clang.LLVMSelfTestSystemEmulated.test_llvm)
2026-07-18 18:06:49,355 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/srv/pokybuild/yocto-worker/qemux86-tc/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/clang.py", line 195, in test_llvm
    raise AssertionError(f"llvm-lit failed for LLVM: {output}")
AssertionError: llvm-lit failed for LLVM: -- Testing: 23802 of 60668 tests, 4 workers --
...
XFAIL: LLVM :: Analysis/DDG/basic-loopnest.ll (287 of 23802)
...
XFAIL: LLVM :: Analysis/DependenceAnalysis/Invariant.ll (338 of 23802)
...
XFAIL: LLVM :: Analysis/ScalarEvolution/2008-12-14-StrideAndSigned.ll (699 of 23802)
...
XFAIL: LLVM :: Bitcode/upgrade-datalayout2.ll (1749 of 23802)
...


https://autobuilder.yoctoproject.org/valkyrie/#/builders/28/builds/4122
https://autobuilder.yoctoproject.org/valkyrie/#/builders/28/builds/4120
https://autobuilder.yoctoproject.org/valkyrie/#/builders/28/builds/4120
https://autobuilder.yoctoproject.org/valkyrie/#/builders/42/builds/4125

Can you have a look at the issue?

Thanks,
Mathieu

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com



      parent reply	other threads:[~2026-07-19  5:51 UTC|newest]

Thread overview: 8+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-15  6:00 [PATCH 0/3 v6] Oe-selftest for Clang, LLVM, LLD Deepesh.Varatharajan
2026-07-15  6:00 ` [PATCH 1/3] clang-tools-extra: disable tests Deepesh.Varatharajan
2026-07-15  6:00 ` [PATCH 2/3] clang: Enable cmake flags for llvm, clang, lld tests Deepesh.Varatharajan
2026-07-15  6:00 ` [PATCH 3/3] oeqa/selftest/clang: Add oe-selftests for Clang/LLVM/LLD test suites Deepesh.Varatharajan
2026-07-16  7:14 ` [OE-core] [PATCH 0/3 v6] Oe-selftest for Clang, LLVM, LLD Mathieu Dubois-Briand
2026-07-16 10:14   ` Deepesh Varatharajan
2026-07-16 16:57     ` Mathieu Dubois-Briand
2026-07-19  5:51 ` Mathieu Dubois-Briand [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=DK2BAKXVNU4Q.2RBGX6QVYNC1D@bootlin.com \
    --to=mathieu.dubois-briand@bootlin.com \
    --cc=Sundeep.Kokkonda@windriver.com \
    --cc=deepesh.varatharajan@windriver.com \
    --cc=openembedded-core@lists.openembedded.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox