Re: [OE-core] Toolchain test results

[Richard Purdie <richard.purdie@linuxfoundation.org>]

On Wed, 2023-07-26 at 06:00 +0000, Mittal, Anuj wrote:
> On Thu, 2023-07-20 at 12:26 +0100, Richard Purdie wrote:
> > On Tue, 2023-07-18 at 10:14 +0100, Richard Purdie via
> > lists.openembedded.org wrote:
> > > qemuarm has ~350 failures
> > > qemuarm64 has ~350 failures
> > > qemux86-64 has ~4000 (3900 in glibc)
> > > qemux86 has ~4000 (3500 in glibc)
> > > qemuppc has ~600 failures
> > > qemumips64 has ~5000 failures (all over)
> > > qemumips has ~1600 failures
> > > 
> > > Anuj: Can Intel look into the glibc test failures on x86?
> > 
> > I realised the glibc issues were due to the network being disabled
> > for
> > the tests and have sent a patch to fix that. That reduces the
> > failures
> > from ~3900 to ~330. We should really try and reduce that further but
> > it
> > is a start!
> > 
> 
> A lot of locale/iconv tests seemed to be failing when calling write
> with large buffers/files over NFS. Some of others were triggering OOM.
> 
> I ran the tests again after making a few changes:
> 
> https://autobuilder.yocto.io/pub/non-release/20230726-11/testresults/qemux86-64-tc/
> 
> After switching NFS mount to TCP and increasing the memory available to
> 1024, the number of tests failed came down to 69.
> 
> =======================================================================
> =======================================
> qemux86-64 PTest Result Summary
> =======================================================================
> =======================================
> -----------------------------------------------------------------------
> ---------------------------------------
> Recipe           | Passed       | Failed   | Skipped     | Time(s)
> -----------------------------------------------------------------------
> ---------------------------------------
> binutils         | 289          | 0        | 8           | -
> binutils-gas     | 1582         | 4        | 1           | -
> binutils-ld      | 1622         | 6        | 111         | -
> gcc              | 149696       | 28       | 27599       | -
> gcc-g++          | 219260       | 30       | 21108       | -
> gcc-libatomic    | 27           | 1        | 27          | -
> gcc-libgomp      | 3426         | 1        | 1962        | -
> gcc-libitm       | 24           | 1        | 24          | -
> gcc-libstdc++-v3 | 9695         | 32       | 5459        | -
> glibc            | 4984         | 69       | 147         | -
> rust             | 15768        | 0        | 554         | -
> -----------------------------------------------------------------------
> ---------------------------------------


That looks like really good progress, thanks Anuj!

I think we might rebuild M2 to allow for some of the resulttool, ltp
and other test fixes to make it in. I want to look into this 32 bit arm
regression first to see what is going on there. If you're able to send
some of these out we should pull them in and improve the failures for
glibc too.

Cheers,

Richard