Re: [OE-core] Toolchain test results

["Mittal, Anuj" <anuj.mittal@intel.com>]

On Wed, 2023-07-26 at 06:45 +0000, Anuj Mittal wrote:
> On Tue, 2023-07-25 at 23:29 -0700, Khem Raj wrote:
> > On Tue, Jul 25, 2023 at 11:00 PM Anuj Mittal
> > <anuj.mittal@intel.com>
> > wrote:
> > > 
> > > On Thu, 2023-07-20 at 12:26 +0100, Richard Purdie wrote:
> > > > On Tue, 2023-07-18 at 10:14 +0100, Richard Purdie via
> > > > lists.openembedded.org wrote:
> > > > > qemuarm has ~350 failures
> > > > > qemuarm64 has ~350 failures
> > > > > qemux86-64 has ~4000 (3900 in glibc)
> > > > > qemux86 has ~4000 (3500 in glibc)
> > > > > qemuppc has ~600 failures
> > > > > qemumips64 has ~5000 failures (all over)
> > > > > qemumips has ~1600 failures
> > > > > 
> > > > > Anuj: Can Intel look into the glibc test failures on x86?
> > > > 
> > > > I realised the glibc issues were due to the network being
> > > > disabled
> > > > for
> > > > the tests and have sent a patch to fix that. That reduces the
> > > > failures
> > > > from ~3900 to ~330. We should really try and reduce that
> > > > further
> > > > but
> > > > it
> > > > is a start!
> > > > 
> > > 
> > > A lot of locale/iconv tests seemed to be failing when calling
> > > write
> > > with large buffers/files over NFS. Some of others were triggering
> > > OOM.
> > > 
> > > I ran the tests again after making a few changes:
> > > 
> > > https://autobuilder.yocto.io/pub/non-release/20230726-11/testresults/qemux86-64-tc/
> > > 
> > > After switching NFS mount to TCP and increasing the memory
> > > available to
> > > 1024, the number of tests failed came down to 69.
> > > 
> > 
> > This is a nice, thanks for doing it. I looked quickly at your
> > results
> > especially glibc part
> > and it seems some of remaining failures are in nss module. I could
> > not
> > see detail logs
> > why those tests were failing but few things to check is if we
> > install
> 
> All the nss tests are failing here:
> 
> https://github.com/bminor/glibc/blob/master/support/test-container.c#L842
> 

I took a look at this and these are failing because of two
reasons. We're looking at the wrong path when creating that file
because of OBJDIR_PATH we set here:

https://git.yoctoproject.org/poky/tree/meta/recipes-core/glibc/glibc/0022-Avoid-hardcoded-build-time-paths-in-the-output-binar.patch

That path is not correct for glibc-testsuite.

Next, the test tries to acquire a lock to a file on NFS which times out
because the user space server we use doesn't support file locking with
NLM.

After reverting this patch for testing and disabling locking, all the
tests that need the test container and some others pass:

https://autobuilder.yocto.io/pub/non-release/20230727-9/testresults/qemux86-64-tc/

glibc            | 5016         | 40       | 144         | -

Thanks,

Anuj