Re: [PATCH 10/24] ptests: exclude lttng-tools

[Jonathan Rajotte-Julien <jonathan.rajotte-julien@efficios.com>]

On Fri, Jan 24, 2020 at 01:47:48PM +0100, Alexander Kanavin wrote:
> I have traced the failing tests to missing supplementary shell scripts that
> apparently are newly added, and weren't packaged to the target.
> 
> Also, /tmp indeed wasn't big enough.
> 
> With those issues addressed (patch is coming), I am still having two
> failures:

Thanks for that effort.

> 
> #     Failed test
> (../../../../../lttng-tools-2.11.0/tests/regression/tools/live/live_test.c:main()
> at line 707)
> # Got first packet index with offset 0 and len 4096
> not ok 6 - Get metadata, received 0 bytes
> FAIL: tools/live/test_ust_tracefile_count 6 - Get metadata, received 0 bytes
> 
> # Got first packet index with offset 0 and len 4096
> not ok 6 - Get metadata, received 0 bytes
> FAIL: tools/live/test_ust 6 - Get metadata, received 0 bytes
> 
> What's weird is that sometimes they pass. Could there be a race or some
> timing issue in the test?

This indeed seems suspicious. Are you able to reproduce it rather quickly? If so
we can continue this in private for the instruction on the base setup so I can
reproduce it and get working on it.

These tests have a lot of moving parts.

Cheers

> 
> Alex
> 
> On Mon, 20 Jan 2020 at 18:37, Jonathan Rajotte-Julien <
> jonathan.rajotte-julien@efficios.com> wrote:
> 
> > Could you point me toward reports for the failing tests?
> >
> > I just want to make sure they are not actual regression.
> >
> > A yocto specific patch was dropped that allowed ptest to pass when
> > lttng-ust is not present. This can be a source of problems.
> > OE commit:015aea5d93614676decd18578a8ae2d68417cfc5
> >
> > Also some tests required a minimum requirement for /tmp that could lead to
> > problem for image/test setup with limited memory since AFAIK /tmp size is
> > derived from the available memory (at least when using qemu test image).
> >
> > Cheers
> >
> > On Mon, Jan 20, 2020 at 06:24:56PM +0100, Alexander Kanavin wrote:
> > > These tests are producing failures that appear and
> > > disappear randomly. This requires investigation
> > > by someone with expertise, so let's disable until then.
> > >
> > > Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
> > > ---
> > >  meta/conf/distro/include/ptest-packagelists.inc | 2 +-
> > >  1 file changed, 1 insertion(+), 1 deletion(-)
> > >
> > > diff --git a/meta/conf/distro/include/ptest-packagelists.inc
> > b/meta/conf/distro/include/ptest-packagelists.inc
> > > index 49cb9046c6c..f42e90bd187 100644
> > > --- a/meta/conf/distro/include/ptest-packagelists.inc
> > > +++ b/meta/conf/distro/include/ptest-packagelists.inc
> > > @@ -58,6 +58,7 @@ PTESTS_FAST = "\
> > >  #    rt-tests-ptest \ # Needs to be checked whether it runs at all
> > >  #    bash-ptest \ # Test outcomes are non-deterministic by design
> > >  #    mdadm-ptest \ # Multiple failures; mdmon crashes in at least one
> > of the tests
> > > +#    lttng-tools-ptest \ # Random failures that are difficult to
> > reproduce
> > >  #"
> > >
> > >  PTESTS_SLOW = "\
> > > @@ -67,7 +68,6 @@ PTESTS_SLOW = "\
> > >      glib-2.0-ptest \
> > >      gstreamer1.0-ptest \
> > >      libevent-ptest \
> > > -    lttng-tools-ptest \
> > >      openssh-ptest \
> > >      openssl-ptest \
> > >      perl-ptest \
> > > --
> > > 2.17.1
> > >
> > > --
> > > _______________________________________________
> > > Openembedded-core mailing list
> > > Openembedded-core@lists.openembedded.org
> > > http://lists.openembedded.org/mailman/listinfo/openembedded-core
> >
> > --
> > Jonathan Rajotte-Julien
> > EfficiOS
> >

-- 
Jonathan Rajotte-Julien
EfficiOS