Re: [OE-core] [PATCH 23/23] ptest-packagelists.inc: exclude lttng-tools-ptest

Alexander Kanavin
2020-12-04T20:48:21Z

[-- Attachment #1: Type: text/plain, Size: 3230 bytes --]

This is the patch that disables the sporadically failing stuff:
http://git.yoctoproject.org/cgit/cgit.cgi/poky/tree/meta/recipes-kernel/lttng/lttng-tools/0001-tests-regression-disable-the-tools-live-tests.patch

And this is the bug I had filed upstream:
https://bugs.lttng.org/issues/1217

As no movement occurred on that bug since Jan, I am not keen on filing
additional bugs, but you can see the additional, currently occuring
failures here:
https://autobuilder.yocto.io/pub/non-release/20201204-4/testresults/qemux86-64-ptest/lttng-tools.log

Alex

On Fri, 4 Dec 2020 at 21:39, Jonathan Rajotte-Julien <
jonathan.rajotte-julien@efficios.com> wrote:

> Hi,
>
> Upstream here.
>
> Always happy to give input as long as we are put in the loop.
> Also bugs/sporadic test failure can be reported on our mailing list [1]
> and bug tracker[2].
>
> [1] https://lists.lttng.org/cgi-bin/mailman/listinfo/lttng-dev
> [2] https://bugs.lttng.org/
>
> We understand that the burden can be quite high for a project such as
> lttng given we end up doing weird
> testing due to the nature of our work and that we are human ;).
> Still we are always interested in getting info about "sporadic" failures.
>
> To be clear, we are not against this patch. We understand the burden
> associated with testing lttng.
>
> Cheers
>
> ----- Original Message -----
> > From: "Alexander Kanavin" <alex.kanavin@gmail.com>
> > To: "openembedded-core" <openembedded-core@lists.openembedded.org>
> > Cc: "Alexander Kanavin" <alex.kanavin@gmail.com>
> > Sent: Friday, December 4, 2020 3:07:36 PM
> > Subject: [OE-core] [PATCH 23/23] ptest-packagelists.inc: exclude
> lttng-tools-ptest
>
> > These tests have been failing for a long time (and even more failing
> > tests are already patched out); no one in YP has the
> > expertise to fix the issues, so until upstream steps in, let's take
> > them out, and try to reach the goal of hard ptest failures so that
> > ptest regressions are caught as they happen.
> >
> > Signed-off-by: Alexander Kanavin <alex.kanavin@gmail.com>
> > ---
> > meta/conf/distro/include/ptest-packagelists.inc | 2 +-
> > 1 file changed, 1 insertion(+), 1 deletion(-)
> >
> > diff --git a/meta/conf/distro/include/ptest-packagelists.inc
> > b/meta/conf/distro/include/ptest-packagelists.inc
> > index ce13368c2e..90272a70af 100644
> > --- a/meta/conf/distro/include/ptest-packagelists.inc
> > +++ b/meta/conf/distro/include/ptest-packagelists.inc
> > @@ -60,6 +60,7 @@ PTESTS_FAST_remove_mips64 = "qemu-ptest"
> > # bash-ptest \ # Test outcomes are non-deterministic by design
> > # ifupdown-ptest \ # Tested separately in
> > lib/oeqa/selftest/cases/imagefeatures.py
> > # mdadm-ptest \ # Tests rely on non-deterministic sleep() amounts
> > +# lttng-tools-ptest \ # multiple sporadic failures, lack of
> expertise in the
> > project to look into them
> > #"
> >
> > PTESTS_SLOW = "\
> > @@ -73,7 +74,6 @@ PTESTS_SLOW = "\
> > gstreamer1.0-ptest \
> > libevent-ptest \
> > libinput-ptest \
> > - lttng-tools-ptest \
> > openssh-ptest \
> > openssl-ptest \
> > perl-ptest \
> > --
> > 2.29.2
> >
> >
> >
> >
>

[-- Attachment #2: Type: text/html, Size: 4783 bytes --]