[PATCH] valgrind: skip intermittently failing ptests

[PATCH] valgrind: skip intermittently failing ptests

[Randy.MacLeod]

From: Randy MacLeod <Randy.MacLeod@windriver.com>

Skip a few additional ptests that fail occasionally on the Yocto
autobuilder and remove those added to the remove-for-all list
if they were already in the remove-for-aarch64 list.

=== Test Summary ===
TOTAL: 774
PASSED: 755
FAILED: 0
SKIPPED: 19

Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
---
 meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64 | 2 --
 meta/recipes-devtools/valgrind/valgrind/remove-for-all     | 4 ++++
 2 files changed, 4 insertions(+), 2 deletions(-)

diff --git a/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64 b/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64
index 04f159d701..5bfba1c8d3 100644
--- a/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64
+++ b/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64
@@ -1,5 +1,4 @@
 drd/tests/annotate_sem
-drd/tests/boost_thread
 gdbserver_tests/hgtls
 helgrind/tests/hg05_race2
 helgrind/tests/tc20_verifywrap
@@ -15,7 +14,6 @@ memcheck/tests/atomic_incs
 memcheck/tests/bug464969_d_demangle
 memcheck/tests/cxx17_aligned_new
 memcheck/tests/demangle
-memcheck/tests/linux/timerfd-syscall
 memcheck/tests/long_namespace_xml
 memcheck/tests/mismatches
 memcheck/tests/mismatches_xml
diff --git a/meta/recipes-devtools/valgrind/valgrind/remove-for-all b/meta/recipes-devtools/valgrind/valgrind/remove-for-all
index 004589a7ea..8435a6d41d 100644
--- a/meta/recipes-devtools/valgrind/valgrind/remove-for-all
+++ b/meta/recipes-devtools/valgrind/valgrind/remove-for-all
@@ -1,8 +1,12 @@
 cachegrind/tests/wrap5
+drd/tests/boost_thread
 none/tests/amd64/fb_test_amd64
+none/tests/tls
 gdbserver_tests/hginfo
+gdbserver_tests/mcinvokeRU
 memcheck/tests/linux/dlclose_leak-no-keep
 memcheck/tests/linux/dlclose_leak
+memcheck/tests/linux/timerfd-syscall
 memcheck/tests/supp_unknown
 memcheck/tests/wrap1
 memcheck/tests/wrap2
-- 
2.43.0

Re: [OE-core] [PATCH] valgrind: skip intermittently failing ptests

[Khem Raj]

do we know the reason for these failures or some details ?

On Wed, Mar 6, 2024 at 5:52 PM Randy MacLeod via
lists.openembedded.org
<randy.macleod=windriver.com@lists.openembedded.org> wrote:
>
> From: Randy MacLeod <Randy.MacLeod@windriver.com>
>
> Skip a few additional ptests that fail occasionally on the Yocto
> autobuilder and remove those added to the remove-for-all list
> if they were already in the remove-for-aarch64 list.
>
> === Test Summary ===
> TOTAL: 774
> PASSED: 755
> FAILED: 0
> SKIPPED: 19
>
> Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
> ---
>  meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64 | 2 --
>  meta/recipes-devtools/valgrind/valgrind/remove-for-all     | 4 ++++
>  2 files changed, 4 insertions(+), 2 deletions(-)
>
> diff --git a/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64 b/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64
> index 04f159d701..5bfba1c8d3 100644
> --- a/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64
> +++ b/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64
> @@ -1,5 +1,4 @@
>  drd/tests/annotate_sem
> -drd/tests/boost_thread
>  gdbserver_tests/hgtls
>  helgrind/tests/hg05_race2
>  helgrind/tests/tc20_verifywrap
> @@ -15,7 +14,6 @@ memcheck/tests/atomic_incs
>  memcheck/tests/bug464969_d_demangle
>  memcheck/tests/cxx17_aligned_new
>  memcheck/tests/demangle
> -memcheck/tests/linux/timerfd-syscall
>  memcheck/tests/long_namespace_xml
>  memcheck/tests/mismatches
>  memcheck/tests/mismatches_xml
> diff --git a/meta/recipes-devtools/valgrind/valgrind/remove-for-all b/meta/recipes-devtools/valgrind/valgrind/remove-for-all
> index 004589a7ea..8435a6d41d 100644
> --- a/meta/recipes-devtools/valgrind/valgrind/remove-for-all
> +++ b/meta/recipes-devtools/valgrind/valgrind/remove-for-all
> @@ -1,8 +1,12 @@
>  cachegrind/tests/wrap5
> +drd/tests/boost_thread
>  none/tests/amd64/fb_test_amd64
> +none/tests/tls
>  gdbserver_tests/hginfo
> +gdbserver_tests/mcinvokeRU
>  memcheck/tests/linux/dlclose_leak-no-keep
>  memcheck/tests/linux/dlclose_leak
> +memcheck/tests/linux/timerfd-syscall
>  memcheck/tests/supp_unknown
>  memcheck/tests/wrap1
>  memcheck/tests/wrap2
> --
> 2.43.0
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#196760): https://lists.openembedded.org/g/openembedded-core/message/196760
> Mute This Topic: https://lists.openembedded.org/mt/104780048/1997914
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [raj.khem@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>

Re: [OE-core] [PATCH] valgrind: skip intermittently failing ptests

[Randy MacLeod]

[-- Attachment #1: Type: text/plain, Size: 3143 bytes --]

On Wed, Mar 6, 2024, 22:31 Khem Raj <raj.khem@gmail.com> wrote:

> do we know the reason for these failures or some details ?
>

Not yet. I'm just skipping the tests for now to make the YP auto builder
less noisy.

Some day I'll make time to work on understanding and hopefully fixing all
the slipped tests.


Randy


> On Wed, Mar 6, 2024 at 5:52 PM Randy MacLeod via
> lists.openembedded.org
> <randy.macleod=windriver.com@lists.openembedded.org> wrote:
> >
> > From: Randy MacLeod <Randy.MacLeod@windriver.com>
> >
> > Skip a few additional ptests that fail occasionally on the Yocto
> > autobuilder and remove those added to the remove-for-all list
> > if they were already in the remove-for-aarch64 list.
> >
> > === Test Summary ===
> > TOTAL: 774
> > PASSED: 755
> > FAILED: 0
> > SKIPPED: 19
> >
> > Signed-off-by: Randy MacLeod <Randy.MacLeod@windriver.com>
> > ---
> >  meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64 | 2 --
> >  meta/recipes-devtools/valgrind/valgrind/remove-for-all     | 4 ++++
> >  2 files changed, 4 insertions(+), 2 deletions(-)
> >
> > diff --git a/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64
> b/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64
> > index 04f159d701..5bfba1c8d3 100644
> > --- a/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64
> > +++ b/meta/recipes-devtools/valgrind/valgrind/remove-for-aarch64
> > @@ -1,5 +1,4 @@
> >  drd/tests/annotate_sem
> > -drd/tests/boost_thread
> >  gdbserver_tests/hgtls
> >  helgrind/tests/hg05_race2
> >  helgrind/tests/tc20_verifywrap
> > @@ -15,7 +14,6 @@ memcheck/tests/atomic_incs
> >  memcheck/tests/bug464969_d_demangle
> >  memcheck/tests/cxx17_aligned_new
> >  memcheck/tests/demangle
> > -memcheck/tests/linux/timerfd-syscall
> >  memcheck/tests/long_namespace_xml
> >  memcheck/tests/mismatches
> >  memcheck/tests/mismatches_xml
> > diff --git a/meta/recipes-devtools/valgrind/valgrind/remove-for-all
> b/meta/recipes-devtools/valgrind/valgrind/remove-for-all
> > index 004589a7ea..8435a6d41d 100644
> > --- a/meta/recipes-devtools/valgrind/valgrind/remove-for-all
> > +++ b/meta/recipes-devtools/valgrind/valgrind/remove-for-all
> > @@ -1,8 +1,12 @@
> >  cachegrind/tests/wrap5
> > +drd/tests/boost_thread
> >  none/tests/amd64/fb_test_amd64
> > +none/tests/tls
> >  gdbserver_tests/hginfo
> > +gdbserver_tests/mcinvokeRU
> >  memcheck/tests/linux/dlclose_leak-no-keep
> >  memcheck/tests/linux/dlclose_leak
> > +memcheck/tests/linux/timerfd-syscall
> >  memcheck/tests/supp_unknown
> >  memcheck/tests/wrap1
> >  memcheck/tests/wrap2
> > --
> > 2.43.0
> >
> >
> >
> >
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#196765):
> https://lists.openembedded.org/g/openembedded-core/message/196765
> Mute This Topic: https://lists.openembedded.org/mt/104780048/953399
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [
> rwmacleod@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
>

[-- Attachment #2: Type: text/html, Size: 4996 bytes --]