From: Richard Palethorpe <rpalethorpe@suse.de>
To: ltp@lists.linux.it
Subject: [LTP] ee
Date: Wed, 30 Jun 2021 08:11:47 +0100 [thread overview]
Message-ID: <87tulf3jyk.fsf@suse.de> (raw)
In-Reply-To: <YNuA/0J20mjiV+NC@pevik>
Hello Petr,
Petr Vorel <pvorel@suse.cz> writes:
> Hi Richie,
>
> sporadically tst_fuzzy_sync01 fails. I wonder if we can relax it somehow.
> I found it while working on enabling API tests in CI, I'll have to disable this
> one to avoid false positives.
>
> Kind regards,
> Petr
>
> ./tst_fuzzy_sync01
> tst_test.c:1311: TINFO: Timeout per run is 0h 05m 00s
> tst_fuzzy_sync01.c:224: TPASS: acs:0 act:0 art:0 | =:101 -:148 +:65
> tst_fuzzy_sync01.c:224: TPASS: acs:0 act:1 art:0 | =:101 -:0 +:0
> tst_fuzzy_sync01.c:224: TPASS: acs:1 act:1 art:1 | =:101 -:0 +:0
> tst_fuzzy_sync01.c:224: TPASS: acs:3 act:1 art:1 | =:101 -:5 +:1
> ../../include/tst_fuzzy_sync.h:522: TINFO: Minimum sampling period ended
> ../../include/tst_fuzzy_sync.h:345: TINFO: loop = 10000, delay_bias = 0
> ../../include/tst_fuzzy_sync.h:333: TINFO: start_a - start_b: { avg = -17ns, avg_dev = 4ns, dev_ratio = 0.25 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: end_a - start_a : { avg = 20773ns, avg_dev = 4714ns, dev_ratio = 0.23 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: end_b - start_b : { avg = 20849ns, avg_dev = 4710ns, dev_ratio = 0.23 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: end_a - end_b : { avg = -94ns, avg_dev = 24ns, dev_ratio = 0.26 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: spins : { avg = 54 , avg_dev = 17 , dev_ratio = 0.31 }
> ../../include/tst_fuzzy_sync.h:684: TINFO: Exceeded execution loops, requesting exit
> tst_fuzzy_sync01.c:224: TFAIL: acs:3 act:1 art:1 | =:0 -:1 +:2999999
> ../../include/tst_fuzzy_sync.h:522: TINFO: Minimum sampling period ended
> ../../include/tst_fuzzy_sync.h:345: TINFO: loop = 10000, delay_bias = 0
> ../../include/tst_fuzzy_sync.h:333: TINFO: start_a - start_b: { avg = -18ns, avg_dev = 8ns, dev_ratio = 0.46 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: end_a - start_a : { avg = 21475ns, avg_dev = 4558ns, dev_ratio = 0.21 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: end_b - start_b : { avg = 19960ns, avg_dev = 4702ns, dev_ratio = 0.24 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: end_a - end_b : { avg = 1497ns, avg_dev = 1956ns, dev_ratio = 1.31 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: spins : { avg = 43 , avg_dev = 17 , dev_ratio = 0.39 }
> ../../include/tst_fuzzy_sync.h:684: TINFO: Exceeded execution loops, requesting exit
> tst_fuzzy_sync01.c:224: TFAIL: acs:1 act:1 art:3 | =:3 -:2999996 +:1
> ../../include/tst_fuzzy_sync.h:522: TINFO: Minimum sampling period ended
> ../../include/tst_fuzzy_sync.h:345: TINFO: loop = 10000, delay_bias = 0
> ../../include/tst_fuzzy_sync.h:333: TINFO: start_a - start_b: { avg = 1529ns, avg_dev = 1930ns, dev_ratio = 1.26 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: end_a - start_a : { avg = 18630ns, avg_dev = 4565ns, dev_ratio = 0.25 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: end_b - start_b : { avg = 8430ns, avg_dev = 4163ns, dev_ratio = 0.49 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: end_a - end_b : { avg = 11729ns, avg_dev = 2725ns, dev_ratio = 0.23 }
> ../../include/tst_fuzzy_sync.h:333: TINFO: spins : { avg = 6115 , avg_dev = 33 , dev_ratio = 0.01 }
> ../../include/tst_fuzzy_sync.h:684: TINFO: Exceeded execution loops, requesting exit
> ...
It looks like the CI machines are too noisy/contended. The avg_dev is
very high. Probably we could relax the dev_ratio threshold to 0.2 or
0.3. Although we would still get failures occassionally. As this is a
probabalistic test.
Could you change the script so that it passes so long as the test
returns TPASS or TFAIL?
We don't want TBROK, TCONF or no result.
--
Thank you,
Richard.
next prev parent reply other threads:[~2021-06-30 7:11 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-06-29 20:22 [LTP] ee Petr Vorel
2021-06-29 20:59 ` [LTP] tst_fuzzy_sync01 sporadically fails Petr Vorel
2021-06-30 7:11 ` Richard Palethorpe [this message]
2021-06-30 8:01 ` [LTP] ee Petr Vorel
2021-06-30 9:12 ` Richard Palethorpe
2021-06-30 10:10 ` [LTP] tst_fuzzy_sync01 sporadically fails Petr Vorel
2021-06-30 12:05 ` Richard Palethorpe
2021-06-30 12:19 ` Petr Vorel
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87tulf3jyk.fsf@suse.de \
--to=rpalethorpe@suse.de \
--cc=ltp@lists.linux.it \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.