From: Petr Vorel <pvorel@suse.cz>
To: ltp@lists.linux.it
Subject: [LTP] [PATCH v5 0/4] Run tests in CI
Date: Thu, 15 Jul 2021 09:38:19 +0200 [thread overview]
Message-ID: <YO/l6yni/AAOGhn9@pevik> (raw)
In-Reply-To: <YO8UIP310jsAmq8I@pevik>
Hi Cyril,
...
> > I guess this should fix it:
> > diff --git a/lib/tst_test.c b/lib/tst_test.c
> > index f4d9f8e3b..084a83c9e 100644
> > --- a/lib/tst_test.c
> > +++ b/lib/tst_test.c
> > @@ -734,12 +734,12 @@ static void do_exit(int ret)
> > if (results->broken)
> > ret |= TBROK;
> > - printf("\nSummary:\n");
> > - printf("passed %d\n", results->passed);
> > - printf("failed %d\n", results->failed);
> > - printf("broken %d\n", results->broken);
> > - printf("skipped %d\n", results->skipped);
> > - printf("warnings %d\n", results->warnings);
> > + fprintf(stderr, "\nSummary:\n");
> > + fprintf(stderr, "passed %d\n", results->passed);
> > + fprintf(stderr, "failed %d\n", results->failed);
> > + fprintf(stderr, "broken %d\n", results->broken);
> > + fprintf(stderr, "skipped %d\n", results->skipped);
> > + fprintf(stderr, "warnings %d\n", results->warnings);
> > }
> Thanks! Testing it in https://github.com/pevik/ltp/actions/runs/1031005963
The result is much better but still not correct:
https://github.com/pevik/ltp/runs/3068932859?check_suite_focus=true#step:11:707
runtest TINFO: * shell/net/tst_ipaddr_un.sh
Summary:
passed 0
failed 0
broken 0
skipped 1
warnings 0
tst_ipaddr_un 1 TINFO: timeout per run is 0h 5m 0s
Could you please merge your fix? And I'll try sync after each test.
https://github.com/pevik/ltp/actions/runs/1033070696
What is worse is that tests are green, but I see TBROK and TWARN which are not
reflected by results:
tst_check_driver 1 TBROK: Test still running, sending SIGKILL
...
tst_rhost_run 1 TCONF: (null) 0 TWARN : tst_kernel.c:105: expected file /lib/modules/5.8.0-1036-azure/modules.dep does not exist or not a file
veth(null) 0 TWARN : tst_kernel.c:105: expected file /lib/modules/5.8.0-1036-azure/modules.builtin does not exist or not a file driver not available
Summary:
passed 0
failed 0
broken 0
skipped 1
warnings 0
runtest TINFO: === SHELL TEST RESULTS ===
runtest TINFO: 1x TPASS: shell/net/tst_ipaddr_un.sh
runtest TINFO: 0x TFAIL:
runtest TINFO: 0x TBROK:
runtest TINFO: 0x TWARN:
runtest TINFO: 2x TCONF: shell/tst_check_driver.sh shell/net/tst_rhost_run.sh
Kind regards,
Petr
> Kind regards,
> Petr
next prev parent reply other threads:[~2021-07-15 7:38 UTC|newest]
Thread overview: 12+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-07-14 14:19 [LTP] [PATCH v5 0/4] Run tests in CI Petr Vorel
2021-07-14 14:19 ` [LTP] [PATCH v5 1/4] lib: Add script for running tests Petr Vorel
2021-07-14 14:19 ` [LTP] [PATCH v5 2/4] make: Add make test{, -c, -shell} targets Petr Vorel
2021-07-14 14:20 ` [LTP] [PATCH v5 3/4] build.sh: Add support for make test Petr Vorel
2021-07-14 14:20 ` [LTP] [PATCH v5 4/4] CI: Run also " Petr Vorel
2021-07-14 14:27 ` [LTP] [PATCH v5 0/4] Run tests in CI Petr Vorel
2021-07-14 15:00 ` Cyril Hrubis
2021-07-14 16:43 ` Petr Vorel
2021-07-15 7:38 ` Petr Vorel [this message]
2021-07-15 7:48 ` Petr Vorel
2021-07-15 8:51 ` Cyril Hrubis
2021-07-15 9:22 ` Petr Vorel
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=YO/l6yni/AAOGhn9@pevik \
--to=pvorel@suse.cz \
--cc=ltp@lists.linux.it \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox