[LTP] [PATCH v5 0/4] Run tests in CI

Petr Vorel
2021-07-15T07:38:19Z

Hi Cyril,

...
> > I guess this should fix it:

> > diff --git a/lib/tst_test.c b/lib/tst_test.c
> > index f4d9f8e3b..084a83c9e 100644
> > --- a/lib/tst_test.c
> > +++ b/lib/tst_test.c
> > @@ -734,12 +734,12 @@ static void do_exit(int ret)
> > if (results->broken)
> > ret |= TBROK;

> > - printf("\nSummary:\n");
> > - printf("passed %d\n", results->passed);
> > - printf("failed %d\n", results->failed);
> > - printf("broken %d\n", results->broken);
> > - printf("skipped %d\n", results->skipped);
> > - printf("warnings %d\n", results->warnings);
> > + fprintf(stderr, "\nSummary:\n");
> > + fprintf(stderr, "passed %d\n", results->passed);
> > + fprintf(stderr, "failed %d\n", results->failed);
> > + fprintf(stderr, "broken %d\n", results->broken);
> > + fprintf(stderr, "skipped %d\n", results->skipped);
> > + fprintf(stderr, "warnings %d\n", results->warnings);
> > }

> Thanks! Testing it in https://github.com/pevik/ltp/actions/runs/1031005963

The result is much better but still not correct:
https://github.com/pevik/ltp/runs/3068932859?check_suite_focus=true#step:11:707

runtest TINFO: * shell/net/tst_ipaddr_un.sh

Summary:
passed 0
failed 0
broken 0
skipped 1
warnings 0
tst_ipaddr_un 1 TINFO: timeout per run is 0h 5m 0s

Could you please merge your fix? And I'll try sync after each test.
https://github.com/pevik/ltp/actions/runs/1033070696

What is worse is that tests are green, but I see TBROK and TWARN which are not
reflected by results:

tst_check_driver 1 TBROK: Test still running, sending SIGKILL
...
tst_rhost_run 1 TCONF: (null) 0 TWARN : tst_kernel.c:105: expected file /lib/modules/5.8.0-1036-azure/modules.dep does not exist or not a file

veth(null) 0 TWARN : tst_kernel.c:105: expected file /lib/modules/5.8.0-1036-azure/modules.builtin does not exist or not a file driver not available
Summary:
passed 0
failed 0
broken 0
skipped 1
warnings 0

runtest TINFO: === SHELL TEST RESULTS ===
runtest TINFO: 1x TPASS: shell/net/tst_ipaddr_un.sh
runtest TINFO: 0x TFAIL:
runtest TINFO: 0x TBROK:
runtest TINFO: 0x TWARN:
runtest TINFO: 2x TCONF: shell/tst_check_driver.sh shell/net/tst_rhost_run.sh

Kind regards,
Petr

> Kind regards,
> Petr