From: "?ukasz Majewski" <lukma@denx.de>
To: Anibal Limon <anibal.limon@linaro.org>
Cc: yocto@lists.yoctoproject.org,
Adrian Freihofer <adrian.freihofer@siemens.com>
Subject: Re: [PATCH v2 ptest-runner 2/2] main: Do not return number of failed tests when calling ptest-runner
Date: Mon, 20 Sep 2021 11:18:52 +0200 [thread overview]
Message-ID: <20210920111852.174eff07@ktm> (raw)
In-Reply-To: <20210827124350.71c00d33@ktm>
[-- Attachment #1: Type: text/plain, Size: 2038 bytes --]
Hi Anibal,
> Hi Anibal,
>
> > Up till now ptest-runner2 returns number of failed tests with its
> > exit status code. Such use case is not recommended [1] and may cause
> > issues when there are more than 256 tests to be executed.
> >
> > To alleviate this issue the number of total tests with number of
> > failed ones is printed before exit. To be more specific - failure of
> > tests (one or more) causes ptest-runner to provide exit code of 1.
> >
> > One can test this change with executing:
> > ./ptest-runner -d tests/data fail
>
> Gentle ping on this patch.
>
Gentle ping on this patch.
Is it OK to be applied?
> >
> > Links:
> > [1] -
> > https://www.gnu.org/software/libc/manual/html_node/Exit-Status.html
> >
> > Signed-off-by: Lukasz Majewski <lukma@denx.de>
> > ---
> > Changes for v2:
> > - When number of failed tests is N, the ptest-runner returns value
> > of 1 to indicate error in the execution
> > ---
> > main.c | 3 +++
> > 1 file changed, 3 insertions(+)
> >
> > diff --git a/main.c b/main.c
> > index 890bc6a..bcec844 100644
> > --- a/main.c
> > +++ b/main.c
> > @@ -220,6 +220,9 @@ main(int argc, char *argv[])
> > ptest_list_remove(run, opts.exclude[i], 1);
> >
> > rc = run_ptests(run, opts, argv[0], stdout, stderr);
> > + fprintf(stdout, "TOTAL: %d FAIL: %d\n",
> > ptest_list_length(run), rc);
> > + if (rc > 0)
> > + rc = 1;
> >
> > ptest_list_free_all(&run);
> >
>
>
>
>
> Best regards,
>
> Lukasz Majewski
>
> --
>
> DENX Software Engineering GmbH, Managing Director: Wolfgang Denk
> HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
> Phone: (+49)-8142-66989-59 Fax: (+49)-8142-66989-80 Email:
> lukma@denx.de
Best regards,
Lukasz Majewski
--
DENX Software Engineering GmbH, Managing Director: Wolfgang Denk
HRB 165235 Munich, Office: Kirchenstr.5, D-82194 Groebenzell, Germany
Phone: (+49)-8142-66989-59 Fax: (+49)-8142-66989-80 Email: lukma@denx.de
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 499 bytes --]
next prev parent reply other threads:[~2021-09-20 9:19 UTC|newest]
Thread overview: 9+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-08-17 12:38 [PATCH v2 ptest-runner 1/2] mem: Refactor ptest_list cleanup ?ukasz Majewski
2021-08-17 12:38 ` [PATCH v2 ptest-runner 2/2] main: Do not return number of failed tests when calling ptest-runner ?ukasz Majewski
2021-08-27 10:43 ` ?ukasz Majewski
2021-09-20 9:18 ` ?ukasz Majewski [this message]
2021-09-20 9:23 ` [yocto] " Alexander Kanavin
2021-09-23 16:18 ` Anibal Limon
2021-09-27 8:09 ` Lukasz Majewski
2021-09-27 8:35 ` Alexander Kanavin
2021-09-27 18:59 ` Anibal Limon
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20210920111852.174eff07@ktm \
--to=lukma@denx.de \
--cc=adrian.freihofer@siemens.com \
--cc=anibal.limon@linaro.org \
--cc=yocto@lists.yoctoproject.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.