* Recipes with ptest dependency problems
@ 2019-04-17 21:55 Richard Purdie
2019-04-18 15:56 ` Richard Purdie
0 siblings, 1 reply; 3+ messages in thread
From: Richard Purdie @ 2019-04-17 21:55 UTC (permalink / raw)
To: openembedded-core
I mentioned differences in numbers of pass/fail depending on which
image you install ptests into. The recipes which have the issues and
the numbers are:
core-image-sato with ptest installed:
Recipe | Passed | Failed | Skipped |
diffutils | 20 | 0 | 1 |
elfutils | 31 | 6 | 166 |
flex | 0 | 0 | 0 |
gzip | 3 | 19 | 0 |
libxml-parser-perl | 0 | 15 | 0 |
lttng-tools | 3397 | 626 | 1 | T
nettle | 95 | 2 | 2 |
openssh | 0 | 0 | 1 |
perl | 2425 | 20 | 235 |
python | 304 | 6 | 39 |
python3 | 30321 | 2 | 1019 |
quilt | 23 | 34 | 0 |
tcl | 148 | 1 | 0 |
util-linux | 378 | 2 | 58 |
valgrind | 0 | 0 | 0 |
core-image-sato-sdk with ptest installed:
Recipe | Passed | Failed | Skipped |
diffutils | 21 | 0 | 0 |
elfutils | 31 | 4 | 168 |
flex | 114 | 0 | 0 |
gzip | 22 | 0 | 0 |
libxml-parser-perl | 15 | 0 | 0 |
lttng-tools | 4693 | 1 | 412 |
nettle | 96 | 1 | 2 |
openssh | 67 | 0 | 3 |
perl | 2430 | 19 | 231 |
python | 131 | 1 | 17 |
python3 | 30329 | 2 | 1011 |
quilt | 57 | 0 | 0 |
tcl | 149 | 0 | 0 |
util-linux | 473 | 2 | 52 |
valgrind | 297 | 251 | 31 |
I appreciate some of the numbers don't add up e.g. valgrind skips 0
tests? or the util-linux skip counts. I cropped the time taken counts
out as they confuse the diff other than to note the timeout/hang in
lttng-tools.
We probably need bugzilla entries for each one of these to look into
and fix the ptest package dependencies so the pass/fail counts are the
same in a core-image-sato to core-image-sato-sdk.
Cheers,
Richard
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: Recipes with ptest dependency problems
@ 2019-04-18 1:11 Jonathan Rajotte-Julien
0 siblings, 0 replies; 3+ messages in thread
From: Jonathan Rajotte-Julien @ 2019-04-18 1:11 UTC (permalink / raw)
To: Richard Purdie; +Cc: openembedded-core
[-- Attachment #1: Type: text/html, Size: 4136 bytes --]
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: Recipes with ptest dependency problems
2019-04-17 21:55 Richard Purdie
@ 2019-04-18 15:56 ` Richard Purdie
0 siblings, 0 replies; 3+ messages in thread
From: Richard Purdie @ 2019-04-18 15:56 UTC (permalink / raw)
To: openembedded-core
On Wed, 2019-04-17 at 22:55 +0100, Richard Purdie wrote:
> I mentioned differences in numbers of pass/fail depending on which
> image you install ptests into. The recipes which have the issues and
> the numbers are:
>
> core-image-sato with ptest installed:
>
> Recipe | Passed | Failed | Skipped |
>
> diffutils | 20 | 0 | 1 |
> elfutils | 31 | 6 | 166 |
> flex | 0 | 0 | 0 |
> gzip | 3 | 19 | 0 |
> libxml-parser-perl | 0 | 15 | 0 |
> lttng-tools | 3397 | 626 | 1 | T
> nettle | 95 | 2 | 2 |
> openssh | 0 | 0 | 1 |
> perl | 2425 | 20 | 235 |
> python | 304 | 6 | 39 |
> python3 | 30321 | 2 | 1019 |
> quilt | 23 | 34 | 0 |
> tcl | 148 | 1 | 0 |
> util-linux | 378 | 2 | 58 |
> valgrind | 0 | 0 | 0 |
The testresults.json file for these tests is:
https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json
To get the report above you can:
wget https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json
/path/to/oe-core/scripts/resulttool report testresults.json
To get the test log output you can:
wget https://autobuilder.yocto.io/pub/non-release/20190417-10/testresults/qemux86-64-ptest/testresults.json
/path/to/oe-core/scripts/resulttool store testresults.json /path/to/new-results-gitrepo
cd /path/to/new-results-gitrepo
git checkout master-next
less repo/runtime/poky/qemux86-64/core-image-sato-ptest/ptest-lttng-tools.log
> core-image-sato-sdk with ptest installed:
>
> Recipe | Passed | Failed | Skipped |
>
> diffutils | 21 | 0 | 0 |
> elfutils | 31 | 4 | 168 |
> flex | 114 | 0 | 0 |
> gzip | 22 | 0 | 0 |
> libxml-parser-perl | 15 | 0 | 0 |
> lttng-tools | 4693 | 1 | 412 |
> nettle | 96 | 1 | 2 |
> openssh | 67 | 0 | 3 |
> perl | 2430 | 19 | 231 |
> python | 131 | 1 | 17 |
> python3 | 30329 | 2 | 1011 |
> quilt | 57 | 0 | 0 |
> tcl | 149 | 0 | 0 |
> util-linux | 473 | 2 | 52 |
> valgrind | 297 | 251 | 31 |
For these the testresults.json file is:
https://autobuilder.yocto.io/pub/non-release/20190417-14/testresults/qemux86-64-ptest/testresults.json
Commands to diving into this are similar to the above.
I would like to:
a) teach resulttool how to handle http urls itself
b) add a command just to dump the ptest logs to the current directory
c) add the logs to the autobuilder http:// urls magically
but simply haven't gotten there with those yet, the tool itself is
clearly nearly there!
Cheers,
Richard
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2019-04-18 15:56 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2019-04-18 1:11 Recipes with ptest dependency problems Jonathan Rajotte-Julien
-- strict thread matches above, loose matches on Subject: below --
2019-04-17 21:55 Richard Purdie
2019-04-18 15:56 ` Richard Purdie
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox