From: "Alex Bennée" <alex.bennee@linaro.org>
To: cota@braap.org, famz@redhat.com, berrange@redhat.com,
f4bug@amsat.org, richard.henderson@linaro.org, balrogg@gmail.com,
aurelien@aurel32.net, agraf@suse.de
Cc: pbonzini@redhat.com, qemu-devel@nongnu.org,
"Alex Bennée" <alex.bennee@linaro.org>
Subject: [Qemu-devel] [PATCH v3 06/20] travis: add gcovr summary for GCOV build
Date: Mon, 2 Jul 2018 15:30:07 +0100 [thread overview]
Message-ID: <20180702143021.18864-7-alex.bennee@linaro.org> (raw)
In-Reply-To: <20180702143021.18864-1-alex.bennee@linaro.org>
This gives a more useful summary, sorted by descending % coverage,
after the tests have run. The final numbers will give an idea if our
coverage is getting better or worse.
To keep the width sane we need to post process the file that the old
gcovr tool generates. This is done with a mix of sed, awk and column
in the scripts/coverage-summary.sh script.
As quite a lot of lines don't get covered at all we filter out all the
0% lines. If the file doesn't appear it is not being exercised.
Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
Reviewed-by: Daniel P. Berrangé <berrange@redhat.com>
---
v2
- pushed finagling into scripts/coverage-summary.sh
- dropped r-b as a big change
v3
- move from scripts to scripts/travis and update MAINTAINERS
---
.travis.yml | 3 +++
MAINTAINERS | 1 +
scripts/travis/coverage-summary.sh | 27 +++++++++++++++++++++++++++
3 files changed, 31 insertions(+)
create mode 100755 scripts/travis/coverage-summary.sh
diff --git a/.travis.yml b/.travis.yml
index 32188d51f1..95be6ec59f 100644
--- a/.travis.yml
+++ b/.travis.yml
@@ -38,6 +38,7 @@ addons:
- libvte-2.90-dev
- sparse
- uuid-dev
+ - gcovr
# The channel name "irc.oftc.net#qemu" is encrypted against qemu/qemu
# to prevent IRC notifications from forks. This was created using:
@@ -86,6 +87,8 @@ matrix:
compiler: clang
# gprof/gcov are GCC features
- env: CONFIG="--enable-gprof --enable-gcov --disable-pie --target-list=aarch64-softmmu,arm-softmmu,i386-softmmu,mips-softmmu,mips64-softmmu,ppc64-softmmu,riscv64-softmmu,s390x-softmmu,x86_64-softmmu"
+ after_success:
+ - ${SRC_DIR}/scripts/travis/coverage-summary.sh
compiler: gcc
# We manually include builds which we disable "make check" for
- env: CONFIG="--enable-debug --enable-tcg-interpreter"
diff --git a/MAINTAINERS b/MAINTAINERS
index 42a1892d6a..4917b8e48d 100644
--- a/MAINTAINERS
+++ b/MAINTAINERS
@@ -2165,6 +2165,7 @@ R: Philippe Mathieu-Daudé <f4bug@amsat.org>
L: qemu-devel@nongnu.org
S: Maintained
F: .travis.yml
+F: scripts/travis/
F: .shippable.yml
F: tests/docker/
F: tests/vm/
diff --git a/scripts/travis/coverage-summary.sh b/scripts/travis/coverage-summary.sh
new file mode 100755
index 0000000000..d7086cf9ca
--- /dev/null
+++ b/scripts/travis/coverage-summary.sh
@@ -0,0 +1,27 @@
+#!/bin/sh
+#
+# Author: Alex Bennée <alex.bennee@linaro.org>
+#
+# Summerise the state of code coverage with gcovr and tweak the output
+# to be more sane on Travis hosts. As we expect to be executed on a
+# throw away CI instance we do spam temp files all over the shop. You
+# most likely don't want to execute this script but just call gcovr
+# directly. See also "make coverage-report"
+#
+# This code is licensed under the GPL version 2 or later. See
+# the COPYING file in the top-level directory.
+
+# first generate the coverage report
+gcovr -p -o raw-report.txt
+
+# strip the full-path and line markers
+sed s@$PWD\/@@ raw-report.txt | sed s/[0-9]\*[,-]//g > simplified.txt
+
+# reflow lines that got split
+awk '/.[ch]$/ { printf("%s", $0); next } 1' simplified.txt > rejoined.txt
+
+# columnify
+column -t rejoined.txt > final.txt
+
+# and dump, stripping out 0% coverage
+grep -v "0%" final.txt
--
2.17.1
next prev parent reply other threads:[~2018-07-02 14:30 UTC|newest]
Thread overview: 32+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-07-02 14:30 [Qemu-devel] [PATCH v3 00/20] Travis, Code Coverage and Cross Build updates Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 01/20] travis: do not waste time cloning unused submodules Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 02/20] travis: test out-of-tree builds Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 03/20] build-system: remove per-test GCOV reporting Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 04/20] .gitignore: add .gcov files Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 05/20] docker: add gcovr to travis image Alex Bennée
2018-07-02 14:30 ` Alex Bennée [this message]
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 07/20] build-system: add clean-coverage target Alex Bennée
2018-07-02 15:45 ` Philippe Mathieu-Daudé
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 08/20] build-system: add coverage-report target Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 09/20] linux-user: introduce preexit_cleanup Alex Bennée
2018-07-02 16:22 ` Philippe Mathieu-Daudé
2018-07-02 16:30 ` Philippe Mathieu-Daudé
2018-07-02 17:59 ` Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 10/20] linux-user: add gcov support to preexit_cleanup Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 11/20] docker: filter out linux-user builds for mingw Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 12/20] docker: ubuntu: Update the package list before installing new ones Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 13/20] docker: ubuntu: Use SDL2 Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 14/20] docker: Clean the MXE base image Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 15/20] docker: Do not run tests in 'intermediate' images Alex Bennée
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 16/20] docker: drop QEMU build-dep from bootstrap Alex Bennée
2018-07-02 20:20 ` Philippe Mathieu-Daudé
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 17/20] docker: debian-bootstrap.pre allow customising of variant/url Alex Bennée
2018-07-02 20:20 ` Philippe Mathieu-Daudé
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 18/20] docker: add special handling for FROM:debian-%-user targets Alex Bennée
2018-07-02 20:21 ` Philippe Mathieu-Daudé
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 19/20] docker: add special rule for deboostrapped images Alex Bennée
2018-07-02 20:32 ` Philippe Mathieu-Daudé
2018-07-02 14:30 ` [Qemu-devel] [PATCH v3 20/20] docker: add linux-user powered cross builder for QEMU Alex Bennée
2018-07-02 20:35 ` Philippe Mathieu-Daudé
2018-07-02 23:50 ` Philippe Mathieu-Daudé
2018-07-02 19:20 ` [Qemu-devel] [PATCH v3 00/20] Travis, Code Coverage and Cross Build updates no-reply
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20180702143021.18864-7-alex.bennee@linaro.org \
--to=alex.bennee@linaro.org \
--cc=agraf@suse.de \
--cc=aurelien@aurel32.net \
--cc=balrogg@gmail.com \
--cc=berrange@redhat.com \
--cc=cota@braap.org \
--cc=f4bug@amsat.org \
--cc=famz@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=richard.henderson@linaro.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).