From: "Daniel P. Berrangé" <berrange@redhat.com>
To: qemu-devel@nongnu.org
Cc: "Thomas Huth" <thuth@redhat.com>, "Ed Maste" <emaste@freebsd.org>,
"Philippe Mathieu-Daudé" <philmd@redhat.com>,
"Daniel P. Berrangé" <berrange@redhat.com>,
"Alex Bennée" <alex.bennee@linaro.org>,
"Li-Wen Hsu" <lwhsu@freebsd.org>
Subject: [PATCH] cirrus: don't run full qtest on macOS
Date: Wed, 6 Jan 2021 11:41:59 +0000 [thread overview]
Message-ID: <20210106114159.981538-1-berrange@redhat.com> (raw)
The Cirrus CI macOS build hosts have exhibited a serious performance
degradation in recent months. For example the "qom-test" qtest takes
over an hour for only the qemu-system-aarch64 binary. This is as much
20-40 times slower than other environments. The other qtests all show
similar performance degradation, as do many of the unit tests.
This does not appear related to QEMU code changes, since older git
commits which were known to fully complete in less than 1 hour on
Cirrus CI now also show similar bad performance. Either Cirrus CI
performance has degraded, or an change in its environment has exposed
a latent bug widely affecting all of QEMU. Debugging the qom-test
showed no easily identified large bottleneck - every step of the
test execution was simply slower.
macOS builds/tests run outside Cirrus CI show normal performance.
With an inability to identify any obvious problem, the only viable
way to get a reliably completing Cirrus CI macOS job is to cut out
almost all of the qtests. We choose to run the x86_64 target only,
since that has very few machine types and thus is least badly
impacted in the qom-test execution.
With this change, the macOS jobs complete in approx 35 minutes.
Signed-off-by: Daniel P. Berrangé <berrange@redhat.com>
---
.cirrus.yml | 14 ++++++++++----
1 file changed, 10 insertions(+), 4 deletions(-)
diff --git a/.cirrus.yml b/.cirrus.yml
index 62a9b57530..3907e036da 100644
--- a/.cirrus.yml
+++ b/.cirrus.yml
@@ -18,7 +18,6 @@ freebsd_12_task:
- gmake -j$(sysctl -n hw.ncpu) check V=1
macos_task:
- timeout_in: 90m
osx_instance:
image: catalina-base
install_script:
@@ -30,10 +29,13 @@ macos_task:
--extra-cflags='-Wno-error=deprecated-declarations'
|| { cat config.log meson-logs/meson-log.txt; exit 1; }
- gmake -j$(sysctl -n hw.ncpu)
- - gmake check V=1
+ - gmake check-unit V=1
+ - gmake check-block V=1
+ - gmake check-qapi-schema V=1
+ - gmake check-softfloat V=1
+ - gmake check-qtest-x86_64 V=1
macos_xcode_task:
- timeout_in: 90m
osx_instance:
# this is an alias for the latest Xcode
image: catalina-xcode
@@ -45,7 +47,11 @@ macos_xcode_task:
- ../configure --extra-cflags='-Wno-error=deprecated-declarations' --enable-modules
--enable-werror --cc=clang || { cat config.log meson-logs/meson-log.txt; exit 1; }
- gmake -j$(sysctl -n hw.ncpu)
- - gmake check V=1
+ - gmake check-unit V=1
+ - gmake check-block V=1
+ - gmake check-qapi-schema V=1
+ - gmake check-softfloat V=1
+ - gmake check-qtest-x86_64 V=1
windows_msys2_task:
timeout_in: 90m
--
2.29.2
next reply other threads:[~2021-01-06 11:43 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-01-06 11:41 Daniel P. Berrangé [this message]
2021-01-06 12:30 ` [PATCH] cirrus: don't run full qtest on macOS Thomas Huth
2021-01-06 12:44 ` Willian Rampazzo
2021-01-06 13:36 ` Daniel P. Berrangé
2021-01-07 12:23 ` Mark Cave-Ayland
2021-01-15 13:10 ` Markus Armbruster
2021-01-06 13:51 ` Alex Bennée
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20210106114159.981538-1-berrange@redhat.com \
--to=berrange@redhat.com \
--cc=alex.bennee@linaro.org \
--cc=emaste@freebsd.org \
--cc=lwhsu@freebsd.org \
--cc=philmd@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=thuth@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).