From: "Alex Bennée" <alex.bennee@linaro.org>
To: qemu-devel@nongnu.org
Cc: peter.maydell@linaro.org, "Alex Bennée" <alex.bennee@linaro.org>
Subject: [PULL v2 00/24] testing updates (gitlab, cirrus, docker, avocado, windows)
Date: Wed, 1 Mar 2023 15:15:40 +0000 [thread overview]
Message-ID: <20230301151604.1948813-1-alex.bennee@linaro.org> (raw)
The following changes since commit 627634031092e1514f363fd8659a579398de0f0e:
Merge tag 'buildsys-qom-qdev-ui-20230227' of https://github.com/philmd/qemu into staging (2023-02-28 15:09:18 +0000)
are available in the Git repository at:
https://gitlab.com/stsquad/qemu.git tags/pull-testing-next-010323-1
for you to fetch changes up to c0c8687ef0fd990db8db1655a8a6c5a5e35dd4bb:
tests/avocado: disable BootLinuxPPC64 test in CI (2023-03-01 12:51:01 +0000)
----------------------------------------------------------------
testing updates:
- ensure socat available for tests
- skip socat tests for MacOS
- properly clean up fifos after use
- make fp-test less chatty
- store test artefacts on Cirrus
- control custom runners with QEMU_CI knobs
- disable benchmark runs under tsan build
- update ubuntu 2004 to 2204
- skip nios2 kernel replay test
- add tuxrun baselines to avocado
- binary build of tricore tools
- export test results on cross builds
- improve windows builds
- ensure we properly print TAP headers
- migrate away from docker.py for building containers
- be more efficient in our handling of build artefacts between stages
- enable ztsd in containers so we can run tux_baselines
- disable heavyweight PPC64 Boot Linux test in CI
----------------------------------------------------------------
Alex Bennée (19):
tests: don't run socat tests on MacOS as well
tests: add socat dependency for tests
tests: be a bit more strict cleaning up fifos
tests: make fp-test less chatty when running from test suite
gitlab: extend custom runners with base_job_template
tests: don't run benchmarks for the tsan build
testing: update ubuntu2004 to ubuntu2204
tests: skip the nios2 replay_kernel test
tests: add tuxrun baseline test to avocado
tests: ensure we export job results for some cross builds
tests/dockerfiles: unify debian-toolchain references
configure: expose the direct container command
tests/lcitool: append user setting stanza to dockerfiles
tests/docker: add USER stanzas to non-lci images
tests/docker: use direct RUNC call to build containers
tests/docker: use direct RUNC call to run test jobs
gitlab: move the majority of artefact handling to a template
tests/docker: add zstdtools to the images
tests/avocado: disable BootLinuxPPC64 test in CI
Bastian Koppelmann (1):
tests/docker: Use binaries for debian-tricore-cross
Fabiano Rosas (1):
gitlab: Use plain docker in container-template.yml
Richard W.M. Jones (1):
tests: Ensure TAP version is printed before other messages
Thomas Huth (2):
gitlab-ci: Use artifacts instead of dumping logs in the Cirrus-CI jobs
cirrus.yml: Improve the windows_msys2_task
MAINTAINERS | 1 +
docs/devel/testing.rst | 4 +-
configure | 3 +
tests/tcg/tricore/macros.h | 2 +-
tests/fp/fp-test.c | 19 +-
tests/qtest/fuzz-lsi53c895a-test.c | 4 +-
tests/qtest/rtl8139-test.c | 3 +-
tests/unit/test-io-channel-command.c | 10 +-
.cirrus.yml | 8 +-
.gitlab-ci.d/buildtest-template.yml | 16 +
.gitlab-ci.d/buildtest.yml | 100 ++---
.gitlab-ci.d/cirrus/build.yml | 7 +-
.gitlab-ci.d/cirrus/freebsd-12.vars | 2 +-
.gitlab-ci.d/cirrus/freebsd-13.vars | 2 +-
.gitlab-ci.d/cirrus/macos-12.vars | 2 +-
.gitlab-ci.d/container-template.yml | 9 +-
.gitlab-ci.d/containers.yml | 4 +-
.gitlab-ci.d/crossbuild-template.yml | 11 +
.gitlab-ci.d/crossbuilds.yml | 12 +-
.gitlab-ci.d/custom-runners.yml | 3 +-
.gitlab-ci.d/custom-runners/ubuntu-20.04-s390x.yml | 10 +-
.../custom-runners/ubuntu-22.04-aarch32.yml | 2 +-
.../custom-runners/ubuntu-22.04-aarch64.yml | 10 +-
tests/avocado/boot_linux.py | 3 +
tests/avocado/replay_kernel.py | 1 +
tests/avocado/tuxrun_baselines.py | 423 +++++++++++++++++++++
tests/docker/Makefile.include | 28 +-
tests/docker/dockerfiles/alpine.docker | 7 +
tests/docker/dockerfiles/centos8.docker | 9 +-
.../dockerfiles/debian-all-test-cross.docker | 5 +
tests/docker/dockerfiles/debian-alpha-cross.docker | 5 +
tests/docker/dockerfiles/debian-amd64-cross.docker | 9 +-
tests/docker/dockerfiles/debian-amd64.docker | 9 +-
tests/docker/dockerfiles/debian-arm64-cross.docker | 9 +-
tests/docker/dockerfiles/debian-armel-cross.docker | 9 +-
tests/docker/dockerfiles/debian-armhf-cross.docker | 9 +-
.../docker/dockerfiles/debian-hexagon-cross.docker | 5 +
tests/docker/dockerfiles/debian-hppa-cross.docker | 5 +
.../dockerfiles/debian-loongarch-cross.docker | 5 +
tests/docker/dockerfiles/debian-m68k-cross.docker | 5 +
tests/docker/dockerfiles/debian-mips-cross.docker | 5 +
.../docker/dockerfiles/debian-mips64-cross.docker | 5 +
.../dockerfiles/debian-mips64el-cross.docker | 9 +-
.../docker/dockerfiles/debian-mipsel-cross.docker | 9 +-
tests/docker/dockerfiles/debian-native.docker | 5 +
.../dockerfiles/debian-powerpc-test-cross.docker | 6 +-
.../docker/dockerfiles/debian-ppc64el-cross.docker | 9 +-
.../docker/dockerfiles/debian-riscv64-cross.docker | 5 +
.../dockerfiles/debian-riscv64-test-cross.docker | 5 +
tests/docker/dockerfiles/debian-s390x-cross.docker | 9 +-
tests/docker/dockerfiles/debian-sh4-cross.docker | 5 +
.../docker/dockerfiles/debian-sparc64-cross.docker | 5 +
tests/docker/dockerfiles/debian-toolchain.docker | 9 +-
.../docker/dockerfiles/debian-tricore-cross.docker | 15 +-
.../docker/dockerfiles/debian-xtensa-cross.docker | 5 +
tests/docker/dockerfiles/fedora-cris-cross.docker | 5 +
tests/docker/dockerfiles/fedora-i386-cross.docker | 5 +
tests/docker/dockerfiles/fedora-win32-cross.docker | 9 +-
tests/docker/dockerfiles/fedora-win64-cross.docker | 9 +-
tests/docker/dockerfiles/fedora.docker | 9 +-
tests/docker/dockerfiles/opensuse-leap.docker | 9 +-
tests/docker/dockerfiles/python.docker | 5 +
tests/docker/dockerfiles/ubuntu2004.docker | 12 +-
tests/docker/dockerfiles/ubuntu2204.docker | 153 ++++++++
tests/docker/test-tsan | 2 +-
tests/fp/berkeley-testfloat-3 | 2 +-
tests/fp/meson.build | 2 +-
tests/lcitool/libvirt-ci | 2 +-
tests/lcitool/projects/qemu.yml | 2 +
tests/lcitool/refresh | 26 +-
tests/tcg/tricore/Makefile.softmmu-target | 6 +-
71 files changed, 994 insertions(+), 160 deletions(-)
create mode 100644 tests/avocado/tuxrun_baselines.py
create mode 100644 tests/docker/dockerfiles/ubuntu2204.docker
--
2.39.2
next reply other threads:[~2023-03-01 15:19 UTC|newest]
Thread overview: 41+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-03-01 15:15 Alex Bennée [this message]
2023-03-01 15:15 ` [PULL v2 01/24] tests: don't run socat tests on MacOS as well Alex Bennée
2023-03-01 15:15 ` [PULL v2 02/24] tests: add socat dependency for tests Alex Bennée
2023-03-01 15:15 ` [PULL v2 03/24] tests: be a bit more strict cleaning up fifos Alex Bennée
2023-03-01 15:15 ` [PULL v2 04/24] tests: make fp-test less chatty when running from test suite Alex Bennée
2023-03-01 15:15 ` [PULL v2 05/24] gitlab-ci: Use artifacts instead of dumping logs in the Cirrus-CI jobs Alex Bennée
2023-03-01 15:15 ` [PULL v2 06/24] gitlab: extend custom runners with base_job_template Alex Bennée
2023-03-01 15:15 ` [PULL v2 07/24] tests: don't run benchmarks for the tsan build Alex Bennée
2023-03-01 15:15 ` [PULL v2 08/24] testing: update ubuntu2004 to ubuntu2204 Alex Bennée
2023-03-01 15:15 ` [PULL v2 09/24] tests: skip the nios2 replay_kernel test Alex Bennée
2023-03-01 15:15 ` [PULL v2 10/24] tests: add tuxrun baseline test to avocado Alex Bennée
2023-03-01 15:15 ` [PULL v2 11/24] tests/docker: Use binaries for debian-tricore-cross Alex Bennée
2023-03-01 15:15 ` [PULL v2 12/24] tests: ensure we export job results for some cross builds Alex Bennée
2023-03-01 15:15 ` [PULL v2 13/24] cirrus.yml: Improve the windows_msys2_task Alex Bennée
2023-03-01 15:15 ` [PULL v2 14/24] tests/dockerfiles: unify debian-toolchain references Alex Bennée
2023-03-01 15:15 ` [PULL v2 15/24] gitlab: Use plain docker in container-template.yml Alex Bennée
2023-03-01 15:15 ` [PULL v2 16/24] tests: Ensure TAP version is printed before other messages Alex Bennée
2023-03-01 15:15 ` [PULL v2 17/24] configure: expose the direct container command Alex Bennée
2023-03-01 15:15 ` [PULL v2 18/24] tests/lcitool: append user setting stanza to dockerfiles Alex Bennée
2023-03-01 15:15 ` [PULL v2 19/24] tests/docker: add USER stanzas to non-lci images Alex Bennée
2023-03-01 15:16 ` [PULL v2 20/24] tests/docker: use direct RUNC call to build containers Alex Bennée
2023-03-01 15:16 ` [PULL v2 21/24] tests/docker: use direct RUNC call to run test jobs Alex Bennée
2023-03-01 15:16 ` [PULL v2 22/24] gitlab: move the majority of artefact handling to a template Alex Bennée
2023-03-01 15:16 ` [PULL v2 23/24] tests/docker: add zstdtools to the images Alex Bennée
2023-03-01 15:16 ` [PULL v2 24/24] tests/avocado: disable BootLinuxPPC64 test in CI Alex Bennée
2023-03-01 17:39 ` [PULL v2 00/24] testing updates (gitlab, cirrus, docker, avocado, windows) Peter Maydell
2023-03-01 18:17 ` Alex Bennée
2023-03-01 19:19 ` Peter Maydell
2023-03-01 19:47 ` Alex Bennée
2023-03-02 10:56 ` Peter Maydell
2023-03-02 11:15 ` Philippe Mathieu-Daudé
2023-03-02 11:19 ` Thomas Huth
2023-03-02 11:21 ` Peter Maydell
2023-03-02 11:34 ` Alex Bennée
2023-03-02 11:24 ` Alex Bennée
2023-03-02 12:00 ` Daniel P. Berrangé
2023-03-02 12:37 ` Philippe Mathieu-Daudé
2023-03-02 11:30 ` Alex Bennée
2023-03-02 11:34 ` Peter Maydell
2023-03-02 12:03 ` Alex Bennée
2023-03-02 16:02 ` Peter Maydell
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20230301151604.1948813-1-alex.bennee@linaro.org \
--to=alex.bennee@linaro.org \
--cc=peter.maydell@linaro.org \
--cc=qemu-devel@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).