From: Thomas Huth <thuth@redhat.com>
To: qemu-devel@nongnu.org
Cc: "Philippe Mathieu-Daudé" <philmd@linaro.org>,
"Daniel P . Berrange" <berrange@redhat.com>
Subject: [PATCH v2 00/15] Convert remaining Avocado tests to functional
Date: Mon, 14 Apr 2025 13:30:14 +0200 [thread overview]
Message-ID: <20250414113031.151105-1-thuth@redhat.com> (raw)
These patches convert the remaining Avocado tests bit by bit to the
functional framework, or replace them with a test that has similar
test coverage. This way we are finally able to get rid of the
test/avocado folder in the end, everything is then integrated with
the meson test runner. It should be possible now to run almost all
tests in parallel by doing something like:
make -j$(nproc) check SPEED=thorough
v2:
- Use separate gitlab issue tickets for the flaky reverse-debugging tests
- Mark the aarch64 reverse debugging test as flaky, too
- Rename QEMU_CI_FUNCTIONAL_TESTING to QEMU_CI_FUNCTIONAL
Thomas Huth (15):
gitlab-ci: Remove the avocado tests from the CI pipelines
tests/functional: Move the check for the parameters from avocado to
functional
tests/functional: Convert reverse_debugging tests to the functional
framework
tests/functional: Convert the i386 replay avocado test
tests/avocado: Remove the LinuxKernelTest class
tests/functional: Convert the 32-bit big endian Wheezy mips test
tests/functional: Convert the 32-bit little endian Wheezy mips test
tests/functional: Convert the 64-bit little endian Wheezy mips test
tests/functional: Convert the 64-bit big endian Wheezy mips test
tests/avocado: Remove the boot_linux.py tests
tests/functional: Use the tuxrun kernel for the x86 replay test
tests/functional: Use the tuxrun kernel for the aarch64 replay test
tests/functional: Convert the SMMU test to the functional framework
gitlab-ci: Update QEMU_JOB_AVOCADO and QEMU_CI_AVOCADO_TESTING
Remove the remainders of the Avocado tests
MAINTAINERS | 15 +-
docs/about/build-platforms.rst | 10 +-
docs/devel/build-system.rst | 11 +-
docs/devel/codebase.rst | 5 -
docs/devel/testing/avocado.rst | 581 ------------------
docs/devel/testing/ci-jobs.rst.inc | 19 +-
docs/devel/testing/functional.rst | 3 -
docs/devel/testing/index.rst | 1 -
docs/devel/testing/main.rst | 15 -
tests/avocado/README.rst | 10 -
configure | 2 +-
.gitlab-ci.d/base.yml | 8 +-
.gitlab-ci.d/buildtest-template.yml | 13 +-
.gitlab-ci.d/buildtest.yml | 33 +-
pythondeps.toml | 8 +-
tests/Makefile.include | 60 +-
tests/avocado/avocado_qemu/__init__.py | 424 -------------
tests/avocado/avocado_qemu/linuxtest.py | 253 --------
tests/avocado/boot_linux.py | 132 ----
tests/avocado/boot_linux_console.py | 96 ---
tests/avocado/linux_ssh_mips_malta.py | 205 ------
tests/avocado/replay_kernel.py | 110 ----
tests/avocado/replay_linux.py | 206 -------
tests/avocado/smmu.py | 139 -----
tests/functional/meson.build | 13 +-
tests/functional/qemu_test/tuxruntest.py | 9 +-
.../reverse_debugging.py | 114 +---
tests/functional/test_aarch64_replay.py | 37 +-
.../functional/test_aarch64_reverse_debug.py | 38 ++
tests/functional/test_aarch64_smmu.py | 205 ++++++
tests/functional/test_i386_replay.py | 28 +
tests/functional/test_mips64_malta.py | 35 ++
tests/functional/test_mips64el_malta.py | 22 +
tests/functional/test_mips_malta.py | 108 +++-
tests/functional/test_mipsel_malta.py | 22 +
tests/functional/test_ppc64_reverse_debug.py | 41 ++
tests/functional/test_x86_64_replay.py | 43 +-
tests/functional/test_x86_64_reverse_debug.py | 36 ++
38 files changed, 673 insertions(+), 2437 deletions(-)
delete mode 100644 docs/devel/testing/avocado.rst
delete mode 100644 tests/avocado/README.rst
delete mode 100644 tests/avocado/avocado_qemu/__init__.py
delete mode 100644 tests/avocado/avocado_qemu/linuxtest.py
delete mode 100644 tests/avocado/boot_linux.py
delete mode 100644 tests/avocado/boot_linux_console.py
delete mode 100644 tests/avocado/linux_ssh_mips_malta.py
delete mode 100644 tests/avocado/replay_kernel.py
delete mode 100644 tests/avocado/replay_linux.py
delete mode 100644 tests/avocado/smmu.py
rename tests/{avocado => functional}/reverse_debugging.py (66%)
create mode 100755 tests/functional/test_aarch64_reverse_debug.py
create mode 100755 tests/functional/test_aarch64_smmu.py
create mode 100755 tests/functional/test_i386_replay.py
create mode 100755 tests/functional/test_mips64_malta.py
create mode 100755 tests/functional/test_ppc64_reverse_debug.py
create mode 100755 tests/functional/test_x86_64_reverse_debug.py
--
2.49.0
next reply other threads:[~2025-04-14 11:31 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-04-14 11:30 Thomas Huth [this message]
2025-04-14 11:30 ` [PATCH v2 01/15] gitlab-ci: Remove the avocado tests from the CI pipelines Thomas Huth
2025-04-14 11:30 ` [PATCH v2 02/15] tests/functional: Move the check for the parameters from avocado to functional Thomas Huth
2025-04-14 11:30 ` [PATCH v2 03/15] tests/functional: Convert reverse_debugging tests to the functional framework Thomas Huth
2025-04-14 11:51 ` Daniel P. Berrangé
2025-04-14 11:30 ` [PATCH v2 04/15] tests/functional: Convert the i386 replay avocado test Thomas Huth
2025-04-14 11:30 ` [PATCH v2 05/15] tests/avocado: Remove the LinuxKernelTest class Thomas Huth
2025-04-14 11:30 ` [PATCH v2 06/15] tests/functional: Convert the 32-bit big endian Wheezy mips test Thomas Huth
2025-04-14 11:30 ` [PATCH v2 07/15] tests/functional: Convert the 32-bit little " Thomas Huth
2025-04-14 11:30 ` [PATCH v2 08/15] tests/functional: Convert the 64-bit " Thomas Huth
2025-04-14 11:30 ` [PATCH v2 09/15] tests/functional: Convert the 64-bit big " Thomas Huth
2025-04-14 11:30 ` [PATCH v2 10/15] tests/avocado: Remove the boot_linux.py tests Thomas Huth
2025-04-14 11:30 ` [PATCH v2 11/15] tests/functional: Use the tuxrun kernel for the x86 replay test Thomas Huth
2025-04-14 11:30 ` [PATCH v2 12/15] tests/functional: Use the tuxrun kernel for the aarch64 " Thomas Huth
2025-04-14 11:30 ` [PATCH v2 13/15] tests/functional: Convert the SMMU test to the functional framework Thomas Huth
2025-04-14 11:30 ` [PATCH v2 14/15] gitlab-ci: Update QEMU_JOB_AVOCADO and QEMU_CI_AVOCADO_TESTING Thomas Huth
2025-04-14 11:30 ` [PATCH v2 15/15] Remove the remainders of the Avocado tests Thomas Huth
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20250414113031.151105-1-thuth@redhat.com \
--to=thuth@redhat.com \
--cc=berrange@redhat.com \
--cc=philmd@linaro.org \
--cc=qemu-devel@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).