qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
From: "Alex Bennée" <alex.bennee@linaro.org>
To: qemu-devel@nongnu.org
Cc: "Alex Bennée" <alex.bennee@linaro.org>,
	"Pavel Dovgalyuk" <pavel.dovgaluk@ispras.ru>,
	"Paolo Bonzini" <pbonzini@redhat.com>,
	"Cleber Rosa" <crosa@redhat.com>,
	"Philippe Mathieu-Daudé" <philmd@linaro.org>,
	"Wainer dos Santos Moschetta" <wainersm@redhat.com>,
	"Beraldo Leal" <bleal@redhat.com>
Subject: [PULL 22/22] Revert "tests/avocado: remove skips from replay_kernel"
Date: Fri, 12 Jan 2024 11:04:35 +0000	[thread overview]
Message-ID: <20240112110435.3801068-23-alex.bennee@linaro.org> (raw)
In-Reply-To: <20240112110435.3801068-1-alex.bennee@linaro.org>

This reverts commit c2ef5ee89d76f0ab77c4dd6a1c9eeed4d35d20ed.

While the fixes for #2010 and #2013 have improved things locally it
seems GitLab still continues to be flaky.

Signed-off-by: Alex Bennée <alex.bennee@linaro.org>

diff --git a/tests/avocado/replay_kernel.py b/tests/avocado/replay_kernel.py
index 6fdcbd6ac3d..1eaa36444cb 100644
--- a/tests/avocado/replay_kernel.py
+++ b/tests/avocado/replay_kernel.py
@@ -98,10 +98,13 @@ def test_i386_pc(self):
 
         self.run_rr(kernel_path, kernel_command_line, console_pattern, shift=5)
 
+    # See https://gitlab.com/qemu-project/qemu/-/issues/2010
+    @skipUnless(os.getenv('QEMU_TEST_FLAKY_TESTS'), 'Test sometimes gets stuck')
     def test_x86_64_pc(self):
         """
         :avocado: tags=arch:x86_64
         :avocado: tags=machine:pc
+        :avocado: tags=flaky
         """
         kernel_url = ('https://archives.fedoraproject.org/pub/archive/fedora'
                       '/linux/releases/29/Everything/x86_64/os/images/pxeboot'
@@ -132,6 +135,8 @@ def test_mips_malta(self):
 
         self.run_rr(kernel_path, kernel_command_line, console_pattern, shift=5)
 
+    # See https://gitlab.com/qemu-project/qemu/-/issues/2013
+    @skipUnless(os.getenv('QEMU_TEST_FLAKY_TESTS'), 'Test is unstable on GitLab')
     def test_mips64el_malta(self):
         """
         This test requires the ar tool to extract "data.tar.gz" from
@@ -147,6 +152,7 @@ def test_mips64el_malta(self):
 
         :avocado: tags=arch:mips64el
         :avocado: tags=machine:malta
+        :avocado: tags=flaky
         """
         deb_url = ('http://snapshot.debian.org/archive/debian/'
                    '20130217T032700Z/pool/main/l/linux-2.6/'
@@ -194,10 +200,13 @@ def test_arm_virt(self):
 
         self.run_rr(kernel_path, kernel_command_line, console_pattern, shift=1)
 
+    @skipUnless(os.getenv('QEMU_TEST_FLAKY_TESTS'), 'Test is unstable on GitLab')
+
     def test_arm_cubieboard_initrd(self):
         """
         :avocado: tags=arch:arm
         :avocado: tags=machine:cubieboard
+        :avocado: tags=flaky
         """
         deb_url = ('https://apt.armbian.com/pool/main/l/'
                    'linux-5.10.16-sunxi/linux-image-current-sunxi_21.02.2_armhf.deb')
@@ -345,6 +354,7 @@ def test_m68k_mcf5208evb(self):
         file_path = self.fetch_asset(tar_url, asset_hash=tar_hash)
         self.do_test_advcal_2018(file_path, 'sanity-clause.elf')
 
+    @skip("Test currently broken") # Console stuck as of 5.2-rc1
     def test_microblaze_s3adsp1800(self):
         """
         :avocado: tags=arch:microblaze
@@ -379,6 +389,7 @@ def test_or1k_sim(self):
         file_path = self.fetch_asset(tar_url, asset_hash=tar_hash)
         self.do_test_advcal_2018(file_path, 'vmlinux')
 
+    @skip("nios2 emulation is buggy under record/replay")
     def test_nios2_10m50(self):
         """
         :avocado: tags=arch:nios2
-- 
2.39.2



  parent reply	other threads:[~2024-01-12 11:11 UTC|newest]

Thread overview: 26+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-01-12 11:04 [PULL 00/22] testing and misc updates Alex Bennée
2024-01-12 11:04 ` [PULL 01/22] tests/avocado: Add a test for a little-endian microblaze machine Alex Bennée
2024-01-12 11:04 ` [PULL 02/22] tests/avocado: use snapshot=on in kvm_xen_guest Alex Bennée
2024-08-01  9:48   ` David Woodhouse
2024-01-12 11:04 ` [PULL 03/22] gitlab: include microblazeel in testing Alex Bennée
2024-01-12 11:04 ` [PULL 04/22] chardev: use bool for fe_is_open Alex Bennée
2024-01-12 11:04 ` [PULL 05/22] qtest: bump min meson timeout to 60 seconds Alex Bennée
2024-01-12 11:04 ` [PULL 06/22] qtest: bump migration-test timeout to 8 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 07/22] qtest: bump qom-test timeout to 15 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 08/22] qtest: bump npcm7xx_pwm-test timeout to 5 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 09/22] qtest: bump test-hmp timeout to 4 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 10/22] qtest: bump pxe-test timeout to 10 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 11/22] qtest: bump prom-env-test timeout to 6 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 12/22] qtest: bump boot-serial-test timeout to 3 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 13/22] qtest: bump qos-test timeout to 2 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 14/22] qtest: bump aspeed_smc-test timeout to 6 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 15/22] qtest: bump bios-table-test timeout to 9 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 16/22] tests/qtest: Bump the device-introspect-test timeout to 12 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 17/22] tests/unit: Bump test-aio-multithread test timeout to 2 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 18/22] tests/unit: Bump test-crypto-block test timeout to 5 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 19/22] tests/fp: Bump fp-test-mulAdd test timeout to 3 minutes Alex Bennée
2024-01-12 11:04 ` [PULL 20/22] mtest2make: stop disabling meson test timeouts Alex Bennée
2024-01-12 11:04 ` [PULL 21/22] readthodocs: fully specify a build environment Alex Bennée
2024-01-12 11:04 ` Alex Bennée [this message]
2024-01-12 11:13   ` [PULL 22/22] Revert "tests/avocado: remove skips from replay_kernel" Peter Maydell
2024-01-12 13:11     ` Alex Bennée

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20240112110435.3801068-23-alex.bennee@linaro.org \
    --to=alex.bennee@linaro.org \
    --cc=bleal@redhat.com \
    --cc=crosa@redhat.com \
    --cc=pavel.dovgaluk@ispras.ru \
    --cc=pbonzini@redhat.com \
    --cc=philmd@linaro.org \
    --cc=qemu-devel@nongnu.org \
    --cc=wainersm@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).