qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
From: "Alex Bennée" <alex.bennee@linaro.org>
To: qemu-devel@nongnu.org
Cc: fam@euphon.net, berrange@redhat.com, f4bug@amsat.org,
	aurelien@aurel32.net, pbonzini@redhat.com, stefanha@redhat.com,
	crosa@redhat.com, "Alex Bennée" <alex.bennee@linaro.org>,
	"Wainer dos Santos Moschetta" <wainersm@redhat.com>,
	"Beraldo Leal" <bleal@redhat.com>
Subject: [PATCH  v1 01/25] tests/avocado: split the AST2x00Machine classes
Date: Fri, 26 Aug 2022 18:21:04 +0100	[thread overview]
Message-ID: <20220826172128.353798-2-alex.bennee@linaro.org> (raw)
In-Reply-To: <20220826172128.353798-1-alex.bennee@linaro.org>

The SDK tests take a lot longer to run and hence need a longer
timeout. As they run well over the 60 second maximum for CI lets also
disable them for CI as well.

I suspect they also suffer from the inability to detect the login
prompt due to no newlines being processed.

Signed-off-by: Alex Bennée <alex.bennee@linaro.org>
---
 tests/avocado/machine_aspeed.py | 18 ++++++++++++++++++
 1 file changed, 18 insertions(+)

diff --git a/tests/avocado/machine_aspeed.py b/tests/avocado/machine_aspeed.py
index 65d38f4efa..0f64eb636c 100644
--- a/tests/avocado/machine_aspeed.py
+++ b/tests/avocado/machine_aspeed.py
@@ -6,12 +6,14 @@
 # later.  See the COPYING file in the top-level directory.
 
 import time
+import os
 
 from avocado_qemu import QemuSystemTest
 from avocado_qemu import wait_for_console_pattern
 from avocado_qemu import exec_command
 from avocado_qemu import exec_command_and_wait_for_pattern
 from avocado.utils import archive
+from avocado import skipIf
 
 
 class AST1030Machine(QemuSystemTest):
@@ -176,6 +178,20 @@ def test_arm_ast2600_evb_builroot(self):
         self.do_test_arm_aspeed_buidroot_poweroff()
 
 
+class AST2x00MachineSDK(QemuSystemTest):
+
+    # FIXME: Although these tests boot a whole distro they are still
+    # slower than comparable machine models. There may be some
+    # optimisations which bring down the runtime. In the meantime they
+    # have generous timeouts and are disable for CI which aims for all
+    # tests to run in less than 60 seconds.
+    timeout = 240
+
+    def wait_for_console_pattern(self, success_message, vm=None):
+        wait_for_console_pattern(self, success_message,
+                                 failure_message='Kernel panic - not syncing',
+                                 vm=vm)
+
     def do_test_arm_aspeed_sdk_start(self, image, cpu_id):
         self.vm.set_console()
         self.vm.add_args('-drive', 'file=' + image + ',if=mtd,format=raw',
@@ -187,6 +203,7 @@ def do_test_arm_aspeed_sdk_start(self, image, cpu_id):
         self.wait_for_console_pattern('Starting kernel ...')
         self.wait_for_console_pattern('Booting Linux on physical CPU ' + cpu_id)
 
+    @skipIf(os.getenv('GITLAB_CI'), 'Running on GitLab')
     def test_arm_ast2500_evb_sdk(self):
         """
         :avocado: tags=arch:arm
@@ -204,6 +221,7 @@ def test_arm_ast2500_evb_sdk(self):
             self.workdir + '/ast2500-default/image-bmc', '0x0')
         self.wait_for_console_pattern('ast2500-default login:')
 
+    @skipIf(os.getenv('GITLAB_CI'), 'Running on GitLab')
     def test_arm_ast2600_evb_sdk(self):
         """
         :avocado: tags=arch:arm
-- 
2.30.2



  reply	other threads:[~2022-08-26 17:26 UTC|newest]

Thread overview: 58+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-08-26 17:21 [PATCH v1 for 7.2 00/25] testing updates and mips deprecation Alex Bennée
2022-08-26 17:21 ` Alex Bennée [this message]
2022-08-26 19:27   ` [PATCH v1 01/25] tests/avocado: split the AST2x00Machine classes Thomas Huth
2022-08-26 17:21 ` [PATCH v1 02/25] tests/avocado: reduce the default timeout to 120s Alex Bennée
2022-08-26 19:44   ` Thomas Huth
2022-08-31 18:18     ` Alex Bennée
2022-08-26 17:21 ` [PATCH v1 03/25] tests/docker: update and flatten debian-alpha-cross Alex Bennée
2022-08-26 20:00   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 04/25] tests/docker: update and flatten debian-hppa-cross Alex Bennée
2022-08-26 20:01   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 05/25] tests/docker: update and flatten debian-m68k-cross Alex Bennée
2022-08-26 20:02   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 06/25] tests/docker: update and flatten debian-mips64-cross Alex Bennée
2022-08-26 20:06   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 07/25] tests/docker: update and flatten debian-sh4-cross Alex Bennée
2022-08-26 20:06   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 08/25] tests/docker: update and flatten debian-sparc64-cross Alex Bennée
2022-08-26 20:10   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 09/25] tests/docker: flatten debian-powerpc-test-cross Alex Bennée
2022-08-26 20:14   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 10/25] tests/docker: remove tricore qemu/debian10 dependency Alex Bennée
2022-08-26 20:17   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 11/25] tests/docker: remove amd64 " Alex Bennée
2022-08-26 20:26   ` Thomas Huth
2022-08-26 21:47     ` Alex Bennée
2022-08-27  4:59       ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 12/25] tests/vm: Remove obsolete Fedora VM test Alex Bennée
2022-08-29 23:13   ` Philippe Mathieu-Daudé via
2022-08-26 17:21 ` [PATCH v1 13/25] gitlab-ci/custom-runners: Disable -static-pie for ubuntu-20.04-aarch64 Alex Bennée
2022-08-29 23:16   ` Philippe Mathieu-Daudé via
2022-08-29 23:41     ` Richard Henderson
2022-08-26 17:21 ` [PATCH v1 14/25] gitlab-ci: update aarch32/aarch64 custom runner jobs Alex Bennée
2022-08-26 20:27   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 15/25] Deprecate 32 bit big-endian MIPS Alex Bennée
2022-08-26 20:39   ` Thomas Huth
2022-09-01  9:57     ` Alex Bennée
2022-08-29 23:38   ` Philippe Mathieu-Daudé via
2022-08-30  0:46     ` Huacai Chen
2022-08-26 17:21 ` [PATCH v1 16/25] tests/docker: flatten debian-riscv64-test-cross Alex Bennée
2022-08-26 20:49   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 17/25] tests/docker: update and flatten debian-all-test-cross Alex Bennée
2022-08-26 18:34   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 18/25] tests/lcitool: bump to latest version Alex Bennée
2022-08-26 18:37   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 19/25] tests/docker: update and flatten debian-amd64-cross Alex Bennée
2022-08-27  5:38   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 20/25] tests/docker: update and flatten debian-loongarch-cross Alex Bennée
2022-08-27  5:41   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 21/25] tests/docker: update and flatten debian-hexagon-cross Alex Bennée
2022-08-27  5:45   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 22/25] tests/docker: update and flatten debian-toolchain Alex Bennée
2022-08-27  5:49   ` Thomas Huth
2022-08-27  9:32     ` Alex Bennée
2022-08-26 17:21 ` [PATCH v1 23/25] tests/docker: remove FROM qemu/ support from docker.py Alex Bennée
2022-08-27  5:50   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 24/25] tests/docker: remove the Debian base images Alex Bennée
2022-08-27  5:53   ` Thomas Huth
2022-08-26 17:21 ` [PATCH v1 25/25] gitlab-ci: Only use one process in Windows jobs for compilation Alex Bennée

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20220826172128.353798-2-alex.bennee@linaro.org \
    --to=alex.bennee@linaro.org \
    --cc=aurelien@aurel32.net \
    --cc=berrange@redhat.com \
    --cc=bleal@redhat.com \
    --cc=crosa@redhat.com \
    --cc=f4bug@amsat.org \
    --cc=fam@euphon.net \
    --cc=pbonzini@redhat.com \
    --cc=qemu-devel@nongnu.org \
    --cc=stefanha@redhat.com \
    --cc=wainersm@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).