* [PATCH v5 1/4] tests: use default cpu for aarch64/sbsa-ref
2024-09-10 9:48 [PATCH v5 0/4] tests: updates for aarch64/sbsa-ref Marcin Juszkiewicz
@ 2024-09-10 9:48 ` Marcin Juszkiewicz
2024-09-10 9:48 ` [PATCH v5 2/4] tests: add FreeBSD tests " Marcin Juszkiewicz
` (3 subsequent siblings)
4 siblings, 0 replies; 6+ messages in thread
From: Marcin Juszkiewicz @ 2024-09-10 9:48 UTC (permalink / raw)
To: qemu-devel
Cc: qemu-arm, Leif Lindholm, Radoslaw Biernacki, Peter Maydell,
Cleber Rosa, Philippe Mathieu-Daudé,
Wainer dos Santos Moschetta, Beraldo Leal, Marcin Juszkiewicz
We want to run tests using default cpu without having to remember which
Arm core is it.
Change Neoverse-N1 (old default) test to use default cpu (Neoverse-N2 at
the moment).
Signed-off-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
---
tests/functional/test_aarch64_sbsaref.py | 18 ++++++++++--------
1 file changed, 10 insertions(+), 8 deletions(-)
diff --git a/tests/functional/test_aarch64_sbsaref.py b/tests/functional/test_aarch64_sbsaref.py
index f31c2a60b6..528882f4fa 100755
--- a/tests/functional/test_aarch64_sbsaref.py
+++ b/tests/functional/test_aarch64_sbsaref.py
@@ -110,16 +110,17 @@ def test_sbsaref_edk2_firmware(self):
# This tests the whole boot chain from EFI to Userspace
# We only boot a whole OS for the current top level CPU and GIC
# Other test profiles should use more minimal boots
- def boot_alpine_linux(self, cpu):
+ def boot_alpine_linux(self, cpu=None):
self.fetch_firmware()
iso_path = self.ASSET_ALPINE_ISO.fetch()
self.vm.set_console()
self.vm.add_args(
- "-cpu", cpu,
"-drive", f"file={iso_path},media=cdrom,format=raw",
)
+ if cpu:
+ self.vm.add_args("-cpu", cpu)
self.vm.launch()
wait_for_console_pattern(self, "Welcome to Alpine Linux 3.17")
@@ -127,8 +128,8 @@ def boot_alpine_linux(self, cpu):
def test_sbsaref_alpine_linux_cortex_a57(self):
self.boot_alpine_linux("cortex-a57")
- def test_sbsaref_alpine_linux_neoverse_n1(self):
- self.boot_alpine_linux("neoverse-n1")
+ def test_sbsaref_alpine_linux_default_cpu(self):
+ self.boot_alpine_linux()
def test_sbsaref_alpine_linux_max_pauth_off(self):
self.boot_alpine_linux("max,pauth=off")
@@ -148,16 +149,17 @@ def test_sbsaref_alpine_linux_max(self):
# This tests the whole boot chain from EFI to Userspace
# We only boot a whole OS for the current top level CPU and GIC
# Other test profiles should use more minimal boots
- def boot_openbsd73(self, cpu):
+ def boot_openbsd73(self, cpu=None):
self.fetch_firmware()
img_path = self.ASSET_OPENBSD_ISO.fetch()
self.vm.set_console()
self.vm.add_args(
- "-cpu", cpu,
"-drive", f"file={img_path},format=raw,snapshot=on",
)
+ if cpu:
+ self.vm.add_args("-cpu", cpu)
self.vm.launch()
wait_for_console_pattern(self,
@@ -167,8 +169,8 @@ def boot_openbsd73(self, cpu):
def test_sbsaref_openbsd73_cortex_a57(self):
self.boot_openbsd73("cortex-a57")
- def test_sbsaref_openbsd73_neoverse_n1(self):
- self.boot_openbsd73("neoverse-n1")
+ def test_sbsaref_openbsd73_default_cpu(self):
+ self.boot_openbsd73()
def test_sbsaref_openbsd73_max_pauth_off(self):
self.boot_openbsd73("max,pauth=off")
--
2.46.0
^ permalink raw reply related [flat|nested] 6+ messages in thread* [PATCH v5 2/4] tests: add FreeBSD tests for aarch64/sbsa-ref
2024-09-10 9:48 [PATCH v5 0/4] tests: updates for aarch64/sbsa-ref Marcin Juszkiewicz
2024-09-10 9:48 ` [PATCH v5 1/4] tests: use default cpu " Marcin Juszkiewicz
@ 2024-09-10 9:48 ` Marcin Juszkiewicz
2024-09-10 9:48 ` [PATCH v5 3/4] tests: expand timeout information " Marcin Juszkiewicz
` (2 subsequent siblings)
4 siblings, 0 replies; 6+ messages in thread
From: Marcin Juszkiewicz @ 2024-09-10 9:48 UTC (permalink / raw)
To: qemu-devel
Cc: qemu-arm, Leif Lindholm, Radoslaw Biernacki, Peter Maydell,
Cleber Rosa, Philippe Mathieu-Daudé,
Wainer dos Santos Moschetta, Beraldo Leal, Marcin Juszkiewicz
FreeBSD has longer support cycle for stable release (14.x EoL in 2028)
than OpenBSD (7.3 we use is already EoL). Also bugfixes are backported
so we can stay on 14.x for longer.
Signed-off-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
---
tests/functional/test_aarch64_sbsaref.py | 43 +++++++++++++++++++++++++++++++-
1 file changed, 42 insertions(+), 1 deletion(-)
diff --git a/tests/functional/test_aarch64_sbsaref.py b/tests/functional/test_aarch64_sbsaref.py
index 528882f4fa..89d0b9587a 100755
--- a/tests/functional/test_aarch64_sbsaref.py
+++ b/tests/functional/test_aarch64_sbsaref.py
@@ -1,6 +1,6 @@
#!/usr/bin/env python3
#
-# Functional test that boots a Linux kernel and checks the console
+# Functional test that boots a kernel and checks the console
#
# SPDX-FileCopyrightText: 2023-2024 Linaro Ltd.
# SPDX-FileContributor: Philippe Mathieu-Daudé <philmd@linaro.org>
@@ -184,5 +184,46 @@ def test_sbsaref_openbsd73_max(self):
self.boot_openbsd73("max")
+ ASSET_FREEBSD_ISO = Asset(
+ ('https://download.freebsd.org/releases/arm64/aarch64/ISO-IMAGES/'
+ '14.1/FreeBSD-14.1-RELEASE-arm64-aarch64-bootonly.iso'),
+ '44cdbae275ef1bb6dab1d5fbb59473d4f741e1c8ea8a80fd9e906b531d6ad461')
+
+ # This tests the whole boot chain from EFI to Userspace
+ # We only boot a whole OS for the current top level CPU and GIC
+ # Other test profiles should use more minimal boots
+ def boot_freebsd14(self, cpu=None):
+ self.fetch_firmware()
+
+ img_path = self.ASSET_FREEBSD_ISO.fetch()
+
+ self.vm.set_console()
+ self.vm.add_args(
+ "-drive", f"file={img_path},format=raw,snapshot=on",
+ )
+ if cpu:
+ self.vm.add_args("-cpu", cpu)
+
+ self.vm.launch()
+ wait_for_console_pattern(self, 'Welcome to FreeBSD!')
+
+ def test_sbsaref_freebsd14_cortex_a57(self):
+ self.boot_freebsd14("cortex-a57")
+
+ def test_sbsaref_freebsd14_default_cpu(self):
+ self.boot_freebsd14()
+
+ def test_sbsaref_freebsd14_max_pauth_off(self):
+ self.boot_freebsd14("max,pauth=off")
+
+ @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'), 'Test might timeout')
+ def test_sbsaref_freebsd14_max_pauth_impdef(self):
+ self.boot_freebsd14("max,pauth-impdef=on")
+
+ @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'), 'Test might timeout')
+ def test_sbsaref_freebsd14_max(self):
+ self.boot_freebsd14("max")
+
+
if __name__ == '__main__':
QemuSystemTest.main()
--
2.46.0
^ permalink raw reply related [flat|nested] 6+ messages in thread* [PATCH v5 3/4] tests: expand timeout information for aarch64/sbsa-ref
2024-09-10 9:48 [PATCH v5 0/4] tests: updates for aarch64/sbsa-ref Marcin Juszkiewicz
2024-09-10 9:48 ` [PATCH v5 1/4] tests: use default cpu " Marcin Juszkiewicz
2024-09-10 9:48 ` [PATCH v5 2/4] tests: add FreeBSD tests " Marcin Juszkiewicz
@ 2024-09-10 9:48 ` Marcin Juszkiewicz
2024-09-10 9:48 ` [PATCH v5 4/4] tests: drop OpenBSD tests " Marcin Juszkiewicz
2024-09-17 16:01 ` [PATCH v5 0/4] tests: updates " Peter Maydell
4 siblings, 0 replies; 6+ messages in thread
From: Marcin Juszkiewicz @ 2024-09-10 9:48 UTC (permalink / raw)
To: qemu-devel
Cc: qemu-arm, Leif Lindholm, Radoslaw Biernacki, Peter Maydell,
Cleber Rosa, Philippe Mathieu-Daudé,
Wainer dos Santos Moschetta, Beraldo Leal, Marcin Juszkiewicz
'Test might timeout' means nothing. Replace it with useful information
that it is emulation of pointer authentication what makes this test run
too long.
Signed-off-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
---
tests/functional/test_aarch64_sbsaref.py | 15 ++++++++++-----
1 file changed, 10 insertions(+), 5 deletions(-)
diff --git a/tests/functional/test_aarch64_sbsaref.py b/tests/functional/test_aarch64_sbsaref.py
index 89d0b9587a..1648e8ceb6 100755
--- a/tests/functional/test_aarch64_sbsaref.py
+++ b/tests/functional/test_aarch64_sbsaref.py
@@ -137,7 +137,8 @@ def test_sbsaref_alpine_linux_max_pauth_off(self):
def test_sbsaref_alpine_linux_max_pauth_impdef(self):
self.boot_alpine_linux("max,pauth-impdef=on")
- @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'), 'Test might timeout')
+ @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'),
+ 'Test might timeout due to PAuth emulation')
def test_sbsaref_alpine_linux_max(self):
self.boot_alpine_linux("max")
@@ -175,11 +176,13 @@ def test_sbsaref_openbsd73_default_cpu(self):
def test_sbsaref_openbsd73_max_pauth_off(self):
self.boot_openbsd73("max,pauth=off")
- @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'), 'Test might timeout')
+ @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'),
+ 'Test might timeout due to PAuth emulation')
def test_sbsaref_openbsd73_max_pauth_impdef(self):
self.boot_openbsd73("max,pauth-impdef=on")
- @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'), 'Test might timeout')
+ @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'),
+ 'Test might timeout due to PAuth emulation')
def test_sbsaref_openbsd73_max(self):
self.boot_openbsd73("max")
@@ -216,11 +219,13 @@ def test_sbsaref_freebsd14_default_cpu(self):
def test_sbsaref_freebsd14_max_pauth_off(self):
self.boot_freebsd14("max,pauth=off")
- @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'), 'Test might timeout')
+ @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'),
+ 'Test might timeout due to PAuth emulation')
def test_sbsaref_freebsd14_max_pauth_impdef(self):
self.boot_freebsd14("max,pauth-impdef=on")
- @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'), 'Test might timeout')
+ @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'),
+ 'Test might timeout due to PAuth emulation')
def test_sbsaref_freebsd14_max(self):
self.boot_freebsd14("max")
--
2.46.0
^ permalink raw reply related [flat|nested] 6+ messages in thread* [PATCH v5 4/4] tests: drop OpenBSD tests for aarch64/sbsa-ref
2024-09-10 9:48 [PATCH v5 0/4] tests: updates for aarch64/sbsa-ref Marcin Juszkiewicz
` (2 preceding siblings ...)
2024-09-10 9:48 ` [PATCH v5 3/4] tests: expand timeout information " Marcin Juszkiewicz
@ 2024-09-10 9:48 ` Marcin Juszkiewicz
2024-09-17 16:01 ` [PATCH v5 0/4] tests: updates " Peter Maydell
4 siblings, 0 replies; 6+ messages in thread
From: Marcin Juszkiewicz @ 2024-09-10 9:48 UTC (permalink / raw)
To: qemu-devel
Cc: qemu-arm, Leif Lindholm, Radoslaw Biernacki, Peter Maydell,
Cleber Rosa, Philippe Mathieu-Daudé,
Wainer dos Santos Moschetta, Beraldo Leal, Marcin Juszkiewicz
OpenBSD 7.3 we use is EoL. Both 7.4 and 7.5 releases do not work on
anything above Neoverse-N1 due to PAC emulation:
https://marc.info/?l=openbsd-arm&m=171050428327850&w=2
OpenBSD 7.6 is not yet released.
Signed-off-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
---
tests/functional/test_aarch64_sbsaref.py | 44 --------------------------------
1 file changed, 44 deletions(-)
diff --git a/tests/functional/test_aarch64_sbsaref.py b/tests/functional/test_aarch64_sbsaref.py
index 1648e8ceb6..b50e1a5965 100755
--- a/tests/functional/test_aarch64_sbsaref.py
+++ b/tests/functional/test_aarch64_sbsaref.py
@@ -143,50 +143,6 @@ def test_sbsaref_alpine_linux_max(self):
self.boot_alpine_linux("max")
- ASSET_OPENBSD_ISO = Asset(
- ('https://cdn.openbsd.org/pub/OpenBSD/7.3/arm64/miniroot73.img'),
- '7fc2c75401d6f01fbfa25f4953f72ad7d7c18650056d30755c44b9c129b707e5')
-
- # This tests the whole boot chain from EFI to Userspace
- # We only boot a whole OS for the current top level CPU and GIC
- # Other test profiles should use more minimal boots
- def boot_openbsd73(self, cpu=None):
- self.fetch_firmware()
-
- img_path = self.ASSET_OPENBSD_ISO.fetch()
-
- self.vm.set_console()
- self.vm.add_args(
- "-drive", f"file={img_path},format=raw,snapshot=on",
- )
- if cpu:
- self.vm.add_args("-cpu", cpu)
-
- self.vm.launch()
- wait_for_console_pattern(self,
- "Welcome to the OpenBSD/arm64"
- " 7.3 installation program.")
-
- def test_sbsaref_openbsd73_cortex_a57(self):
- self.boot_openbsd73("cortex-a57")
-
- def test_sbsaref_openbsd73_default_cpu(self):
- self.boot_openbsd73()
-
- def test_sbsaref_openbsd73_max_pauth_off(self):
- self.boot_openbsd73("max,pauth=off")
-
- @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'),
- 'Test might timeout due to PAuth emulation')
- def test_sbsaref_openbsd73_max_pauth_impdef(self):
- self.boot_openbsd73("max,pauth-impdef=on")
-
- @skipUnless(os.getenv('QEMU_TEST_TIMEOUT_EXPECTED'),
- 'Test might timeout due to PAuth emulation')
- def test_sbsaref_openbsd73_max(self):
- self.boot_openbsd73("max")
-
-
ASSET_FREEBSD_ISO = Asset(
('https://download.freebsd.org/releases/arm64/aarch64/ISO-IMAGES/'
'14.1/FreeBSD-14.1-RELEASE-arm64-aarch64-bootonly.iso'),
--
2.46.0
^ permalink raw reply related [flat|nested] 6+ messages in thread* Re: [PATCH v5 0/4] tests: updates for aarch64/sbsa-ref
2024-09-10 9:48 [PATCH v5 0/4] tests: updates for aarch64/sbsa-ref Marcin Juszkiewicz
` (3 preceding siblings ...)
2024-09-10 9:48 ` [PATCH v5 4/4] tests: drop OpenBSD tests " Marcin Juszkiewicz
@ 2024-09-17 16:01 ` Peter Maydell
4 siblings, 0 replies; 6+ messages in thread
From: Peter Maydell @ 2024-09-17 16:01 UTC (permalink / raw)
To: Marcin Juszkiewicz
Cc: qemu-devel, qemu-arm, Leif Lindholm, Radoslaw Biernacki,
Cleber Rosa, Philippe Mathieu-Daudé,
Wainer dos Santos Moschetta, Beraldo Leal
On Tue, 10 Sept 2024 at 10:48, Marcin Juszkiewicz
<marcin.juszkiewicz@linaro.org> wrote:
>
> We want test to run on default cpu settings. For now it is plain
> Neoverse-N2 but we are considering either disabling PAuth or going with
> 'impdef' way.
>
> We want to have some non-Linux OS in testing in case one of changes keep
> Linux booting but crash elsewhere. So far OpenBSD was used for it but we
> move to FreeBSD 14.x due to longer support cycles (OpenBSD 7.3 we use is
> already EoL).
>
> Signed-off-by: Marcin Juszkiewicz <marcin.juszkiewicz@linaro.org>
Applied to target-arm.next, thanks.
-- PMM
^ permalink raw reply [flat|nested] 6+ messages in thread