From: Thomas Perale via buildroot <buildroot@buildroot.org>
To: Romain Naour <romain.naour@smile.fr>
Cc: Thomas Perale <thomas.perale@mind.be>, buildroot@buildroot.org
Subject: Re: [Buildroot] [PATCH 3/3] support/testing: use larger runner to reduce the CI minute consumed per pipeline
Date: Fri, 12 Jun 2026 13:37:51 +0200 [thread overview]
Message-ID: <20260612113751.252126-1-thomas.perale@mind.be> (raw)
In-Reply-To: <20260530175831.1806461-3-romain.naour@smile.fr>
In reply of:
> Based on the first pipeline result [1], use larger runner for the
> following tests:
>
> tests.fs.test_oci.TestOci.test_run (01:08:15)
> saas-linux-small-amd64 -> saas-linux-xlarge-amd64
>
> tests.package.test_dpdk.TestDPDK.test_run (01:08:36)
> saas-linux-small-amd64 -> saas-linux-xlarge-amd64
>
> tests.package.test_z3.TestZ3.test_run (01:11:41)
> saas-linux-small-amd64 -> saas-linux-xlarge-amd64
>
> tests.package.test_octave.TestOctave.test_run (01:21:57)
> saas-linux-small-amd64 -> saas-linux-xlarge-amd64
>
> tests.package.test_podman.TestPodmanSlirpNftables.test_run (01:21:15)
> saas-linux-small-amd64 -> saas-linux-xlarge-amd64
>
> tests.package.test_podman.TestPodmanSlirpIptables.test_run (01:21:25)
> saas-linux-small-amd64 -> saas-linux-xlarge-amd64
>
> tests.package.test_mariadb.TestMariaDB.test_run (01:26:15)
> saas-linux-small-amd64 -> saas-linux-xlarge-amd64
>
> tests.package.test_podman.TestPodmanIptables.test_run (01:28:51)
> saas-linux-small-amd64 -> saas-linux-xlarge-amd64
>
> tests.package.test_podman.TestPodmanTini.test_run (01:29:08)
> saas-linux-small-amd64 -> saas-linux-xlarge-amd64
>
> tests.package.test_podman.TestPodmanNftables.test_run (01:41:26)
> saas-linux-small-amd64 -> saas-linux-xlarge-amd64
>
> tests.package.test_weston.TestWeston.test_run (01:26:17)
> saas-linux-large-amd64 -> saas-linux-2xlarge-amd64
>
> tests.package.test_python_pyqt5.TestPythonPyQt5.test_run (01:41:33)
> saas-linux-large-amd64 -> saas-linux-2xlarge-amd64
>
> tests.package.test_nodejs.TestNodeJSModuleHostBin.test_run (01:21:06)
> saas-linux-large-amd64 -> saas-linux-2xlarge-amd64
>
> tests.package.test_flutter.TestFlutter.test_run (01:03:05)
> saas-linux-xlarge-amd64 -> saas-linux-2xlarge-amd64
>
> For tests long that already use 2xlarge runner tag, we may have to run
> them on Gitlab runners owned by the Buildroot project.
>
> [1] https://gitlab.com/buildroot.org/buildroot/-/pipelines/2562421098
>
> Signed-off-by: Romain Naour <romain.naour@smile.fr>
Applied to 2025.02.x & 2026.02.x. Thanks
> ---
> support/testing/tests/fs/test_oci.py | 1 +
> support/testing/tests/package/test_dpdk.py | 1 +
> support/testing/tests/package/test_flutter.py | 2 +-
> support/testing/tests/package/test_mariadb.py | 1 +
> support/testing/tests/package/test_nodejs.py | 2 +-
> support/testing/tests/package/test_octave.py | 1 +
> support/testing/tests/package/test_podman.py | 5 +++++
> support/testing/tests/package/test_python_pyqt5.py | 2 +-
> support/testing/tests/package/test_weston.py | 2 +-
> support/testing/tests/package/test_z3.py | 1 +
> 10 files changed, 14 insertions(+), 4 deletions(-)
>
> diff --git a/support/testing/tests/fs/test_oci.py b/support/testing/tests/fs/test_oci.py
> index 38ed168b62..c2e330c512 100644
> --- a/support/testing/tests/fs/test_oci.py
> +++ b/support/testing/tests/fs/test_oci.py
> @@ -3,6 +3,7 @@ import shutil
> import infra.basetest
>
>
> +# gitlab-runner: xlarge
> class TestOci(infra.basetest.BRTest):
> config = \
> """
> diff --git a/support/testing/tests/package/test_dpdk.py b/support/testing/tests/package/test_dpdk.py
> index 6f55cddee8..0438fe3d4c 100644
> --- a/support/testing/tests/package/test_dpdk.py
> +++ b/support/testing/tests/package/test_dpdk.py
> @@ -3,6 +3,7 @@ import os
> import infra.basetest
>
>
> +# gitlab-runner: xlarge
> class TestDPDK(infra.basetest.BRTest):
> config = \
> """
> diff --git a/support/testing/tests/package/test_flutter.py b/support/testing/tests/package/test_flutter.py
> index 95cccb529d..30c6a430fa 100644
> --- a/support/testing/tests/package/test_flutter.py
> +++ b/support/testing/tests/package/test_flutter.py
> @@ -5,7 +5,7 @@ import infra.basetest
> from ..graphics_base import GraphicsBase
>
>
> -# gitlab-runner: xlarge
> +# gitlab-runner: 2xlarge
> class TestFlutter(infra.basetest.BRTest, GraphicsBase):
> config = f"""
> BR2_aarch64=y
> diff --git a/support/testing/tests/package/test_mariadb.py b/support/testing/tests/package/test_mariadb.py
> index d40ffdba96..67ae61c3e1 100644
> --- a/support/testing/tests/package/test_mariadb.py
> +++ b/support/testing/tests/package/test_mariadb.py
> @@ -3,6 +3,7 @@ import os
> import infra.basetest
>
>
> +# gitlab-runner: xlarge
> class TestMariaDB(infra.basetest.BRTest):
> # We use a specific configuration for:
> # - using Aarch64, to have more than 256MB memory,
> diff --git a/support/testing/tests/package/test_nodejs.py b/support/testing/tests/package/test_nodejs.py
> index 0e679a0ddd..5f3d41a28c 100644
> --- a/support/testing/tests/package/test_nodejs.py
> +++ b/support/testing/tests/package/test_nodejs.py
> @@ -29,7 +29,7 @@ class TestNodeJSBasic(infra.basetest.BRTest):
> self.assertRunOk("node sample_nodejs_basic.js")
>
>
> -# gitlab-runner: large
> +# gitlab-runner: 2xlarge
> class TestNodeJSModuleHostBin(infra.basetest.BRTest):
> config = \
> """
> diff --git a/support/testing/tests/package/test_octave.py b/support/testing/tests/package/test_octave.py
> index 4b269e3af0..5c0b26a5fd 100644
> --- a/support/testing/tests/package/test_octave.py
> +++ b/support/testing/tests/package/test_octave.py
> @@ -3,6 +3,7 @@ import os
> import infra.basetest
>
>
> +# gitlab-runner: xlarge
> class TestOctave(infra.basetest.BRTest):
> # infra.basetest.BASIC_TOOLCHAIN_CONFIG cannot be used as it does
> # not include gfortran.
> diff --git a/support/testing/tests/package/test_podman.py b/support/testing/tests/package/test_podman.py
> index 9d86a06129..bd16bd99ac 100644
> --- a/support/testing/tests/package/test_podman.py
> +++ b/support/testing/tests/package/test_podman.py
> @@ -211,11 +211,13 @@ class PodmanBase(infra.basetest.BRTest):
> self.assertEqual(len(img_info), 0, f"{len(img_info)} image(s) still present, expecting 0")
>
>
> +# gitlab-runner: xlarge
> class TestPodmanIptables(PodmanBase):
> def test_run(self):
> self.do_test()
>
>
> +# gitlab-runner: xlarge
> class TestPodmanNftables(PodmanBase):
> config = PodmanBase.config + """
> BR2_PACKAGE_NFTABLES=y
> @@ -225,6 +227,7 @@ class TestPodmanNftables(PodmanBase):
> self.do_test()
>
>
> +# gitlab-runner: xlarge
> class TestPodmanTini(PodmanBase):
> config = PodmanBase.config + """
> BR2_PACKAGE_PODMAN_INIT_TINI=y
> @@ -234,6 +237,7 @@ class TestPodmanTini(PodmanBase):
> self.do_test()
>
>
> +# gitlab-runner: xlarge
> class TestPodmanSlirpIptables(PodmanBase):
> config = PodmanBase.config + """
> BR2_PACKAGE_PODMAN_NET_SLIRP4NETNS=y
> @@ -243,6 +247,7 @@ class TestPodmanSlirpIptables(PodmanBase):
> self.do_test()
>
>
> +# gitlab-runner: xlarge
> class TestPodmanSlirpNftables(PodmanBase):
> config = PodmanBase.config + """
> BR2_PACKAGE_NFTABLES=y
> diff --git a/support/testing/tests/package/test_python_pyqt5.py b/support/testing/tests/package/test_python_pyqt5.py
> index fd933ba560..571012ed7c 100644
> --- a/support/testing/tests/package/test_python_pyqt5.py
> +++ b/support/testing/tests/package/test_python_pyqt5.py
> @@ -3,7 +3,7 @@ import os
> import infra.basetest
>
>
> -# gitlab-runner: large
> +# gitlab-runner: 2xlarge
> class TestPythonPyQt5(infra.basetest.BRTest):
> # We use a specific configuration for:
> # - using Aarch64, to have more than 256MB memory,
> diff --git a/support/testing/tests/package/test_weston.py b/support/testing/tests/package/test_weston.py
> index 1b25d5ac5e..c8b243a6a7 100644
> --- a/support/testing/tests/package/test_weston.py
> +++ b/support/testing/tests/package/test_weston.py
> @@ -5,7 +5,7 @@ import infra.basetest
> from ..graphics_base import GraphicsBase
>
>
> -# gitlab-runner: large
> +# gitlab-runner: 2xlarge
> class TestWeston(infra.basetest.BRTest, GraphicsBase):
> config = \
> """
> diff --git a/support/testing/tests/package/test_z3.py b/support/testing/tests/package/test_z3.py
> index 30794a250b..851dcfab1a 100644
> --- a/support/testing/tests/package/test_z3.py
> +++ b/support/testing/tests/package/test_z3.py
> @@ -3,6 +3,7 @@ import os
> import infra.basetest
>
>
> +# gitlab-runner: xlarge
> class TestZ3(infra.basetest.BRTest):
> config = infra.basetest.BASIC_TOOLCHAIN_CONFIG + \
> """
> --
> 2.54.0
>
> _______________________________________________
> buildroot mailing list
> buildroot@buildroot.org
> https://lists.buildroot.org/mailman/listinfo/buildroot
_______________________________________________
buildroot mailing list
buildroot@buildroot.org
https://lists.buildroot.org/mailman/listinfo/buildroot
next prev parent reply other threads:[~2026-06-12 11:37 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-05-30 17:58 [Buildroot] [PATCH 1/3] Revert "support/testing: generate runtime test jobs with runner tags" Romain Naour via buildroot
2026-05-30 17:58 ` [Buildroot] [PATCH 2/3] support/testing: generate runtime test jobs with runner tags Romain Naour via buildroot
2026-06-12 11:37 ` Thomas Perale via buildroot
2026-05-30 17:58 ` [Buildroot] [PATCH 3/3] support/testing: use larger runner to reduce the CI minute consumed per pipeline Romain Naour via buildroot
2026-06-12 11:37 ` Thomas Perale via buildroot [this message]
2026-05-30 20:36 ` [Buildroot] [PATCH 1/3] Revert "support/testing: generate runtime test jobs with runner tags" Arnout Vandecappelle via buildroot
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260612113751.252126-1-thomas.perale@mind.be \
--to=buildroot@buildroot.org \
--cc=romain.naour@smile.fr \
--cc=thomas.perale@mind.be \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox