* [PATCH v2 0/1] recipes-support/gnutls: disable slow tests for RISCV64 @ 2026-09-28 16:26 João Marcos Costa 2026-09-28 16:26 ` [PATCH v2 1/1] " João Marcos Costa 0 siblings, 1 reply; 5+ messages in thread From: João Marcos Costa @ 2026-09-28 16:26 UTC (permalink / raw) To: openembedded-core; +Cc: thomas.petazzoni, tgamblin, João Marcos Costa Hello, After Trevor's investigation, I was able to remove only the most time consuming test cases. Changes since v1 [1]: - patched the tests instead of entirely disabling gnutls ptests - updated the title accordingly Best regards, [1] https://lists.openembedded.org/g/openembedded-core/message/246201 João Marcos Costa (1): recipes-support/gnutls: disable slow tests for RISCV64 ...m-disable-slow-test-cases-in-RISCV64.patch | 109 ++++++++++++++++++ meta/recipes-support/gnutls/gnutls_3.8.13.bb | 4 + 2 files changed, 113 insertions(+) create mode 100644 meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch -- 2.55.0 ^ permalink raw reply [flat|nested] 5+ messages in thread
* [PATCH v2 1/1] recipes-support/gnutls: disable slow tests for RISCV64 2026-09-28 16:26 [PATCH v2 0/1] recipes-support/gnutls: disable slow tests for RISCV64 João Marcos Costa @ 2026-09-28 16:26 ` João Marcos Costa 2026-09-28 17:04 ` Trevor Gamblin 0 siblings, 1 reply; 5+ messages in thread From: João Marcos Costa @ 2026-09-28 16:26 UTC (permalink / raw) To: openembedded-core; +Cc: thomas.petazzoni, tgamblin, João Marcos Costa Timeouts have been observed (very frequently in the past weeks) in the autobuilder, and a bug [1] was filed at Bugzilla. After some investigation [2] was performed by Trevor Gamblin, we now have a list of the most time consuming test cases: - mini-record-2 (187880ms) - record-retvals (145390ms) - rng-op-key (63820ms) - rng-op-random (63330ms) - rng-op-nonce (63260ms) - dtls-rehandshake-cert (61360ms) - dtls-rehandshake-cert-2 (61230ms) - dtls-rehandshake-anon (61030ms) - mini-loss-time (60130ms) - mini-dtls-hello-verify-48 (30050ms) - tls12-ffdhe (27790ms) - x509sign-verify-rsa (18460ms) - x509sign-verify-ecdsa (16050ms) Disable them to avoid so many timeouts in qemuriscv64-ptest runs. [1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162 [2] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162#c19 Signed-off-by: João Marcos Costa <joaomarcos.costa@bootlin.com> --- ...m-disable-slow-test-cases-in-RISCV64.patch | 109 ++++++++++++++++++ meta/recipes-support/gnutls/gnutls_3.8.13.bb | 4 + 2 files changed, 113 insertions(+) create mode 100644 meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch diff --git a/meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch b/meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch new file mode 100644 index 0000000000..6dbd165658 --- /dev/null +++ b/meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch @@ -0,0 +1,109 @@ +From a27faed63722263f5ae8e2b7fac564de3a65fda1 Mon Sep 17 00:00:00 2001 +From: =?UTF-8?q?Jo=C3=A3o=20Marcos=20Costa?= <joaomarcos.costa@bootlin.com> +Date: Mon, 28 Sep 2026 15:56:37 +0000 +Subject: [PATCH] tests/Makefile.am: disable slow test cases in RISCV64 +MIME-Version: 1.0 +Content-Type: text/plain; charset=UTF-8 +Content-Transfer-Encoding: 8bit + +Timeouts have been observed (very frequently in the past weeks) +in the autobuilder, and a bug [1] was filed at Bugzilla. + +After some investigation [2] was performed by Trevor Gamblin, we now have a +list of the most time consuming test cases: + +- mini-record-2 (187880ms) +- record-retvals (145390ms) +- rng-op-key (63820ms) +- rng-op-random (63330ms) +- rng-op-nonce (63260ms) +- dtls-rehandshake-cert (61360ms) +- dtls-rehandshake-cert-2 (61230ms) +- dtls-rehandshake-anon (61030ms) +- mini-loss-time (60130ms) +- mini-dtls-hello-verify-48 (30050ms) +- tls12-ffdhe (27790ms) +- x509sign-verify-rsa (18460ms) +- x509sign-verify-ecdsa (16050ms) + +Disable them to avoid so many timeouts in qemuriscv64-ptest runs. + +Upstream-Status: Inappropriate [oe-core specific] + +[1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162 +[2] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162#c19 + +Signed-off-by: João Marcos Costa <joaomarcos.costa@bootlin.com> +--- + tests/Makefile.am | 20 ++++++++++---------- + 1 file changed, 10 insertions(+), 10 deletions(-) + +diff --git a/tests/Makefile.am b/tests/Makefile.am +index f84b2f1..b03e570 100644 +--- a/tests/Makefile.am ++++ b/tests/Makefile.am +@@ -161,7 +161,7 @@ ctests += tls13-early-start + + ctests += tls13/no-auto-send-ticket + +-ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert certuniqueid tls-neg-ext-key \ ++ctests += simple gnutls_hmac_fast set_pkcs12_cred cert certuniqueid tls-neg-ext-key \ + mpi certificate_set_x509_crl dn parse_ca x509-dn x509-dn-decode record-sizes \ + hostname-check cve-2008-4989 pkcs12_s2k chainverify missingissuer missingissuer_aia record-sizes-range \ + crq_key_id x509sign-verify sign-verify cve-2009-1415 cve-2009-1416 \ +@@ -172,13 +172,13 @@ ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert certuniquei + rng-fork mini-eagain-dtls resume-dtls empty_retrieve_function \ + tls13-rehandshake-cert gnutls_ext_raw_parse handshake-large-cert \ + x509cert x509cert-tl x509cert-ct infoaccess mini-dtls-hello-verify sign-verify-ed25519-rfc8080 \ +- trustdb-tofu dtls-rehandshake-anon mini-alpn mini-dtls-large \ ++ trustdb-tofu mini-alpn mini-dtls-large \ + mini-termination mini-x509-cas mini-x509-2 pkcs12_simple \ +- mini-emsgsize-dtls chainverify-unsorted mini-overhead tls12-ffdhe \ ++ mini-emsgsize-dtls chainverify-unsorted mini-overhead \ + mini-dtls-heartbeat mini-x509-callbacks key-openssl priorities priorities-groups \ + gnutls_x509_privkey_import gnutls_x509_crt_list_import time x509-server-verify \ + sign-verify-ext4 tls-neg-ext4-key resume-lifetime \ +- mini-dtls-srtp rsa-encrypt-decrypt mini-loss-time gnutls-strcodes \ ++ mini-dtls-srtp rsa-encrypt-decrypt gnutls-strcodes \ + mini-record mini-dtls-record handshake-timeout mini-record-range \ + cert-status rsa-psk global-init sec-params sign-verify-data \ + fips-test fips-override-test mini-global-load name-constraints x509-extensions \ +@@ -192,16 +192,16 @@ ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert certuniquei + rsa-rsa-oaep rsa-rsa-pss \ + mini-dtls-fork mini-key-material x509cert-invalid \ + tls-ext-register tls-supplemental mini-dtls0-9 duplicate-extensions \ +- record-retvals mini-server-name tls-etm tls-force-etm x509-cert-callback alerts \ ++ mini-server-name tls-etm tls-force-etm x509-cert-callback alerts \ + client-sign-md5-rep tls12-invalid-key-exchanges session-rdn-read \ + tls13-cert-key-exchange x509-cert-callback-ocsp gnutls_ocsp_resp_list_import2 \ + server-sign-md5-rep privkey-keygen mini-tls-nonblock no-signal pkcs7-gen dtls-etm \ +- x509sign-verify-rsa x509sign-verify-ecdsa x509sign-verify-gost \ ++ x509sign-verify-gost \ + cipher-alignment oids atfork prf psk-file priority-init2 post-client-hello-change-prio \ + status-request status-request-ok rfc7633-missing sign-verify-ext \ +- fallback-scsv pkcs8-key-decode urls dtls-rehandshake-cert rfc7633-ok \ ++ fallback-scsv pkcs8-key-decode urls rfc7633-ok \ + key-usage-rsa key-usage-ecdhe-rsa mini-session-verify-function auto-verify \ +- record-timeouts mini-dtls-hello-verify-48 set-default-prio \ ++ record-timeouts set-default-prio \ + tls12-anon-upgrade tlsext-decoding rsa-psk-cb gnutls-ids \ + rehandshake-switch-cert rehandshake-switch-cert-allow rehandshake-switch-cert-client \ + rehandshake-switch-cert-client-allow handshake-versions dtls-handshake-versions \ +@@ -214,7 +214,7 @@ ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert certuniquei + set_x509_key_file_der set_x509_pkcs12_key crt_apis tls12-cert-key-exchange \ + tls11-cert-key-exchange tls10-cert-key-exchange ssl30-cert-key-exchange \ + dtls12-cert-key-exchange dtls10-cert-key-exchange x509-cert-callback-legacy \ +- keylog-env ssl2-hello tlsfeature-ext dtls-rehandshake-cert-2 dtls-session-ticket-lost \ ++ keylog-env ssl2-hello tlsfeature-ext dtls-session-ticket-lost \ + tlsfeature-crt dtls-rehandshake-cert-3 resume-with-false-start \ + set_x509_key_file_ocsp client-fastopen rng-sigint srp \ + safe-renegotiation/srn0 safe-renegotiation/srn1 safe-renegotiation/srn2 \ +@@ -230,7 +230,7 @@ ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert certuniquei + rng-no-onload dtls1-2-mtu-check crl_apis cert_verify_inv_utf8 no-extensions \ + no-status-request hostname-check-utf8 pkcs8-key-decode-encrypted priority-mix pkcs7 \ + send-data-before-handshake recv-data-before-handshake crt_inv_write \ +- x509sign-verify-error rng-op-nonce rng-op-random rng-op-key x509-dn-decode-compat \ ++ x509sign-verify-error x509-dn-decode-compat \ + ip-check mini-x509-ipaddr trust-store base64-raw random-art dhex509self \ + dss-sig-val sign-pk-api tls-session-ext-override record-pad \ + tls13-server-kx-neg gnutls_ext_raw_parse_dtls key-export-pkcs8 \ diff --git a/meta/recipes-support/gnutls/gnutls_3.8.13.bb b/meta/recipes-support/gnutls/gnutls_3.8.13.bb index 9c8c994bdc..ff1c3e661e 100644 --- a/meta/recipes-support/gnutls/gnutls_3.8.13.bb +++ b/meta/recipes-support/gnutls/gnutls_3.8.13.bb @@ -27,6 +27,10 @@ SRC_URI = "https://www.gnupg.org/ftp/gcrypt/gnutls/v${SHRT_VER}/gnutls-${PV}.tar file://0001-tests-mini-dtls-framents-link-to-gnulib.patch \ " +SRC_URI:append:riscv64 = "\ + file://0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch \ +" + SRC_URI[sha256sum] = "ffed8ec1bf09c2426d4f14aae377de4753b53e537d685e604e99a8b16ca9c97e" inherit autotools texinfo pkgconfig gettext lib_package gtk-doc ptest -- 2.55.0 ^ permalink raw reply related [flat|nested] 5+ messages in thread
* Re: [PATCH v2 1/1] recipes-support/gnutls: disable slow tests for RISCV64 2026-09-28 16:26 ` [PATCH v2 1/1] " João Marcos Costa @ 2026-09-28 17:04 ` Trevor Gamblin 2026-09-28 19:09 ` [OE-core] " Joao Marcos Costa 0 siblings, 1 reply; 5+ messages in thread From: Trevor Gamblin @ 2026-09-28 17:04 UTC (permalink / raw) To: João Marcos Costa, openembedded-core; +Cc: thomas.petazzoni, tgamblin On Mon Sep 28, 2026 at 12:26 PM EDT, João Marcos Costa wrote: > Timeouts have been observed (very frequently in the past weeks) > in the autobuilder, and a bug [1] was filed at Bugzilla. > > After some investigation [2] was performed by Trevor Gamblin, we now have a > list of the most time consuming test cases: > > - mini-record-2 (187880ms) > - record-retvals (145390ms) > - rng-op-key (63820ms) > - rng-op-random (63330ms) > - rng-op-nonce (63260ms) > - dtls-rehandshake-cert (61360ms) > - dtls-rehandshake-cert-2 (61230ms) > - dtls-rehandshake-anon (61030ms) > - mini-loss-time (60130ms) > - mini-dtls-hello-verify-48 (30050ms) > - tls12-ffdhe (27790ms) > - x509sign-verify-rsa (18460ms) > - x509sign-verify-ecdsa (16050ms) > > Disable them to avoid so many timeouts in qemuriscv64-ptest runs. Thanks for submitting this. I'm sorry if I wasn't clear before, but I think we should only disable mini-record-2 and record-retvals to start, since they are significantly longer than all of the others. If gnutls remains a problem afterward then the others should be considered, but for now we want to try retaining the others to maximize test coverage. Trevor > > [1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162 > [2] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162#c19 > > Signed-off-by: João Marcos Costa <joaomarcos.costa@bootlin.com> > --- > ...m-disable-slow-test-cases-in-RISCV64.patch | 109 ++++++++++++++++++ > meta/recipes-support/gnutls/gnutls_3.8.13.bb | 4 + > 2 files changed, 113 insertions(+) > create mode 100644 meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch > > diff --git a/meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch b/meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch > new file mode 100644 > index 0000000000..6dbd165658 > --- /dev/null > +++ b/meta/recipes-support/gnutls/gnutls/0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch > @@ -0,0 +1,109 @@ > +From a27faed63722263f5ae8e2b7fac564de3a65fda1 Mon Sep 17 00:00:00 2001 > +From: =?UTF-8?q?Jo=C3=A3o=20Marcos=20Costa?= <joaomarcos.costa@bootlin.com> > +Date: Mon, 28 Sep 2026 15:56:37 +0000 > +Subject: [PATCH] tests/Makefile.am: disable slow test cases in RISCV64 > +MIME-Version: 1.0 > +Content-Type: text/plain; charset=UTF-8 > +Content-Transfer-Encoding: 8bit > + > +Timeouts have been observed (very frequently in the past weeks) > +in the autobuilder, and a bug [1] was filed at Bugzilla. > + > +After some investigation [2] was performed by Trevor Gamblin, we now have a > +list of the most time consuming test cases: > + > +- mini-record-2 (187880ms) > +- record-retvals (145390ms) > +- rng-op-key (63820ms) > +- rng-op-random (63330ms) > +- rng-op-nonce (63260ms) > +- dtls-rehandshake-cert (61360ms) > +- dtls-rehandshake-cert-2 (61230ms) > +- dtls-rehandshake-anon (61030ms) > +- mini-loss-time (60130ms) > +- mini-dtls-hello-verify-48 (30050ms) > +- tls12-ffdhe (27790ms) > +- x509sign-verify-rsa (18460ms) > +- x509sign-verify-ecdsa (16050ms) > + > +Disable them to avoid so many timeouts in qemuriscv64-ptest runs. > + > +Upstream-Status: Inappropriate [oe-core specific] > + > +[1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162 > +[2] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162#c19 > + > +Signed-off-by: João Marcos Costa <joaomarcos.costa@bootlin.com> > +--- > + tests/Makefile.am | 20 ++++++++++---------- > + 1 file changed, 10 insertions(+), 10 deletions(-) > + > +diff --git a/tests/Makefile.am b/tests/Makefile.am > +index f84b2f1..b03e570 100644 > +--- a/tests/Makefile.am > ++++ b/tests/Makefile.am > +@@ -161,7 +161,7 @@ ctests += tls13-early-start > + > + ctests += tls13/no-auto-send-ticket > + > +-ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert certuniqueid tls-neg-ext-key \ > ++ctests += simple gnutls_hmac_fast set_pkcs12_cred cert certuniqueid tls-neg-ext-key \ > + mpi certificate_set_x509_crl dn parse_ca x509-dn x509-dn-decode record-sizes \ > + hostname-check cve-2008-4989 pkcs12_s2k chainverify missingissuer missingissuer_aia record-sizes-range \ > + crq_key_id x509sign-verify sign-verify cve-2009-1415 cve-2009-1416 \ > +@@ -172,13 +172,13 @@ ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert certuniquei > + rng-fork mini-eagain-dtls resume-dtls empty_retrieve_function \ > + tls13-rehandshake-cert gnutls_ext_raw_parse handshake-large-cert \ > + x509cert x509cert-tl x509cert-ct infoaccess mini-dtls-hello-verify sign-verify-ed25519-rfc8080 \ > +- trustdb-tofu dtls-rehandshake-anon mini-alpn mini-dtls-large \ > ++ trustdb-tofu mini-alpn mini-dtls-large \ > + mini-termination mini-x509-cas mini-x509-2 pkcs12_simple \ > +- mini-emsgsize-dtls chainverify-unsorted mini-overhead tls12-ffdhe \ > ++ mini-emsgsize-dtls chainverify-unsorted mini-overhead \ > + mini-dtls-heartbeat mini-x509-callbacks key-openssl priorities priorities-groups \ > + gnutls_x509_privkey_import gnutls_x509_crt_list_import time x509-server-verify \ > + sign-verify-ext4 tls-neg-ext4-key resume-lifetime \ > +- mini-dtls-srtp rsa-encrypt-decrypt mini-loss-time gnutls-strcodes \ > ++ mini-dtls-srtp rsa-encrypt-decrypt gnutls-strcodes \ > + mini-record mini-dtls-record handshake-timeout mini-record-range \ > + cert-status rsa-psk global-init sec-params sign-verify-data \ > + fips-test fips-override-test mini-global-load name-constraints x509-extensions \ > +@@ -192,16 +192,16 @@ ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert certuniquei > + rsa-rsa-oaep rsa-rsa-pss \ > + mini-dtls-fork mini-key-material x509cert-invalid \ > + tls-ext-register tls-supplemental mini-dtls0-9 duplicate-extensions \ > +- record-retvals mini-server-name tls-etm tls-force-etm x509-cert-callback alerts \ > ++ mini-server-name tls-etm tls-force-etm x509-cert-callback alerts \ > + client-sign-md5-rep tls12-invalid-key-exchanges session-rdn-read \ > + tls13-cert-key-exchange x509-cert-callback-ocsp gnutls_ocsp_resp_list_import2 \ > + server-sign-md5-rep privkey-keygen mini-tls-nonblock no-signal pkcs7-gen dtls-etm \ > +- x509sign-verify-rsa x509sign-verify-ecdsa x509sign-verify-gost \ > ++ x509sign-verify-gost \ > + cipher-alignment oids atfork prf psk-file priority-init2 post-client-hello-change-prio \ > + status-request status-request-ok rfc7633-missing sign-verify-ext \ > +- fallback-scsv pkcs8-key-decode urls dtls-rehandshake-cert rfc7633-ok \ > ++ fallback-scsv pkcs8-key-decode urls rfc7633-ok \ > + key-usage-rsa key-usage-ecdhe-rsa mini-session-verify-function auto-verify \ > +- record-timeouts mini-dtls-hello-verify-48 set-default-prio \ > ++ record-timeouts set-default-prio \ > + tls12-anon-upgrade tlsext-decoding rsa-psk-cb gnutls-ids \ > + rehandshake-switch-cert rehandshake-switch-cert-allow rehandshake-switch-cert-client \ > + rehandshake-switch-cert-client-allow handshake-versions dtls-handshake-versions \ > +@@ -214,7 +214,7 @@ ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert certuniquei > + set_x509_key_file_der set_x509_pkcs12_key crt_apis tls12-cert-key-exchange \ > + tls11-cert-key-exchange tls10-cert-key-exchange ssl30-cert-key-exchange \ > + dtls12-cert-key-exchange dtls10-cert-key-exchange x509-cert-callback-legacy \ > +- keylog-env ssl2-hello tlsfeature-ext dtls-rehandshake-cert-2 dtls-session-ticket-lost \ > ++ keylog-env ssl2-hello tlsfeature-ext dtls-session-ticket-lost \ > + tlsfeature-crt dtls-rehandshake-cert-3 resume-with-false-start \ > + set_x509_key_file_ocsp client-fastopen rng-sigint srp \ > + safe-renegotiation/srn0 safe-renegotiation/srn1 safe-renegotiation/srn2 \ > +@@ -230,7 +230,7 @@ ctests += mini-record-2 simple gnutls_hmac_fast set_pkcs12_cred cert certuniquei > + rng-no-onload dtls1-2-mtu-check crl_apis cert_verify_inv_utf8 no-extensions \ > + no-status-request hostname-check-utf8 pkcs8-key-decode-encrypted priority-mix pkcs7 \ > + send-data-before-handshake recv-data-before-handshake crt_inv_write \ > +- x509sign-verify-error rng-op-nonce rng-op-random rng-op-key x509-dn-decode-compat \ > ++ x509sign-verify-error x509-dn-decode-compat \ > + ip-check mini-x509-ipaddr trust-store base64-raw random-art dhex509self \ > + dss-sig-val sign-pk-api tls-session-ext-override record-pad \ > + tls13-server-kx-neg gnutls_ext_raw_parse_dtls key-export-pkcs8 \ > diff --git a/meta/recipes-support/gnutls/gnutls_3.8.13.bb b/meta/recipes-support/gnutls/gnutls_3.8.13.bb > index 9c8c994bdc..ff1c3e661e 100644 > --- a/meta/recipes-support/gnutls/gnutls_3.8.13.bb > +++ b/meta/recipes-support/gnutls/gnutls_3.8.13.bb > @@ -27,6 +27,10 @@ SRC_URI = "https://www.gnupg.org/ftp/gcrypt/gnutls/v${SHRT_VER}/gnutls-${PV}.tar > file://0001-tests-mini-dtls-framents-link-to-gnulib.patch \ > " > > +SRC_URI:append:riscv64 = "\ > + file://0001-tests-Makefile.am-disable-slow-test-cases-in-RISCV64.patch \ > +" > + > SRC_URI[sha256sum] = "ffed8ec1bf09c2426d4f14aae377de4753b53e537d685e604e99a8b16ca9c97e" > > inherit autotools texinfo pkgconfig gettext lib_package gtk-doc ptest ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [OE-core] [PATCH v2 1/1] recipes-support/gnutls: disable slow tests for RISCV64 2026-09-28 17:04 ` Trevor Gamblin @ 2026-09-28 19:09 ` Joao Marcos Costa 2026-09-28 20:10 ` Trevor Gamblin 0 siblings, 1 reply; 5+ messages in thread From: Joao Marcos Costa @ 2026-09-28 19:09 UTC (permalink / raw) To: Trevor Gamblin, openembedded-core; +Cc: thomas.petazzoni Hello, On 9/28/26 7:04 PM, Trevor Gamblin wrote: > On Mon Sep 28, 2026 at 12:26 PM EDT, João Marcos Costa wrote: >> Timeouts have been observed (very frequently in the past weeks) >> in the autobuilder, and a bug [1] was filed at Bugzilla. >> >> After some investigation [2] was performed by Trevor Gamblin, we now have a >> list of the most time consuming test cases: >> >> - mini-record-2 (187880ms) >> - record-retvals (145390ms) >> - rng-op-key (63820ms) >> - rng-op-random (63330ms) >> - rng-op-nonce (63260ms) >> - dtls-rehandshake-cert (61360ms) >> - dtls-rehandshake-cert-2 (61230ms) >> - dtls-rehandshake-anon (61030ms) >> - mini-loss-time (60130ms) >> - mini-dtls-hello-verify-48 (30050ms) >> - tls12-ffdhe (27790ms) >> - x509sign-verify-rsa (18460ms) >> - x509sign-verify-ecdsa (16050ms) >> >> Disable them to avoid so many timeouts in qemuriscv64-ptest runs. > > Thanks for submitting this. I'm sorry if I wasn't clear before, but I think we > should only disable mini-record-2 and record-retvals to start, since they are > significantly longer than all of the others. If gnutls remains a problem > afterward then the others should be considered, but for now we want to try > retaining the others to maximize test coverage. > > Trevor In that case, I'd rather remove at least the cases that take > 60000ms to run, and avoid getting back to this again when the runners are more loaded than usual. What do you think? -- Best regards, João Marcos Costa ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [OE-core] [PATCH v2 1/1] recipes-support/gnutls: disable slow tests for RISCV64 2026-09-28 19:09 ` [OE-core] " Joao Marcos Costa @ 2026-09-28 20:10 ` Trevor Gamblin 0 siblings, 0 replies; 5+ messages in thread From: Trevor Gamblin @ 2026-09-28 20:10 UTC (permalink / raw) To: Joao Marcos Costa, Trevor Gamblin, openembedded-core; +Cc: thomas.petazzoni On Mon Sep 28, 2026 at 3:09 PM EDT, Joao Marcos Costa wrote: > Hello, > > On 9/28/26 7:04 PM, Trevor Gamblin wrote: >> On Mon Sep 28, 2026 at 12:26 PM EDT, João Marcos Costa wrote: >>> Timeouts have been observed (very frequently in the past weeks) >>> in the autobuilder, and a bug [1] was filed at Bugzilla. >>> >>> After some investigation [2] was performed by Trevor Gamblin, we now have a >>> list of the most time consuming test cases: >>> >>> - mini-record-2 (187880ms) >>> - record-retvals (145390ms) >>> - rng-op-key (63820ms) >>> - rng-op-random (63330ms) >>> - rng-op-nonce (63260ms) >>> - dtls-rehandshake-cert (61360ms) >>> - dtls-rehandshake-cert-2 (61230ms) >>> - dtls-rehandshake-anon (61030ms) >>> - mini-loss-time (60130ms) >>> - mini-dtls-hello-verify-48 (30050ms) >>> - tls12-ffdhe (27790ms) >>> - x509sign-verify-rsa (18460ms) >>> - x509sign-verify-ecdsa (16050ms) >>> >>> Disable them to avoid so many timeouts in qemuriscv64-ptest runs. >> >> Thanks for submitting this. I'm sorry if I wasn't clear before, but I think we >> should only disable mini-record-2 and record-retvals to start, since they are >> significantly longer than all of the others. If gnutls remains a problem >> afterward then the others should be considered, but for now we want to try >> retaining the others to maximize test coverage. >> >> Trevor > > In that case, I'd rather remove at least the cases that take > 60000ms > to run, and avoid getting back to this again when the runners are more > loaded than usual. What do you think? Sure, let's do that for now. I'll keep a list of tests disabled for load/performance reasons and come back to them at some point when we have faster riscv64 hardware in the AB cluster :) ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2026-09-29 5:42 UTC | newest] Thread overview: 5+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2026-09-28 16:26 [PATCH v2 0/1] recipes-support/gnutls: disable slow tests for RISCV64 João Marcos Costa 2026-09-28 16:26 ` [PATCH v2 1/1] " João Marcos Costa 2026-09-28 17:04 ` Trevor Gamblin 2026-09-28 19:09 ` [OE-core] " Joao Marcos Costa 2026-09-28 20:10 ` Trevor Gamblin
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.