[PATCH] ptest-packagelists.inc: disable gnutls for RISCV64

[PATCH] ptest-packagelists.inc: disable gnutls for RISCV64

[João Marcos Costa]

Timeouts have been observed (very frequently in the past weeks)
in the autobuilder, and a bug [1] was filed at Bugzilla.

For now, it's not quite clear what specific test case is causing the timeout.

[1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162

Signed-off-by: João Marcos Costa <joaomarcos.costa@bootlin.com>
---
 meta/conf/distro/include/ptest-packagelists.inc | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/meta/conf/distro/include/ptest-packagelists.inc b/meta/conf/distro/include/ptest-packagelists.inc
index 79e27f617b..9b264657bb 100644
--- a/meta/conf/distro/include/ptest-packagelists.inc
+++ b/meta/conf/distro/include/ptest-packagelists.inc
@@ -163,8 +163,8 @@ PTESTS_PROBLEMS:append:riscv32 = " lttng-tools strace"
 PTESTS_SLOW:append:libc-musl = " libc-test"
 
 # These tests don't yet pass for riscv64
-PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd"
-PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd"
+PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
+PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
 
 # These tests don't yet pass for musl qemuarm64
 PTESTS_SLOW:remove:libc-musl:qemuarm64 = "strace perl gnutls glib-2.0"
-- 
2.55.0

Re: [PATCH] ptest-packagelists.inc: disable gnutls for RISCV64

[Trevor Gamblin]

On Fri Sep 18, 2026 at 5:07 AM EDT, João Marcos Costa wrote:
> Timeouts have been observed (very frequently in the past weeks)
> in the autobuilder, and a bug [1] was filed at Bugzilla.
>
> For now, it's not quite clear what specific test case is causing the timeout.
>
> [1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162

I think that this change is too aggressive given what we actually see in the AB
issue - most of the logs seem to show a timeout at the same part of the ptest
run, after the 'mini-record' test. I'm doing some investigation locally to see
what the heaviest tests in the suite are, so that we can more surgically disable
only the problematic ones instead.

Trevor
>
> Signed-off-by: João Marcos Costa <joaomarcos.costa@bootlin.com>
> ---
>  meta/conf/distro/include/ptest-packagelists.inc | 4 ++--
>  1 file changed, 2 insertions(+), 2 deletions(-)
>
> diff --git a/meta/conf/distro/include/ptest-packagelists.inc b/meta/conf/distro/include/ptest-packagelists.inc
> index 79e27f617b..9b264657bb 100644
> --- a/meta/conf/distro/include/ptest-packagelists.inc
> +++ b/meta/conf/distro/include/ptest-packagelists.inc
> @@ -163,8 +163,8 @@ PTESTS_PROBLEMS:append:riscv32 = " lttng-tools strace"
>  PTESTS_SLOW:append:libc-musl = " libc-test"
>  
>  # These tests don't yet pass for riscv64
> -PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd"
> -PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd"
> +PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
> +PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
>  
>  # These tests don't yet pass for musl qemuarm64
>  PTESTS_SLOW:remove:libc-musl:qemuarm64 = "strace perl gnutls glib-2.0"

Re: [PATCH] ptest-packagelists.inc: disable gnutls for RISCV64

[Trevor Gamblin]

On Fri Sep 18, 2026 at 5:07 AM EDT, João Marcos Costa wrote:
> Timeouts have been observed (very frequently in the past weeks)
> in the autobuilder, and a bug [1] was filed at Bugzilla.
>
> For now, it's not quite clear what specific test case is causing the timeout.
>
> [1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162

After modifying the gnutls ptest so that it outputs rough test durations (in ms)
and collecting a log, these seem to be the worst offenders:

|tgamblin@megalith ~/workspace/ypbuilds/poky-qemuriscv64/layers/openembedded-core (master)$ grep 'PASS:' tests.log | sort -t'(' -k2 -n -r
|PASS: mini-record-2 (187880ms)
|PASS: record-retvals (145390ms)
|PASS: rng-op-key (63820ms)
|PASS: rng-op-random (63330ms)
|PASS: rng-op-nonce (63260ms)
|PASS: dtls-rehandshake-cert (61360ms)
|PASS: dtls-rehandshake-cert-2 (61230ms)
|PASS: dtls-rehandshake-anon (61030ms)
|PASS: mini-loss-time (60130ms)
|PASS: mini-dtls-hello-verify-48 (30050ms)
|PASS: tls12-ffdhe (27790ms)
|PASS: x509sign-verify-rsa (18460ms)
|PASS: x509sign-verify-ecdsa (16050ms)

mini-record-2 is longest runtime by far, and is consistent with what the
Bugzilla bug shows - if you build core-image-ptest-gnutls and watch the output,
mini-record-2 comes after mini-record, which is the last on that runs before the
AB log timeouts. Do you want to submit a narrower patch, which conditionally
disables mini-record-2 and record-retvals for riscv64?

>
> Signed-off-by: João Marcos Costa <joaomarcos.costa@bootlin.com>
> ---
>  meta/conf/distro/include/ptest-packagelists.inc | 4 ++--
>  1 file changed, 2 insertions(+), 2 deletions(-)
>
> diff --git a/meta/conf/distro/include/ptest-packagelists.inc b/meta/conf/distro/include/ptest-packagelists.inc
> index 79e27f617b..9b264657bb 100644
> --- a/meta/conf/distro/include/ptest-packagelists.inc
> +++ b/meta/conf/distro/include/ptest-packagelists.inc
> @@ -163,8 +163,8 @@ PTESTS_PROBLEMS:append:riscv32 = " lttng-tools strace"
>  PTESTS_SLOW:append:libc-musl = " libc-test"
>  
>  # These tests don't yet pass for riscv64
> -PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd"
> -PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd"
> +PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
> +PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
>  
>  # These tests don't yet pass for musl qemuarm64
>  PTESTS_SLOW:remove:libc-musl:qemuarm64 = "strace perl gnutls glib-2.0"

Re: [OE-core] [PATCH] ptest-packagelists.inc: disable gnutls for RISCV64

[Khem Raj]

[-- Attachment #1: Type: text/plain, Size: 3457 bytes --]

On Mon, Sep 21, 2026, 8:12 PM Trevor Gamblin via lists.openembedded.org
<tgamblin=baylibre.com@lists.openembedded.org> wrote:

> On Fri Sep 18, 2026 at 5:07 AM EDT, João Marcos Costa wrote:
> > Timeouts have been observed (very frequently in the past weeks)
> > in the autobuilder, and a bug [1] was filed at Bugzilla.
> >
> > For now, it's not quite clear what specific test case is causing the
> timeout.
> >
> > [1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162
>
> After modifying the gnutls ptest so that it outputs rough test durations
> (in ms)
> and collecting a log, these seem to be the worst offenders:
>
> |tgamblin@megalith
> ~/workspace/ypbuilds/poky-qemuriscv64/layers/openembedded-core (master)$
> grep 'PASS:' tests.log | sort -t'(' -k2 -n -r
> |PASS: mini-record-2 (187880ms)
> |PASS: record-retvals (145390ms)
> |PASS: rng-op-key (63820ms)
> |PASS: rng-op-random (63330ms)
> |PASS: rng-op-nonce (63260ms)
> |PASS: dtls-rehandshake-cert (61360ms)
> |PASS: dtls-rehandshake-cert-2 (61230ms)
> |PASS: dtls-rehandshake-anon (61030ms)
> |PASS: mini-loss-time (60130ms)
> |PASS: mini-dtls-hello-verify-48 (30050ms)
> |PASS: tls12-ffdhe (27790ms)
> |PASS: x509sign-verify-rsa (18460ms)
> |PASS: x509sign-verify-ecdsa (16050ms)
>
> mini-record-2 is longest runtime by far, and is consistent with what the
> Bugzilla bug shows - if you build core-image-ptest-gnutls and watch the
> output,
> mini-record-2 comes after mini-record, which is the last on that runs
> before the
> AB log timeouts. Do you want to submit a narrower patch, which
> conditionally
> disables mini-record-2 and record-retvals for riscv64?
>

Or relax the timeout a bit


> >
> > Signed-off-by: João Marcos Costa <joaomarcos.costa@bootlin.com>
> > ---
> >  meta/conf/distro/include/ptest-packagelists.inc | 4 ++--
> >  1 file changed, 2 insertions(+), 2 deletions(-)
> >
> > diff --git a/meta/conf/distro/include/ptest-packagelists.inc
> b/meta/conf/distro/include/ptest-packagelists.inc
> > index 79e27f617b..9b264657bb 100644
> > --- a/meta/conf/distro/include/ptest-packagelists.inc
> > +++ b/meta/conf/distro/include/ptest-packagelists.inc
> > @@ -163,8 +163,8 @@ PTESTS_PROBLEMS:append:riscv32 = " lttng-tools
> strace"
> >  PTESTS_SLOW:append:libc-musl = " libc-test"
> >
> >  # These tests don't yet pass for riscv64
> > -PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools
> python3-numpy perl glib-2.0 zstd"
> > -PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace
> lttng-tools python3-numpy perl glib-2.0 zstd"
> > +PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools
> python3-numpy perl glib-2.0 zstd gnutls"
> > +PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace
> lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
> >
> >  # These tests don't yet pass for musl qemuarm64
> >  PTESTS_SLOW:remove:libc-musl:qemuarm64 = "strace perl gnutls glib-2.0"
>
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#246367):
> https://lists.openembedded.org/g/openembedded-core/message/246367
> Mute This Topic: https://lists.openembedded.org/mt/121311542/1997914
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [
> raj.khem@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
>

[-- Attachment #2: Type: text/html, Size: 5116 bytes --]

Re: [OE-core] [PATCH] ptest-packagelists.inc: disable gnutls for RISCV64

[Joao Marcos Costa]

Hello, Trevor

On 9/21/26 9:44 PM, Trevor Gamblin wrote:
> On Fri Sep 18, 2026 at 5:07 AM EDT, João Marcos Costa wrote:
>> Timeouts have been observed (very frequently in the past weeks)
>> in the autobuilder, and a bug [1] was filed at Bugzilla.
>>
>> For now, it's not quite clear what specific test case is causing the timeout.
>>
>> [1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162
> 
> I think that this change is too aggressive given what we actually see in the AB
> issue - most of the logs seem to show a timeout at the same part of the ptest
> run, after the 'mini-record' test. I'm doing some investigation locally to see
> what the heaviest tests in the suite are, so that we can more surgically disable
> only the problematic ones instead.

Well, it was agressive indeed, considering how frequent this one became 
in the past few weeks, and I was not 100% happy to send this patch 
either way.

So thanks a lot for narrowing it down. I can send a v2 later this week 
to handle the worst offenders (as per your comment in bugzilla).

> Trevor
>>
>> Signed-off-by: João Marcos Costa <joaomarcos.costa@bootlin.com>
>> ---
>>   meta/conf/distro/include/ptest-packagelists.inc | 4 ++--
>>   1 file changed, 2 insertions(+), 2 deletions(-)
>>
>> diff --git a/meta/conf/distro/include/ptest-packagelists.inc b/meta/conf/distro/include/ptest-packagelists.inc
>> index 79e27f617b..9b264657bb 100644
>> --- a/meta/conf/distro/include/ptest-packagelists.inc
>> +++ b/meta/conf/distro/include/ptest-packagelists.inc
>> @@ -163,8 +163,8 @@ PTESTS_PROBLEMS:append:riscv32 = " lttng-tools strace"
>>   PTESTS_SLOW:append:libc-musl = " libc-test"
>>   
>>   # These tests don't yet pass for riscv64
>> -PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd"
>> -PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd"
>> +PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
>> +PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
>>   
>>   # These tests don't yet pass for musl qemuarm64
>>   PTESTS_SLOW:remove:libc-musl:qemuarm64 = "strace perl gnutls glib-2.0"
> 
> 
> 
> 
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#246347): https://lists.openembedded.org/g/openembedded-core/message/246347
> Mute This Topic: https://lists.openembedded.org/mt/121311542/8026893
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [joaomarcos.costa@bootlin.com]
> -=-=-=-=-=-=-=-=-=-=-=-
> 

-- 
Best regards,
João Marcos Costa

Re: [OE-core] [PATCH] ptest-packagelists.inc: disable gnutls for RISCV64

[Trevor Gamblin]

On Tue Sep 22, 2026 at 4:01 AM EDT, Joao Marcos Costa wrote:
> Hello, Trevor
>
> On 9/21/26 9:44 PM, Trevor Gamblin wrote:
>> On Fri Sep 18, 2026 at 5:07 AM EDT, João Marcos Costa wrote:
>>> Timeouts have been observed (very frequently in the past weeks)
>>> in the autobuilder, and a bug [1] was filed at Bugzilla.
>>>
>>> For now, it's not quite clear what specific test case is causing the timeout.
>>>
>>> [1] https://bugzilla.yoctoproject.org/show_bug.cgi?id=16162
>> 
>> I think that this change is too aggressive given what we actually see in the AB
>> issue - most of the logs seem to show a timeout at the same part of the ptest
>> run, after the 'mini-record' test. I'm doing some investigation locally to see
>> what the heaviest tests in the suite are, so that we can more surgically disable
>> only the problematic ones instead.
>
> Well, it was agressive indeed, considering how frequent this one became 
> in the past few weeks, and I was not 100% happy to send this patch 
> either way.
>
> So thanks a lot for narrowing it down. I can send a v2 later this week 
> to handle the worst offenders (as per your comment in bugzilla).

Sure! Let me know if I can help.
>
>> Trevor
>>>
>>> Signed-off-by: João Marcos Costa <joaomarcos.costa@bootlin.com>
>>> ---
>>>   meta/conf/distro/include/ptest-packagelists.inc | 4 ++--
>>>   1 file changed, 2 insertions(+), 2 deletions(-)
>>>
>>> diff --git a/meta/conf/distro/include/ptest-packagelists.inc b/meta/conf/distro/include/ptest-packagelists.inc
>>> index 79e27f617b..9b264657bb 100644
>>> --- a/meta/conf/distro/include/ptest-packagelists.inc
>>> +++ b/meta/conf/distro/include/ptest-packagelists.inc
>>> @@ -163,8 +163,8 @@ PTESTS_PROBLEMS:append:riscv32 = " lttng-tools strace"
>>>   PTESTS_SLOW:append:libc-musl = " libc-test"
>>>   
>>>   # These tests don't yet pass for riscv64
>>> -PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd"
>>> -PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd"
>>> +PTESTS_SLOW:remove:riscv64 = "tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
>>> +PTESTS_PROBLEMS:append:riscv64 = " tcl tcl8 python3-cffi strace lttng-tools python3-numpy perl glib-2.0 zstd gnutls"
>>>   
>>>   # These tests don't yet pass for musl qemuarm64
>>>   PTESTS_SLOW:remove:libc-musl:qemuarm64 = "strace perl gnutls glib-2.0"
>> 
>> 
>> 
>> 
>> 
>>