[PATCH 1/2] oeqa/runtime/ptest: Use a timeout with command, remove disabling

[PATCH 1/2] oeqa/runtime/ptest: Use a timeout with command, remove disabling

[Richard Purdie]

A simple 'which' call doesn't need the timeout disabling. This was likely
a copy and paste error and can be removed.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
 meta/lib/oeqa/runtime/cases/ptest.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/lib/oeqa/runtime/cases/ptest.py b/meta/lib/oeqa/runtime/cases/ptest.py
index 1a0782374d0..2887e136719 100644
--- a/meta/lib/oeqa/runtime/cases/ptest.py
+++ b/meta/lib/oeqa/runtime/cases/ptest.py
@@ -35,7 +35,7 @@ class PtestRunnerTest(OERuntimeTestCase):
         self.do_ptestrunner()
 
     def do_ptestrunner(self):
-        status, output = self.target.run('which ptest-runner', 0)
+        status, output = self.target.run('which ptest-runner')
         if status != 0:
             self.skipTest("No -ptest packages are installed in the image")
 

[PATCH 2/2] oeqa/runtime/ptest: Improve timeout values

[Richard Purdie]

The ptest runner command has timeouts disabled which has the side effect of limiting
the command logging. This can lead to incomplete logs and makes issues harder to debug
since the log buffer is lost if things crash or are interrupted.

Pass in a timeout value of the ptest timeout + 30 so that debugging is improved.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
---
 meta/lib/oeqa/runtime/cases/ptest.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/lib/oeqa/runtime/cases/ptest.py b/meta/lib/oeqa/runtime/cases/ptest.py
index 2887e136719..57cb050a1d3 100644
--- a/meta/lib/oeqa/runtime/cases/ptest.py
+++ b/meta/lib/oeqa/runtime/cases/ptest.py
@@ -60,7 +60,7 @@ class PtestRunnerTest(OERuntimeTestCase):
         if not libdir in ptest_dirs:
             ptest_dirs.append(libdir)
         ptest_timeout = self.td.get('PTEST_RUNNER_TIMEOUT', '450')
-        status, output = self.target.run('ptest-runner -t {} -d \"{}\"'.format(ptest_timeout, ' '.join(ptest_dirs)), 0)
+        status, output = self.target.run('ptest-runner -t {} -d \"{}\"'.format(ptest_timeout, ' '.join(ptest_dirs)), timeout=int(ptest_timeout)+30)
         os.makedirs(ptest_log_dir)
         with open(ptest_runner_log, 'w') as f:
             f.write(output)

Re: [OE-core] [PATCH 1/2] oeqa/runtime/ptest: Use a timeout with command, remove disabling

[Mathieu Dubois-Briand]

On Wed Mar 4, 2026 at 7:41 PM CET, Richard Purdie via lists.openembedded.org wrote:
> A simple 'which' call doesn't need the timeout disabling. This was likely
> a copy and paste error and can be removed.
>
> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> ---
>  meta/lib/oeqa/runtime/cases/ptest.py | 2 +-
>  1 file changed, 1 insertion(+), 1 deletion(-)
>
> diff --git a/meta/lib/oeqa/runtime/cases/ptest.py b/meta/lib/oeqa/runtime/cases/ptest.py
> index 1a0782374d0..2887e136719 100644
> --- a/meta/lib/oeqa/runtime/cases/ptest.py
> +++ b/meta/lib/oeqa/runtime/cases/ptest.py
> @@ -35,7 +35,7 @@ class PtestRunnerTest(OERuntimeTestCase):
>          self.do_ptestrunner()
>  
>      def do_ptestrunner(self):
> -        status, output = self.target.run('which ptest-runner', 0)
> +        status, output = self.target.run('which ptest-runner')
>          if status != 0:
>              self.skipTest("No -ptest packages are installed in the image")
>  

Hi Richard,

I believe this is causing some ptest failures on riscv64:

Traceback (most recent call last):
  File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/runtime/cases/ptest.py", line 27, in test_ptestrunner_expectfail
    self.do_ptestrunner()
  File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/runtime/cases/ptest.py", line 63, in do_ptestrunner
    status, output = self.target.run('ptest-runner -t {} -d \"{}\"'.format(ptest_timeout, ' '.join(ptest_dirs)), timeout=int(ptest_timeout)+30)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/target/ssh.py", line 98, in run
    status, output = self._run(sshCmd, processTimeout, ignore_status, raw, ignore_ssh_fails)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/target/ssh.py", line 70, in _run
    raise AssertionError("ssh exited with status '255' for command "
AssertionError: ssh exited with status '255' for command '['ssh', '-l', 'root', '-o', 'ServerAliveCountMax=2', '-o', 'ServerAliveInterval=30', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'StrictHostKeyChecking=no', '-o', 'LogLevel=ERROR', '192.168.7.14', 'export PATH=/usr/sbin:/sbin:/usr/bin:/bin; ptest-runner -t 450 -d "/usr/lib"']': this is likely an SSH failure

Process killed - no output for 480 seconds. Total running time: 485 seconds.

Cannot run ptests without @expectedFailure as ptests are expected to fail
WARNING: core-image-ptest-dpkg-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts

And similar errors:

WARNING: core-image-ptest-coreutils-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
Cannot run ptests without @expectedFailure as ptests are expected to fail

WARNING: core-image-ptest-gettext-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
Cannot run ptests without @expectedFailure as ptests are expected to fail

https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1182

Thanks,
Mathieu

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com

Re: [OE-core] [PATCH 1/2] oeqa/runtime/ptest: Use a timeout with command, remove disabling

[Mathieu Dubois-Briand]

On Fri Mar 6, 2026 at 12:47 PM CET, Mathieu Dubois-Briand wrote:
> On Wed Mar 4, 2026 at 7:41 PM CET, Richard Purdie via lists.openembedded.org wrote:
>> A simple 'which' call doesn't need the timeout disabling. This was likely
>> a copy and paste error and can be removed.
>>
>> Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
>> ---
>>  meta/lib/oeqa/runtime/cases/ptest.py | 2 +-
>>  1 file changed, 1 insertion(+), 1 deletion(-)
>>
>> diff --git a/meta/lib/oeqa/runtime/cases/ptest.py b/meta/lib/oeqa/runtime/cases/ptest.py
>> index 1a0782374d0..2887e136719 100644
>> --- a/meta/lib/oeqa/runtime/cases/ptest.py
>> +++ b/meta/lib/oeqa/runtime/cases/ptest.py
>> @@ -35,7 +35,7 @@ class PtestRunnerTest(OERuntimeTestCase):
>>          self.do_ptestrunner()
>>  
>>      def do_ptestrunner(self):
>> -        status, output = self.target.run('which ptest-runner', 0)
>> +        status, output = self.target.run('which ptest-runner')
>>          if status != 0:
>>              self.skipTest("No -ptest packages are installed in the image")
>>  
>

So, a bit more details. I had 4 builds with this patch, because it was
in two branches and tried some rebuilds. All 4 builds failed, but the
failing packages were not always the same:

WARNING: core-image-ptest-openssh-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
WARNING: core-image-ptest-dpkg-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1186

WARNING: core-image-ptest-openssh-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
WARNING: core-image-ptest-coreutils-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1184

WARNING: core-image-ptest-dpkg-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
WARNING: core-image-ptest-coreutils-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
WARNING: core-image-ptest-gettext-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1182

WARNING: core-image-ptest-dpkg-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
WARNING: core-image-ptest-coreutils-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1178


-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com

Re: [OE-core] [PATCH 1/2] oeqa/runtime/ptest: Use a timeout with command, remove disabling

[Richard Purdie]

On Fri, 2026-03-06 at 12:47 +0100, Mathieu Dubois-Briand wrote:
> On Wed Mar 4, 2026 at 7:41 PM CET, Richard Purdie via lists.openembedded.org wrote:
> > A simple 'which' call doesn't need the timeout disabling. This was likely
> > a copy and paste error and can be removed.
> > 
> > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> > ---
> >  meta/lib/oeqa/runtime/cases/ptest.py | 2 +-
> >  1 file changed, 1 insertion(+), 1 deletion(-)
> > 
> > diff --git a/meta/lib/oeqa/runtime/cases/ptest.py b/meta/lib/oeqa/runtime/cases/ptest.py
> > index 1a0782374d0..2887e136719 100644
> > --- a/meta/lib/oeqa/runtime/cases/ptest.py
> > +++ b/meta/lib/oeqa/runtime/cases/ptest.py
> > @@ -35,7 +35,7 @@ class PtestRunnerTest(OERuntimeTestCase):
> >          self.do_ptestrunner()
> >  
> >      def do_ptestrunner(self):
> > -        status, output = self.target.run('which ptest-runner', 0)
> > +        status, output = self.target.run('which ptest-runner')
> >          if status != 0:
> >              self.skipTest("No -ptest packages are installed in the image")
> >  
> 
> Hi Richard,
> 
> I believe this is causing some ptest failures on riscv64:
> 
> Traceback (most recent call last):
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
>     return func(*args, **kwargs)
>            ^^^^^^^^^^^^^^^^^^^^^
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
>     return func(*args, **kwargs)
>            ^^^^^^^^^^^^^^^^^^^^^
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
>     return func(*args, **kwargs)
>            ^^^^^^^^^^^^^^^^^^^^^
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/runtime/cases/ptest.py", line 27, in test_ptestrunner_expectfail
>     self.do_ptestrunner()
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/runtime/cases/ptest.py", line 63, in do_ptestrunner
>     status, output = self.target.run('ptest-runner -t {} -d \"{}\"'.format(ptest_timeout, ' '.join(ptest_dirs)), timeout=int(ptest_timeout)+30)
>                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/target/ssh.py", line 98, in run
>     status, output = self._run(sshCmd, processTimeout, ignore_status, raw, ignore_ssh_fails)
>                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/target/ssh.py", line 70, in _run
>     raise AssertionError("ssh exited with status '255' for command "
> AssertionError: ssh exited with status '255' for command '['ssh', '-l', 'root', '-o', 'ServerAliveCountMax=2', '-o', 'ServerAliveInterval=30', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'StrictHostKeyChecking=no', '-o', 'LogLevel=ERROR', '192.168.7.14', 'export PATH=/usr/sbin:/sbin:/usr/bin:/bin; ptest-runner -t 450 -d "/usr/lib"']': this is likely an SSH failure
> 
> Process killed - no output for 480 seconds. Total running time: 485 seconds.
> 
> Cannot run ptests without @expectedFailure as ptests are expected to fail
> WARNING: core-image-ptest-dpkg-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
> 
> And similar errors:
> 
> WARNING: core-image-ptest-coreutils-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
> Cannot run ptests without @expectedFailure as ptests are expected to fail
> 
> WARNING: core-image-ptest-gettext-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
> Cannot run ptests without @expectedFailure as ptests are expected to fail
> 
> https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1182

Thanks. I think this has lead to an interesting discovery of an
additional issue in ptest-runner with buffering of logs when used non-
interactively.

I've sent a patch to ptest-runner which I believe will address this
issue.

Cheers,

Richard

Re: [OE-core] [PATCH 1/2] oeqa/runtime/ptest: Use a timeout with command, remove disabling

[Anibal Limon]

[-- Attachment #1: Type: text/plain, Size: 5031 bytes --]

Hi,

I have pushed the ptest-runner fix with the tag v2.5.1. The Automatic
Upgrade Helper (AUH) should pick it up shortly.

Cheers!,
Anibal

On Sat, Mar 7, 2026 at 4:52 AM Richard Purdie <
richard.purdie@linuxfoundation.org> wrote:

> On Fri, 2026-03-06 at 12:47 +0100, Mathieu Dubois-Briand wrote:
> > On Wed Mar 4, 2026 at 7:41 PM CET, Richard Purdie via
> lists.openembedded.org wrote:
> > > A simple 'which' call doesn't need the timeout disabling. This was
> likely
> > > a copy and paste error and can be removed.
> > >
> > > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> > > ---
> > >  meta/lib/oeqa/runtime/cases/ptest.py | 2 +-
> > >  1 file changed, 1 insertion(+), 1 deletion(-)
> > >
> > > diff --git a/meta/lib/oeqa/runtime/cases/ptest.py
> b/meta/lib/oeqa/runtime/cases/ptest.py
> > > index 1a0782374d0..2887e136719 100644
> > > --- a/meta/lib/oeqa/runtime/cases/ptest.py
> > > +++ b/meta/lib/oeqa/runtime/cases/ptest.py
> > > @@ -35,7 +35,7 @@ class PtestRunnerTest(OERuntimeTestCase):
> > >          self.do_ptestrunner()
> > >
> > >      def do_ptestrunner(self):
> > > -        status, output = self.target.run('which ptest-runner', 0)
> > > +        status, output = self.target.run('which ptest-runner')
> > >          if status != 0:
> > >              self.skipTest("No -ptest packages are installed in the
> image")
> > >
> >
> > Hi Richard,
> >
> > I believe this is causing some ptest failures on riscv64:
> >
> > Traceback (most recent call last):
> >   File
> "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py",
> line 35, in wrapped_f
> >     return func(*args, **kwargs)
> >            ^^^^^^^^^^^^^^^^^^^^^
> >   File
> "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py",
> line 35, in wrapped_f
> >     return func(*args, **kwargs)
> >            ^^^^^^^^^^^^^^^^^^^^^
> >   File
> "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py",
> line 35, in wrapped_f
> >     return func(*args, **kwargs)
> >            ^^^^^^^^^^^^^^^^^^^^^
> >   File
> "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/runtime/cases/ptest.py",
> line 27, in test_ptestrunner_expectfail
> >     self.do_ptestrunner()
> >   File
> "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/runtime/cases/ptest.py",
> line 63, in do_ptestrunner
> >     status, output = self.target.run('ptest-runner -t {} -d
> \"{}\"'.format(ptest_timeout, ' '.join(ptest_dirs)),
> timeout=int(ptest_timeout)+30)
> >
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> >   File
> "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/target/ssh.py",
> line 98, in run
> >     status, output = self._run(sshCmd, processTimeout, ignore_status,
> raw, ignore_ssh_fails)
> >
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> >   File
> "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/target/ssh.py",
> line 70, in _run
> >     raise AssertionError("ssh exited with status '255' for command "
> > AssertionError: ssh exited with status '255' for command '['ssh', '-l',
> 'root', '-o', 'ServerAliveCountMax=2', '-o', 'ServerAliveInterval=30',
> '-o', 'UserKnownHostsFile=/dev/null', '-o', 'StrictHostKeyChecking=no',
> '-o', 'LogLevel=ERROR', '192.168.7.14', 'export
> PATH=/usr/sbin:/sbin:/usr/bin:/bin; ptest-runner -t 450 -d "/usr/lib"']':
> this is likely an SSH failure
> >
> > Process killed - no output for 480 seconds. Total running time: 485
> seconds.
> >
> > Cannot run ptests without @expectedFailure as ptests are expected to fail
> > WARNING: core-image-ptest-dpkg-1.0-r0 do_testimage: Can not retrieve
> artifacts from test target: Error while fetching compressed artifacts
> >
> > And similar errors:
> >
> > WARNING: core-image-ptest-coreutils-1.0-r0 do_testimage: Can not
> retrieve artifacts from test target: Error while fetching compressed
> artifacts
> > Cannot run ptests without @expectedFailure as ptests are expected to fail
> >
> > WARNING: core-image-ptest-gettext-1.0-r0 do_testimage: Can not retrieve
> artifacts from test target: Error while fetching compressed artifacts
> > Cannot run ptests without @expectedFailure as ptests are expected to fail
> >
> > https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1182
>
> Thanks. I think this has lead to an interesting discovery of an
> additional issue in ptest-runner with buffering of logs when used non-
> interactively.
>
> I've sent a patch to ptest-runner which I believe will address this
> issue.
>
> Cheers,
>
> Richard
>
>

[-- Attachment #2: Type: text/html, Size: 6492 bytes --]

Re: [OE-core] [PATCH 1/2] oeqa/runtime/ptest: Use a timeout with command, remove disabling

[Richard Purdie]

On Mon, 2026-03-09 at 20:14 -0600, Anibal Limon wrote:
> I have pushed the ptest-runner fix with the tag v2.5.1. The Automatic
> Upgrade Helper (AUH) should pick it up shortly.

Thanks, I noticed and already tested and merged an upgrade!

I'm curiously optimistic this will help a lot with some of the
intermittent failures we have been seeing on the autobuilder :)

Cheers,

Richard