Re: [OE-core] [PATCH 1/2] oeqa/runtime/ptest: Use a timeout with command, remove disabling

[Richard Purdie <richard.purdie@linuxfoundation.org>]

On Fri, 2026-03-06 at 12:47 +0100, Mathieu Dubois-Briand wrote:
> On Wed Mar 4, 2026 at 7:41 PM CET, Richard Purdie via lists.openembedded.org wrote:
> > A simple 'which' call doesn't need the timeout disabling. This was likely
> > a copy and paste error and can be removed.
> > 
> > Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
> > ---
> >  meta/lib/oeqa/runtime/cases/ptest.py | 2 +-
> >  1 file changed, 1 insertion(+), 1 deletion(-)
> > 
> > diff --git a/meta/lib/oeqa/runtime/cases/ptest.py b/meta/lib/oeqa/runtime/cases/ptest.py
> > index 1a0782374d0..2887e136719 100644
> > --- a/meta/lib/oeqa/runtime/cases/ptest.py
> > +++ b/meta/lib/oeqa/runtime/cases/ptest.py
> > @@ -35,7 +35,7 @@ class PtestRunnerTest(OERuntimeTestCase):
> >          self.do_ptestrunner()
> >  
> >      def do_ptestrunner(self):
> > -        status, output = self.target.run('which ptest-runner', 0)
> > +        status, output = self.target.run('which ptest-runner')
> >          if status != 0:
> >              self.skipTest("No -ptest packages are installed in the image")
> >  
> 
> Hi Richard,
> 
> I believe this is causing some ptest failures on riscv64:
> 
> Traceback (most recent call last):
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
>     return func(*args, **kwargs)
>            ^^^^^^^^^^^^^^^^^^^^^
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
>     return func(*args, **kwargs)
>            ^^^^^^^^^^^^^^^^^^^^^
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/decorator/__init__.py", line 35, in wrapped_f
>     return func(*args, **kwargs)
>            ^^^^^^^^^^^^^^^^^^^^^
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/runtime/cases/ptest.py", line 27, in test_ptestrunner_expectfail
>     self.do_ptestrunner()
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/runtime/cases/ptest.py", line 63, in do_ptestrunner
>     status, output = self.target.run('ptest-runner -t {} -d \"{}\"'.format(ptest_timeout, ' '.join(ptest_dirs)), timeout=int(ptest_timeout)+30)
>                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/target/ssh.py", line 98, in run
>     status, output = self._run(sshCmd, processTimeout, ignore_status, raw, ignore_ssh_fails)
>                      ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>   File "/srv/pokybuild/yocto-worker/qemuriscv64-ptest/build/layers/openembedded-core/meta/lib/oeqa/core/target/ssh.py", line 70, in _run
>     raise AssertionError("ssh exited with status '255' for command "
> AssertionError: ssh exited with status '255' for command '['ssh', '-l', 'root', '-o', 'ServerAliveCountMax=2', '-o', 'ServerAliveInterval=30', '-o', 'UserKnownHostsFile=/dev/null', '-o', 'StrictHostKeyChecking=no', '-o', 'LogLevel=ERROR', '192.168.7.14', 'export PATH=/usr/sbin:/sbin:/usr/bin:/bin; ptest-runner -t 450 -d "/usr/lib"']': this is likely an SSH failure
> 
> Process killed - no output for 480 seconds. Total running time: 485 seconds.
> 
> Cannot run ptests without @expectedFailure as ptests are expected to fail
> WARNING: core-image-ptest-dpkg-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
> 
> And similar errors:
> 
> WARNING: core-image-ptest-coreutils-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
> Cannot run ptests without @expectedFailure as ptests are expected to fail
> 
> WARNING: core-image-ptest-gettext-1.0-r0 do_testimage: Can not retrieve artifacts from test target: Error while fetching compressed artifacts
> Cannot run ptests without @expectedFailure as ptests are expected to fail
> 
> https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/1182

Thanks. I think this has lead to an interesting discovery of an
additional issue in ptest-runner with buffering of logs when used non-
interactively.

I've sent a patch to ptest-runner which I believe will address this
issue.

Cheers,

Richard