Re: [OE-core] [PATCH 2/2] dpkg: add ptest support

["Mathieu Dubois-Briand" <mathieu.dubois-briand@bootlin.com>]

On Sat Aug 2, 2025 at 3:12 PM CEST, Gyorgy Sarvari via lists.openembedded.org wrote:
> Added it to slow tests, as it takes betwen 165 and 190 seconds on my
> machine to execute (qemux86-64 + kvm).
>
> The test folder's Makefile contains a list of passing, failing and manual
> tests. By default, only the expected-to-pass tests are executed by the
> Makefile (unless magic environment variable is set).
>
> The run-ptest script mimics the default behavior of executing the
> expected-to-pass tests, however they are executed one by one, instead of
> running them as one batch - that way it is easier to determine exactly
> which tests pass and which fail.
>
> One other thing that might worth a note, is that the tests folder that needs to be
> installed contains a number of subfolders called "DEBIAN". When packaging them
> at least with rpm, these folders are omitted from the package. 
> However these are essential for the tests, as they contain test data. As a 
> workaround, these folders are renamed during installation to DEBIAN-ptest, 
> and before execution the run-ptest script restores their names.
>
> Signed-off-by: Gyorgy Sarvari <skandigraun@gmail.com>
> ---

Hi Gyorgy,

Thanks for your patch.

It looks like some of these ptests are failing:

WARNING: core-image-ptest-dpkg-1.0-r0 do_testimage: There were failing ptests.
...
AssertionError:
ptests which had no test results:
['dpkg']

Cannot run ptests without @expectedFailure as ptests are expected to fail

https://autobuilder.yoctoproject.org/valkyrie/api/v2/logs/3164697/raw_inline
https://autobuilder.yoctoproject.org/valkyrie/api/v2/logs/3164752/raw_inline
https://autobuilder.yoctoproject.org/valkyrie/api/v2/logs/3164788/raw_inline

Ptest results can be found here:

https://valkyrie.yocto.io/pub/non-release/20250805-32/testresults/qemuarm64-ptest/core-image-ptest-dpkg/
https://valkyrie.yocto.io/pub/non-release/20250805-32/testresults/qemuriscv64-ptest/core-image-ptest-dpkg/
https://valkyrie.yocto.io/pub/non-release/20250805-32/testresults/qemux86-64-ptest/core-image-ptest-dpkg/

Best regards,
Mathieu

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com