Re: [OE-core][PATCH v3] libsoup: add ptest support

["Mathieu Dubois-Briand" <mathieu.dubois-briand@bootlin.com>]

On Fri Oct 16, 2026 at 10:05 AM CEST, Mathieu Dubois-Briand via lists.openembedded.org wrote:
> On Wed Oct 14, 2026 at 2:07 PM CEST, Pratik Farkase wrote:
>> Build the installed-tests via the meson tests/installed_tests options
>> (enabled through a new 'tests' PACKAGECONFIG when ptest is in
>> DISTRO_FEATURES) and run them under ptest with
>> gnome-desktop-testing-runner.
>>
>> Tested on qemux86-64 with ptest-runner.
>>
>> Signed-off-by: Pratik Farkase <pratik.farkase@est.tech>
>> ---
>
> Hi Pratik,
>
> Thanks, it's much better now. Still, I do note some intermittent
> failures.
>
> Failed ptests:
> {'libsoup': ['libsoup-3.0/multithread-test.test']}
> https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/4725
>
> Failed ptests:
> {'libsoup': ['libsoup-3.0/http2-test.test']}
> https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/26031
>
> I believe we can keep it in testing for a bit of time and see which test
> fails and how often, then decide if it gets merged or not. But we will
> probably need a bit more work in there.
>
> Thanks,
> Mathieu

Hi Pratik,

So after a few days, here is the situation:

{'libsoup': ['libsoup-3.0/multithread-test.test']}
2 occurrences, 1 qemuarm64-musl-ptest, 1 qemuarm64-ptest
https://autobuilder.yoctoproject.org/valkyrie/#/builders/109/builds/1400
https://autobuilder.yoctoproject.org/valkyrie/#/builders/61/builds/4725

{'libsoup': ['libsoup-3.0/http2-test.test']}
8 occurences, all on qemuriscv64-ptest
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2603
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2614
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2615
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2616
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2618
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2621
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2625
https://autobuilder.yoctoproject.org/valkyrie/#/builders/56/builds/2626

So I believe this will need a bit more work to make these tests a bit
more stable, I'm sorry.

Thanks,
Mathieu

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com