Re: [OE-core] [PATCH v2 13/14] oe-selftest: devtool ide-sdk: add clang/LLDB test

["Mathieu Dubois-Briand" <mathieu.dubois-briand@bootlin.com>]

On Tue Aug 4, 2026 at 1:59 PM CEST, Adrian Freihofer via lists.openembedded.org wrote:
> From: Adrian Freihofer <adrian.freihofer@siemens.com>
>
> Add test_devtool_ide_sdk_code_cmake_clang to verify the full devtool
> ide-sdk workflow for a cmake recipe built with clang.  Unlike the gcc
> variant the clang recipe uses lldb-server for remote debugging and
> CodeLLDB (vadimcn.vscode-lldb) as the VS Code debug adapter.
>
> The test covers:
> - devtool modify + devtool ide-sdk with ide=code
> - cmake preset compilation and CTest execution (same as the gcc test)
> - extensions.json recommends vadimcn.vscode-lldb
> - launch.json uses "type": "lldb" (CodeLLDB) instead of "type": "cppdbg"
> - End-to-end lldb --batch remote debugging session via lldb-server
>   platform mode running on qemu
>
> Supporting changes:
> - _write_bb_config: accept optional extra_packages parameter so the
>   clang test can add lldb-server to IMAGE_INSTALL
> - _verify_launch_json_lldb: new helper that validates the CodeLLDB
>   launch.json structure (type, initCommands, program, cwd, preLaunchTask)
> - _lldb_server_debugging_once: new helper that reads the preLaunchTask
>   SSH command from tasks.json, starts lldb-server on the target, and
>   runs lldb --batch to verify a breakpoint at main is hit
> - _verify_service_running: use pgrep with exact regex (^name$) for exact
>   process name matching; without that, pgrep would also match
>   cmake-example-clang (truncated to 'cmake-example-c' in
>   /proc/pid/comm) when checking for cmake-example, returning two PIDs
>   and failing the isdigit() assertion
>
> Signed-off-by: Adrian Freihofer <adrian.freihofer@siemens.com>
> ---


Hi Adrian,

This patch was merged, but it now looks like some of the added tests are
sometimes failing.

So far, we only saw the issue on test branches and never on master, so
there is a small chance some other patch is breaking the test, but I
suspect the issue is also present on master.

Here is the error:

2026-08-05 14:12:52,800 - oe-selftest - INFO - devtool.DevtoolIdeSdkTests.test_devtool_ide_sdk_code_cmake_clang (subunit.RemotedTestCase)
2026-08-05 14:12:52,801 - oe-selftest - INFO -  ... FAIL
...
2026-08-05 14:12:52,801 - oe-selftest - INFO - 11: 3/27 320/763 (915.39s) (0 failed) (devtool.DevtoolIdeSdkTests.test_devtool_ide_sdk_code_cmake_clang)
2026-08-05 14:12:52,801 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/devtool.py", line 4377, in test_devtool_ide_sdk_code_cmake_clang
    self._lldb_cross_debugging_multi(
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/devtool.py", line 4223, in _lldb_cross_debugging_multi
    lldb_session_func(DevtoolIdeSdkTests.MAGIC_STRING_ORIG)
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/devtool.py", line 4379, in <lambda>
    lambda magic_string: self._lldb_server_debugging_once(
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/selftest/cases/devtool.py", line 4323, in _lldb_server_debugging_once
    r = runCmd(lldb_batch, output_log=self._cmd_logger)
        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/layers/openembedded-core/meta/lib/oeqa/utils/commands.py", line 214, in runCmd
    raise AssertionError("Command '%s' returned non-zero exit status %d:\n%s" % (command, result.status, exc_output))
AssertionError: Command '['/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/x86_64-linux/lldb-native/22.1.8/recipe-sysroot-native/usr/bin/lldb', '--batch', '-o', 'platform select remote-linux', '-o', 'platform connect connect://192.168.7.14:1234', '-o', 'settings set target.process.thread.step-avoid-regexp ""', '-o', 'settings set target.debug-file-search-paths /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/qemux86_64-poky-linux/oe-selftest-image/1.0/rootfs-dbg/lib/.debug /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/qemux86_64-poky-linux/oe-selftest-image/1.0/rootfs-dbg/usr/lib/.debug /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/qemux86_64-poky-linux/oe-selftest-image/1.0/rootfs-dbg/usr/lib/debug /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/qemux86_64-poky-linux/oe-selftest-image/1.0/rootfs-dbg/lib /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/qemux86_64-poky-linux/oe-selftest-image/1.0/rootfs-dbg/usr/lib /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/qemux86_64-poky-linux/oe-selftest-image/1.0/rootfs/lib /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/qemux86_64-poky-linux/oe-selftest-image/1.0/rootfs/usr/lib', '-o', 'settings set target.exec-search-paths /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/x86-64-v3-poky-linux/cmake-example-clang/1.0/image/usr/lib /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/x86-64-v3-poky-linux/cmake-example-clang/1.0/image/lib /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/x86-64-v3-poky-linux/cmake-example-clang/1.0/image/usr/bin', '-o', 'target create --remote-file /usr/bin/cmake-example-clang /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/x86-64-v3-poky-linux/cmake-example-clang/1.0/image/usr/bin/cmake-example-clang', '-o', 'settings set target.source-map /usr/include /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/x86-64-v3-poky-linux/cmake-example-clang/1.0/recipe-sysroot/usr/include /usr/src/debug/cmake-example-clang/1.0 /tmp/devtoolqarl0rouil /usr/src/debug /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-893803/tmp/work/qemux86_64-poky-linux/oe-selftest-image/1.0/rootfs-dbg/usr/src/debug', '-o', 'breakpoint set --file cpp-example.cpp --line 41', '-o', 'breakpoint set --file cpp-example-lib.cpp --line 31', '-o', 'breakpoint set --file cpp-example-lib.hpp --line 21', '-o', 'breakpoint list', '-o', 'run', '-o', 'p cpp_example.get_string()', '-o', 'continue', '-o', 'p flag', '-o', 'continue', '-o', 'p n', '-o', 'continue', '-o', 'exit']' returned non-zero exit status 1:
(lldb) platform select remote-linux
  Platform: remote-linux
 Connected: no
(lldb) platform connect connect://192.168.7.14:1234
error: Failed to connect to 192.168.7.14:1234

And we have similar errors on
devtool.DevtoolIdeSdkTests.test_devtool_ide_sdk_code_meson_clang.

All affected builds:
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/4474
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/4478
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/4484
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/4485
https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/4302
https://autobuilder.yoctoproject.org/valkyrie/#/builders/23/builds/4553
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/4490
https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/4311
https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/4314
https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/4493

Can you have a look at this? Any clue about what is going wrong here?

Thanks,
Mathieu

-- 
Mathieu Dubois-Briand, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com