Re: [OE-core] [PATCH v4 0/9] mesa: upgrade to 25.0.2

[Dmitry Baryshkov <dmitry.baryshkov@oss.qualcomm.com>]

Hello Mathieu,

On 01/04/2025 10:40, Mathieu Dubois-Briand wrote:
> On Mon Mar 31, 2025 at 2:21 PM CEST, Dmitry Baryshkov via lists.openembedded.org wrote:
>> libclc is required in order to build Intel drivers in Mesa 24.1 and
>> later. Thus OE-Core is currently locked to the 24.0.x branch, which is
>> no longer maintained, having last release in June 2024.
>>
>> A clean solution is to package Clang, then use it to build libclc and
>> SPIRV-LLVM-Translator (required for Mesa OpenCL support). However
>> creating proper recipes for Clang is a long process (ongoing by Khem
>> Raj).
>>
>> This patchset attempts to solve the issue in a simpler way: by building
>> libclc and SPIRV-LLVM-Translator together with the LLVM. This way we
>> don't have to create target Clang recipes, there is no extra toolchain
>> to support, etc. Clang binaries are creted as a part of the build
>> process (in order to support building target packages), however it only
>> hits the LLVM sysroot-native and is only used by the LLVM target build.
>>
>> Future work by Khem (once Clang is properly supported in OE-Core) should
>> allow us to create proper recipes for libclc and spirv-llvm-translator
>> and drop them from the llvm / clang recipe.
>>
>> I think this approach provides a good balance between OE-Core being
>> stuck with the outdated Mesa release and being able to upgrade it,
>> bringing support for new hardware.
>>
>> Last two patches of the series bring in RustiCL support, a new OpenCL
>> implementation within Mesa. They are optional for the sake of the
>> upgrade and can be dropped if there is any issue with those. RustiCL
>> support is mostly compile-tested at this point.
>>
>> Signed-off-by: Dmitry Baryshkov <dmitry.baryshkov@oss.qualcomm.com>
>> ---
> 
> Hi Dmitry,
> 
> Thanks for the new version.
> 
> It looks like we still have issues on the autobuilder, now during
> oe-selftests. I truncated a bit the logs below.
> 
> ERROR: mesa-native-2_25.0.2-r0 do_compile: Execution of '/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53842/tmp/work/x86_64-linux/mesa-native/25.0.2/temp/run.do_compile.506477' failed with exit code 1
> ...
> | FAILED: src/intel/shaders/intel_gfx80_shaders.spv
> | /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53842/tmp/work/x86_64-linux/mesa-native/25.0.2/build/src/compiler/clc/mesa_clc ../mesa-25.0.2/src/intel/shaders/libintel_shaders.h ../mesa-25.0.2/src/intel/shaders/generate.cl ../mesa-25.0.2/src/intel/shaders/generate_draws.cl ../mesa-25.0.2/src/intel/shaders/generate_draws_iris.cl ../mesa-25.0.2/src/intel/shaders/query_copy.cl ../mesa-25.0.2/src/intel/shaders/util.cl -o src/intel/shaders/intel_gfx80_shaders.spv -- -DNDEBUG=1 -DGFX_VERx10=80 -I/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53842/tmp/work/x86_64-linux/mesa-native/25.0.2/mesa-25.0.2/src/intel/shaders/. -I/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53842/tmp/work/x86_64-linux/mesa-native/25.0.2/mesa-25.0.2/src/compiler/libcl -I/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53842/tmp/work/x86_64-linux/mesa-native/25.0.2/mesa-25.0.2/src -I/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53842/tmp/work/x86_64-linux/mesa-native/25.0.2/mesa-25.0.2/src/intel -I/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53842/tmp/work/x86_64-linux/mesa-native/25.0.2/build/src/intel -I/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53842/tmp/work/x86_64-linux/mesa-native/25.0.2/mesa-25.0.2/src/intel/genxml
> | /bin/sh: 1: /srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53842/tmp/work/x86_64-linux/mesa-native/25.0.2/build/src/compiler/clc/mesa_clc: not found


I've fixed all other issues, except the x32 (working on reproducing it 
now) and this one. Would you have a pointer to the build job?


> 
> But also a lot of issues with sstate tests:
> 
> 2025-03-31 19:31:36,349 - oe-selftest - INFO - 6: 46/49 214/622 (88.62s) (0 failed) (sstatetests.SStateHashSameSigs.test_sstate_32_64_same_hash)
> 2025-03-31 19:31:36,349 - oe-selftest - INFO - testtools.testresult.real._StringException: Traceback (most recent call last):
>    File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/meta/lib/oeqa/selftest/cases/sstatetests.py", line 418, in test_sstate_32_64_same_hash
>      self.sstate_hashtest("i686")
>    File "/srv/pokybuild/yocto-worker/oe-selftest-debian/build/meta/lib/oeqa/selftest/cases/sstatetests.py", line 409, in sstate_hashtest
>      self.assertCountEqual(files1, files2)
>    File "/usr/lib/python3.11/unittest/case.py", line 1233, in assertCountEqual
>      self.fail(msg)
>    File "/usr/lib/python3.11/unittest/case.py", line 703, in fail
>      raise self.failureException(msg)
> AssertionError: Element counts were not equal:
> First has 1, Second has 0:  '/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53795/tmp-sstatesamehash/stamps/core2-32-poky-linux/mesa/25.0.2.do_install.sigdata.f1121eb56f1f6b8335722e32d0e21eb777e95ab4af83b777971f3666d1265bed'
> First has 1, Second has 0:  '/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53795/tmp-sstatesamehash/stamps/core2-32-poky-linux/mesa/25.0.2.do_create_spdx.sigdata.4c53505a0e3a5bba214d854ae8eea7c551f794d6b85392564d7c3923180e5d7f'
> First has 1, Second has 0:  '/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53795/tmp-sstatesamehash/stamps/core2-32-poky-linux/mesa/25.0.2.do_create_package_spdx.sigdata.cefe11ad38c3c40968e4757314ad08b91f9584c9845cbcf08cc8635e1216912e'
> First has 1, Second has 0:  '/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53795/tmp-sstatesamehash/stamps/core2-32-poky-linux/mesa/25.0.2.do_populate_sysroot.sigdata.2e3e3b9c17855a8a865dd9e99c002016e697024fc93cdfed690b7d54bb05e34e'
> First has 1, Second has 0:  '/srv/pokybuild/yocto-worker/oe-selftest-debian/build/build-st-53795/tmp-sstatesamehash/stamps/core2-32-poky-linux/mesa/25.0.2.do_prepare_recipe_sysroot.sigdata.73d0df5170ce762727a517856505f3505b2c47f479affdddb242ddcad34d5e29'
> ...
> 
> https://autobuilder.yoctoproject.org/valkyrie/#/builders/35/builds/1264
> https://autobuilder.yoctoproject.org/valkyrie/#/builders/23/builds/1350
> https://autobuilder.yoctoproject.org/valkyrie/#/builders/48/builds/1214
> 
> Can you have a look a these please?
> 


-- 
With best wishes
Dmitry