[meta-python][PATCH 1/4] python3-pyzmq: set cmake build dir to support reproducible

[meta-python][PATCH 1/4] python3-pyzmq: set cmake build dir to support reproducible

[Hongxu Jia]

According to [1], set cmake build dir, otherwise a unique temporary directory
is used which caused generated library not be reproducible
...
    "build-dir": {
      "type": "string",
      "default": "",
      "description": "The CMake build directory. Defaults to a unique temporary directory."
    },
...

Note: To support reproducible, it also requires oe-core commit [2] to be merged

[1] https://github.com/scikit-build/scikit-build-core/blob/main/src/scikit_build_core/resources/scikit-build.schema.json#L487C6-L487C16
[2] https://lists.openembedded.org/g/openembedded-core/message/223604?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2C%2C20%2C2%2C0%2C115291386%2Cd%253D3&d=3

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
---
 meta-python/recipes-devtools/python/python3-pyzmq_27.0.2.bb | 1 +
 1 file changed, 1 insertion(+)

diff --git a/meta-python/recipes-devtools/python/python3-pyzmq_27.0.2.bb b/meta-python/recipes-devtools/python/python3-pyzmq_27.0.2.bb
index 6607b7c34d..121ca322a0 100644
--- a/meta-python/recipes-devtools/python/python3-pyzmq_27.0.2.bb
+++ b/meta-python/recipes-devtools/python/python3-pyzmq_27.0.2.bb
@@ -23,6 +23,7 @@ PEP517_BUILD_OPTS = "--skip-dependency-check \
                      -Ccmake.define.CMAKE_FIND_ROOT_PATH_MODE_INCLUDE=ONLY \
                      -Ccmake.define.CMAKE_FIND_ROOT_PATH="${STAGING_DIR_NATIVE}" \
                      -Ccmake.build-type="RelWithDebInfo" \
+                     -Cbuild-dir="${B}" \
 "
 
 SRC_URI:append = " \
-- 
2.34.1

[meta-python][PATCH 2/4] python3-frozenlist: support reproducible

[Hongxu Jia]

In order to make the generated library be reproducible, build wheel
in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
option -fdebug-prefix-map could work as expected

Note: To support reproducible, it also requires oe-core commit [1] to be merged

[1] https://lists.openembedded.org/g/openembedded-core/message/223604?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2C%2C20%2C2%2C0%2C115291386%2Cd%253D3&d=3

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
---
 .../files/0001-build-wheel-in-place.patch     | 31 +++++++++++++++++++
 .../python/python3-frozenlist_1.7.0.bb        |  3 ++
 2 files changed, 34 insertions(+)
 create mode 100644 meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch

diff --git a/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch b/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
new file mode 100644
index 0000000000..84f81da775
--- /dev/null
+++ b/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
@@ -0,0 +1,31 @@
+From 606843ad079d9d0dac1172533d42b5a2327b99ed Mon Sep 17 00:00:00 2001
+From: Hongxu Jia <hongxu.jia@windriver.com>
+Date: Wed, 17 Sep 2025 15:41:09 +0800
+Subject: [PATCH] build wheel in place
+
+In order to make the generated library be reproducible, build wheel
+in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
+option -fdebug-prefix-map could work as expected
+
+Upstream-Status: Pending
+Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
+---
+ packaging/pep517_backend/_backend.py | 2 +-
+ 1 file changed, 1 insertion(+), 1 deletion(-)
+
+diff --git a/packaging/pep517_backend/_backend.py b/packaging/pep517_backend/_backend.py
+index 61cad34..d5d839e 100644
+--- a/packaging/pep517_backend/_backend.py
++++ b/packaging/pep517_backend/_backend.py
+@@ -316,7 +316,7 @@ def build_wheel(
+     """
+     with maybe_prebuild_c_extensions(
+             line_trace_cython_when_unset=False,
+-            build_inplace=False,
++            build_inplace=True,
+             config_settings=config_settings,
+     ):
+         return _setuptools_build_wheel(
+-- 
+2.34.1
+
diff --git a/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb b/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
index 7d813a026c..d832494c82 100644
--- a/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
+++ b/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
@@ -7,6 +7,9 @@ SRC_URI[sha256sum] = "2e310d81923c2437ea8670467121cc3e9b0f76d3043cc1d2331d56c7fb
 
 inherit pypi python_setuptools_build_meta cython
 
+SRC_URI += " \
+    file://0001-build-wheel-in-place.patch \
+"
 DEPENDS += " \
     python3-expandvars-native \
 "
-- 
2.34.1

[meta-python][PATCH 3/4] python3-propcache: support reproducible

[Hongxu Jia]

In order to make the generated library be reproducible, build wheel
in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
option -fdebug-prefix-map could work as expected

Note: To support reproducible, it also requires oe-core commit [1] to be merged

[1] https://lists.openembedded.org/g/openembedded-core/message/223604?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2C%2C20%2C2%2C0%2C115291386%2Cd%253D3&d=3

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
---
 .../recipes-devtools/python/python3-propcache_0.3.2.bb        | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/meta-python/recipes-devtools/python/python3-propcache_0.3.2.bb b/meta-python/recipes-devtools/python/python3-propcache_0.3.2.bb
index e78d7b3428..8e2394a5c4 100644
--- a/meta-python/recipes-devtools/python/python3-propcache_0.3.2.bb
+++ b/meta-python/recipes-devtools/python/python3-propcache_0.3.2.bb
@@ -7,6 +7,10 @@ SRC_URI[sha256sum] = "20d7d62e4e7ef05f221e0db2856b979540686342e7dd9973b815599c70
 
 inherit pypi python_setuptools_build_meta ptest-python-pytest cython
 
+SRC_URI += " \
+    file://0001-build-wheel-in-place.patch \
+"
+
 DEPENDS += " \
 	python3-expandvars-native \
 "
-- 
2.34.1

[meta-python][PATCH 4/4] python3-yarl: support reproducible

[Hongxu Jia]

In order to make the generated library be reproducible, build wheel
in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
option -fdebug-prefix-map could work as expected

Note: To support reproducible, it also requires oe-core commit [1] to be merged

[1] https://lists.openembedded.org/g/openembedded-core/message/223604?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2C%2C20%2C2%2C0%2C115291386%2Cd%253D3&d=3

Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
---
 meta-python/recipes-devtools/python/python3-yarl_1.20.1.bb | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/meta-python/recipes-devtools/python/python3-yarl_1.20.1.bb b/meta-python/recipes-devtools/python/python3-yarl_1.20.1.bb
index bbf9e3d782..6eedcf0f82 100644
--- a/meta-python/recipes-devtools/python/python3-yarl_1.20.1.bb
+++ b/meta-python/recipes-devtools/python/python3-yarl_1.20.1.bb
@@ -9,6 +9,10 @@ PYPI_PACKAGE = "yarl"
 
 inherit pypi ptest-python-pytest python_setuptools_build_meta cython
 
+SRC_URI += " \
+    file://0001-build-wheel-in-place.patch \
+"
+
 DEPENDS += " \
     python3-expandvars-native \
 "
-- 
2.34.1

Re: [oe] [meta-python][PATCH 2/4] python3-frozenlist: support reproducible

[Khem Raj]

seeing

stdio: ERROR: python3-frozenlist-1.7.0-r0 do_package_qa: QA Issue:
File /usr/src/debug/python3-frozenlist/1.7.0/frozenlist/_frozenlist.cpp
in package python3-frozenlist-src contains reference to TMPDIR
[buildpaths]
stdio: ERROR: python3-frozenlist-1.7.0-r0 do_package_qa: Fatal QA
errors were found, failing task.


See - https://autobuilder.yoctoproject.org/valkyrie/?#/builders/81/builds/935

On Thu, Sep 18, 2025 at 12:16 AM hongxu via lists.openembedded.org
<hongxu.jia=eng.windriver.com@lists.openembedded.org> wrote:
>
> In order to make the generated library be reproducible, build wheel
> in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
> option -fdebug-prefix-map could work as expected
>
> Note: To support reproducible, it also requires oe-core commit [1] to be merged
>
> [1] https://lists.openembedded.org/g/openembedded-core/message/223604?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2C%2C20%2C2%2C0%2C115291386%2Cd%253D3&d=3
>
> Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
> ---
>  .../files/0001-build-wheel-in-place.patch     | 31 +++++++++++++++++++
>  .../python/python3-frozenlist_1.7.0.bb        |  3 ++
>  2 files changed, 34 insertions(+)
>  create mode 100644 meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
>
> diff --git a/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch b/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
> new file mode 100644
> index 0000000000..84f81da775
> --- /dev/null
> +++ b/meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
> @@ -0,0 +1,31 @@
> +From 606843ad079d9d0dac1172533d42b5a2327b99ed Mon Sep 17 00:00:00 2001
> +From: Hongxu Jia <hongxu.jia@windriver.com>
> +Date: Wed, 17 Sep 2025 15:41:09 +0800
> +Subject: [PATCH] build wheel in place
> +
> +In order to make the generated library be reproducible, build wheel
> +in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
> +option -fdebug-prefix-map could work as expected
> +
> +Upstream-Status: Pending
> +Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
> +---
> + packaging/pep517_backend/_backend.py | 2 +-
> + 1 file changed, 1 insertion(+), 1 deletion(-)
> +
> +diff --git a/packaging/pep517_backend/_backend.py b/packaging/pep517_backend/_backend.py
> +index 61cad34..d5d839e 100644
> +--- a/packaging/pep517_backend/_backend.py
> ++++ b/packaging/pep517_backend/_backend.py
> +@@ -316,7 +316,7 @@ def build_wheel(
> +     """
> +     with maybe_prebuild_c_extensions(
> +             line_trace_cython_when_unset=False,
> +-            build_inplace=False,
> ++            build_inplace=True,
> +             config_settings=config_settings,
> +     ):
> +         return _setuptools_build_wheel(
> +--
> +2.34.1
> +
> diff --git a/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb b/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
> index 7d813a026c..d832494c82 100644
> --- a/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
> +++ b/meta-python/recipes-devtools/python/python3-frozenlist_1.7.0.bb
> @@ -7,6 +7,9 @@ SRC_URI[sha256sum] = "2e310d81923c2437ea8670467121cc3e9b0f76d3043cc1d2331d56c7fb
>
>  inherit pypi python_setuptools_build_meta cython
>
> +SRC_URI += " \
> +    file://0001-build-wheel-in-place.patch \
> +"
>  DEPENDS += " \
>      python3-expandvars-native \
>  "
> --
> 2.34.1
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#119531): https://lists.openembedded.org/g/openembedded-devel/message/119531
> Mute This Topic: https://lists.openembedded.org/mt/115306109/1997914
> Group Owner: openembedded-devel+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub [raj.khem@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>

Re: [oe] [meta-python][PATCH 4/4] python3-yarl: support reproducible

[Khem Raj]

On Thu, Sep 18, 2025 at 12:16 AM hongxu via lists.openembedded.org
<hongxu.jia=eng.windriver.com@lists.openembedded.org> wrote:
>
> In order to make the generated library be reproducible, build wheel
> in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
> option -fdebug-prefix-map could work as expected
>
> Note: To support reproducible, it also requires oe-core commit [1] to be merged
>
> [1] https://lists.openembedded.org/g/openembedded-core/message/223604?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2C%2C20%2C2%2C0%2C115291386%2Cd%253D3&d=3
>
> Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
> ---
>  meta-python/recipes-devtools/python/python3-yarl_1.20.1.bb | 4 ++++
>  1 file changed, 4 insertions(+)
>
> diff --git a/meta-python/recipes-devtools/python/python3-yarl_1.20.1.bb b/meta-python/recipes-devtools/python/python3-yarl_1.20.1.bb
> index bbf9e3d782..6eedcf0f82 100644
> --- a/meta-python/recipes-devtools/python/python3-yarl_1.20.1.bb
> +++ b/meta-python/recipes-devtools/python/python3-yarl_1.20.1.bb
> @@ -9,6 +9,10 @@ PYPI_PACKAGE = "yarl"
>
>  inherit pypi ptest-python-pytest python_setuptools_build_meta cython
>
> +SRC_URI += " \
> +    file://0001-build-wheel-in-place.patch \
> +"

This patch file is missing.

> +
>  DEPENDS += " \
>      python3-expandvars-native \
>  "
> --
> 2.34.1
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#119532): https://lists.openembedded.org/g/openembedded-devel/message/119532
> Mute This Topic: https://lists.openembedded.org/mt/115306110/1997914
> Group Owner: openembedded-devel+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub [raj.khem@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>

Re: [oe] [meta-python][PATCH 3/4] python3-propcache: support reproducible

[Khem Raj]

On Thu, Sep 18, 2025 at 12:16 AM hongxu via lists.openembedded.org
<hongxu.jia=eng.windriver.com@lists.openembedded.org> wrote:
>
> In order to make the generated library be reproducible, build wheel
> in source dir other than tmp dir (/tmp/xxxxxx), then yocto toolchain's
> option -fdebug-prefix-map could work as expected
>
> Note: To support reproducible, it also requires oe-core commit [1] to be merged
>
> [1] https://lists.openembedded.org/g/openembedded-core/message/223604?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2C%2C20%2C2%2C0%2C115291386%2Cd%253D3&d=3
>
> Signed-off-by: Hongxu Jia <hongxu.jia@windriver.com>
> ---
>  .../recipes-devtools/python/python3-propcache_0.3.2.bb        | 4 ++++
>  1 file changed, 4 insertions(+)
>
> diff --git a/meta-python/recipes-devtools/python/python3-propcache_0.3.2.bb b/meta-python/recipes-devtools/python/python3-propcache_0.3.2.bb
> index e78d7b3428..8e2394a5c4 100644
> --- a/meta-python/recipes-devtools/python/python3-propcache_0.3.2.bb
> +++ b/meta-python/recipes-devtools/python/python3-propcache_0.3.2.bb
> @@ -7,6 +7,10 @@ SRC_URI[sha256sum] = "20d7d62e4e7ef05f221e0db2856b979540686342e7dd9973b815599c70
>
>  inherit pypi python_setuptools_build_meta ptest-python-pytest cython
>
> +SRC_URI += " \
> +    file://0001-build-wheel-in-place.patch \
> +"

This patch file is missing

> +
>  DEPENDS += " \
>         python3-expandvars-native \
>  "
> --
> 2.34.1
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#119533): https://lists.openembedded.org/g/openembedded-devel/message/119533
> Mute This Topic: https://lists.openembedded.org/mt/115306111/1997914
> Group Owner: openembedded-devel+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub [raj.khem@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>

Re: [meta-python][PATCH 3/4] python3-propcache: support reproducible

[hongxu]

[-- Attachment #1: Type: text/plain, Size: 612 bytes --]

On Fri, Sep 19, 2025 at 12:25 PM, Khem Raj wrote:

> 
> 
>> +SRC_URI += " \
>> + file://0001-build-wheel-in-place.patch \
>> +"
> 
> This patch file is missing

The patch locates in meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
which shared with [meta-python][PATCH 2/4] python3-frozenlist: support reproducible [1]

[1] https://lists.openembedded.org/g/openembedded-devel/message/119531?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2Csupport+reproducible%2C20%2C2%2C0%2C115306109

//Hongxu

> 
> 
>> +
>> DEPENDS += " \
>> python3-expandvars-native \
>> "
> 
>

[-- Attachment #2: Type: text/html, Size: 3089 bytes --]

Re: [meta-python][PATCH 4/4] python3-yarl: support reproducible

[hongxu]

[-- Attachment #1: Type: text/plain, Size: 607 bytes --]

On Fri, Sep 19, 2025 at 12:24 PM, Khem Raj wrote:

> 
> 
>> +SRC_URI += " \
>> + file://0001-build-wheel-in-place.patch \
>> +"
> 
> This patch file is missing.

The patch locates in meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
which shared with [meta-python][PATCH 2/4] python3-frozenlist: support reproducible [1]

[1] https://lists.openembedded.org/g/openembedded-devel/message/119531?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2Csupport+reproducible%2C20%2C2%2C0%2C115306109

//Hongxu

> 
> 
>> +
>> DEPENDS += " \
>> python3-expandvars-native \
> 
>

[-- Attachment #2: Type: text/html, Size: 3083 bytes --]

Re: [meta-python][PATCH 4/4] python3-yarl: support reproducible

[hongxu]

[-- Attachment #1: Type: text/plain, Size: 607 bytes --]

On Fri, Sep 19, 2025 at 12:24 PM, Khem Raj wrote:

> 
> 
>> +SRC_URI += " \
>> + file://0001-build-wheel-in-place.patch \
>> +"
> 
> This patch file is missing.

The patch locates in meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
which shared with [meta-python][PATCH 2/4] python3-frozenlist: support reproducible [1]

[1] https://lists.openembedded.org/g/openembedded-devel/message/119531?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2Csupport+reproducible%2C20%2C2%2C0%2C115306109

//Hongxu

> 
> 
>> +
>> DEPENDS += " \
>> python3-expandvars-native \
> 
>

[-- Attachment #2: Type: text/html, Size: 3083 bytes --]

Re: [oe] [meta-python][PATCH 3/4] python3-propcache: support reproducible

[Khem Raj]

Thanks, but there is a problem with the original patch so resend the
series when done.

On Fri, Sep 19, 2025 at 5:01 PM hongxu via lists.openembedded.org
<hongxu.jia=eng.windriver.com@lists.openembedded.org> wrote:
>
> On Fri, Sep 19, 2025 at 12:25 PM, Khem Raj wrote:
>
> +SRC_URI += " \
> + file://0001-build-wheel-in-place.patch \
> +"
>
> This patch file is missing
>
> The patch locates in meta-python/recipes-devtools/python/files/0001-build-wheel-in-place.patch
>
> which shared with [meta-python][PATCH 2/4] python3-frozenlist: support reproducible [1]
>
> [1] https://lists.openembedded.org/g/openembedded-devel/message/119531?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2Csupport+reproducible%2C20%2C2%2C0%2C115306109
>
> //Hongxu
>
> +
> DEPENDS += " \
> python3-expandvars-native \
> "
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#119613): https://lists.openembedded.org/g/openembedded-devel/message/119613
> Mute This Topic: https://lists.openembedded.org/mt/115306111/1997914
> Group Owner: openembedded-devel+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-devel/unsub [raj.khem@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>

Re: [meta-python][PATCH 2/4] python3-frozenlist: support reproducible

[hongxu]

[-- Attachment #1: Type: text/plain, Size: 981 bytes --]

On Thu, Sep 18, 2025 at 09:01 PM, Khem Raj wrote:

> 
> seeing
> 
> stdio: ERROR: python3-frozenlist-1.7.0-r0 do_package_qa: QA Issue:
> File /usr/src/debug/python3-frozenlist/1.7.0/frozenlist/_frozenlist.cpp
> in package python3-frozenlist-src contains reference to TMPDIR
> [buildpaths]
> stdio: ERROR: python3-frozenlist-1.7.0-r0 do_package_qa: Fatal QA
> errors were found, failing task.
> 
> 
> See - https://autobuilder.yoctoproject.org/valkyrie/?#/builders/81/builds/935
> ( https://autobuilder.yoctoproject.org/valkyrie/#/builders/81/builds/935 )

As I mentioned in the commit message, it also requires oe-core commit [1] to be merged, otherwise the issue you met

[1] https://lists.openembedded.org/g/openembedded-core/message/223604?p=%2C%2C%2C20%2C0%2C0%2C0%3A%3ACreated%2C%2C%2C20%2C2%2C0%2C115291386%2Cd%253D3&d=3

//Hongxu

> 
> On Thu, Sep 18, 2025 at 12:16 AM hongxu via lists.openembedded.org
> <hongxu.jia=eng.windriver.com@...> wrote:

[-- Attachment #2: Type: text/html, Size: 4747 bytes --]