[PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Zoltán Böszörményi]

One of the main points in the Python 3.14.x release notes was
that free threading is officially supported.

Add PACKAGECONFIG[freethreading] to turn it on with --disable-gil.
GIL is the Global Interpreter Lock, which is kept enabled without
this option.

By default, keep free threading disabled, i.e. GIL enabled.

Signed-off-by: Zoltán Böszörményi <zboszor@gmail.com>
---
 meta/recipes-devtools/python/python3_3.14.3.bb | 1 +
 1 file changed, 1 insertion(+)

diff --git a/meta/recipes-devtools/python/python3_3.14.3.bb b/meta/recipes-devtools/python/python3_3.14.3.bb
index 7047cd8e8d..7a1ad1e386 100644
--- a/meta/recipes-devtools/python/python3_3.14.3.bb
+++ b/meta/recipes-devtools/python/python3_3.14.3.bb
@@ -112,6 +112,7 @@ CACHED_CONFIGUREVARS:append:libc-musl = "\
 
 # PGO currently causes builds to not be reproducible so disable by default, see YOCTO #13407
 PACKAGECONFIG ??= "editline gdbm ${@bb.utils.filter('DISTRO_FEATURES', 'lto', d)}"
+PACKAGECONFIG[freethreading] = "--disable-gil,--enable-gil"
 PACKAGECONFIG[readline] = "--with-readline=readline,,readline,,,editline"
 PACKAGECONFIG[editline] = "--with-readline=editline,,libedit,,,readline"
 # Use profile guided optimisation by running PyBench inside qemu-user
-- 
2.53.0

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Bartosz Golaszewski]

On Thu, 12 Mar 2026 13:00:24 +0100, "Zoltan Boszormenyi via
lists.openembedded.org" <zboszor=gmail.com@lists.openembedded.org>
said:
> One of the main points in the Python 3.14.x release notes was
> that free threading is officially supported.
>
> Add PACKAGECONFIG[freethreading] to turn it on with --disable-gil.
> GIL is the Global Interpreter Lock, which is kept enabled without
> this option.
>
> By default, keep free threading disabled, i.e. GIL enabled.
>
> Signed-off-by: Zoltán Böszörményi <zboszor@gmail.com>
> ---
>  meta/recipes-devtools/python/python3_3.14.3.bb | 1 +
>  1 file changed, 1 insertion(+)
>
> diff --git a/meta/recipes-devtools/python/python3_3.14.3.bb b/meta/recipes-devtools/python/python3_3.14.3.bb
> index 7047cd8e8d..7a1ad1e386 100644
> --- a/meta/recipes-devtools/python/python3_3.14.3.bb
> +++ b/meta/recipes-devtools/python/python3_3.14.3.bb
> @@ -112,6 +112,7 @@ CACHED_CONFIGUREVARS:append:libc-musl = "\
>
>  # PGO currently causes builds to not be reproducible so disable by default, see YOCTO #13407
>  PACKAGECONFIG ??= "editline gdbm ${@bb.utils.filter('DISTRO_FEATURES', 'lto', d)}"
> +PACKAGECONFIG[freethreading] = "--disable-gil,--enable-gil"
>  PACKAGECONFIG[readline] = "--with-readline=readline,,readline,,,editline"
>  PACKAGECONFIG[editline] = "--with-readline=editline,,libedit,,,readline"
>  # Use profile guided optimisation by running PyBench inside qemu-user
> --
> 2.53.0
>

Thanks for doing this, I'm really interested in using free-threaded python on
Yocto. However, when trying to enable this with current openembedded-core, I
ran into the following problem:

Loading cache: 100%
|###############################################################################################################################################################################################################################################################|
Time: 0:00:02
Loaded 5224 entries from dependency cache.
NOTE: Resolving any missing task queue dependencies

Build Configuration:
BB_VERSION           = "2.16.0"
BUILD_SYS            = "x86_64-linux"
NATIVELSBSTRING      = "universal"
TARGET_SYS           = "x86_64-poky-linux"
MACHINE              = "qemux86-64"
SDKMACHINE           = "x86_64"
DISTRO               = "poky"
DISTRO_VERSION       =
"5.3.99+snapshot-8061433fcd11eba91a29004dfafd175d449fb2fd"
TUNE_FEATURES        = "m64 x86-64-v3"
meta                 = "master:8061433fcd11eba91a29004dfafd175d449fb2fd"
meta-poky            = "master:c7fa63bea78248597798739aa4da49a9f4405b9c"
meta-oe
meta-python
meta-networking
meta-filesystems     = "master:b883bd25cdd27560fdebc5a4bf56f90e99964c4c"

Sstate summary: Wanted 254 Local 2 Mirrors 0 Missed 252 Current 2392
(0% match, 90% complete)#############################################################################################################################################################
                         | ETA:  0:00:00
Initialising tasks: 100%
|##########################################################################################################################################################################################################################################################|
Time: 0:00:05
NOTE: Executing Tasks
ERROR: python3-3.14.3-r0 do_install: oe_multilib_header: Unable to
find header python3.14/pyconfig.h.
ERROR: python3-3.14.3-r0 do_install: Execution of
'/home/brgl/workspace/yocto/python-freethreaded/build/tmp/work/x86-64-v3-poky-linux/python3/3.14.3/temp/run.do_install.2092850'
failed with exit code 1
ERROR: Logfile of failure stored in:
/home/brgl/workspace/yocto/python-freethreaded/build/tmp/work/x86-64-v3-poky-linux/python3/3.14.3/temp/log.do_install.2092850
ERROR: Task (/home/brgl/workspace/yocto/python-freethreaded/sources/openembedded-core/meta/recipes-devtools/python/python3_3.14.3.bb:do_install)
failed with exit code '1'
NOTE: Tasks Summary: Attempted 4513 tasks of which 4512 didn't need to
be rerun and 1 failed.

Summary: 1 task failed:
  /home/brgl/workspace/yocto/python-freethreaded/sources/openembedded-core/meta/recipes-devtools/python/python3_3.14.3.bb:do_install
    log: /home/brgl/workspace/yocto/python-freethreaded/build/tmp/work/x86-64-v3-poky-linux/python3/3.14.3/temp/log.do_install.2092850
Summary: There were 2 ERROR messages, returning a non-zero exit code.


Any hints on what could be wrong? The same config builds fine without the
new option. It's just a core-image-minimal on poky with a few python packages
from meta-openembedded.

Thanks in advance,
Bartosz

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Alexander Kanavin]

On Mon, 23 Mar 2026 at 14:29, Bartosz Golaszewski <brgl@kernel.org> wrote:

> ERROR: python3-3.14.3-r0 do_install: oe_multilib_header: Unable to
> find header python3.14/pyconfig.h.
> Any hints on what could be wrong? The same config builds fine without the
> new option. It's just a core-image-minimal on poky with a few python packages
> from meta-openembedded.

This is the error? ^^^

Alex

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Bartosz Golaszewski]

On Mon, Mar 23, 2026 at 2:35 PM Alexander Kanavin
<alex.kanavin@gmail.com> wrote:
>
> On Mon, 23 Mar 2026 at 14:29, Bartosz Golaszewski <brgl@kernel.org> wrote:
>
> > ERROR: python3-3.14.3-r0 do_install: oe_multilib_header: Unable to
> > find header python3.14/pyconfig.h.
> > Any hints on what could be wrong? The same config builds fine without the
> > new option. It's just a core-image-minimal on poky with a few python packages
> > from meta-openembedded.
>
> This is the error? ^^^
>

As in: pulling in packages from meta-openembedded? Not sure what you
mean, this shouldn't have any impact as the offending recipe is python
itself.

But ok, I disabled meta-openembedded and it fails the same with the
only additional package being python3.

Bart

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Alexander Kanavin]

On Mon, 23 Mar 2026 at 14:48, Bartosz Golaszewski <brgl@kernel.org> wrote:
> > > ERROR: python3-3.14.3-r0 do_install: oe_multilib_header: Unable to
> > > find header python3.14/pyconfig.h.

^^^ This.

> > > Any hints on what could be wrong? The same config builds fine without the
> > > new option. It's just a core-image-minimal on poky with a few python packages
> > > from meta-openembedded.
> >
> > This is the error? ^^^
> >
>
> As in: pulling in packages from meta-openembedded? Not sure what you
> mean, this shouldn't have any impact as the offending recipe is python
> itself.
>
> But ok, I disabled meta-openembedded and it fails the same with the
> only additional package being python3.

No. This error:

ERROR: python3-3.14.3-r0 do_install: oe_multilib_header: Unable to
find header python3.14/pyconfig.h.


Alex



Alex

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Bartosz Golaszewski]

On Mon, Mar 23, 2026 at 3:04 PM Alexander Kanavin
<alex.kanavin@gmail.com> wrote:
>
> On Mon, 23 Mar 2026 at 14:48, Bartosz Golaszewski <brgl@kernel.org> wrote:
> > > > ERROR: python3-3.14.3-r0 do_install: oe_multilib_header: Unable to
> > > > find header python3.14/pyconfig.h.
>
> ^^^ This.
>
> > > > Any hints on what could be wrong? The same config builds fine without the
> > > > new option. It's just a core-image-minimal on poky with a few python packages
> > > > from meta-openembedded.
> > >
> > > This is the error? ^^^
> > >
> >
> > As in: pulling in packages from meta-openembedded? Not sure what you
> > mean, this shouldn't have any impact as the offending recipe is python
> > itself.
> >
> > But ok, I disabled meta-openembedded and it fails the same with the
> > only additional package being python3.
>
> No. This error:
>
> ERROR: python3-3.14.3-r0 do_install: oe_multilib_header: Unable to
> find header python3.14/pyconfig.h.
>

Yes, that seems to be the error though the file is there under
recipe-sysroot-native.

Bart

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Böszörményi Zoltán]

2026. 03. 23. 14:28 keltezéssel, Bartosz Golaszewski írta:
> On Thu, 12 Mar 2026 13:00:24 +0100, "Zoltan Boszormenyi via
> lists.openembedded.org" <zboszor=gmail.com@lists.openembedded.org>
> said:
>> One of the main points in the Python 3.14.x release notes was
>> that free threading is officially supported.
>>
>> Add PACKAGECONFIG[freethreading] to turn it on with --disable-gil.
>> GIL is the Global Interpreter Lock, which is kept enabled without
>> this option.
>>
>> By default, keep free threading disabled, i.e. GIL enabled.
>>
>> Signed-off-by: Zoltán Böszörményi <zboszor@gmail.com>
>> ---
>>   meta/recipes-devtools/python/python3_3.14.3.bb | 1 +
>>   1 file changed, 1 insertion(+)
>>
>> diff --git a/meta/recipes-devtools/python/python3_3.14.3.bb b/meta/recipes-devtools/python/python3_3.14.3.bb
>> index 7047cd8e8d..7a1ad1e386 100644
>> --- a/meta/recipes-devtools/python/python3_3.14.3.bb
>> +++ b/meta/recipes-devtools/python/python3_3.14.3.bb
>> @@ -112,6 +112,7 @@ CACHED_CONFIGUREVARS:append:libc-musl = "\
>>
>>   # PGO currently causes builds to not be reproducible so disable by default, see YOCTO #13407
>>   PACKAGECONFIG ??= "editline gdbm ${@bb.utils.filter('DISTRO_FEATURES', 'lto', d)}"
>> +PACKAGECONFIG[freethreading] = "--disable-gil,--enable-gil"
>>   PACKAGECONFIG[readline] = "--with-readline=readline,,readline,,,editline"
>>   PACKAGECONFIG[editline] = "--with-readline=editline,,libedit,,,readline"
>>   # Use profile guided optimisation by running PyBench inside qemu-user
>> --
>> 2.53.0
>>
> Thanks for doing this, I'm really interested in using free-threaded python on
> Yocto. However, when trying to enable this with current openembedded-core, I
> ran into the following problem:
>
> Loading cache: 100%
> |###############################################################################################################################################################################################################################################################|
> Time: 0:00:02
> Loaded 5224 entries from dependency cache.
> NOTE: Resolving any missing task queue dependencies
>
> Build Configuration:
> BB_VERSION           = "2.16.0"
> BUILD_SYS            = "x86_64-linux"
> NATIVELSBSTRING      = "universal"
> TARGET_SYS           = "x86_64-poky-linux"
> MACHINE              = "qemux86-64"
> SDKMACHINE           = "x86_64"
> DISTRO               = "poky"
> DISTRO_VERSION       =
> "5.3.99+snapshot-8061433fcd11eba91a29004dfafd175d449fb2fd"
> TUNE_FEATURES        = "m64 x86-64-v3"
> meta                 = "master:8061433fcd11eba91a29004dfafd175d449fb2fd"
> meta-poky            = "master:c7fa63bea78248597798739aa4da49a9f4405b9c"
> meta-oe
> meta-python
> meta-networking
> meta-filesystems     = "master:b883bd25cdd27560fdebc5a4bf56f90e99964c4c"
>
> Sstate summary: Wanted 254 Local 2 Mirrors 0 Missed 252 Current 2392
> (0% match, 90% complete)#############################################################################################################################################################
>                           | ETA:  0:00:00
> Initialising tasks: 100%
> |##########################################################################################################################################################################################################################################################|
> Time: 0:00:05
> NOTE: Executing Tasks
> ERROR: python3-3.14.3-r0 do_install: oe_multilib_header: Unable to
> find header python3.14/pyconfig.h.
> ERROR: python3-3.14.3-r0 do_install: Execution of
> '/home/brgl/workspace/yocto/python-freethreaded/build/tmp/work/x86-64-v3-poky-linux/python3/3.14.3/temp/run.do_install.2092850'
> failed with exit code 1
> ERROR: Logfile of failure stored in:
> /home/brgl/workspace/yocto/python-freethreaded/build/tmp/work/x86-64-v3-poky-linux/python3/3.14.3/temp/log.do_install.2092850
> ERROR: Task (/home/brgl/workspace/yocto/python-freethreaded/sources/openembedded-core/meta/recipes-devtools/python/python3_3.14.3.bb:do_install)
> failed with exit code '1'
> NOTE: Tasks Summary: Attempted 4513 tasks of which 4512 didn't need to
> be rerun and 1 failed.
>
> Summary: 1 task failed:
>    /home/brgl/workspace/yocto/python-freethreaded/sources/openembedded-core/meta/recipes-devtools/python/python3_3.14.3.bb:do_install
>      log: /home/brgl/workspace/yocto/python-freethreaded/build/tmp/work/x86-64-v3-poky-linux/python3/3.14.3/temp/log.do_install.2092850
> Summary: There were 2 ERROR messages, returning a non-zero exit code.
>
>
> Any hints on what could be wrong? The same config builds fine without the
> new option. It's just a core-image-minimal on poky with a few python packages
> from meta-openembedded.

The problem is that now the directories are
${libdir}/python3.14t and ${includedir}/python3.14t

Note the "t" suffix.

diff --git a/meta/recipes-devtools/python/python3_3.14.3.bb 
b/meta/recipes-devtools/python/python3_3.14.3.bb
index 7a1ad1e386..492f2f93f0 100644
--- a/meta/recipes-devtools/python/python3_3.14.3.bb
+++ b/meta/recipes-devtools/python/python3_3.14.3.bb
@@ -47,7 +47,7 @@ UPSTREAM_CHECK_REGEX = "[Pp]ython-(?P<pver>\d+(\.\d+)+).tar"

  CVE_PRODUCT = "python:python python_software_foundation:python cpython"

-PYTHON_MAJMIN = "3.14"
+PYTHON_MAJMIN = "3.14${@bb.utils.contains('PACKAGECONFIG', 'freethreading', 't', '', d)}"

  S = "${UNPACKDIR}/Python-${PV}"

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Bartosz Golaszewski]

On Mon, 23 Mar 2026 15:23:52 +0100, "Zoltan Boszormenyi via
lists.openembedded.org" <zboszor=gmail.com@lists.openembedded.org>
said:
>>
>> Any hints on what could be wrong? The same config builds fine without the
>> new option. It's just a core-image-minimal on poky with a few python packages
>> from meta-openembedded.
>
> The problem is that now the directories are
> ${libdir}/python3.14t and ${includedir}/python3.14t
>
> Note the "t" suffix.
>
> diff --git a/meta/recipes-devtools/python/python3_3.14.3.bb
> b/meta/recipes-devtools/python/python3_3.14.3.bb
> index 7a1ad1e386..492f2f93f0 100644
> --- a/meta/recipes-devtools/python/python3_3.14.3.bb
> +++ b/meta/recipes-devtools/python/python3_3.14.3.bb
> @@ -47,7 +47,7 @@ UPSTREAM_CHECK_REGEX = "[Pp]ython-(?P<pver>\d+(\.\d+)+).tar"
>
>   CVE_PRODUCT = "python:python python_software_foundation:python cpython"
>
> -PYTHON_MAJMIN = "3.14"
> +PYTHON_MAJMIN = "3.14${@bb.utils.contains('PACKAGECONFIG', 'freethreading', 't', '', d)}"
>
>   S = "${UNPACKDIR}/Python-${PV}"
>

I think it's more fine-grained, because I'm seeing this:

ERROR: Task (/home/brgl/workspace/yocto/python-freethreaded/sources/openembedded-core/meta/recipes-devtools/python/python3-iniconfig_2.3.0.bb:do_prepare_recipe_sysroot)
failed with exit code '1'
ERROR: python3-3.14.3-r0 do_package: QA Issue: python3:
Files/directories were installed but not shipped in any package:
  /usr/bin/python3.14
Please set FILES such that these items are packaged. Alternatively if
they are unneeded, avoid installing them or delete them within
do_install.
python3: 1 installed and not shipped files. [installed-vs-shipped]
ERROR: python3-3.14.3-r0 do_package: Fatal QA errors were found, failing task.
ERROR: Logfile of failure stored in:
/home/brgl/workspace/yocto/python-freethreaded/build/tmp/work/x86-64-v3-poky-linux/python3/3.14.3/temp/log.do_package.2308607
ERROR: Task (/home/brgl/workspace/yocto/python-freethreaded/sources/openembedded-core/meta/recipes-devtools/python/python3_3.14.3.bb:do_package)
failed with exit code '1'

The MAJMIN seems to be used for the executable as well and with this change,
it's missing from FILES.

Bart

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Böszörményi Zoltán]

2026. 03. 23. 15:34 keltezéssel, Bartosz Golaszewski írta:
> On Mon, 23 Mar 2026 15:23:52 +0100, "Zoltan Boszormenyi via
> lists.openembedded.org" <zboszor=gmail.com@lists.openembedded.org>
> said:
>>> Any hints on what could be wrong? The same config builds fine without the
>>> new option. It's just a core-image-minimal on poky with a few python packages
>>> from meta-openembedded.
>> The problem is that now the directories are
>> ${libdir}/python3.14t and ${includedir}/python3.14t
>>
>> Note the "t" suffix.
>>
>> diff --git a/meta/recipes-devtools/python/python3_3.14.3.bb
>> b/meta/recipes-devtools/python/python3_3.14.3.bb
>> index 7a1ad1e386..492f2f93f0 100644
>> --- a/meta/recipes-devtools/python/python3_3.14.3.bb
>> +++ b/meta/recipes-devtools/python/python3_3.14.3.bb
>> @@ -47,7 +47,7 @@ UPSTREAM_CHECK_REGEX = "[Pp]ython-(?P<pver>\d+(\.\d+)+).tar"
>>
>>    CVE_PRODUCT = "python:python python_software_foundation:python cpython"
>>
>> -PYTHON_MAJMIN = "3.14"
>> +PYTHON_MAJMIN = "3.14${@bb.utils.contains('PACKAGECONFIG', 'freethreading', 't', '', d)}"
>>
>>    S = "${UNPACKDIR}/Python-${PV}"
>>
> I think it's more fine-grained, because I'm seeing this:

I also see other issues popping up, first in python3-installer-native.

Probably this setting ("python-freethreading") should be a
DISTRO_FEATURE and then the python3 recipe would use that
to enable its PACKAGECONFIG.

PYTHON_DIR in python-dir.bbclass should also be set accordingly.

I suspect that both native and target builds of python3 would have
to use the same setting, i.e. DISTRO_FEATURE and DISTRO_FEATURE_NATIVE
must contain python-freethreading. Some build helpers (skbuild, etc.)
does not seem to distinguish correctly between host python and target.

> ERROR: Task (/home/brgl/workspace/yocto/python-freethreaded/sources/openembedded-core/meta/recipes-devtools/python/python3-iniconfig_2.3.0.bb:do_prepare_recipe_sysroot)
> failed with exit code '1'
> ERROR: python3-3.14.3-r0 do_package: QA Issue: python3:
> Files/directories were installed but not shipped in any package:
>    /usr/bin/python3.14
> Please set FILES such that these items are packaged. Alternatively if
> they are unneeded, avoid installing them or delete them within
> do_install.
> python3: 1 installed and not shipped files. [installed-vs-shipped]
> ERROR: python3-3.14.3-r0 do_package: Fatal QA errors were found, failing task.
> ERROR: Logfile of failure stored in:
> /home/brgl/workspace/yocto/python-freethreaded/build/tmp/work/x86-64-v3-poky-linux/python3/3.14.3/temp/log.do_package.2308607
> ERROR: Task (/home/brgl/workspace/yocto/python-freethreaded/sources/openembedded-core/meta/recipes-devtools/python/python3_3.14.3.bb:do_package)
> failed with exit code '1'
>
> The MAJMIN seems to be used for the executable as well and with this change,
> it's missing from FILES.
>
> Bart

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Bartosz Golaszewski]

On Mon, Mar 23, 2026 at 3:40 PM Böszörményi Zoltán <zboszor@gmail.com> wrote:
>
> 2026. 03. 23. 15:34 keltezéssel, Bartosz Golaszewski írta:
> > On Mon, 23 Mar 2026 15:23:52 +0100, "Zoltan Boszormenyi via
> > lists.openembedded.org" <zboszor=gmail.com@lists.openembedded.org>
> > said:
> >>> Any hints on what could be wrong? The same config builds fine without the
> >>> new option. It's just a core-image-minimal on poky with a few python packages
> >>> from meta-openembedded.
> >> The problem is that now the directories are
> >> ${libdir}/python3.14t and ${includedir}/python3.14t
> >>
> >> Note the "t" suffix.
> >>
> >> diff --git a/meta/recipes-devtools/python/python3_3.14.3.bb
> >> b/meta/recipes-devtools/python/python3_3.14.3.bb
> >> index 7a1ad1e386..492f2f93f0 100644
> >> --- a/meta/recipes-devtools/python/python3_3.14.3.bb
> >> +++ b/meta/recipes-devtools/python/python3_3.14.3.bb
> >> @@ -47,7 +47,7 @@ UPSTREAM_CHECK_REGEX = "[Pp]ython-(?P<pver>\d+(\.\d+)+).tar"
> >>
> >>    CVE_PRODUCT = "python:python python_software_foundation:python cpython"
> >>
> >> -PYTHON_MAJMIN = "3.14"
> >> +PYTHON_MAJMIN = "3.14${@bb.utils.contains('PACKAGECONFIG', 'freethreading', 't', '', d)}"
> >>
> >>    S = "${UNPACKDIR}/Python-${PV}"
> >>
> > I think it's more fine-grained, because I'm seeing this:
>
> I also see other issues popping up, first in python3-installer-native.
>
> Probably this setting ("python-freethreading") should be a
> DISTRO_FEATURE and then the python3 recipe would use that
> to enable its PACKAGECONFIG.
>
> PYTHON_DIR in python-dir.bbclass should also be set accordingly.
>
> I suspect that both native and target builds of python3 would have
> to use the same setting, i.e. DISTRO_FEATURE and DISTRO_FEATURE_NATIVE
> must contain python-freethreading. Some build helpers (skbuild, etc.)
> does not seem to distinguish correctly between host python and target.
>

But is there a config for which it ever worked?

Bart

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Böszörményi Zoltán]

2026. 03. 23. 15:45 keltezéssel, Bartosz Golaszewski írta:
> On Mon, Mar 23, 2026 at 3:40 PM Böszörményi Zoltán <zboszor@gmail.com> wrote:
>> 2026. 03. 23. 15:34 keltezéssel, Bartosz Golaszewski írta:
>>> On Mon, 23 Mar 2026 15:23:52 +0100, "Zoltan Boszormenyi via
>>> lists.openembedded.org" <zboszor=gmail.com@lists.openembedded.org>
>>> said:
>>>>> Any hints on what could be wrong? The same config builds fine without the
>>>>> new option. It's just a core-image-minimal on poky with a few python packages
>>>>> from meta-openembedded.
>>>> The problem is that now the directories are
>>>> ${libdir}/python3.14t and ${includedir}/python3.14t
>>>>
>>>> Note the "t" suffix.
>>>>
>>>> diff --git a/meta/recipes-devtools/python/python3_3.14.3.bb
>>>> b/meta/recipes-devtools/python/python3_3.14.3.bb
>>>> index 7a1ad1e386..492f2f93f0 100644
>>>> --- a/meta/recipes-devtools/python/python3_3.14.3.bb
>>>> +++ b/meta/recipes-devtools/python/python3_3.14.3.bb
>>>> @@ -47,7 +47,7 @@ UPSTREAM_CHECK_REGEX = "[Pp]ython-(?P<pver>\d+(\.\d+)+).tar"
>>>>
>>>>     CVE_PRODUCT = "python:python python_software_foundation:python cpython"
>>>>
>>>> -PYTHON_MAJMIN = "3.14"
>>>> +PYTHON_MAJMIN = "3.14${@bb.utils.contains('PACKAGECONFIG', 'freethreading', 't', '', d)}"
>>>>
>>>>     S = "${UNPACKDIR}/Python-${PV}"
>>>>
>>> I think it's more fine-grained, because I'm seeing this:
>> I also see other issues popping up, first in python3-installer-native.
>>
>> Probably this setting ("python-freethreading") should be a
>> DISTRO_FEATURE and then the python3 recipe would use that
>> to enable its PACKAGECONFIG.
>>
>> PYTHON_DIR in python-dir.bbclass should also be set accordingly.
>>
>> I suspect that both native and target builds of python3 would have
>> to use the same setting, i.e. DISTRO_FEATURE and DISTRO_FEATURE_NATIVE
>> must contain python-freethreading. Some build helpers (skbuild, etc.)
>> does not seem to distinguish correctly between host python and target.
>>
> But is there a config for which it ever worked?

Not really, this change was just a stab in the dark.
Probaly it should have been an RFC patch.

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Alexander Kanavin]

On Mon, 23 Mar 2026 at 15:40, Böszörményi Zoltán <zboszor@gmail.com> wrote:
> I also see other issues popping up, first in python3-installer-native.
>
> Probably this setting ("python-freethreading") should be a
> DISTRO_FEATURE and then the python3 recipe would use that
> to enable its PACKAGECONFIG.
>
> PYTHON_DIR in python-dir.bbclass should also be set accordingly.

In patch review it was suggested that we should actually have two
co-installable recipes, rather than an exclusive choice between.

Alex

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Böszörményi Zoltán]

2026. 03. 23. 15:47 keltezéssel, Alexander Kanavin írta:
> On Mon, 23 Mar 2026 at 15:40, Böszörményi Zoltán <zboszor@gmail.com> wrote:
>> I also see other issues popping up, first in python3-installer-native.
>>
>> Probably this setting ("python-freethreading") should be a
>> DISTRO_FEATURE and then the python3 recipe would use that
>> to enable its PACKAGECONFIG.
>>
>> PYTHON_DIR in python-dir.bbclass should also be set accordingly.
> In patch review it was suggested that we should actually have two
> co-installable recipes, rather than an exclusive choice between.

Which implies doubling every python3-* recipes, too.

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Trevor Gamblin]

On 2026-03-23 10:52, Zoltan Boszormenyi via lists.openembedded.org wrote:
> 2026. 03. 23. 15:47 keltezéssel, Alexander Kanavin írta:
>> On Mon, 23 Mar 2026 at 15:40, Böszörményi Zoltán <zboszor@gmail.com> 
>> wrote:
>>> I also see other issues popping up, first in python3-installer-native.
>>>
>>> Probably this setting ("python-freethreading") should be a
>>> DISTRO_FEATURE and then the python3 recipe would use that
>>> to enable its PACKAGECONFIG.
>>>
>>> PYTHON_DIR in python-dir.bbclass should also be set accordingly.
>> In patch review it was suggested that we should actually have two
>> co-installable recipes, rather than an exclusive choice between.
>
> Which implies doubling every python3-* recipes, too.

I think that should only be for python3 packages which actually have 
binary builds.

For example, python3-setuptools should still be fine, but python3-pyyaml 
would also need threading enabled for the recipe.

Unfortunately that means this gets even more complicated.

We may need to come up with a couple of new variables and/or a class for 
threaded builds to make the threaded versions work.

>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#233742): https://lists.openembedded.org/g/openembedded-core/message/233742
> Mute This Topic: https://lists.openembedded.org/mt/118277380/7611679
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [tgamblin@baylibre.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Böszörményi Zoltán]

2026. 03. 23. 16:03 keltezéssel, Trevor Gamblin írta:
>
> On 2026-03-23 10:52, Zoltan Boszormenyi via lists.openembedded.org wrote:
>> 2026. 03. 23. 15:47 keltezéssel, Alexander Kanavin írta:
>>> On Mon, 23 Mar 2026 at 15:40, Böszörményi Zoltán <zboszor@gmail.com> wrote:
>>>> I also see other issues popping up, first in python3-installer-native.
>>>>
>>>> Probably this setting ("python-freethreading") should be a
>>>> DISTRO_FEATURE and then the python3 recipe would use that
>>>> to enable its PACKAGECONFIG.
>>>>
>>>> PYTHON_DIR in python-dir.bbclass should also be set accordingly.
>>> In patch review it was suggested that we should actually have two
>>> co-installable recipes, rather than an exclusive choice between.
>>
>> Which implies doubling every python3-* recipes, too.
>
> I think that should only be for python3 packages which actually have binary builds.

Not just those. Script-only modules won't be found either
by one build in the the other build's site-packages.

> For example, python3-setuptools should still be fine, but python3-pyyaml would also need 
> threading enabled for the recipe.
>
> Unfortunately that means this gets even more complicated.
>
> We may need to come up with a couple of new variables and/or a class for threaded builds 
> to make the threaded versions work.
>
>>
>>
>> -=-=-=-=-=-=-=-=-=-=-=-
>> Links: You receive all messages sent to this group.
>> View/Reply Online (#233742): 
>> https://lists.openembedded.org/g/openembedded-core/message/233742
>> Mute This Topic: https://lists.openembedded.org/mt/118277380/7611679
>> Group Owner: openembedded-core+owner@lists.openembedded.org
>> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub 
>> [tgamblin@baylibre.com]
>> -=-=-=-=-=-=-=-=-=-=-=-
>>

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Bartosz Golaszewski]

On Mon, Mar 23, 2026 at 6:23 PM Böszörményi Zoltán <zboszor@gmail.com> wrote:
>
> 2026. 03. 23. 16:03 keltezéssel, Trevor Gamblin írta:
> >
> > On 2026-03-23 10:52, Zoltan Boszormenyi via lists.openembedded.org wrote:
> >> 2026. 03. 23. 15:47 keltezéssel, Alexander Kanavin írta:
> >>> On Mon, 23 Mar 2026 at 15:40, Böszörményi Zoltán <zboszor@gmail.com> wrote:
> >>>> I also see other issues popping up, first in python3-installer-native.
> >>>>
> >>>> Probably this setting ("python-freethreading") should be a
> >>>> DISTRO_FEATURE and then the python3 recipe would use that
> >>>> to enable its PACKAGECONFIG.
> >>>>
> >>>> PYTHON_DIR in python-dir.bbclass should also be set accordingly.
> >>> In patch review it was suggested that we should actually have two
> >>> co-installable recipes, rather than an exclusive choice between.
> >>
> >> Which implies doubling every python3-* recipes, too.
> >
> > I think that should only be for python3 packages which actually have binary builds.
>
> Not just those. Script-only modules won't be found either
> by one build in the the other build's site-packages.
>

Am I getting this right: This is experimental, never worked and
actually shouldn't even be in openembedded-core master at all? I'm
trying to figure out if I'm wasting my time trying to make this work.

Bart

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Böszörményi Zoltán]

2026. 03. 24. 9:46 keltezéssel, Bartosz Golaszewski írta:
> On Mon, Mar 23, 2026 at 6:23 PM Böszörményi Zoltán <zboszor@gmail.com> wrote:
>> 2026. 03. 23. 16:03 keltezéssel, Trevor Gamblin írta:
>>> On 2026-03-23 10:52, Zoltan Boszormenyi via lists.openembedded.org wrote:
>>>> 2026. 03. 23. 15:47 keltezéssel, Alexander Kanavin írta:
>>>>> On Mon, 23 Mar 2026 at 15:40, Böszörményi Zoltán <zboszor@gmail.com> wrote:
>>>>>> I also see other issues popping up, first in python3-installer-native.
>>>>>>
>>>>>> Probably this setting ("python-freethreading") should be a
>>>>>> DISTRO_FEATURE and then the python3 recipe would use that
>>>>>> to enable its PACKAGECONFIG.
>>>>>>
>>>>>> PYTHON_DIR in python-dir.bbclass should also be set accordingly.
>>>>> In patch review it was suggested that we should actually have two
>>>>> co-installable recipes, rather than an exclusive choice between.
>>>> Which implies doubling every python3-* recipes, too.
>>> I think that should only be for python3 packages which actually have binary builds.
>> Not just those. Script-only modules won't be found either
>> by one build in the the other build's site-packages.
>>
> Am I getting this right: This is experimental, never worked and
> actually shouldn't even be in openembedded-core master at all? I'm
> trying to figure out if I'm wasting my time trying to make this work.

I have figured out what was needed, it wasn't that bad.
I just sent two series for that, one for openembedded-core and
one for meta-openembedded.

Some projects do not actually expect freethreading to be enabled,
see the ones with moving the installed site-packages directory into
the correct location:

+do_install:append () {
+    if [ ! -d ${D}${libdir}/${PYTHON_DIR} ]; then
+        mv ${D}${libdir}/python${PYTHON_BASEVERSION} ${D}${libdir}/${PYTHON_DIR}
+    fi
+}

I expect a lot of fallouts in CI.

Re: [OE-core] [PATCH v2] python3: Add a new PACKAGECONFIG knob for free threading

[Böszörményi Zoltán]

2026. 03. 23. 15:40 keltezéssel, Zoltan Boszormenyi via lists.openembedded.org írta:
> 2026. 03. 23. 15:34 keltezéssel, Bartosz Golaszewski írta:
>> On Mon, 23 Mar 2026 15:23:52 +0100, "Zoltan Boszormenyi via
>> lists.openembedded.org" <zboszor=gmail.com@lists.openembedded.org>
>> said:
>>>> Any hints on what could be wrong? The same config builds fine without the
>>>> new option. It's just a core-image-minimal on poky with a few python packages
>>>> from meta-openembedded.
>>> The problem is that now the directories are
>>> ${libdir}/python3.14t and ${includedir}/python3.14t
>>>
>>> Note the "t" suffix.
>>>
>>> diff --git a/meta/recipes-devtools/python/python3_3.14.3.bb
>>> b/meta/recipes-devtools/python/python3_3.14.3.bb
>>> index 7a1ad1e386..492f2f93f0 100644
>>> --- a/meta/recipes-devtools/python/python3_3.14.3.bb
>>> +++ b/meta/recipes-devtools/python/python3_3.14.3.bb
>>> @@ -47,7 +47,7 @@ UPSTREAM_CHECK_REGEX = "[Pp]ython-(?P<pver>\d+(\.\d+)+).tar"
>>>
>>>    CVE_PRODUCT = "python:python python_software_foundation:python cpython"
>>>
>>> -PYTHON_MAJMIN = "3.14"
>>> +PYTHON_MAJMIN = "3.14${@bb.utils.contains('PACKAGECONFIG', 'freethreading', 't', '', 
>>> d)}"
>>>
>>>    S = "${UNPACKDIR}/Python-${PV}"
>>>
>> I think it's more fine-grained, because I'm seeing this:
>
> I also see other issues popping up, first in python3-installer-native.
>
> Probably this setting ("python-freethreading") should be a
> DISTRO_FEATURE and then the python3 recipe would use that
> to enable its PACKAGECONFIG.
>
> PYTHON_DIR in python-dir.bbclass should also be set accordingly.
>
> I suspect that both native and target builds of python3 would have
> to use the same setting, i.e. DISTRO_FEATURE and DISTRO_FEATURE_NATIVE
> must contain python-freethreading. Some build helpers (skbuild, etc.)
> does not seem to distinguish correctly between host python and target.

Plus, this seems to be a long term project to enable freethreaded python
because a lot of modules have status lines like this:

     "Programming Language :: Python :: Free Threading :: 1 - Unstable",

For now, I wouldn't recommend it, only for experimenting.

>
>> ERROR: Task 
>> (/home/brgl/workspace/yocto/python-freethreaded/sources/openembedded-core/meta/recipes-devtools/python/python3-iniconfig_2.3.0.bb:do_prepare_recipe_sysroot)
>> failed with exit code '1'
>> ERROR: python3-3.14.3-r0 do_package: QA Issue: python3:
>> Files/directories were installed but not shipped in any package:
>>    /usr/bin/python3.14
>> Please set FILES such that these items are packaged. Alternatively if
>> they are unneeded, avoid installing them or delete them within
>> do_install.
>> python3: 1 installed and not shipped files. [installed-vs-shipped]
>> ERROR: python3-3.14.3-r0 do_package: Fatal QA errors were found, failing task.
>> ERROR: Logfile of failure stored in:
>> /home/brgl/workspace/yocto/python-freethreaded/build/tmp/work/x86-64-v3-poky-linux/python3/3.14.3/temp/log.do_package.2308607 
>>
>> ERROR: Task 
>> (/home/brgl/workspace/yocto/python-freethreaded/sources/openembedded-core/meta/recipes-devtools/python/python3_3.14.3.bb:do_package)
>> failed with exit code '1'
>>
>> The MAJMIN seems to be used for the executable as well and with this change,
>> it's missing from FILES.
>>
>> Bart
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#233739): https://lists.openembedded.org/g/openembedded-core/message/233739
> Mute This Topic: https://lists.openembedded.org/mt/118277380/3617728
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [zboszor@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>