* [bitbake][walnascar][2.12][PATCH 0/2] Patch review
@ 2025-09-10 15:55 Steve Sakoman
2025-09-10 15:55 ` [bitbake][walnascar][2.12][PATCH 1/2] Use a "fork" multiprocessing context Steve Sakoman
2025-09-10 15:55 ` [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1 Steve Sakoman
0 siblings, 2 replies; 10+ messages in thread
From: Steve Sakoman @ 2025-09-10 15:55 UTC (permalink / raw)
To: bitbake-devel
Please review this set of changes for 2.12/walnascar and have comments back
by end of day Friday, September 12
Passed a-full on autobuilder:
https://autobuilder.yoctoproject.org/valkyrie/#/builders/29/builds/2348
The following changes since commit 710f98844ae30416bdf6a01b655df398b49574ec:
utils: Optimise signal/sigmask performance (2025-07-31 09:32:00 -0700)
are available in the Git repository at:
https://git.openembedded.org/bitbake-contrib stable/2.12-nut
https://git.openembedded.org/bitbake-contrib/log/?h=stable/2.12-nut
Joshua Watt (1):
Use a "fork" multiprocessing context
Martin Jansa (1):
bitbake: Bump version to 2.12.1
bin/bitbake | 2 +-
lib/bb/__init__.py | 30 +++++++++++++++++++++++++++++-
lib/bb/asyncrpc/serv.py | 2 +-
lib/bb/cooker.py | 2 +-
lib/bb/server/process.py | 2 +-
lib/bb/tests/support/httpserver.py | 4 ++--
lib/bb/utils.py | 4 +---
lib/hashserv/tests.py | 2 +-
8 files changed, 37 insertions(+), 11 deletions(-)
--
2.43.0
^ permalink raw reply [flat|nested] 10+ messages in thread
* [bitbake][walnascar][2.12][PATCH 1/2] Use a "fork" multiprocessing context
2025-09-10 15:55 [bitbake][walnascar][2.12][PATCH 0/2] Patch review Steve Sakoman
@ 2025-09-10 15:55 ` Steve Sakoman
2025-09-10 15:55 ` [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1 Steve Sakoman
1 sibling, 0 replies; 10+ messages in thread
From: Steve Sakoman @ 2025-09-10 15:55 UTC (permalink / raw)
To: bitbake-devel
From: Joshua Watt <JPEWhacker@gmail.com>
Python 3.14 changes the default multiprocessing context from "fork" to
"forkserver"; however bitbake heavily relies on "fork" to efficiently
pass data to the child processes. As such, make "fork" context in the bb
namespace and use it in place of the normal multiprocessing module.
Note that multiprocessing contexts were added in Python 3.4, so this
should be safe to use even before Python 3.14
[YOCTO #15858]
Signed-off-by: Joshua Watt <JPEWhacker@gmail.com>
Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
lib/bb/__init__.py | 28 ++++++++++++++++++++++++++++
lib/bb/asyncrpc/serv.py | 2 +-
lib/bb/cooker.py | 2 +-
lib/bb/server/process.py | 2 +-
lib/bb/tests/support/httpserver.py | 4 ++--
lib/bb/utils.py | 4 +---
lib/hashserv/tests.py | 2 +-
7 files changed, 35 insertions(+), 9 deletions(-)
diff --git a/lib/bb/__init__.py b/lib/bb/__init__.py
index 566835573..605355e1a 100644
--- a/lib/bb/__init__.py
+++ b/lib/bb/__init__.py
@@ -37,6 +37,34 @@ class BBHandledException(Exception):
import os
import logging
from collections import namedtuple
+import multiprocessing as mp
+
+# Python 3.14 changes the default multiprocessing context from "fork" to
+# "forkserver". However, bitbake heavily relies on "fork" behavior to
+# efficiently pass data to the child processes. Places that need this should do:
+# from bb import multiprocessing
+# in place of
+# import multiprocessing
+
+class MultiprocessingContext(object):
+ """
+ Multiprocessing proxy object that uses the "fork" context for a property if
+ available, otherwise goes to the main multiprocessing module. This allows
+ it to be a drop-in replacement for the multiprocessing module, but use the
+ fork context
+ """
+ def __init__(self):
+ super().__setattr__("_ctx", mp.get_context("fork"))
+
+ def __getattr__(self, name):
+ if hasattr(self._ctx, name):
+ return getattr(self._ctx, name)
+ return getattr(mp, name)
+
+ def __setattr__(self, name, value):
+ raise AttributeError(f"Unable to set attribute {name}")
+
+multiprocessing = MultiprocessingContext()
class NullHandler(logging.Handler):
diff --git a/lib/bb/asyncrpc/serv.py b/lib/bb/asyncrpc/serv.py
index 667217c5c..acdcaf08e 100644
--- a/lib/bb/asyncrpc/serv.py
+++ b/lib/bb/asyncrpc/serv.py
@@ -11,7 +11,7 @@ import os
import signal
import socket
import sys
-import multiprocessing
+from bb import multiprocessing
import logging
from .connection import StreamConnection, WebsocketConnection
from .exceptions import ClientError, ServerError, ConnectionClosedError, InvokeError
diff --git a/lib/bb/cooker.py b/lib/bb/cooker.py
index 1810bcc60..36659cee2 100644
--- a/lib/bb/cooker.py
+++ b/lib/bb/cooker.py
@@ -12,7 +12,7 @@ import enum
import sys, os, glob, os.path, re, time
import itertools
import logging
-import multiprocessing
+from bb import multiprocessing
import threading
from io import StringIO, UnsupportedOperation
from contextlib import closing
diff --git a/lib/bb/server/process.py b/lib/bb/server/process.py
index 4b35be62c..f74b3f1bf 100644
--- a/lib/bb/server/process.py
+++ b/lib/bb/server/process.py
@@ -13,7 +13,7 @@
import bb
import bb.event
import logging
-import multiprocessing
+from bb import multiprocessing
import threading
import array
import os
diff --git a/lib/bb/tests/support/httpserver.py b/lib/bb/tests/support/httpserver.py
index 78f766005..03327e923 100644
--- a/lib/bb/tests/support/httpserver.py
+++ b/lib/bb/tests/support/httpserver.py
@@ -3,7 +3,7 @@
#
import http.server
-import multiprocessing
+from bb import multiprocessing
import os
import traceback
import signal
@@ -43,7 +43,7 @@ class HTTPService(object):
self.process = multiprocessing.Process(target=self.server.server_start, args=[self.root_dir, self.logger])
# The signal handler from testimage.bbclass can cause deadlocks here
- # if the HTTPServer is terminated before it can restore the standard
+ # if the HTTPServer is terminated before it can restore the standard
#signal behaviour
orig = signal.getsignal(signal.SIGTERM)
signal.signal(signal.SIGTERM, signal.SIG_DFL)
diff --git a/lib/bb/utils.py b/lib/bb/utils.py
index 083242268..694e79f55 100644
--- a/lib/bb/utils.py
+++ b/lib/bb/utils.py
@@ -12,7 +12,7 @@ import sys
import errno
import logging
import locale
-import multiprocessing
+from bb import multiprocessing
import importlib
import importlib.machinery
import importlib.util
@@ -1198,8 +1198,6 @@ def process_profilelog(fn, pout = None):
#
def multiprocessingpool(*args, **kwargs):
- import multiprocessing.pool
- #import multiprocessing.util
#multiprocessing.util.log_to_stderr(10)
# Deal with a multiprocessing bug where signals to the processes would be delayed until the work
# completes. Putting in a timeout means the signals (like SIGINT/SIGTERM) get processed.
diff --git a/lib/hashserv/tests.py b/lib/hashserv/tests.py
index da3f8e088..124d8aa00 100644
--- a/lib/hashserv/tests.py
+++ b/lib/hashserv/tests.py
@@ -10,7 +10,7 @@ from .server import DEFAULT_ANON_PERMS, ALL_PERMISSIONS
from bb.asyncrpc import InvokeError
import hashlib
import logging
-import multiprocessing
+from bb import multiprocessing
import os
import sys
import tempfile
--
2.43.0
^ permalink raw reply related [flat|nested] 10+ messages in thread
* [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1
2025-09-10 15:55 [bitbake][walnascar][2.12][PATCH 0/2] Patch review Steve Sakoman
2025-09-10 15:55 ` [bitbake][walnascar][2.12][PATCH 1/2] Use a "fork" multiprocessing context Steve Sakoman
@ 2025-09-10 15:55 ` Steve Sakoman
2025-09-17 7:27 ` [bitbake-devel] " Martin Jansa
1 sibling, 1 reply; 10+ messages in thread
From: Steve Sakoman @ 2025-09-10 15:55 UTC (permalink / raw)
To: bitbake-devel
From: Martin Jansa <martin.jansa@gmail.com>
To indicate compatibility with python 3.14
[YOCTO #15858]
Signed-off-by: Martin Jansa <martin.jansa@gmail.com>
Signed-off-by: Steve Sakoman <steve@sakoman.com>
---
bin/bitbake | 2 +-
lib/bb/__init__.py | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/bin/bitbake b/bin/bitbake
index 09cbb54e8..05b6ba742 100755
--- a/bin/bitbake
+++ b/bin/bitbake
@@ -27,7 +27,7 @@ from bb.main import bitbake_main, BitBakeConfigParameters, BBMainException
bb.utils.check_system_locale()
-__version__ = "2.12.0"
+__version__ = "2.12.1"
if __name__ == "__main__":
if __version__ != bb.__version__:
diff --git a/lib/bb/__init__.py b/lib/bb/__init__.py
index 605355e1a..eba7b8fdd 100644
--- a/lib/bb/__init__.py
+++ b/lib/bb/__init__.py
@@ -9,7 +9,7 @@
# SPDX-License-Identifier: GPL-2.0-only
#
-__version__ = "2.12.0"
+__version__ = "2.12.1"
import sys
if sys.version_info < (3, 9, 0):
--
2.43.0
^ permalink raw reply related [flat|nested] 10+ messages in thread
* Re: [bitbake-devel] [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1
2025-09-10 15:55 ` [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1 Steve Sakoman
@ 2025-09-17 7:27 ` Martin Jansa
2025-09-17 13:57 ` Steve Sakoman
2025-09-17 22:24 ` Richard Purdie
0 siblings, 2 replies; 10+ messages in thread
From: Martin Jansa @ 2025-09-17 7:27 UTC (permalink / raw)
To: steve; +Cc: bitbake-devel
Hello Steve,
I've noticed today that 1.12.3 tag was pushed for current 1.12 branch:
commit 710f98844ae30416bdf6a01b655df398b49574ec (tag: yocto-5.2.3,
tag: 2025-04.3-walnascar, tag: 2.12.3, origin/2.12, oe/2.12,
github/2.12, github.oe/2.12, 2.12)
Author: Richard Purdie <richard.purdie@linuxfoundation.org>
Date: Tue Jul 29 16:42:25 2025 -0400
utils: Optimise signal/sigmask performance
Should I redo this as 2.12.4 and adjust the related change for oe-core
to bump the minimal version to 2.12.4 as well?
Similarly for scarthgap and 2.8 bitbake, which has 2.8.12 tag already,
so instead of 2.8.1 I would bump it to 2.8.13.
commit 982645110a19ebb94d519926a4e14c8a2a205cfd (tag: yocto-5.0.12,
tag: 2024-04.12-scarthgap, tag: 2.8.12, origin/2.8, oe/2.8,
github/2.8, github.oe/2.8, 2.8)
Author: Richard Purdie <richard.purdie@linuxfoundation.org>
Date: Tue Jul 29 14:43:09 2025 -0400
utils: Optimise signal/sigmask performance
Regards,
On Wed, Sep 10, 2025 at 5:55 PM Steve Sakoman via
lists.openembedded.org <steve=sakoman.com@lists.openembedded.org>
wrote:
>
> From: Martin Jansa <martin.jansa@gmail.com>
>
> To indicate compatibility with python 3.14
>
> [YOCTO #15858]
>
> Signed-off-by: Martin Jansa <martin.jansa@gmail.com>
> Signed-off-by: Steve Sakoman <steve@sakoman.com>
> ---
> bin/bitbake | 2 +-
> lib/bb/__init__.py | 2 +-
> 2 files changed, 2 insertions(+), 2 deletions(-)
>
> diff --git a/bin/bitbake b/bin/bitbake
> index 09cbb54e8..05b6ba742 100755
> --- a/bin/bitbake
> +++ b/bin/bitbake
> @@ -27,7 +27,7 @@ from bb.main import bitbake_main, BitBakeConfigParameters, BBMainException
>
> bb.utils.check_system_locale()
>
> -__version__ = "2.12.0"
> +__version__ = "2.12.1"
>
> if __name__ == "__main__":
> if __version__ != bb.__version__:
> diff --git a/lib/bb/__init__.py b/lib/bb/__init__.py
> index 605355e1a..eba7b8fdd 100644
> --- a/lib/bb/__init__.py
> +++ b/lib/bb/__init__.py
> @@ -9,7 +9,7 @@
> # SPDX-License-Identifier: GPL-2.0-only
> #
>
> -__version__ = "2.12.0"
> +__version__ = "2.12.1"
>
> import sys
> if sys.version_info < (3, 9, 0):
> --
> 2.43.0
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#17999): https://lists.openembedded.org/g/bitbake-devel/message/17999
> Mute This Topic: https://lists.openembedded.org/mt/115172226/3617156
> Group Owner: bitbake-devel+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/bitbake-devel/unsub [martin.jansa@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [bitbake-devel] [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1
2025-09-17 7:27 ` [bitbake-devel] " Martin Jansa
@ 2025-09-17 13:57 ` Steve Sakoman
2025-09-17 14:05 ` Martin Jansa
2025-09-17 22:24 ` Richard Purdie
1 sibling, 1 reply; 10+ messages in thread
From: Steve Sakoman @ 2025-09-17 13:57 UTC (permalink / raw)
To: Martin Jansa, Richard Purdie; +Cc: bitbake-devel
On Wed, Sep 17, 2025 at 12:27 AM Martin Jansa <martin.jansa@gmail.com> wrote:
>
> Hello Steve,
>
> I've noticed today that 1.12.3 tag was pushed for current 1.12 branch:
>
> commit 710f98844ae30416bdf6a01b655df398b49574ec (tag: yocto-5.2.3,
> tag: 2025-04.3-walnascar, tag: 2.12.3, origin/2.12, oe/2.12,
> github/2.12, github.oe/2.12, 2.12)
> Author: Richard Purdie <richard.purdie@linuxfoundation.org>
> Date: Tue Jul 29 16:42:25 2025 -0400
>
> utils: Optimise signal/sigmask performance
>
> Should I redo this as 2.12.4 and adjust the related change for oe-core
> to bump the minimal version to 2.12.4 as well?
>
> Similarly for scarthgap and 2.8 bitbake, which has 2.8.12 tag already,
> so instead of 2.8.1 I would bump it to 2.8.13.
Adding Richard since he is the bitbake maintainer.
I'm not sure what has been done historically. We haven't been bumping
the version with each minor release, but it seems to make sense to me
to do the bump to 2.12.4 rather than 2.12.1
Steve
> commit 982645110a19ebb94d519926a4e14c8a2a205cfd (tag: yocto-5.0.12,
> tag: 2024-04.12-scarthgap, tag: 2.8.12, origin/2.8, oe/2.8,
> github/2.8, github.oe/2.8, 2.8)
> Author: Richard Purdie <richard.purdie@linuxfoundation.org>
> Date: Tue Jul 29 14:43:09 2025 -0400
>
> utils: Optimise signal/sigmask performance
>
> Regards,
>
> On Wed, Sep 10, 2025 at 5:55 PM Steve Sakoman via
> lists.openembedded.org <steve=sakoman.com@lists.openembedded.org>
> wrote:
> >
> > From: Martin Jansa <martin.jansa@gmail.com>
> >
> > To indicate compatibility with python 3.14
> >
> > [YOCTO #15858]
> >
> > Signed-off-by: Martin Jansa <martin.jansa@gmail.com>
> > Signed-off-by: Steve Sakoman <steve@sakoman.com>
> > ---
> > bin/bitbake | 2 +-
> > lib/bb/__init__.py | 2 +-
> > 2 files changed, 2 insertions(+), 2 deletions(-)
> >
> > diff --git a/bin/bitbake b/bin/bitbake
> > index 09cbb54e8..05b6ba742 100755
> > --- a/bin/bitbake
> > +++ b/bin/bitbake
> > @@ -27,7 +27,7 @@ from bb.main import bitbake_main, BitBakeConfigParameters, BBMainException
> >
> > bb.utils.check_system_locale()
> >
> > -__version__ = "2.12.0"
> > +__version__ = "2.12.1"
> >
> > if __name__ == "__main__":
> > if __version__ != bb.__version__:
> > diff --git a/lib/bb/__init__.py b/lib/bb/__init__.py
> > index 605355e1a..eba7b8fdd 100644
> > --- a/lib/bb/__init__.py
> > +++ b/lib/bb/__init__.py
> > @@ -9,7 +9,7 @@
> > # SPDX-License-Identifier: GPL-2.0-only
> > #
> >
> > -__version__ = "2.12.0"
> > +__version__ = "2.12.1"
> >
> > import sys
> > if sys.version_info < (3, 9, 0):
> > --
> > 2.43.0
> >
> >
> > -=-=-=-=-=-=-=-=-=-=-=-
> > Links: You receive all messages sent to this group.
> > View/Reply Online (#17999): https://lists.openembedded.org/g/bitbake-devel/message/17999
> > Mute This Topic: https://lists.openembedded.org/mt/115172226/3617156
> > Group Owner: bitbake-devel+owner@lists.openembedded.org
> > Unsubscribe: https://lists.openembedded.org/g/bitbake-devel/unsub [martin.jansa@gmail.com]
> > -=-=-=-=-=-=-=-=-=-=-=-
> >
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [bitbake-devel] [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1
2025-09-17 13:57 ` Steve Sakoman
@ 2025-09-17 14:05 ` Martin Jansa
2025-09-17 16:25 ` Steve Sakoman
0 siblings, 1 reply; 10+ messages in thread
From: Martin Jansa @ 2025-09-17 14:05 UTC (permalink / raw)
To: Steve Sakoman; +Cc: Richard Purdie, bitbake-devel
I've sent the v2 of all 4 related changes to use 2.12.4 and 2.8.13.
I've also noticed that the sanity check for bitbake version is
executed too late after the utils.py is already failing with:
ERROR: Unable to parse oe-core/meta/lib/oe/utils.py
Traceback (most recent call last):
File "oe-core/meta/lib/oe/utils.py", line 11, in <module>
from bb import multiprocessing
ImportError: cannot import name 'multiprocessing' from 'bb'
(bitbake/lib/bb/__init__.py)
To avoid this issue I recommend to leave "lib/oe/utils: use
multiprocessing from bb" commit in oe-core scarthgap and walnascar for
some future batch and now merge just the bitbake version bump in
bitbake and the requirement for newer bitbake in oe-core, that way
people will hopefully update both before it gets really mandatory.
Cheers,
On Wed, Sep 17, 2025 at 3:57 PM Steve Sakoman <steve@sakoman.com> wrote:
>
> On Wed, Sep 17, 2025 at 12:27 AM Martin Jansa <martin.jansa@gmail.com> wrote:
> >
> > Hello Steve,
> >
> > I've noticed today that 1.12.3 tag was pushed for current 1.12 branch:
> >
> > commit 710f98844ae30416bdf6a01b655df398b49574ec (tag: yocto-5.2.3,
> > tag: 2025-04.3-walnascar, tag: 2.12.3, origin/2.12, oe/2.12,
> > github/2.12, github.oe/2.12, 2.12)
> > Author: Richard Purdie <richard.purdie@linuxfoundation.org>
> > Date: Tue Jul 29 16:42:25 2025 -0400
> >
> > utils: Optimise signal/sigmask performance
> >
> > Should I redo this as 2.12.4 and adjust the related change for oe-core
> > to bump the minimal version to 2.12.4 as well?
> >
> > Similarly for scarthgap and 2.8 bitbake, which has 2.8.12 tag already,
> > so instead of 2.8.1 I would bump it to 2.8.13.
>
> Adding Richard since he is the bitbake maintainer.
>
> I'm not sure what has been done historically. We haven't been bumping
> the version with each minor release, but it seems to make sense to me
> to do the bump to 2.12.4 rather than 2.12.1
>
> Steve
>
> > commit 982645110a19ebb94d519926a4e14c8a2a205cfd (tag: yocto-5.0.12,
> > tag: 2024-04.12-scarthgap, tag: 2.8.12, origin/2.8, oe/2.8,
> > github/2.8, github.oe/2.8, 2.8)
> > Author: Richard Purdie <richard.purdie@linuxfoundation.org>
> > Date: Tue Jul 29 14:43:09 2025 -0400
> >
> > utils: Optimise signal/sigmask performance
> >
> > Regards,
> >
> > On Wed, Sep 10, 2025 at 5:55 PM Steve Sakoman via
> > lists.openembedded.org <steve=sakoman.com@lists.openembedded.org>
> > wrote:
> > >
> > > From: Martin Jansa <martin.jansa@gmail.com>
> > >
> > > To indicate compatibility with python 3.14
> > >
> > > [YOCTO #15858]
> > >
> > > Signed-off-by: Martin Jansa <martin.jansa@gmail.com>
> > > Signed-off-by: Steve Sakoman <steve@sakoman.com>
> > > ---
> > > bin/bitbake | 2 +-
> > > lib/bb/__init__.py | 2 +-
> > > 2 files changed, 2 insertions(+), 2 deletions(-)
> > >
> > > diff --git a/bin/bitbake b/bin/bitbake
> > > index 09cbb54e8..05b6ba742 100755
> > > --- a/bin/bitbake
> > > +++ b/bin/bitbake
> > > @@ -27,7 +27,7 @@ from bb.main import bitbake_main, BitBakeConfigParameters, BBMainException
> > >
> > > bb.utils.check_system_locale()
> > >
> > > -__version__ = "2.12.0"
> > > +__version__ = "2.12.1"
> > >
> > > if __name__ == "__main__":
> > > if __version__ != bb.__version__:
> > > diff --git a/lib/bb/__init__.py b/lib/bb/__init__.py
> > > index 605355e1a..eba7b8fdd 100644
> > > --- a/lib/bb/__init__.py
> > > +++ b/lib/bb/__init__.py
> > > @@ -9,7 +9,7 @@
> > > # SPDX-License-Identifier: GPL-2.0-only
> > > #
> > >
> > > -__version__ = "2.12.0"
> > > +__version__ = "2.12.1"
> > >
> > > import sys
> > > if sys.version_info < (3, 9, 0):
> > > --
> > > 2.43.0
> > >
> > >
> > > -=-=-=-=-=-=-=-=-=-=-=-
> > > Links: You receive all messages sent to this group.
> > > View/Reply Online (#17999): https://lists.openembedded.org/g/bitbake-devel/message/17999
> > > Mute This Topic: https://lists.openembedded.org/mt/115172226/3617156
> > > Group Owner: bitbake-devel+owner@lists.openembedded.org
> > > Unsubscribe: https://lists.openembedded.org/g/bitbake-devel/unsub [martin.jansa@gmail.com]
> > > -=-=-=-=-=-=-=-=-=-=-=-
> > >
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [bitbake-devel] [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1
2025-09-17 14:05 ` Martin Jansa
@ 2025-09-17 16:25 ` Steve Sakoman
2025-09-17 22:34 ` Richard Purdie
0 siblings, 1 reply; 10+ messages in thread
From: Steve Sakoman @ 2025-09-17 16:25 UTC (permalink / raw)
To: Martin Jansa; +Cc: Richard Purdie, bitbake-devel
On Wed, Sep 17, 2025 at 7:05 AM Martin Jansa <martin.jansa@gmail.com> wrote:
>
> I've sent the v2 of all 4 related changes to use 2.12.4 and 2.8.13.
>
> I've also noticed that the sanity check for bitbake version is
> executed too late after the utils.py is already failing with:
> ERROR: Unable to parse oe-core/meta/lib/oe/utils.py
> Traceback (most recent call last):
> File "oe-core/meta/lib/oe/utils.py", line 11, in <module>
> from bb import multiprocessing
> ImportError: cannot import name 'multiprocessing' from 'bb'
> (bitbake/lib/bb/__init__.py)
>
> To avoid this issue I recommend to leave "lib/oe/utils: use
> multiprocessing from bb" commit in oe-core scarthgap and walnascar for
> some future batch and now merge just the bitbake version bump in
> bitbake and the requirement for newer bitbake in oe-core, that way
> people will hopefully update both before it gets really mandatory.
I'll be doing the final walnascar build at the end of next week, so we
either need to have this sorted by early next week, or just decide to
leave things as they are with walnascar since it is going end of life.
I'll pull the patches from scarthgap till we sort the proper version
numbering and we can then stage them as you suggest.
Steve
> On Wed, Sep 17, 2025 at 3:57 PM Steve Sakoman <steve@sakoman.com> wrote:
> >
> > On Wed, Sep 17, 2025 at 12:27 AM Martin Jansa <martin.jansa@gmail.com> wrote:
> > >
> > > Hello Steve,
> > >
> > > I've noticed today that 1.12.3 tag was pushed for current 1.12 branch:
> > >
> > > commit 710f98844ae30416bdf6a01b655df398b49574ec (tag: yocto-5.2.3,
> > > tag: 2025-04.3-walnascar, tag: 2.12.3, origin/2.12, oe/2.12,
> > > github/2.12, github.oe/2.12, 2.12)
> > > Author: Richard Purdie <richard.purdie@linuxfoundation.org>
> > > Date: Tue Jul 29 16:42:25 2025 -0400
> > >
> > > utils: Optimise signal/sigmask performance
> > >
> > > Should I redo this as 2.12.4 and adjust the related change for oe-core
> > > to bump the minimal version to 2.12.4 as well?
> > >
> > > Similarly for scarthgap and 2.8 bitbake, which has 2.8.12 tag already,
> > > so instead of 2.8.1 I would bump it to 2.8.13.
> >
> > Adding Richard since he is the bitbake maintainer.
> >
> > I'm not sure what has been done historically. We haven't been bumping
> > the version with each minor release, but it seems to make sense to me
> > to do the bump to 2.12.4 rather than 2.12.1
> >
> > Steve
> >
> > > commit 982645110a19ebb94d519926a4e14c8a2a205cfd (tag: yocto-5.0.12,
> > > tag: 2024-04.12-scarthgap, tag: 2.8.12, origin/2.8, oe/2.8,
> > > github/2.8, github.oe/2.8, 2.8)
> > > Author: Richard Purdie <richard.purdie@linuxfoundation.org>
> > > Date: Tue Jul 29 14:43:09 2025 -0400
> > >
> > > utils: Optimise signal/sigmask performance
> > >
> > > Regards,
> > >
> > > On Wed, Sep 10, 2025 at 5:55 PM Steve Sakoman via
> > > lists.openembedded.org <steve=sakoman.com@lists.openembedded.org>
> > > wrote:
> > > >
> > > > From: Martin Jansa <martin.jansa@gmail.com>
> > > >
> > > > To indicate compatibility with python 3.14
> > > >
> > > > [YOCTO #15858]
> > > >
> > > > Signed-off-by: Martin Jansa <martin.jansa@gmail.com>
> > > > Signed-off-by: Steve Sakoman <steve@sakoman.com>
> > > > ---
> > > > bin/bitbake | 2 +-
> > > > lib/bb/__init__.py | 2 +-
> > > > 2 files changed, 2 insertions(+), 2 deletions(-)
> > > >
> > > > diff --git a/bin/bitbake b/bin/bitbake
> > > > index 09cbb54e8..05b6ba742 100755
> > > > --- a/bin/bitbake
> > > > +++ b/bin/bitbake
> > > > @@ -27,7 +27,7 @@ from bb.main import bitbake_main, BitBakeConfigParameters, BBMainException
> > > >
> > > > bb.utils.check_system_locale()
> > > >
> > > > -__version__ = "2.12.0"
> > > > +__version__ = "2.12.1"
> > > >
> > > > if __name__ == "__main__":
> > > > if __version__ != bb.__version__:
> > > > diff --git a/lib/bb/__init__.py b/lib/bb/__init__.py
> > > > index 605355e1a..eba7b8fdd 100644
> > > > --- a/lib/bb/__init__.py
> > > > +++ b/lib/bb/__init__.py
> > > > @@ -9,7 +9,7 @@
> > > > # SPDX-License-Identifier: GPL-2.0-only
> > > > #
> > > >
> > > > -__version__ = "2.12.0"
> > > > +__version__ = "2.12.1"
> > > >
> > > > import sys
> > > > if sys.version_info < (3, 9, 0):
> > > > --
> > > > 2.43.0
> > > >
> > > >
> > > > -=-=-=-=-=-=-=-=-=-=-=-
> > > > Links: You receive all messages sent to this group.
> > > > View/Reply Online (#17999): https://lists.openembedded.org/g/bitbake-devel/message/17999
> > > > Mute This Topic: https://lists.openembedded.org/mt/115172226/3617156
> > > > Group Owner: bitbake-devel+owner@lists.openembedded.org
> > > > Unsubscribe: https://lists.openembedded.org/g/bitbake-devel/unsub [martin.jansa@gmail.com]
> > > > -=-=-=-=-=-=-=-=-=-=-=-
> > > >
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [bitbake-devel] [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1
2025-09-17 7:27 ` [bitbake-devel] " Martin Jansa
2025-09-17 13:57 ` Steve Sakoman
@ 2025-09-17 22:24 ` Richard Purdie
1 sibling, 0 replies; 10+ messages in thread
From: Richard Purdie @ 2025-09-17 22:24 UTC (permalink / raw)
To: martin.jansa, steve; +Cc: bitbake-devel
On Wed, 2025-09-17 at 09:27 +0200, Martin Jansa via lists.openembedded.org wrote:
> Hello Steve,
>
> I've noticed today that 1.12.3 tag was pushed for current 1.12
> branch:
>
> commit 710f98844ae30416bdf6a01b655df398b49574ec (tag: yocto-5.2.3,
> tag: 2025-04.3-walnascar, tag: 2.12.3, origin/2.12, oe/2.12,
> github/2.12, github.oe/2.12, 2.12)
> Author: Richard Purdie <richard.purdie@linuxfoundation.org>
> Date: Tue Jul 29 16:42:25 2025 -0400
>
> utils: Optimise signal/sigmask performance
>
> Should I redo this as 2.12.4 and adjust the related change for oe-
> core
> to bump the minimal version to 2.12.4 as well?
>
> Similarly for scarthgap and 2.8 bitbake, which has 2.8.12 tag
> already,
> so instead of 2.8.1 I would bump it to 2.8.13.
Sorry about the delay.
Your patches are right and the tags are messed up. They're getting
cleaned up and I've merged the patches in the meantime.
Cheers,
Richard
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [bitbake-devel] [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1
2025-09-17 16:25 ` Steve Sakoman
@ 2025-09-17 22:34 ` Richard Purdie
2025-09-17 22:35 ` Steve Sakoman
0 siblings, 1 reply; 10+ messages in thread
From: Richard Purdie @ 2025-09-17 22:34 UTC (permalink / raw)
To: Steve Sakoman, Martin Jansa; +Cc: bitbake-devel
On Wed, 2025-09-17 at 09:25 -0700, Steve Sakoman wrote:
> On Wed, Sep 17, 2025 at 7:05 AM Martin Jansa <martin.jansa@gmail.com> wrote:
> >
> > I've sent the v2 of all 4 related changes to use 2.12.4 and 2.8.13.
> >
> > I've also noticed that the sanity check for bitbake version is
> > executed too late after the utils.py is already failing with:
> > ERROR: Unable to parse oe-core/meta/lib/oe/utils.py
> > Traceback (most recent call last):
> > File "oe-core/meta/lib/oe/utils.py", line 11, in <module>
> > from bb import multiprocessing
> > ImportError: cannot import name 'multiprocessing' from 'bb'
> > (bitbake/lib/bb/__init__.py)
> >
> > To avoid this issue I recommend to leave "lib/oe/utils: use
> > multiprocessing from bb" commit in oe-core scarthgap and walnascar for
> > some future batch and now merge just the bitbake version bump in
> > bitbake and the requirement for newer bitbake in oe-core, that way
> > people will hopefully update both before it gets really mandatory.
>
> I'll be doing the final walnascar build at the end of next week, so we
> either need to have this sorted by early next week, or just decide to
> leave things as they are with walnascar since it is going end of life.
>
> I'll pull the patches from scarthgap till we sort the proper version
> numbering and we can then stage them as you suggest.
I've pushed what I think makes sense, hopefully that gets things unblocked.
Cheers,
Richard
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [bitbake-devel] [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1
2025-09-17 22:34 ` Richard Purdie
@ 2025-09-17 22:35 ` Steve Sakoman
0 siblings, 0 replies; 10+ messages in thread
From: Steve Sakoman @ 2025-09-17 22:35 UTC (permalink / raw)
To: Richard Purdie; +Cc: Martin Jansa, bitbake-devel
On Wed, Sep 17, 2025 at 3:34 PM Richard Purdie
<richard.purdie@linuxfoundation.org> wrote:
>
> On Wed, 2025-09-17 at 09:25 -0700, Steve Sakoman wrote:
> > On Wed, Sep 17, 2025 at 7:05 AM Martin Jansa <martin.jansa@gmail.com> wrote:
> > >
> > > I've sent the v2 of all 4 related changes to use 2.12.4 and 2.8.13.
> > >
> > > I've also noticed that the sanity check for bitbake version is
> > > executed too late after the utils.py is already failing with:
> > > ERROR: Unable to parse oe-core/meta/lib/oe/utils.py
> > > Traceback (most recent call last):
> > > File "oe-core/meta/lib/oe/utils.py", line 11, in <module>
> > > from bb import multiprocessing
> > > ImportError: cannot import name 'multiprocessing' from 'bb'
> > > (bitbake/lib/bb/__init__.py)
> > >
> > > To avoid this issue I recommend to leave "lib/oe/utils: use
> > > multiprocessing from bb" commit in oe-core scarthgap and walnascar for
> > > some future batch and now merge just the bitbake version bump in
> > > bitbake and the requirement for newer bitbake in oe-core, that way
> > > people will hopefully update both before it gets really mandatory.
> >
> > I'll be doing the final walnascar build at the end of next week, so we
> > either need to have this sorted by early next week, or just decide to
> > leave things as they are with walnascar since it is going end of life.
> >
> > I'll pull the patches from scarthgap till we sort the proper version
> > numbering and we can then stage them as you suggest.
>
> I've pushed what I think makes sense, hopefully that gets things unblocked.
It does. Thanks!
Steve
>
> Cheers,
>
> Richard
^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2025-09-17 22:35 UTC | newest]
Thread overview: 10+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2025-09-10 15:55 [bitbake][walnascar][2.12][PATCH 0/2] Patch review Steve Sakoman
2025-09-10 15:55 ` [bitbake][walnascar][2.12][PATCH 1/2] Use a "fork" multiprocessing context Steve Sakoman
2025-09-10 15:55 ` [bitbake][walnascar][2.12][PATCH 2/2] bitbake: Bump version to 2.12.1 Steve Sakoman
2025-09-17 7:27 ` [bitbake-devel] " Martin Jansa
2025-09-17 13:57 ` Steve Sakoman
2025-09-17 14:05 ` Martin Jansa
2025-09-17 16:25 ` Steve Sakoman
2025-09-17 22:34 ` Richard Purdie
2025-09-17 22:35 ` Steve Sakoman
2025-09-17 22:24 ` Richard Purdie
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.