[OE-core][PATCH 00/20] python3: fix run-time dependencies

[OE-core][PATCH 00/20] python3: fix run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

I noticed that every now and then I import some python package into an
image only to find out the recipe didn't pull in all required run-time
dependencies. I would fix it whenever I noticed it but figured that I
could right a script that would go over all python packages, build a
minimal image and see that all its modules can be imported.

The patches in this series are the result of that. Most simply add
missing RDEPENDS, some are additional tweaks to recipes and the last
three add new standard library packages to the manifest. These are the
ones for which simply adding python3-misc would still be insufficient in
terms of run-time dependencies.

I plan to do the same for meta-python but this will take more time and I
need to think of some automated way of updating the recipes first.

Bartosz Golaszewski (20):
  python3-async: add missing run-time dependencies
  python3-attrs: unify RDEPENDS
  python3-attrs: don't use PYTHON_PN
  python3-attrs: add missing run-time dependencies
  python3-certifi: add missing run-time dependencies
  python3-libfdt: new package
  python3-dtschema: add missing run-time dependencies
  python3-hypothesis: fix run-time dependencies
  python3-tomli: add missing run-time dependencies
  python3-pathspec: add missing run-time dependencies
  python3-installer: add missing run-time dependencies
  python3-sphinx-rtd-theme: add missing run-time dependencies
  python3-setuptools-rust: fix RDEPENDS and allow target build
  python3-pyproject-hooks: add missing run-time dependencies
  python3-pycryptodome: don't use PYTHON_PN
  python3-pycryptodome: add missing run-time dependencies
  python3-pygobject: add missing run-time dependencies
  python3-manifest: cgitb: new package
  python3-manifest: zipapp: new package
  python3-manifest: turtle: new package

 meta/recipes-devtools/python/python-async.inc |  5 ++-
 .../python/python-pycryptodome.inc            |  8 ++--
 .../python/python3-attrs_23.1.0.bb            | 15 +++----
 .../python/python3-certifi_2022.12.7.bb       |  2 +
 .../python/python3-dtschema_2023.4.bb         |  7 +++-
 .../python/python3-hypothesis_6.71.0.bb       |  2 +-
 .../python/python3-installer_0.7.0.bb         |  6 +++
 .../python/python3-libfdt_1.7.0.post1.bb      | 20 +++++++++
 .../python/python3-pathspec_0.11.1.bb         |  2 +
 .../python/python3-pygobject_3.44.1.bb        |  5 ++-
 .../python/python3-pyproject-hooks_1.0.0.bb   |  5 ++-
 .../python/python3-setuptools-rust_1.5.2.bb   | 17 ++++----
 .../python/python3-sphinx-rtd-theme_1.2.0.bb  |  5 ++-
 .../python/python3-tomli_2.0.1.bb             |  5 +++
 .../python/python3/python3-manifest.json      | 42 +++++++++++++++++++
 15 files changed, 121 insertions(+), 25 deletions(-)
 create mode 100644 meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb

-- 
2.39.2

[OE-core][PATCH 01/20] python3-async: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python-async.inc | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/python/python-async.inc b/meta/recipes-devtools/python/python-async.inc
index fde864601c..53f8d79361 100644
--- a/meta/recipes-devtools/python/python-async.inc
+++ b/meta/recipes-devtools/python/python-async.inc
@@ -9,6 +9,9 @@ inherit pypi
 SRC_URI[md5sum] = "9b06b5997de2154f3bc0273f80bcef6b"
 SRC_URI[sha256sum] = "ac6894d876e45878faae493b0cf61d0e28ec417334448ac0a6ea2229d8343051"
 
-RDEPENDS:${PN} += "${PYTHON_PN}-threading"
+RDEPENDS:${PN} += " \
+    python3-logging \
+    python3-threading \
+"
 
 BBCLASSEXTEND = "native nativesdk"
-- 
2.39.2

Re: [OE-core][PATCH 01/20] python3-async: add missing run-time dependencies

[Trevor Gamblin]

On 2023-05-17 04:06, Bartosz Golaszewski wrote:
> From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
>
> Add missing RDEPENDS for this package.
>
> Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
> ---
>   meta/recipes-devtools/python/python-async.inc | 5 ++++-
>   1 file changed, 4 insertions(+), 1 deletion(-)
>
> diff --git a/meta/recipes-devtools/python/python-async.inc b/meta/recipes-devtools/python/python-async.inc
> index fde864601c..53f8d79361 100644
> --- a/meta/recipes-devtools/python/python-async.inc
> +++ b/meta/recipes-devtools/python/python-async.inc
> @@ -9,6 +9,9 @@ inherit pypi
>   SRC_URI[md5sum] = "9b06b5997de2154f3bc0273f80bcef6b"
>   SRC_URI[sha256sum] = "ac6894d876e45878faae493b0cf61d0e28ec417334448ac0a6ea2229d8343051"
>   
> -RDEPENDS:${PN} += "${PYTHON_PN}-threading"
> +RDEPENDS:${PN} += " \
> +    python3-logging \
> +    python3-threading \
> +"
>   
>   BBCLASSEXTEND = "native nativesdk"

This is an OK change, but the recipe should arguably be removed from 
oe-core instead, given that it 1) hasn't been updated in 9 years and has 
been abandoned in favor of alternatives by the maintainer, and 2) 
doesn't appear to be a dependency for anything else in oe-core or 
meta-openembedded.

- Trevor

>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#181450): https://lists.openembedded.org/g/openembedded-core/message/181450
> Mute This Topic: https://lists.openembedded.org/mt/98943997/7611679
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [tgamblin@baylibre.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>

Re: [OE-core][PATCH 01/20] python3-async: add missing run-time dependencies

[Bartosz Golaszewski]

On Wed, May 17, 2023 at 6:15 PM Trevor Gamblin <tgamblin@baylibre.com> wrote:
>
>
> On 2023-05-17 04:06, Bartosz Golaszewski wrote:
> > From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
> >
> > Add missing RDEPENDS for this package.
> >
> > Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
> > ---
> >   meta/recipes-devtools/python/python-async.inc | 5 ++++-
> >   1 file changed, 4 insertions(+), 1 deletion(-)
> >
> > diff --git a/meta/recipes-devtools/python/python-async.inc b/meta/recipes-devtools/python/python-async.inc
> > index fde864601c..53f8d79361 100644
> > --- a/meta/recipes-devtools/python/python-async.inc
> > +++ b/meta/recipes-devtools/python/python-async.inc
> > @@ -9,6 +9,9 @@ inherit pypi
> >   SRC_URI[md5sum] = "9b06b5997de2154f3bc0273f80bcef6b"
> >   SRC_URI[sha256sum] = "ac6894d876e45878faae493b0cf61d0e28ec417334448ac0a6ea2229d8343051"
> >
> > -RDEPENDS:${PN} += "${PYTHON_PN}-threading"
> > +RDEPENDS:${PN} += " \
> > +    python3-logging \
> > +    python3-threading \
> > +"
> >
> >   BBCLASSEXTEND = "native nativesdk"
>
> This is an OK change, but the recipe should arguably be removed from
> oe-core instead, given that it 1) hasn't been updated in 9 years and has
> been abandoned in favor of alternatives by the maintainer, and 2)
> doesn't appear to be a dependency for anything else in oe-core or
> meta-openembedded.
>
> - Trevor
>

I admit I didn't really pay attention to how well maintained the
packages are, just fixed their run-time dependencies. I have nothing
against removing this. This is precisely why I split the series into
individual patches - some may be skipped while others go upstream.

Bart

[OE-core][PATCH 02/20] python3-attrs: unify RDEPENDS

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

The nativesdk and target RDEPENDS are the same and there's nothing that
prohibits this package from build built for the native sysroot either.
Use the global RDEPENDS instead of per-class assignments.

While at it: order the dependencies alphabetically.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python3-attrs_23.1.0.bb | 6 +-----
 1 file changed, 1 insertion(+), 5 deletions(-)

diff --git a/meta/recipes-devtools/python/python3-attrs_23.1.0.bb b/meta/recipes-devtools/python/python3-attrs_23.1.0.bb
index c8e2e514a4..207636d62e 100644
--- a/meta/recipes-devtools/python/python3-attrs_23.1.0.bb
+++ b/meta/recipes-devtools/python/python3-attrs_23.1.0.bb
@@ -12,13 +12,9 @@ DEPENDS += " \
     ${PYTHON_PN}-hatch-fancy-pypi-readme-native \
 "
 
-RDEPENDS:${PN}:class-target += " \
-    ${PYTHON_PN}-crypt \
+RDEPENDS:${PN}+= " \
     ${PYTHON_PN}-ctypes \
-"
-RDEPENDS:${PN}:class-nativesdk += " \
     ${PYTHON_PN}-crypt \
-    ${PYTHON_PN}-ctypes \
 "
 
 BBCLASSEXTEND = "native nativesdk"
-- 
2.39.2

[OE-core][PATCH 03/20] python3-attrs: don't use PYTHON_PN

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

We no longer support python2. Drop PYTHON_PN and use python3 explicitly.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python3-attrs_23.1.0.bb | 8 ++++----
 1 file changed, 4 insertions(+), 4 deletions(-)

diff --git a/meta/recipes-devtools/python/python3-attrs_23.1.0.bb b/meta/recipes-devtools/python/python3-attrs_23.1.0.bb
index 207636d62e..ab3a08073d 100644
--- a/meta/recipes-devtools/python/python3-attrs_23.1.0.bb
+++ b/meta/recipes-devtools/python/python3-attrs_23.1.0.bb
@@ -8,13 +8,13 @@ SRC_URI[sha256sum] = "6279836d581513a26f1bf235f9acd333bc9115683f14f7e8fae46c98fc
 inherit pypi python_hatchling
 
 DEPENDS += " \
-    ${PYTHON_PN}-hatch-vcs-native \
-    ${PYTHON_PN}-hatch-fancy-pypi-readme-native \
+    python3-hatch-vcs-native \
+    python3-hatch-fancy-pypi-readme-native \
 "
 
 RDEPENDS:${PN}+= " \
-    ${PYTHON_PN}-ctypes \
-    ${PYTHON_PN}-crypt \
+    python3-ctypes \
+    python3-crypt \
 "
 
 BBCLASSEXTEND = "native nativesdk"
-- 
2.39.2

[OE-core][PATCH 04/20] python3-attrs: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python3-attrs_23.1.0.bb | 1 +
 1 file changed, 1 insertion(+)

diff --git a/meta/recipes-devtools/python/python3-attrs_23.1.0.bb b/meta/recipes-devtools/python/python3-attrs_23.1.0.bb
index ab3a08073d..314053de08 100644
--- a/meta/recipes-devtools/python/python3-attrs_23.1.0.bb
+++ b/meta/recipes-devtools/python/python3-attrs_23.1.0.bb
@@ -13,6 +13,7 @@ DEPENDS += " \
 "
 
 RDEPENDS:${PN}+= " \
+    python3-compression \
     python3-ctypes \
     python3-crypt \
 "
-- 
2.39.2

[OE-core][PATCH 05/20] python3-certifi: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python3-certifi_2022.12.7.bb | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/meta/recipes-devtools/python/python3-certifi_2022.12.7.bb b/meta/recipes-devtools/python/python3-certifi_2022.12.7.bb
index dca3d26811..b2e3ec125a 100644
--- a/meta/recipes-devtools/python/python3-certifi_2022.12.7.bb
+++ b/meta/recipes-devtools/python/python3-certifi_2022.12.7.bb
@@ -12,3 +12,5 @@ SRC_URI[sha256sum] = "35824b4c3a97115964b408844d64aa14db1cc518f6562e8d7261699d13
 inherit pypi setuptools3
 
 BBCLASSEXTEND = "native nativesdk"
+
+RDEPENDS:${PN} += "python3-io"
-- 
2.39.2

[OE-core][PATCH 06/20] python3-libfdt: new package

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add a recipe for python bindings for libfdt (spun out of upstream dtc)
fetched from pypi.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 .../python/python3-libfdt_1.7.0.post1.bb      | 20 +++++++++++++++++++
 1 file changed, 20 insertions(+)
 create mode 100644 meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb

diff --git a/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb b/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
new file mode 100644
index 0000000000..1ff3decbb9
--- /dev/null
+++ b/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
@@ -0,0 +1,20 @@
+SUMMARY = "Python bindings for libfdt."
+LICENSE = "GPL-2.0-only | BSD-2-Clause"
+LIC_FILES_CHKSUM = " \
+    file://BSD-2-Clause;md5=5d6306d1b08f8df623178dfd81880927 \
+    file://GPL;md5=b234ee4d69f5fce4486a80fdaf4a4263 \
+"
+
+inherit pypi setuptools3
+
+PYPI_PACKAGE = "pylibfdt"
+
+SRC_URI[sha256sum] = "2d048f9f8ce9a0527d497f423dea1f1135f9811c05b009cc5d5753771c1f9ba1"
+
+BBCLASSEXTEND = "native nativesdk"
+
+DEPENDS += " \
+    python3-pip-native \
+    python3-setuptools-scm-native \
+    swig-native \
+"
-- 
2.39.2

Re: [OE-core][PATCH 06/20] python3-libfdt: new package

[Trevor Gamblin]

On 2023-05-17 04:06, Bartosz Golaszewski wrote:
> From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
>
> Add a recipe for python bindings for libfdt (spun out of upstream dtc)
> fetched from pypi.
>
> Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
> ---
>   .../python/python3-libfdt_1.7.0.post1.bb      | 20 +++++++++++++++++++
>   1 file changed, 20 insertions(+)
>   create mode 100644 meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
>
> diff --git a/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb b/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
> new file mode 100644
> index 0000000000..1ff3decbb9
> --- /dev/null
> +++ b/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
> @@ -0,0 +1,20 @@
> +SUMMARY = "Python bindings for libfdt."
> +LICENSE = "GPL-2.0-only | BSD-2-Clause"
> +LIC_FILES_CHKSUM = " \
> +    file://BSD-2-Clause;md5=5d6306d1b08f8df623178dfd81880927 \
> +    file://GPL;md5=b234ee4d69f5fce4486a80fdaf4a4263 \
> +"
> +
> +inherit pypi setuptools3
> +
> +PYPI_PACKAGE = "pylibfdt"
> +
> +SRC_URI[sha256sum] = "2d048f9f8ce9a0527d497f423dea1f1135f9811c05b009cc5d5753771c1f9ba1"
> +
> +BBCLASSEXTEND = "native nativesdk"
> +
> +DEPENDS += " \
> +    python3-pip-native \
> +    python3-setuptools-scm-native \
> +    swig-native \
> +"
Can you also add this recipe to the 
meta/conf/distro/include/maintainers.inc file?
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#181455): https://lists.openembedded.org/g/openembedded-core/message/181455
> Mute This Topic: https://lists.openembedded.org/mt/98944002/7611679
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [tgamblin@baylibre.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>

Re: [OE-core][PATCH 06/20] python3-libfdt: new package

[Alexandre Belloni]

On 17/05/2023 12:16:21-0400, Trevor Gamblin wrote:
> 
> On 2023-05-17 04:06, Bartosz Golaszewski wrote:
> > From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
> > 
> > Add a recipe for python bindings for libfdt (spun out of upstream dtc)
> > fetched from pypi.
> > 
> > Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
> > ---
> >   .../python/python3-libfdt_1.7.0.post1.bb      | 20 +++++++++++++++++++
> >   1 file changed, 20 insertions(+)
> >   create mode 100644 meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
> > 
> > diff --git a/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb b/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
> > new file mode 100644
> > index 0000000000..1ff3decbb9
> > --- /dev/null
> > +++ b/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
> > @@ -0,0 +1,20 @@
> > +SUMMARY = "Python bindings for libfdt."
> > +LICENSE = "GPL-2.0-only | BSD-2-Clause"
> > +LIC_FILES_CHKSUM = " \
> > +    file://BSD-2-Clause;md5=5d6306d1b08f8df623178dfd81880927 \
> > +    file://GPL;md5=b234ee4d69f5fce4486a80fdaf4a4263 \
> > +"
> > +
> > +inherit pypi setuptools3
> > +
> > +PYPI_PACKAGE = "pylibfdt"
> > +
> > +SRC_URI[sha256sum] = "2d048f9f8ce9a0527d497f423dea1f1135f9811c05b009cc5d5753771c1f9ba1"
> > +
> > +BBCLASSEXTEND = "native nativesdk"
> > +
> > +DEPENDS += " \
> > +    python3-pip-native \
> > +    python3-setuptools-scm-native \
> > +    swig-native \
> > +"
> Can you also add this recipe to the meta/conf/distro/include/maintainers.inc
> file?

As stated, this fails on the autobuilders:

The following recipes do not have a maintainer assigned to them. Please add an entry to meta/conf/distro/include/maintainers.inc file.
python3-libfdt (/home/pokybuild/yocto-worker/oe-selftest-ubuntu/build/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb)

I also got this:

stdio: WARNING: python3-libfdt-1.7.0.post1-r0 do_fetch: QA Issue: Recipe python3-libfdt in /home/pokybuild/yocto-worker/a-full/build/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb does not contain a HOMEPAGE. Please add an entry. [missing-metadata]
stdio: WARNING: python3-libfdt-1.7.0.post1-r0 do_fetch: QA Issue: Recipe python3-libfdt in /home/pokybuild/yocto-worker/a-full/build/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb does not have an assigned maintainer. Please add an entry into meta/conf/distro/include/maintainers.inc. [missing-metadata]
stdio: WARNING: python3-libfdt-native-1.7.0.post1-r0 do_fetch: QA Issue: Recipe python3-libfdt in /home/pokybuild/yocto-worker/a-full/build/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb does not contain a HOMEPAGE. Please add an entry. [missing-metadata]
stdio: WARNING: nativesdk-python3-libfdt-1.7.0.post1-r0 do_fetch: QA Issue: Recipe python3-libfdt in /home/pokybuild/yocto-worker/a-full/build/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb does not contain a HOMEPAGE. Please add an entry. [missing-metadata]

-- 
Alexandre Belloni, co-owner and COO, Bootlin
Embedded Linux and Kernel engineering
https://bootlin.com

Re: [OE-core][PATCH 06/20] python3-libfdt: new package

[Bruce Ashfield]

I'm not sure if you saw the old threads on this, but we went through this
binding in detail in february:

See the series from TrevorW:

[PATCH v3 1/4] dtc: version bump and add python wrapper

The pypi releases of libfdt bindings are not kept in sync with the dtc
releases and rarely update. Not that they change a lot, but that is
still the case.

The suggestion for the bindings is the same, they'd be better of built
from dtc, versus using pypi.

There may be some issues remaining with the build, as Trevor hasn't
updated his series in a while now.

Bruce


On Wed, May 17, 2023 at 4:06 AM Bartosz Golaszewski <brgl@bgdev.pl> wrote:
>
> From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
>
> Add a recipe for python bindings for libfdt (spun out of upstream dtc)
> fetched from pypi.
>
> Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
> ---
>  .../python/python3-libfdt_1.7.0.post1.bb      | 20 +++++++++++++++++++
>  1 file changed, 20 insertions(+)
>  create mode 100644 meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
>
> diff --git a/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb b/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
> new file mode 100644
> index 0000000000..1ff3decbb9
> --- /dev/null
> +++ b/meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
> @@ -0,0 +1,20 @@
> +SUMMARY = "Python bindings for libfdt."
> +LICENSE = "GPL-2.0-only | BSD-2-Clause"
> +LIC_FILES_CHKSUM = " \
> +    file://BSD-2-Clause;md5=5d6306d1b08f8df623178dfd81880927 \
> +    file://GPL;md5=b234ee4d69f5fce4486a80fdaf4a4263 \
> +"
> +
> +inherit pypi setuptools3
> +
> +PYPI_PACKAGE = "pylibfdt"
> +
> +SRC_URI[sha256sum] = "2d048f9f8ce9a0527d497f423dea1f1135f9811c05b009cc5d5753771c1f9ba1"
> +
> +BBCLASSEXTEND = "native nativesdk"
> +
> +DEPENDS += " \
> +    python3-pip-native \
> +    python3-setuptools-scm-native \
> +    swig-native \
> +"
> --
> 2.39.2
>


--
- Thou shalt not follow the NULL pointer, for chaos and madness await
thee at its end
- "Use the force Harry" - Gandalf, Star Trek II

Re: [OE-core][PATCH 06/20] python3-libfdt: new package

[Ross Burton]

> On 17 May 2023, at 17:32, Bruce Ashfield via lists.openembedded.org <bruce.ashfield=gmail.com@lists.openembedded.org> wrote:
> 
> I'm not sure if you saw the old threads on this, but we went through this
> binding in detail in february:
> 
> See the series from TrevorW:
> 
> [PATCH v3 1/4] dtc: version bump and add python wrapper
> 
> The pypi releases of libfdt bindings are not kept in sync with the dtc
> releases and rarely update. Not that they change a lot, but that is
> still the case.
> 
> The suggestion for the bindings is the same, they'd be better of built
> from dtc, versus using pypi.
> 
> There may be some issues remaining with the build, as Trevor hasn't
> updated his series in a while now.

Agreed - that series needs to be resurrected as it’s the canonical source of the bindings.

Ross

Re: [OE-core][PATCH 06/20] python3-libfdt: new package

[Bartosz Golaszewski]

On Thu, May 18, 2023 at 6:56 PM Ross Burton <ross.burton@arm.com> wrote:
>
>
>
> > On 17 May 2023, at 17:32, Bruce Ashfield via lists.openembedded.org <bruce.ashfield=gmail.com@lists.openembedded.org> wrote:
> >
> > I'm not sure if you saw the old threads on this, but we went through this
> > binding in detail in february:
> >
> > See the series from TrevorW:
> >
> > [PATCH v3 1/4] dtc: version bump and add python wrapper
> >
> > The pypi releases of libfdt bindings are not kept in sync with the dtc
> > releases and rarely update. Not that they change a lot, but that is
> > still the case.
> >
> > The suggestion for the bindings is the same, they'd be better of built
> > from dtc, versus using pypi.
> >
> > There may be some issues remaining with the build, as Trevor hasn't
> > updated his series in a while now.
>
> Agreed - that series needs to be resurrected as it’s the canonical source of the bindings.
>
> Ross
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#181527): https://lists.openembedded.org/g/openembedded-core/message/181527
> Mute This Topic: https://lists.openembedded.org/mt/98944002/3618139
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [brgl@bgdev.pl]
> -=-=-=-=-=-=-=-=-=-=-=-
>

In this case I propose to just drop patches 06/20 and 07/20 from this
series for now when applying.

Bart

[OE-core][PATCH 07/20] python3-dtschema: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python3-dtschema_2023.4.bb | 7 ++++++-
 1 file changed, 6 insertions(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/python/python3-dtschema_2023.4.bb b/meta/recipes-devtools/python/python3-dtschema_2023.4.bb
index f87563facd..e5a18b0649 100644
--- a/meta/recipes-devtools/python/python3-dtschema_2023.4.bb
+++ b/meta/recipes-devtools/python/python3-dtschema_2023.4.bb
@@ -10,6 +10,11 @@ PYPI_PACKAGE = "dtschema"
 SRC_URI[sha256sum] = "6daefb8f54403b4d82961b3346571200571747ab01950fd36c1f69950fa7a8cf"
 
 DEPENDS += "python3-setuptools-scm-native"
-RDEPENDS:${PN} += "python3-ruamel-yaml python3-jsonschema python3-rfc3987"
+RDEPENDS:${PN} += " \
+    python3-jsonschema \
+    python3-libfdt \
+    python3-rfc3987 \
+    python3-ruamel-yaml \
+"
 
 BBCLASSEXTEND = "native nativesdk"
-- 
2.39.2

[OE-core][PATCH 08/20] python3-hypothesis: fix run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

The main hypothesis module depends on pytest already so move it to
global RDEPENDS from ptest-specific ones.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python3-hypothesis_6.71.0.bb | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/python/python3-hypothesis_6.71.0.bb b/meta/recipes-devtools/python/python3-hypothesis_6.71.0.bb
index 8ec885fabf..15f4090c6d 100644
--- a/meta/recipes-devtools/python/python3-hypothesis_6.71.0.bb
+++ b/meta/recipes-devtools/python/python3-hypothesis_6.71.0.bb
@@ -20,13 +20,13 @@ RDEPENDS:${PN} += " \
     python3-compression \
     python3-core \
     python3-json \
+    python3-pytest \
     python3-sortedcontainers \
     python3-statistics \
     python3-unittest \
     "
 
 RDEPENDS:${PN}-ptest += " \
-    ${PYTHON_PN}-pytest \
     ${PYTHON_PN}-unittest-automake-output \
     "
 
-- 
2.39.2

[OE-core][PATCH 09/20] python3-tomli: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python3-tomli_2.0.1.bb | 5 +++++
 1 file changed, 5 insertions(+)

diff --git a/meta/recipes-devtools/python/python3-tomli_2.0.1.bb b/meta/recipes-devtools/python/python3-tomli_2.0.1.bb
index 6118a6a9c3..9401ed897f 100644
--- a/meta/recipes-devtools/python/python3-tomli_2.0.1.bb
+++ b/meta/recipes-devtools/python/python3-tomli_2.0.1.bb
@@ -11,3 +11,8 @@ inherit pypi python_flit_core
 SRC_URI[sha256sum] = "de526c12914f0c550d15924c62d72abc48d6fe7364aa87328337a31007fe8a4f"
 
 BBCLASSEXTEND = "native nativesdk"
+
+RDEPENDS:${PN} += " \
+    python3-datetime \
+    python3-stringold \
+"
-- 
2.39.2

[OE-core][PATCH 10/20] python3-pathspec: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python3-pathspec_0.11.1.bb | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/meta/recipes-devtools/python/python3-pathspec_0.11.1.bb b/meta/recipes-devtools/python/python3-pathspec_0.11.1.bb
index f49bf080e9..79f03da984 100644
--- a/meta/recipes-devtools/python/python3-pathspec_0.11.1.bb
+++ b/meta/recipes-devtools/python/python3-pathspec_0.11.1.bb
@@ -9,3 +9,5 @@ SRC_URI[sha256sum] = "2798de800fa92780e33acca925945e9a19a133b715067cf165b8866c15
 inherit pypi setuptools3
 
 BBCLASSEXTEND = "native nativesdk"
+
+RDEPENDS:${PN} += "python3-profile"
-- 
2.39.2

[OE-core][PATCH 11/20] python3-installer: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python3-installer_0.7.0.bb | 6 ++++++
 1 file changed, 6 insertions(+)

diff --git a/meta/recipes-devtools/python/python3-installer_0.7.0.bb b/meta/recipes-devtools/python/python3-installer_0.7.0.bb
index d7f1e79a5c..9429705b1f 100644
--- a/meta/recipes-devtools/python/python3-installer_0.7.0.bb
+++ b/meta/recipes-devtools/python/python3-installer_0.7.0.bb
@@ -15,6 +15,12 @@ inherit pypi python_flit_core
 # Bootstrap the native build
 DEPENDS:remove:class-native = "python3-build-native python3-installer-native"
 
+RDEPENDS:${PN} += " \
+    python3-compile \
+    python3-compression \
+    python3-netclient \
+"
+
 INSTALL_WHEEL_COMPILE_BYTECODE:class-native = "--no-compile-bytecode"
 
 do_compile:class-native () {
-- 
2.39.2

[OE-core][PATCH 12/20] python3-sphinx-rtd-theme: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Remove DEPENDS as this package doesn't really have any.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 .../python/python3-sphinx-rtd-theme_1.2.0.bb                 | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/python/python3-sphinx-rtd-theme_1.2.0.bb b/meta/recipes-devtools/python/python3-sphinx-rtd-theme_1.2.0.bb
index e8a422b2e7..d9cd18e0ed 100644
--- a/meta/recipes-devtools/python/python3-sphinx-rtd-theme_1.2.0.bb
+++ b/meta/recipes-devtools/python/python3-sphinx-rtd-theme_1.2.0.bb
@@ -6,7 +6,10 @@ LIC_FILES_CHKSUM = "file://LICENSE;md5=a1db7d4ef426c2935227264e1d4ae8f9 \
                     file://OFL-License.txt;md5=4534c22e0147eadb6828bd9fe86d4868 \
                     file://Apache-License-2.0.txt;md5=8a75796f0ef19c3f601d69857f5a9a5b"
 
-DEPENDS = "python3-sphinx"
+RDEPENDS:${PN} += " \
+    python3-compile \
+    python3-sphinx \
+"
 
 PYPI_PACKAGE = "sphinx_rtd_theme"
 
-- 
2.39.2

[OE-core][PATCH 13/20] python3-setuptools-rust: fix RDEPENDS and allow target build

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Cargo and rustc can now be built for the target architecture. There's no
reason to limit the setuptools rust extensions to native build only so
make the RDEPENDS global. Also: add the missing ones.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 .../python/python3-setuptools-rust_1.5.2.bb     | 17 ++++++++++-------
 1 file changed, 10 insertions(+), 7 deletions(-)

diff --git a/meta/recipes-devtools/python/python3-setuptools-rust_1.5.2.bb b/meta/recipes-devtools/python/python3-setuptools-rust_1.5.2.bb
index 502967fd20..01e29cc6d8 100644
--- a/meta/recipes-devtools/python/python3-setuptools-rust_1.5.2.bb
+++ b/meta/recipes-devtools/python/python3-setuptools-rust_1.5.2.bb
@@ -18,13 +18,16 @@ inherit cargo pypi python_setuptools_build_meta
 
 DEPENDS += "python3-setuptools-scm-native python3-wheel-native"
 
-RDEPENDS:${PN}:class-native += " \
-    python3-semantic-version-native \
-    python3-setuptools-native \
-    python3-setuptools-scm-native \
-    python3-toml-native \
-    python3-typing-extensions-native \
-    python3-wheel-native \
+RDEPENDS:${PN} += " \
+    python3-distutils \
+    python3-json \
+    python3-semantic-version \
+    python3-setuptools \
+    python3-setuptools-scm \
+    python3-shell \
+    python3-toml \
+    python3-typing-extensions \
+    python3-wheel \
 "
 
 BBCLASSEXTEND = "native"
-- 
2.39.2

[OE-core][PATCH 14/20] python3-pyproject-hooks: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 .../recipes-devtools/python/python3-pyproject-hooks_1.0.0.bb | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/python/python3-pyproject-hooks_1.0.0.bb b/meta/recipes-devtools/python/python3-pyproject-hooks_1.0.0.bb
index e3893d51cb..c3f1fb75ed 100644
--- a/meta/recipes-devtools/python/python3-pyproject-hooks_1.0.0.bb
+++ b/meta/recipes-devtools/python/python3-pyproject-hooks_1.0.0.bb
@@ -14,7 +14,10 @@ BBCLASSEXTEND = "native nativesdk"
 # Bootstrap the native build
 DEPENDS:remove:class-native = "python3-build-native"
 
-RDEPENDS:${PN} += "python3-json"
+RDEPENDS:${PN} += " \
+    python3-io \
+    python3-json \
+"
 
 do_compile:class-native () {
     python_flit_core_do_manual_build
-- 
2.39.2

[OE-core][PATCH 15/20] python3-pycryptodome: don't use PYTHON_PN

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

We no longer support python2. Drop PYTHON_PN and use python3 explicitly.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python-pycryptodome.inc | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/meta/recipes-devtools/python/python-pycryptodome.inc b/meta/recipes-devtools/python/python-pycryptodome.inc
index 29fe80d224..86d7f261af 100644
--- a/meta/recipes-devtools/python/python-pycryptodome.inc
+++ b/meta/recipes-devtools/python/python-pycryptodome.inc
@@ -10,12 +10,12 @@ inherit pypi
 PYPI_PACKAGE_EXT = "tar.gz"
 
 RDEPENDS:${PN} += " \
-    ${PYTHON_PN}-io \
-    ${PYTHON_PN}-math \
+    python3-io \
+    python3-math \
 "
 
 RDEPENDS:${PN}-tests += " \
-    ${PYTHON_PN}-unittest \
+    python3-unittest \
 "
 
 PACKAGES =+ "${PN}-tests"
-- 
2.39.2

[OE-core][PATCH 16/20] python3-pycryptodome: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python-pycryptodome.inc | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/meta/recipes-devtools/python/python-pycryptodome.inc b/meta/recipes-devtools/python/python-pycryptodome.inc
index 86d7f261af..8d9b6d911e 100644
--- a/meta/recipes-devtools/python/python-pycryptodome.inc
+++ b/meta/recipes-devtools/python/python-pycryptodome.inc
@@ -10,6 +10,8 @@ inherit pypi
 PYPI_PACKAGE_EXT = "tar.gz"
 
 RDEPENDS:${PN} += " \
+    python3-cffi \
+    python3-ctypes \
     python3-io \
     python3-math \
 "
-- 
2.39.2

[OE-core][PATCH 17/20] python3-pygobject: add missing run-time dependencies

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Add missing RDEPENDS for this package.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 meta/recipes-devtools/python/python3-pygobject_3.44.1.bb | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/meta/recipes-devtools/python/python3-pygobject_3.44.1.bb b/meta/recipes-devtools/python/python3-pygobject_3.44.1.bb
index 8bfff43560..a5eecd33aa 100644
--- a/meta/recipes-devtools/python/python3-pygobject_3.44.1.bb
+++ b/meta/recipes-devtools/python/python3-pygobject_3.44.1.bb
@@ -24,7 +24,10 @@ S = "${WORKDIR}/${SRCNAME}-${PV}"
 
 PACKAGECONFIG ??= "${@bb.utils.contains_any('DISTRO_FEATURES', [ 'directfb', 'wayland', 'x11' ], 'cairo', '', d)}"
 
-RDEPENDS:${PN} += "python3-pkgutil"
+RDEPENDS:${PN} += " \
+    python3-io \
+    python3-pkgutil \
+"
 
 # python3-pycairo is checked on configuration -> DEPENDS
 # we don't link against python3-pycairo -> RDEPENDS
-- 
2.39.2

[OE-core][PATCH 18/20] python3-manifest: cgitb: new package

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Extend the manifest with definitions for the cgitb package from the
Python standard library. Currently this package cannot be imported at
run-time because python3-misc doesn't pull the required dependencies.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 .../python/python3/python3-manifest.json        | 17 +++++++++++++++++
 1 file changed, 17 insertions(+)

diff --git a/meta/recipes-devtools/python/python3/python3-manifest.json b/meta/recipes-devtools/python/python3/python3-manifest.json
index f278b18775..f60c83d76b 100644
--- a/meta/recipes-devtools/python/python3/python3-manifest.json
+++ b/meta/recipes-devtools/python/python3/python3-manifest.json
@@ -152,6 +152,23 @@
             "${libdir}/python${PYTHON_MAJMIN}/__pycache__/wave.*.pyc"
         ]
     },
+    "cgitb": {
+        "summary": "Special exception handler for Python scripts",
+        "rdepends": [
+            "core",
+            "crypt",
+            "html",
+            "io",
+            "math",
+            "pydoc"
+        ],
+        "files": [
+            "${libdir}/python${PYTHON_MAJMIN}/cgitb.py"
+        ],
+        "cached": [
+            "${libdir}/python${PYTHON_MAJMIN}/__pycache__/cgitb.*.pyc"
+        ]
+    },
     "codecs": {
         "summary": "Python codec",
         "rdepends": [
-- 
2.39.2

[OE-core][PATCH 19/20] python3-manifest: zipapp: new package

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Extend the manifest with definitions for the zipapp package from the
Python standard library. Currently this package cannot be imported at
run-time because python3-misc doesn't pull the required dependencies.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 .../python/python3/python3-manifest.json            | 13 +++++++++++++
 1 file changed, 13 insertions(+)

diff --git a/meta/recipes-devtools/python/python3/python3-manifest.json b/meta/recipes-devtools/python/python3/python3-manifest.json
index f60c83d76b..d368b162bd 100644
--- a/meta/recipes-devtools/python/python3/python3-manifest.json
+++ b/meta/recipes-devtools/python/python3/python3-manifest.json
@@ -1321,6 +1321,19 @@
         ],
         "cached": []
     },
+    "zipapp": {
+        "summary": "Tools to manage the creation of zip files containing Python code",
+        "rdepends": [
+            "compression",
+            "core"
+        ],
+        "files": [
+            "${libdir}/python${PYTHON_MAJMIN}/zipapp.py"
+        ],
+        "cached": [
+            "${libdir}/python${PYTHON_MAJMIN}/__pycache__/zipapp.*.pyc"
+        ]
+    },
     "zoneinfo": {
         "summary": "IANA time zone support",
         "rdepends": [
-- 
2.39.2

[OE-core][PATCH 20/20] python3-manifest: turtle: new package

[Bartosz Golaszewski]

From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>

Extend the manifest with definitions for the turtle package from the
Python standard library. Currently this package cannot be imported at
run-time because python3-misc doesn't pull the required dependencies.

Signed-off-by: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
---
 .../python/python3/python3-manifest.json             | 12 ++++++++++++
 1 file changed, 12 insertions(+)

diff --git a/meta/recipes-devtools/python/python3/python3-manifest.json b/meta/recipes-devtools/python/python3/python3-manifest.json
index d368b162bd..766f083ae4 100644
--- a/meta/recipes-devtools/python/python3/python3-manifest.json
+++ b/meta/recipes-devtools/python/python3/python3-manifest.json
@@ -1236,6 +1236,18 @@
             "${libdir}/python${PYTHON_MAJMIN}/tomllib/_parser.*.pyc"
         ]
     },
+    "turtle": {
+        "summary": "Turtle graphics is a popular way for introducing programming to kids.",
+        "rdepends": [
+            "tkinter"
+        ],
+        "files": [
+            "${libdir}/python${PYTHON_MAJMIN}/turtle.py"
+        ],
+        "cached": [
+            "${libdir}/python${PYTHON_MAJMIN}/__pycache__/turtle.*.pyc"
+        ]
+     },
     "unittest": {
         "summary": "Python unit testing framework",
         "rdepends": [
-- 
2.39.2

Re: [OE-core][PATCH 00/20] python3: fix run-time dependencies

[Alexander Kanavin]

Thanks for this work. Perhaps we could catch this easier if there are
runtime tests for those items, maybe in the shape of ptest.

Sometimes recipes have no longer needed dependencies too, and trimming
those down is harder, but also appreciated.

Alex

On Wed, 17 May 2023 at 10:06, Bartosz Golaszewski <brgl@bgdev.pl> wrote:
>
> From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
>
> I noticed that every now and then I import some python package into an
> image only to find out the recipe didn't pull in all required run-time
> dependencies. I would fix it whenever I noticed it but figured that I
> could right a script that would go over all python packages, build a
> minimal image and see that all its modules can be imported.
>
> The patches in this series are the result of that. Most simply add
> missing RDEPENDS, some are additional tweaks to recipes and the last
> three add new standard library packages to the manifest. These are the
> ones for which simply adding python3-misc would still be insufficient in
> terms of run-time dependencies.
>
> I plan to do the same for meta-python but this will take more time and I
> need to think of some automated way of updating the recipes first.
>
> Bartosz Golaszewski (20):
>   python3-async: add missing run-time dependencies
>   python3-attrs: unify RDEPENDS
>   python3-attrs: don't use PYTHON_PN
>   python3-attrs: add missing run-time dependencies
>   python3-certifi: add missing run-time dependencies
>   python3-libfdt: new package
>   python3-dtschema: add missing run-time dependencies
>   python3-hypothesis: fix run-time dependencies
>   python3-tomli: add missing run-time dependencies
>   python3-pathspec: add missing run-time dependencies
>   python3-installer: add missing run-time dependencies
>   python3-sphinx-rtd-theme: add missing run-time dependencies
>   python3-setuptools-rust: fix RDEPENDS and allow target build
>   python3-pyproject-hooks: add missing run-time dependencies
>   python3-pycryptodome: don't use PYTHON_PN
>   python3-pycryptodome: add missing run-time dependencies
>   python3-pygobject: add missing run-time dependencies
>   python3-manifest: cgitb: new package
>   python3-manifest: zipapp: new package
>   python3-manifest: turtle: new package
>
>  meta/recipes-devtools/python/python-async.inc |  5 ++-
>  .../python/python-pycryptodome.inc            |  8 ++--
>  .../python/python3-attrs_23.1.0.bb            | 15 +++----
>  .../python/python3-certifi_2022.12.7.bb       |  2 +
>  .../python/python3-dtschema_2023.4.bb         |  7 +++-
>  .../python/python3-hypothesis_6.71.0.bb       |  2 +-
>  .../python/python3-installer_0.7.0.bb         |  6 +++
>  .../python/python3-libfdt_1.7.0.post1.bb      | 20 +++++++++
>  .../python/python3-pathspec_0.11.1.bb         |  2 +
>  .../python/python3-pygobject_3.44.1.bb        |  5 ++-
>  .../python/python3-pyproject-hooks_1.0.0.bb   |  5 ++-
>  .../python/python3-setuptools-rust_1.5.2.bb   | 17 ++++----
>  .../python/python3-sphinx-rtd-theme_1.2.0.bb  |  5 ++-
>  .../python/python3-tomli_2.0.1.bb             |  5 +++
>  .../python/python3/python3-manifest.json      | 42 +++++++++++++++++++
>  15 files changed, 121 insertions(+), 25 deletions(-)
>  create mode 100644 meta/recipes-devtools/python/python3-libfdt_1.7.0.post1.bb
>
> --
> 2.39.2
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#181449): https://lists.openembedded.org/g/openembedded-core/message/181449
> Mute This Topic: https://lists.openembedded.org/mt/98943996/1686489
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [alex.kanavin@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>

Re: [OE-core][PATCH 00/20] python3: fix run-time dependencies

[Tim Orling]

[-- Attachment #1: Type: text/plain, Size: 4505 bytes --]

Thank you, Bartosz. I didn't review in great depth, but others have done
so. This series looks like a
step in the right direction.

On Wed, May 17, 2023 at 1:39 AM Alexander Kanavin <alex.kanavin@gmail.com>
wrote:

> Thanks for this work. Perhaps we could catch this easier if there are
> runtime tests for those items, maybe in the shape of ptest.
>
> Sometimes recipes have no longer needed dependencies too, and trimming
> those down is harder, but also appreciated.
>
> One challenge has been the additional dependencies that come in for
ptests. Another is that
many PyPi packages do not include their /tests/ directory, meaning we would
need to switch to
the git fetcher in many cases. My intent has always been "full" ptest
coverage, when practical.

Alex
>
> On Wed, 17 May 2023 at 10:06, Bartosz Golaszewski <brgl@bgdev.pl> wrote:
> >
> > From: Bartosz Golaszewski <bartosz.golaszewski@linaro.org>
> >
> > I noticed that every now and then I import some python package into an
> > image only to find out the recipe didn't pull in all required run-time
> > dependencies. I would fix it whenever I noticed it but figured that I
> > could right a script that would go over all python packages, build a
> > minimal image and see that all its modules can be imported.
> >
> > The patches in this series are the result of that. Most simply add
> > missing RDEPENDS, some are additional tweaks to recipes and the last
> > three add new standard library packages to the manifest. These are the
> > ones for which simply adding python3-misc would still be insufficient in
> > terms of run-time dependencies.
> >
> > I plan to do the same for meta-python but this will take more time and I
> > need to think of some automated way of updating the recipes first.
> >
> > Bartosz Golaszewski (20):
> >   python3-async: add missing run-time dependencies
> >   python3-attrs: unify RDEPENDS
> >   python3-attrs: don't use PYTHON_PN
> >   python3-attrs: add missing run-time dependencies
> >   python3-certifi: add missing run-time dependencies
> >   python3-libfdt: new package
> >   python3-dtschema: add missing run-time dependencies
> >   python3-hypothesis: fix run-time dependencies
> >   python3-tomli: add missing run-time dependencies
> >   python3-pathspec: add missing run-time dependencies
> >   python3-installer: add missing run-time dependencies
> >   python3-sphinx-rtd-theme: add missing run-time dependencies
> >   python3-setuptools-rust: fix RDEPENDS and allow target build
> >   python3-pyproject-hooks: add missing run-time dependencies
> >   python3-pycryptodome: don't use PYTHON_PN
> >   python3-pycryptodome: add missing run-time dependencies
> >   python3-pygobject: add missing run-time dependencies
> >   python3-manifest: cgitb: new package
> >   python3-manifest: zipapp: new package
> >   python3-manifest: turtle: new package
> >
> >  meta/recipes-devtools/python/python-async.inc |  5 ++-
> >  .../python/python-pycryptodome.inc            |  8 ++--
> >  .../python/python3-attrs_23.1.0.bb            | 15 +++----
> >  .../python/python3-certifi_2022.12.7.bb       |  2 +
> >  .../python/python3-dtschema_2023.4.bb         |  7 +++-
> >  .../python/python3-hypothesis_6.71.0.bb       |  2 +-
> >  .../python/python3-installer_0.7.0.bb         |  6 +++
> >  .../python/python3-libfdt_1.7.0.post1.bb      | 20 +++++++++
> >  .../python/python3-pathspec_0.11.1.bb         |  2 +
> >  .../python/python3-pygobject_3.44.1.bb        |  5 ++-
> >  .../python/python3-pyproject-hooks_1.0.0.bb   |  5 ++-
> >  .../python/python3-setuptools-rust_1.5.2.bb   | 17 ++++----
> >  .../python/python3-sphinx-rtd-theme_1.2.0.bb  |  5 ++-
> >  .../python/python3-tomli_2.0.1.bb             |  5 +++
> >  .../python/python3/python3-manifest.json      | 42 +++++++++++++++++++
> >  15 files changed, 121 insertions(+), 25 deletions(-)
> >  create mode 100644 meta/recipes-devtools/python/
> python3-libfdt_1.7.0.post1.bb
> >
> > --
> > 2.39.2
> >
> >
> >
> >
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#181479):
> https://lists.openembedded.org/g/openembedded-core/message/181479
> Mute This Topic: https://lists.openembedded.org/mt/98943996/924729
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [
> ticotimo@gmail.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>
>

[-- Attachment #2: Type: text/html, Size: 7135 bytes --]