Re: [OE-core][PATCH 0/6 v3] python3: upgrade 3.13.11 -> 3.14.2

[Trevor Gamblin <tgamblin@baylibre.com>]

I seem to have missed a module import issue this time around. Will send 
a response to this or a v4 depending on how complicated the fix becomes.

- Trevor

On 2026-01-09 10:06, Trevor Gamblin via lists.openembedded.org wrote:
> Compared to v2
> (https://lists.openembedded.org/g/openembedded-core/message/228232):
>
> - rebase on top of the 3.13.11 python3 recipe in master;
> - add a patch to include the _ast_unparse module in the core split, fixing some
>    import issues for annotationlib
>
> I've kept the original ptest, reproducibility, and buildall checks in the
> respective patches, but here is another set of runs for completeness:
>
> ptests:
>
> |== Tests result: SUCCESS ==
> |
> |28 tests skipped:
> |    test.test_asyncio.test_windows_events
> |    test.test_asyncio.test_windows_utils test.test_gdb.test_backtrace
> |    test.test_gdb.test_cfunction test.test_gdb.test_cfunction_full
> |    test.test_gdb.test_misc test.test_gdb.test_pretty_print
> |    test_android test_apple test_asdl_parser test_clinic test_devpoll
> |    test_free_threading test_generated_cases test_idle test_kqueue
> |    test_launcher test_msvcrt test_startfile test_tcl test_tkinter
> |    test_ttk test_ttk_textonly test_turtle test_winapi
> |    test_winconsoleio test_winreg test_wmi
> |
> |8 tests skipped (resource denied):
> |    test_curses test_peg_generator test_smtpnet test_socketserver
> |    test_urllib2net test_urllibnet test_winsound test_zipfile64
> |
> |455 tests OK.
> |
> |Total duration: 3 min 44 sec
> |Total tests: run=46,462 skipped=2,384
> |Total test files: run=483/491 skipped=28 resource_denied=8
> |Result: SUCCESS
> |DURATION: 224
> |END: /usr/lib/python3/ptest
> |2026-01-08T14:58
> |STOP: ptest-runner
> |TOTAL: 1 FAIL: 0
>
> Reproducibility OK (saw issue with gcc-doc, but not python3):
>
> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/deb/./x86-64-v3/gcc-doc_15.2.0-r0_amd64.deb
> |The following ipk packages are different and not in exclusion list:
> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/ipk/./x86-64-v3/gcc-doc_15.2.0-r0_x86-64-v3.ipk
> |The following rpm packages are different and not in exclusion list:
> |/home/tgamblin/workspace/yocto/openembedded-core/build-st/reproducibleB-extended/tmp/deploy/rpm/./x86_64_v3/gcc-doc-15.2.0-r0.x86_64_v3.rpm
> |
> |2026-01-08 13:18:28,640 - oe-selftest - INFO - ----------------------------------------------------------------------
> |2026-01-08 13:18:28,640 - oe-selftest - INFO - Ran 1 test in 1285.587s
> |2026-01-08 13:18:28,640 - oe-selftest - INFO - FAILED
> |2026-01-08 13:18:28,640 - oe-selftest - INFO -  (failures=1)
> |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS:
> |2026-01-08 13:18:31,656 - oe-selftest - INFO - RESULTS - reproducible.ReproducibleTests.test_reproducible_builds: FAILED (1285.41s)
> |2026-01-08 13:18:31,660 - oe-selftest - INFO - SUMMARY:
> |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest () - Ran 1 test in 1285.588s
> |2026-01-08 13:18:31,660 - oe-selftest - INFO - oe-selftest - FAIL - Required tests failed (successes=0, skipped=0, failures=1, errors=0)
>
> buildall-qemu:
>
> |BUILDALL-QEMU LOG FOR python3
> |START TIME: 2026-01-08_13:27:10
> |HOSTNAME: megalith
> |HOST OS: Fedora Linux 43 (Server Edition)
> |HOST KERNEL: 6.17.12-300.fc43.x86_64
> |===============
> |BUILD RESULTS:
> |[glibc]
> |PASS: qemuarm
> |PASS: qemuarm64
> |PASS: qemuarmv5
> |PASS: qemuloongarch64
> |PASS: qemumips
> |PASS: qemumips64
> |PASS: qemuppc
> |PASS: qemuppc64
> |PASS: qemuriscv32
> |PASS: qemuriscv64
> |PASS: qemux86-64
> |PASS: qemux86
> |[musl]
> |PASS: qemuarm
> |PASS: qemuarm64
> |PASS: qemuarmv5
> |FAIL: qemuloongarch64
> |PASS: qemumips
> |PASS: qemumips64
> |PASS: qemuppc
> |PASS: qemuppc64
> |PASS: qemuriscv32
> |PASS: qemuriscv64
> |PASS: qemux86-64
> |PASS: qemux86
> |===============
> |PASSED: 23
> |FAILED: 1
>
> Previous iteration details below.
>
> Compared to v1
> (https://lists.openembedded.org/g/openembedded-core/message/227955):
>
> - Drop python3-bcrypt upgrade, as someone else has submitted that;
> - Drop rpm patch to manually override Python3_SITEARCH with a patch, as that was
>    masking the real issue (see below);
> - Add a new patch to fix python3targetconfig by exporting _PYTHON_PROJECT_BASE,
>    which Python's sysconfig looks for (as of 3.14.0) when doing
>    cross-compilation. The absence of this was resulting in packages like rpm
>    finding paths for the native interpreter when making use of sysconfig, when
>    they needed the host values.
>
> Note that I've dropped my own version of the python3-bcrypt upgrade, but I
> tested this patch series on top of the other one that was submitted, as
> otherwise the ptest images would break during build (version mismatch errors
> around PyO3, which is fixed with the bcrypt upgrade).
>
> v1 details below.
>
> This supersedes a previous series sent, which only did the 3.14.0 upgrade.
>
> Compared to the first series
> (https://lists.openembedded.org/g/openembedded-core/message/227310), I've
> done the following:
>
> - Added a commit for including the '_py_warnings' and 'annotationlib' modules in
>    python3-core;
> - Adds the python 3.14.2 upgrade;
> - Removed commits for adding python3-misc to RDEPENDS for python3-pytest and
>    python3-jsonpointer, as these are now solved by a new patch to add new modules
>    to python3-core in the manifest. Doing it this way was fragile in the sense
>    that there were many other recipes needing this same fix that testing didn't
>    easily catch, and it doesn't make sense to add python3-misc to recipe RDEPENDS
>    just because (for example) python3-logging (another package split) is trying
>    to make use of warnings, but can't find the right module;
> - Modified the rpm commit to apply a patch (submitted upstream) to fix
>    CMakeLists.txt, rather than a do_configure prepend;
> - Fixed the Python 3.14.0 upgrade commit so that one of the patches we carry to
>    skip tests doesn't include duplicate calls to the relevant skip functions.
>
> I've kept the upgrades from 3.13.11 to 3.14.0 and 3.14.0 to 3.14.2 separate to
> reflect separate testing and let people review those changelogs individually if
> desired.
>
> Trevor Gamblin (6):
>    python3: upgrade 3.13.11 -> 3.14.0
>    python3targetconfig: export _PYTHON_PROJECT_BASE
>    python_pep517: add --prefix to nativepython3 call
>    python3: upgrade 3.14.0 -> 3.14.2
>    python3: add _py_warnings, annotationlib to core
>    python3: add _ast_unparse to core
>
>   meta/classes-recipe/python3-dir.bbclass       |    2 +-
>   .../python3targetconfig.bbclass               |    1 +
>   meta/classes-recipe/python_pep517.bbclass     |    2 +-
>   ...r-OpenSSL-3.4-and-add-it-to-multissl.patch | 1452 -----------------
>   ...-use-prefix-value-from-build-configu.patch |   35 +-
>   ...sts-due-to-load-variability-on-YP-AB.patch |   31 +-
>   ...ctive_children-skip-problematic-test.patch |   17 +-
>   ...1-test_cmd-skip-bang-completion-test.patch |   31 +
>   ...-test_unix_console.test_cursor_back_.patch |   46 +
>   ...kip-test_sysconfig.test_sysconfigdat.patch |   32 +
>   .../python/python3/python3-manifest.json      |    6 +-
>   .../{python3_3.13.11.bb => python3_3.14.2.bb} |   20 +-
>   12 files changed, 188 insertions(+), 1487 deletions(-)
>   delete mode 100644 meta/recipes-devtools/python/python3/0001-Generate-data-for-OpenSSL-3.4-and-add-it-to-multissl.patch
>   create mode 100644 meta/recipes-devtools/python/python3/0001-test_cmd-skip-bang-completion-test.patch
>   create mode 100644 meta/recipes-devtools/python/python3/0001-test_pyrepl-skip-test_unix_console.test_cursor_back_.patch
>   create mode 100644 meta/recipes-devtools/python/python3/0001-test_sysconfig-skip-test_sysconfig.test_sysconfigdat.patch
>   rename meta/recipes-devtools/python/{python3_3.13.11.bb => python3_3.14.2.bb} (95%)
>
>
> -=-=-=-=-=-=-=-=-=-=-=-
> Links: You receive all messages sent to this group.
> View/Reply Online (#229126): https://lists.openembedded.org/g/openembedded-core/message/229126
> Mute This Topic: https://lists.openembedded.org/mt/117176199/7611679
> Group Owner: openembedded-core+owner@lists.openembedded.org
> Unsubscribe: https://lists.openembedded.org/g/openembedded-core/unsub [tgamblin@baylibre.com]
> -=-=-=-=-=-=-=-=-=-=-=-
>