Re: [OE-core] [PATCH] package management: Allow dynamic loading of PM

["Fredrik Gustafsson" <fredrik.gustafsson@axis.com>]

________________________________________
From: Richard Purdie <richard.purdie@linuxfoundation.org>
Sent: Tuesday, September 8, 2020 1:25 PM
To: Fredrik Gustafsson; Fredrik Gustafsson
Cc: openembedded-core@lists.openembedded.org; tools-cfpbuild-internal
Subject: Re: [OE-core] [PATCH] package management: Allow dynamic loading of PM

On Tue, 2020-09-08 at 12:53 +0200, Fredrik Gustafsson wrote:
> Dynamic loading of package managers will allow other layers to simply
> add their package manager code in package_manager/ and have bitbake
> find
> it according to the package manager configuration. This is useful for
> adding new (faster) package managers to Open Embedded while not
> increasing the
> test scope or require Open Embedded to support more package managers.
>
> How this is tested:
> * Build core-image-minimal with all three package managers
> * Build the sdk with all three package managers. dpkg fails, but
>   it fails on master as well.
> * Run the complete test suite, all tests passed except 16
> * Run those 16 tests on master and verify that they fail there as
> well
> * Fix errors making tests works on master but not with this patch.

Did you test both the sdk and esdk? Which tests are failing? Are these
oe-selftests? They all should pass and do on the autobuilder?

We're over a week past feature freeze and this series has a troubled
history of testing so realistically this needs to be 3.3 material at
this point (just to ensure we have the same expectations).

Cheers,

Richard


Hi Richard,
I'm sorry that you experienced trouble with this patch series. That's
why I've tried to be really clear on what's tested and not tested. I don't
mind running tests, but of course I might miss which tests that should be run.

I did the following test:
set PACKAGE_CLASSES = rpm
bitbake core-image-minimal # OK
bitbake core-image-minimal -c populate_sdk # OK
bitbake core-image-minimal -c populate_sdk_ext # fail
# Failed to generate filtered task list for extensible SDK
# Fails on master as well

oe-selftest -a

set PACKAGE_CLASSES = ipk
bitbake core-image-minimal
bitbake core-image-minimal -c populate_sdk # OK
bitbake core-image-minimal -c populate_sdk_ext # fail
# Failed to generate filtered task list for extensible SDK
# Fails on master as well

set PACKAGE_CLASSES = deb
bitbake core-image-minimal
bitbake core-image-minimal -c populate_sdk # fail
# dpkg: nativesdk-qemu-helper: dependency problems, but configuring anyway as your requested
# Fails on master as well

And also ran oe-selftest -a with the follwing erros:
2020-08-28 21:39:27,092 - oe-selftest - INFO - RESULTS - imagefeatures.ImageFeatures.test_all_users_can_connect_via_ssh_without_password: ERROR (
26.84s)
2020-08-28 21:39:27,092 - oe-selftest - INFO - RESULTS - imagefeatures.ImageFeatures.test_non_root_user_can_connect_via_ssh_without_password: ERR
OR (26.86s)
2020-08-28 21:39:27,092 - oe-selftest - INFO - RESULTS - package.PackageTests.test_gdb_hardlink_debug: ERROR (165.96s)
2020-08-28 21:39:27,092 - oe-selftest - INFO - RESULTS - package.PackageTests.test_preserve_ownership: ERROR (30.97s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.SystemTap.test_crosstap_helloworld: ERROR (768.02s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.SystemTap.test_crosstap_pstree: ERROR (12.23s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.SystemTap.test_crosstap_syscalls_by_pid: ERROR (11.61s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.SystemTap.test_crosstap_syscalls_by_proc: ERROR (11.61s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.TestExport.test_testexport_basic: ERROR (33.40s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - wic.Wic2.test_biosplusefi_plugin_qemu: ERROR (7.40s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - wic.Wic2.test_expand_mbr_image: ERROR (32.09s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - wic.Wic2.test_qemu: ERROR (34.10s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - wic.Wic2.test_qemu_efi: ERROR (29.09s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - wic.Wic2.test_rawcopy_plugin_qemu: ERROR (53.20s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - buildoptions.ArchiverTest.test_arch_work_dir_and_export_source: FAILED (14.04s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - containerimage.ContainerImageTests.test_expected_files: FAILED (18.34s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - devtool.DevtoolAddTests.test_devtool_add_fetch_git: FAILED (7.82s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - distrodata.Distrodata.test_checkpkg: FAILED (100.84s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - fetch.Fetch.test_git_mirrors: FAILED (5.81s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - incompatible_lic.NoGPL3InImagesTests.test_core_image_full_cmdline: FAILED (74.05s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - recipetool.RecipetoolTests.test_recipetool_create_git_http: FAILED (1.60s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - recipetool.RecipetoolTests.test_recipetool_create_github: FAILED (3.59s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - recipetool.RecipetoolTests.test_recipetool_create_npm: FAILED (1.70s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.TestImage.test_testimage_dnf: FAILED (144.74s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.TestImage.test_testimage_install: FAILED (50.83s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.TestImage.test_testimage_virgl_gtk_sdl: FAILED (108.25s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.Postinst.test_failing_postinst: UNKNOWN (61.95s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.Postinst.test_postinst_rootfs_and_boot_systemd: UNKNOWN (1375.15s)
2020-08-28 21:39:27,093 - oe-selftest - INFO - RESULTS - runtime_test.Postinst.test_postinst_rootfs_and_boot_sysvinit: UNKNOWN (383.32s)

Here I know that our corporate network might be a culprint. Some tests also worked with I ran only that test. Is there anyway I can trigger a test with
this patch on the autobuilder?

I was hoping to get this into 3.2, but I appreciate that you're clear. Is there something I can do to lower the risk of this patch enough to make it suitable for 3.2?

BR
Fredrik