* QA notification for completed autobuilder build (yocto-5.2_M1.rc2)
@ 2024-12-15 22:47 Richard Purdie
2024-12-19 14:48 ` [qa-build-notification] " Tham, Jing Hui
` (2 more replies)
0 siblings, 3 replies; 7+ messages in thread
From: Richard Purdie @ 2024-12-15 22:47 UTC (permalink / raw)
To: <yocto@lists.yoctoproject.org>; +Cc: qa-build-notification
A build flagged for QA (yocto-5.2_M1.rc2) was completed on the
autobuilder and is available at:
https://valkyrie.yocto.io/pub/releases/yocto-5.2_M1.rc2
Build URL:
https://valkyrie.yoctoproject.org/#/builders/29/builds/647
Build hash information:
bitbake: ba90fe673aa87cb0cda9b2e465ebe2063551f527
meta-agl: c036aa7b02f8cdf0f9190358bb8d8128c47c689b
meta-arm: b2c43dbf9b4e7c22038bdd5d01633962afe8f18f
meta-aws: 74dc7bc21a81c82fa9640997da206ee097704341
meta-clang: 147349b7334b8a25b96bb08c2361ae0ae95e7eb6
meta-intel: d0150964ca7c6a83d38ba54cda3e19b34d274f80
meta-mingw: 220a8ad605d60247df27d3a66facc89c1854ed10
meta-openembedded: da51096bcf257723a929c799bc6934877de81fa5
meta-virtualization: c1f668c337a56457acacbbefe4d1f1989202ba95
oecore: e345b34703d4fa5e0bc9a82ac33b7c1fd84f99fe
poky: fafd1db382cc24c53c17170df82780f9d593ca1f
This is an automated message from the Yocto Project Autobuilder
Git: git://git.yoctoproject.org/yocto-autobuilder2
Email: richard.purdie@linuxfoundation.org
^ permalink raw reply [flat|nested] 7+ messages in thread* RE: [qa-build-notification] QA notification for completed autobuilder build (yocto-5.2_M1.rc2) 2024-12-15 22:47 QA notification for completed autobuilder build (yocto-5.2_M1.rc2) Richard Purdie @ 2024-12-19 14:48 ` Tham, Jing Hui 2024-12-30 8:29 ` Tham, Jing Hui 2024-12-30 8:33 ` Tham, Jing Hui 2 siblings, 0 replies; 7+ messages in thread From: Tham, Jing Hui @ 2024-12-19 14:48 UTC (permalink / raw) To: qa-build-notification@lists.yoctoproject.org, <yocto@lists.yoctoproject.org>, Pokybuild User, openembedded-core@lists.openembedded.org Hi all, Intel and WR YP QA is planning for QA execution for YP build yocto-5.2_M1.rc2. We are planning to execute following tests for this cycle: OEQA-manual tests for following module: 1. OE-Core 2. BSP-hw Runtime auto test for following platforms: 1. MinnowBoard Turbot - 32bit 2. Alder Lake-S (12th Generation Intel(r) Core(tm) Processors) 3. Raptor Lake-P (13th Generation Intel(r) Core(tm) Processors) 4. Meteor Lake-P (14th Generation Intel(r) Core(tm) Processors) 5. Beaglebone ETA for completion: Thursday, 26 Dec 2024. Best regards, Jing Hui > -----Original Message----- > From: qa-build-notification@lists.yoctoproject.org <qa-build- > notification@lists.yoctoproject.org> On Behalf Of Richard Purdie via > lists.yoctoproject.org > Sent: Monday, December 16, 2024 6:48 AM > To: <yocto@lists.yoctoproject.org> <yocto@lists.yoctoproject.org> > Cc: qa-build-notification <qa-build-notification@lists.yoctoproject.org> > Subject: [qa-build-notification] QA notification for completed autobuilder > build (yocto-5.2_M1.rc2) > > A build flagged for QA (yocto-5.2_M1.rc2) was completed on the > autobuilder and is available at: > > > https://valkyrie.yocto.io/pub/releases/yocto-5.2_M1.rc2 > > > Build URL: > https://valkyrie.yoctoproject.org/#/builders/29/builds/647 > > Build hash information: > > bitbake: ba90fe673aa87cb0cda9b2e465ebe2063551f527 > meta-agl: c036aa7b02f8cdf0f9190358bb8d8128c47c689b > meta-arm: b2c43dbf9b4e7c22038bdd5d01633962afe8f18f > meta-aws: 74dc7bc21a81c82fa9640997da206ee097704341 > meta-clang: 147349b7334b8a25b96bb08c2361ae0ae95e7eb6 > meta-intel: d0150964ca7c6a83d38ba54cda3e19b34d274f80 > meta-mingw: 220a8ad605d60247df27d3a66facc89c1854ed10 > meta-openembedded: da51096bcf257723a929c799bc6934877de81fa5 > meta-virtualization: c1f668c337a56457acacbbefe4d1f1989202ba95 > oecore: e345b34703d4fa5e0bc9a82ac33b7c1fd84f99fe > poky: fafd1db382cc24c53c17170df82780f9d593ca1f > > > > This is an automated message from the Yocto Project Autobuilder > Git: git://git.yoctoproject.org/yocto-autobuilder2 > Email: richard.purdie@linuxfoundation.org > > > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > View/Reply Online (#488): https://lists.yoctoproject.org/g/qa-build- > notification/message/488 > Mute This Topic: https://lists.yoctoproject.org/mt/110135968/6424044 > Group Owner: qa-build-notification+owner@lists.yoctoproject.org > Unsubscribe: https://lists.yoctoproject.org/g/qa-build- > notification/leave/13581802/6424044/1746813897/xyzzy > [jing.hui.tham@intel.com] > -=-=-=-=-=-=-=-=-=-=-=- > ^ permalink raw reply [flat|nested] 7+ messages in thread
* RE: [qa-build-notification] QA notification for completed autobuilder build (yocto-5.2_M1.rc2) 2024-12-15 22:47 QA notification for completed autobuilder build (yocto-5.2_M1.rc2) Richard Purdie 2024-12-19 14:48 ` [qa-build-notification] " Tham, Jing Hui @ 2024-12-30 8:29 ` Tham, Jing Hui 2024-12-30 8:33 ` Tham, Jing Hui 2 siblings, 0 replies; 7+ messages in thread From: Tham, Jing Hui @ 2024-12-30 8:29 UTC (permalink / raw) To: qa-build-notification@lists.yoctoproject.org, <yocto@lists.yoctoproject.org>, openembedded-core@lists.openembedded.org Hi All, QA for yocto-4.1.rc2 is completed. This is the full report for yocto-5.2_M1.rc2: https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/tree/?h=intel-yocto-testresults ======= Summary ======== For Beaglebone, there is a new bug found: Bug 15703 - [5.2 M1 RC2] Fail to start matchbox-desktop on beaglebone: https://bugzilla.yoctoproject.org/show_bug.cgi?id=15703 Since there is no graphic desktop, all graphics-related test cases are skipped. For the new BSP BeaglePlay, the test for genericarm64 image could not be completed due to bug 15704. So there are only test results for genericarm64-alt image this time. Bug 15704 - [5.2 M1 RC2] BeaglePlay: System hangs randomly and kernel call trace with 6.12: https://bugzilla.yoctoproject.org/show_bug.cgi?id=15704 Thanks, Jing Hui > -----Original Message----- > From: qa-build-notification@lists.yoctoproject.org <qa-build- > notification@lists.yoctoproject.org> On Behalf Of Richard Purdie via > lists.yoctoproject.org > Sent: Monday, December 16, 2024 6:48 AM > To: <yocto@lists.yoctoproject.org> <yocto@lists.yoctoproject.org> > Cc: qa-build-notification <qa-build-notification@lists.yoctoproject.org> > Subject: [qa-build-notification] QA notification for completed autobuilder > build (yocto-5.2_M1.rc2) > > A build flagged for QA (yocto-5.2_M1.rc2) was completed on the > autobuilder and is available at: > > > https://valkyrie.yocto.io/pub/releases/yocto-5.2_M1.rc2 > > > Build URL: > https://valkyrie.yoctoproject.org/#/builders/29/builds/647 > > Build hash information: > > bitbake: ba90fe673aa87cb0cda9b2e465ebe2063551f527 > meta-agl: c036aa7b02f8cdf0f9190358bb8d8128c47c689b > meta-arm: b2c43dbf9b4e7c22038bdd5d01633962afe8f18f > meta-aws: 74dc7bc21a81c82fa9640997da206ee097704341 > meta-clang: 147349b7334b8a25b96bb08c2361ae0ae95e7eb6 > meta-intel: d0150964ca7c6a83d38ba54cda3e19b34d274f80 > meta-mingw: 220a8ad605d60247df27d3a66facc89c1854ed10 > meta-openembedded: da51096bcf257723a929c799bc6934877de81fa5 > meta-virtualization: c1f668c337a56457acacbbefe4d1f1989202ba95 > oecore: e345b34703d4fa5e0bc9a82ac33b7c1fd84f99fe > poky: fafd1db382cc24c53c17170df82780f9d593ca1f > > > > This is an automated message from the Yocto Project Autobuilder > Git: git://git.yoctoproject.org/yocto-autobuilder2 > Email: richard.purdie@linuxfoundation.org > > > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > View/Reply Online (#488): https://lists.yoctoproject.org/g/qa-build- > notification/message/488 > Mute This Topic: https://lists.yoctoproject.org/mt/110135968/6424044 > Group Owner: qa-build-notification+owner@lists.yoctoproject.org > Unsubscribe: https://lists.yoctoproject.org/g/qa-build- > notification/leave/13581802/6424044/1746813897/xyzzy > [jing.hui.tham@intel.com] > -=-=-=-=-=-=-=-=-=-=-=- > ^ permalink raw reply [flat|nested] 7+ messages in thread
* RE: [qa-build-notification] QA notification for completed autobuilder build (yocto-5.2_M1.rc2) 2024-12-15 22:47 QA notification for completed autobuilder build (yocto-5.2_M1.rc2) Richard Purdie 2024-12-19 14:48 ` [qa-build-notification] " Tham, Jing Hui 2024-12-30 8:29 ` Tham, Jing Hui @ 2024-12-30 8:33 ` Tham, Jing Hui 2025-01-09 14:17 ` [OE-core] " Mikko Rapeli 2 siblings, 1 reply; 7+ messages in thread From: Tham, Jing Hui @ 2024-12-30 8:33 UTC (permalink / raw) To: qa-build-notification@lists.yoctoproject.org, <yocto@lists.yoctoproject.org>, openembedded-core@lists.openembedded.org Hi All, QA for yocto-5.2_M1.rc2 is completed. This is the full report for yocto-5.2_M1.rc2: https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/tree/?h=intel-yocto-testresults ======= Summary ======== For Beaglebone, there is a new bug found: Bug 15703 - [5.2 M1 RC2] Fail to start matchbox-desktop on beaglebone: https://bugzilla.yoctoproject.org/show_bug.cgi?id=15703 Since there is no graphic desktop, all graphics-related test cases are skipped. For the new BSP BeaglePlay, the test for genericarm64 image could not be completed due to bug 15704. So there are only test results for genericarm64-alt image this time. Bug 15704 - [5.2 M1 RC2] BeaglePlay: System hangs randomly and kernel call trace with 6.12: https://bugzilla.yoctoproject.org/show_bug.cgi?id=15704 Thanks, Jing Hui > -----Original Message----- > From: qa-build-notification@lists.yoctoproject.org <qa-build- > notification@lists.yoctoproject.org> On Behalf Of Richard Purdie via > lists.yoctoproject.org > Sent: Monday, December 16, 2024 6:48 AM > To: <yocto@lists.yoctoproject.org> <yocto@lists.yoctoproject.org> > Cc: qa-build-notification <qa-build-notification@lists.yoctoproject.org> > Subject: [qa-build-notification] QA notification for completed autobuilder > build (yocto-5.2_M1.rc2) > > A build flagged for QA (yocto-5.2_M1.rc2) was completed on the > autobuilder and is available at: > > > https://valkyrie.yocto.io/pub/releases/yocto-5.2_M1.rc2 > > > Build URL: > https://valkyrie.yoctoproject.org/#/builders/29/builds/647 > > Build hash information: > > bitbake: ba90fe673aa87cb0cda9b2e465ebe2063551f527 > meta-agl: c036aa7b02f8cdf0f9190358bb8d8128c47c689b > meta-arm: b2c43dbf9b4e7c22038bdd5d01633962afe8f18f > meta-aws: 74dc7bc21a81c82fa9640997da206ee097704341 > meta-clang: 147349b7334b8a25b96bb08c2361ae0ae95e7eb6 > meta-intel: d0150964ca7c6a83d38ba54cda3e19b34d274f80 > meta-mingw: 220a8ad605d60247df27d3a66facc89c1854ed10 > meta-openembedded: da51096bcf257723a929c799bc6934877de81fa5 > meta-virtualization: c1f668c337a56457acacbbefe4d1f1989202ba95 > oecore: e345b34703d4fa5e0bc9a82ac33b7c1fd84f99fe > poky: fafd1db382cc24c53c17170df82780f9d593ca1f > > > > This is an automated message from the Yocto Project Autobuilder > Git: git://git.yoctoproject.org/yocto-autobuilder2 > Email: richard.purdie@linuxfoundation.org > > > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > View/Reply Online (#488): https://lists.yoctoproject.org/g/qa-build- > notification/message/488 > Mute This Topic: https://lists.yoctoproject.org/mt/110135968/6424044 > Group Owner: qa-build-notification+owner@lists.yoctoproject.org > Unsubscribe: https://lists.yoctoproject.org/g/qa-build- > notification/leave/13581802/6424044/1746813897/xyzzy > [jing.hui.tham@intel.com] > -=-=-=-=-=-=-=-=-=-=-=- > ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [OE-core] [qa-build-notification] QA notification for completed autobuilder build (yocto-5.2_M1.rc2) 2024-12-30 8:33 ` Tham, Jing Hui @ 2025-01-09 14:17 ` Mikko Rapeli 2025-01-10 12:14 ` Tham, Jing Hui 0 siblings, 1 reply; 7+ messages in thread From: Mikko Rapeli @ 2025-01-09 14:17 UTC (permalink / raw) To: jing.hui.tham Cc: qa-build-notification@lists.yoctoproject.org, <yocto@lists.yoctoproject.org>, openembedded-core@lists.openembedded.org, Ross Burton, Ilias Apalodimas, Bill Mills Hi On Mon, Dec 30, 2024 at 08:33:17AM +0000, Jing Hui Tham via lists.openembedded.org wrote: > QA for yocto-5.2_M1.rc2 is completed. This is the full report for yocto-5.2_M1.rc2: > https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/tree/?h=intel-yocto-testresults How are these results generated for each HW? Do you run a build for the machine with some special config on a build machine which has the test target connected? Specificially, I'm wondering how to run the manual tests and oeqa runtime tests at the same time to produce a single testresults.json file which has both. The result json files show which images get tested. How did you select these for each HW? Default oeqa runtime tests from TEST_SUITES variable for images without SSH server don't really work so core-image-base and core-image-minimal testing doesn't find anything. Only core-image-sato, core-image-weston etc have SSH server and real tests find something. I wonder if some other tests should be done for these images without SSH over serial console. > ======= Summary ======== > For Beaglebone, there is a new bug found: Bug 15703 - [5.2 M1 RC2] Fail to start matchbox-desktop on beaglebone: > https://bugzilla.yoctoproject.org/show_bug.cgi?id=15703 > Since there is no graphic desktop, all graphics-related test cases are skipped. > > For the new BSP BeaglePlay, the test for genericarm64 image could not be completed due to bug 15704. So there are only test results for genericarm64-alt image this time. > Bug 15704 - [5.2 M1 RC2] BeaglePlay: System hangs randomly and kernel call trace with 6.12: > https://bugzilla.yoctoproject.org/show_bug.cgi?id=15704 I've done some testing of genericarm64 machine builds on AMD KV260 which I could also contribute to yocto-testresults-contrib repo, as well as some fixes/changes to oe-core/poky and/or bug reports/feature requests: * testing done in Linaro Lava lab with AMD KV260 devices running Linaro Truste Substrate u-boot based firmware with secure boot disabled ( https://gitlab.com/Linaro/trustedsubstrate/meta-ts ). HW has been slightly modified to enable flashing firmware and SW automatically. * default poky distro build images don't work for testing because serial console getty setup is broken. Thus serial login prompt fails which our Lava testing uses to detect a fully booted system. Fix is to add KV260 serial console to genericarm64 or to fix serial console detection with udev also on sysvinit. systemd images with udev work correctly. Example: https://ledge.validation.linaro.org/scheduler/job/99486 INIT: Id "S0" respawning too fast: disabled for 5 minutes INIT: Id "S1" respawning too fast: disabled for 5 minutes INIT: Id "S2" respawning too fast: disabled for 5 minutes INIT: Id "S0" respawning too fast: disabled for 5 minutes INIT: Id "S1" respawning too fast: disabled for 5 minutes INIT: Id "S2" respawning too fast: disabled for 5 minutes * testexport.bbclass not enabled so testing outside of build environment is hard. Using exported tests works well in Linaro Lava so I've enable them in the test build and modified the output files to contain full image name to easily match image with image specific test export file. Draft patch: --- a/meta/classes-recipe/testexport.bbclass +++ b/meta/classes-recipe/testexport.bbclass @@ -139,7 +139,7 @@ def copy_needed_files(d, tc): shutil.rmtree(os.path.join(subdir, dir)) # Create tar file for common parts of testexport - testexport_create_tarball(d, "testexport.tar.gz", d.getVar("TEST_EXPORT_DIR")) + testexport_create_tarball(d, "testexport_" + d.getVar('IMAGE_LINK_NAME') + ".tar.gz", d.getVar("TEST_EXPORT_DIR")) # Copy packages needed for runtime testing package_extraction(d, tc.suites) Enabled in local.conf with: IMAGE_CLASSES += "testexport testimage" * Since serial console works correctly with systemd init, testing poky-altcfg distro instead of poky, but that downgrades kernel from 6.12 to 6.6 which is not that interesting for us. Thus updated kernel to 6.12 with draft poky change: --- a/meta-poky/conf/distro/include/poky-distro-alt-test-config.inc +++ b/meta-poky/conf/distro/include/poky-distro-alt-test-config.inc @@ -2,7 +2,7 @@ DISTRO_FEATURES:append = " pam usrmerge" # Use our alternate kernel version -PREFERRED_VERSION_linux-yocto = "6.6%" +#PREFERRED_VERSION_linux-yocto = "6.6%" # Ensure the kernel nfs server is enabled KERNEL_FEATURES:append:pn-linux-yocto = " features/nfsd/nfsd-enable.scc" * core-image-base boots to serial console login and reboot succeeds. Further testing with oeqa runtime does not work since SSH server not installed. https://ledge.validation.linaro.org/scheduler/job/99485 * core-image-minimal boots to serial console login and reboot succeeds. Further testing with oeqa runtime does not work since no SSH server installed. https://ledge.validation.linaro.org/scheduler/job/99484 * core-image-sato boots to serial console login and reboot succeeds. Since SSH server is on image oeqa runtime tests run and results are: https://ledge.validation.linaro.org/scheduler/job/99483 2025-01-09 08:08:13,221 - runtime - INFO - Ran 73 tests in 186.726s 2025-01-09 08:08:13,222 - runtime - INFO - FAILED 2025-01-09 08:08:13,222 - runtime - INFO - (failures=4, skipped=49) 2025-01-09 08:08:13,239 - runtime - INFO - RESULTS: 2025-01-09 08:08:13,239 - runtime - INFO - RESULTS - connman.ConnmanTest.test_connmand_help: PASSED (0.75s) 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - connman.ConnmanTest.test_connmand_running: PASSED (0.70s) 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - date.DateTest.test_date: PASSED (9.10s) 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - df.DfTest.test_df: PASSED (0.74s) 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - oe_syslog.SyslogTest.test_syslog_running: PASSED (0.72s) 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - oe_syslog.SyslogTestConfig.test_syslog_logger: PASSED (2.28s) 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - oe_syslog.SyslogTestConfig.test_syslog_restart: PASSED (1.31s) 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - pam.PamBasicTest.test_pam: PASSED (2.88s) 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - parselogs.ParseLogsTest.test_get_context: PASSED (0.00s) 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - ping.PingTest.test_ping: PASSED (0.01s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - python.PythonTest.test_python3: PASSED (1.25s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - scp.ScpTest.test_scp_file: PASSED (2.81s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - ssh.SSHTest.test_ssh: PASSED (0.72s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - systemd.SystemdBasicTests.test_systemd_basic: PASSED (0.71s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - systemd.SystemdBasicTests.test_systemd_list: PASSED (3.07s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - systemd.SystemdJournalTests.test_systemd_boot_time: PASSED (0.89s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - systemd.SystemdJournalTests.test_systemd_journal: PASSED (1.12s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - systemd.SystemdServiceTests.test_systemd_disable_enable: PASSED (7.29s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - systemd.SystemdServiceTests.test_systemd_status: PASSED (0.76s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - systemd.SystemdServiceTests.test_systemd_stop_start: PASSED (2.78s) 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - apt.AptRepoTest.test_apt_install_from_repo: SKIPPED (0.00s) 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - buildcpio.BuildCpioTest.test_cpio: SKIPPED (0.00s) 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - buildgalculator.GalculatorTest.test_galculator: SKIPPED (0.00s) 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - buildlzip.BuildLzipTest.test_lzip: SKIPPED (0.00s) 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - dnf.DnfBasicTest.test_dnf_help: SKIPPED (0.00s) 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - dnf.DnfBasicTest.test_dnf_history: SKIPPED (0.00s) 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - dnf.DnfBasicTest.test_dnf_info: SKIPPED (0.00s) 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - dnf.DnfBasicTest.test_dnf_search: SKIPPED (0.00s) 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - dnf.DnfBasicTest.test_dnf_version: SKIPPED (0.00s) 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_exclude: SKIPPED (0.00s) 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_install: SKIPPED (0.00s) 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_install_dependency: SKIPPED (0.00s) 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_install_from_disk: SKIPPED (0.00s) 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_install_from_http: SKIPPED (0.00s) 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_installroot: SKIPPED (0.00s) 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_installroot_usrmerge: SKIPPED (0.00s) 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_makecache: SKIPPED (0.00s) 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_reinstall: SKIPPED (0.00s) 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_repoinfo: SKIPPED (0.00s) 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - gcc.GccCompileTest.test_gcc_compile: SKIPPED (0.00s) 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - gcc.GccCompileTest.test_gpp2_compile: SKIPPED (0.00s) 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - gcc.GccCompileTest.test_gpp_compile: SKIPPED (0.00s) 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - gcc.GccCompileTest.test_make: SKIPPED (0.00s) 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - gi.GObjectIntrospectionTest.test_python: SKIPPED (0.00s) 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - go.GoHelloworldTest.test_gohelloworld: SKIPPED (0.00s) 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - kernelmodule.KernelModuleTest.test_kernel_module: SKIPPED (0.00s) 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - ldd.LddTest.test_ldd: SKIPPED (0.00s) 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - logrotate.LogrotateTest.test_logrotate_newlog: SKIPPED (0.00s) 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - logrotate.LogrotateTest.test_logrotate_wtmp: SKIPPED (0.00s) 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - oe_syslog.SyslogTestConfig.test_syslog_startup_config: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - perl.PerlTest.test_perl_works: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - ptest.PtestRunnerTest.test_ptestrunner_expectfail: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - ptest.PtestRunnerTest.test_ptestrunner_expectsuccess: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - rpm.RpmBasicTest.test_rpm_help: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - rpm.RpmBasicTest.test_rpm_query: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - rpm.RpmBasicTest.test_rpm_query_nonroot: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - rpm.RpmInstallRemoveTest.test_check_rpm_install_removal_log_file_size: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - rpm.RpmInstallRemoveTest.test_rpm_install: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - rpm.RpmInstallRemoveTest.test_rpm_remove: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - rust.RustCLibExampleTest.test_rust_c_lib_example: SKIPPED (0.00s) 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - rust.RustCompileTest.test_cargo_compile: SKIPPED (0.00s) 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - rust.RustCompileTest.test_rust_compile: SKIPPED (0.00s) 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - stap.StapTest.test_stap: SKIPPED (0.00s) 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - systemd.SystemdServiceTests.test_systemd_coredump_minidebuginfo: SKIPPED (0.00s) 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - systemd.SystemdServiceTests.test_systemd_disable_enable_ro: SKIPPED (0.00s) 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - weston.WestonTest.test_wayland_info: SKIPPED (0.00s) 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - weston.WestonTest.test_weston_can_initialize_new_wayland_compositor: SKIPPED (0.00s) 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - weston.WestonTest.test_weston_running: SKIPPED (0.00s) 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - weston.WestonTest.test_weston_supports_xwayland: SKIPPED (0.00s) 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - opkg.OpkgRepoTest.test_opkg_install_from_repo: FAILED (135.86s) 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - parselogs.ParseLogsTest.test_parselogs: FAILED (4.76s) 2025-01-09 08:08:13,247 - runtime - INFO - RESULTS - systemd.SystemdBasicTests.test_systemd_failed: FAILED (2.19s) 2025-01-09 08:08:13,247 - runtime - INFO - RESULTS - xorg.XorgTest.test_xorg_running: FAILED (1.27s) 2025-01-09 08:08:13,250 - runtime - INFO - SUMMARY: 2025-01-09 08:08:13,250 - runtime - INFO - runtime () - Ran 73 tests in 186.734s 2025-01-09 08:08:13,250 - runtime - INFO - runtime - FAIL - Required tests failed (successes=20, skipped=49, failures=4, errors=0) opkg.OpkgRepoTest.test_opkg_install_from_repo failure is a test setup issue since package repo from build environment is not exported to test environment. parselogs.ParseLogsTest.test_parselogs fails since firmware and kernel trigger some new non-fatal warnings to dmesg. Needs detailed investigation to either supress warnings or to fix root causes. systemd.SystemdBasicTests.test_systemd_failed fails since xserver-nodm.service fails start. X11 graphics support on AMD KV260 is not enabled or working yet on genericarm64 machine. xorg.XorgTest.test_xorg_running fails since xorg startup fails. * core-image-weston boots to serial console login and reboot succeeds. SSH server is installed so oeqa runtime tests run and results are: https://ledge.validation.linaro.org/scheduler/job/99486 2025-01-09 08:55:34,919 - runtime - INFO - ---------------------------------------------------------------------- 2025-01-09 08:55:34,919 - runtime - INFO - Ran 73 tests in 192.950s 2025-01-09 08:55:34,920 - runtime - INFO - FAILED 2025-01-09 08:55:34,920 - runtime - INFO - (failures=6, skipped=49) 2025-01-09 08:55:34,937 - runtime - INFO - RESULTS: 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - date.DateTest.test_date: PASSED (9.06s) 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - df.DfTest.test_df: PASSED (0.73s) 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - oe_syslog.SyslogTest.test_syslog_running: PASSED (0.71s) 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - oe_syslog.SyslogTestConfig.test_syslog_logger: PASSED (2.29s) 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - oe_syslog.SyslogTestConfig.test_syslog_restart: PASSED (1.29s) 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - pam.PamBasicTest.test_pam: PASSED (2.89s) 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - parselogs.ParseLogsTest.test_get_context: PASSED (0.00s) 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - ping.PingTest.test_ping: PASSED (0.01s) 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - scp.ScpTest.test_scp_file: PASSED (2.78s) 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - ssh.SSHTest.test_ssh: PASSED (0.74s) 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - systemd.SystemdBasicTests.test_systemd_basic: PASSED (0.69s) 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - systemd.SystemdBasicTests.test_systemd_list: PASSED (3.10s) 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - systemd.SystemdJournalTests.test_systemd_boot_time: PASSED (0.91s) 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - systemd.SystemdJournalTests.test_systemd_journal: PASSED (1.11s) 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - systemd.SystemdServiceTests.test_systemd_disable_enable: PASSED (7.28s) 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - systemd.SystemdServiceTests.test_systemd_status: PASSED (0.76s) 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - systemd.SystemdServiceTests.test_systemd_stop_start: PASSED (2.75s) 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - weston.WestonTest.test_wayland_info: PASSED (7.56s) 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - apt.AptRepoTest.test_apt_install_from_repo: SKIPPED (0.00s) 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - buildcpio.BuildCpioTest.test_cpio: SKIPPED (0.00s) 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - buildgalculator.GalculatorTest.test_galculator: SKIPPED (0.00s) 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - buildlzip.BuildLzipTest.test_lzip: SKIPPED (0.00s) 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - connman.ConnmanTest.test_connmand_help: SKIPPED (0.00s) 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - connman.ConnmanTest.test_connmand_running: SKIPPED (0.00s) 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - dnf.DnfBasicTest.test_dnf_help: SKIPPED (0.00s) 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - dnf.DnfBasicTest.test_dnf_history: SKIPPED (0.00s) 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - dnf.DnfBasicTest.test_dnf_info: SKIPPED (0.00s) 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - dnf.DnfBasicTest.test_dnf_search: SKIPPED (0.00s) 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - dnf.DnfBasicTest.test_dnf_version: SKIPPED (0.00s) 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_exclude: SKIPPED (0.00s) 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_install: SKIPPED (0.00s) 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_install_dependency: SKIPPED (0.00s) 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_install_from_disk: SKIPPED (0.00s) 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_install_from_http: SKIPPED (0.00s) 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_installroot: SKIPPED (0.00s) 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_installroot_usrmerge: SKIPPED (0.00s) 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_makecache: SKIPPED (0.00s) 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_reinstall: SKIPPED (0.00s) 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - dnf.DnfRepoTest.test_dnf_repoinfo: SKIPPED (0.00s) 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - gcc.GccCompileTest.test_gcc_compile: SKIPPED (0.00s) 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - gcc.GccCompileTest.test_gpp2_compile: SKIPPED (0.00s) 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - gcc.GccCompileTest.test_gpp_compile: SKIPPED (0.00s) 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - gcc.GccCompileTest.test_make: SKIPPED (0.00s) 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - gi.GObjectIntrospectionTest.test_python: SKIPPED (0.00s) 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - go.GoHelloworldTest.test_gohelloworld: SKIPPED (0.00s) 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - kernelmodule.KernelModuleTest.test_kernel_module: SKIPPED (0.00s) 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - ldd.LddTest.test_ldd: SKIPPED (0.00s) 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - logrotate.LogrotateTest.test_logrotate_newlog: SKIPPED (0.00s) 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - logrotate.LogrotateTest.test_logrotate_wtmp: SKIPPED (0.00s) 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - oe_syslog.SyslogTestConfig.test_syslog_startup_config: SKIPPED (0.00s) 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - perl.PerlTest.test_perl_works: SKIPPED (0.00s) 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - ptest.PtestRunnerTest.test_ptestrunner_expectfail: SKIPPED (0.00s) 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - ptest.PtestRunnerTest.test_ptestrunner_expectsuccess: SKIPPED (0.00s) 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - python.PythonTest.test_python3: SKIPPED (0.00s) 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - rpm.RpmBasicTest.test_rpm_help: SKIPPED (0.00s) 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - rpm.RpmBasicTest.test_rpm_query: SKIPPED (0.00s) 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - rpm.RpmBasicTest.test_rpm_query_nonroot: SKIPPED (0.00s) 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - rpm.RpmInstallRemoveTest.test_check_rpm_install_removal_log_file_size: SKIPPED (0.00s) 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - rpm.RpmInstallRemoveTest.test_rpm_install: SKIPPED (0.00s) 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - rpm.RpmInstallRemoveTest.test_rpm_remove: SKIPPED (0.00s) 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - rust.RustCLibExampleTest.test_rust_c_lib_example: SKIPPED (0.00s) 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - rust.RustCompileTest.test_cargo_compile: SKIPPED (0.00s) 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - rust.RustCompileTest.test_rust_compile: SKIPPED (0.00s) 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - stap.StapTest.test_stap: SKIPPED (0.00s) 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - systemd.SystemdServiceTests.test_systemd_coredump_minidebuginfo: SKIPPED (0.00s) 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - systemd.SystemdServiceTests.test_systemd_disable_enable_ro: SKIPPED (0.00s) 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - xorg.XorgTest.test_xorg_running: SKIPPED (0.00s) 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - opkg.OpkgRepoTest.test_opkg_install_from_repo: FAILED (136.68s) 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - parselogs.ParseLogsTest.test_parselogs: FAILED (4.11s) 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - systemd.SystemdBasicTests.test_systemd_failed: FAILED (2.21s) 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - weston.WestonTest.test_weston_can_initialize_new_wayland_compositor: FAILED (0.54s) 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - weston.WestonTest.test_weston_running: FAILED (1.27s) 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - weston.WestonTest.test_weston_supports_xwayland: FAILED (0.73s) 2025-01-09 08:55:34,948 - runtime - INFO - SUMMARY: 2025-01-09 08:55:34,948 - runtime - INFO - runtime () - Ran 73 tests in 192.962s 2025-01-09 08:55:34,948 - runtime - INFO - runtime - FAIL - Required tests failed (successes=18, skipped=49, failures=6, errors=0) opkg.OpkgRepoTest.test_opkg_install_from_repo fails like on core-image-sato with same root cause, missing package repo in test environment. parselogs.ParseLogsTest.test_parselogs fails like on core-image-sato. systemd.SystemdBasicTests.test_systemd_failed fails since weston.service fails to start. Details need to be investigated and likely related to graphics stack not setup yet on genericarm64 for AMD KV260. weston.WestonTest.test_weston_can_initialize_new_wayland_compositor fails since weston.service startup fails. weston.WestonTest.test_weston_running fails since weston.service startup fails. weston.WestonTest.test_weston_supports_xwayland fails since weston.service startup fails. I could upload testresult.json files from these test runs to yocto-testresults-contrib. Which branch name should I use? Any reviews needed for the changes? I could also report the test failures to bugzilla, if that makes sense. I will try get these fixed and also improve the tests, for example the small images without SSH could be checked a bit more over serial console. Any feedback to this first test run is welcome. Cheers, -Mikko ^ permalink raw reply [flat|nested] 7+ messages in thread
* RE: [OE-core] [qa-build-notification] QA notification for completed autobuilder build (yocto-5.2_M1.rc2) 2025-01-09 14:17 ` [OE-core] " Mikko Rapeli @ 2025-01-10 12:14 ` Tham, Jing Hui 2025-01-10 12:56 ` Mikko Rapeli 0 siblings, 1 reply; 7+ messages in thread From: Tham, Jing Hui @ 2025-01-10 12:14 UTC (permalink / raw) To: qa-build-notification@lists.yoctoproject.org Cc: <yocto@lists.yoctoproject.org>, openembedded-core@lists.openembedded.org, Ross Burton, Ilias Apalodimas, Bill Mills Hi, You may refer to the wiki page for tests on HW. : https://wiki.yoctoproject.org/wiki/BSP_Test_Plan For single testresults.json file, you can use below command to merge both testresults to single testresult file. $ resulttool merge <testA.json> <testB.json> Regards, Jing Hui > -----Original Message----- > From: qa-build-notification@lists.yoctoproject.org <qa-build- > notification@lists.yoctoproject.org> On Behalf Of Mikko Rapeli via > lists.yoctoproject.org > Sent: Thursday, January 9, 2025 10:17 PM > To: Tham, Jing Hui <jing.hui.tham@intel.com> > Cc: qa-build-notification@lists.yoctoproject.org; > <yocto@lists.yoctoproject.org> <yocto@lists.yoctoproject.org>; > openembedded-core@lists.openembedded.org; Ross Burton > <Ross.Burton@arm.com>; Ilias Apalodimas <ilias.apalodimas@linaro.org>; Bill > Mills <bill.mills@linaro.org> > Subject: Re: [OE-core] [qa-build-notification] QA notification for completed > autobuilder build (yocto-5.2_M1.rc2) > > Hi > > On Mon, Dec 30, 2024 at 08:33:17AM +0000, Jing Hui Tham via > lists.openembedded.org wrote: > > QA for yocto-5.2_M1.rc2 is completed. This is the full report for yocto- > 5.2_M1.rc2: > > https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/t > > ree/?h=intel-yocto-testresults > > How are these results generated for each HW? > > Do you run a build for the machine with some special config on a build > machine which has the test target connected? > > Specificially, I'm wondering how to run the manual tests and oeqa runtime > tests at the same time to produce a single testresults.json file which has both. > > The result json files show which images get tested. > > How did you select these for each HW? > > Default oeqa runtime tests from TEST_SUITES variable for images without SSH > server don't really work so core-image-base and core-image-minimal testing > doesn't find anything. > Only core-image-sato, core-image-weston etc have SSH server and real tests > find something. > I wonder if some other tests should be done for these images without SSH > over serial console. > > > ======= Summary ======== > > For Beaglebone, there is a new bug found: Bug 15703 - [5.2 M1 RC2] Fail to > start matchbox-desktop on beaglebone: > > https://bugzilla.yoctoproject.org/show_bug.cgi?id=15703 > > Since there is no graphic desktop, all graphics-related test cases are skipped. > > > > For the new BSP BeaglePlay, the test for genericarm64 image could not be > completed due to bug 15704. So there are only test results for genericarm64- > alt image this time. > > Bug 15704 - [5.2 M1 RC2] BeaglePlay: System hangs randomly and kernel > call trace with 6.12: > > https://bugzilla.yoctoproject.org/show_bug.cgi?id=15704 > > I've done some testing of genericarm64 machine builds on AMD KV260 which > I could also contribute to yocto-testresults-contrib repo, as well as some > fixes/changes to oe-core/poky and/or bug reports/feature requests: > > * testing done in Linaro Lava lab with AMD KV260 devices running Linaro > Truste Substrate u-boot > based firmware with secure boot disabled > ( https://gitlab.com/Linaro/trustedsubstrate/meta-ts ). > HW has been slightly modified to enable flashing firmware and SW > automatically. > > * default poky distro build images don't work for testing because serial > console getty > setup is broken. Thus serial login prompt fails which our Lava testing uses to > detect > a fully booted system. Fix is to add KV260 serial console to genericarm64 or > to fix > serial console detection with udev also on sysvinit. systemd images with > udev work > correctly. Example: > > https://ledge.validation.linaro.org/scheduler/job/99486 > > INIT: Id "S0" respawning too fast: disabled for 5 minutes > INIT: Id "S1" respawning too fast: disabled for 5 minutes > INIT: Id "S2" respawning too fast: disabled for 5 minutes > INIT: Id "S0" respawning too fast: disabled for 5 minutes > INIT: Id "S1" respawning too fast: disabled for 5 minutes > INIT: Id "S2" respawning too fast: disabled for 5 minutes > > * testexport.bbclass not enabled so testing outside of build environment is > hard. > Using exported tests works well in Linaro Lava so I've enable them in the test > build > and modified the output files to contain full image name to easily match > image with image specific test export file. Draft patch: > > --- a/meta/classes-recipe/testexport.bbclass > +++ b/meta/classes-recipe/testexport.bbclass > @@ -139,7 +139,7 @@ def copy_needed_files(d, tc): > shutil.rmtree(os.path.join(subdir, dir)) > > # Create tar file for common parts of testexport > - testexport_create_tarball(d, "testexport.tar.gz", > d.getVar("TEST_EXPORT_DIR")) > + testexport_create_tarball(d, "testexport_" + > + d.getVar('IMAGE_LINK_NAME') + ".tar.gz", d.getVar("TEST_EXPORT_DIR")) > > # Copy packages needed for runtime testing > package_extraction(d, tc.suites) > > Enabled in local.conf with: > > IMAGE_CLASSES += "testexport testimage" > > * Since serial console works correctly with systemd init, testing poky-altcfg > distro > instead of poky, but that downgrades kernel from 6.12 to 6.6 which is not > that interesting > for us. Thus updated kernel to 6.12 with draft poky change: > > --- a/meta-poky/conf/distro/include/poky-distro-alt-test-config.inc > +++ b/meta-poky/conf/distro/include/poky-distro-alt-test-config.inc > @@ -2,7 +2,7 @@ > DISTRO_FEATURES:append = " pam usrmerge" > > # Use our alternate kernel version > -PREFERRED_VERSION_linux-yocto = "6.6%" > +#PREFERRED_VERSION_linux-yocto = "6.6%" > > # Ensure the kernel nfs server is enabled KERNEL_FEATURES:append:pn-linux- > yocto = " features/nfsd/nfsd-enable.scc" > > * core-image-base boots to serial console login and reboot succeeds. Further > testing > with oeqa runtime does not work since SSH server not installed. > > https://ledge.validation.linaro.org/scheduler/job/99485 > > * core-image-minimal boots to serial console login and reboot succeeds. > Further testing > with oeqa runtime does not work since no SSH server installed. > > https://ledge.validation.linaro.org/scheduler/job/99484 > > * core-image-sato boots to serial console login and reboot succeeds. Since > SSH server is > on image oeqa runtime tests run and results are: > > https://ledge.validation.linaro.org/scheduler/job/99483 > > 2025-01-09 08:08:13,221 - runtime - INFO - Ran 73 tests in 186.726s > 2025-01-09 08:08:13,222 - runtime - INFO - FAILED > 2025-01-09 08:08:13,222 - runtime - INFO - (failures=4, skipped=49) > 2025-01-09 08:08:13,239 - runtime - INFO - RESULTS: > 2025-01-09 08:08:13,239 - runtime - INFO - RESULTS - > connman.ConnmanTest.test_connmand_help: PASSED (0.75s) > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > connman.ConnmanTest.test_connmand_running: PASSED (0.70s) > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > date.DateTest.test_date: PASSED (9.10s) > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - df.DfTest.test_df: > PASSED (0.74s) > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > oe_syslog.SyslogTest.test_syslog_running: PASSED (0.72s) > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > oe_syslog.SyslogTestConfig.test_syslog_logger: PASSED (2.28s) > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > oe_syslog.SyslogTestConfig.test_syslog_restart: PASSED (1.31s) > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > pam.PamBasicTest.test_pam: PASSED (2.88s) > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > parselogs.ParseLogsTest.test_get_context: PASSED (0.00s) > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > ping.PingTest.test_ping: PASSED (0.01s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > python.PythonTest.test_python3: PASSED (1.25s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > scp.ScpTest.test_scp_file: PASSED (2.81s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - ssh.SSHTest.test_ssh: > PASSED (0.72s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > systemd.SystemdBasicTests.test_systemd_basic: PASSED (0.71s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > systemd.SystemdBasicTests.test_systemd_list: PASSED (3.07s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > systemd.SystemdJournalTests.test_systemd_boot_time: PASSED (0.89s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > systemd.SystemdJournalTests.test_systemd_journal: PASSED (1.12s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > systemd.SystemdServiceTests.test_systemd_disable_enable: PASSED (7.29s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > systemd.SystemdServiceTests.test_systemd_status: PASSED (0.76s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > systemd.SystemdServiceTests.test_systemd_stop_start: PASSED (2.78s) > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > apt.AptRepoTest.test_apt_install_from_repo: SKIPPED (0.00s) > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > buildcpio.BuildCpioTest.test_cpio: SKIPPED (0.00s) > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > buildgalculator.GalculatorTest.test_galculator: SKIPPED (0.00s) > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > buildlzip.BuildLzipTest.test_lzip: SKIPPED (0.00s) > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > dnf.DnfBasicTest.test_dnf_help: SKIPPED (0.00s) > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > dnf.DnfBasicTest.test_dnf_history: SKIPPED (0.00s) > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > dnf.DnfBasicTest.test_dnf_info: SKIPPED (0.00s) > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > dnf.DnfBasicTest.test_dnf_search: SKIPPED (0.00s) > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > dnf.DnfBasicTest.test_dnf_version: SKIPPED (0.00s) > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_exclude: SKIPPED (0.00s) > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_install: SKIPPED (0.00s) > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_install_dependency: SKIPPED (0.00s) > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_install_from_disk: SKIPPED (0.00s) > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_install_from_http: SKIPPED (0.00s) > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_installroot: SKIPPED (0.00s) > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_installroot_usrmerge: SKIPPED (0.00s) > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_makecache: SKIPPED (0.00s) > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_reinstall: SKIPPED (0.00s) > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_repoinfo: SKIPPED (0.00s) > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > gcc.GccCompileTest.test_gcc_compile: SKIPPED (0.00s) > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > gcc.GccCompileTest.test_gpp2_compile: SKIPPED (0.00s) > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > gcc.GccCompileTest.test_gpp_compile: SKIPPED (0.00s) > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > gcc.GccCompileTest.test_make: SKIPPED (0.00s) > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > gi.GObjectIntrospectionTest.test_python: SKIPPED (0.00s) > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > go.GoHelloworldTest.test_gohelloworld: SKIPPED (0.00s) > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > kernelmodule.KernelModuleTest.test_kernel_module: SKIPPED (0.00s) > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - ldd.LddTest.test_ldd: > SKIPPED (0.00s) > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > logrotate.LogrotateTest.test_logrotate_newlog: SKIPPED (0.00s) > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > logrotate.LogrotateTest.test_logrotate_wtmp: SKIPPED (0.00s) > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > oe_syslog.SyslogTestConfig.test_syslog_startup_config: SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > perl.PerlTest.test_perl_works: SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > ptest.PtestRunnerTest.test_ptestrunner_expectfail: SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > ptest.PtestRunnerTest.test_ptestrunner_expectsuccess: SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > rpm.RpmBasicTest.test_rpm_help: SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > rpm.RpmBasicTest.test_rpm_query: SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > rpm.RpmBasicTest.test_rpm_query_nonroot: SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > rpm.RpmInstallRemoveTest.test_check_rpm_install_removal_log_file_size: > SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > rpm.RpmInstallRemoveTest.test_rpm_install: SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > rpm.RpmInstallRemoveTest.test_rpm_remove: SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > rust.RustCLibExampleTest.test_rust_c_lib_example: SKIPPED (0.00s) > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > rust.RustCompileTest.test_cargo_compile: SKIPPED (0.00s) > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > rust.RustCompileTest.test_rust_compile: SKIPPED (0.00s) > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > stap.StapTest.test_stap: SKIPPED (0.00s) > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > systemd.SystemdServiceTests.test_systemd_coredump_minidebuginfo: > SKIPPED (0.00s) > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > systemd.SystemdServiceTests.test_systemd_disable_enable_ro: SKIPPED > (0.00s) > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > weston.WestonTest.test_wayland_info: SKIPPED (0.00s) > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > weston.WestonTest.test_weston_can_initialize_new_wayland_compositor: > SKIPPED (0.00s) > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > weston.WestonTest.test_weston_running: SKIPPED (0.00s) > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > weston.WestonTest.test_weston_supports_xwayland: SKIPPED (0.00s) > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > opkg.OpkgRepoTest.test_opkg_install_from_repo: FAILED (135.86s) > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > parselogs.ParseLogsTest.test_parselogs: FAILED (4.76s) > 2025-01-09 08:08:13,247 - runtime - INFO - RESULTS - > systemd.SystemdBasicTests.test_systemd_failed: FAILED (2.19s) > 2025-01-09 08:08:13,247 - runtime - INFO - RESULTS - > xorg.XorgTest.test_xorg_running: FAILED (1.27s) > 2025-01-09 08:08:13,250 - runtime - INFO - SUMMARY: > 2025-01-09 08:08:13,250 - runtime - INFO - runtime () - Ran 73 tests in > 186.734s > 2025-01-09 08:08:13,250 - runtime - INFO - runtime - FAIL - Required tests > failed (successes=20, skipped=49, failures=4, errors=0) > > opkg.OpkgRepoTest.test_opkg_install_from_repo failure is a test setup issue > since > package repo from build environment is not exported to test environment. > > parselogs.ParseLogsTest.test_parselogs fails since firmware and kernel trigger > some new > non-fatal warnings to dmesg. Needs detailed investigation to either supress > warnings or > to fix root causes. > > systemd.SystemdBasicTests.test_systemd_failed fails since xserver- > nodm.service fails > start. X11 graphics support on AMD KV260 is not enabled or working yet on > genericarm64 > machine. > > xorg.XorgTest.test_xorg_running fails since xorg startup fails. > > * core-image-weston boots to serial console login and reboot succeeds. SSH > server is installed > so oeqa runtime tests run and results are: > > https://ledge.validation.linaro.org/scheduler/job/99486 > > 2025-01-09 08:55:34,919 - runtime - INFO - --------------------------------------- > ------------------------------- > 2025-01-09 08:55:34,919 - runtime - INFO - Ran 73 tests in 192.950s > 2025-01-09 08:55:34,920 - runtime - INFO - FAILED > 2025-01-09 08:55:34,920 - runtime - INFO - (failures=6, skipped=49) > 2025-01-09 08:55:34,937 - runtime - INFO - RESULTS: > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > date.DateTest.test_date: PASSED (9.06s) > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - df.DfTest.test_df: > PASSED (0.73s) > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > oe_syslog.SyslogTest.test_syslog_running: PASSED (0.71s) > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > oe_syslog.SyslogTestConfig.test_syslog_logger: PASSED (2.29s) > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > oe_syslog.SyslogTestConfig.test_syslog_restart: PASSED (1.29s) > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > pam.PamBasicTest.test_pam: PASSED (2.89s) > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > parselogs.ParseLogsTest.test_get_context: PASSED (0.00s) > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > ping.PingTest.test_ping: PASSED (0.01s) > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > scp.ScpTest.test_scp_file: PASSED (2.78s) > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - ssh.SSHTest.test_ssh: > PASSED (0.74s) > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > systemd.SystemdBasicTests.test_systemd_basic: PASSED (0.69s) > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > systemd.SystemdBasicTests.test_systemd_list: PASSED (3.10s) > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > systemd.SystemdJournalTests.test_systemd_boot_time: PASSED (0.91s) > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > systemd.SystemdJournalTests.test_systemd_journal: PASSED (1.11s) > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > systemd.SystemdServiceTests.test_systemd_disable_enable: PASSED (7.28s) > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > systemd.SystemdServiceTests.test_systemd_status: PASSED (0.76s) > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > systemd.SystemdServiceTests.test_systemd_stop_start: PASSED (2.75s) > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > weston.WestonTest.test_wayland_info: PASSED (7.56s) > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > apt.AptRepoTest.test_apt_install_from_repo: SKIPPED (0.00s) > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > buildcpio.BuildCpioTest.test_cpio: SKIPPED (0.00s) > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > buildgalculator.GalculatorTest.test_galculator: SKIPPED (0.00s) > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > buildlzip.BuildLzipTest.test_lzip: SKIPPED (0.00s) > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > connman.ConnmanTest.test_connmand_help: SKIPPED (0.00s) > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > connman.ConnmanTest.test_connmand_running: SKIPPED (0.00s) > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > dnf.DnfBasicTest.test_dnf_help: SKIPPED (0.00s) > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > dnf.DnfBasicTest.test_dnf_history: SKIPPED (0.00s) > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > dnf.DnfBasicTest.test_dnf_info: SKIPPED (0.00s) > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > dnf.DnfBasicTest.test_dnf_search: SKIPPED (0.00s) > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > dnf.DnfBasicTest.test_dnf_version: SKIPPED (0.00s) > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_exclude: SKIPPED (0.00s) > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_install: SKIPPED (0.00s) > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_install_dependency: SKIPPED (0.00s) > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_install_from_disk: SKIPPED (0.00s) > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_install_from_http: SKIPPED (0.00s) > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_installroot: SKIPPED (0.00s) > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_installroot_usrmerge: SKIPPED (0.00s) > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_makecache: SKIPPED (0.00s) > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_reinstall: SKIPPED (0.00s) > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > dnf.DnfRepoTest.test_dnf_repoinfo: SKIPPED (0.00s) > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > gcc.GccCompileTest.test_gcc_compile: SKIPPED (0.00s) > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > gcc.GccCompileTest.test_gpp2_compile: SKIPPED (0.00s) > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > gcc.GccCompileTest.test_gpp_compile: SKIPPED (0.00s) > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > gcc.GccCompileTest.test_make: SKIPPED (0.00s) > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > gi.GObjectIntrospectionTest.test_python: SKIPPED (0.00s) > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > go.GoHelloworldTest.test_gohelloworld: SKIPPED (0.00s) > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > kernelmodule.KernelModuleTest.test_kernel_module: SKIPPED (0.00s) > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - ldd.LddTest.test_ldd: > SKIPPED (0.00s) > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > logrotate.LogrotateTest.test_logrotate_newlog: SKIPPED (0.00s) > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > logrotate.LogrotateTest.test_logrotate_wtmp: SKIPPED (0.00s) > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > oe_syslog.SyslogTestConfig.test_syslog_startup_config: SKIPPED (0.00s) > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > perl.PerlTest.test_perl_works: SKIPPED (0.00s) > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > ptest.PtestRunnerTest.test_ptestrunner_expectfail: SKIPPED (0.00s) > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > ptest.PtestRunnerTest.test_ptestrunner_expectsuccess: SKIPPED (0.00s) > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > python.PythonTest.test_python3: SKIPPED (0.00s) > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > rpm.RpmBasicTest.test_rpm_help: SKIPPED (0.00s) > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > rpm.RpmBasicTest.test_rpm_query: SKIPPED (0.00s) > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > rpm.RpmBasicTest.test_rpm_query_nonroot: SKIPPED (0.00s) > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > rpm.RpmInstallRemoveTest.test_check_rpm_install_removal_log_file_size: > SKIPPED (0.00s) > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > rpm.RpmInstallRemoveTest.test_rpm_install: SKIPPED (0.00s) > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > rpm.RpmInstallRemoveTest.test_rpm_remove: SKIPPED (0.00s) > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > rust.RustCLibExampleTest.test_rust_c_lib_example: SKIPPED (0.00s) > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > rust.RustCompileTest.test_cargo_compile: SKIPPED (0.00s) > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > rust.RustCompileTest.test_rust_compile: SKIPPED (0.00s) > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > stap.StapTest.test_stap: SKIPPED (0.00s) > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > systemd.SystemdServiceTests.test_systemd_coredump_minidebuginfo: > SKIPPED (0.00s) > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > systemd.SystemdServiceTests.test_systemd_disable_enable_ro: SKIPPED > (0.00s) > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > xorg.XorgTest.test_xorg_running: SKIPPED (0.00s) > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > opkg.OpkgRepoTest.test_opkg_install_from_repo: FAILED (136.68s) > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > parselogs.ParseLogsTest.test_parselogs: FAILED (4.11s) > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > systemd.SystemdBasicTests.test_systemd_failed: FAILED (2.21s) > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > weston.WestonTest.test_weston_can_initialize_new_wayland_compositor: > FAILED (0.54s) > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > weston.WestonTest.test_weston_running: FAILED (1.27s) > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > weston.WestonTest.test_weston_supports_xwayland: FAILED (0.73s) > 2025-01-09 08:55:34,948 - runtime - INFO - SUMMARY: > 2025-01-09 08:55:34,948 - runtime - INFO - runtime () - Ran 73 tests in > 192.962s > 2025-01-09 08:55:34,948 - runtime - INFO - runtime - FAIL - Required tests > failed (successes=18, skipped=49, failures=6, errors=0) > > opkg.OpkgRepoTest.test_opkg_install_from_repo fails like on core-image- > sato with same root cause, > missing package repo in test environment. > > parselogs.ParseLogsTest.test_parselogs fails like on core-image-sato. > > systemd.SystemdBasicTests.test_systemd_failed fails since weston.service > fails > to start. Details need to be investigated and likely related to graphics stack > not setup yet on genericarm64 for AMD KV260. > > weston.WestonTest.test_weston_can_initialize_new_wayland_compositor > fails since > weston.service startup fails. > > weston.WestonTest.test_weston_running fails since weston.service startup > fails. > > weston.WestonTest.test_weston_supports_xwayland fails since > weston.service startup > fails. > > I could upload testresult.json files from these test runs to yocto-testresults- > contrib. > Which branch name should I use? Any reviews needed for the changes? I > could also report the test failures to bugzilla, if that makes sense. I will try get > these fixed and also improve the tests, for example the small images without > SSH could be checked a bit more over serial console. > > Any feedback to this first test run is welcome. > > Cheers, > > -Mikko > > > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > View/Reply Online (#495): https://lists.yoctoproject.org/g/qa-build- > notification/message/495 > Mute This Topic: https://lists.yoctoproject.org/mt/110516091/6424044 > Group Owner: qa-build-notification+owner@lists.yoctoproject.org > Unsubscribe: https://lists.yoctoproject.org/g/qa-build- > notification/leave/13581802/6424044/1746813897/xyzzy > [jing.hui.tham@intel.com] > -=-=-=-=-=-=-=-=-=-=-=- > ^ permalink raw reply [flat|nested] 7+ messages in thread
* Re: [OE-core] [qa-build-notification] QA notification for completed autobuilder build (yocto-5.2_M1.rc2) 2025-01-10 12:14 ` Tham, Jing Hui @ 2025-01-10 12:56 ` Mikko Rapeli 0 siblings, 0 replies; 7+ messages in thread From: Mikko Rapeli @ 2025-01-10 12:56 UTC (permalink / raw) To: qa-build-notification Cc: <yocto@lists.yoctoproject.org>, openembedded-core@lists.openembedded.org, Ross Burton, Ilias Apalodimas, Bill Mills Hi, On Fri, Jan 10, 2025 at 12:14:05PM +0000, Jing Hui Tham via lists.yoctoproject.org wrote: > Hi, > > You may refer to the wiki page for tests on HW. : https://wiki.yoctoproject.org/wiki/BSP_Test_Plan > > For single testresults.json file, you can use below command to merge both testresults to single testresult file. > $ resulttool merge <testA.json> <testB.json> Thanks, the wikipage explains a lot! Maybe this could be linked in the results repo or in some documentation about release testing. Cheers, -Mikko > > Regards, > Jing Hui > > > -----Original Message----- > > From: qa-build-notification@lists.yoctoproject.org <qa-build- > > notification@lists.yoctoproject.org> On Behalf Of Mikko Rapeli via > > lists.yoctoproject.org > > Sent: Thursday, January 9, 2025 10:17 PM > > To: Tham, Jing Hui <jing.hui.tham@intel.com> > > Cc: qa-build-notification@lists.yoctoproject.org; > > <yocto@lists.yoctoproject.org> <yocto@lists.yoctoproject.org>; > > openembedded-core@lists.openembedded.org; Ross Burton > > <Ross.Burton@arm.com>; Ilias Apalodimas <ilias.apalodimas@linaro.org>; Bill > > Mills <bill.mills@linaro.org> > > Subject: Re: [OE-core] [qa-build-notification] QA notification for completed > > autobuilder build (yocto-5.2_M1.rc2) > > > > Hi > > > > On Mon, Dec 30, 2024 at 08:33:17AM +0000, Jing Hui Tham via > > lists.openembedded.org wrote: > > > QA for yocto-5.2_M1.rc2 is completed. This is the full report for yocto- > > 5.2_M1.rc2: > > > https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/t > > > ree/?h=intel-yocto-testresults > > > > How are these results generated for each HW? > > > > Do you run a build for the machine with some special config on a build > > machine which has the test target connected? > > > > Specificially, I'm wondering how to run the manual tests and oeqa runtime > > tests at the same time to produce a single testresults.json file which has both. > > > > The result json files show which images get tested. > > > > How did you select these for each HW? > > > > Default oeqa runtime tests from TEST_SUITES variable for images without SSH > > server don't really work so core-image-base and core-image-minimal testing > > doesn't find anything. > > Only core-image-sato, core-image-weston etc have SSH server and real tests > > find something. > > I wonder if some other tests should be done for these images without SSH > > over serial console. > > > > > ======= Summary ======== > > > For Beaglebone, there is a new bug found: Bug 15703 - [5.2 M1 RC2] Fail to > > start matchbox-desktop on beaglebone: > > > https://bugzilla.yoctoproject.org/show_bug.cgi?id=15703 > > > Since there is no graphic desktop, all graphics-related test cases are skipped. > > > > > > For the new BSP BeaglePlay, the test for genericarm64 image could not be > > completed due to bug 15704. So there are only test results for genericarm64- > > alt image this time. > > > Bug 15704 - [5.2 M1 RC2] BeaglePlay: System hangs randomly and kernel > > call trace with 6.12: > > > https://bugzilla.yoctoproject.org/show_bug.cgi?id=15704 > > > > I've done some testing of genericarm64 machine builds on AMD KV260 which > > I could also contribute to yocto-testresults-contrib repo, as well as some > > fixes/changes to oe-core/poky and/or bug reports/feature requests: > > > > * testing done in Linaro Lava lab with AMD KV260 devices running Linaro > > Truste Substrate u-boot > > based firmware with secure boot disabled > > ( https://gitlab.com/Linaro/trustedsubstrate/meta-ts ). > > HW has been slightly modified to enable flashing firmware and SW > > automatically. > > > > * default poky distro build images don't work for testing because serial > > console getty > > setup is broken. Thus serial login prompt fails which our Lava testing uses to > > detect > > a fully booted system. Fix is to add KV260 serial console to genericarm64 or > > to fix > > serial console detection with udev also on sysvinit. systemd images with > > udev work > > correctly. Example: > > > > https://ledge.validation.linaro.org/scheduler/job/99486 > > > > INIT: Id "S0" respawning too fast: disabled for 5 minutes > > INIT: Id "S1" respawning too fast: disabled for 5 minutes > > INIT: Id "S2" respawning too fast: disabled for 5 minutes > > INIT: Id "S0" respawning too fast: disabled for 5 minutes > > INIT: Id "S1" respawning too fast: disabled for 5 minutes > > INIT: Id "S2" respawning too fast: disabled for 5 minutes > > > > * testexport.bbclass not enabled so testing outside of build environment is > > hard. > > Using exported tests works well in Linaro Lava so I've enable them in the test > > build > > and modified the output files to contain full image name to easily match > > image with image specific test export file. Draft patch: > > > > --- a/meta/classes-recipe/testexport.bbclass > > +++ b/meta/classes-recipe/testexport.bbclass > > @@ -139,7 +139,7 @@ def copy_needed_files(d, tc): > > shutil.rmtree(os.path.join(subdir, dir)) > > > > # Create tar file for common parts of testexport > > - testexport_create_tarball(d, "testexport.tar.gz", > > d.getVar("TEST_EXPORT_DIR")) > > + testexport_create_tarball(d, "testexport_" + > > + d.getVar('IMAGE_LINK_NAME') + ".tar.gz", d.getVar("TEST_EXPORT_DIR")) > > > > # Copy packages needed for runtime testing > > package_extraction(d, tc.suites) > > > > Enabled in local.conf with: > > > > IMAGE_CLASSES += "testexport testimage" > > > > * Since serial console works correctly with systemd init, testing poky-altcfg > > distro > > instead of poky, but that downgrades kernel from 6.12 to 6.6 which is not > > that interesting > > for us. Thus updated kernel to 6.12 with draft poky change: > > > > --- a/meta-poky/conf/distro/include/poky-distro-alt-test-config.inc > > +++ b/meta-poky/conf/distro/include/poky-distro-alt-test-config.inc > > @@ -2,7 +2,7 @@ > > DISTRO_FEATURES:append = " pam usrmerge" > > > > # Use our alternate kernel version > > -PREFERRED_VERSION_linux-yocto = "6.6%" > > +#PREFERRED_VERSION_linux-yocto = "6.6%" > > > > # Ensure the kernel nfs server is enabled KERNEL_FEATURES:append:pn-linux- > > yocto = " features/nfsd/nfsd-enable.scc" > > > > * core-image-base boots to serial console login and reboot succeeds. Further > > testing > > with oeqa runtime does not work since SSH server not installed. > > > > https://ledge.validation.linaro.org/scheduler/job/99485 > > > > * core-image-minimal boots to serial console login and reboot succeeds. > > Further testing > > with oeqa runtime does not work since no SSH server installed. > > > > https://ledge.validation.linaro.org/scheduler/job/99484 > > > > * core-image-sato boots to serial console login and reboot succeeds. Since > > SSH server is > > on image oeqa runtime tests run and results are: > > > > https://ledge.validation.linaro.org/scheduler/job/99483 > > > > 2025-01-09 08:08:13,221 - runtime - INFO - Ran 73 tests in 186.726s > > 2025-01-09 08:08:13,222 - runtime - INFO - FAILED > > 2025-01-09 08:08:13,222 - runtime - INFO - (failures=4, skipped=49) > > 2025-01-09 08:08:13,239 - runtime - INFO - RESULTS: > > 2025-01-09 08:08:13,239 - runtime - INFO - RESULTS - > > connman.ConnmanTest.test_connmand_help: PASSED (0.75s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > connman.ConnmanTest.test_connmand_running: PASSED (0.70s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > date.DateTest.test_date: PASSED (9.10s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - df.DfTest.test_df: > > PASSED (0.74s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTest.test_syslog_running: PASSED (0.72s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_logger: PASSED (2.28s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_restart: PASSED (1.31s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > pam.PamBasicTest.test_pam: PASSED (2.88s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > parselogs.ParseLogsTest.test_get_context: PASSED (0.00s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > ping.PingTest.test_ping: PASSED (0.01s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > python.PythonTest.test_python3: PASSED (1.25s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > scp.ScpTest.test_scp_file: PASSED (2.81s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - ssh.SSHTest.test_ssh: > > PASSED (0.72s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_basic: PASSED (0.71s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_list: PASSED (3.07s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdJournalTests.test_systemd_boot_time: PASSED (0.89s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdJournalTests.test_systemd_journal: PASSED (1.12s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_disable_enable: PASSED (7.29s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_status: PASSED (0.76s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_stop_start: PASSED (2.78s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > apt.AptRepoTest.test_apt_install_from_repo: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > buildcpio.BuildCpioTest.test_cpio: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > buildgalculator.GalculatorTest.test_galculator: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > buildlzip.BuildLzipTest.test_lzip: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_help: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_history: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_info: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_search: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_version: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_exclude: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_dependency: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_from_disk: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_from_http: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_installroot: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_installroot_usrmerge: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_makecache: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_reinstall: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_repoinfo: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gcc_compile: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gpp2_compile: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gpp_compile: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_make: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > gi.GObjectIntrospectionTest.test_python: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > go.GoHelloworldTest.test_gohelloworld: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > kernelmodule.KernelModuleTest.test_kernel_module: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - ldd.LddTest.test_ldd: > > SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > logrotate.LogrotateTest.test_logrotate_newlog: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > logrotate.LogrotateTest.test_logrotate_wtmp: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_startup_config: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > perl.PerlTest.test_perl_works: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > ptest.PtestRunnerTest.test_ptestrunner_expectfail: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > ptest.PtestRunnerTest.test_ptestrunner_expectsuccess: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_help: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_query: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_query_nonroot: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_check_rpm_install_removal_log_file_size: > > SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_rpm_install: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_rpm_remove: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rust.RustCLibExampleTest.test_rust_c_lib_example: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rust.RustCompileTest.test_cargo_compile: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > rust.RustCompileTest.test_rust_compile: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > stap.StapTest.test_stap: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_coredump_minidebuginfo: > > SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_disable_enable_ro: SKIPPED > > (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > weston.WestonTest.test_wayland_info: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_can_initialize_new_wayland_compositor: > > SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_running: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_supports_xwayland: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > opkg.OpkgRepoTest.test_opkg_install_from_repo: FAILED (135.86s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > parselogs.ParseLogsTest.test_parselogs: FAILED (4.76s) > > 2025-01-09 08:08:13,247 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_failed: FAILED (2.19s) > > 2025-01-09 08:08:13,247 - runtime - INFO - RESULTS - > > xorg.XorgTest.test_xorg_running: FAILED (1.27s) > > 2025-01-09 08:08:13,250 - runtime - INFO - SUMMARY: > > 2025-01-09 08:08:13,250 - runtime - INFO - runtime () - Ran 73 tests in > > 186.734s > > 2025-01-09 08:08:13,250 - runtime - INFO - runtime - FAIL - Required tests > > failed (successes=20, skipped=49, failures=4, errors=0) > > > > opkg.OpkgRepoTest.test_opkg_install_from_repo failure is a test setup issue > > since > > package repo from build environment is not exported to test environment. > > > > parselogs.ParseLogsTest.test_parselogs fails since firmware and kernel trigger > > some new > > non-fatal warnings to dmesg. Needs detailed investigation to either supress > > warnings or > > to fix root causes. > > > > systemd.SystemdBasicTests.test_systemd_failed fails since xserver- > > nodm.service fails > > start. X11 graphics support on AMD KV260 is not enabled or working yet on > > genericarm64 > > machine. > > > > xorg.XorgTest.test_xorg_running fails since xorg startup fails. > > > > * core-image-weston boots to serial console login and reboot succeeds. SSH > > server is installed > > so oeqa runtime tests run and results are: > > > > https://ledge.validation.linaro.org/scheduler/job/99486 > > > > 2025-01-09 08:55:34,919 - runtime - INFO - --------------------------------------- > > ------------------------------- > > 2025-01-09 08:55:34,919 - runtime - INFO - Ran 73 tests in 192.950s > > 2025-01-09 08:55:34,920 - runtime - INFO - FAILED > > 2025-01-09 08:55:34,920 - runtime - INFO - (failures=6, skipped=49) > > 2025-01-09 08:55:34,937 - runtime - INFO - RESULTS: > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > date.DateTest.test_date: PASSED (9.06s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - df.DfTest.test_df: > > PASSED (0.73s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTest.test_syslog_running: PASSED (0.71s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_logger: PASSED (2.29s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_restart: PASSED (1.29s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > pam.PamBasicTest.test_pam: PASSED (2.89s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > parselogs.ParseLogsTest.test_get_context: PASSED (0.00s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > ping.PingTest.test_ping: PASSED (0.01s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > scp.ScpTest.test_scp_file: PASSED (2.78s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - ssh.SSHTest.test_ssh: > > PASSED (0.74s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_basic: PASSED (0.69s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_list: PASSED (3.10s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdJournalTests.test_systemd_boot_time: PASSED (0.91s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdJournalTests.test_systemd_journal: PASSED (1.11s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_disable_enable: PASSED (7.28s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_status: PASSED (0.76s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_stop_start: PASSED (2.75s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > weston.WestonTest.test_wayland_info: PASSED (7.56s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > apt.AptRepoTest.test_apt_install_from_repo: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > buildcpio.BuildCpioTest.test_cpio: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > buildgalculator.GalculatorTest.test_galculator: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > buildlzip.BuildLzipTest.test_lzip: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > connman.ConnmanTest.test_connmand_help: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > connman.ConnmanTest.test_connmand_running: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_help: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_history: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_info: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_search: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_version: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_exclude: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_dependency: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_from_disk: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_from_http: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_installroot: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_installroot_usrmerge: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_makecache: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_reinstall: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_repoinfo: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gcc_compile: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gpp2_compile: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gpp_compile: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_make: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > gi.GObjectIntrospectionTest.test_python: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > go.GoHelloworldTest.test_gohelloworld: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > kernelmodule.KernelModuleTest.test_kernel_module: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - ldd.LddTest.test_ldd: > > SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > logrotate.LogrotateTest.test_logrotate_newlog: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > logrotate.LogrotateTest.test_logrotate_wtmp: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_startup_config: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > perl.PerlTest.test_perl_works: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > ptest.PtestRunnerTest.test_ptestrunner_expectfail: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > ptest.PtestRunnerTest.test_ptestrunner_expectsuccess: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > python.PythonTest.test_python3: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_help: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_query: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_query_nonroot: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_check_rpm_install_removal_log_file_size: > > SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_rpm_install: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_rpm_remove: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > rust.RustCLibExampleTest.test_rust_c_lib_example: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > rust.RustCompileTest.test_cargo_compile: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > rust.RustCompileTest.test_rust_compile: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > stap.StapTest.test_stap: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_coredump_minidebuginfo: > > SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_disable_enable_ro: SKIPPED > > (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > xorg.XorgTest.test_xorg_running: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > opkg.OpkgRepoTest.test_opkg_install_from_repo: FAILED (136.68s) > > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > > parselogs.ParseLogsTest.test_parselogs: FAILED (4.11s) > > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_failed: FAILED (2.21s) > > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_can_initialize_new_wayland_compositor: > > FAILED (0.54s) > > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_running: FAILED (1.27s) > > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_supports_xwayland: FAILED (0.73s) > > 2025-01-09 08:55:34,948 - runtime - INFO - SUMMARY: > > 2025-01-09 08:55:34,948 - runtime - INFO - runtime () - Ran 73 tests in > > 192.962s > > 2025-01-09 08:55:34,948 - runtime - INFO - runtime - FAIL - Required tests > > failed (successes=18, skipped=49, failures=6, errors=0) > > > > opkg.OpkgRepoTest.test_opkg_install_from_repo fails like on core-image- > > sato with same root cause, > > missing package repo in test environment. > > > > parselogs.ParseLogsTest.test_parselogs fails like on core-image-sato. > > > > systemd.SystemdBasicTests.test_systemd_failed fails since weston.service > > fails > > to start. Details need to be investigated and likely related to graphics stack > > not setup yet on genericarm64 for AMD KV260. > > > > weston.WestonTest.test_weston_can_initialize_new_wayland_compositor > > fails since > > weston.service startup fails. > > > > weston.WestonTest.test_weston_running fails since weston.service startup > > fails. > > > > weston.WestonTest.test_weston_supports_xwayland fails since > > weston.service startup > > fails. > > > > I could upload testresult.json files from these test runs to yocto-testresults- > > contrib. > > Which branch name should I use? Any reviews needed for the changes? I > > could also report the test failures to bugzilla, if that makes sense. I will try get > > these fixed and also improve the tests, for example the small images without > > SSH could be checked a bit more over serial console. > > > > Any feedback to this first test run is welcome. > > > > Cheers, > > > > -Mikko > > > > > > > > > > > > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > View/Reply Online (#497): https://lists.yoctoproject.org/g/qa-build-notification/message/497 > Mute This Topic: https://lists.yoctoproject.org/mt/110516091/7159507 > Group Owner: qa-build-notification+owner@lists.yoctoproject.org > Unsubscribe: https://lists.yoctoproject.org/g/qa-build-notification/leave/13855390/7159507/999868192/xyzzy [mikko.rapeli@linaro.org] > -=-=-=-=-=-=-=-=-=-=-=- > > ^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2025-01-10 12:56 UTC | newest] Thread overview: 7+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2024-12-15 22:47 QA notification for completed autobuilder build (yocto-5.2_M1.rc2) Richard Purdie 2024-12-19 14:48 ` [qa-build-notification] " Tham, Jing Hui 2024-12-30 8:29 ` Tham, Jing Hui 2024-12-30 8:33 ` Tham, Jing Hui 2025-01-09 14:17 ` [OE-core] " Mikko Rapeli 2025-01-10 12:14 ` Tham, Jing Hui 2025-01-10 12:56 ` Mikko Rapeli
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.