From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from aws-us-west-2-korg-lkml-1.web.codeaurora.org (localhost.localdomain [127.0.0.1]) by smtp.lore.kernel.org (Postfix) with ESMTP id 9B700E7719D for ; Fri, 10 Jan 2025 12:56:59 +0000 (UTC) Received: from mail-lf1-f50.google.com (mail-lf1-f50.google.com [209.85.167.50]) by mx.groups.io with SMTP id smtpd.web10.17885.1736513809448507536 for ; Fri, 10 Jan 2025 04:56:50 -0800 Authentication-Results: mx.groups.io; dkim=pass header.i=@linaro.org header.s=google header.b=E0FCe+ra; spf=pass (domain: linaro.org, ip: 209.85.167.50, mailfrom: mikko.rapeli@linaro.org) Received: by mail-lf1-f50.google.com with SMTP id 2adb3069b0e04-53df80eeeedso1944491e87.2 for ; Fri, 10 Jan 2025 04:56:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linaro.org; s=google; t=1736513807; x=1737118607; darn=lists.openembedded.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=phEl4uEDI1vscEc1G5jAoEJp26DzK2FRLxzKO/VcfKc=; b=E0FCe+raMPwnBycVXEnDQIwgHsWCnc4ot+58SrgBvNoPd6cEd/ksIVcAHB+Q/VHcmg Fwp3LbABRu5ImEqmrUgOyOtOR+J+vvu+Jub6dBtsXO1a7LckF/5ihdTrY/CMimh+iZUB NQBgPC9+3OCXXTbXuF78KZXwOr8M1u2uSzvIzzqKfTOQpACDE0paCVGdszSpeI4qxVqH MZPZPPMaJg+owFWFfc+xryPMWuV4sGA9nZOeV5XEr/OVXBL2IDNTWENuCz2/AFFtptiR R8c8nsUsoiSIK2jet4AXDm9GZ7OSF92lJKe7PHaFQ8tFcmFhIzNC8BsEtif6jg53+R+N Zo+g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1736513807; x=1737118607; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=phEl4uEDI1vscEc1G5jAoEJp26DzK2FRLxzKO/VcfKc=; b=QA3pIjB2+XkcytM7txxGY9O0WGFvjqXlfQDoQFCzdBhzNnmQW7c2vMjMsKvHMhcohu 04/2MG5cBU1rrgPxTnPoxdLxU+2A/tvnXv1CgozCpkg+3i1uaDTlkw+E+y0sL9HIn0BM tpK8PPNk+VD9z35Oe/xZK9CB49qHgJuw0yTCWBB9k3JQAtD1faJwlutGupYMoa36G4IL xtRKlGIDZ03k8pVFwhHeAZcoiNGyyjAWGDAeQOjFWE6zF0b3+FqfUpF5yLGhL/OsLdER pOoAC+iGGxoynfwl3mhW8oPgE04Jh0C1kNgjplDUjE/omGgs5RWKjPl5BGQiGFvlily/ yoTw== X-Forwarded-Encrypted: i=1; AJvYcCX9Ke83Zh8o3pCquDzsZRdtFLKHXMx5MjOZFs0LV10TTRiktizk3x+0hhCWLminQW9zjhtZ+LCfCVHPWLPXzdIkdw==@lists.openembedded.org X-Gm-Message-State: AOJu0Yw08f7/FmN2vhNtjIG39TxzmZxLwv5d42i5f0vIVxj5pZe7plPu 3RfLn+5wZC2vyAGF1aJa665lWtP+/THo9Ib7ck4vn0TePC8JKMlFQoUWRwS20vOSLdMNPAhMgAG l X-Gm-Gg: ASbGnctBjcErGXSLudpZsiO8LmvC9CpaO7QhmtFbu2W0/Syu0DPqG53aTnLNaYN3Hca kkVB/nfgG33CL1rowQvP+nip08JnyKbpZUcbx0Bp0+L89hGua+bh0KsMCVPTMLUuPae32GGiWV9 Cr+ZKFVDBz2QB49idEHX9gL2A5fh19j+5eW3+vgOslGPh0f6lAVJTweEHWPXrz+kabsBTKjEDJw 748UPuz3ZBE1Jf+a9Xe0ON9dZ4ukMGE1XYuKqcSMy0Tca0MNCZ8AHegdVTWLbOOOCa1WZYSGA+Z DeT4Sugz1g== X-Google-Smtp-Source: AGHT+IE+ravpGMkeAEtz9+mmgZ0iwob5RLBn+nM2IMUp6J3iut51j+IpGihunXi4MdFhfw1rY7jn3A== X-Received: by 2002:a05:6512:3e17:b0:53d:ed69:a593 with SMTP id 2adb3069b0e04-542845282a5mr3491636e87.22.1736513807369; Fri, 10 Jan 2025 04:56:47 -0800 (PST) Received: from nuoska (2001-14ba-44f-6700--199.rev.dnainternet.fi. [2001:14ba:44f:6700::199]) by smtp.gmail.com with ESMTPSA id 2adb3069b0e04-5428be49f0bsm512667e87.36.2025.01.10.04.56.44 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 10 Jan 2025 04:56:46 -0800 (PST) Date: Fri, 10 Jan 2025 14:56:43 +0200 From: Mikko Rapeli To: qa-build-notification@lists.yoctoproject.org Cc: "" , "openembedded-core@lists.openembedded.org" , Ross Burton , Ilias Apalodimas , Bill Mills Subject: Re: [OE-core] [qa-build-notification] QA notification for completed autobuilder build (yocto-5.2_M1.rc2) Message-ID: References: <2157aff053df3e53717993042e587b20e256f87b.camel@linuxfoundation.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: List-Id: X-Webhook-Received: from li982-79.members.linode.com [45.33.32.79] by aws-us-west-2-korg-lkml-1.web.codeaurora.org with HTTPS for ; Fri, 10 Jan 2025 12:56:59 -0000 X-Groupsio-URL: https://lists.openembedded.org/g/openembedded-core/message/209646 Hi, On Fri, Jan 10, 2025 at 12:14:05PM +0000, Jing Hui Tham via lists.yoctoproject.org wrote: > Hi, > > You may refer to the wiki page for tests on HW. : https://wiki.yoctoproject.org/wiki/BSP_Test_Plan > > For single testresults.json file, you can use below command to merge both testresults to single testresult file. > $ resulttool merge Thanks, the wikipage explains a lot! Maybe this could be linked in the results repo or in some documentation about release testing. Cheers, -Mikko > > Regards, > Jing Hui > > > -----Original Message----- > > From: qa-build-notification@lists.yoctoproject.org > notification@lists.yoctoproject.org> On Behalf Of Mikko Rapeli via > > lists.yoctoproject.org > > Sent: Thursday, January 9, 2025 10:17 PM > > To: Tham, Jing Hui > > Cc: qa-build-notification@lists.yoctoproject.org; > > ; > > openembedded-core@lists.openembedded.org; Ross Burton > > ; Ilias Apalodimas ; Bill > > Mills > > Subject: Re: [OE-core] [qa-build-notification] QA notification for completed > > autobuilder build (yocto-5.2_M1.rc2) > > > > Hi > > > > On Mon, Dec 30, 2024 at 08:33:17AM +0000, Jing Hui Tham via > > lists.openembedded.org wrote: > > > QA for yocto-5.2_M1.rc2 is completed. This is the full report for yocto- > > 5.2_M1.rc2: > > > https://git.yoctoproject.org/cgit/cgit.cgi/yocto-testresults-contrib/t > > > ree/?h=intel-yocto-testresults > > > > How are these results generated for each HW? > > > > Do you run a build for the machine with some special config on a build > > machine which has the test target connected? > > > > Specificially, I'm wondering how to run the manual tests and oeqa runtime > > tests at the same time to produce a single testresults.json file which has both. > > > > The result json files show which images get tested. > > > > How did you select these for each HW? > > > > Default oeqa runtime tests from TEST_SUITES variable for images without SSH > > server don't really work so core-image-base and core-image-minimal testing > > doesn't find anything. > > Only core-image-sato, core-image-weston etc have SSH server and real tests > > find something. > > I wonder if some other tests should be done for these images without SSH > > over serial console. > > > > > ======= Summary ======== > > > For Beaglebone, there is a new bug found: Bug 15703 - [5.2 M1 RC2] Fail to > > start matchbox-desktop on beaglebone: > > > https://bugzilla.yoctoproject.org/show_bug.cgi?id=15703 > > > Since there is no graphic desktop, all graphics-related test cases are skipped. > > > > > > For the new BSP BeaglePlay, the test for genericarm64 image could not be > > completed due to bug 15704. So there are only test results for genericarm64- > > alt image this time. > > > Bug 15704 - [5.2 M1 RC2] BeaglePlay: System hangs randomly and kernel > > call trace with 6.12: > > > https://bugzilla.yoctoproject.org/show_bug.cgi?id=15704 > > > > I've done some testing of genericarm64 machine builds on AMD KV260 which > > I could also contribute to yocto-testresults-contrib repo, as well as some > > fixes/changes to oe-core/poky and/or bug reports/feature requests: > > > > * testing done in Linaro Lava lab with AMD KV260 devices running Linaro > > Truste Substrate u-boot > > based firmware with secure boot disabled > > ( https://gitlab.com/Linaro/trustedsubstrate/meta-ts ). > > HW has been slightly modified to enable flashing firmware and SW > > automatically. > > > > * default poky distro build images don't work for testing because serial > > console getty > > setup is broken. Thus serial login prompt fails which our Lava testing uses to > > detect > > a fully booted system. Fix is to add KV260 serial console to genericarm64 or > > to fix > > serial console detection with udev also on sysvinit. systemd images with > > udev work > > correctly. Example: > > > > https://ledge.validation.linaro.org/scheduler/job/99486 > > > > INIT: Id "S0" respawning too fast: disabled for 5 minutes > > INIT: Id "S1" respawning too fast: disabled for 5 minutes > > INIT: Id "S2" respawning too fast: disabled for 5 minutes > > INIT: Id "S0" respawning too fast: disabled for 5 minutes > > INIT: Id "S1" respawning too fast: disabled for 5 minutes > > INIT: Id "S2" respawning too fast: disabled for 5 minutes > > > > * testexport.bbclass not enabled so testing outside of build environment is > > hard. > > Using exported tests works well in Linaro Lava so I've enable them in the test > > build > > and modified the output files to contain full image name to easily match > > image with image specific test export file. Draft patch: > > > > --- a/meta/classes-recipe/testexport.bbclass > > +++ b/meta/classes-recipe/testexport.bbclass > > @@ -139,7 +139,7 @@ def copy_needed_files(d, tc): > > shutil.rmtree(os.path.join(subdir, dir)) > > > > # Create tar file for common parts of testexport > > - testexport_create_tarball(d, "testexport.tar.gz", > > d.getVar("TEST_EXPORT_DIR")) > > + testexport_create_tarball(d, "testexport_" + > > + d.getVar('IMAGE_LINK_NAME') + ".tar.gz", d.getVar("TEST_EXPORT_DIR")) > > > > # Copy packages needed for runtime testing > > package_extraction(d, tc.suites) > > > > Enabled in local.conf with: > > > > IMAGE_CLASSES += "testexport testimage" > > > > * Since serial console works correctly with systemd init, testing poky-altcfg > > distro > > instead of poky, but that downgrades kernel from 6.12 to 6.6 which is not > > that interesting > > for us. Thus updated kernel to 6.12 with draft poky change: > > > > --- a/meta-poky/conf/distro/include/poky-distro-alt-test-config.inc > > +++ b/meta-poky/conf/distro/include/poky-distro-alt-test-config.inc > > @@ -2,7 +2,7 @@ > > DISTRO_FEATURES:append = " pam usrmerge" > > > > # Use our alternate kernel version > > -PREFERRED_VERSION_linux-yocto = "6.6%" > > +#PREFERRED_VERSION_linux-yocto = "6.6%" > > > > # Ensure the kernel nfs server is enabled KERNEL_FEATURES:append:pn-linux- > > yocto = " features/nfsd/nfsd-enable.scc" > > > > * core-image-base boots to serial console login and reboot succeeds. Further > > testing > > with oeqa runtime does not work since SSH server not installed. > > > > https://ledge.validation.linaro.org/scheduler/job/99485 > > > > * core-image-minimal boots to serial console login and reboot succeeds. > > Further testing > > with oeqa runtime does not work since no SSH server installed. > > > > https://ledge.validation.linaro.org/scheduler/job/99484 > > > > * core-image-sato boots to serial console login and reboot succeeds. Since > > SSH server is > > on image oeqa runtime tests run and results are: > > > > https://ledge.validation.linaro.org/scheduler/job/99483 > > > > 2025-01-09 08:08:13,221 - runtime - INFO - Ran 73 tests in 186.726s > > 2025-01-09 08:08:13,222 - runtime - INFO - FAILED > > 2025-01-09 08:08:13,222 - runtime - INFO - (failures=4, skipped=49) > > 2025-01-09 08:08:13,239 - runtime - INFO - RESULTS: > > 2025-01-09 08:08:13,239 - runtime - INFO - RESULTS - > > connman.ConnmanTest.test_connmand_help: PASSED (0.75s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > connman.ConnmanTest.test_connmand_running: PASSED (0.70s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > date.DateTest.test_date: PASSED (9.10s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - df.DfTest.test_df: > > PASSED (0.74s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTest.test_syslog_running: PASSED (0.72s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_logger: PASSED (2.28s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_restart: PASSED (1.31s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > pam.PamBasicTest.test_pam: PASSED (2.88s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > parselogs.ParseLogsTest.test_get_context: PASSED (0.00s) > > 2025-01-09 08:08:13,240 - runtime - INFO - RESULTS - > > ping.PingTest.test_ping: PASSED (0.01s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > python.PythonTest.test_python3: PASSED (1.25s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > scp.ScpTest.test_scp_file: PASSED (2.81s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - ssh.SSHTest.test_ssh: > > PASSED (0.72s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_basic: PASSED (0.71s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_list: PASSED (3.07s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdJournalTests.test_systemd_boot_time: PASSED (0.89s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdJournalTests.test_systemd_journal: PASSED (1.12s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_disable_enable: PASSED (7.29s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_status: PASSED (0.76s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_stop_start: PASSED (2.78s) > > 2025-01-09 08:08:13,241 - runtime - INFO - RESULTS - > > apt.AptRepoTest.test_apt_install_from_repo: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > buildcpio.BuildCpioTest.test_cpio: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > buildgalculator.GalculatorTest.test_galculator: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > buildlzip.BuildLzipTest.test_lzip: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_help: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_history: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_info: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_search: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_version: SKIPPED (0.00s) > > 2025-01-09 08:08:13,242 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_exclude: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_dependency: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_from_disk: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_from_http: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_installroot: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_installroot_usrmerge: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_makecache: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_reinstall: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_repoinfo: SKIPPED (0.00s) > > 2025-01-09 08:08:13,243 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gcc_compile: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gpp2_compile: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gpp_compile: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_make: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > gi.GObjectIntrospectionTest.test_python: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > go.GoHelloworldTest.test_gohelloworld: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > kernelmodule.KernelModuleTest.test_kernel_module: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - ldd.LddTest.test_ldd: > > SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > logrotate.LogrotateTest.test_logrotate_newlog: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > logrotate.LogrotateTest.test_logrotate_wtmp: SKIPPED (0.00s) > > 2025-01-09 08:08:13,244 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_startup_config: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > perl.PerlTest.test_perl_works: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > ptest.PtestRunnerTest.test_ptestrunner_expectfail: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > ptest.PtestRunnerTest.test_ptestrunner_expectsuccess: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_help: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_query: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_query_nonroot: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_check_rpm_install_removal_log_file_size: > > SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_rpm_install: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_rpm_remove: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rust.RustCLibExampleTest.test_rust_c_lib_example: SKIPPED (0.00s) > > 2025-01-09 08:08:13,245 - runtime - INFO - RESULTS - > > rust.RustCompileTest.test_cargo_compile: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > rust.RustCompileTest.test_rust_compile: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > stap.StapTest.test_stap: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_coredump_minidebuginfo: > > SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_disable_enable_ro: SKIPPED > > (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > weston.WestonTest.test_wayland_info: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_can_initialize_new_wayland_compositor: > > SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_running: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_supports_xwayland: SKIPPED (0.00s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > opkg.OpkgRepoTest.test_opkg_install_from_repo: FAILED (135.86s) > > 2025-01-09 08:08:13,246 - runtime - INFO - RESULTS - > > parselogs.ParseLogsTest.test_parselogs: FAILED (4.76s) > > 2025-01-09 08:08:13,247 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_failed: FAILED (2.19s) > > 2025-01-09 08:08:13,247 - runtime - INFO - RESULTS - > > xorg.XorgTest.test_xorg_running: FAILED (1.27s) > > 2025-01-09 08:08:13,250 - runtime - INFO - SUMMARY: > > 2025-01-09 08:08:13,250 - runtime - INFO - runtime () - Ran 73 tests in > > 186.734s > > 2025-01-09 08:08:13,250 - runtime - INFO - runtime - FAIL - Required tests > > failed (successes=20, skipped=49, failures=4, errors=0) > > > > opkg.OpkgRepoTest.test_opkg_install_from_repo failure is a test setup issue > > since > > package repo from build environment is not exported to test environment. > > > > parselogs.ParseLogsTest.test_parselogs fails since firmware and kernel trigger > > some new > > non-fatal warnings to dmesg. Needs detailed investigation to either supress > > warnings or > > to fix root causes. > > > > systemd.SystemdBasicTests.test_systemd_failed fails since xserver- > > nodm.service fails > > start. X11 graphics support on AMD KV260 is not enabled or working yet on > > genericarm64 > > machine. > > > > xorg.XorgTest.test_xorg_running fails since xorg startup fails. > > > > * core-image-weston boots to serial console login and reboot succeeds. SSH > > server is installed > > so oeqa runtime tests run and results are: > > > > https://ledge.validation.linaro.org/scheduler/job/99486 > > > > 2025-01-09 08:55:34,919 - runtime - INFO - --------------------------------------- > > ------------------------------- > > 2025-01-09 08:55:34,919 - runtime - INFO - Ran 73 tests in 192.950s > > 2025-01-09 08:55:34,920 - runtime - INFO - FAILED > > 2025-01-09 08:55:34,920 - runtime - INFO - (failures=6, skipped=49) > > 2025-01-09 08:55:34,937 - runtime - INFO - RESULTS: > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > date.DateTest.test_date: PASSED (9.06s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - df.DfTest.test_df: > > PASSED (0.73s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTest.test_syslog_running: PASSED (0.71s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_logger: PASSED (2.29s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_restart: PASSED (1.29s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > pam.PamBasicTest.test_pam: PASSED (2.89s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > parselogs.ParseLogsTest.test_get_context: PASSED (0.00s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > ping.PingTest.test_ping: PASSED (0.01s) > > 2025-01-09 08:55:34,938 - runtime - INFO - RESULTS - > > scp.ScpTest.test_scp_file: PASSED (2.78s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - ssh.SSHTest.test_ssh: > > PASSED (0.74s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_basic: PASSED (0.69s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_list: PASSED (3.10s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdJournalTests.test_systemd_boot_time: PASSED (0.91s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdJournalTests.test_systemd_journal: PASSED (1.11s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_disable_enable: PASSED (7.28s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_status: PASSED (0.76s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_stop_start: PASSED (2.75s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > weston.WestonTest.test_wayland_info: PASSED (7.56s) > > 2025-01-09 08:55:34,939 - runtime - INFO - RESULTS - > > apt.AptRepoTest.test_apt_install_from_repo: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > buildcpio.BuildCpioTest.test_cpio: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > buildgalculator.GalculatorTest.test_galculator: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > buildlzip.BuildLzipTest.test_lzip: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > connman.ConnmanTest.test_connmand_help: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > connman.ConnmanTest.test_connmand_running: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_help: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_history: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_info: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_search: SKIPPED (0.00s) > > 2025-01-09 08:55:34,940 - runtime - INFO - RESULTS - > > dnf.DnfBasicTest.test_dnf_version: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_exclude: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_dependency: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_from_disk: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_install_from_http: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_installroot: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_installroot_usrmerge: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_makecache: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_reinstall: SKIPPED (0.00s) > > 2025-01-09 08:55:34,941 - runtime - INFO - RESULTS - > > dnf.DnfRepoTest.test_dnf_repoinfo: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gcc_compile: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gpp2_compile: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_gpp_compile: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > gcc.GccCompileTest.test_make: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > gi.GObjectIntrospectionTest.test_python: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > go.GoHelloworldTest.test_gohelloworld: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > kernelmodule.KernelModuleTest.test_kernel_module: SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - ldd.LddTest.test_ldd: > > SKIPPED (0.00s) > > 2025-01-09 08:55:34,942 - runtime - INFO - RESULTS - > > logrotate.LogrotateTest.test_logrotate_newlog: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > logrotate.LogrotateTest.test_logrotate_wtmp: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > oe_syslog.SyslogTestConfig.test_syslog_startup_config: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > perl.PerlTest.test_perl_works: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > ptest.PtestRunnerTest.test_ptestrunner_expectfail: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > ptest.PtestRunnerTest.test_ptestrunner_expectsuccess: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > python.PythonTest.test_python3: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_help: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_query: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > rpm.RpmBasicTest.test_rpm_query_nonroot: SKIPPED (0.00s) > > 2025-01-09 08:55:34,943 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_check_rpm_install_removal_log_file_size: > > SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_rpm_install: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > rpm.RpmInstallRemoveTest.test_rpm_remove: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > rust.RustCLibExampleTest.test_rust_c_lib_example: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > rust.RustCompileTest.test_cargo_compile: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > rust.RustCompileTest.test_rust_compile: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > stap.StapTest.test_stap: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_coredump_minidebuginfo: > > SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > systemd.SystemdServiceTests.test_systemd_disable_enable_ro: SKIPPED > > (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > xorg.XorgTest.test_xorg_running: SKIPPED (0.00s) > > 2025-01-09 08:55:34,944 - runtime - INFO - RESULTS - > > opkg.OpkgRepoTest.test_opkg_install_from_repo: FAILED (136.68s) > > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > > parselogs.ParseLogsTest.test_parselogs: FAILED (4.11s) > > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > > systemd.SystemdBasicTests.test_systemd_failed: FAILED (2.21s) > > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_can_initialize_new_wayland_compositor: > > FAILED (0.54s) > > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_running: FAILED (1.27s) > > 2025-01-09 08:55:34,945 - runtime - INFO - RESULTS - > > weston.WestonTest.test_weston_supports_xwayland: FAILED (0.73s) > > 2025-01-09 08:55:34,948 - runtime - INFO - SUMMARY: > > 2025-01-09 08:55:34,948 - runtime - INFO - runtime () - Ran 73 tests in > > 192.962s > > 2025-01-09 08:55:34,948 - runtime - INFO - runtime - FAIL - Required tests > > failed (successes=18, skipped=49, failures=6, errors=0) > > > > opkg.OpkgRepoTest.test_opkg_install_from_repo fails like on core-image- > > sato with same root cause, > > missing package repo in test environment. > > > > parselogs.ParseLogsTest.test_parselogs fails like on core-image-sato. > > > > systemd.SystemdBasicTests.test_systemd_failed fails since weston.service > > fails > > to start. Details need to be investigated and likely related to graphics stack > > not setup yet on genericarm64 for AMD KV260. > > > > weston.WestonTest.test_weston_can_initialize_new_wayland_compositor > > fails since > > weston.service startup fails. > > > > weston.WestonTest.test_weston_running fails since weston.service startup > > fails. > > > > weston.WestonTest.test_weston_supports_xwayland fails since > > weston.service startup > > fails. > > > > I could upload testresult.json files from these test runs to yocto-testresults- > > contrib. > > Which branch name should I use? Any reviews needed for the changes? I > > could also report the test failures to bugzilla, if that makes sense. I will try get > > these fixed and also improve the tests, for example the small images without > > SSH could be checked a bit more over serial console. > > > > Any feedback to this first test run is welcome. > > > > Cheers, > > > > -Mikko > > > > > > > > > > > > -=-=-=-=-=-=-=-=-=-=-=- > Links: You receive all messages sent to this group. > View/Reply Online (#497): https://lists.yoctoproject.org/g/qa-build-notification/message/497 > Mute This Topic: https://lists.yoctoproject.org/mt/110516091/7159507 > Group Owner: qa-build-notification+owner@lists.yoctoproject.org > Unsubscribe: https://lists.yoctoproject.org/g/qa-build-notification/leave/13855390/7159507/999868192/xyzzy [mikko.rapeli@linaro.org] > -=-=-=-=-=-=-=-=-=-=-=- > >