From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id AFCDEC10F1A for ; Tue, 7 May 2024 05:46:46 +0000 (UTC) Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 5A6BF1123F1; Tue, 7 May 2024 05:46:41 +0000 (UTC) Authentication-Results: gabe.freedesktop.org; dkim=pass (2048-bit key; unprotected) header.d=collabora.com header.i=@collabora.com header.b="FuNCQ0Fc"; dkim-atps=neutral Received: from madrid.collaboradmins.com (madrid.collaboradmins.com [46.235.227.194]) by gabe.freedesktop.org (Postfix) with ESMTPS id 6DB3C1123EC; Tue, 7 May 2024 05:46:39 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=collabora.com; s=mail; t=1715060797; bh=/NxMfXX51LM6wRVaE17ulyFtkVct5TM0jpzpKe/PK9U=; h=Date:Subject:To:Cc:References:From:In-Reply-To:From; b=FuNCQ0FcD+ZiIfF/od4b4YLkcRCXp0rGoT+N7WjM9oDvvlxsjT6MHIJpOjY9CAeLi lbBqMMTrBcbEomZO8hEKDPeNiifXlvgQ5BefORRhZ1Nl4clkVZeQIRufHGARJ6C4Gw ng2QdkYlG4zyiHeI4HnDVEmdka24eWcpTLlh2c12W7tw2yxbzZ0CTP2kdUhrl8mvuH 4gC+cNIrBnJ4z2e0d93ltIPinESo7lf5c/8fM3QHzetcQ2B0ERSZl6sqToa+s+mZpE su/MOeBms3n85AwVi5jrTulqPOCdt3gcitgUIVAxz94JxzVbcaoK99ml7BLHEgj7Yy jy7JMOcnJtY9w== Received: from [100.66.96.193] (cola.collaboradmins.com [195.201.22.229]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: vignesh) by madrid.collaboradmins.com (Postfix) with ESMTPSA id 93DFB3781FE9; Tue, 7 May 2024 05:46:34 +0000 (UTC) Message-ID: <0e56241a-859b-45d6-bc7e-da2ed894d01a@collabora.com> Date: Tue, 7 May 2024 11:16:32 +0530 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v1 2/5] drm/ci: generate testlist from build Content-Language: en-US To: Dmitry Baryshkov Cc: dri-devel@lists.freedesktop.org, daniels@collabora.com, helen.koike@collabora.com, airlied@gmail.com, daniel@ffwll.ch, robdclark@gmail.com, david.heidelberg@collabora.com, guilherme.gallo@collabora.com, sergi.blanch.torne@collabora.com, mcanal@igalia.com, linux-mediatek@lists.infradead.org, linux-amlogic@lists.infradead.org, linux-rockchip@lists.infradead.org, amd-gfx@lists.freedesktop.org, linux-arm-msm@vger.kernel.org, intel-gfx@lists.freedesktop.org, virtualization@lists.linux-foundation.org, linux-kernel@vger.kernel.org References: <20240430091121.508099-1-vignesh.raman@collabora.com> <20240430091121.508099-3-vignesh.raman@collabora.com> From: Vignesh Raman In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: intel-gfx@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Intel graphics driver community testing & development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: intel-gfx-bounces@lists.freedesktop.org Sender: "Intel-gfx" Hi Dmitry, On 30/04/24 15:47, Dmitry Baryshkov wrote: > On Tue, Apr 30, 2024 at 02:41:18PM +0530, Vignesh Raman wrote: >> Stop vendoring the testlist into the kernel. Instead, use the >> testlist from the IGT build to ensure we do not miss renamed >> or newly added tests. >> >> Signed-off-by: Vignesh Raman >> --- >> drivers/gpu/drm/ci/build-igt.sh | 23 + >> drivers/gpu/drm/ci/igt_runner.sh | 9 +- >> drivers/gpu/drm/ci/testlist.txt | 2761 ------------------------------ >> 3 files changed, 28 insertions(+), 2765 deletions(-) >> delete mode 100644 drivers/gpu/drm/ci/testlist.txt >> >> diff --git a/drivers/gpu/drm/ci/build-igt.sh b/drivers/gpu/drm/ci/build-igt.sh >> index 500fa4f5c30a..cedc62baba1e 100644 >> --- a/drivers/gpu/drm/ci/build-igt.sh >> +++ b/drivers/gpu/drm/ci/build-igt.sh >> @@ -26,6 +26,29 @@ meson build $MESON_OPTIONS $EXTRA_MESON_ARGS >> ninja -C build -j${FDO_CI_CONCURRENT:-4} || ninja -C build -j 1 >> ninja -C build install >> >> +set +ex >> +export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/igt/lib64 >> +while read -r line; do >> + if [ "$line" = "TESTLIST" ] || [ "$line" = "END TESTLIST" ]; then >> + continue >> + fi >> + >> + tests=$(echo "$line" | tr ' ' '\n') >> + >> + for test in $tests; do >> + output=$(/igt/libexec/igt-gpu-tools/"$test" --list-subtests) >> + >> + if [ -z "$output" ]; then >> + echo "$test" >> + else >> + echo "$output" | while read -r subtest; do >> + echo "$test@$subtest" >> + done >> + fi >> + done >> +done < /igt/libexec/igt-gpu-tools/test-list.txt > /igt/libexec/igt-gpu-tools/testlist.txt >> +set -ex > > Is the list in sync between x86 and arm/arm64 IGT builds? Is there a > chance of having a safety net here? We need to handle arm/arm64 cases also. IGT is not generating test-list for arm and it is fixed now with https://gitlab.freedesktop.org/drm/igt-gpu-tools/-/commit/1cf83083f855894dd287d9cf84bbcc2952b52d02 Will uprev IGT to latest commit to include this fix. Thanks. Regards, Vignesh >> + >> mkdir -p artifacts/ >> tar -cf artifacts/igt.tar /igt >> >> diff --git a/drivers/gpu/drm/ci/igt_runner.sh b/drivers/gpu/drm/ci/igt_runner.sh >> index f1a08b9b146f..20026612a9bd 100755 >> --- a/drivers/gpu/drm/ci/igt_runner.sh >> +++ b/drivers/gpu/drm/ci/igt_runner.sh >> @@ -59,25 +59,26 @@ fi >> >> curl -L --retry 4 -f --retry-all-errors --retry-delay 60 -s ${FDO_HTTP_CACHE_URI:-}$PIPELINE_ARTIFACTS_BASE/$ARCH/igt.tar.gz | tar --zstd -v -x -C / >> >> +TESTLIST="/igt/libexec/igt-gpu-tools/testlist.txt" >> >> # If the job is parallel at the gitab job level, take the corresponding fraction >> # of the caselist. >> if [ -n "$CI_NODE_INDEX" ]; then >> - sed -ni $CI_NODE_INDEX~$CI_NODE_TOTAL"p" /install/testlist.txt >> + sed -ni $CI_NODE_INDEX~$CI_NODE_TOTAL"p" $TESTLIST >> fi >> >> # core_getversion checks if the driver is loaded and probed correctly >> # so run it in all shards >> -if ! grep -q "core_getversion" /install/testlist.txt; then >> +if ! grep -q "core_getversion" $TESTLIST; then >> # Add the line to the file >> - echo "core_getversion" >> /install/testlist.txt >> + echo "core_getversion" >> $TESTLIST >> fi >> >> set +e >> igt-runner \ >> run \ >> --igt-folder /igt/libexec/igt-gpu-tools \ >> - --caselist /install/testlist.txt \ >> + --caselist $TESTLIST \ >> --output /results \ >> $IGT_SKIPS \ >> $IGT_FLAKES \ >