From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id BF912C433EF for ; Wed, 10 Nov 2021 09:35:15 +0000 (UTC) Received: from smtp1.osuosl.org (smtp1.osuosl.org [140.211.166.138]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 14CD261247 for ; Wed, 10 Nov 2021 09:35:14 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 14CD261247 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=free.fr Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=buildroot.org Received: from localhost (localhost [127.0.0.1]) by smtp1.osuosl.org (Postfix) with ESMTP id B277680EFC; Wed, 10 Nov 2021 09:35:14 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp1.osuosl.org ([127.0.0.1]) by localhost (smtp1.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Y8m7URYDqPI2; Wed, 10 Nov 2021 09:35:13 +0000 (UTC) Received: from ash.osuosl.org (ash.osuosl.org [140.211.166.34]) by smtp1.osuosl.org (Postfix) with ESMTP id EDEFD80E25; Wed, 10 Nov 2021 09:35:12 +0000 (UTC) Received: from smtp4.osuosl.org (smtp4.osuosl.org [140.211.166.137]) by ash.osuosl.org (Postfix) with ESMTP id 3D34A1BF345 for ; Wed, 10 Nov 2021 09:35:11 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp4.osuosl.org (Postfix) with ESMTP id 2D27640413 for ; Wed, 10 Nov 2021 09:35:11 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Authentication-Results: smtp4.osuosl.org (amavisd-new); dkim=pass (2048-bit key) header.d=free.fr Received: from smtp4.osuosl.org ([127.0.0.1]) by localhost (smtp4.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id sZgEB67j51q3 for ; Wed, 10 Nov 2021 09:35:10 +0000 (UTC) X-Greylist: whitelisted by SQLgrey-1.8.0 Received: from smtp5-g21.free.fr (smtp5-g21.free.fr [212.27.42.5]) by smtp4.osuosl.org (Postfix) with ESMTPS id 2FF1C40411 for ; Wed, 10 Nov 2021 09:35:10 +0000 (UTC) Received: from ymorin.is-a-geek.org (unknown [IPv6:2a01:cb19:8b51:cb00:90c4:eaed:10a6:22de]) (Authenticated sender: yann.morin.1998@free.fr) by smtp5-g21.free.fr (Postfix) with ESMTPSA id 245C75FF33; Wed, 10 Nov 2021 10:34:59 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=free.fr; s=smtp-20201208; t=1636536907; bh=0ruNwbPswP2UwpHFWvEG4hRIDttoMbNrhDzhJNHDL80=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=RCE4Ui+vJHG4ukPQ2SPtQ/5xIcFiv1bhBJzDimFyfvksHrZPzGe5MhNsKjKvhY6jj tj8KBvJ+QIi4LNit/OQGJ2IT0BokXk94Nsnibty1rnNv9W7n/Z9FtUOO/88CJxA/rx 5Ky3oktS67tBMsFIQXxLPTSnK8rLVowJuoe/hwo93JnIxZDbJgoporc5BR0ZxxQMwn uSGY4QbfmBubyTdh/zWDOzWIhJvFkuYa7DqXg8Tyl03hf6NscsUBIsbot/PpMDVqLl 5DrEdqJY7xnmbEvbqbXdUSuPqL1ficirMVc/omCCNktMqT4ReQdU7V11pmmA7BMQSa JSPcIXam/F4+A== Received: by ymorin.is-a-geek.org (sSMTP sendmail emulation); Wed, 10 Nov 2021 10:34:58 +0100 Date: Wed, 10 Nov 2021 10:34:58 +0100 From: "Yann E. MORIN" To: Romain Naour Message-ID: <20211110093458.GE2084998@scaer> References: <20211109220328.388872-1-romain.naour@gmail.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20211109220328.388872-1-romain.naour@gmail.com> User-Agent: Mutt/1.5.22 (2013-10-16) Subject: Re: [Buildroot] [PATCH v2 RFC] support/scripts: don't build board defconfigs with Gitlab's pipelines trigged on tag X-BeenThere: buildroot@buildroot.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion and development of buildroot List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Thomas Petazzoni , buildroot@buildroot.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: buildroot-bounces@buildroot.org Sender: "buildroot" Romain, All, +Arnout On 2021-11-09 23:03 +0100, Romain Naour spake thusly: > Currently when a tag is added to the Buildroot git tree, the gitlab-ci > create a pipeline with several hundred of jobs (~750) to build all > defconfigs and execute the Buildroot testsuite. > > However, there is only a limited number of gitlab-ci runner (9 runners) > and some jobs reach the timeout limit (24h) while waiting for a runner > [1]. Indeed, the Buildroot project doesn't use the Gitlab's shared > runners. > > In addition to the pipeline created when a new tag is added to the > git repository, two pipelines are created each weeks to execute the > Buildroot testsuite (on monday [2]) and build all defconfigs (on > Thursday [3]). > > At some point there are too many jobs waiting in gitlab due board > defconfigs builds. Indded a board defconfig requires a lot of time > (~30min) compared to other jobs in order to build a toolchain and a > kernel linux along with a basic rootfs. There is currently 262 > defconfigs. > > This is even worse when several pipelines are trigged at the same > time (new git tag and scheduled pipeline trigger). > > In order to reduce the number of long jobs, don't build board > defconfigs with pipelines trigged on tag, keeping only the runtime > tests and the Qemu's defconfigs. > > [1] https://gitlab.com/buildroot.org/buildroot/-/jobs/1758966541 > [2] https://gitlab.com/buildroot.org/buildroot/-/pipelines/404035190 > [3] https://gitlab.com/buildroot.org/buildroot/-/pipelines/401685550 > > Signed-off-by: Romain Naour > Cc: Thomas Petazzoni > Cc: Yann E. MORIN > Cc: Arnout Vandecappelle Acked-by: Yann E. MORIN If noone whines shortly, I'll apply it. Regards, Yann E. MORIN. > --- > v2: improve commit log > > I would like to keep Qemu runtime testing when a tag is added because > it test the toolchain provided by default by Buildroot on several > architectures. > --- > support/scripts/generate-gitlab-ci-yml | 3 +++ > 1 file changed, 3 insertions(+) > > diff --git a/support/scripts/generate-gitlab-ci-yml b/support/scripts/generate-gitlab-ci-yml > index 7d09279bbd..232785f2e3 100755 > --- a/support/scripts/generate-gitlab-ci-yml > +++ b/support/scripts/generate-gitlab-ci-yml > @@ -36,6 +36,9 @@ gen_tests() { > ) > > if [ -n "${CI_COMMIT_TAG}" ]; then > + # When a tag is added to the Buildroot git tree, we want > + # to run the runtime tests and only test Qemu defconfigs. > + defconfigs=( $(cd configs; LC_ALL=C ls -1 qemu_*_defconfig) ) > do_basics=true > do_defconfigs=base > do_runtime=true > -- > 2.31.1 > > _______________________________________________ > buildroot mailing list > buildroot@buildroot.org > https://lists.buildroot.org/mailman/listinfo/buildroot -- .-----------------.--------------------.------------------.--------------------. | Yann E. MORIN | Real-Time Embedded | /"\ ASCII RIBBON | Erics' conspiracy: | | +33 662 376 056 | Software Designer | \ / CAMPAIGN | ___ | | +33 561 099 427 `------------.-------: X AGAINST | \e/ There is no | | http://ymorin.is-a-geek.org/ | _/*\_ | / \ HTML MAIL | v conspiracy. | '------------------------------^-------^------------------^--------------------' _______________________________________________ buildroot mailing list buildroot@buildroot.org https://lists.buildroot.org/mailman/listinfo/buildroot