From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3B0A3C433F5 for ; Thu, 11 Nov 2021 10:02:35 +0000 (UTC) Received: from smtp3.osuosl.org (smtp3.osuosl.org [140.211.166.136]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id A0EC760EE7 for ; Thu, 11 Nov 2021 10:02:34 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org A0EC760EE7 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=bootlin.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=buildroot.org Received: from localhost (localhost [127.0.0.1]) by smtp3.osuosl.org (Postfix) with ESMTP id 4DD6D6087C; Thu, 11 Nov 2021 10:02:34 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp3.osuosl.org ([127.0.0.1]) by localhost (smtp3.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id B-X9qb4BRc-F; Thu, 11 Nov 2021 10:02:33 +0000 (UTC) Received: from ash.osuosl.org (ash.osuosl.org [140.211.166.34]) by smtp3.osuosl.org (Postfix) with ESMTP id A4203605B7; Thu, 11 Nov 2021 10:02:32 +0000 (UTC) Received: from smtp2.osuosl.org (smtp2.osuosl.org [140.211.166.133]) by ash.osuosl.org (Postfix) with ESMTP id 7FF691BF2E3 for ; Thu, 11 Nov 2021 10:02:31 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp2.osuosl.org (Postfix) with ESMTP id 6BB5940102 for ; Thu, 11 Nov 2021 10:02:31 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp2.osuosl.org ([127.0.0.1]) by localhost (smtp2.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9H-3qMkU2Ult for ; Thu, 11 Nov 2021 10:02:30 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.8.0 Received: from relay8-d.mail.gandi.net (relay8-d.mail.gandi.net [217.70.183.201]) by smtp2.osuosl.org (Postfix) with ESMTPS id C301940004 for ; Thu, 11 Nov 2021 10:02:29 +0000 (UTC) Received: (Authenticated sender: thomas.petazzoni@bootlin.com) by relay8-d.mail.gandi.net (Postfix) with ESMTPSA id 476BC1BF207; Thu, 11 Nov 2021 10:02:26 +0000 (UTC) Date: Thu, 11 Nov 2021 11:02:25 +0100 From: Thomas Petazzoni To: "Yann E. MORIN" Message-ID: <20211111110225.50c73fd9@windsurf> In-Reply-To: <20211111082548.GA2504300@scaer> References: <20211109220328.388872-1-romain.naour@gmail.com> <20211111082548.GA2504300@scaer> Organization: Bootlin X-Mailer: Claws Mail 3.18.0 (GTK+ 2.24.33; x86_64-redhat-linux-gnu) MIME-Version: 1.0 Subject: Re: [Buildroot] [PATCH v2 RFC] support/scripts: don't build board defconfigs with Gitlab's pipelines trigged on tag X-BeenThere: buildroot@buildroot.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussion and development of buildroot List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Romain Naour , buildroot@buildroot.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: buildroot-bounces@buildroot.org Sender: "buildroot" Hello, On Thu, 11 Nov 2021 09:25:48 +0100 "Yann E. MORIN" wrote: > On 2021-11-09 23:03 +0100, Romain Naour spake thusly: > > Currently when a tag is added to the Buildroot git tree, the gitlab-ci > > create a pipeline with several hundred of jobs (~750) to build all > > defconfigs and execute the Buildroot testsuite. > > > > However, there is only a limited number of gitlab-ci runner (9 runners) > > and some jobs reach the timeout limit (24h) while waiting for a runner > > [1]. Indeed, the Buildroot project doesn't use the Gitlab's shared > > runners. > > > > In addition to the pipeline created when a new tag is added to the > > git repository, two pipelines are created each weeks to execute the > > Buildroot testsuite (on monday [2]) and build all defconfigs (on > > Thursday [3]). > > > > At some point there are too many jobs waiting in gitlab due board > > defconfigs builds. Indded a board defconfig requires a lot of time > > (~30min) compared to other jobs in order to build a toolchain and a > > kernel linux along with a basic rootfs. There is currently 262 > > defconfigs. > > > > This is even worse when several pipelines are trigged at the same > > time (new git tag and scheduled pipeline trigger). > > > > In order to reduce the number of long jobs, don't build board > > defconfigs with pipelines trigged on tag, keeping only the runtime > > tests and the Qemu's defconfigs. > > > > [1] https://gitlab.com/buildroot.org/buildroot/-/jobs/1758966541 > > [2] https://gitlab.com/buildroot.org/buildroot/-/pipelines/404035190 > > [3] https://gitlab.com/buildroot.org/buildroot/-/pipelines/401685550 > > > > Signed-off-by: Romain Naour > > Cc: Thomas Petazzoni > > Cc: Yann E. MORIN > > Cc: Arnout Vandecappelle > > Applied to master, thanks. I hadn't had the chance to chime in on this one, but I don't entirely agree with the change (I also don't entirely disagree!). Indeed, I believe we do want to have the results of the defconfigs builds on tags. If we missed something, and one of our release has defconfigs broken, we definitely want to know it and fix it. This disabling of defconfig builds is only done because there is an infrastructure issue. But really, from a proper QA/CI point of view, we really want to build the defconfigs on tags I think. Thomas -- Thomas Petazzoni, co-owner and CEO, Bootlin Embedded Linux and Kernel engineering and training https://bootlin.com _______________________________________________ buildroot mailing list buildroot@buildroot.org https://lists.buildroot.org/mailman/listinfo/buildroot