From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from phobos.denx.de (phobos.denx.de [85.214.62.61]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 99DB3C001DC for ; Wed, 12 Jul 2023 17:09:10 +0000 (UTC) Received: from h2850616.stratoserver.net (localhost [IPv6:::1]) by phobos.denx.de (Postfix) with ESMTP id D9A5886B37; Wed, 12 Jul 2023 19:09:08 +0200 (CEST) Authentication-Results: phobos.denx.de; dmarc=pass (p=none dis=none) header.from=konsulko.com Authentication-Results: phobos.denx.de; spf=pass smtp.mailfrom=u-boot-bounces@lists.denx.de Authentication-Results: phobos.denx.de; dkim=pass (1024-bit key; unprotected) header.d=konsulko.com header.i=@konsulko.com header.b="f+Hp+3wg"; dkim-atps=neutral Received: by phobos.denx.de (Postfix, from userid 109) id 04C4886B4E; Wed, 12 Jul 2023 19:09:07 +0200 (CEST) Received: from mail-oa1-x2f.google.com (mail-oa1-x2f.google.com [IPv6:2001:4860:4864:20::2f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)) (No client certificate requested) by phobos.denx.de (Postfix) with ESMTPS id 40F9186B12 for ; Wed, 12 Jul 2023 19:09:03 +0200 (CEST) Authentication-Results: phobos.denx.de; dmarc=pass (p=none dis=none) header.from=konsulko.com Authentication-Results: phobos.denx.de; spf=pass smtp.mailfrom=trini@konsulko.com Received: by mail-oa1-x2f.google.com with SMTP id 586e51a60fabf-1b38121a011so5811351fac.2 for ; Wed, 12 Jul 2023 10:09:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=konsulko.com; s=google; t=1689181742; x=1691773742; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:from:to:cc:subject:date:message-id:reply-to; bh=CxcwZfp6ovz4J9acf526veUW3TR3t1RXWxRK3tQ2ivQ=; b=f+Hp+3wgAdfkt746RIfPtiKaFGANYhzdlNtuMLTXRLDqHQGv5RCgBmUjizfOnCerNW W5srP7cN7rL5PEONWQv37RlDyi19IKmD82LAnuKiPYZX0EhT2g0b+rtjuHgm+oWyW8HL dVgfRt+0o6nEknXH/S+w/IlLvFoWYX/Nf65ik= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1689181742; x=1691773742; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=CxcwZfp6ovz4J9acf526veUW3TR3t1RXWxRK3tQ2ivQ=; b=Glmf15DgWJlVBbVWoiiF8fPDqPf0OA4CmLeyRASZrpm4PIsiIPs3xWE0fx9dEugf4U VUunbDrl4TbASXsCy77LS47t7uxWHKglF0ELcardVLj5cLiSG1STyLI9ngETHxyoD9qp yDcxHZzvpH5i28mf5KFiKnwbEKdEuce+xfTNK7lqHyZWubL1wWPKpkam5GwEYO24TrxI +5bEXyjttEHyKEpJKygz13+JWxyWxl2VLAUmBQNIirSxmqG+025QQY6Jhek6Mth0BnVh fmAyallTsNrpuOD3kqx1HLW/QIX15pbvtT0du/GfhysxJVyrE4GmgRBr3zwRMivVKHqY AZPA== X-Gm-Message-State: ABy/qLbEDSI0ggZ1iVaPoavvSqV/IlXpGxakeg82ehv3QxSd6RRlGVYV YrUMagbTjud+XZZTJLbu6QIozO9quZfeCShJ4m2k3w== X-Google-Smtp-Source: APBJJlG4uTut8Q7UpPerUgTunVFhSRiE0dq5NO8+13c94ciU5uMhPZviJbrNEwTxv0cr1X02WvdOKg== X-Received: by 2002:a05:6871:70b:b0:1b3:ec6b:b264 with SMTP id f11-20020a056871070b00b001b3ec6bb264mr19717285oap.5.1689181741843; Wed, 12 Jul 2023 10:09:01 -0700 (PDT) Received: from bill-the-cat (2603-6081-7b00-6400-616f-f5d3-9cfa-22fc.res6.spectrum.com. [2603:6081:7b00:6400:616f:f5d3:9cfa:22fc]) by smtp.gmail.com with ESMTPSA id e126-20020a0df584000000b00576e67820f3sm1262119ywf.66.2023.07.12.10.09.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Wed, 12 Jul 2023 10:09:01 -0700 (PDT) Date: Wed, 12 Jul 2023 13:08:59 -0400 From: Tom Rini To: Simon Glass Cc: u-boot@lists.denx.de Subject: Re: [PATCH] CI: Add automatic retry for test.py jobs Message-ID: <20230712170859.GA2066889@bill-the-cat> References: <20230712023303.1969966-1-trini@konsulko.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="z5CrFQ4vMeaPbKqR" Content-Disposition: inline In-Reply-To: X-Clacks-Overhead: GNU Terry Pratchett X-BeenThere: u-boot@lists.denx.de X-Mailman-Version: 2.1.39 Precedence: list List-Id: U-Boot discussion List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: u-boot-bounces@lists.denx.de Sender: "U-Boot" X-Virus-Scanned: clamav-milter 0.103.8 at phobos.denx.de X-Virus-Status: Clean --z5CrFQ4vMeaPbKqR Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jul 12, 2023 at 08:00:23AM -0600, Simon Glass wrote: > Hi Tom, >=20 > On Tue, 11 Jul 2023 at 20:33, Tom Rini wrote: > > > > It is not uncommon for some of the QEMU-based jobs to fail not because > > of a code issue but rather because of a timing issue or similar problem > > that is out of our control. Make use of the keywords that Azure and > > GitLab provide so that we will automatically re-run these when they fail > > 2 times. If they fail that often it is likely we have found a real issue > > to investigate. > > > > Signed-off-by: Tom Rini > > --- > > .azure-pipelines.yml | 1 + > > .gitlab-ci.yml | 1 + > > 2 files changed, 2 insertions(+) >=20 > This seems like a slippery slope. Do we know why things fail? I wonder > if we should disable the tests / builders instead, until it can be > corrected? It happens in Azure, so it's not just the broken runner problem we have in GitLab. And the problem is timing, as I said in the commit. Sometimes we still get the RTC test failing. Other times we don't get QEMU + U-Boot spawned in time (most often m68k, but sometimes x86). > I'll note that we don't have this problem with sandbox tests. OK, but that's not relevant? --=20 Tom --z5CrFQ4vMeaPbKqR Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQGzBAABCgAdFiEEGjx/cOCPqxcHgJu/FHw5/5Y0tywFAmSu3igACgkQFHw5/5Y0 tyyMwgv/YLizwW2dLxkyru5z+DyJqCr81xcN15yqsdX1djOhyMlClfHro5KGCEG4 zsqs7iSaH+3FPnJPPza4wfnIitafSHM/2b22N748pu8wqUgrIHvQYu1vAHQS2CTu Qaa9YyH05znULn9OEQCb3Os2SNSGqvcc5dmJJlyACcfvnjvnBAua8Z0CsJmtEFiA PNfnb1XIN4WgYGApK73stOZbzhqyAtqqXoDatTRl6Hn8H7xSElQ5OPcbkZjUfiHo /t888o+74WuSsdXj+1PqApq5fs5QSIb9P5aAttNUKRGzNoeSh9qqOws8ZbizcK9M s+4wJyifdvhXuI9mXtChtygpX1jMe4dufq9Lfw6lrtpSoy0yOxzcWsV/6hFmOTD4 9p+KkmuD+GNgRFkYUIv1iHHVKR9nfi9NI9hBkI+mzvmgCb6JtM4A5p6ppKzF/EAV 9aPRdgn1FC2dI/iTJILefh1B/YTZzy6ncZkefDwE/BtiHY3/UMu7iJV5xLyIjWpK 2/a2bVuo =/d5W -----END PGP SIGNATURE----- --z5CrFQ4vMeaPbKqR--