From mboxrd@z Thu Jan 1 00:00:00 1970 Received: by 2002:adf:e804:0:0:0:0:0 with SMTP id o4csp1421278wrm; Wed, 9 Oct 2019 14:01:21 -0700 (PDT) X-Google-Smtp-Source: APXvYqy0XjThx/WjHrcxO7YDnZQaaG4XyL7BHfLJsB6+kPnyKvZQ+Yvtd7cS6UlzWSZUVgVoNV4Q X-Received: by 2002:a37:ba87:: with SMTP id k129mr5861047qkf.62.1570654881652; Wed, 09 Oct 2019 14:01:21 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1570654881; cv=none; d=google.com; s=arc-20160816; b=nV0NIUQ9vRVHy0BLOqPUSeSuLfTcuUwENXHrwNY/pOcijzuLIONhrues/zEcDFXUMV 9Q7cd2G9We8IMdykEHScVH0ZFKiTf/CJrK3Fxd1rqmQ4VHqKppfKGAQKw1CVe8fNMgXz xFRFaiOqM6aOdetyqOGg8NquJ7i3NXJPj8rw9pJc9HJwRNUb3h820w7LT11X+K9Y72Hn niK0uBGwnyV+BzxSv3tDIxA+ax9qvmCJb4Qw++6e5b+yF2I5mYfm9IxOZ7DyY5wp8ljB JqFURZgcrfYmdwpU+eSJXR7llFkhkXyCo3yapmqZWWn+PJPo10C+QXyzlxV4M9acqKJU 4fgw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=sender:errors-to:cc:list-subscribe:list-help:list-post:list-archive :list-unsubscribe:list-id:precedence:user-agent:in-reply-to :content-disposition:mime-version:references:message-id:subject:to :from:date; bh=qd8pSPgFrLrso2xqfw1Xv2tnzi0Sg1fq+Buy0hsE2ks=; b=0sswk5CiaXrcJTcpB5l4VxnY2IDlEcU7GC+Xx1GGj/DxJ8c6Y/TBZ1bNTjdL+BuWSG kYhueIzYKEkELzf1c33oVYySsUtkuulLaewsveADsCRiDKFH/PEG0RfDgRjHwWHaxj3A OWAANfQY+d9jzfbEJnBZG1/PAsltgrEFNxg306TZ7VmCvJCofBswzR5fHRkkJoqQvVWK 2XObuZC48lCqGNFbAD0BOForL05mzY06i1hY2ptvYg3oaa7GlLq86rJr4u4hyN72KShn 5WAxNJ8JYk0SBWc9D1iHSXGOaWdpZ5DoKVeE3Il17bvB05tn8FGWX2bT2+9IqBwg7HEo s0YA== ARC-Authentication-Results: i=1; mx.google.com; spf=pass (google.com: domain of qemu-devel-bounces+alex.bennee=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+alex.bennee=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Return-Path: Received: from lists.gnu.org (lists.gnu.org. [209.51.188.17]) by mx.google.com with ESMTPS id f3si3227779qkl.170.2019.10.09.14.01.21 for (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Wed, 09 Oct 2019 14:01:21 -0700 (PDT) Received-SPF: pass (google.com: domain of qemu-devel-bounces+alex.bennee=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) client-ip=209.51.188.17; Authentication-Results: mx.google.com; spf=pass (google.com: domain of qemu-devel-bounces+alex.bennee=linaro.org@nongnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom="qemu-devel-bounces+alex.bennee=linaro.org@nongnu.org"; dmarc=fail (p=NONE sp=NONE dis=NONE) header.from=redhat.com Received: from localhost ([::1]:57892 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iIJ5E-0001qS-Fv for alex.bennee@linaro.org; Wed, 09 Oct 2019 17:01:20 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:50269) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iIHJb-0008Fk-4P for qemu-devel@nongnu.org; Wed, 09 Oct 2019 15:08:04 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1iIHJZ-0001Xd-Uh for qemu-devel@nongnu.org; Wed, 09 Oct 2019 15:08:03 -0400 Received: from mx1.redhat.com ([209.132.183.28]:43510) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1iIHJR-0001T4-QW; Wed, 09 Oct 2019 15:07:54 -0400 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.phx2.redhat.com [10.5.11.14]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id A65929B29C; Wed, 9 Oct 2019 19:07:51 +0000 (UTC) Received: from localhost.localdomain (ovpn-122-151.rdu2.redhat.com [10.10.122.151]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 05CDD179C9; Wed, 9 Oct 2019 19:07:44 +0000 (UTC) Date: Wed, 9 Oct 2019 15:07:43 -0400 From: Cleber Rosa To: Peter Maydell Subject: Re: [PATCH 1/5] tests/boot_linux_console: Add initrd test for the Exynos4210 Message-ID: <20191009190743.GA6019@localhost.localdomain> References: <20191005154748.21718-1-f4bug@amsat.org> <20191005154748.21718-2-f4bug@amsat.org> <20191008214907.GA28137@localhost.localdomain> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.12.1 (2019-06-15) X-Scanned-By: MIMEDefang 2.79 on 10.5.11.14 X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.39]); Wed, 09 Oct 2019 19:07:51 +0000 (UTC) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] [fuzzy] X-Received-From: 209.132.183.28 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: =?iso-8859-1?Q?Fr=E9d=E9ric?= Basse , Maksim Kozlov , Eduardo Habkost , Evgeny Voevodin , Bartlomiej Zolnierkiewicz , Igor Mitsyanko , QEMU Developers , Krzysztof Kozlowski , Philippe =?iso-8859-1?Q?Mathieu-Daud=E9?= , qemu-arm , Dmitry Solodkiy , Jean-Christophe Dubois , Philippe =?iso-8859-1?Q?Mathieu-Daud=E9?= , Guenter Roeck Errors-To: qemu-devel-bounces+alex.bennee=linaro.org@nongnu.org Sender: "Qemu-devel" X-TUID: EnuuBE5faUg4 On Wed, Oct 09, 2019 at 02:38:02PM +0100, Peter Maydell wrote: > On Tue, 8 Oct 2019 at 22:49, Cleber Rosa wrote: > > > > I find it hard to judge precisely how much of a third-party some of > > these are. I remember Philippe mentioning that one of them, I guess > > the images used on linux_ssh_mips_malta.py, were "as official as it > > gets" (my words, from my often misleading memory). > > > > Reproducibility is definitely an issue, in the sense given that some > > of these can indeed go away, but as long as they're available the hash > > recorded in the test should guarantee that we're running the same > > images. > > > > Do you think we should do something different here? > > I'm not sure, which is why I asked whether this new test > was in line with what we've done previously. Since these > are just test cases and we don't redistribute them to > other people there's less of a traceability/reproducibility > worry, and if we check hashes on download that cuts off > a lot of "fail to notice if the image changes for some > reason" possible problems. > > thanks > -- PMM > Yep, because I have no clue how to do improve on this (redistributing the binaries is definitely not on the improvement side, and neither is not testing some machine types), the current approach seems good. Thanks for checking in and giving feedback! - Cleber.