From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.1 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY, SPF_HELO_NONE,SPF_PASS,USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id B5FA5C2D0DB for ; Thu, 30 Jan 2020 14:14:01 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 7E83820658 for ; Thu, 30 Jan 2020 14:14:01 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="LA1yufWh" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 7E83820658 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=redhat.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Received: from localhost ([::1]:33142 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ixAa0-0003lr-OX for qemu-devel@archiver.kernel.org; Thu, 30 Jan 2020 09:14:00 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:59665) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ixAZK-0003Ey-5c for qemu-devel@nongnu.org; Thu, 30 Jan 2020 09:13:19 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ixAZI-0000au-NZ for qemu-devel@nongnu.org; Thu, 30 Jan 2020 09:13:18 -0500 Received: from us-smtp-delivery-1.mimecast.com ([207.211.31.120]:37089 helo=us-smtp-1.mimecast.com) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1ixAZI-0000aP-KF for qemu-devel@nongnu.org; Thu, 30 Jan 2020 09:13:16 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1580393596; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3dpPs6K6PrY0Hzupjyykqlj5lTsIiTsRfgxyHuZmej4=; b=LA1yufWhMsXTBfibqqNAj/AVnKlRu67a33gugciZKUkS0gRwzmt1KMk30faVgwl/O4d1rb 6BY7s3p8z5moP5+FEc4XMBkr+LROeCryYMLq92/uwOg8DJ2pdAdKv1h6OeNNrr2DlVFfP3 mW/VIhgybROWDSZChMIr0T3uenDzTUs= Received: from mimecast-mx01.redhat.com (mimecast-mx01.redhat.com [209.132.183.4]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-63-w2a2yS9tPVuDqQVQqzYkJg-1; Thu, 30 Jan 2020 09:12:58 -0500 Received: from smtp.corp.redhat.com (int-mx06.intmail.prod.int.phx2.redhat.com [10.5.11.16]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by mimecast-mx01.redhat.com (Postfix) with ESMTPS id AAD8E8010CB; Thu, 30 Jan 2020 14:12:56 +0000 (UTC) Received: from localhost.localdomain (ovpn-116-40.gru2.redhat.com [10.97.116.40]) by smtp.corp.redhat.com (Postfix) with ESMTP id D89EA5C541; Thu, 30 Jan 2020 14:12:52 +0000 (UTC) Subject: Re: [PATCH] tests/acceptance: Add boot tests for some of the QEMU advent calendar images To: Thomas Huth , qemu-devel@nongnu.org References: <20200124170325.30072-1-thuth@redhat.com> From: Wainer dos Santos Moschetta Message-ID: <64773e1a-7ad5-d664-f7c0-e1b18868b9aa@redhat.com> Date: Thu, 30 Jan 2020 12:12:50 -0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.4.0 MIME-Version: 1.0 In-Reply-To: <20200124170325.30072-1-thuth@redhat.com> Content-Language: en-US X-Scanned-By: MIMEDefang 2.79 on 10.5.11.16 X-MC-Unique: w2a2yS9tPVuDqQVQqzYkJg-1 X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] [fuzzy] X-Received-From: 207.211.31.120 X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: =?UTF-8?Q?Alex_Benn=c3=a9e?= , qemu-arm@nongnu.org, qemu-ppc@nongnu.org, =?UTF-8?Q?Philippe_Mathieu-Daud=c3=a9?= , Cleber Rosa Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On 1/24/20 3:03 PM, Thomas Huth wrote: > The 2018 edition of the QEMU advent calendar 2018 featured Linux images > for various non-x86 machines. We can use them for a boot tests in our > acceptance test suite. > > Let's also make sure that we build the corresponding machines in Travis, > and while we're there, drop the superfluous --python parameter (python3 > is now the only supported version anyway). > > Signed-off-by: Thomas Huth > --- > .travis.yml | 2 +- > tests/acceptance/boot_linux_console.py | 96 ++++++++++++++++++++++++++ > 2 files changed, 97 insertions(+), 1 deletion(-) Overall result from the discussions I raised on this thread: this patch is ready to go as is, IMO. Reviewed-by: Wainer dos Santos Moschetta Thanks Thomas! - Wainer > > diff --git a/.travis.yml b/.travis.yml > index 6c1038a0f1..73ca12c921 100644 > --- a/.travis.yml > +++ b/.travis.yml > @@ -268,7 +268,7 @@ matrix: > > # Acceptance (Functional) tests > - env: > - - CONFIG="--python=/usr/bin/python3 --target-list=x86_64-softmmu,mips-softmmu,mips64el-softmmu,aarch64-softmmu,arm-softmmu,s390x-softmmu,alpha-softmmu,ppc-softmmu,ppc64-softmmu,m68k-softmmu,sparc-softmmu" > + - CONFIG="--target-list=aarch64-softmmu,alpha-softmmu,arm-softmmu,m68k-softmmu,microblaze-softmmu,mips-softmmu,mips64el-softmmu,nios2-softmmu,or1k-softmmu,ppc-softmmu,ppc64-softmmu,s390x-softmmu,sparc-softmmu,x86_64-softmmu,xtensa-softmmu" > - TEST_CMD="make check-acceptance" > after_script: > - python3 -c 'import json; r = json.load(open("tests/results/latest/results.json")); [print(t["logfile"]) for t in r["tests"] if t["status"] not in ("PASS", "SKIP")]' | xargs cat > diff --git a/tests/acceptance/boot_linux_console.py b/tests/acceptance/boot_linux_console.py > index e03add2989..f7ac2a3a59 100644 > --- a/tests/acceptance/boot_linux_console.py > +++ b/tests/acceptance/boot_linux_console.py > @@ -584,3 +584,99 @@ class BootLinuxConsole(Test): > self.wait_for_console_pattern(console_pattern) > console_pattern = 'No filesystem could mount root' > self.wait_for_console_pattern(console_pattern) > + > + def do_test_advcal_2018(self, day, tar_hash, kernel_name): > + tar_url = ('https://www.qemu-advent-calendar.org' > + '/2018/download/day' + day + '.tar.xz') > + file_path = self.fetch_asset(tar_url, asset_hash=tar_hash) > + archive.extract(file_path, self.workdir) > + self.vm.set_console() > + self.vm.add_args('-kernel', > + self.workdir + '/day' + day + '/' + kernel_name) > + self.vm.launch() > + self.wait_for_console_pattern('QEMU advent calendar') > + > + def test_arm_vexpressa9(self): > + """ > + :avocado: tags=arch:arm > + :avocado: tags=machine:vexpress-a9 > + """ > + tar_hash = '32b7677ce8b6f1471fb0059865f451169934245b' > + self.vm.add_args('-dtb', self.workdir + '/day16/vexpress-v2p-ca9.dtb') > + self.do_test_advcal_2018('16', tar_hash, 'winter.zImage') > + > + def test_m68k_mcf5208evb(self): > + """ > + :avocado: tags=arch:m68k > + :avocado: tags=machine:mcf5208evb > + """ > + tar_hash = 'ac688fd00561a2b6ce1359f9ff6aa2b98c9a570c' > + self.do_test_advcal_2018('07', tar_hash, 'sanity-clause.elf') > + > + def test_microblaze_s3adsp1800(self): > + """ > + :avocado: tags=arch:microblaze > + :avocado: tags=machine:petalogix-s3adsp1800 > + """ > + tar_hash = '08bf3e3bfb6b6c7ce1e54ab65d54e189f2caf13f' > + self.do_test_advcal_2018('17', tar_hash, 'ballerina.bin') > + > + def test_or1k_sim(self): > + """ > + :avocado: tags=arch:or1k > + :avocado: tags=machine:or1k-sim > + """ > + tar_hash = '20334cdaf386108c530ff0badaecc955693027dd' > + self.do_test_advcal_2018('20', tar_hash, 'vmlinux') > + > + def test_nios2_10m50(self): > + """ > + :avocado: tags=arch:nios2 > + :avocado: tags=machine:10m50-ghrd > + """ > + tar_hash = 'e4251141726c412ac0407c5a6bceefbbff018918' > + self.do_test_advcal_2018('14', tar_hash, 'vmlinux.elf') > + > + def test_ppc64_e500(self): > + """ > + :avocado: tags=arch:ppc64 > + :avocado: tags=machine:ppce500 > + """ > + tar_hash = '6951d86d644b302898da2fd701739c9406527fe1' > + self.vm.add_args('-cpu', 'e5500') > + self.do_test_advcal_2018('19', tar_hash, 'uImage') > + > + def test_ppc_g3beige(self): > + """ > + :avocado: tags=arch:ppc > + :avocado: tags=machine:g3beige > + """ > + tar_hash = 'e0b872a5eb8fdc5bed19bd43ffe863900ebcedfc' > + self.vm.add_args('-M', 'graphics=off') > + self.do_test_advcal_2018('15', tar_hash, 'invaders.elf') > + > + def test_ppc_mac99(self): > + """ > + :avocado: tags=arch:ppc > + :avocado: tags=machine:mac99 > + """ > + tar_hash = 'e0b872a5eb8fdc5bed19bd43ffe863900ebcedfc' > + self.vm.add_args('-M', 'graphics=off') > + self.do_test_advcal_2018('15', tar_hash, 'invaders.elf') > + > + def test_sparc_ss20(self): > + """ > + :avocado: tags=arch:sparc > + :avocado: tags=machine:SS-20 > + """ > + tar_hash = 'b18550d5d61c7615d989a06edace051017726a9f' > + self.do_test_advcal_2018('11', tar_hash, 'zImage.elf') > + > + def test_xtensa_lx60(self): > + """ > + :avocado: tags=arch:xtensa > + :avocado: tags=machine:lx60 > + """ > + tar_hash = '49e88d9933742f0164b60839886c9739cb7a0d34' > + self.vm.add_args('-cpu', 'dc233c') > + self.do_test_advcal_2018('02', tar_hash, 'santas-sleigh-ride.elf')