From mboxrd@z Thu Jan 1 00:00:00 1970 From: =?UTF-8?q?Radim=20Kr=C4=8Dm=C3=A1=C5=99?= Subject: [kvm-unit-tests PATCH v4 00/13] Improve the output of test runners Date: Wed, 11 May 2016 18:12:42 +0200 Message-ID: <1462983171-4208-1-git-send-email-rkrcmar@redhat.com> Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: QUOTED-PRINTABLE Cc: Paolo Bonzini , Andrew Jones To: kvm@vger.kernel.org Return-path: Received: from mx1.redhat.com ([209.132.183.28]:45665 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752505AbcEKQNH (ORCPT ); Wed, 11 May 2016 12:13:07 -0400 Received: from int-mx13.intmail.prod.int.phx2.redhat.com (int-mx13.intmail.prod.int.phx2.redhat.com [10.5.11.26]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.redhat.com (Postfix) with ESMTPS id 49B8C3B731 for ; Wed, 11 May 2016 16:13:07 +0000 (UTC) Sender: kvm-owner@vger.kernel.org List-ID: v3: http://www.spinics.net/lists/kvm/msg130911.html Changes are described in each changed patch. The output differs a bit from v3, because SKIP when QEMU didn't have a chance to run the test now prints the last line of stdout + stderr in summary. PASS apic (14 tests) PASS emulator (131 tests, 1 skipped) PASS pmu (67 tests, 1 expected failures) SKIP svm (0 tests) SKIP taskswitch (i386 only) PASS kvmclock_test=20 SKIP hyperv_synic (qemu-kvm: Property '.hv-synic' not found) Radim Kr=C4=8Dm=C3=A1=C5=99 (13): lib/report: allow test skipping x86/*: report skipped tests x86/unittests: remove svm-disabled lib/string: add strncmp lib/util: add args_parse_keyval x86/pmu: expect failure with nmi_watchdog lib/report: don't print 0 failed tests scripts/runtime: consolidate summary tags run_tests: print SUMMARY line in summary run_tests: log stderr scripts/runtime: skip tests that cannot run scripts/arch-run: change QEMU failure detection scripts/run: generalize check arm/run | 2 +- lib/libcflat.h | 1 + lib/report.c | 49 ++++++++++++++++++++++++----------- lib/string.c | 17 ++++++++----- lib/string.h | 1 + lib/util.c | 17 +++++++++++++ lib/util.h | 10 ++++++++ powerpc/run | 2 +- run_tests.sh | 15 ++++++----- scripts/arch-run.bash | 2 +- scripts/mkstandalone.sh | 4 +++ scripts/runtime.bash | 68 ++++++++++++++++++++++++++++++++++++-----= -------- x86/Makefile.common | 1 + x86/apic.c | 7 +++-- x86/emulator.c | 2 +- x86/hyperv_synic.c | 2 +- x86/pku.c | 2 +- x86/pmu.c | 8 ++++-- x86/smap.c | 2 +- x86/svm.c | 2 +- x86/tsc.c | 2 +- x86/unittests.cfg | 9 +------ 22 files changed, 156 insertions(+), 69 deletions(-) --=20 2.8.2