From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:41180) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Yy0vw-0002Sk-7H for qemu-devel@nongnu.org; Thu, 28 May 2015 12:45:29 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Yy0vr-0007l2-Cq for qemu-devel@nongnu.org; Thu, 28 May 2015 12:45:28 -0400 Received: from mx1.redhat.com ([209.132.183.28]:45162) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Yy0vr-0007kw-88 for qemu-devel@nongnu.org; Thu, 28 May 2015 12:45:23 -0400 Received: from int-mx11.intmail.prod.int.phx2.redhat.com (int-mx11.intmail.prod.int.phx2.redhat.com [10.5.11.24]) by mx1.redhat.com (Postfix) with ESMTPS id D56FE37FF60 for ; Thu, 28 May 2015 16:45:22 +0000 (UTC) From: John Snow Date: Thu, 28 May 2015 12:45:17 -0400 Message-Id: <1432831521-11972-1-git-send-email-jsnow@redhat.com> Subject: [Qemu-devel] [PATCH v2 0/4] iotests: skip tests with unchanged dependencies List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: qemu-devel@nongnu.org Cc: kwolf@redhat.com, famz@redhat.com, John Snow This patchset is a little off the beaten path, but: Add the ability to skip tests that have already been run whose external dependencies have remained unchanged since the last test run. This is useful for, say, re-running a test set to see if a failure was a one-off or is reproducible by just re-running the last command, which will skip all the tests that completed, but hitting all the ones that failed or were not run. It's also useful for testing patchsets for publication against bisect problems by only running tests after each patch that have changed anything worth testing -- for instance, a patch that only changes documentation is not going to change any of the binaries, so we can skip a large swath of tests here. The new feature is, of course, optional and can be invoked with -ts. === v2: === - Replaced grep script for awk in patch 01 - Added qemu dependency in patch 02 == For convenience, this branch is available at: https://github.com/jnsnow/qemu.git branch ch3ck https://github.com/jnsnow/qemu/tree/ch3ck This version is tagged ch3ck-v2: https://github.com/jnsnow/qemu/releases/tag/ch3ck-v2 == John Snow (4): iotests: fix exclusion option iotests: Add dependency info to groups list iotests: add timestamp skip feature iotests: clarify help text tests/qemu-iotests/check | 56 +++++++++++++++++++++++++++++++++++++++++- tests/qemu-iotests/common | 15 ++++++++++-- tests/qemu-iotests/group | 62 +++++++++++++++++++++++------------------------ 3 files changed, 99 insertions(+), 34 deletions(-) -- 2.1.0