From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:53297) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1YvtNg-0007rS-Et for qemu-devel@nongnu.org; Fri, 22 May 2015 16:17:21 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1YvtNe-0002iH-0t for qemu-devel@nongnu.org; Fri, 22 May 2015 16:17:20 -0400 Received: from mx1.redhat.com ([209.132.183.28]:34860) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1YvtNd-0002iA-PP for qemu-devel@nongnu.org; Fri, 22 May 2015 16:17:17 -0400 Received: from int-mx14.intmail.prod.int.phx2.redhat.com (int-mx14.intmail.prod.int.phx2.redhat.com [10.5.11.27]) by mx1.redhat.com (Postfix) with ESMTPS id 7DF353674A5 for ; Fri, 22 May 2015 20:17:17 +0000 (UTC) From: John Snow Date: Fri, 22 May 2015 16:17:11 -0400 Message-Id: <1432325832-12887-4-git-send-email-jsnow@redhat.com> In-Reply-To: <1432325832-12887-1-git-send-email-jsnow@redhat.com> References: <1432325832-12887-1-git-send-email-jsnow@redhat.com> Subject: [Qemu-devel] [PATCH 3/4] iotests: add timestamp skip feature List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: qemu-devel@nongnu.org Cc: kwolf@redhat.com, famz@redhat.com, John Snow Like a makefile, try to skip tests if we know they have already been executed using the current set of external dependencies. If a user passes the -ts option to ./check, if a test or its output or its dependencies (qemu, qemu-nbd, qemu-io, qemu-img, socket-scm-helper) have been modified, the test will be skipped. This is primarily to speed up running bisectability tests for larger series where each interim patch may or may not change all of the dependencies, so some tests can be skipped. Signed-off-by: John Snow --- tests/qemu-iotests/check | 56 ++++++++++++++++++++++++++++++++++++++++++++++- tests/qemu-iotests/common | 6 +++++ 2 files changed, 61 insertions(+), 1 deletion(-) diff --git a/tests/qemu-iotests/check b/tests/qemu-iotests/check index baeae80..0db40e2 100755 --- a/tests/qemu-iotests/check +++ b/tests/qemu-iotests/check @@ -141,6 +141,51 @@ _timestamp() echo -n " [$now]" } +_okfile() +{ + echo "ts/${IMGPROTO}/${IMGFMT}/${1}.ok" +} + +# _hasdep +_hasdep() +{ + grep -q "^${1}.*${2}" "${source_iotests}/group" +} + +# _skippable +_skippable() +{ + tsfile=$(_okfile "${1}") + deps=(${QEMU_IMG} \ + ${QEMU_IO} \ + "${source_iotests}/${1}" \ + "${source_iotests}/${1}.out" \ + "${source_iotests}/common" \ + "${source_iotests}/common.rc" \ + "${source_iotests}/common.env" \ + "${source_iotests}/common.config") + + if _hasdep "${1}" "scm"; then + deps+=("${SOCKET_SCM_HELPER}") + fi + + if _hasdep "${1}" "nbd" || [ "$IMGPROTO" = "nbd" ]; then + deps+=("${QEMU_NBD}") + fi + + if _hasdep "${1}" "qemu"; then + deps+=("${QEMU}") + fi + + if [ ! -e "${tsfile}" ]; then return 1; fi + for dep in "${deps[@]}"; do + if [ "${tsfile}" -ot "${dep}" ]; then return 1; fi + done + + # Looks skippable, .ok file is newer than all external dependencies. + return 0 +} + _wrapup() { # for hangcheck ... @@ -268,6 +313,10 @@ do echo " - expunged" rm -f $seq.out.bad echo "/^$seq\$/d" >>$tmp.expunged + + elif [ "${ts_skip}" == "true" ] && _skippable "${seq}"; then + echo " [skip] (Results are recent)" + elif [ ! -f "$source_iotests/$seq" ] then echo " - no such test?" @@ -275,7 +324,8 @@ do else # really going to try and run this one # - rm -f $seq.out.bad + tsfile="$(_okfile ${seq})" + rm -f $seq.out.bad "${tsfile}" lasttime=`sed -n -e "/^$seq /s/.* //p" >$tmp.time fi else diff --git a/tests/qemu-iotests/common b/tests/qemu-iotests/common index c4d0742..b3d869e 100644 --- a/tests/qemu-iotests/common +++ b/tests/qemu-iotests/common @@ -161,6 +161,8 @@ check options -T output timestamps -r randomize test order -c mode cache mode + -ts timestamp skip: skip tests when already ran and + no dependencies have changed on disk. testlist options -g group[,group...] include tests from these groups @@ -319,6 +321,10 @@ testlist options xpand=false ;; + -ts) + ts_skip=true + xpand=false + ;; -v) verbose=true xpand=false -- 2.1.0