Intel-GFX Archive on lore.kernel.org
 help / color / mirror / Atom feed
From: Gabriel Feceoru <gabriel.feceoru@intel.com>
To: intel-gfx@lists.freedesktop.org
Subject: [PATCH i-g-t] scripts: Add support to retest tests wich changed results
Date: Fri, 27 Nov 2015 14:40:36 +0200	[thread overview]
Message-ID: <1448628036-7410-1-git-send-email-gabriel.feceoru@intel.com> (raw)

This script takes multiple test results and prints the diffs, useful
for detecting noise in subsequent executions.
It gives the option to re-run these tests.

Signed-off-by: Gabriel Feceoru <gabriel.feceoru@intel.com>
---
 scripts/retest-diff.sh | 72 ++++++++++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 72 insertions(+)
 create mode 100755 scripts/retest-diff.sh

diff --git a/scripts/retest-diff.sh b/scripts/retest-diff.sh
new file mode 100755
index 0000000..aee1d05
--- /dev/null
+++ b/scripts/retest-diff.sh
@@ -0,0 +1,72 @@
+#!/bin/bash
+#
+# Copyright © 2015 Intel Corporation
+#
+# Permission is hereby granted, free of charge, to any person obtaining a
+# copy of this software and associated documentation files (the "Software"),
+# to deal in the Software without restriction, including without limitation
+# the rights to use, copy, modify, merge, publish, distribute, sublicense,
+# and/or sell copies of the Software, and to permit persons to whom the
+# Software is furnished to do so, subject to the following conditions:
+#
+# The above copyright notice and this permission notice (including the next
+# paragraph) shall be included in all copies or substantial portions of the
+# Software.
+#
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT.  IN NO EVENT SHALL
+# THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
+# FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS
+# IN THE SOFTWARE.
+
+ROOT="`dirname $0`"
+ROOT="`readlink -f $ROOT/..`"
+IGT_TEST_ROOT="$ROOT/tests"
+RESULTS="$ROOT/results"
+PIGLIT="$ROOT/piglit/piglit"
+
+if [ ! -d "$IGT_TEST_ROOT" ]; then
+	echo "Error: could not find tests directory."
+	exit 1
+fi
+
+function print_help {
+	echo "Usage: $0 [<Results Paths> ...]"
+	echo ""
+}
+
+
+if [ $# -lt 2 ]; then
+	print_help
+	exit 1
+fi
+
+RESULT_FILES=$@
+
+for result in $RESULT_FILES; do
+    if [ ! -e $result ]; then
+        echo "Wrong result paths"
+        exit 1
+    fi
+done
+
+
+TESTS=`$PIGLIT summary console -d $RESULT_FILES | grep igt | cut -d':' -f1`
+if [[ -z $TESTS ]]; then
+    exit 1
+else
+    RED='\033[0;31m'
+    NC='\033[0m'
+    printf "$RED $TESTS $NC " | sed -e 's/ /\n/g'
+fi
+
+
+read -p "Dow you want to run these tests [y/N]? " -n 2 -r
+if [[ $REPLY =~ ^[Yy]$ ]]; then
+    mkdir -p $RESULTS
+    TEST_LIST=($TESTS)
+    TEST_PARAMS=`printf "%s "  "${TEST_LIST[@]/#/-t }"`
+    sudo IGT_TEST_ROOT=$IGT_TEST_ROOT $PIGLIT run igt $RESULTS $TEST_PARAMS
+fi
-- 
1.9.1

_______________________________________________
Intel-gfx mailing list
Intel-gfx@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/intel-gfx

             reply	other threads:[~2015-11-27 12:33 UTC|newest]

Thread overview: 3+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-11-27 12:40 Gabriel Feceoru [this message]
2015-11-27 14:53 ` [PATCH i-g-t] scripts: Add support to retest tests wich changed results Thomas Wood
2015-11-30  8:34   ` Daniel Vetter

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1448628036-7410-1-git-send-email-gabriel.feceoru@intel.com \
    --to=gabriel.feceoru@intel.com \
    --cc=intel-gfx@lists.freedesktop.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox