From: Gabriel Feceoru <gabriel.feceoru@intel.com>
To: intel-gfx@lists.freedesktop.org
Subject: [PATCH i-g-t] scripts: Add support to retest tests wich changed results
Date: Fri, 27 Nov 2015 14:40:36 +0200 [thread overview]
Message-ID: <1448628036-7410-1-git-send-email-gabriel.feceoru@intel.com> (raw)
This script takes multiple test results and prints the diffs, useful
for detecting noise in subsequent executions.
It gives the option to re-run these tests.
Signed-off-by: Gabriel Feceoru <gabriel.feceoru@intel.com>
---
scripts/retest-diff.sh | 72 ++++++++++++++++++++++++++++++++++++++++++++++++++
1 file changed, 72 insertions(+)
create mode 100755 scripts/retest-diff.sh
diff --git a/scripts/retest-diff.sh b/scripts/retest-diff.sh
new file mode 100755
index 0000000..aee1d05
--- /dev/null
+++ b/scripts/retest-diff.sh
@@ -0,0 +1,72 @@
+#!/bin/bash
+#
+# Copyright © 2015 Intel Corporation
+#
+# Permission is hereby granted, free of charge, to any person obtaining a
+# copy of this software and associated documentation files (the "Software"),
+# to deal in the Software without restriction, including without limitation
+# the rights to use, copy, modify, merge, publish, distribute, sublicense,
+# and/or sell copies of the Software, and to permit persons to whom the
+# Software is furnished to do so, subject to the following conditions:
+#
+# The above copyright notice and this permission notice (including the next
+# paragraph) shall be included in all copies or substantial portions of the
+# Software.
+#
+# THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+# IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+# FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL
+# THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+# LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
+# FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS
+# IN THE SOFTWARE.
+
+ROOT="`dirname $0`"
+ROOT="`readlink -f $ROOT/..`"
+IGT_TEST_ROOT="$ROOT/tests"
+RESULTS="$ROOT/results"
+PIGLIT="$ROOT/piglit/piglit"
+
+if [ ! -d "$IGT_TEST_ROOT" ]; then
+ echo "Error: could not find tests directory."
+ exit 1
+fi
+
+function print_help {
+ echo "Usage: $0 [<Results Paths> ...]"
+ echo ""
+}
+
+
+if [ $# -lt 2 ]; then
+ print_help
+ exit 1
+fi
+
+RESULT_FILES=$@
+
+for result in $RESULT_FILES; do
+ if [ ! -e $result ]; then
+ echo "Wrong result paths"
+ exit 1
+ fi
+done
+
+
+TESTS=`$PIGLIT summary console -d $RESULT_FILES | grep igt | cut -d':' -f1`
+if [[ -z $TESTS ]]; then
+ exit 1
+else
+ RED='\033[0;31m'
+ NC='\033[0m'
+ printf "$RED $TESTS $NC " | sed -e 's/ /\n/g'
+fi
+
+
+read -p "Dow you want to run these tests [y/N]? " -n 2 -r
+if [[ $REPLY =~ ^[Yy]$ ]]; then
+ mkdir -p $RESULTS
+ TEST_LIST=($TESTS)
+ TEST_PARAMS=`printf "%s " "${TEST_LIST[@]/#/-t }"`
+ sudo IGT_TEST_ROOT=$IGT_TEST_ROOT $PIGLIT run igt $RESULTS $TEST_PARAMS
+fi
--
1.9.1
_______________________________________________
Intel-gfx mailing list
Intel-gfx@lists.freedesktop.org
http://lists.freedesktop.org/mailman/listinfo/intel-gfx
next reply other threads:[~2015-11-27 12:33 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-11-27 12:40 Gabriel Feceoru [this message]
2015-11-27 14:53 ` [PATCH i-g-t] scripts: Add support to retest tests wich changed results Thomas Wood
2015-11-30 8:34 ` Daniel Vetter
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1448628036-7410-1-git-send-email-gabriel.feceoru@intel.com \
--to=gabriel.feceoru@intel.com \
--cc=intel-gfx@lists.freedesktop.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox