From: Luc Van Oostenryck <luc.vanoostenryck@gmail.com>
To: linux-sparse@vger.kernel.org
Cc: Luc Van Oostenryck <luc.vanoostenryck@gmail.com>
Subject: [PATCH 1/5] testsuite: check the nbr of times a pattern should be present
Date: Thu, 5 Jan 2017 06:16:28 +0100 [thread overview]
Message-ID: <20170105051632.8392-2-luc.vanoostenryck@gmail.com> (raw)
In-Reply-To: <20170105051632.8392-1-luc.vanoostenryck@gmail.com>
Complement the 'check-output-contains/excludes' tags to also
be able to specify the number of times a given pattern should
occurs in the output.
Signed-off-by: Luc Van Oostenryck <luc.vanoostenryck@gmail.com>
---
Documentation/test-suite | 4 ++++
validation/test-suite | 28 ++++++++++++++++++++++++++++
2 files changed, 32 insertions(+)
diff --git a/Documentation/test-suite b/Documentation/test-suite
index a0f205f4..2e786bbf 100644
--- a/Documentation/test-suite
+++ b/Documentation/test-suite
@@ -49,6 +49,10 @@ check-output-excludes: <pattern> (optional)
Several such tags can be given, in which case the output
must contains none of the patterns.
+check-output-pattern-<nbr>-times: <pattern> (optional)
+ Similar than the contains/excludes her above, but with full control
+ of the number of times the pattern should occurs in the output.
+
Using test-suite
~~~~~~~~~~~~~~~~
diff --git a/validation/test-suite b/validation/test-suite
index e5317109..c14a4c5a 100755
--- a/validation/test-suite
+++ b/validation/test-suite
@@ -93,6 +93,27 @@ has_none_patterns()
has_patterns "$1" "$2" "$3" -eq
}
+##
+# nbr_patterns(ifile tag ofile) - does ofile contains the
+# the patterns given by ifile's tags
+# the right number of time?
+nbr_patterns()
+{
+ ifile="$1"
+ patt="$2"
+ ofile="$3"
+ grep "$patt-[0-9][0-9]*-times:" "$ifile" | \
+ sed -e "s/^.*$patt-\([0-9][0-9]*\)-times: *\(.*\)/\1 \2/" | \
+ while read nbr pat; do
+ n=$(grep -s "$pat" "$ofile" | wc -l)
+ if [ "$n" -ne "$nbr" ]; then
+ return 1
+ fi
+ done
+
+ return $?
+}
+
##
# verbose(string) - prints string if we are in verbose mode
verbose()
@@ -221,6 +242,13 @@ do_test()
test_failed=1
fi
+ # verify the 'check-output-pattern-X-times' tags
+ nbr_patterns "$file" 'check-output-pattern' $file.output.got
+ if [ "$?" -ne "0" ]; then
+ error "Actual output doesn't contain the pattern the expected number."
+ test_failed=1
+ fi
+
get_tag "check-known-to-fail" $file
must_fail=`expr "$?" = 0`
known_ko_tests=`expr $known_ko_tests + $must_fail`
--
2.11.0
next prev parent reply other threads:[~2017-01-05 5:19 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2017-01-05 5:16 [PATCH 0/5] more testsuite improvements Luc Van Oostenryck
2017-01-05 5:16 ` Luc Van Oostenryck [this message]
2017-01-05 5:16 ` [PATCH 2/5] testsuite: use 'error' instead of 'info' for successful tests known to fail Luc Van Oostenryck
2017-01-05 5:16 ` [PATCH 3/5] testsuite: get 'check-known-to-fail' earlier Luc Van Oostenryck
2017-01-05 5:16 ` [PATCH 4/5] testsuite: allow quieter error reporting Luc Van Oostenryck
2017-01-05 5:16 ` [PATCH 5/5] testsuite: quieter error reporting for 'known-to-fail' Luc Van Oostenryck
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20170105051632.8392-2-luc.vanoostenryck@gmail.com \
--to=luc.vanoostenryck@gmail.com \
--cc=linux-sparse@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).