public inbox for linux-xfs@vger.kernel.org
 help / color / mirror / Atom feed
From: Phil White <pwhite@sgi.com>
To: Dave Chinner <david@fromorbit.com>
Cc: xfs@oss.sgi.com
Subject: Re: [PATCH 21/25] xfstests: Reintroduce configurable test expunging.
Date: Sat, 23 Mar 2013 03:24:23 -0700	[thread overview]
Message-ID: <20130323102423.GY25253@caliban.engr.sgi.com> (raw)
In-Reply-To: <1363350489-22257-22-git-send-email-david@fromorbit.com>

Looks OK.

Reviewed-by: Phil White <pwhite@sgi.com>

On Fri, Mar 15, 2013 at 11:28:05PM +1100, Dave Chinner wrote:
> From: Dave Chinner <dchinner@redhat.com>
> 
> It is definitely handy to be able to disabdle certain tests (e.g. tests that are
> known to hang or crash the test machine on certain kernels), so re-introducing
> the capability of avoiding certain tests just by placing them in a file is
> useful.
> 
> Introduce a command line option to specify the expunged file name. The file will
> exist in each tests/* sub-directory so that only the testname is required, and
> can be managed independently. The use of a command line parameter allows
> multiple expunge files to exist simultaneously in the one xfstests tree which
> simplifies management of a source repository used for multiple versions of a
> distro.
> 
> Typical usage:
> 
> $ cat tests/generic/3.0-stable-avoid
> 280
> $ sudo ./check -X 3.0-stable-avoid generic/280
> FSTYP         -- xfs (debug)
> PLATFORM      -- Linux/x86_64 test-1 3.0.39-dgc+
> MKFS_OPTIONS  -- -f -bsize=4096 /dev/vdb
> MOUNT_OPTIONS -- /dev/vdb /mnt/scratch
> 
> generic/280     [expunged]
> Passed all 0 tests
> $
> 
> Eventually we should be able to automate setting up expunged files based on
> distro release or kernel version through this infrastructure.
> 
> Signed-off-by: Dave Chinner <dchinner@redhat.com>
> ---
>  check |   59 ++++++++++++++++++++++++++++++++++++++++++++---------------
>  1 file changed, 44 insertions(+), 15 deletions(-)
> 
> diff --git a/check b/check
> index cc426db..17bc004 100755
> --- a/check
> +++ b/check
> @@ -34,6 +34,7 @@ have_test_arg=false
>  randomize=false
>  here=`pwd`
>  FSTYP=xfs
> +xfile=""
>  
>  SUPPORTED_TESTS="[0-9][0-9][0-9] [0-9][0-9][0-9][0-9]"
>  SRC_GROUPS="generic shared"
> @@ -72,6 +73,7 @@ check options
>  testlist options
>      -g group[,group...]	include tests from these groups
>      -x group[,group...]	exclude tests from these groups
> +    -X file		exclude individual tests
>      [testlist]		include tests matching names in testlist
>  '
>  	    exit 0
> @@ -110,6 +112,30 @@ get_all_tests()
>  	done
>  }
>  
> +# takes the list of tests to run in $tmp.list, and removes the tests passed to
> +# the function from that list.
> +trim_test_list()
> +{
> +	test_list="$*"
> +
> +	rm -f $tmp.grep
> +	numsed=0
> +	for t in $test_list
> +	do
> +	    if [ $numsed -gt 100 ]; then
> +		grep -v -f $tmp.grep <$tmp.list >$tmp.tmp
> +		mv $tmp.tmp $tmp.list
> +		numsed=0
> +		rm -f $tmp.grep
> +	    fi
> +	    echo "^$t\$" >>$tmp.grep
> +	    numsed=`expr $numsed + 1`
> +	done
> +	grep -v -f $tmp.grep <$tmp.list >$tmp.tmp
> +	mv $tmp.tmp $tmp.list
> +}
> +
> +
>  _wallclock()
>  {
>      date "+%H %M %S" | $AWK_PROG '{ print $1*3600 + $2*60 + $3 }'
> @@ -124,7 +150,7 @@ _timestamp()
>  # start the initialisation work now
>  _setenvironment
>  
> -rm -f $tmp.list $tmp.tmp $tmp.grep $here/$iam.out
> +rm -f $tmp.list $tmp.tmp $tmp.grep $here/$iam.out $tmp.xlist
>  
>  # Autodetect fs type based on what's on $TEST_DEV
>  if [ "$HOSTOS" == "Linux" ]; then
> @@ -177,21 +203,16 @@ while [ $# -gt 0 ]; do
>  		    exit 1
>  		fi
>  
> -		rm -f $tmp.grep
> -		numsed=0
> -		for t in $group_list
> -		do
> -		    if [ $numsed -gt 100 ]; then
> -			grep -v -f $tmp.grep <$tmp.list >$tmp.tmp
> -			mv $tmp.tmp $tmp.list
> -			numsed=0
> -			rm -f $tmp.grep
> -		    fi
> -		    echo "^$t\$" >>$tmp.grep
> -		    numsed=`expr $numsed + 1`
> +		trim_test_list $group_list
> +		;;
> +
> +	-X)	xfile=$2; shift ;
> +		for d in $SRC_GROUPS $FSTYP; do
> +			[ -f $SRC_DIR/$d/$xfile ] || continue
> +			for f in `cat $SRC_DIR/$d/$xfile`; do
> +				echo $d/$f >> $tmp.xlist
> +			done
>  		done
> -		grep -v -f $tmp.grep <$tmp.list >$tmp.tmp
> -		mv $tmp.tmp $tmp.list
>  		;;
>  
>  	-l)	diff="diff" ;;
> @@ -413,6 +434,14 @@ do
>  	#
>  	rm -f $seqres.out.bad
>  
> +	# check if we really should run it
> +	if [ -s $tmp.xlist ]; then
> +		if grep $seqnum $tmp.xlist > /dev/null 2>&1 ; then
> +			echo "       [expunged]"
> +			continue
> +		fi
> +	fi
> +
>  	# slashes now in names, sed barfs on them so use grep
>  	lasttime=`grep -w ^$seq check.time | awk '// {print $2}'`
>  	if [ "X$lasttime" != X ]; then
> -- 
> 1.7.10.4
> 
> _______________________________________________
> xfs mailing list
> xfs@oss.sgi.com
> http://oss.sgi.com/mailman/listinfo/xfs

_______________________________________________
xfs mailing list
xfs@oss.sgi.com
http://oss.sgi.com/mailman/listinfo/xfs

  reply	other threads:[~2013-03-23 10:24 UTC|newest]

Thread overview: 59+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-03-15 12:27 [PATCH 00/25] xfstests: xfstests: move tests out of top level Dave Chinner
2013-03-15 12:27 ` [PATCH 01/25] xfstests: remove remake script Dave Chinner
2013-03-22 16:51   ` Phil White
2013-03-15 12:27 ` [PATCH 02/25] xfstests: remove bench infrastructure Dave Chinner
2013-03-15 19:36   ` Phil White
2013-03-19 22:31     ` Dave Chinner
2013-03-21 23:52       ` Phil White
2013-03-22  7:37         ` Dave Chinner
2013-03-22 16:22           ` Troy McCorkell
2013-03-26 20:26             ` Troy McCorkell
2013-03-22 16:53   ` Phil White
2013-03-15 12:27 ` [PATCH 03/25] xfstests: kill useless test owner fields Dave Chinner
2013-03-22 16:57   ` Phil White
2013-03-15 12:27 ` [PATCH 04/25] xfstests: remove stale machine configs Dave Chinner
2013-03-22 17:02   ` Phil White
2013-03-15 12:27 ` [PATCH 05/25] xfstests: fold common into check Dave Chinner
2013-03-23 10:18   ` Phil White
2013-03-15 12:27 ` [PATCH 06/25] xfstests: clean up and simply check CLI option parsing Dave Chinner
2013-03-23 10:19   ` Phil White
2013-03-15 12:27 ` [PATCH 07/25] xfstests: kill hangcheck stuff from check Dave Chinner
2013-03-23 10:19   ` Phil White
2013-03-15 12:27 ` [PATCH 08/25] xfstests: remove test expunge file support Dave Chinner
2013-03-23 10:19   ` Phil White
2013-03-15 12:27 ` [PATCH 09/25] xfstests: remove undocumented TESTS_REMAINING_LOG Dave Chinner
2013-03-23 10:20   ` Phil White
2013-03-15 12:27 ` [PATCH 10/25] xfstests: include test subdirectory support Dave Chinner
2013-03-23 10:20   ` Phil White
2013-03-15 12:27 ` [PATCH 11/25] xfstests: remove 285.full and 286.full Dave Chinner
2013-03-23 10:20   ` Phil White
2013-03-15 12:27 ` [PATCH 12/25] xfstests: move generic tests out of top level dir Dave Chinner
2013-03-23 10:22   ` Phil White
2013-03-15 12:27 ` [PATCH 13/25] xfstests: move xfs specific tests out of top directory Dave Chinner
2013-03-23 10:22   ` Phil White
2013-03-15 12:27 ` [PATCH 14/25] xfstests: move remaining tests out of top level directory Dave Chinner
2013-03-23 10:23   ` Phil White
2013-03-15 12:27 ` [PATCH 15/25] xfstests: rework CLI individual test specification Dave Chinner
2013-03-23 10:23   ` Phil White
2013-03-15 12:28 ` [PATCH 16/25] xfstests: make exclude groups aware of multiple subdirectories Dave Chinner
2013-03-23 10:23   ` Phil White
2013-03-15 12:28 ` [PATCH 17/25] xfstests: Introduce a results directory Dave Chinner
2013-03-23 10:23   ` Phil White
2013-03-15 12:28 ` [PATCH 18/25] xfstests: convert tests to use new " Dave Chinner
2013-03-23 10:24   ` Phil White
2013-03-15 12:28 ` [PATCH 19/25] xfstests: fix _link_out_file callers Dave Chinner
2013-03-23 10:24   ` Phil White
2013-03-15 12:28 ` [PATCH 20/25] xfstests: introduce a common directory Dave Chinner
2013-03-23 10:24   ` Phil White
2013-03-15 12:28 ` [PATCH 21/25] xfstests: Reintroduce configurable test expunging Dave Chinner
2013-03-23 10:24   ` Phil White [this message]
2013-03-15 12:28 ` [PATCH 22/25] xfstests: RESULTS_DIR needs to be an absolute path Dave Chinner
2013-03-23 10:24   ` Phil White
2013-03-15 12:28 ` [PATCH 23/25] xfstests: Decomplicate quota setup in 050 Dave Chinner
2013-03-23 10:24   ` Phil White
2013-03-15 12:28 ` [PATCH 24/25] xfstests: clean up test 262 output file use Dave Chinner
2013-03-23 10:24   ` Phil White
2013-03-15 12:28 ` [PATCH 25/25] xfstests: use _notrun for tape checks Dave Chinner
2013-03-23 10:24   ` Phil White
2013-03-27 10:51 ` [PATCH 00/25] xfstests: xfstests: move tests out of top level Rich Johnston
2013-03-27 10:51 ` Rich Johnston

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20130323102423.GY25253@caliban.engr.sgi.com \
    --to=pwhite@sgi.com \
    --cc=david@fromorbit.com \
    --cc=xfs@oss.sgi.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox