Re: [PATCH 0/5]: CLI and feature improvements for check-parallel

[Dave Chinner <david@fromorbit.com>]

On Tue, Jan 14, 2025 at 10:29:16PM -0800, Darrick J. Wong wrote:
> On Wed, Jan 15, 2025 at 04:51:11PM +1100, Dave Chinner wrote:
> > Hi folks,
> > 
> > This patchset brings some new functionality to check-parallel to
> > make it easier to run across different machines and filesystems.
> > The patch seti adds these features:
> > 
> > - auto-adjusts concurrency for the machine it is running on.
> > - adds CLI support of selection of tests. These CLI parameters are
> >   identical to the check CLI parameters and the test lists are built
> >   using the same code.
> > - adds support for logwrites devices so that all the test that use
> >   dm-logwrites are now enabled
> > - adds support for specifying the initial filesystem type to test
> >   on the CLI. This makes it easy to select xfs, btrfs, ext4, etc as
> >   the target filesystem type that is to be tested.
> > - Only block device based filesystems can be used with
> >   check-parallel, and this is now enforced at FSTYP selection time.
> 
> Can you please add a --help so that curious users don't have to go find
> the calling conventions by reading the bash? :)

Already implemented:

$ ./check-parallel --help
Usage: ./check-parallel [options] [testlist]

check options
    -D <dir>            Directory to run in
    -n                  Output test list, do not run tests
    -r                  randomize test order
    --exact-order       run tests in the exact order specified
    -s section          run only specified section from config file
    -f <FSTYPE>         specify the filesystem type to test

testlist options
    -g group[,group...] include tests from these groups
    -x group[,group...] exclude tests from these groups
    -X exclude_file     exclude individual tests
    -e testlist         exclude a specific list of tests
    -E external_file    exclude individual tests
    [testlist]          include tests matching names in testlist

testlist argument is a list of tests in the form of <test dir>/<test name>.

<test dir> is a directory under tests that contains a group file,
with a list of the names of the tests in that directory.

<test name> may be either a specific test file name (e.g. xfs/001) or
a test file name match pattern (e.g. xfs/*).

group argument is either a name of a tests group to collect from all
the test dirs (e.g. quick) or a name of a tests group to collect from
a specific tests dir in the form of <test dir>/<group name> (e.g. xfs/quick).
If you want to run all the tests in the test suite, use "-g all" to specify all
groups.

exclude_file argument refers to a name of a file inside each test directory.
for every test dir where this file is found, the listed test names are
excluded from the list of tests to run from that test dir.

external_file argument is a path to a single file containing a list of tests
to exclude in the form of <test dir>/<test name>.

examples:
 check-parallel -f xfs -D /mnt xfs/001
 check-parallel -f ext4 -D /mnt -g quick
 check-parallel -D /mnt -g xfs/quick
 check-parallel -D /mnt -x stress xfs/*
 check-parallel -f btrfs -D /mnt -X .exclude -g auto
 check-parallel -f udf -D /mnt -E ~/.xfstests.exclude
$

-Dave.

-- 
Dave Chinner
david@fromorbit.com