From: Thomas Huth <thuth@redhat.com>
To: qemu-devel@nongnu.org
Cc: "Fam Zheng" <fam@euphon.net>,
qemu-block@nongnu.org, "Eric Blake" <eblake@redhat.com>,
"Ed Maste" <emaste@freebsd.org>,
"Christophe Fergeau" <cfergeau@redhat.com>,
"Kevin Wolf" <kwolf@redhat.com>, "Max Reitz" <mreitz@redhat.com>,
"Li-Wen Hsu" <lwhsu@freebsd.org>,
"Philippe Mathieu-Daudé" <philmd@redhat.com>,
"Wainer dos Santos Moschetta" <wainersm@redhat.com>,
"Markus Armbruster" <armbru@redhat.com>,
"Alex Bennée" <alex.bennee@linaro.org>
Subject: [Qemu-devel] [PATCH v2 0/8] tests/qemu-iotests: Run basic iotests during "make check"
Date: Sun, 28 Apr 2019 17:54:43 +0200 [thread overview]
Message-ID: <20190428155451.15653-1-thuth@redhat.com> (raw)
People often forget to run the iotests before submitting patches or
pull requests - this is likely due to the fact that we do not run the
tests during our mandatory "make check" tests yet.
This patch series now changes the "auto" group to only include tests
that should be safe to run in all CI environments (including FreeBSD
and macOS!). Thus these iotests can now always be run during "make
check" automatically, too.
v2:
- Use "auto" group instead of adding a new "ci" group
- Adjusted the tests that are run automatically (after doing lots
of CI runs on cirrus-ci.com, gitlab and travis)
- Added patch to fix the current regression with the "qemu-io:"
prefix in the master branch
- Added a fix for iotest 005 on ext4 filesystems (skip it there)
Thomas Huth (8):
tests/qemu-iotests: Fix output of qemu-io related tests
tests/qemu-iotests/005: Add a sanity check for large sparse file
support
tests/qemu-iotests/check: Pick a default machine if necessary
tests/qemu-iotests: Do not hard-code the path to bash
cirrus / travis: Add gnu-sed and bash for macOS and FreeBSD
tests/qemu-iotests: Remove the "_supported_os Linux" line from many
tests
tests/qemu-iotests/group: Re-use the "auto" group for tests that can
always run
tests: Run the iotests during "make check" again
.cirrus.yml | 4 +-
.travis.yml | 1 +
tests/Makefile.include | 8 +-
tests/check-block.sh | 44 +++++++---
tests/qemu-iotests-quick.sh | 8 --
tests/qemu-iotests/001 | 1 -
tests/qemu-iotests/002 | 1 -
tests/qemu-iotests/003 | 1 -
tests/qemu-iotests/004 | 1 -
tests/qemu-iotests/005 | 9 ++
tests/qemu-iotests/007 | 1 -
tests/qemu-iotests/008 | 1 -
tests/qemu-iotests/009 | 1 -
tests/qemu-iotests/010 | 1 -
tests/qemu-iotests/011 | 1 -
tests/qemu-iotests/012 | 1 -
tests/qemu-iotests/015 | 1 -
tests/qemu-iotests/017 | 1 -
tests/qemu-iotests/020 | 1 -
tests/qemu-iotests/021 | 1 -
tests/qemu-iotests/022 | 1 -
tests/qemu-iotests/025 | 1 -
tests/qemu-iotests/026 | 1 -
tests/qemu-iotests/026.out | 168 +++++++++++++++++------------------
tests/qemu-iotests/027 | 1 -
tests/qemu-iotests/029 | 1 -
tests/qemu-iotests/031 | 1 -
tests/qemu-iotests/032 | 1 -
tests/qemu-iotests/033 | 1 -
tests/qemu-iotests/035 | 1 -
tests/qemu-iotests/036 | 1 -
tests/qemu-iotests/037 | 1 -
tests/qemu-iotests/042 | 1 -
tests/qemu-iotests/043 | 1 -
tests/qemu-iotests/046 | 1 -
tests/qemu-iotests/047 | 1 -
tests/qemu-iotests/049 | 1 -
tests/qemu-iotests/050 | 1 -
tests/qemu-iotests/051 | 1 -
tests/qemu-iotests/052 | 1 -
tests/qemu-iotests/053 | 1 -
tests/qemu-iotests/054 | 1 -
tests/qemu-iotests/060.out | 6 +-
tests/qemu-iotests/062 | 1 -
tests/qemu-iotests/063 | 1 -
tests/qemu-iotests/066 | 1 -
tests/qemu-iotests/067 | 1 -
tests/qemu-iotests/068 | 1 -
tests/qemu-iotests/069 | 1 -
tests/qemu-iotests/069.out | 2 +-
tests/qemu-iotests/070.out | 2 +-
tests/qemu-iotests/071 | 1 -
tests/qemu-iotests/072 | 1 -
tests/qemu-iotests/073 | 1 -
tests/qemu-iotests/075.out | 14 +--
tests/qemu-iotests/076.out | 6 +-
tests/qemu-iotests/078.out | 12 +--
tests/qemu-iotests/079 | 1 -
tests/qemu-iotests/080.out | 40 ++++-----
tests/qemu-iotests/081.out | 2 +-
tests/qemu-iotests/082 | 1 -
tests/qemu-iotests/085 | 1 -
tests/qemu-iotests/088.out | 12 +--
tests/qemu-iotests/089 | 1 -
tests/qemu-iotests/090 | 1 -
tests/qemu-iotests/094 | 1 -
tests/qemu-iotests/095 | 1 -
tests/qemu-iotests/098 | 1 -
tests/qemu-iotests/102 | 1 -
tests/qemu-iotests/103 | 1 -
tests/qemu-iotests/103.out | 14 +--
tests/qemu-iotests/104 | 1 -
tests/qemu-iotests/105 | 1 -
tests/qemu-iotests/107 | 1 -
tests/qemu-iotests/110 | 1 -
tests/qemu-iotests/111 | 1 -
tests/qemu-iotests/112 | 1 -
tests/qemu-iotests/114 | 1 -
tests/qemu-iotests/114.out | 2 +-
tests/qemu-iotests/115 | 1 -
tests/qemu-iotests/116.out | 14 +--
tests/qemu-iotests/117 | 1 -
tests/qemu-iotests/120 | 1 -
tests/qemu-iotests/125 | 1 -
tests/qemu-iotests/126 | 1 -
tests/qemu-iotests/127 | 1 -
tests/qemu-iotests/131.out | 2 +-
tests/qemu-iotests/133 | 1 -
tests/qemu-iotests/133.out | 30 +++----
tests/qemu-iotests/134 | 1 -
tests/qemu-iotests/137.out | 28 +++---
tests/qemu-iotests/140.out | 2 +-
tests/qemu-iotests/142 | 1 -
tests/qemu-iotests/143 | 1 -
tests/qemu-iotests/143.out | 2 +-
tests/qemu-iotests/144 | 1 -
tests/qemu-iotests/145 | 1 -
tests/qemu-iotests/153 | 1 -
tests/qemu-iotests/153.out | 30 +++----
tests/qemu-iotests/156 | 1 -
tests/qemu-iotests/157 | 1 -
tests/qemu-iotests/158 | 1 -
tests/qemu-iotests/159 | 1 -
tests/qemu-iotests/162 | 1 -
tests/qemu-iotests/170 | 1 -
tests/qemu-iotests/173 | 1 -
tests/qemu-iotests/182 | 1 -
tests/qemu-iotests/183 | 1 -
tests/qemu-iotests/186 | 1 -
tests/qemu-iotests/187 | 1 -
tests/qemu-iotests/187.out | 6 +-
tests/qemu-iotests/188.out | 2 +-
tests/qemu-iotests/190 | 1 -
tests/qemu-iotests/191 | 1 -
tests/qemu-iotests/192 | 1 -
tests/qemu-iotests/195 | 1 -
tests/qemu-iotests/197 | 1 -
tests/qemu-iotests/197.out | 2 +-
tests/qemu-iotests/200 | 1 -
tests/qemu-iotests/205 | 2 +-
tests/qemu-iotests/214 | 1 -
tests/qemu-iotests/215 | 1 -
tests/qemu-iotests/215.out | 2 +-
tests/qemu-iotests/217 | 1 -
tests/qemu-iotests/226.out | 16 ++--
tests/qemu-iotests/227 | 1 -
tests/qemu-iotests/231 | 1 -
tests/qemu-iotests/233 | 1 -
tests/qemu-iotests/239 | 2 +-
tests/qemu-iotests/240 | 3 +-
tests/qemu-iotests/241 | 2 +-
tests/qemu-iotests/243 | 2 +-
tests/qemu-iotests/244 | 2 +-
tests/qemu-iotests/244.out | 10 +--
tests/qemu-iotests/247 | 1 -
tests/qemu-iotests/check | 13 ++-
tests/qemu-iotests/group | 169 +++++++++++++++++++-----------------
137 files changed, 372 insertions(+), 421 deletions(-)
delete mode 100755 tests/qemu-iotests-quick.sh
--
2.21.0
WARNING: multiple messages have this Message-ID (diff)
From: Thomas Huth <thuth@redhat.com>
To: qemu-devel@nongnu.org
Cc: "Fam Zheng" <fam@euphon.net>, "Kevin Wolf" <kwolf@redhat.com>,
"Ed Maste" <emaste@freebsd.org>,
qemu-block@nongnu.org,
"Philippe Mathieu-Daudé" <philmd@redhat.com>,
"Markus Armbruster" <armbru@redhat.com>,
"Christophe Fergeau" <cfergeau@redhat.com>,
"Max Reitz" <mreitz@redhat.com>,
"Alex Bennée" <alex.bennee@linaro.org>,
"Wainer dos Santos Moschetta" <wainersm@redhat.com>,
"Li-Wen Hsu" <lwhsu@freebsd.org>
Subject: [Qemu-devel] [PATCH v2 0/8] tests/qemu-iotests: Run basic iotests during "make check"
Date: Sun, 28 Apr 2019 17:54:43 +0200 [thread overview]
Message-ID: <20190428155451.15653-1-thuth@redhat.com> (raw)
Message-ID: <20190428155443.CzUvooTYcvzVVQHEAh3Xu0QRft_6OX7tAhfOmBeakFc@z> (raw)
People often forget to run the iotests before submitting patches or
pull requests - this is likely due to the fact that we do not run the
tests during our mandatory "make check" tests yet.
This patch series now changes the "auto" group to only include tests
that should be safe to run in all CI environments (including FreeBSD
and macOS!). Thus these iotests can now always be run during "make
check" automatically, too.
v2:
- Use "auto" group instead of adding a new "ci" group
- Adjusted the tests that are run automatically (after doing lots
of CI runs on cirrus-ci.com, gitlab and travis)
- Added patch to fix the current regression with the "qemu-io:"
prefix in the master branch
- Added a fix for iotest 005 on ext4 filesystems (skip it there)
Thomas Huth (8):
tests/qemu-iotests: Fix output of qemu-io related tests
tests/qemu-iotests/005: Add a sanity check for large sparse file
support
tests/qemu-iotests/check: Pick a default machine if necessary
tests/qemu-iotests: Do not hard-code the path to bash
cirrus / travis: Add gnu-sed and bash for macOS and FreeBSD
tests/qemu-iotests: Remove the "_supported_os Linux" line from many
tests
tests/qemu-iotests/group: Re-use the "auto" group for tests that can
always run
tests: Run the iotests during "make check" again
.cirrus.yml | 4 +-
.travis.yml | 1 +
tests/Makefile.include | 8 +-
tests/check-block.sh | 44 +++++++---
tests/qemu-iotests-quick.sh | 8 --
tests/qemu-iotests/001 | 1 -
tests/qemu-iotests/002 | 1 -
tests/qemu-iotests/003 | 1 -
tests/qemu-iotests/004 | 1 -
tests/qemu-iotests/005 | 9 ++
tests/qemu-iotests/007 | 1 -
tests/qemu-iotests/008 | 1 -
tests/qemu-iotests/009 | 1 -
tests/qemu-iotests/010 | 1 -
tests/qemu-iotests/011 | 1 -
tests/qemu-iotests/012 | 1 -
tests/qemu-iotests/015 | 1 -
tests/qemu-iotests/017 | 1 -
tests/qemu-iotests/020 | 1 -
tests/qemu-iotests/021 | 1 -
tests/qemu-iotests/022 | 1 -
tests/qemu-iotests/025 | 1 -
tests/qemu-iotests/026 | 1 -
tests/qemu-iotests/026.out | 168 +++++++++++++++++------------------
tests/qemu-iotests/027 | 1 -
tests/qemu-iotests/029 | 1 -
tests/qemu-iotests/031 | 1 -
tests/qemu-iotests/032 | 1 -
tests/qemu-iotests/033 | 1 -
tests/qemu-iotests/035 | 1 -
tests/qemu-iotests/036 | 1 -
tests/qemu-iotests/037 | 1 -
tests/qemu-iotests/042 | 1 -
tests/qemu-iotests/043 | 1 -
tests/qemu-iotests/046 | 1 -
tests/qemu-iotests/047 | 1 -
tests/qemu-iotests/049 | 1 -
tests/qemu-iotests/050 | 1 -
tests/qemu-iotests/051 | 1 -
tests/qemu-iotests/052 | 1 -
tests/qemu-iotests/053 | 1 -
tests/qemu-iotests/054 | 1 -
tests/qemu-iotests/060.out | 6 +-
tests/qemu-iotests/062 | 1 -
tests/qemu-iotests/063 | 1 -
tests/qemu-iotests/066 | 1 -
tests/qemu-iotests/067 | 1 -
tests/qemu-iotests/068 | 1 -
tests/qemu-iotests/069 | 1 -
tests/qemu-iotests/069.out | 2 +-
tests/qemu-iotests/070.out | 2 +-
tests/qemu-iotests/071 | 1 -
tests/qemu-iotests/072 | 1 -
tests/qemu-iotests/073 | 1 -
tests/qemu-iotests/075.out | 14 +--
tests/qemu-iotests/076.out | 6 +-
tests/qemu-iotests/078.out | 12 +--
tests/qemu-iotests/079 | 1 -
tests/qemu-iotests/080.out | 40 ++++-----
tests/qemu-iotests/081.out | 2 +-
tests/qemu-iotests/082 | 1 -
tests/qemu-iotests/085 | 1 -
tests/qemu-iotests/088.out | 12 +--
tests/qemu-iotests/089 | 1 -
tests/qemu-iotests/090 | 1 -
tests/qemu-iotests/094 | 1 -
tests/qemu-iotests/095 | 1 -
tests/qemu-iotests/098 | 1 -
tests/qemu-iotests/102 | 1 -
tests/qemu-iotests/103 | 1 -
tests/qemu-iotests/103.out | 14 +--
tests/qemu-iotests/104 | 1 -
tests/qemu-iotests/105 | 1 -
tests/qemu-iotests/107 | 1 -
tests/qemu-iotests/110 | 1 -
tests/qemu-iotests/111 | 1 -
tests/qemu-iotests/112 | 1 -
tests/qemu-iotests/114 | 1 -
tests/qemu-iotests/114.out | 2 +-
tests/qemu-iotests/115 | 1 -
tests/qemu-iotests/116.out | 14 +--
tests/qemu-iotests/117 | 1 -
tests/qemu-iotests/120 | 1 -
tests/qemu-iotests/125 | 1 -
tests/qemu-iotests/126 | 1 -
tests/qemu-iotests/127 | 1 -
tests/qemu-iotests/131.out | 2 +-
tests/qemu-iotests/133 | 1 -
tests/qemu-iotests/133.out | 30 +++----
tests/qemu-iotests/134 | 1 -
tests/qemu-iotests/137.out | 28 +++---
tests/qemu-iotests/140.out | 2 +-
tests/qemu-iotests/142 | 1 -
tests/qemu-iotests/143 | 1 -
tests/qemu-iotests/143.out | 2 +-
tests/qemu-iotests/144 | 1 -
tests/qemu-iotests/145 | 1 -
tests/qemu-iotests/153 | 1 -
tests/qemu-iotests/153.out | 30 +++----
tests/qemu-iotests/156 | 1 -
tests/qemu-iotests/157 | 1 -
tests/qemu-iotests/158 | 1 -
tests/qemu-iotests/159 | 1 -
tests/qemu-iotests/162 | 1 -
tests/qemu-iotests/170 | 1 -
tests/qemu-iotests/173 | 1 -
tests/qemu-iotests/182 | 1 -
tests/qemu-iotests/183 | 1 -
tests/qemu-iotests/186 | 1 -
tests/qemu-iotests/187 | 1 -
tests/qemu-iotests/187.out | 6 +-
tests/qemu-iotests/188.out | 2 +-
tests/qemu-iotests/190 | 1 -
tests/qemu-iotests/191 | 1 -
tests/qemu-iotests/192 | 1 -
tests/qemu-iotests/195 | 1 -
tests/qemu-iotests/197 | 1 -
tests/qemu-iotests/197.out | 2 +-
tests/qemu-iotests/200 | 1 -
tests/qemu-iotests/205 | 2 +-
tests/qemu-iotests/214 | 1 -
tests/qemu-iotests/215 | 1 -
tests/qemu-iotests/215.out | 2 +-
tests/qemu-iotests/217 | 1 -
tests/qemu-iotests/226.out | 16 ++--
tests/qemu-iotests/227 | 1 -
tests/qemu-iotests/231 | 1 -
tests/qemu-iotests/233 | 1 -
tests/qemu-iotests/239 | 2 +-
tests/qemu-iotests/240 | 3 +-
tests/qemu-iotests/241 | 2 +-
tests/qemu-iotests/243 | 2 +-
tests/qemu-iotests/244 | 2 +-
tests/qemu-iotests/244.out | 10 +--
tests/qemu-iotests/247 | 1 -
tests/qemu-iotests/check | 13 ++-
tests/qemu-iotests/group | 169 +++++++++++++++++++-----------------
137 files changed, 372 insertions(+), 421 deletions(-)
delete mode 100755 tests/qemu-iotests-quick.sh
--
2.21.0
next reply other threads:[~2019-04-28 15:55 UTC|newest]
Thread overview: 62+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-04-28 15:54 Thomas Huth [this message]
2019-04-28 15:54 ` [Qemu-devel] [PATCH v2 0/8] tests/qemu-iotests: Run basic iotests during "make check" Thomas Huth
2019-04-28 15:54 ` [Qemu-devel] [PATCH v2 1/8] tests/qemu-iotests: Fix output of qemu-io related tests Thomas Huth
2019-04-28 15:54 ` Thomas Huth
2019-05-01 10:24 ` Alex Bennée
2019-05-01 10:24 ` Alex Bennée
2019-04-28 15:54 ` [Qemu-devel] [PATCH v2 2/8] tests/qemu-iotests/005: Add a sanity check for large sparse file support Thomas Huth
2019-04-28 15:54 ` Thomas Huth
2019-05-01 11:08 ` Alex Bennée
2019-05-01 11:08 ` Alex Bennée
2019-05-01 12:06 ` Eric Blake
2019-05-01 12:06 ` Eric Blake
2019-05-01 13:36 ` Thomas Huth
2019-05-01 13:36 ` Thomas Huth
2019-05-01 13:13 ` Thomas Huth
2019-05-01 13:13 ` Thomas Huth
2019-05-01 14:23 ` Alex Bennée
2019-05-01 14:23 ` Alex Bennée
2019-04-28 15:54 ` [Qemu-devel] [PATCH v2 3/8] tests/qemu-iotests/check: Pick a default machine if necessary Thomas Huth
2019-04-28 15:54 ` Thomas Huth
2019-05-01 8:27 ` Alex Bennée
2019-05-01 8:27 ` Alex Bennée
2019-05-01 15:18 ` Philippe Mathieu-Daudé
2019-05-01 15:18 ` Philippe Mathieu-Daudé
2019-04-28 15:54 ` [Qemu-devel] [PATCH v2 4/8] tests/qemu-iotests: Do not hard-code the path to bash Thomas Huth
2019-04-28 15:54 ` Thomas Huth
2019-05-01 8:27 ` Alex Bennée
2019-05-01 8:27 ` Alex Bennée
2019-04-28 15:54 ` [Qemu-devel] [PATCH v2 5/8] cirrus / travis: Add gnu-sed and bash for macOS and FreeBSD Thomas Huth
2019-04-28 15:54 ` Thomas Huth
2019-04-30 21:54 ` Li-Wen Hsu
2019-04-30 21:54 ` Li-Wen Hsu
2019-05-01 11:09 ` Alex Bennée
2019-05-01 11:09 ` Alex Bennée
2019-05-01 15:19 ` Philippe Mathieu-Daudé
2019-05-01 15:19 ` Philippe Mathieu-Daudé
2019-04-28 15:54 ` [Qemu-devel] [PATCH v2 6/8] tests/qemu-iotests: Remove the "_supported_os Linux" line from many tests Thomas Huth
2019-04-28 15:54 ` Thomas Huth
2019-05-01 11:10 ` Alex Bennée
2019-05-01 11:10 ` Alex Bennée
2019-04-28 15:54 ` [Qemu-devel] [PATCH v2 7/8] tests/qemu-iotests/group: Re-use the "auto" group for tests that can always run Thomas Huth
2019-04-28 15:54 ` Thomas Huth
2019-05-01 16:37 ` Alex Bennée
2019-05-01 16:37 ` Alex Bennée
2019-05-02 5:44 ` Thomas Huth
2019-05-02 5:44 ` Thomas Huth
2019-04-28 15:54 ` [Qemu-devel] [PATCH v2 8/8] tests: Run the iotests during "make check" again Thomas Huth
2019-04-28 15:54 ` Thomas Huth
2019-04-28 16:10 ` [Qemu-devel] [PATCH v2 0/8] tests/qemu-iotests: Run basic iotests during "make check" no-reply
2019-04-28 16:10 ` no-reply
2019-04-29 5:25 ` Thomas Huth
2019-04-29 5:25 ` Thomas Huth
2019-04-29 3:47 ` no-reply
2019-04-29 3:47 ` no-reply
2019-04-29 5:30 ` Thomas Huth
2019-04-29 5:30 ` Thomas Huth
2019-05-01 8:30 ` Alex Bennée
2019-05-01 8:30 ` Alex Bennée
2019-05-01 10:04 ` Thomas Huth
2019-05-01 10:04 ` Thomas Huth
2019-05-01 8:30 ` Alex Bennée
2019-05-01 8:30 ` Alex Bennée
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20190428155451.15653-1-thuth@redhat.com \
--to=thuth@redhat.com \
--cc=alex.bennee@linaro.org \
--cc=armbru@redhat.com \
--cc=cfergeau@redhat.com \
--cc=eblake@redhat.com \
--cc=emaste@freebsd.org \
--cc=fam@euphon.net \
--cc=kwolf@redhat.com \
--cc=lwhsu@freebsd.org \
--cc=mreitz@redhat.com \
--cc=philmd@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=wainersm@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).