From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:35565) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1asYqm-0004hz-UN for qemu-devel@nongnu.org; Tue, 19 Apr 2016 12:50:09 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1asYqh-000190-4z for qemu-devel@nongnu.org; Tue, 19 Apr 2016 12:50:08 -0400 Received: from e06smtp11.uk.ibm.com ([195.75.94.107]:56049) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1asYqg-000181-S5 for qemu-devel@nongnu.org; Tue, 19 Apr 2016 12:50:03 -0400 Received: from localhost by e06smtp11.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Tue, 19 Apr 2016 17:49:59 +0100 From: Sascha Silbe In-Reply-To: <87twixyecs.fsf@dusky.pond.sub.org> References: <1460633543-7366-1-git-send-email-silbe@linux.vnet.ibm.com> <87ega39yez.fsf@dusky.pond.sub.org> <87inzd7qss.fsf@oc4731375738.ibm.com> <87twixyecs.fsf@dusky.pond.sub.org> Date: Tue, 19 Apr 2016 18:49:55 +0200 Message-ID: <874max7dcc.fsf@oc4731375738.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: Re: [Qemu-devel] [PATCH for-2.6?] qemu-iotests: iotests: fail hard if not run via "check" List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Markus Armbruster Cc: Kevin Wolf , qemu-devel@nongnu.org, qemu-block@nongnu.org, Max Reitz Dear Markus, Markus Armbruster writes: > Say you had an accurate way to find out whether we're running under > "check". You could then reject any attempt to run the test directly. > I'd oppose that. > > It's okay to have test wrapper scripts to configure the tests just so. > It's okay to tell people to use them. But "you can't do that, Dave" is > not okay. [...] AFAICT the environment in which the individual test cases run isn't well-defined. Currently it's indirectly defined by whatever "check" does. The goal of the patch is to catch unwary developers invoking the tests directly from the command line, providing them with useful advice. If somebody wants to write another test runner (in place of "check"), it's their responsibility to set up the environment appropriately. (They could even set an environment variable "I_AM_CHECK=3Dyes" if that's part of the environment the tests expect). I'd be perfectly fine with defining the environment more clearly and possibly extending the implementation to allow individual test cases to be invoked directly (without a test runner like "check"). But that would be 2.7 material. Sascha --=20 Softwareentwicklung Sascha Silbe, Niederhofenstra=C3=9Fe 5/1, 71229 Leonberg https://se-silbe.de/ USt-IdNr. DE281696641