From: "Michael S. Tsirkin" <mst@redhat.com>
To: "Daniel P. Berrangé" <berrange@redhat.com>
Cc: Ani Sinha <ani@anisinha.ca>, John Snow <jsnow@redhat.com>,
qemu-devel <qemu-devel@nongnu.org>,
Thomas Huth <thuth@redhat.com>,
Peter Maydell <peter.maydell@linaro.org>,
Paolo Bonzini <pbonzini@redhat.com>,
Igor Mammedov <imammedo@redhat.com>
Subject: Re: [PATCH v2 10/11] pytest: add pytest to the meson build system
Date: Tue, 27 Sep 2022 17:26:06 -0400 [thread overview]
Message-ID: <20220927172212-mutt-send-email-mst@kernel.org> (raw)
In-Reply-To: <YxdG4LISpDFvBr0k@redhat.com>
On Tue, Sep 06, 2022 at 02:10:56PM +0100, Daniel P. Berrangé wrote:
> On Tue, Jul 12, 2022 at 12:22:10PM +0530, Ani Sinha wrote:
> >
> >
> > On Mon, 11 Jul 2022, John Snow wrote:
> >
> > > On Sun, Jul 10, 2022 at 1:01 PM Ani Sinha <ani@anisinha.ca> wrote:
> > > >
> > > > Integrate the pytest framework with the meson build system. This will make meson
> > > > run all the pytests under the pytest directory.
> > > >
> > > > Signed-off-by: Ani Sinha <ani@anisinha.ca>
> > > > ---
> > > > tests/Makefile.include | 4 +++-
> > > > tests/meson.build | 1 +
> > > > tests/pytest/meson.build | 49 ++++++++++++++++++++++++++++++++++++++++
> > > > 3 files changed, 53 insertions(+), 1 deletion(-)
> > > > create mode 100644 tests/pytest/meson.build
> > > >
> > > > diff --git a/tests/Makefile.include b/tests/Makefile.include
> > > > index 3accb83b13..40755a6bd1 100644
> > > > --- a/tests/Makefile.include
> > > > +++ b/tests/Makefile.include
> > > > @@ -3,12 +3,14 @@
> > > > .PHONY: check-help
> > > > check-help:
> > > > @echo "Regression testing targets:"
> > > > - @echo " $(MAKE) check Run block, qapi-schema, unit, softfloat, qtest and decodetree tests"
> > > > + @echo " $(MAKE) check Run block, qapi-schema, unit, softfloat, qtest, pytest and decodetree tests"
> > >
> > > Does this mean that "make check" *requires* an internet connection?
> >
> > No. My test will be skipped if it is unable to download the artifacts it
> > requires due to lack of Internet connectivity.
>
> That's not the only concern, there are also people who have metered
> internet connections, or whose connections are slow and thus have
> long download times. Any test that downloads should be opt-in only.
>
>
> With regards,
> Daniel
<rant>
This is why I wanted git submodules. A well understood decentralized
model. Now we are reinventing them badly.
I asked on the maintainers summit what issues people have with
submodules, no one volunteered any information.
It might make sense to figure out if there's a way to
use submodules sanely.
</rant>
Anyway, download should just be done separately,
make check should just verify it has the correct binary
and if not fail.
And I'd like to have a target that fails if it can not
run the tests a opposed to skipping.
> --
> |: https://berrange.com -o- https://www.flickr.com/photos/dberrange :|
> |: https://libvirt.org -o- https://fstop138.berrange.com :|
> |: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|
next prev parent reply other threads:[~2022-09-27 21:27 UTC|newest]
Thread overview: 90+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-07-10 17:00 [PATCH v2 00/11] Introduce new acpi/smbios python tests using biosbits Ani Sinha
2022-07-10 17:00 ` [PATCH v2 01/11] acpi/tests/bits: initial commit of test scripts that are run by biosbits Ani Sinha
2022-07-11 20:38 ` John Snow
2022-07-12 7:17 ` Ani Sinha
2022-07-12 15:23 ` John Snow
2022-07-12 15:38 ` Ani Sinha
2022-07-12 15:42 ` John Snow
2022-07-12 15:46 ` Ani Sinha
2022-07-10 17:00 ` [PATCH v2 02/11] acpi/tests/bits: add SPDX license identifiers for bios bits tests Ani Sinha
2022-07-14 13:56 ` Daniel P. Berrangé
2022-07-14 14:12 ` Ani Sinha
2022-07-10 17:00 ` [PATCH v2 03/11] acpi/tests/bits: disable acpi PSS tests that are failing in biosbits Ani Sinha
2022-07-10 17:00 ` [PATCH v2 04/11] acpi/tests/bits: add smilatency test suite from bits in order to disable it Ani Sinha
2022-07-10 17:00 ` [PATCH v2 05/11] acpi/tests/bits: add SPDX license identifiers for bios bits smilatency tests Ani Sinha
2022-07-10 17:00 ` [PATCH v2 06/11] acpi/tests/bits: disable smilatency test since it does not pass everytime Ani Sinha
2022-07-10 17:00 ` [PATCH v2 07/11] acpi/tests/bits: add python test that exercizes QEMU bios tables using biosbits Ani Sinha
2022-07-11 20:42 ` John Snow
2022-07-12 7:15 ` Ani Sinha
2022-09-06 13:05 ` Daniel P. Berrangé
2022-07-14 14:05 ` Daniel P. Berrangé
2022-07-14 14:19 ` Ani Sinha
2022-07-14 17:49 ` Ani Sinha
2022-07-14 20:43 ` Michael S. Tsirkin
2022-07-14 20:41 ` Michael S. Tsirkin
2022-07-15 4:17 ` Ani Sinha
2022-07-15 6:50 ` Michael S. Tsirkin
2022-07-16 6:36 ` Ani Sinha
2022-07-16 15:30 ` Michael S. Tsirkin
2022-07-25 18:02 ` Ani Sinha
2022-07-27 18:38 ` Ani Sinha
2022-09-16 16:00 ` Ani Sinha
2022-09-17 20:28 ` Michael S. Tsirkin
2022-09-27 8:13 ` Ani Sinha
2022-09-27 8:33 ` Daniel P. Berrangé
2022-09-27 10:07 ` Ani Sinha
2022-09-27 10:18 ` Daniel P. Berrangé
2022-09-27 10:24 ` Ani Sinha
2022-09-27 11:42 ` Ani Sinha
2022-09-27 14:05 ` Ani Sinha
2022-09-27 15:45 ` Daniel P. Berrangé
2022-09-27 21:21 ` Michael S. Tsirkin
2022-09-28 8:31 ` Thomas Huth
2022-09-28 8:35 ` Daniel P. Berrangé
2022-09-28 9:47 ` Michael S. Tsirkin
2022-09-28 9:35 ` Michael S. Tsirkin
2022-09-28 9:39 ` Thomas Huth
2022-09-28 9:56 ` Michael S. Tsirkin
2022-10-06 7:58 ` Ani Sinha
2022-10-06 8:11 ` Ani Sinha
2022-10-06 10:18 ` Ani Sinha
2022-09-27 21:19 ` Michael S. Tsirkin
2022-09-27 21:18 ` Michael S. Tsirkin
2022-09-28 3:08 ` Ani Sinha
2022-09-28 3:58 ` Michael S. Tsirkin
2022-09-28 6:06 ` Ani Sinha
2022-10-06 12:12 ` Michael S. Tsirkin
2022-09-28 6:58 ` Daniel P. Berrangé
2022-09-28 7:15 ` Ani Sinha
2022-09-28 7:26 ` Daniel P. Berrangé
2022-09-28 9:19 ` Michael S. Tsirkin
2022-09-27 21:44 ` Paolo Bonzini
2022-09-27 22:09 ` Michael S. Tsirkin
2022-09-27 23:10 ` Paolo Bonzini
2022-09-28 5:53 ` Michael S. Tsirkin
2022-09-28 7:06 ` Daniel P. Berrangé
2022-09-28 7:43 ` Thomas Huth
2022-10-09 5:21 ` Ani Sinha
2022-10-09 6:30 ` Ani Sinha
2022-10-09 16:06 ` Ani Sinha
2022-07-10 17:00 ` [PATCH v2 08/11] acpi/tests/bits: add biosbits config file for running bios tests Ani Sinha
2022-07-10 17:00 ` [PATCH v2 09/11] acpi/tests/bits: add a README file describing bits pytests Ani Sinha
2022-07-10 17:00 ` [PATCH v2 10/11] pytest: add pytest to the meson build system Ani Sinha
2022-07-11 20:46 ` John Snow
2022-07-12 6:52 ` Ani Sinha
2022-09-06 13:10 ` Daniel P. Berrangé
2022-09-27 21:26 ` Michael S. Tsirkin [this message]
2022-09-28 7:32 ` Thomas Huth
2022-09-28 9:23 ` Michael S. Tsirkin
2022-07-10 17:00 ` [PATCH v2 11/11] MAINTAINERS: add myself as the maintainer for acpi biosbits pytests Ani Sinha
2022-07-11 9:33 ` [PATCH v2 00/11] Introduce new acpi/smbios python tests using biosbits Michael S. Tsirkin
2022-07-14 13:24 ` Peter Maydell
2022-09-06 6:26 ` Ani Sinha
2022-09-06 8:19 ` Michael S. Tsirkin
2022-09-06 13:15 ` Daniel P. Berrangé
2022-09-06 13:28 ` Ani Sinha
2022-09-06 13:30 ` Daniel P. Berrangé
2022-09-09 12:53 ` Ani Sinha
2022-09-06 14:03 ` Michael S. Tsirkin
2022-09-06 14:10 ` Daniel P. Berrangé
2022-09-06 14:19 ` Michael S. Tsirkin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20220927172212-mutt-send-email-mst@kernel.org \
--to=mst@redhat.com \
--cc=ani@anisinha.ca \
--cc=berrange@redhat.com \
--cc=imammedo@redhat.com \
--cc=jsnow@redhat.com \
--cc=pbonzini@redhat.com \
--cc=peter.maydell@linaro.org \
--cc=qemu-devel@nongnu.org \
--cc=thuth@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).