qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
From: Thomas Huth <thuth@redhat.com>
To: "Peter Maydell" <peter.maydell@linaro.org>,
	"Alex Bennée" <alex.bennee@linaro.org>,
	"Cleber Rosa" <crosa@redhat.com>
Cc: qemu-devel@nongnu.org, richard.henderson@linaro.org
Subject: Re: [PULL 00/18] testing and doc updates
Date: Tue, 2 May 2023 14:21:00 +0200	[thread overview]
Message-ID: <0afb8e76-8ff5-a4fe-31d8-a7749c25cd07@redhat.com> (raw)
In-Reply-To: <CAFEAcA-nvqJtP0Ez+1juneRTsUkUB53CsZV0CfhLUWe83M0GTg@mail.gmail.com>

On 02/05/2023 13.46, Peter Maydell wrote:
> On Thu, 27 Apr 2023 at 16:47, Alex Bennée <alex.bennee@linaro.org> wrote:
>>
>> The following changes since commit 1eb95e1baef852d0971a1dd62a3293cd68f1ec35:
>>
>>    Merge tag 'migration-20230426-pull-request' of https://gitlab.com/juan.quintela/qemu into staging (2023-04-27 10:47:14 +0100)
>>
>> are available in the Git repository at:
>>
>>    https://gitlab.com/stsquad/qemu.git tags/pull-testing-docs-270423-1
>>
>> for you to fetch changes up to ef46ae67ba9a785cf0cce58b5fc5a36ed3c6c7b9:
>>
>>    docs/style: call out the use of GUARD macros (2023-04-27 14:58:51 +0100)
>>
>> ----------------------------------------------------------------
>> Testing and documentation updates:
>>
>>    - bump avocado to 101.0
> 
> Did this change the behaviour of 'make check-avocado' ?
> Previously it would continue the whole test run even if one
> test timed out; now it seems to abort the test run when the
> first test times out.
> 
> I don't object to the current behaviour, but is there some
> command line option I can use to force avocado to complete
> the whole test set even if there are failures or timeouts?
> 
> ('make check-avocado' for arm targets has some persistent
> intermittent timeout stuff still, so I generally prefer to
> eyeball the failures and ignore the stuff I know is flaky.)

I think I've seen it in the past, too:

 
https://lore.kernel.org/qemu-devel/7836af42-9969-a01a-3c8c-717987b0b27e@redhat.com/

... but after Cleber said that there is no change in behavior, I did not 
follow up. Anyway, it is likely related to that --failfast switch of 
Avocado, so that's likely the first thing to look for, I guess...

  Thomas




      reply	other threads:[~2023-05-02 12:26 UTC|newest]

Thread overview: 26+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2023-04-27 15:44 [PULL 00/18] testing and doc updates Alex Bennée
2023-04-27 15:44 ` [PULL 01/18] tests/requirements.txt: bump up avocado-framework version to 101.0 Alex Bennée
2023-04-27 15:44 ` [PULL 02/18] tests/avocado: use the new snapshots for testing Alex Bennée
2023-04-28 12:08   ` Thomas Huth
2023-04-28 16:43     ` Alex Bennée
2023-04-27 15:44 ` [PULL 03/18] tests/avocado: Add set of boot tests on SBSA-ref Alex Bennée
2023-04-28 10:33   ` Thomas Huth
2023-07-10 12:10     ` Thomas Huth
2023-04-27 15:44 ` [PULL 04/18] gitlab-ci: Avoid to re-run "configure" in the device-crash-test jobs Alex Bennée
2023-04-27 15:44 ` [PULL 05/18] scripts/device-crash-test: Add a parameter to run with TCG only Alex Bennée
2023-04-27 15:44 ` [PULL 06/18] qemu-options: finesse the recommendations around -blockdev Alex Bennée
2023-04-27 15:44 ` [PULL 07/18] .gitlab-ci.d/cirrus: Drop the CI job for compiling with FreeBSD 12 Alex Bennée
2023-04-27 15:45 ` [PULL 08/18] tests/avocado: Make ssh_command_output_contains() globally available Alex Bennée
2023-04-27 15:45 ` [PULL 09/18] tests/avocado/machine_aspeed: Fix the broken ast2[56]00_evb_sdk tests Alex Bennée
2023-04-27 15:45 ` [PULL 10/18] MAINTAINERS: Cover tests/avocado/machine_aspeed.py Alex Bennée
2023-04-27 15:45 ` [PULL 11/18] avocado_qemu/__init__.py: factor out the qemu-img finding Alex Bennée
2023-04-27 15:45 ` [PULL 12/18] tests/avocado/tuxrun_baselines.py: improve code coverage for ppc64 Alex Bennée
2023-04-27 15:45 ` [PULL 13/18] tests/tcg: limit the scope of the plugin tests Alex Bennée
2023-04-27 15:45 ` [PULL 14/18] qemu-options.hx: Update descriptions of memory options for NUMA node Alex Bennée
2023-04-27 15:45 ` [PULL 15/18] docs/system: remove excessive punctuation from guest-loader docs Alex Bennée
2023-04-27 15:45 ` [PULL 16/18] docs/devel: make a statement about includes Alex Bennée
2023-04-27 15:45 ` [PULL 17/18] docs/devel: mention the spacing requirement for QOM Alex Bennée
2023-04-27 15:45 ` [PULL 18/18] docs/style: call out the use of GUARD macros Alex Bennée
2023-04-28  7:34 ` [PULL 00/18] testing and doc updates Richard Henderson
2023-05-02 11:46 ` Peter Maydell
2023-05-02 12:21   ` Thomas Huth [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=0afb8e76-8ff5-a4fe-31d8-a7749c25cd07@redhat.com \
    --to=thuth@redhat.com \
    --cc=alex.bennee@linaro.org \
    --cc=crosa@redhat.com \
    --cc=peter.maydell@linaro.org \
    --cc=qemu-devel@nongnu.org \
    --cc=richard.henderson@linaro.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).