qemu-devel.nongnu.org archive mirror
 help / color / mirror / Atom feed
From: "Alex Bennée" <alex.bennee@linaro.org>
To: Ani Sinha <ani@anisinha.ca>
Cc: "Cleber Rosa" <crosa@redhat.com>,
	"Philippe Mathieu-Daudé" <f4bug@amsat.org>,
	"Wainer dos Santos Moschetta" <wainersm@redhat.com>,
	"Beraldo Leal" <bleal@redhat.com>,
	"Daniel P . Berrangé" <berrange@redhat.com>,
	"Paolo Bonzini" <pbonzini@redhat.com>,
	"Maydell Peter" <peter.maydell@linaro.org>,
	"John Snow" <jsnow@redhat.com>, "Thomas Huth" <thuth@redhat.com>,
	"Igor Mammedov" <imammedo@redhat.com>,
	"Michael Tsirkin" <mst@redhat.com>,
	qemu-devel@nongnu.org
Subject: Re: [PATCH v6 06/10] acpi/tests/avocado/bits: disable smilatency test since it does not pass everytime
Date: Thu, 20 Oct 2022 18:46:53 +0100	[thread overview]
Message-ID: <87sfji75g2.fsf@linaro.org> (raw)
In-Reply-To: <20221020123506.26363-7-ani@anisinha.ca>


Ani Sinha <ani@anisinha.ca> writes:

> smilatency test is latency sensitive and does not pass deterministically when
> run in QEMU environment under biosbits. Disable the test suite for now.
>
> Example failure:
>
> ==== SMI latency test ====
> Warning: touching the keyboard can affect the results of this test.
> Starting test. Wait here, I will be back in 15 seconds.
> [assert] SMI latency < 150us to minimize risk of OS timeouts FAIL
>   1us   < t <=  10us; average = 1372ns; count = 10912449
>    Times between first few observations:  176us 1646ns 1441ns 1450ns 1462ns
>   10us  < t <= 100us; average = 16us; count = 1187
>    Times between first few observations:   15ms 3148us 5856us   49ms   33ms
>   100us < t <=   1ms; average = 259us; count = 8
>    Times between first few observations:  111ms 2227ms 1779ms  999ms  219ms
>   0 SMI detected using MSR_SMI_COUNT (MSR 0x34)
>   Summary of impact: observed maximum latency = 298us
> Summary: 0 passed, 1 failed

Is this because of TCG slowness? You might try running under icount for
a more consistent elapsed time for the guest.

>
> Cc: Daniel P. Berrangé <berrange@redhat.com>
> Cc: Paolo Bonzini <pbonzini@redhat.com>
> Cc: Maydell Peter <peter.maydell@linaro.org>
> Cc: John Snow <jsnow@redhat.com>
> Cc: Thomas Huth <thuth@redhat.com>
> Cc: Alex Bennée <alex.bennee@linaro.org>
> Cc: Igor Mammedov <imammedo@redhat.com>
> Cc: Michael Tsirkin <mst@redhat.com>
> Signed-off-by: Ani Sinha <ani@anisinha.ca>
> ---
>  tests/avocado/acpi-bits/bits-tests/smilatency.py2 | 5 +++--
>  1 file changed, 3 insertions(+), 2 deletions(-)
>
> diff --git a/tests/avocado/acpi-bits/bits-tests/smilatency.py2 b/tests/avocado/acpi-bits/bits-tests/smilatency.py2
> index d616970b31..e907c55cc2 100644
> --- a/tests/avocado/acpi-bits/bits-tests/smilatency.py2
> +++ b/tests/avocado/acpi-bits/bits-tests/smilatency.py2
> @@ -37,8 +37,9 @@ import time
>  import usb
>  
>  def register_tests():
> -    testsuite.add_test("SMI latency test", smi_latency);
> -    testsuite.add_test("SMI latency test with USB disabled via BIOS handoff", test_with_usb_disabled, runall=False);
> +    pass
> +    # testsuite.add_test("SMI latency test", smi_latency);
> +    # testsuite.add_test("SMI latency test with USB disabled via BIOS handoff", test_with_usb_disabled, runall=False);
>  
>  def smi_latency():
>      MSR_SMI_COUNT = 0x34


-- 
Alex Bennée


  reply	other threads:[~2022-10-20 17:48 UTC|newest]

Thread overview: 50+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-10-20 12:34 [PATCH v6 00/10] Introduce new acpi/smbios avocado tests using biosbits Ani Sinha
2022-10-20 12:34 ` [PATCH v6 01/10] acpi/tests/avocado/bits: initial commit of test scripts that are run by biosbits Ani Sinha
2022-10-20 17:27   ` Alex Bennée
2022-10-20 12:34 ` [PATCH v6 02/10] acpi/tests/avocado/bits: add SPDX license identifiers for bios bits tests Ani Sinha
2022-10-20 12:34 ` [PATCH v6 03/10] acpi/tests/avocado/bits: disable acpi PSS tests that are failing in biosbits Ani Sinha
2022-10-20 17:27   ` Alex Bennée
2022-10-20 12:35 ` [PATCH v6 04/10] acpi/tests/avocado/bits: add smilatency test suite from bits in order to disable it Ani Sinha
2022-10-20 12:35 ` [PATCH v6 05/10] acpi/tests/avocado/bits: add SPDX license identifiers for bios bits smilatency tests Ani Sinha
2022-10-20 17:43   ` Alex Bennée
2022-10-20 12:35 ` [PATCH v6 06/10] acpi/tests/avocado/bits: disable smilatency test since it does not pass everytime Ani Sinha
2022-10-20 17:46   ` Alex Bennée [this message]
2022-10-21  8:39     ` Ani Sinha
2022-10-20 12:35 ` [PATCH v6 07/10] acpi/tests/avocado/bits: add biosbits config file for running bios tests Ani Sinha
2022-10-20 17:47   ` Alex Bennée
2022-10-21  5:37     ` Ani Sinha
2022-10-20 12:35 ` [PATCH v6 08/10] acpi/tests/avocado/bits: add acpi and smbios avocado tests that uses biosbits Ani Sinha
2022-10-20 17:30   ` Alex Bennée
2022-10-20 12:35 ` [PATCH v6 09/10] acpi/tests/avocado/bits/doc: add a doc file to describe the acpi bits test Ani Sinha
2022-10-20 17:08   ` Alex Bennée
2022-10-20 12:35 ` [PATCH v6 10/10] MAINTAINERS: add myself as the maintainer for acpi biosbits avocado tests Ani Sinha
2022-10-20 12:38 ` [PATCH v6 00/10] Introduce new acpi/smbios avocado tests using biosbits Michael S. Tsirkin
2022-10-20 12:42   ` Ani Sinha
2022-10-20 12:45     ` Michael S. Tsirkin
2022-10-20 12:50       ` Ani Sinha
2022-10-20 19:13         ` Michael S. Tsirkin
2022-10-20 23:40           ` Ani Sinha
2022-10-21  0:15             ` Ani Sinha
2022-10-21  8:32               ` Michael S. Tsirkin
2022-10-21  8:43                 ` Ani Sinha
2022-10-21  9:30                   ` Alex Bennée
2022-10-21  9:40                     ` Michael S. Tsirkin
2022-10-21  9:58                       ` Ani Sinha
2022-10-21 11:52                         ` Alex Bennée
2022-10-21 12:22                           ` Ani Sinha
2022-10-21 13:13                             ` Ani Sinha
2022-10-21 15:53                               ` Alex Bennée
2022-10-21 16:11                                 ` Ani Sinha
2022-10-22  0:58                                 ` Ani Sinha
2022-10-22 16:35                                   ` Michael S. Tsirkin
2022-10-22 16:43                                     ` Ani Sinha
2022-10-22 16:47                                       ` Michael S. Tsirkin
2022-10-22 10:56                                 ` Ani Sinha
2022-10-21 16:03                             ` Alex Bennée
2022-10-21 16:17                               ` Ani Sinha
2022-10-22 16:45                                 ` Michael S. Tsirkin
2022-10-22 17:34                                   ` Ani Sinha
2022-10-21  8:20             ` Michael S. Tsirkin
2022-10-21 11:42               ` Ani Sinha
2022-10-22 16:40                 ` Michael S. Tsirkin
2022-10-22 16:44                   ` Ani Sinha

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=87sfji75g2.fsf@linaro.org \
    --to=alex.bennee@linaro.org \
    --cc=ani@anisinha.ca \
    --cc=berrange@redhat.com \
    --cc=bleal@redhat.com \
    --cc=crosa@redhat.com \
    --cc=f4bug@amsat.org \
    --cc=imammedo@redhat.com \
    --cc=jsnow@redhat.com \
    --cc=mst@redhat.com \
    --cc=pbonzini@redhat.com \
    --cc=peter.maydell@linaro.org \
    --cc=qemu-devel@nongnu.org \
    --cc=thuth@redhat.com \
    --cc=wainersm@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).