Re: [PATCH v2] tests/functional: Convert Aarch64 SBSA-Ref avocado tests

[Thomas Huth <thuth@redhat.com>]

On 22/08/2024 16.39, Philippe Mathieu-Daudé wrote:
> On 22/8/24 16:06, Marcin Juszkiewicz wrote:
>> On 22.08.2024 13:41, Philippe Mathieu-Daudé wrote:
>>>   # Timeouts for individual tests that can be slow e.g. with debugging 
>>> enabled
>>>   test_timeouts = {
>>> +  'aarch64_sbsaref' : 180,
>>
>> What kind of machine is able to run those tests in 180s? I bumped them to 
>> 2400s and got timeout (Macbook with M1 Pro).
>>
>> "make check-avocado" (with some AVOCADO_* vars to limit list of tests) 
>> shown me which test is run and pass/fail for each.
>>
>> "make check-functional-aarch64 V=1" shows me "1/4 
>> qemu:func-thorough+func-aarch64-thorough+thorough / 
>> func-aarch64-aarch64_sbsaref" and timeouts without information which tests 
>> pass, which fail.
>>
>> Maybe for QEMU project this is a progress. For me it is moving tests from 
>> working ones to "sorry, timeout, find out why" ones.
> 
> Sorry for the annoyance of switching from one framework to another
> one :/ Are you using Linux on your Macbook with M1 Pro? I'm using
> macOS and these tests currently don't work, so for me this is a
> huge win.
> 
> Most of the (long) time was spent in downloading the assets.
> 
> IIUC there is a way to pre-download without using the test timer
> (apparently Richard and Daniel use it) but I haven't found the way
> yet.

It's done automatically when you run "make check-functional" ... but I think 
it might get skipped if you run "make check-functional-<target>".

Anyway, you can do the precaching manually by running:

  make precache-functional

  HTH,
   Thomas