* Did Avocado assets hashing system changed?
@ 2023-09-13 14:17 Philippe Mathieu-Daudé
2023-09-13 15:20 ` Daniel P. Berrangé
0 siblings, 1 reply; 4+ messages in thread
From: Philippe Mathieu-Daudé @ 2023-09-13 14:17 UTC (permalink / raw)
To: avocado-devel, Cleber Rosa
Cc: QEMU Developers, Stefan Hajnoczi, Thomas Huth, Alex Bennée
Hi,
We are trying to figure out why old assets saved in our Avocado
cache (which we populate in our various CI jobs) isn't used
anymore.
Trying to reproduce locally, I see for example:
2023-09-13 14:39:18,834 test L0520 INFO | START
14-tests/avocado/machine_mips_malta.py:MaltaMachine.test_mipsel_malta_yamon
2023-09-13 14:39:18,834 test L0205 DEBUG| DATA
(filename=output.expected) => NOT FOUND (data sources: variant, test, file)
2023-09-13 14:39:18,861 asset L0339 INFO | Asset not in
cache, fetching it.
2023-09-13 14:39:18,862 download L0067 INFO | Fetching
http://www.imgtec.com/tools/mips-tools/downloads/yamon/yamon-bin-02.22.zip
->
/home/philippe.mathieu-daude/avocado/data/cache/by_location/70c32932b7794b6b37a5040a8808ac943699b944/yamon-bin-02.22.zip.csi3gk2v
2023-09-13 14:39:18,940 asset L0144 INFO | Temporary asset
file unavailable due to failed download attempt.
2023-09-13 14:39:18,940 asset L0378 ERROR| HTTPError: HTTP
Error 403: Forbidden
I remember this test used to pass last year, so checking the file I
can see:
$ find ~/avocado/data/ -name yamon-bin-02.22.zip\* -ls
1489611 6629 -rw-r--r-- 1 philmd primary 6776580 Dec 30 2022
/home/philmd/avocado/data/cache/by_location/c1961386ba52f06c6005b48cd32195a371152769/yamon-bin-02.22.zip
1489613 1 -rw-r--r-- 1 philmd primary 46 Dec 30 2022
/home/philmd/avocado/data/cache/by_location/c1961386ba52f06c6005b48cd32195a371152769/yamon-bin-02.22.zip-CHECKSUM
But the hash is different... Looking at QEMU git history we haven't
changed the URL in tests/avocado/machine_mips_malta.py, so I wonder,
did Avocado changed its asset hashing during the last year?
Thanks,
Phil.
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Did Avocado assets hashing system changed?
2023-09-13 14:17 Did Avocado assets hashing system changed? Philippe Mathieu-Daudé
@ 2023-09-13 15:20 ` Daniel P. Berrangé
2023-09-13 15:40 ` Thomas Huth
0 siblings, 1 reply; 4+ messages in thread
From: Daniel P. Berrangé @ 2023-09-13 15:20 UTC (permalink / raw)
To: Philippe Mathieu-Daudé
Cc: avocado-devel, Cleber Rosa, QEMU Developers, Stefan Hajnoczi,
Thomas Huth, Alex Bennée
On Wed, Sep 13, 2023 at 04:17:24PM +0200, Philippe Mathieu-Daudé wrote:
> Hi,
>
> We are trying to figure out why old assets saved in our Avocado
> cache (which we populate in our various CI jobs) isn't used
> anymore.
>
> Trying to reproduce locally, I see for example:
>
> 2023-09-13 14:39:18,834 test L0520 INFO | START
> 14-tests/avocado/machine_mips_malta.py:MaltaMachine.test_mipsel_malta_yamon
> 2023-09-13 14:39:18,834 test L0205 DEBUG| DATA
> (filename=output.expected) => NOT FOUND (data sources: variant, test, file)
> 2023-09-13 14:39:18,861 asset L0339 INFO | Asset not in cache,
> fetching it.
> 2023-09-13 14:39:18,862 download L0067 INFO | Fetching
> http://www.imgtec.com/tools/mips-tools/downloads/yamon/yamon-bin-02.22.zip
> -> /home/philippe.mathieu-daude/avocado/data/cache/by_location/70c32932b7794b6b37a5040a8808ac943699b944/yamon-bin-02.22.zip.csi3gk2v
> 2023-09-13 14:39:18,940 asset L0144 INFO | Temporary asset file
> unavailable due to failed download attempt.
> 2023-09-13 14:39:18,940 asset L0378 ERROR| HTTPError: HTTP Error
> 403: Forbidden
>
> I remember this test used to pass last year, so checking the file I
> can see:
>
> $ find ~/avocado/data/ -name yamon-bin-02.22.zip\* -ls
> 1489611 6629 -rw-r--r-- 1 philmd primary 6776580 Dec 30 2022 /home/philmd/avocado/data/cache/by_location/c1961386ba52f06c6005b48cd32195a371152769/yamon-bin-02.22.zip
> 1489613 1 -rw-r--r-- 1 philmd primary 46 Dec 30 2022 /home/philmd/avocado/data/cache/by_location/c1961386ba52f06c6005b48cd32195a371152769/yamon-bin-02.22.zip-CHECKSUM
>
> But the hash is different... Looking at QEMU git history we haven't
> changed the URL in tests/avocado/machine_mips_malta.py, so I wonder,
> did Avocado changed its asset hashing during the last year?
How can it have changed when we've been pinned to avocado 88.1 for
ages now, not consuming new versions ?
With regards,
Daniel
--
|: https://berrange.com -o- https://www.flickr.com/photos/dberrange :|
|: https://libvirt.org -o- https://fstop138.berrange.com :|
|: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Did Avocado assets hashing system changed?
2023-09-13 15:20 ` Daniel P. Berrangé
@ 2023-09-13 15:40 ` Thomas Huth
2023-09-13 15:50 ` Daniel P. Berrangé
0 siblings, 1 reply; 4+ messages in thread
From: Thomas Huth @ 2023-09-13 15:40 UTC (permalink / raw)
To: Daniel P. Berrangé, Philippe Mathieu-Daudé
Cc: avocado-devel, Cleber Rosa, QEMU Developers, Stefan Hajnoczi,
Alex Bennée
On 13/09/2023 17.20, Daniel P. Berrangé wrote:
> On Wed, Sep 13, 2023 at 04:17:24PM +0200, Philippe Mathieu-Daudé wrote:
>> Hi,
>>
>> We are trying to figure out why old assets saved in our Avocado
>> cache (which we populate in our various CI jobs) isn't used
>> anymore.
>>
>> Trying to reproduce locally, I see for example:
>>
>> 2023-09-13 14:39:18,834 test L0520 INFO | START
>> 14-tests/avocado/machine_mips_malta.py:MaltaMachine.test_mipsel_malta_yamon
>> 2023-09-13 14:39:18,834 test L0205 DEBUG| DATA
>> (filename=output.expected) => NOT FOUND (data sources: variant, test, file)
>> 2023-09-13 14:39:18,861 asset L0339 INFO | Asset not in cache,
>> fetching it.
>> 2023-09-13 14:39:18,862 download L0067 INFO | Fetching
>> http://www.imgtec.com/tools/mips-tools/downloads/yamon/yamon-bin-02.22.zip
>> -> /home/philippe.mathieu-daude/avocado/data/cache/by_location/70c32932b7794b6b37a5040a8808ac943699b944/yamon-bin-02.22.zip.csi3gk2v
>> 2023-09-13 14:39:18,940 asset L0144 INFO | Temporary asset file
>> unavailable due to failed download attempt.
>> 2023-09-13 14:39:18,940 asset L0378 ERROR| HTTPError: HTTP Error
>> 403: Forbidden
>>
>> I remember this test used to pass last year, so checking the file I
>> can see:
>>
>> $ find ~/avocado/data/ -name yamon-bin-02.22.zip\* -ls
>> 1489611 6629 -rw-r--r-- 1 philmd primary 6776580 Dec 30 2022 /home/philmd/avocado/data/cache/by_location/c1961386ba52f06c6005b48cd32195a371152769/yamon-bin-02.22.zip
>> 1489613 1 -rw-r--r-- 1 philmd primary 46 Dec 30 2022 /home/philmd/avocado/data/cache/by_location/c1961386ba52f06c6005b48cd32195a371152769/yamon-bin-02.22.zip-CHECKSUM
>>
>> But the hash is different... Looking at QEMU git history we haven't
>> changed the URL in tests/avocado/machine_mips_malta.py, so I wonder,
>> did Avocado changed its asset hashing during the last year?
>
> How can it have changed when we've been pinned to avocado 88.1 for
> ages now, not consuming new versions ?
We've temporarily switched to version 101 some months ago, see commit
ec5ffa0056389c3c.
Thomas
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Did Avocado assets hashing system changed?
2023-09-13 15:40 ` Thomas Huth
@ 2023-09-13 15:50 ` Daniel P. Berrangé
0 siblings, 0 replies; 4+ messages in thread
From: Daniel P. Berrangé @ 2023-09-13 15:50 UTC (permalink / raw)
To: Thomas Huth
Cc: Philippe Mathieu-Daudé, avocado-devel, Cleber Rosa,
QEMU Developers, Stefan Hajnoczi, Alex Bennée
On Wed, Sep 13, 2023 at 05:40:25PM +0200, Thomas Huth wrote:
> On 13/09/2023 17.20, Daniel P. Berrangé wrote:
> > On Wed, Sep 13, 2023 at 04:17:24PM +0200, Philippe Mathieu-Daudé wrote:
> > > Hi,
> > >
> > > We are trying to figure out why old assets saved in our Avocado
> > > cache (which we populate in our various CI jobs) isn't used
> > > anymore.
> > >
> > > Trying to reproduce locally, I see for example:
> > >
> > > 2023-09-13 14:39:18,834 test L0520 INFO | START
> > > 14-tests/avocado/machine_mips_malta.py:MaltaMachine.test_mipsel_malta_yamon
> > > 2023-09-13 14:39:18,834 test L0205 DEBUG| DATA
> > > (filename=output.expected) => NOT FOUND (data sources: variant, test, file)
> > > 2023-09-13 14:39:18,861 asset L0339 INFO | Asset not in cache,
> > > fetching it.
> > > 2023-09-13 14:39:18,862 download L0067 INFO | Fetching
> > > http://www.imgtec.com/tools/mips-tools/downloads/yamon/yamon-bin-02.22.zip
> > > -> /home/philippe.mathieu-daude/avocado/data/cache/by_location/70c32932b7794b6b37a5040a8808ac943699b944/yamon-bin-02.22.zip.csi3gk2v
> > > 2023-09-13 14:39:18,940 asset L0144 INFO | Temporary asset file
> > > unavailable due to failed download attempt.
> > > 2023-09-13 14:39:18,940 asset L0378 ERROR| HTTPError: HTTP Error
> > > 403: Forbidden
> > >
> > > I remember this test used to pass last year, so checking the file I
> > > can see:
> > >
> > > $ find ~/avocado/data/ -name yamon-bin-02.22.zip\* -ls
> > > 1489611 6629 -rw-r--r-- 1 philmd primary 6776580 Dec 30 2022 /home/philmd/avocado/data/cache/by_location/c1961386ba52f06c6005b48cd32195a371152769/yamon-bin-02.22.zip
> > > 1489613 1 -rw-r--r-- 1 philmd primary 46 Dec 30 2022 /home/philmd/avocado/data/cache/by_location/c1961386ba52f06c6005b48cd32195a371152769/yamon-bin-02.22.zip-CHECKSUM
> > >
> > > But the hash is different... Looking at QEMU git history we haven't
> > > changed the URL in tests/avocado/machine_mips_malta.py, so I wonder,
> > > did Avocado changed its asset hashing during the last year?
> >
> > How can it have changed when we've been pinned to avocado 88.1 for
> > ages now, not consuming new versions ?
>
> We've temporarily switched to version 101 some months ago, see commit
> ec5ffa0056389c3c.
Which was quickly reverted in eaf245becd9ece615a4831c0cf4d27b165d8675f,
but I guess perhaps the cache has some files from that window of the
upgrade.
With regards,
Daniel
--
|: https://berrange.com -o- https://www.flickr.com/photos/dberrange :|
|: https://libvirt.org -o- https://fstop138.berrange.com :|
|: https://entangle-photo.org -o- https://www.instagram.com/dberrange :|
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2023-09-13 15:51 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2023-09-13 14:17 Did Avocado assets hashing system changed? Philippe Mathieu-Daudé
2023-09-13 15:20 ` Daniel P. Berrangé
2023-09-13 15:40 ` Thomas Huth
2023-09-13 15:50 ` Daniel P. Berrangé
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).