[Qemu-devel] [qemu] how to test qemu?

[Qemu-devel] [qemu] how to test qemu?

[wangyan (AQ)]

[-- Attachment #1: Type: text/plain, Size: 498 bytes --]



Hi all:
AFAIK, there're several ways to test qemu:
1) virt-test, which is driven by autotest or avocado-vt, based on qemu-kvm
2) Qtest，using instruction “make check V=1”, which aims to do low level tests, that is to test function modules of qemu.


I've got 2 questions:
1) besides the 2 test suites, are there any other automatic-test tools?
2) is there any testsuite used to test qemu-xen, similar to virt-test?

Anyone knows that? Thanks in advance.

Best wishes,
Sally



[-- Attachment #2: Type: text/html, Size: 3899 bytes --]

Re: [Qemu-devel] [qemu] how to test qemu?

[Bastian Koppelmann]

Hi,

On 02/25/2016 01:24 PM, wangyan (AQ) wrote:
> 
> 
> Hi all:
> AFAIK, there're several ways to test qemu:
> 1) virt-test, which is driven by autotest or avocado-vt, based on qemu-kvm
> 2) Qtest��using instruction ��make check V=1��, which aims to do low level tests, that is to test function modules of qemu.
> 
> 
> I've got 2 questions:
> 1) besides the 2 test suites, are there any other automatic-test tools?

>From the top of my head I can only think of risu[1] which generates
random instruction sequences. This is IIRC used to test whether TCG
works correctly for ARM.

Cheers,
Bastian

[1] https://github.com/stsquad/risu

Re: [Qemu-devel] [qemu] how to test qemu?

[Alex Bennée]

Bastian Koppelmann <kbastian@mail.uni-paderborn.de> writes:

> Hi,
>
> On 02/25/2016 01:24 PM, wangyan (AQ) wrote:
>>
>>
>> Hi all:
>> AFAIK, there're several ways to test qemu:
>> 1) virt-test, which is driven by autotest or avocado-vt, based on qemu-kvm
>> 2) Qtest��using instruction ��make check V=1��, which aims to do low level tests, that is to test function modules of qemu.
>>
>>
>> I've got 2 questions:
>> 1) besides the 2 test suites, are there any other automatic-test tools?
>
> From the top of my head I can only think of risu[1] which generates
> random instruction sequences. This is IIRC used to test whether TCG
> works correctly for ARM.

We run some basic system boot tests as well as RISU and LTP within our
LAVA system:

https://validation.linaro.org/dashboard/streams/anonymous/qemu-master/bundles/

We certainly could do more.

Also see [PATCH v2 00/15] tests: Introducing docker tests which extends
the testing capability under different build environments. I've still to
look at extending this with qemu-${ARCH}-static.

The automatic Travis tests are basically a simple compile test + make
check on Ubuntu 12.04 so a bit limited in coverage.

>
> Cheers,
> Bastian
>
> [1] https://github.com/stsquad/risu

https://git.linaro.org/people/peter.maydell/risu.git is the canonical
location although I still have some patches for replay/playback in my
tree to get merged.

I think the major hole is our TCG testing as although we have code in
tests/tcg it's not built as you require cross tools to build it. This
means $ARCH-on-x86 isn't as routinely tested as it should be. Obviously
the various arch maintainers have their own boot tests they run.

--
Alex Bennée