From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:48525) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aZDwz-0005JT-BE for qemu-devel@nongnu.org; Fri, 26 Feb 2016 03:40:38 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1aZDwu-0007NL-VT for qemu-devel@nongnu.org; Fri, 26 Feb 2016 03:40:37 -0500 Received: from mail-wm0-x230.google.com ([2a00:1450:400c:c09::230]:34701) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1aZDwu-0007NF-Ih for qemu-devel@nongnu.org; Fri, 26 Feb 2016 03:40:32 -0500 Received: by mail-wm0-x230.google.com with SMTP id b205so62841210wmb.1 for ; Fri, 26 Feb 2016 00:40:31 -0800 (PST) References: <56CF1550.7040605@mail.uni-paderborn.de> From: Alex =?utf-8?Q?Benn=C3=A9e?= In-reply-to: <56CF1550.7040605@mail.uni-paderborn.de> Date: Fri, 26 Feb 2016 08:40:29 +0000 Message-ID: <87twkv7tky.fsf@linaro.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Subject: Re: [Qemu-devel] [qemu] how to test qemu? List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Bastian Koppelmann Cc: "Zhangbo (Oscar)" , "qemu-devel@nongnu.org" , "wangyan (AQ)" Bastian Koppelmann writes: > Hi, > > On 02/25/2016 01:24 PM, wangyan (AQ) wrote: >> >> >> Hi all: >> AFAIK, there're several ways to test qemu: >> 1) virt-test, which is driven by autotest or avocado-vt, based on qemu-kvm >> 2) Qtest��using instruction ��make check V=1��, which aims to do low level tests, that is to test function modules of qemu. >> >> >> I've got 2 questions: >> 1) besides the 2 test suites, are there any other automatic-test tools? > > From the top of my head I can only think of risu[1] which generates > random instruction sequences. This is IIRC used to test whether TCG > works correctly for ARM. We run some basic system boot tests as well as RISU and LTP within our LAVA system: https://validation.linaro.org/dashboard/streams/anonymous/qemu-master/bundles/ We certainly could do more. Also see [PATCH v2 00/15] tests: Introducing docker tests which extends the testing capability under different build environments. I've still to look at extending this with qemu-${ARCH}-static. The automatic Travis tests are basically a simple compile test + make check on Ubuntu 12.04 so a bit limited in coverage. > > Cheers, > Bastian > > [1] https://github.com/stsquad/risu https://git.linaro.org/people/peter.maydell/risu.git is the canonical location although I still have some patches for replay/playback in my tree to get merged. I think the major hole is our TCG testing as although we have code in tests/tcg it's not built as you require cross tools to build it. This means $ARCH-on-x86 isn't as routinely tested as it should be. Obviously the various arch maintainers have their own boot tests they run. -- Alex Bennée