From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([208.118.235.92]:51054) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UCpMw-0005b8-FX for qemu-devel@nongnu.org; Tue, 05 Mar 2013 05:45:15 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UCpMv-0005vm-7d for qemu-devel@nongnu.org; Tue, 05 Mar 2013 05:45:14 -0500 Received: from mail-we0-x22c.google.com ([2a00:1450:400c:c03::22c]:36707) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UCpMv-0005vV-1q for qemu-devel@nongnu.org; Tue, 05 Mar 2013 05:45:13 -0500 Received: by mail-we0-f172.google.com with SMTP id d46so1655134wer.3 for ; Tue, 05 Mar 2013 02:45:12 -0800 (PST) Date: Tue, 5 Mar 2013 11:45:09 +0100 From: Stefan Hajnoczi Message-ID: <20130305104509.GF1938@stefanha-thinkpad.redhat.com> References: <87ehfv9dlo.fsf@codemonkey.ws> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <87ehfv9dlo.fsf@codemonkey.ws> Subject: Re: [Qemu-devel] The state of testing List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Anthony Liguori Cc: Kevin Wolf , Juan Quintela , Markus Armbruster , Michael Roth , qemu-devel , Amit Shah On Mon, Mar 04, 2013 at 01:20:03PM -0600, Anthony Liguori wrote: > Stefan Hajnoczi writes: > > > People are working on testing for various parts of QEMU. I started > > this thread to gather an update on the state of testing and see where > > we still need help. > > > > I'm not sure yet if we should propose Google Summer of Code projects > > to help with the testing infrastructure. Perhaps working on libqtest > > support for PCI, USB, virtio, etc would be a cool project. > > > > Buildbot > > ------------ > > The buildbot performs nightly builds and "make check". Test coverage > > is still minimal but it's a starting point where we can add more tests > > that will run every day. > > > > Block > > -------- > > tests/qemu-iotests/ contains 49 tests for the block layer. These > > tests mostly cover image format features like backing files, > > snapshots, resize, and basic I/O verify tests. > > > > The test suite has a few areas for improvement: > > > > 1. aio is not well-supported. We need to be able to control the order > > in which asynchronous requests complete in order to test all possible > > code paths. This issue also means the current aio tests are not > > deterministic and can fail randomly due to reordered output. > > > > 2. make check-block is not run by the buildbot. We should do so to > > get nightly coverage of basic qcow2 tests. I will send a buildbot > > config patch to fix this. > > > > Net > > --- > > No tests! > > qemu-test has a ping test that runs against rtl8139, e1000, virtio, > ne2k_pci, i82551, i82557b, and i82559er. > > It also tests hotplug add/remove of network adapters with a variety of > command line combinations. > > There's quite a few more things in qemu-test too. Great, would it help to integrate qemu-test into the buildbot or do you already have infrastructure to run it regularly on qemu.git/master? Stefan