From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([208.118.235.92]:47730) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UCaw1-0001OG-64 for qemu-devel@nongnu.org; Mon, 04 Mar 2013 14:20:33 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1UCavw-0001zZ-OL for qemu-devel@nongnu.org; Mon, 04 Mar 2013 14:20:29 -0500 Received: from e23smtp04.au.ibm.com ([202.81.31.146]:40632) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1UCavw-0001yh-7X for qemu-devel@nongnu.org; Mon, 04 Mar 2013 14:20:24 -0500 Received: from /spool/local by e23smtp04.au.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Tue, 5 Mar 2013 05:10:34 +1000 Received: from d23relay03.au.ibm.com (d23relay03.au.ibm.com [9.190.235.21]) by d23dlp03.au.ibm.com (Postfix) with ESMTP id 7086E357804E for ; Tue, 5 Mar 2013 06:20:13 +1100 (EST) Received: from d23av03.au.ibm.com (d23av03.au.ibm.com [9.190.234.97]) by d23relay03.au.ibm.com (8.13.8/8.13.8/NCO v10.0) with ESMTP id r24JKAHO54657232 for ; Tue, 5 Mar 2013 06:20:10 +1100 Received: from d23av03.au.ibm.com (loopback [127.0.0.1]) by d23av03.au.ibm.com (8.14.4/8.13.1/NCO v10.0 AVout) with ESMTP id r24JKCbO023777 for ; Tue, 5 Mar 2013 06:20:13 +1100 From: Anthony Liguori In-Reply-To: References: Date: Mon, 04 Mar 2013 13:20:03 -0600 Message-ID: <87ehfv9dlo.fsf@codemonkey.ws> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Subject: Re: [Qemu-devel] The state of testing List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: Stefan Hajnoczi , qemu-devel Cc: Amit Shah , Kevin Wolf , Michael Roth , Markus Armbruster , Juan Quintela Stefan Hajnoczi writes: > People are working on testing for various parts of QEMU. I started > this thread to gather an update on the state of testing and see where > we still need help. > > I'm not sure yet if we should propose Google Summer of Code projects > to help with the testing infrastructure. Perhaps working on libqtest > support for PCI, USB, virtio, etc would be a cool project. > > Buildbot > ------------ > The buildbot performs nightly builds and "make check". Test coverage > is still minimal but it's a starting point where we can add more tests > that will run every day. > > Block > -------- > tests/qemu-iotests/ contains 49 tests for the block layer. These > tests mostly cover image format features like backing files, > snapshots, resize, and basic I/O verify tests. > > The test suite has a few areas for improvement: > > 1. aio is not well-supported. We need to be able to control the order > in which asynchronous requests complete in order to test all possible > code paths. This issue also means the current aio tests are not > deterministic and can fail randomly due to reordered output. > > 2. make check-block is not run by the buildbot. We should do so to > get nightly coverage of basic qcow2 tests. I will send a buildbot > config patch to fix this. > > Net > --- > No tests! qemu-test has a ping test that runs against rtl8139, e1000, virtio, ne2k_pci, i82551, i82557b, and i82559er. It also tests hotplug add/remove of network adapters with a variety of command line combinations. There's quite a few more things in qemu-test too. Regards, Anthony Liguori > > How are things looking with device emulation, migration, monitor, char, etc? > > Stefan