Re: [Qemu-devel] The state of testing

[Stefan Hajnoczi <stefanha@gmail.com>]

On Mon, Mar 04, 2013 at 01:20:03PM -0600, Anthony Liguori wrote:
> Stefan Hajnoczi <stefanha@gmail.com> writes:
> 
> > People are working on testing for various parts of QEMU.  I started
> > this thread to gather an update on the state of testing and see where
> > we still need help.
> >
> > I'm not sure yet if we should propose Google Summer of Code projects
> > to help with the testing infrastructure.  Perhaps working on libqtest
> > support for PCI, USB, virtio, etc would be a cool project.
> >
> > Buildbot
> > ------------
> > The buildbot performs nightly builds and "make check".  Test coverage
> > is still minimal but it's a starting point where we can add more tests
> > that will run every day.
> >
> > Block
> > --------
> > tests/qemu-iotests/ contains 49 tests for the block layer.  These
> > tests mostly cover image format features like backing files,
> > snapshots, resize, and basic I/O verify tests.
> >
> > The test suite has a few areas for improvement:
> >
> > 1. aio is not well-supported.  We need to be able to control the order
> > in which asynchronous requests complete in order to test all possible
> > code paths.  This issue also means the current aio tests are not
> > deterministic and can fail randomly due to reordered output.
> >
> > 2. make check-block is not run by the buildbot.  We should do so to
> > get nightly coverage of basic qcow2 tests.  I will send a buildbot
> > config patch to fix this.
> >
> > Net
> > ---
> > No tests!
> 
> qemu-test has a ping test that runs against rtl8139, e1000, virtio,
> ne2k_pci, i82551, i82557b, and i82559er.
> 
> It also tests hotplug add/remove of network adapters with a variety of
> command line combinations.
> 
> There's quite a few more things in qemu-test too.

Great, would it help to integrate qemu-test into the buildbot or do you
already have infrastructure to run it regularly on qemu.git/master?

Stefan