From mboxrd@z Thu Jan 1 00:00:00 1970 From: Konrad Rzeszutek Wilk Subject: Re: Call to write tests for osstest Date: Thu, 8 Aug 2013 15:40:45 -0400 Message-ID: <20130808194044.GE4513@konrad-lan.dumpdata.com> References: Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Return-path: Content-Disposition: inline In-Reply-To: List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: George Dunlap Cc: "xen-devel@lists.xen.org" List-Id: xen-devel@lists.xenproject.org On Thu, Aug 08, 2013 at 05:01:01PM +0100, George Dunlap wrote: > As release coordinator, and therefore de-facto > tracker-of-bugs-and-regressions, it seems to me that one of the > shortcomings in our current development mode is a lack of good > regression testing for many of the less common, but still very > important features of Xen; things like S3, driver domains, nested > virt, and so on. > > We do have a regression-testing push gate for the xen trees, written > by Ian Jackson, called osstest, with a lot of great functionality, > including a test scheduler, an automatic Baysean bisector, and so on. > Apart from more hardware, it is mainly lacking a more complete set of > tests. > > The Xen Project team here at Citrix agreed with me, and have decided > during the 4.4 timeframe to take on the task of adding some important > functional tests to osstest; our list is below. We'd love for you to > join us. > > I will be tracking the implementation of the tests as part of the > regular 4.4 release updates. I encourage people to join us by > thinking about a particular feature or bit of functionality that is > not yet tested by osstest, which you would like to see implemented in > the 4.4 timeframe, and responding to this e-mail, or one of the > regular development update e-mails asking it to be added. > > There is a description of osstest, along with a link to the source code, here: > > http://blog.xen.org/index.php/2013/02/02/xen-automatic-test-system-osstest/ > > === Testing coverage === > > * Network driver domains > @George > > * new libxl w/ previous versions of xl > @IanJ > > * Host S3 suspend > @bguthro? > > * Default [example] XSM policy > @Stefano to ask Daniel D > > * Xen on ARM > # problem ATM: hardware > @ianc > emulator: @stefano to think about it > > * Storage driver domains > @roger > > * HVM pci passthrough > @anthony PV pci passthrough would be nice too. You can assign me to it, thought I would need some help in groking the osstest thingy. Maybe I will just copy what @anthony is doing. > > * Nested virt? > @intel (chased by George) > > * Fix SRIOV test (chase intel) > @ianj > > * Fix bisector to e-mail blame-worthy parties > @ianj > > * Fix xl shutdown > @ianj > > * stub domains > @athony > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xen.org > http://lists.xen.org/xen-devel