Re: Call to write tests for osstest

[George Dunlap <george.dunlap@eu.citrix.com>]

On 08/08/13 18:37, Sander Eikelenboom wrote:
> Thursday, August 8, 2013, 6:01:01 PM, you wrote:
>
>> As release coordinator, and therefore de-facto
>> tracker-of-bugs-and-regressions, it seems to me that one of the
>> shortcomings in our current development mode is a lack of good
>> regression testing for many of the less common, but still very
>> important features of Xen; things like S3, driver domains, nested
>> virt, and so on.
>> We do have a regression-testing push gate for the xen trees, written
>> by Ian Jackson, called osstest, with a lot of great functionality,
>> including a test scheduler, an automatic Baysean bisector, and so on.
>> Apart from more hardware, it is mainly lacking a more complete set of
>> tests.
>> The Xen Project team here at Citrix agreed with me, and have decided
>> during the 4.4 timeframe to take on the task of adding some important
>> functional tests to osstest; our list is below.  We'd love for you to
>> join us.
>> I will be tracking the implementation of the tests as part of the
>> regular 4.4 release updates.  I encourage people to join us by
>> thinking about a particular feature or bit of functionality that is
>> not yet tested by osstest, which you would like to see implemented in
>> the 4.4 timeframe, and responding to this e-mail, or one of the
>> regular development update e-mails asking it to be added.
>> There is a description of osstest, along with a link to the source code, here:
>> http://blog.xen.org/index.php/2013/02/02/xen-automatic-test-system-osstest/
>> === Testing coverage ===
>> * Network driver domains
>>   @George
>> * new libxl w/ previous versions of xl
>>   @IanJ
>> * Host S3 suspend
>>   @bguthro?
>> * Default [example] XSM policy
>>   @Stefano to ask Daniel D
>> * Xen on ARM
>>   # problem ATM: hardware
>>    @ianc
>>     emulator: @stefano to think about it
>> * Storage driver domains
>>   @roger
>> * HVM pci passthrough
>>   @anthony
>> * Nested virt?
>>   @intel (chased by George)
>> * Fix SRIOV test (chase intel)
>>   @ianj
>> * Fix bisector to e-mail blame-worthy parties
>>   @ianj
>> * Fix xl shutdown
>>    @ianj
>> * stub domains
>>    @athony
>
> Slightly related,
>
> Is xend/xm support going to be dropped for 4.4 ?
> If so, that could spare quite some testing resources, so perhaps nice to know rather sooner than later ?

It's not really clear yet -- I think a proper discussion will happen 
if/when someone posts a patch to remove it. :-)

  -George