[PATCH OSSTEST v5 00/24] add distro domU testing flight

[Ian Campbell <ian.campbell@citrix.com>]

Hi,

Since v5 I've run various adhoc tests and fixed a bunch of issues (most
noticeably in "Debian: refactor code to add preseed commands to the
preseed file" which had broken most debian hvm installs).

As last time there are some patches in here which I think will be useful
to the Intel folks doing the nested virt testing, specifically the
refactoring of how overlays and ssh host keys are done will be useful
for installing a guest to be treated as the L1 host. (Note that this has
changed a bit, again, since last time)

Since Intel are building on some of this with their nested virt patch
series I'd like to get the early part of this series in sooner than the
rest, I think up to "make-flight: Handle $BUILD_LVEXTEND_MAX in
mfi-common:create_build_jobs()" makes sense. I have run an adhoc
xen-unstable flight on just those changes and the results are at
http://osstest.xs.citrite.net/~osstest/testlogs/logs/37326/ (only
visible in Citrix, sorry). The results email is also appended. No
regressions AFAICT.

(Possibly "Debian: [rR]efactor.*" could go in in isolation, but I didn't
test that by itself)

This also builds on some changes which are in "[GIT PULL OSSTEST] Merge
up changes from Cambridge instance.". Perhaps we should push that as one
batch? I can provide a branch if needed.

Open questions from last time:

When I originally started this work I envisioned a flight running on the
main production instance (in Cambridge at the time). Now that we have
the new colo I would still consider that the main production instance is
the best home, however given the new colo is not yet up to full capacity
we could also consider running this flight in Cambridge for the time
being. What do you think?

Also when running the adhoc tests the sheer number of jobs which are
involved (with my hope there will be more in the future as other distros
get in on the act) I was considering splitting it into multiple
distros-debian-{squeeze,wheezy,jessie,sid,daily} flights. Thoughts?

Summary of (A)cks, (M)odified and (N)ew:

         TestSupport: Add helper to fetch a URL on a host
 A       TestSupport: allow caller of prepareguest_part_xencfg to specify viftype
 A       create_webfile: Support use with guests as well as hosts.
M        Debian: refactor code to add preseed commands to the preseed file
         Debian: refactor preseeding of .ssh directories
 A       Debian: Refactor installation of overlays, so it can be used for guests too
         Debian: add preseed_create_guest helper
  N      ts-debian-hvm-install: Only apply EFI workaround for Wheezy
 A       make-flight: Handle $BUILD_LVEXTEND_MAX in mfi-common:create_build_jobs()
         <------------ CONSIDER APPLYING TO HERE ------------>
M        distros: add support for installing Debian PV guests via d-i, flight and jobs
         distros: support booting Debian PV (d-i installed) guests with pvgrub.
         distros: Support pvgrub for Wheezy too.
         distros: support PV guest install from Debian netinst media.
         Test pygrub and pvgrub on the regular flights
         distros: add branch infrastructure
 A       distros: Run a flight over the weekend.
         Debian: Handle lack of bootloader support in d-i on ARM.
         standalone: propagate result of command from with_logging
         ts-debian-di-install: Refactor root_disk specification
         make-flight: refactor PV debian tests
M        Add testing of non-LVM/phy disk backends.
         mfi-common: Allow make-*flight to filter the set of build jobs to include
         make-distros-flight: don't bother building for XSM.
         distros: email only me on play flights
         ts-debian-di-install: Use ftp.debian.org directly

Ian.


"Old" tested version had not actually been tested; therefore in this
flight we test it, rather than a new candidate.  The baseline, if
any, is the most recent actually tested revision.

flight 37326 xen-unstable play [play]
http://osstest.xs.citrite.net/~osstest/testlogs/logs/37326/

Failures :-/ but no regressions.

Tests which did not succeed, but are not blocking:
 test-amd64-amd64-rumpuserxen-amd64  1 build-check(1)               blocked n/a
 test-amd64-i386-rumpuserxen-i386  1 build-check(1)               blocked  n/a
 test-amd64-i386-xl-qemuu-winxpsp3 16 guest-stop                fail never pass
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass
 test-amd64-amd64-xl-qemuu-win7-amd64 16 guest-stop             fail never pass
 test-armhf-armhf-xl-sedf-pin 12 migrate-support-check        fail   never pass
 test-amd64-amd64-xl-winxpsp3 16 guest-stop                   fail   never pass
 test-amd64-i386-xl-qemut-winxpsp3 16 guest-stop                fail never pass
 test-amd64-i386-xl-winxpsp3  16 guest-stop                   fail   never pass
 test-amd64-amd64-xl-qemut-win7-amd64 16 guest-stop             fail never pass
 test-amd64-amd64-libvirt     12 migrate-support-check        fail   never pass
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass
 test-armhf-armhf-xl-xsm       6 xen-boot                     fail   never pass
 test-armhf-armhf-xl          12 migrate-support-check        fail   never pass
 test-amd64-i386-xl-qemuu-win7-amd64 16 guest-stop              fail never pass
 test-amd64-amd64-xl-qemuu-winxpsp3 16 guest-stop               fail never pass
 test-amd64-i386-xl-qemut-win7-amd64 16 guest-stop              fail never pass
 test-amd64-i386-libvirt      12 migrate-support-check        fail   never pass
 test-amd64-amd64-xl-pvh-amd  11 guest-start                  fail   never pass
 test-amd64-amd64-xl-pvh-intel 11 guest-start                  fail  never pass
 test-amd64-amd64-xl-qemut-winxpsp3 16 guest-stop               fail never pass
 test-amd64-i386-libvirt-xsm  11 guest-start                  fail   never pass
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass
 test-armhf-armhf-xl-midway   12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-sedf     12 migrate-support-check        fail   never pass
 test-amd64-i386-xl-win7-amd64 16 guest-stop                   fail  never pass
 test-armhf-armhf-xl-credit2  12 migrate-support-check        fail   never pass
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 16 guest-stop         fail never pass
 test-amd64-i386-xl-winxpsp3-vcpus1 16 guest-stop               fail never pass
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1 16 guest-stop         fail never pass
 test-amd64-amd64-xl-win7-amd64 16 guest-stop                   fail never pass
 test-armhf-armhf-xl-multivcpu 12 migrate-support-check        fail  never pass
 test-amd64-amd64-libvirt-xsm 11 guest-start                  fail   never pass
 test-amd64-amd64-xl-xsm      11 guest-start                  fail   never pass
 test-armhf-armhf-libvirt-xsm  6 xen-boot                     fail   never pass
 test-amd64-i386-xl-xsm       11 guest-start                  fail   never pass
 test-armhf-armhf-libvirt     12 migrate-support-check        fail   never pass

version targeted for testing:
 xen                  3a28f760508fb35c430edac17a9efde5aff6d1d5
baseline version:
 xen                  3a28f760508fb35c430edac17a9efde5aff6d1d5

jobs:
 test-amd64-amd64-xl                                          pass    
 test-armhf-armhf-xl                                          pass    
 test-amd64-i386-xl                                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm                fail    
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm                 fail    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm                fail    
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm                 fail    
 test-amd64-amd64-libvirt-xsm                                 fail    
 test-armhf-armhf-libvirt-xsm                                 fail    
 test-amd64-i386-libvirt-xsm                                  fail    
 test-amd64-amd64-xl-xsm                                      fail    
 test-armhf-armhf-xl-xsm                                      fail    
 test-amd64-i386-xl-xsm                                       fail    
 test-amd64-amd64-xl-pvh-amd                                  fail    
 test-amd64-i386-rhel6hvm-amd                                 pass    
 test-amd64-i386-qemut-rhel6hvm-amd                           pass    
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass    
 test-amd64-i386-freebsd10-amd64                              pass    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         pass    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          pass    
 test-amd64-amd64-rumpuserxen-amd64                           broken  
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-amd64-amd64-xl-win7-amd64                               fail    
 test-amd64-i386-xl-win7-amd64                                fail    
 test-amd64-amd64-xl-credit2                                  pass    
 test-armhf-armhf-xl-credit2                                  pass    
 test-amd64-i386-freebsd10-i386                               pass    
 test-amd64-i386-rumpuserxen-i386                             broken  
 test-amd64-amd64-xl-pvh-intel                                fail    
 test-amd64-i386-rhel6hvm-intel                               pass    
 test-amd64-i386-qemut-rhel6hvm-intel                         pass    
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
 test-amd64-amd64-libvirt                                     pass    
 test-armhf-armhf-libvirt                                     pass    
 test-amd64-i386-libvirt                                      pass    
 test-armhf-armhf-xl-midway                                   pass    
 test-amd64-amd64-xl-multivcpu                                pass    
 test-armhf-armhf-xl-multivcpu                                pass    
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         pass    
 test-amd64-amd64-xl-sedf-pin                                 pass    
 test-armhf-armhf-xl-sedf-pin                                 pass    
 test-amd64-amd64-xl-sedf                                     pass    
 test-armhf-armhf-xl-sedf                                     pass    
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     fail    
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     fail    
 test-amd64-i386-xl-winxpsp3-vcpus1                           fail    
 test-amd64-amd64-xl-qemut-winxpsp3                           fail    
 test-amd64-i386-xl-qemut-winxpsp3                            fail    
 test-amd64-amd64-xl-qemuu-winxpsp3                           fail    
 test-amd64-i386-xl-qemuu-winxpsp3                            fail    
 test-amd64-amd64-xl-winxpsp3                                 fail    
 test-amd64-i386-xl-winxpsp3                                  fail    


------------------------------------------------------------
sg-report-flight on osstest.xs.citrite.net
logs: /home/xc_osstest/logs
images: /home/xc_osstest/images

Logs, config files, etc. are available at
    http://osstest.xs.citrite.net/~osstest/testlogs/logs

Test harness code can be found at
    http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary


Published tested tree is already up to date.