[PATCH OSSTEST v3 00/19] add distro domU testing flight

[Ian Campbell <Ian.Campbell@citrix.com>]

Hi,

The following series adds a new flight type intended to test distro domU
support, i.e. running distro installers and kernels on top of current
Xen to ensure things work. I intend for the flight to be run on a weekly
basis, and I've scheduled it here to run at the weekend when in theory
things might be quieter.

I've initially just done Debian PV domU support since Debian is what I
know, but I hope others will add other distros as time goes on.

The series introduces support for running the Debian Installer in a PV
domU booting from netboot (PXE-ish) and netinst (ISO media) and adding
jobs to test all of those for Squeeze onwards up to Sid and the
daily/weekly builds (CDs are built daily, DVDs weekly).

The flight is a bit unusual since distro installer builds are not really
versioned in a way which is useful to osstest, so instead each flight
will be compared against the previous run only.

Compared with the previous version I've addressed the review comments
and I've also reworked the cr-daily-branch changes after discussion with
Ian. I've run this a few times in play mode on the production system and
things are looking pretty good. See
http://www.chiark.greenend.org.uk/~xensrcts/logs/31967/ for the latest
results.

Most tests passed modulo a few host install failures and the fact that
Debian Jessie+Sid don't install right now for tedious Debian reasons
(the nightlies are OK though, so these will be fixed next time d-i is
uploaded). The armhf failures should be addressed by the patch at the
end of the series.

The exception to that good news is that sg-report-flight
--that-flight=NNN MMM doesn't seem to be considering failures in MMM
regressions vs NNN. e.g. test-amd64-i386-i386-daily-netboot-pvgrub
should appear as a regression from 31961 to 31964 but isn't. I'm going
to have a poke around that.

The new Debian install functionality here also gives us the opportunity
to test pygrub and pvgrub, so a couple of jobs are added to the regular
tests using installer images versioned via TftpDiVersion in the usual
way. This requires an early patch "mg-debian-installer-update: grab Xen
PV domU capable images too" to go in and a patch to update TftpDiVersion
to a refreshed version to be inserted before "Test pygrub and pvgrub on
the regular flights" is committed.

I've also pushed a branch:

The following changes since commit 9fa3df2d9838f2aecb0d0cb6d1a565d824828d65:

  cs-adjust-flight: runvar-perlop: Do not report non-changes (2014-11-17 17:32:11 +0000)

are available in the git repository at:

  git://xenbits.xen.org/people/ianc/osstest.git distro-flight-v3

for you to fetch changes up to aa67780314f5d9c88858dddde0c6f2b6b149d697:

  Debian: Handle lack of bootloader support in d-i on ARM. (2014-12-01 12:43:08 +0000)

----------------------------------------------------------------
Ian Campbell (19):
      TestSupport: Add helper to fetch a URL on a host
      TestSupport: Add helper to wait for a guest to shutdown
      TestSupport: allow overring of on_* in prepareguest_part_xencfg
      TestSupport: allow caller of prepareguest_part_xencfg to specify viftype
      create_webfile: Support use with guests as well as hosts.
      Debian: refactor code to add preseed commands to the preseed file
      Debian: refactor preseeding of .ssh directories
      Debian: ensure preseed base comment remains at actual end of base.
      Debian: Refactor installation of overlays, so it can be used for guests too
      Debian: add preseed_create_guest helper
      make-flight: Handle $BUILD_LVEXTEND_MAX in mfi-common:create_build_jobs()
      distros: add support for installing Debian PV guests via d-i, flight and jobs
      distros: support booting Debian PV (d-i installed) guests with pvgrub.
      distros: Support pvgrub for Wheezy too.
      distros: support PV guest install from Debian netinst media.
      Test pygrub and pvgrub on the regular flights
      distros: add branch infrastructure
      distros: Run a flight over the weekend.
      Debian: Handle lack of bootloader support in d-i on ARM.

 Osstest.pm             |   7 ++
 Osstest/Debian.pm      | 247 +++++++++++++++++++++++++++++++++++--------------
 Osstest/TestSupport.pm |  47 ++++++++--
 cr-daily-branch        |  39 ++++++--
 cri-common             |   1 +
 crontab                |   1 +
 make-distros-flight    | 140 ++++++++++++++++++++++++++++
 make-flight            |  43 ++++++++-
 mfi-common             |   4 +
 sg-run-job             |  11 +++
 ts-debian-di-install   | 236 ++++++++++++++++++++++++++++++++++++++++++++++
 ts-debian-hvm-install  |   8 +-
 12 files changed, 689 insertions(+), 95 deletions(-)
 create mode 100755 make-distros-flight
 create mode 100755 ts-debian-di-install