[linux-4.1 test] 60785: tolerable FAIL - PUSHED

[linux-4.1 test] 60785: tolerable FAIL - PUSHED

[osstest service owner]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain, Size: 24595 bytes --]

flight 60785 linux-4.1 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/60785/

Failures :-/ but no regressions.

Tests which are failing intermittently (not blocking):
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 19 guest-start/debianhvm.repeat fail in 60746 pass in 60785
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest-start/debianhvm.repeat fail pass in 60746
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail pass in 60746

Regressions which are regarded as allowable (not blocking):
 test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 60654
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail blocked in 60654
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail in 60746 like 60654
 test-amd64-i386-xl-xsm       14 guest-saverestore            fail   like 60654
 test-amd64-i386-xl           14 guest-saverestore            fail   like 60654
 test-amd64-i386-pair        21 guest-migrate/src_host/dst_host fail like 60654
 test-armhf-armhf-xl-rtds     11 guest-start                  fail   like 60654
 test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop             fail like 60654
 test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop             fail like 60654

Tests which did not succeed, but are not blocking:
 test-amd64-amd64-xl-pvh-intel 14 guest-saverestore            fail  never pass
 test-amd64-i386-libvirt-xsm  12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-xsm  14 guest-saverestore            fail   never pass
 test-armhf-armhf-xl-vhd       9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt-qcow2  9 debian-di-install            fail never pass
 test-amd64-i386-libvirt      14 guest-saverestore            fail   never pass
 test-amd64-i386-libvirt      12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-qcow2     9 debian-di-install            fail   never pass
 test-armhf-armhf-xl-raw       9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt-vhd  9 debian-di-install            fail   never pass
 test-amd64-amd64-xl-pvh-amd  11 guest-start                  fail   never pass
 test-armhf-armhf-libvirt-raw  9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt     14 guest-saverestore            fail   never pass
 test-armhf-armhf-libvirt     12 migrate-support-check        fail   never pass
 test-armhf-armhf-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-armhf-armhf-libvirt-xsm 14 guest-saverestore            fail   never pass
 test-amd64-amd64-libvirt     12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
 test-amd64-amd64-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl          12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl          13 saverestore-support-check    fail   never pass
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-amd64-amd64-libvirt-raw 11 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
 test-amd64-i386-libvirt-qcow2 11 migrate-support-check        fail  never pass
 test-amd64-i386-libvirt-raw  11 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-credit2  13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-credit2  12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-armhf-armhf-xl-multivcpu 13 saverestore-support-check    fail  never pass
 test-armhf-armhf-xl-multivcpu 12 migrate-support-check        fail  never pass
 test-amd64-amd64-libvirt-vhd 11 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-vhd  11 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-cubietruck 12 migrate-support-check        fail never pass
 test-armhf-armhf-xl-cubietruck 13 saverestore-support-check    fail never pass
 test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop              fail never pass
 test-armhf-armhf-xl-xsm      13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-xsm      12 migrate-support-check        fail   never pass
 test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop              fail never pass
 test-amd64-amd64-libvirt-qcow2 11 migrate-support-check        fail never pass
 test-armhf-armhf-xl-arndale  12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-arndale  13 saverestore-support-check    fail   never pass

version targeted for testing:
 linux                4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
baseline version:
 linux                352cb8677f83a6cf2139151578c8c79785d2d4bf

Last test of basis    60654  2015-08-10 20:42:06 Z   10 days
Testing same since    60746  2015-08-17 05:53:13 Z    4 days    2 attempts

------------------------------------------------------------
People who touched revisions under test:
  Adam Williamson <awilliam@redhat.com>
  Alan Stern <stern@rowland.harvard.edu>
  Alex Deucher <alexander.deucher@amd.com>
  Amanieu d'Antras <amanieu@gmail.com>
  Anatol Pomozov <anatol.pomozov@gmail.com>
  Andrew Morton <akpm@linux-foundation.org>
  Andy Lutomirski <luto@kernel.org>
  Arkadiusz Miśkiewicz <arekm@maven.pl>
  Axel Lin <axel.lin@ingics.com>
  Ben Zhang <benzh@chromium.org>
  Benjamin Randazzo <benjamin@randazzo.fr>
  Bjorn Helgaas <bhelgaas@google.com>
  Borislav Petkov <bp@suse.de>
  Brian King <brking@linux.vnet.ibm.com>
  Brian Norris <computersforpeace@gmail.com>
  Chris Wilson <chris@chris-wilson.co.uk>
  Christoph Hellwig <hch@lst.de>
  Cyrille Pitchen <cyrille.pitchen@atmel.com>
  Dan Carpenter <dan.carpenter@oracle.com>
  Daniel Mack <zonque@gmail.com>
  Daniel Vetter <daniel.vetter@ffwll.ch>
  Daniel Vetter <daniel.vetter@intel.com>
  David Daney <david.daney@cavium.com>
  David S. Miller <davem@davemloft.net>
  David Vrabel <david.vrabel@citrix.com>
  Davidlohr Bueso <dbueso@suse.de>
  Denis Carikli <denis@eukrea.com>
  Dirk Behme <dirk.behme@de.bosch.com>
  Dmitry Torokhov <dmitry.torokhov@gmail.com>
  Doug Ledford <dledford@redhat.com>
  Eduardo Valentin <edubezval@gmail.com>
  Fang, Yang A <yang.a.fang@intel.com>
  Felipe Balbi <balbi@ti.com>
  Felix Fietkau <nbd@openwrt.org>
  Florian Fainelli <f.fainelli@gmail.com>
  Gavin Shan <gwshan@linux.vnet.ibm.com>
  Greg Kroah-Hartman <gregkh@linuxfoundation.org>
  Guenter Roeck <linux@roeck-us.net>
  Hans de Goede <hdegoede@redhat.com>
  Herbert Xu <herbert@gondor.apana.org.au>
  Hugh Dickins <hughd@google.com>
  Hui Wang <hui.wang@canonical.com>
  Ilya Dryomov <idryomov@gmail.com>
  Ingo Molnar <mingo@kernel.org>
  J. Bruce Fields <bfields@redhat.com>
  James Bottomley <JBottomley@Odin.com>
  James Cowgill <James.Cowgill@imgtec.com>
  James Hogan <james.hogan@imgtec.com>
  Jan C Peters <jcpeters89@gmail.com>
  Jan Kara <jack@suse.com>
  Javier Martinez Canillas <javier@osg.samsung.com>
  Jeff Layton <jeff.layton@primarydata.com>
  Jeff Layton <jlayton@poochiereds.net>
  Joe Thornber <ejt@redhat.com>
  Johan Hedberg <johan.hedberg@intel.com>
  Johan Hovold <johan@kernel.org>
  Johannes Oertei <johannes.oertel@uni-due.de>
  Joseph Qi <joseph.qi@huawei.com>
  Kalle Valo <kvalo@qca.qualcomm.com>
  Kinglong Mee <kinglongmee@gmail.com>
  Kishon Vijay Abraham I <kishon@ti.com>
  Krzysztof Kozlowski <k.kozlowski.k@gmail.com>
  Krzysztof Kozlowski <k.kozlowski@samsung.com>
  Lars-Peter Clausen <lars@metafoo.de>
  Leonidas Da Silva Barbosa <leosilva@linux.vnet.ibm.com>
  Leonidas S. Barbosa <leosilva@linux.vnet.ibm.com>
  Linus Torvalds <torvalds@linux-foundation.org>
  Ludovic Desroches <ludovic.desroches@atmel.com>
  Lukasz Majewski <l.majewski@samsung.com>
  Malcolm Priestley <tvboxspy@gmail.com>
  Marcel Holtmann <marcel@holtmann.org>
  Marcus Gelderie <redmnic@gmail.com>
  Marek Belisko <marek.belisko@streamunlimited.com>
  Marek Marczykowski-Górecki <marmarek@invisiblethingslab.com>
  Mark Brown <broonie@kernel.org>
  Martin Schwidefsky <schwidefsky@de.ibm.com>
  Mathias Nyman <mathias.nyman@linux.intel.com>
  Michael Kerrisk <mtk.manpages@gmail.com>
  Michael S. Tsirkin <mst@redhat.com>
  Michael Turquette <mturquette@baylibre.com>
  Michal Hocko <mhocko@suse.cz>
  Michal Kazior <michal.kazior@tieto.com>
  Mike Snitzer <snitzer@redhat.com>
  Murali Karicheri <m-karicheri2@ti.com>
  NeilBrown <neilb@suse.com>
  NeilBrown <neilb@suse.de>
  Nicolas Ferre <nicolas.ferre@atmel.com>
  Olof Johansson <olof@lixom.net>
  Pali Rohár <pali.rohar@gmail.com>
  Paolo Bonzini <pbonzini@redhat.com>
  Paul Walmsley <paul@pwsan.com>
  Peter Chen <peter.chen@freescale.com>
  Pieter Hollants <pieter@hollants.com>
  Ralf Baechle <ralf@linux-mips.org>
  Reinhard Speyerer <rspmn@arcor.de>
  Roger Quadros <rogerq@ti.com>
  Santosh Shilimkar <ssantosh@kernel.org>
  Scott Wood <scottwood@freescale.com>
  Shawn Guo <shawnguo@kernel.org>
  Shilpa Sreeramalu <shilpa.sreeramalu@intel.com>
  Tadeusz Struk <tadeusz.struk@intel.com>
  Takashi Iwai <tiwai@suse.de>
  Takashi Sakamoto <o-takashi@sakamocchi.jp>
  Tony Lindgren <tony@atomide.com>
  Vinod Koul <vinod.koul@intel.com>
  Wang Kai <morgan.wang@huawei.com>
  Wen Xiong <wenxiong@linux.vnet.ibm.com>

jobs:
 build-amd64-xsm                                              pass
 build-armhf-xsm                                              pass
 build-i386-xsm                                               pass
 build-amd64                                                  pass
 build-armhf                                                  pass
 build-i386                                                   pass
 build-amd64-libvirt                                          pass
 build-armhf-libvirt                                          pass
 build-i386-libvirt                                           pass
 build-amd64-pvops                                            pass
 build-armhf-pvops                                            pass
 build-i386-pvops                                             pass
 build-amd64-rumpuserxen                                      pass
 build-i386-rumpuserxen                                       pass
 test-amd64-amd64-xl                                          pass
 test-armhf-armhf-xl                                          pass
 test-amd64-i386-xl                                           fail
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm                pass
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm                 pass
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm           pass
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm            fail
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm                pass
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm                 pass
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm        fail
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm         fail
 test-amd64-amd64-libvirt-xsm                                 pass
 test-armhf-armhf-libvirt-xsm                                 fail
 test-amd64-i386-libvirt-xsm                                  fail
 test-amd64-amd64-xl-xsm                                      pass
 test-armhf-armhf-xl-xsm                                      pass
 test-amd64-i386-xl-xsm                                       fail
 test-amd64-amd64-xl-pvh-amd                                  fail
 test-amd64-i386-qemut-rhel6hvm-amd                           pass
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass
 test-amd64-i386-xl-qemut-debianhvm-amd64                     pass
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass
 test-amd64-i386-freebsd10-amd64                              pass
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         pass
 test-amd64-i386-xl-qemuu-ovmf-amd64                          pass
 test-amd64-amd64-rumpuserxen-amd64                           fail
 test-amd64-amd64-xl-qemut-win7-amd64                         fail
 test-amd64-i386-xl-qemut-win7-amd64                          fail
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail
 test-amd64-i386-xl-qemuu-win7-amd64                          fail
 test-armhf-armhf-xl-arndale                                  pass
 test-amd64-amd64-xl-credit2                                  pass
 test-armhf-armhf-xl-credit2                                  pass
 test-armhf-armhf-xl-cubietruck                               pass
 test-amd64-i386-freebsd10-i386                               pass
 test-amd64-i386-rumpuserxen-i386                             pass
 test-amd64-amd64-xl-pvh-intel                                fail
 test-amd64-i386-qemut-rhel6hvm-intel                         pass
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass
 test-amd64-amd64-libvirt                                     pass
 test-armhf-armhf-libvirt                                     fail
 test-amd64-i386-libvirt                                      fail
 test-amd64-amd64-xl-multivcpu                                pass
 test-armhf-armhf-xl-multivcpu                                pass
 test-amd64-amd64-pair                                        pass
 test-amd64-i386-pair                                         fail
 test-amd64-amd64-libvirt-pair                                fail
 test-amd64-i386-libvirt-pair                                 fail
 test-amd64-amd64-amd64-pvgrub                                pass
 test-amd64-amd64-i386-pvgrub                                 pass
 test-amd64-amd64-pygrub                                      pass
 test-amd64-amd64-libvirt-qcow2                               pass
 test-armhf-armhf-libvirt-qcow2                               fail
 test-amd64-i386-libvirt-qcow2                                pass
 test-amd64-amd64-xl-qcow2                                    pass
 test-armhf-armhf-xl-qcow2                                    fail
 test-amd64-i386-xl-qcow2                                     pass
 test-amd64-amd64-libvirt-raw                                 pass
 test-armhf-armhf-libvirt-raw                                 fail
 test-amd64-i386-libvirt-raw                                  pass
 test-amd64-amd64-xl-raw                                      pass
 test-armhf-armhf-xl-raw                                      fail
 test-amd64-i386-xl-raw                                       pass
 test-amd64-amd64-xl-rtds                                     pass
 test-armhf-armhf-xl-rtds                                     fail
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     pass
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     pass
 test-amd64-amd64-libvirt-vhd                                 pass
 test-armhf-armhf-libvirt-vhd                                 fail
 test-amd64-i386-libvirt-vhd                                  pass
 test-amd64-amd64-xl-vhd                                      pass
 test-armhf-armhf-xl-vhd                                      fail
 test-amd64-i386-xl-vhd                                       pass
 test-amd64-amd64-xl-qemut-winxpsp3                           pass
 test-amd64-i386-xl-qemut-winxpsp3                            pass
 test-amd64-amd64-xl-qemuu-winxpsp3                           pass
 test-amd64-i386-xl-qemuu-winxpsp3                            pass


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary


Pushing revision :

+ branch=linux-4.1
+ revision=4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
+ . cri-lock-repos
++ . cri-common
+++ . cri-getconfig
+++ umask 002
+++ getrepos
++++ getconfig Repos
++++ perl -e '
                use Osstest;
                readglobalconfig();
                print $c{"Repos"} or die $!;
        '
+++ local repos=/home/osstest/repos
+++ '[' -z /home/osstest/repos ']'
+++ '[' '!' -d /home/osstest/repos ']'
+++ echo /home/osstest/repos
++ repos=/home/osstest/repos
++ repos_lock=/home/osstest/repos/lock
++ '[' x '!=' x/home/osstest/repos/lock ']'
++ OSSTEST_REPOS_LOCK_LOCKED=/home/osstest/repos/lock
++ exec with-lock-ex -w /home/osstest/repos/lock ./ap-push linux-4.1 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
+ branch=linux-4.1
+ revision=4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
+ . cri-lock-repos
++ . cri-common
+++ . cri-getconfig
+++ umask 002
+++ getrepos
++++ getconfig Repos
++++ perl -e '
                use Osstest;
                readglobalconfig();
                print $c{"Repos"} or die $!;
        '
+++ local repos=/home/osstest/repos
+++ '[' -z /home/osstest/repos ']'
+++ '[' '!' -d /home/osstest/repos ']'
+++ echo /home/osstest/repos
++ repos=/home/osstest/repos
++ repos_lock=/home/osstest/repos/lock
++ '[' x/home/osstest/repos/lock '!=' x/home/osstest/repos/lock ']'
+ . cri-common
++ . cri-getconfig
++ umask 002
+ select_xenbranch
+ case "$branch" in
+ tree=linux
+ xenbranch=xen-unstable
+ '[' xlinux = xlinux ']'
+ linuxbranch=linux-4.1
+ '[' x = x ']'
+ qemuubranch=qemu-upstream-unstable
+ select_prevxenbranch
+ local b
+ local p
++ ./mg-list-all-branches
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.0-testing = xxen-unstable ']'
+ p=xen-4.0-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.1-testing = xxen-unstable ']'
+ p=xen-4.1-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.2-testing = xxen-unstable ']'
+ p=xen-4.2-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.3-testing = xxen-unstable ']'
+ p=xen-4.3-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.4-testing = xxen-unstable ']'
+ p=xen-4.4-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.5-testing = xxen-unstable ']'
+ p=xen-4.5-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-unstable = xxen-unstable ']'
+ break
+ prevxenbranch=xen-4.5-testing
+ : tested/2.6.39.x
+ . ap-common
++ : osstest@xenbits.xen.org
+++ getconfig OsstestUpstream
+++ perl -e '
                use Osstest;
                readglobalconfig();
                print $c{"OsstestUpstream"} or die $!;
        '
++ :
++ : git://xenbits.xen.org/xen.git
++ : osstest@xenbits.xen.org:/home/xen/git/xen.git
++ : git://xenbits.xen.org/staging/qemu-xen-unstable.git
++ : git://git.kernel.org
++ : git://git.kernel.org/pub/scm/linux/kernel/git
++ : git
++ : git://xenbits.xen.org/libvirt.git
++ : osstest@xenbits.xen.org:/home/xen/git/libvirt.git
++ : git://xenbits.xen.org/libvirt.git
++ : git://xenbits.xen.org/rumpuser-xen.git
++ : git
++ : git://xenbits.xen.org/rumpuser-xen.git
++ : osstest@xenbits.xen.org:/home/xen/git/rumpuser-xen.git
+++ besteffort_repo https://github.com/rumpkernel/rumpkernel-netbsd-src
+++ local repo=https://github.com/rumpkernel/rumpkernel-netbsd-src
+++ cached_repo https://github.com/rumpkernel/rumpkernel-netbsd-src '[fetch=try]'
+++ local repo=https://github.com/rumpkernel/rumpkernel-netbsd-src
+++ local 'options=[fetch=try]'
++++ getconfig GitCacheProxy
++++ perl -e '
                use Osstest;
                readglobalconfig();
                print $c{"GitCacheProxy"} or die $!;
        '
+++ local cache=git://cache:9419/
+++ '[' xgit://cache:9419/ '!=' x ']'
+++ echo 'git://cache:9419/https://github.com/rumpkernel/rumpkernel-netbsd-src%20[fetch=try]'
++ : 'git://cache:9419/https://github.com/rumpkernel/rumpkernel-netbsd-src%20[fetch=try]'
++ : git
++ : git://git.seabios.org/seabios.git
++ : osstest@xenbits.xen.org:/home/xen/git/osstest/seabios.git
++ : git://xenbits.xen.org/osstest/seabios.git
++ : https://github.com/tianocore/edk2.git
++ : osstest@xenbits.xen.org:/home/xen/git/osstest/ovmf.git
++ : git://xenbits.xen.org/osstest/ovmf.git
++ : git://xenbits.xen.org/osstest/linux-firmware.git
++ : osstest@xenbits.xen.org:/home/osstest/ext/linux-firmware.git
++ : git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git
++ : osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
++ : git://xenbits.xen.org/linux-pvops.git
++ : tested/linux-3.14
++ : tested/linux-arm-xen
++ '[' xgit://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git = x ']'
++ '[' xgit://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git = x ']'
++ : git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git
++ : tested/2.6.39.x
++ : daily-cron.linux-4.1
++ : daily-cron.linux-4.1
++ : daily-cron.linux-4.1
++ : daily-cron.linux-4.1
++ : daily-cron.linux-4.1
++ : daily-cron.linux-4.1
++ : http://hg.uk.xensource.com/carbon/trunk/linux-2.6.27
++ : git://xenbits.xen.org/staging/qemu-upstream-unstable.git
++ : daily-cron.linux-4.1
++ : git://git.qemu.org/qemu.git
++ : git://xenbits.xen.org/osstest/qemu.git
++ : osstest@xenbits.xen.org:/home/xen/git/osstest/qemu.git
++ : daily-cron.linux-4.1
+ TREE_LINUX=osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
+ TREE_QEMU_MAINLINE=osstest@xenbits.xen.org:/home/xen/git/osstest/qemu.git
+ TREE_QEMU_UPSTREAM=osstest@xenbits.xen.org:/home/xen/git/qemu-upstream-unstable.git
+ TREE_XEN=osstest@xenbits.xen.org:/home/xen/git/xen.git
+ TREE_LIBVIRT=osstest@xenbits.xen.org:/home/xen/git/libvirt.git
+ TREE_RUMPUSERXEN=osstest@xenbits.xen.org:/home/xen/git/rumpuser-xen.git
+ TREE_SEABIOS=osstest@xenbits.xen.org:/home/xen/git/osstest/seabios.git
+ TREE_OVMF=osstest@xenbits.xen.org:/home/xen/git/osstest/ovmf.git
+ info_linux_tree linux-4.1
+ case $1 in
+ : git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
+ : linux-4.1.y
+ : linux-4.1.y
+ : git
+ : git
+ : git://xenbits.xen.org/linux-pvops.git
+ : osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
+ : tested/linux-4.1
+ : refs/heads/tested/linux-4.1
+ return 0
+ cd /home/osstest/repos/linux
+ git push osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc:refs/heads/tested/linux-4.1
To osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
   352cb86..4ff62ca  4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc -> tested/linux-4.1
+ exit 0


[-- Attachment #2: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Analysis: switch osstest default kernel from 3.14 to 4.1 (Was: Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED)

[Ian Campbell]

[-- Attachment #1: Type: text/plain, Size: 32430 bytes --]

TL;DR: There are issues which need fixing first...

On Fri, 2015-08-21 at 17:24 +0000, osstest service owner wrote:
> flight 60785 linux-4.1 real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/60785/
> 
> Failures :-/ but no regressions.
> 
> Tests which are failing intermittently (not blocking):
>  test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 19 guest-start/debianhvm.repeat fail in 60746 pass in 60785
>  test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest-start/debianhvm.repeat fail pass in 60746
>  test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail pass in 60746

I've been considering updating osstest to switch from the current baseline
kernel (the one used for all non linux-* tests) from 3.14 to 4.1.

The last pass on 3.14 was 60666[0] a little while ago on 13/8 (due to a
known issue[1]). As well as this pass of 4.1 today I therefore also
considered 60654[2] on 12/8. Two reports (like this one) are attached
comparing 3.16:60666 against 4.1:60654 and 4.1:60795 respectively.

Both reports have these in common:

    Tests which did not succeed and are blocking,
    including tests which could not be run:
     test-amd64-i386-pair   21 guest-migrate/src_host/dst_host fail REGR. vs. 60666
     test-amd64-i386-xl-xsm       14 guest-saverestore         fail REGR. vs. 60666
     test-amd64-i386-xl           14 guest-saverestore         fail REGR. vs. 60666

While the more recent one also adds two more:

    Tests which did not succeed and are blocking,
    including tests which could not be run:
    [...]
     test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail REGR. vs. 60666
     test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest-start/debianhvm.repeat fail REGR. vs. 60666
    [...]

The relevant long term histories of each these jobs on the relevant
branches are (also included is the Linus branch for "most recent":

http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-pair/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-pair/linux-4.1.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-pair/linux-linus.html

      * 4.1 and Linux have been failing since late July, both sticky to
        elbling*.
      * 3.14 is passing, including a few passes in August on elbling*

http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl-xsm/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl-xsm/linux-4.1.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl-xsm/linux-linus.html

      * Linus is hard to say, since there are some xen-boot fails in there,
        but it has been failing guest-saverestore since late July on
        elbling*
      * 4.1 failing on italia0 since late July
      * 3.14 regularly passing since early June, some recent passes on
        elbling* but not attempts on italia0

http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl/linux-4.1.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl/linux-linus.html

      * Linus is hard to say, since there are some xen-boot fails in there,
        but it has been failing guest-saverestore since late July on
        italia0*
      * 4.1 failing on fiano0 since late July
      * 3.14 regularly passing since forever, some recent passes on fiano0
        and italia0.

http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/linux-4.1.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/linux-linus.html

      * Linus is hard to say, since there are some xen-boot fails in there,
        but it has been failing guest-localmigrate since late July on
        merlot1
      * 4.1 has been passing until the very last attempt, which touched
        merlot1 and failed. I expect this will now be a sticky failure on
        merlot1.
      * 3.14 regularly failing since late June on merlot0, including on
        60666

This looks like a regression between 60666 and 60785 because the former
failed guest-localmigrate.2 while the later failed guest-localmigrate
(which 60666 must have therefore passed).

http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm/linux-4.1.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm/linux-linus.html

      * Linus looks to mostly pass (a few recent glitches on italia1, but a
        pass since).
      * 4.1 only has 3 results, 2 passes and the most recent fail on
        huxelrebe0
      * 3.14 seems to mostly pass.

I think it is pretty clear from the above that we shouldn't be switching to
4.1 just yet.

test-amd64-i386-pair, test-amd64-i386-xl-xsm and test-amd64-i386-xl look
like they ought to be bisectable.

test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm looks like the  "WTF
is us with merlot*" issue :-(

test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm doesn't really have
enough data to go on yet.

For the potentially bisectable ones:

http://logs.test-lab.xenproject.org/osstest/results/bisect/linux-4.1/test-amd64-i386-pair.guest-migrate--src_host--dst_host.html

    Seems to have gotten close to blaming something then (from the
    timestamps in the apache index) given up towards the end of July.

http://logs.test-lab.xenproject.org/osstest/results/bisect/linux-4.1/test-amd64-i386-xl-xsm.guest-saverestore.html
    =>     http://lists.xen.org/archives/html/xen-devel/2015-07/msg04798.html
http://logs.test-lab.xenproject.org/osstest/results/bisect/linux-4.1/test-amd64-i386-xl.guest-saverestore.html
    =>     http://lists.xen.org/archives/html/xen-devel/2015-07/msg05158.html

Both of which are blaming 3a9ace0147d4 "tools/libxc+libxl+xl: Restore v2
streams". That's also within the range of the first incomplete bisect, so I
expect that is the same issue.

Ian.

[0] http://logs.test-lab.xenproject.org/osstest/logs/60666/
    http://lists.xen.org/archives/html/xen-devel/2015-09/msg00304.html
[1] http://lists.xen.org/archives/html/xen-devel/2015-09/msg00161.html
[2] http://logs.test-lab.xenproject.org/osstest/logs/60654/
    http://lists.xen.org/archives/html/xen-devel/2015-09/msg00303.html

> 
> Regressions which are regarded as allowable (not blocking):
>  test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 60654
>  test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail blocked in 60654
>  test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail in 60746 like 60654
>  test-amd64-i386-xl-xsm       14 guest-saverestore            fail   like 60654
>  test-amd64-i386-xl           14 guest-saverestore            fail   like 60654
>  test-amd64-i386-pair        21 guest-migrate/src_host/dst_host fail like 60654
>  test-armhf-armhf-xl-rtds     11 guest-start                  fail   like 60654
>  test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop             fail like 60654
>  test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop             fail like 60654
> 
> Tests which did not succeed, but are not blocking:
>  test-amd64-amd64-xl-pvh-intel 14 guest-saverestore            fail  never pass
>  test-amd64-i386-libvirt-xsm  12 migrate-support-check        fail   never pass
>  test-amd64-i386-libvirt-xsm  14 guest-saverestore            fail   never pass
>  test-armhf-armhf-xl-vhd       9 debian-di-install            fail   never pass
>  test-armhf-armhf-libvirt-qcow2  9 debian-di-install            fail never pass
>  test-amd64-i386-libvirt      14 guest-saverestore            fail   never pass
>  test-amd64-i386-libvirt      12 migrate-support-check        fail   never pass
>  test-armhf-armhf-xl-qcow2     9 debian-di-install            fail   never pass
>  test-armhf-armhf-xl-raw       9 debian-di-install            fail   never pass
>  test-armhf-armhf-libvirt-vhd  9 debian-di-install            fail   never pass
>  test-amd64-amd64-xl-pvh-amd  11 guest-start                  fail   never pass
>  test-armhf-armhf-libvirt-raw  9 debian-di-install            fail   never pass
>  test-armhf-armhf-libvirt     14 guest-saverestore            fail   never pass
>  test-armhf-armhf-libvirt     12 migrate-support-check        fail   never pass
>  test-armhf-armhf-libvirt-xsm 12 migrate-support-check        fail   never pass
>  test-armhf-armhf-libvirt-xsm 14 guest-saverestore            fail   never pass
>  test-amd64-amd64-libvirt     12 migrate-support-check        fail   never pass
>  test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
>  test-amd64-amd64-libvirt-xsm 12 migrate-support-check        fail   never pass
>  test-armhf-armhf-xl          12 migrate-support-check        fail   never pass
>  test-armhf-armhf-xl          13 saverestore-support-check    fail   never pass
>  test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
>  test-amd64-amd64-libvirt-raw 11 migrate-support-check        fail   never pass
>  test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
>  test-amd64-i386-libvirt-qcow2 11 migrate-support-check        fail  never pass
>  test-amd64-i386-libvirt-raw  11 migrate-support-check        fail   never pass
>  test-armhf-armhf-xl-credit2  13 saverestore-support-check    fail   never pass
>  test-armhf-armhf-xl-credit2  12 migrate-support-check        fail   never pass
>  test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
>  test-armhf-armhf-xl-multivcpu 13 saverestore-support-check    fail  never pass
>  test-armhf-armhf-xl-multivcpu 12 migrate-support-check        fail  never pass
>  test-amd64-amd64-libvirt-vhd 11 migrate-support-check        fail   never pass
>  test-amd64-i386-libvirt-vhd  11 migrate-support-check        fail   never pass
>  test-armhf-armhf-xl-cubietruck 12 migrate-support-check        fail never pass
>  test-armhf-armhf-xl-cubietruck 13 saverestore-support-check    fail never pass
>  test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop              fail never pass
>  test-armhf-armhf-xl-xsm      13 saverestore-support-check    fail   never pass
>  test-armhf-armhf-xl-xsm      12 migrate-support-check        fail   never pass
>  test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop              fail never pass
>  test-amd64-amd64-libvirt-qcow2 11 migrate-support-check        fail never pass
>  test-armhf-armhf-xl-arndale  12 migrate-support-check        fail   never pass
>  test-armhf-armhf-xl-arndale  13 saverestore-support-check    fail   never pass
> 
> version targeted for testing:
>  linux                4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
> baseline version:
>  linux                352cb8677f83a6cf2139151578c8c79785d2d4bf
> 
> Last test of basis    60654  2015-08-10 20:42:06 Z   10 days
> Testing same since    60746  2015-08-17 05:53:13 Z    4 days    2 attempts
> 
> ------------------------------------------------------------
> People who touched revisions under test:
>   Adam Williamson <awilliam@redhat.com>
>   Alan Stern <stern@rowland.harvard.edu>
>   Alex Deucher <alexander.deucher@amd.com>
>   Amanieu d'Antras <amanieu@gmail.com>
>   Anatol Pomozov <anatol.pomozov@gmail.com>
>   Andrew Morton <akpm@linux-foundation.org>
>   Andy Lutomirski <luto@kernel.org>
>   Arkadiusz Miśkiewicz <arekm@maven.pl>
>   Axel Lin <axel.lin@ingics.com>
>   Ben Zhang <benzh@chromium.org>
>   Benjamin Randazzo <benjamin@randazzo.fr>
>   Bjorn Helgaas <bhelgaas@google.com>
>   Borislav Petkov <bp@suse.de>
>   Brian King <brking@linux.vnet.ibm.com>
>   Brian Norris <computersforpeace@gmail.com>
>   Chris Wilson <chris@chris-wilson.co.uk>
>   Christoph Hellwig <hch@lst.de>
>   Cyrille Pitchen <cyrille.pitchen@atmel.com>
>   Dan Carpenter <dan.carpenter@oracle.com>
>   Daniel Mack <zonque@gmail.com>
>   Daniel Vetter <daniel.vetter@ffwll.ch>
>   Daniel Vetter <daniel.vetter@intel.com>
>   David Daney <david.daney@cavium.com>
>   David S. Miller <davem@davemloft.net>
>   David Vrabel <david.vrabel@citrix.com>
>   Davidlohr Bueso <dbueso@suse.de>
>   Denis Carikli <denis@eukrea.com>
>   Dirk Behme <dirk.behme@de.bosch.com>
>   Dmitry Torokhov <dmitry.torokhov@gmail.com>
>   Doug Ledford <dledford@redhat.com>
>   Eduardo Valentin <edubezval@gmail.com>
>   Fang, Yang A <yang.a.fang@intel.com>
>   Felipe Balbi <balbi@ti.com>
>   Felix Fietkau <nbd@openwrt.org>
>   Florian Fainelli <f.fainelli@gmail.com>
>   Gavin Shan <gwshan@linux.vnet.ibm.com>
>   Greg Kroah-Hartman <gregkh@linuxfoundation.org>
>   Guenter Roeck <linux@roeck-us.net>
>   Hans de Goede <hdegoede@redhat.com>
>   Herbert Xu <herbert@gondor.apana.org.au>
>   Hugh Dickins <hughd@google.com>
>   Hui Wang <hui.wang@canonical.com>
>   Ilya Dryomov <idryomov@gmail.com>
>   Ingo Molnar <mingo@kernel.org>
>   J. Bruce Fields <bfields@redhat.com>
>   James Bottomley <JBottomley@Odin.com>
>   James Cowgill <James.Cowgill@imgtec.com>
>   James Hogan <james.hogan@imgtec.com>
>   Jan C Peters <jcpeters89@gmail.com>
>   Jan Kara <jack@suse.com>
>   Javier Martinez Canillas <javier@osg.samsung.com>
>   Jeff Layton <jeff.layton@primarydata.com>
>   Jeff Layton <jlayton@poochiereds.net>
>   Joe Thornber <ejt@redhat.com>
>   Johan Hedberg <johan.hedberg@intel.com>
>   Johan Hovold <johan@kernel.org>
>   Johannes Oertei <johannes.oertel@uni-due.de>
>   Joseph Qi <joseph.qi@huawei.com>
>   Kalle Valo <kvalo@qca.qualcomm.com>
>   Kinglong Mee <kinglongmee@gmail.com>
>   Kishon Vijay Abraham I <kishon@ti.com>
>   Krzysztof Kozlowski <k.kozlowski.k@gmail.com>
>   Krzysztof Kozlowski <k.kozlowski@samsung.com>
>   Lars-Peter Clausen <lars@metafoo.de>
>   Leonidas Da Silva Barbosa <leosilva@linux.vnet.ibm.com>
>   Leonidas S. Barbosa <leosilva@linux.vnet.ibm.com>
>   Linus Torvalds <torvalds@linux-foundation.org>
>   Ludovic Desroches <ludovic.desroches@atmel.com>
>   Lukasz Majewski <l.majewski@samsung.com>
>   Malcolm Priestley <tvboxspy@gmail.com>
>   Marcel Holtmann <marcel@holtmann.org>
>   Marcus Gelderie <redmnic@gmail.com>
>   Marek Belisko <marek.belisko@streamunlimited.com>
>   Marek Marczykowski-Górecki <marmarek@invisiblethingslab.com>
>   Mark Brown <broonie@kernel.org>
>   Martin Schwidefsky <schwidefsky@de.ibm.com>
>   Mathias Nyman <mathias.nyman@linux.intel.com>
>   Michael Kerrisk <mtk.manpages@gmail.com>
>   Michael S. Tsirkin <mst@redhat.com>
>   Michael Turquette <mturquette@baylibre.com>
>   Michal Hocko <mhocko@suse.cz>
>   Michal Kazior <michal.kazior@tieto.com>
>   Mike Snitzer <snitzer@redhat.com>
>   Murali Karicheri <m-karicheri2@ti.com>
>   NeilBrown <neilb@suse.com>
>   NeilBrown <neilb@suse.de>
>   Nicolas Ferre <nicolas.ferre@atmel.com>
>   Olof Johansson <olof@lixom.net>
>   Pali Rohár <pali.rohar@gmail.com>
>   Paolo Bonzini <pbonzini@redhat.com>
>   Paul Walmsley <paul@pwsan.com>
>   Peter Chen <peter.chen@freescale.com>
>   Pieter Hollants <pieter@hollants.com>
>   Ralf Baechle <ralf@linux-mips.org>
>   Reinhard Speyerer <rspmn@arcor.de>
>   Roger Quadros <rogerq@ti.com>
>   Santosh Shilimkar <ssantosh@kernel.org>
>   Scott Wood <scottwood@freescale.com>
>   Shawn Guo <shawnguo@kernel.org>
>   Shilpa Sreeramalu <shilpa.sreeramalu@intel.com>
>   Tadeusz Struk <tadeusz.struk@intel.com>
>   Takashi Iwai <tiwai@suse.de>
>   Takashi Sakamoto <o-takashi@sakamocchi.jp>
>   Tony Lindgren <tony@atomide.com>
>   Vinod Koul <vinod.koul@intel.com>
>   Wang Kai <morgan.wang@huawei.com>
>   Wen Xiong <wenxiong@linux.vnet.ibm.com>
> 
> jobs:
>  build-amd64-xsm                                              pass    
>  build-armhf-xsm                                              pass    
>  build-i386-xsm                                               pass    
>  build-amd64                                                  pass    
>  build-armhf                                                  pass    
>  build-i386                                                   pass    
>  build-amd64-libvirt                                          pass    
>  build-armhf-libvirt                                          pass    
>  build-i386-libvirt                                           pass    
>  build-amd64-pvops                                            pass    
>  build-armhf-pvops                                            pass    
>  build-i386-pvops                                             pass    
>  build-amd64-rumpuserxen                                      pass    
>  build-i386-rumpuserxen                                       pass    
>  test-amd64-amd64-xl                                          pass    
>  test-armhf-armhf-xl                                          pass    
>  test-amd64-i386-xl                                           fail    
>  test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm                pass    
>  test-amd64-i386-xl-qemut-debianhvm-amd64-xsm                 pass    
>  test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm           pass    
>  test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm            fail    
>  test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm                pass    
>  test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm                 pass    
>  test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm        fail    
>  test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm         fail    
>  test-amd64-amd64-libvirt-xsm                                 pass    
>  test-armhf-armhf-libvirt-xsm                                 fail    
>  test-amd64-i386-libvirt-xsm                                  fail    
>  test-amd64-amd64-xl-xsm                                      pass    
>  test-armhf-armhf-xl-xsm                                      pass    
>  test-amd64-i386-xl-xsm                                       fail    
>  test-amd64-amd64-xl-pvh-amd                                  fail    
>  test-amd64-i386-qemut-rhel6hvm-amd                           pass    
>  test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
>  test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass    
>  test-amd64-i386-xl-qemut-debianhvm-amd64                     pass    
>  test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass    
>  test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass    
>  test-amd64-i386-freebsd10-amd64                              pass    
>  test-amd64-amd64-xl-qemuu-ovmf-amd64                         pass    
>  test-amd64-i386-xl-qemuu-ovmf-amd64                          pass    
>  test-amd64-amd64-rumpuserxen-amd64                           fail    
>  test-amd64-amd64-xl-qemut-win7-amd64                         fail    
>  test-amd64-i386-xl-qemut-win7-amd64                          fail    
>  test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
>  test-amd64-i386-xl-qemuu-win7-amd64                          fail    
>  test-armhf-armhf-xl-arndale                                  pass    
>  test-amd64-amd64-xl-credit2                                  pass    
>  test-armhf-armhf-xl-credit2                                  pass    
>  test-armhf-armhf-xl-cubietruck                               pass    
>  test-amd64-i386-freebsd10-i386                               pass    
>  test-amd64-i386-rumpuserxen-i386                             pass    
>  test-amd64-amd64-xl-pvh-intel                                fail    
>  test-amd64-i386-qemut-rhel6hvm-intel                         pass    
>  test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
>  test-amd64-amd64-libvirt                                     pass    
>  test-armhf-armhf-libvirt                                     fail    
>  test-amd64-i386-libvirt                                      fail    
>  test-amd64-amd64-xl-multivcpu                                pass    
>  test-armhf-armhf-xl-multivcpu                                pass    
>  test-amd64-amd64-pair                                        pass    
>  test-amd64-i386-pair                                         fail    
>  test-amd64-amd64-libvirt-pair                                fail    
>  test-amd64-i386-libvirt-pair                                 fail    
>  test-amd64-amd64-amd64-pvgrub                                pass    
>  test-amd64-amd64-i386-pvgrub                                 pass    
>  test-amd64-amd64-pygrub                                      pass    
>  test-amd64-amd64-libvirt-qcow2                               pass    
>  test-armhf-armhf-libvirt-qcow2                               fail    
>  test-amd64-i386-libvirt-qcow2                                pass    
>  test-amd64-amd64-xl-qcow2                                    pass    
>  test-armhf-armhf-xl-qcow2                                    fail    
>  test-amd64-i386-xl-qcow2                                     pass    
>  test-amd64-amd64-libvirt-raw                                 pass    
>  test-armhf-armhf-libvirt-raw                                 fail    
>  test-amd64-i386-libvirt-raw                                  pass    
>  test-amd64-amd64-xl-raw                                      pass    
>  test-armhf-armhf-xl-raw                                      fail    
>  test-amd64-i386-xl-raw                                       pass    
>  test-amd64-amd64-xl-rtds                                     pass    
>  test-armhf-armhf-xl-rtds                                     fail    
>  test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     pass    
>  test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     pass    
>  test-amd64-amd64-libvirt-vhd                                 pass    
>  test-armhf-armhf-libvirt-vhd                                 fail    
>  test-amd64-i386-libvirt-vhd                                  pass    
>  test-amd64-amd64-xl-vhd                                      pass    
>  test-armhf-armhf-xl-vhd                                      fail    
>  test-amd64-i386-xl-vhd                                       pass    
>  test-amd64-amd64-xl-qemut-winxpsp3                           pass    
>  test-amd64-i386-xl-qemut-winxpsp3                            pass    
>  test-amd64-amd64-xl-qemuu-winxpsp3                           pass    
>  test-amd64-i386-xl-qemuu-winxpsp3                            pass    
> 
> 
> ------------------------------------------------------------
> sg-report-flight on osstest.test-lab.xenproject.org
> logs: /home/logs/logs
> images: /home/logs/images
> 
> Logs, config files, etc. are available at
>     http://logs.test-lab.xenproject.org/osstest/logs
> 
> Explanation of these reports, and of osstest in general, is at
>     http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
>     http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
> 
> Test harness code can be found at
>     http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
> 
> 
> Pushing revision :
> 
> + branch=linux-4.1
> + revision=4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
> + . cri-lock-repos
> ++ . cri-common
> +++ . cri-getconfig
> +++ umask 002
> +++ getrepos
> ++++ getconfig Repos
> ++++ perl -e '
>                 use Osstest;
>                 readglobalconfig();
>                 print $c{"Repos"} or die $!;
>         '
> +++ local repos=/home/osstest/repos
> +++ '[' -z /home/osstest/repos ']'
> +++ '[' '!' -d /home/osstest/repos ']'
> +++ echo /home/osstest/repos
> ++ repos=/home/osstest/repos
> ++ repos_lock=/home/osstest/repos/lock
> ++ '[' x '!=' x/home/osstest/repos/lock ']'
> ++ OSSTEST_REPOS_LOCK_LOCKED=/home/osstest/repos/lock
> ++ exec with-lock-ex -w /home/osstest/repos/lock ./ap-push linux-4.1 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
> + branch=linux-4.1
> + revision=4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
> + . cri-lock-repos
> ++ . cri-common
> +++ . cri-getconfig
> +++ umask 002
> +++ getrepos
> ++++ getconfig Repos
> ++++ perl -e '
>                 use Osstest;
>                 readglobalconfig();
>                 print $c{"Repos"} or die $!;
>         '
> +++ local repos=/home/osstest/repos
> +++ '[' -z /home/osstest/repos ']'
> +++ '[' '!' -d /home/osstest/repos ']'
> +++ echo /home/osstest/repos
> ++ repos=/home/osstest/repos
> ++ repos_lock=/home/osstest/repos/lock
> ++ '[' x/home/osstest/repos/lock '!=' x/home/osstest/repos/lock ']'
> + . cri-common
> ++ . cri-getconfig
> ++ umask 002
> + select_xenbranch
> + case "$branch" in
> + tree=linux
> + xenbranch=xen-unstable
> + '[' xlinux = xlinux ']'
> + linuxbranch=linux-4.1
> + '[' x = x ']'
> + qemuubranch=qemu-upstream-unstable
> + select_prevxenbranch
> + local b
> + local p
> ++ ./mg-list-all-branches
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.0-testing = xxen-unstable ']'
> + p=xen-4.0-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.1-testing = xxen-unstable ']'
> + p=xen-4.1-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.2-testing = xxen-unstable ']'
> + p=xen-4.2-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.3-testing = xxen-unstable ']'
> + p=xen-4.3-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.4-testing = xxen-unstable ']'
> + p=xen-4.4-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.5-testing = xxen-unstable ']'
> + p=xen-4.5-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-unstable = xxen-unstable ']'
> + break
> + prevxenbranch=xen-4.5-testing
> + : tested/2.6.39.x
> + . ap-common
> ++ : osstest@xenbits.xen.org
> +++ getconfig OsstestUpstream
> +++ perl -e '
>                 use Osstest;
>                 readglobalconfig();
>                 print $c{"OsstestUpstream"} or die $!;
>         '
> ++ :
> ++ : git://xenbits.xen.org/xen.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/xen.git
> ++ : git://xenbits.xen.org/staging/qemu-xen-unstable.git
> ++ : git://git.kernel.org
> ++ : git://git.kernel.org/pub/scm/linux/kernel/git
> ++ : git
> ++ : git://xenbits.xen.org/libvirt.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/libvirt.git
> ++ : git://xenbits.xen.org/libvirt.git
> ++ : git://xenbits.xen.org/rumpuser-xen.git
> ++ : git
> ++ : git://xenbits.xen.org/rumpuser-xen.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/rumpuser-xen.git
> +++ besteffort_repo https://github.com/rumpkernel/rumpkernel-netbsd-src
> +++ local repo=https://github.com/rumpkernel/rumpkernel-netbsd-src
> +++ cached_repo https://github.com/rumpkernel/rumpkernel-netbsd-src '[fetch=try]'
> +++ local repo=https://github.com/rumpkernel/rumpkernel-netbsd-src
> +++ local 'options=[fetch=try]'
> ++++ getconfig GitCacheProxy
> ++++ perl -e '
>                 use Osstest;
>                 readglobalconfig();
>                 print $c{"GitCacheProxy"} or die $!;
>         '
> +++ local cache=git://cache:9419/
> +++ '[' xgit://cache:9419/ '!=' x ']'
> +++ echo 'git://cache:9419/https://github.com/rumpkernel/rumpkernel-netbsd-src%20[fetch=try]'
> ++ : 'git://cache:9419/https://github.com/rumpkernel/rumpkernel-netbsd-src%20[fetch=try]'
> ++ : git
> ++ : git://git.seabios.org/seabios.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/osstest/seabios.git
> ++ : git://xenbits.xen.org/osstest/seabios.git
> ++ : https://github.com/tianocore/edk2.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/osstest/ovmf.git
> ++ : git://xenbits.xen.org/osstest/ovmf.git
> ++ : git://xenbits.xen.org/osstest/linux-firmware.git
> ++ : osstest@xenbits.xen.org:/home/osstest/ext/linux-firmware.git
> ++ : git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
> ++ : git://xenbits.xen.org/linux-pvops.git
> ++ : tested/linux-3.14
> ++ : tested/linux-arm-xen
> ++ '[' xgit://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git = x ']'
> ++ '[' xgit://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git = x ']'
> ++ : git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git
> ++ : tested/2.6.39.x
> ++ : daily-cron.linux-4.1
> ++ : daily-cron.linux-4.1
> ++ : daily-cron.linux-4.1
> ++ : daily-cron.linux-4.1
> ++ : daily-cron.linux-4.1
> ++ : daily-cron.linux-4.1
> ++ : http://hg.uk.xensource.com/carbon/trunk/linux-2.6.27
> ++ : git://xenbits.xen.org/staging/qemu-upstream-unstable.git
> ++ : daily-cron.linux-4.1
> ++ : git://git.qemu.org/qemu.git
> ++ : git://xenbits.xen.org/osstest/qemu.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/osstest/qemu.git
> ++ : daily-cron.linux-4.1
> + TREE_LINUX=osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
> + TREE_QEMU_MAINLINE=osstest@xenbits.xen.org:/home/xen/git/osstest/qemu.git
> + TREE_QEMU_UPSTREAM=osstest@xenbits.xen.org:/home/xen/git/qemu-upstream-unstable.git
> + TREE_XEN=osstest@xenbits.xen.org:/home/xen/git/xen.git
> + TREE_LIBVIRT=osstest@xenbits.xen.org:/home/xen/git/libvirt.git
> + TREE_RUMPUSERXEN=osstest@xenbits.xen.org:/home/xen/git/rumpuser-xen.git
> + TREE_SEABIOS=osstest@xenbits.xen.org:/home/xen/git/osstest/seabios.git
> + TREE_OVMF=osstest@xenbits.xen.org:/home/xen/git/osstest/ovmf.git
> + info_linux_tree linux-4.1
> + case $1 in
> + : git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
> + : linux-4.1.y
> + : linux-4.1.y
> + : git
> + : git
> + : git://xenbits.xen.org/linux-pvops.git
> + : osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
> + : tested/linux-4.1
> + : refs/heads/tested/linux-4.1
> + return 0
> + cd /home/osstest/repos/linux
> + git push osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc:refs/heads/tested/linux-4.1
> To osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
>    352cb86..4ff62ca  4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc -> tested/linux-4.1
> + exit 0

[-- Attachment #2: 3.14:60666-vs-4.1:60654 --]
[-- Type: text/plain, Size: 11531 bytes --]

60654: regressions - FAIL

flight 60654 linux-4.1 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/60654/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 test-amd64-i386-pair   21 guest-migrate/src_host/dst_host fail REGR. vs. 60666
 test-amd64-i386-xl-xsm       14 guest-saverestore         fail REGR. vs. 60666
 test-amd64-i386-xl           14 guest-saverestore         fail REGR. vs. 60666

Regressions which are regarded as allowable (not blocking):
 test-armhf-armhf-xl-rtds     11 guest-start              fail blocked in 60666
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail blocked in 60666
 test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop             fail like 60666
 test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop             fail like 60666
 test-armhf-armhf-libvirt-vhd  6 xen-boot                     fail   like 60666

Tests which did not succeed, but are not blocking:
 test-armhf-armhf-xl-raw       9 debian-di-install            fail   never pass
 test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
 test-armhf-armhf-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-xsm      13 saverestore-support-check    fail   never pass
 test-amd64-i386-libvirt-qcow2 11 migrate-support-check        fail  never pass
 test-armhf-armhf-libvirt-qcow2  9 debian-di-install            fail never pass
 test-armhf-armhf-xl-cubietruck 12 migrate-support-check        fail never pass
 test-amd64-i386-libvirt-xsm  12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt     12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-credit2  13 saverestore-support-check    fail   never pass
 test-amd64-i386-libvirt-raw  11 migrate-support-check        fail   never pass
 test-armhf-armhf-libvirt-raw  9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt     14 guest-saverestore            fail   never pass
 test-armhf-armhf-xl-cubietruck 13 saverestore-support-check    fail never pass
 test-amd64-i386-libvirt-vhd  11 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt      14 guest-saverestore            fail   never pass
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-armhf-armhf-xl          12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-vhd 11 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-xsm      12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-raw 11 migrate-support-check        fail   never pass
 test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop              fail never pass
 test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop              fail never pass
 test-amd64-i386-libvirt      12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl          13 saverestore-support-check    fail   never pass
 test-armhf-armhf-libvirt-xsm 14 guest-saverestore            fail   never pass
 test-amd64-amd64-xl-pvh-amd  11 guest-start                  fail   never pass
 test-armhf-armhf-xl-multivcpu 13 saverestore-support-check    fail  never pass
 test-armhf-armhf-xl-arndale  12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-qcow2 11 migrate-support-check        fail never pass
 test-armhf-armhf-xl-credit2  12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-xsm  14 guest-saverestore            fail   never pass
 test-armhf-armhf-xl-arndale  13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-multivcpu 12 migrate-support-check        fail  never pass
 test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
 test-amd64-amd64-xl-pvh-intel 14 guest-saverestore            fail  never pass
 test-armhf-armhf-xl-qcow2     9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt     12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-vhd       9 debian-di-install            fail   never pass

baseline version:
 flight               60666

jobs:
 build-amd64-xsm                                              pass    
 build-armhf-xsm                                              pass    
 build-i386-xsm                                               pass    
 build-amd64                                                  pass    
 build-armhf                                                  pass    
 build-i386                                                   pass    
 build-amd64-libvirt                                          pass    
 build-armhf-libvirt                                          pass    
 build-i386-libvirt                                           pass    
 build-amd64-pvops                                            pass    
 build-armhf-pvops                                            pass    
 build-i386-pvops                                             pass    
 build-amd64-rumpuserxen                                      pass    
 build-i386-rumpuserxen                                       pass    
 test-amd64-amd64-xl                                          pass    
 test-armhf-armhf-xl                                          pass    
 test-amd64-i386-xl                                           fail    
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm           pass    
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm            pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm        pass    
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm         fail    
 test-amd64-amd64-libvirt-xsm                                 pass    
 test-armhf-armhf-libvirt-xsm                                 fail    
 test-amd64-i386-libvirt-xsm                                  fail    
 test-amd64-amd64-xl-xsm                                      pass    
 test-armhf-armhf-xl-xsm                                      pass    
 test-amd64-i386-xl-xsm                                       fail    
 test-amd64-amd64-xl-pvh-amd                                  fail    
 test-amd64-i386-qemut-rhel6hvm-amd                           pass    
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass    
 test-amd64-i386-freebsd10-amd64                              pass    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         pass    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          pass    
 test-amd64-amd64-rumpuserxen-amd64                           pass    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-armhf-armhf-xl-arndale                                  pass    
 test-amd64-amd64-xl-credit2                                  pass    
 test-armhf-armhf-xl-credit2                                  pass    
 test-armhf-armhf-xl-cubietruck                               pass    
 test-amd64-i386-freebsd10-i386                               pass    
 test-amd64-i386-rumpuserxen-i386                             pass    
 test-amd64-amd64-xl-pvh-intel                                fail    
 test-amd64-i386-qemut-rhel6hvm-intel                         pass    
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
 test-amd64-amd64-libvirt                                     pass    
 test-armhf-armhf-libvirt                                     fail    
 test-amd64-i386-libvirt                                      fail    
 test-amd64-amd64-xl-multivcpu                                pass    
 test-armhf-armhf-xl-multivcpu                                pass    
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         fail    
 test-amd64-amd64-libvirt-pair                                fail    
 test-amd64-i386-libvirt-pair                                 fail    
 test-amd64-amd64-amd64-pvgrub                                pass    
 test-amd64-amd64-i386-pvgrub                                 pass    
 test-amd64-amd64-pygrub                                      pass    
 test-amd64-amd64-libvirt-qcow2                               pass    
 test-armhf-armhf-libvirt-qcow2                               fail    
 test-amd64-i386-libvirt-qcow2                                pass    
 test-amd64-amd64-xl-qcow2                                    pass    
 test-armhf-armhf-xl-qcow2                                    fail    
 test-amd64-i386-xl-qcow2                                     pass    
 test-amd64-amd64-libvirt-raw                                 pass    
 test-armhf-armhf-libvirt-raw                                 fail    
 test-amd64-i386-libvirt-raw                                  pass    
 test-amd64-amd64-xl-raw                                      pass    
 test-armhf-armhf-xl-raw                                      fail    
 test-amd64-i386-xl-raw                                       pass    
 test-amd64-amd64-xl-rtds                                     pass    
 test-armhf-armhf-xl-rtds                                     fail    
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     pass    
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     pass    
 test-amd64-amd64-libvirt-vhd                                 pass    
 test-armhf-armhf-libvirt-vhd                                 fail    
 test-amd64-i386-libvirt-vhd                                  pass    
 test-amd64-amd64-xl-vhd                                      pass    
 test-armhf-armhf-xl-vhd                                      fail    
 test-amd64-i386-xl-vhd                                       pass    
 test-amd64-amd64-xl-qemut-winxpsp3                           pass    
 test-amd64-i386-xl-qemut-winxpsp3                            pass    
 test-amd64-amd64-xl-qemuu-winxpsp3                           pass    
 test-amd64-i386-xl-qemuu-winxpsp3                            pass    


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary


[-- Attachment #3: 3.14:60666-vs-4.1:60785 --]
[-- Type: text/plain, Size: 11836 bytes --]

60785: regressions - FAIL

flight 60785 linux-4.1 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/60785/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 test-amd64-i386-pair   21 guest-migrate/src_host/dst_host fail REGR. vs. 60666
 test-amd64-i386-xl-xsm       14 guest-saverestore         fail REGR. vs. 60666
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail REGR. vs. 60666
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest-start/debianhvm.repeat fail REGR. vs. 60666
 test-amd64-i386-xl           14 guest-saverestore         fail REGR. vs. 60666

Regressions which are regarded as allowable (not blocking):
 test-armhf-armhf-xl-rtds     11 guest-start              fail blocked in 60666
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail blocked in 60666
 test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop             fail like 60666
 test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop             fail like 60666
 test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail like 60666

Tests which did not succeed, but are not blocking:
 test-armhf-armhf-xl-raw       9 debian-di-install            fail   never pass
 test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
 test-armhf-armhf-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-xsm      13 saverestore-support-check    fail   never pass
 test-amd64-i386-libvirt-qcow2 11 migrate-support-check        fail  never pass
 test-armhf-armhf-libvirt-qcow2  9 debian-di-install            fail never pass
 test-armhf-armhf-xl-cubietruck 12 migrate-support-check        fail never pass
 test-amd64-i386-libvirt-xsm  12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt     12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-credit2  13 saverestore-support-check    fail   never pass
 test-amd64-i386-libvirt-raw  11 migrate-support-check        fail   never pass
 test-armhf-armhf-libvirt-raw  9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt     14 guest-saverestore            fail   never pass
 test-armhf-armhf-xl-cubietruck 13 saverestore-support-check    fail never pass
 test-amd64-i386-libvirt-vhd  11 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt      14 guest-saverestore            fail   never pass
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-armhf-armhf-xl          12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-vhd 11 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-xsm      12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-raw 11 migrate-support-check        fail   never pass
 test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop              fail never pass
 test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop              fail never pass
 test-amd64-i386-libvirt      12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl          13 saverestore-support-check    fail   never pass
 test-armhf-armhf-libvirt-xsm 14 guest-saverestore            fail   never pass
 test-amd64-amd64-xl-pvh-amd  11 guest-start                  fail   never pass
 test-armhf-armhf-xl-multivcpu 13 saverestore-support-check    fail  never pass
 test-armhf-armhf-xl-arndale  12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-qcow2 11 migrate-support-check        fail never pass
 test-armhf-armhf-xl-credit2  12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-xsm  14 guest-saverestore            fail   never pass
 test-armhf-armhf-xl-arndale  13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-multivcpu 12 migrate-support-check        fail  never pass
 test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
 test-armhf-armhf-libvirt-vhd  9 debian-di-install            fail   never pass
 test-amd64-amd64-xl-pvh-intel 14 guest-saverestore            fail  never pass
 test-armhf-armhf-xl-qcow2     9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt     12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-vhd       9 debian-di-install            fail   never pass

baseline version:
 flight               60666

jobs:
 build-amd64-xsm                                              pass    
 build-armhf-xsm                                              pass    
 build-i386-xsm                                               pass    
 build-amd64                                                  pass    
 build-armhf                                                  pass    
 build-i386                                                   pass    
 build-amd64-libvirt                                          pass    
 build-armhf-libvirt                                          pass    
 build-i386-libvirt                                           pass    
 build-amd64-pvops                                            pass    
 build-armhf-pvops                                            pass    
 build-i386-pvops                                             pass    
 build-amd64-rumpuserxen                                      pass    
 build-i386-rumpuserxen                                       pass    
 test-amd64-amd64-xl                                          pass    
 test-armhf-armhf-xl                                          pass    
 test-amd64-i386-xl                                           fail    
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm           pass    
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm            fail    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm        fail    
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm         fail    
 test-amd64-amd64-libvirt-xsm                                 pass    
 test-armhf-armhf-libvirt-xsm                                 fail    
 test-amd64-i386-libvirt-xsm                                  fail    
 test-amd64-amd64-xl-xsm                                      pass    
 test-armhf-armhf-xl-xsm                                      pass    
 test-amd64-i386-xl-xsm                                       fail    
 test-amd64-amd64-xl-pvh-amd                                  fail    
 test-amd64-i386-qemut-rhel6hvm-amd                           pass    
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass    
 test-amd64-i386-freebsd10-amd64                              pass    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         pass    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          pass    
 test-amd64-amd64-rumpuserxen-amd64                           fail    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-armhf-armhf-xl-arndale                                  pass    
 test-amd64-amd64-xl-credit2                                  pass    
 test-armhf-armhf-xl-credit2                                  pass    
 test-armhf-armhf-xl-cubietruck                               pass    
 test-amd64-i386-freebsd10-i386                               pass    
 test-amd64-i386-rumpuserxen-i386                             pass    
 test-amd64-amd64-xl-pvh-intel                                fail    
 test-amd64-i386-qemut-rhel6hvm-intel                         pass    
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
 test-amd64-amd64-libvirt                                     pass    
 test-armhf-armhf-libvirt                                     fail    
 test-amd64-i386-libvirt                                      fail    
 test-amd64-amd64-xl-multivcpu                                pass    
 test-armhf-armhf-xl-multivcpu                                pass    
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         fail    
 test-amd64-amd64-libvirt-pair                                fail    
 test-amd64-i386-libvirt-pair                                 fail    
 test-amd64-amd64-amd64-pvgrub                                pass    
 test-amd64-amd64-i386-pvgrub                                 pass    
 test-amd64-amd64-pygrub                                      pass    
 test-amd64-amd64-libvirt-qcow2                               pass    
 test-armhf-armhf-libvirt-qcow2                               fail    
 test-amd64-i386-libvirt-qcow2                                pass    
 test-amd64-amd64-xl-qcow2                                    pass    
 test-armhf-armhf-xl-qcow2                                    fail    
 test-amd64-i386-xl-qcow2                                     pass    
 test-amd64-amd64-libvirt-raw                                 pass    
 test-armhf-armhf-libvirt-raw                                 fail    
 test-amd64-i386-libvirt-raw                                  pass    
 test-amd64-amd64-xl-raw                                      pass    
 test-armhf-armhf-xl-raw                                      fail    
 test-amd64-i386-xl-raw                                       pass    
 test-amd64-amd64-xl-rtds                                     pass    
 test-armhf-armhf-xl-rtds                                     fail    
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     pass    
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     pass    
 test-amd64-amd64-libvirt-vhd                                 pass    
 test-armhf-armhf-libvirt-vhd                                 fail    
 test-amd64-i386-libvirt-vhd                                  pass    
 test-amd64-amd64-xl-vhd                                      pass    
 test-armhf-armhf-xl-vhd                                      fail    
 test-amd64-i386-xl-vhd                                       pass    
 test-amd64-amd64-xl-qemut-winxpsp3                           pass    
 test-amd64-i386-xl-qemut-winxpsp3                            pass    
 test-amd64-amd64-xl-qemuu-winxpsp3                           pass    
 test-amd64-i386-xl-qemuu-winxpsp3                            pass    


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary


[-- Attachment #4: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: Analysis: switch osstest default kernel from 3.14 to 4.1 (Was: Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED)

[Ian Campbell]

[-- Attachment #1: Type: text/plain, Size: 3128 bytes --]

TL;DR: There are issues, but IMHO switching can be justified.

On Thu, 2015-09-03 at 09:59 +0100, Ian Campbell wrote:
> TL;DR: There are issues which need fixing first...
> 
> On Fri, 2015-08-21 at 17:24 +0000, osstest service owner wrote:
> > flight 60785 linux-4.1 real [real]
> > http://logs.test-lab.xenproject.org/osstest/logs/60785/
> > 
> > Failures :-/ but no regressions.
> > 
> > Tests which are failing intermittently (not blocking):
> >  test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 19 guest
> > -start/debianhvm.repeat fail in 60746 pass in 60785
> >  test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest
> > -start/debianhvm.repeat fail pass in 60746
> >  test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest
> > -localmigrate fail pass in 60746
> 
> I've been considering updating osstest to switch from the current baseline
> kernel (the one used for all non linux-* tests) from 3.14 to 4.1.
> 
> The last pass on 3.14 was 60666[0] a little while ago on 13/8 (due to a
> known issue[1]). As well as this pass of 4.1 today I therefore also
> considered 60654[2] on 12/8. Two reports (like this one) are attached
> comparing 3.16:60666 against 4.1:60654 and 4.1:60795 respectively.

Some time has passed and the issues with migration v2 are now fixed.


The most recent pass of 3.14 is (still, sigh) 60666[0].

The most recent fail was 62085[1] which suffers from the same known issue
WRT gntdev (which breaks qdisk based tests for qcow2 and vhd)

The latest 4.1 pass was 62053[2] from Friday.

Attached are two reports of 4.1:62053 vs 3.14:60666 and 3.14:62085.

The failures are:

vs. 60666 only:

 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail REGR. vs. 60666

vs. 60666 and 62085:

 test-amd64-amd64-xl-qemuu-ovmf-amd64 19 guest-start/debianhvm.repeat fail REGR. vs. 60666

For the first considering the history:
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/linux-4.1.html

It seems pretty obvious that this is host specific, and in fact 60666
failed, just as guest-localmigrate.2 not guest-localmigrate like 62053 did.

For the second the history:
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemuu-ovmf-amd64/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemuu-ovmf-amd64/linux-4.1.html

Suggests the issue is pretty intermittent. FWIW the push associated with
62085 justified this failure using 61947[3] where it passed with the exact
same kernel version.

So, I think it could be justified to switch our default kernel version to
linux-4.1. Probably after 4.6 is released though.

Ian.

[0] http://lists.xen.org/archives/html/xen-devel/2015-09/msg00304.html
[1] http://lists.xen.org/archives/html/xen-devel/2015-09/msg02441.html
[2] http://lists.xen.org/archives/html/xen-devel/2015-09/msg02364.html
[3] http://lists.xen.org/archives/html/xen-devel/2015-09/msg01921.html

[-- Attachment #2: 3.14:60666-vs-4.1:62053 --]
[-- Type: text/plain, Size: 11320 bytes --]

62053: regressions - FAIL

flight 62053 linux-4.1 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/62053/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail REGR. vs. 60666
 test-amd64-amd64-xl-qemuu-ovmf-amd64 19 guest-start/debianhvm.repeat fail REGR. vs. 60666

Regressions which are regarded as allowable (not blocking):
 test-armhf-armhf-xl-rtds     11 guest-start              fail blocked in 60666
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail blocked in 60666
 test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop             fail like 60666
 test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop             fail like 60666

Tests which did not succeed, but are not blocking:
 test-amd64-amd64-xl-pvh-intel 14 guest-saverestore            fail  never pass
 test-armhf-armhf-xl-qcow2     9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt-qcow2  9 debian-di-install            fail never pass
 test-armhf-armhf-xl-vhd       9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt-vhd  9 debian-di-install            fail   never pass
 test-armhf-armhf-xl-raw       9 debian-di-install            fail   never pass
 test-amd64-amd64-xl-pvh-amd  11 guest-start                  fail   never pass
 test-armhf-armhf-libvirt-raw  9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-armhf-armhf-libvirt-xsm 14 guest-saverestore            fail   never pass
 test-amd64-amd64-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
 test-amd64-amd64-libvirt     12 migrate-support-check        fail   never pass
 test-armhf-armhf-libvirt     14 guest-saverestore            fail   never pass
 test-armhf-armhf-libvirt     12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-xsm  12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt      12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
 test-armhf-armhf-xl-xsm      13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-xsm      12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-arndale  12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-arndale  13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl          12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl          13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-multivcpu 13 saverestore-support-check    fail  never pass
 test-armhf-armhf-xl-multivcpu 12 migrate-support-check        fail  never pass
 test-amd64-amd64-libvirt-qcow2 11 migrate-support-check        fail never pass
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-amd64-amd64-libvirt-raw 11 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-vhd  11 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-vhd 11 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-raw  11 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-credit2  13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-credit2  12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-cubietruck 12 migrate-support-check        fail never pass
 test-armhf-armhf-xl-cubietruck 13 saverestore-support-check    fail never pass
 test-amd64-i386-libvirt-qcow2 11 migrate-support-check        fail  never pass
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop              fail never pass
 test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop              fail never pass

baseline version:
 flight               60666

jobs:
 build-amd64-xsm                                              pass    
 build-armhf-xsm                                              pass    
 build-i386-xsm                                               pass    
 build-amd64                                                  pass    
 build-armhf                                                  pass    
 build-i386                                                   pass    
 build-amd64-libvirt                                          pass    
 build-armhf-libvirt                                          pass    
 build-i386-libvirt                                           pass    
 build-amd64-pvops                                            pass    
 build-armhf-pvops                                            pass    
 build-i386-pvops                                             pass    
 build-amd64-rumpuserxen                                      pass    
 build-i386-rumpuserxen                                       pass    
 test-amd64-amd64-xl                                          pass    
 test-armhf-armhf-xl                                          pass    
 test-amd64-i386-xl                                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm           pass    
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm            pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm        fail    
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm         fail    
 test-amd64-amd64-libvirt-xsm                                 pass    
 test-armhf-armhf-libvirt-xsm                                 fail    
 test-amd64-i386-libvirt-xsm                                  pass    
 test-amd64-amd64-xl-xsm                                      pass    
 test-armhf-armhf-xl-xsm                                      pass    
 test-amd64-i386-xl-xsm                                       pass    
 test-amd64-amd64-xl-pvh-amd                                  fail    
 test-amd64-i386-qemut-rhel6hvm-amd                           pass    
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass    
 test-amd64-i386-freebsd10-amd64                              pass    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         fail    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          pass    
 test-amd64-amd64-rumpuserxen-amd64                           pass    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-armhf-armhf-xl-arndale                                  pass    
 test-amd64-amd64-xl-credit2                                  pass    
 test-armhf-armhf-xl-credit2                                  pass    
 test-armhf-armhf-xl-cubietruck                               pass    
 test-amd64-i386-freebsd10-i386                               pass    
 test-amd64-i386-rumpuserxen-i386                             pass    
 test-amd64-amd64-xl-pvh-intel                                fail    
 test-amd64-i386-qemut-rhel6hvm-intel                         pass    
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
 test-amd64-amd64-libvirt                                     pass    
 test-armhf-armhf-libvirt                                     fail    
 test-amd64-i386-libvirt                                      pass    
 test-amd64-amd64-xl-multivcpu                                pass    
 test-armhf-armhf-xl-multivcpu                                pass    
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         pass    
 test-amd64-amd64-libvirt-pair                                fail    
 test-amd64-i386-libvirt-pair                                 fail    
 test-amd64-amd64-amd64-pvgrub                                pass    
 test-amd64-amd64-i386-pvgrub                                 pass    
 test-amd64-amd64-pygrub                                      pass    
 test-amd64-amd64-libvirt-qcow2                               pass    
 test-armhf-armhf-libvirt-qcow2                               fail    
 test-amd64-i386-libvirt-qcow2                                pass    
 test-amd64-amd64-xl-qcow2                                    pass    
 test-armhf-armhf-xl-qcow2                                    fail    
 test-amd64-i386-xl-qcow2                                     pass    
 test-amd64-amd64-libvirt-raw                                 pass    
 test-armhf-armhf-libvirt-raw                                 fail    
 test-amd64-i386-libvirt-raw                                  pass    
 test-amd64-amd64-xl-raw                                      pass    
 test-armhf-armhf-xl-raw                                      fail    
 test-amd64-i386-xl-raw                                       pass    
 test-amd64-amd64-xl-rtds                                     pass    
 test-armhf-armhf-xl-rtds                                     fail    
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     pass    
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     pass    
 test-amd64-amd64-libvirt-vhd                                 pass    
 test-armhf-armhf-libvirt-vhd                                 fail    
 test-amd64-i386-libvirt-vhd                                  pass    
 test-amd64-amd64-xl-vhd                                      pass    
 test-armhf-armhf-xl-vhd                                      fail    
 test-amd64-i386-xl-vhd                                       pass    
 test-amd64-amd64-xl-qemut-winxpsp3                           pass    
 test-amd64-i386-xl-qemut-winxpsp3                            pass    
 test-amd64-amd64-xl-qemuu-winxpsp3                           pass    
 test-amd64-i386-xl-qemuu-winxpsp3                            pass    


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary


[-- Attachment #3: 3.14:62085-vs-4.1:62053 --]
[-- Type: text/plain, Size: 11315 bytes --]

62053: regressions - FAIL

flight 62053 linux-4.1 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/62053/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 test-amd64-amd64-xl-qemuu-ovmf-amd64 19 guest-start/debianhvm.repeat fail REGR. vs. 62085

Regressions which are regarded as allowable (not blocking):
 test-armhf-armhf-xl-rtds     11 guest-start              fail blocked in 62085
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail blocked in 62085
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail like 62085
 test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop             fail like 62085
 test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop             fail like 62085

Tests which did not succeed, but are not blocking:
 test-amd64-amd64-xl-pvh-intel 14 guest-saverestore            fail  never pass
 test-armhf-armhf-xl-qcow2     9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt-qcow2  9 debian-di-install            fail never pass
 test-armhf-armhf-xl-vhd       9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt-vhd  9 debian-di-install            fail   never pass
 test-armhf-armhf-xl-raw       9 debian-di-install            fail   never pass
 test-amd64-amd64-xl-pvh-amd  11 guest-start                  fail   never pass
 test-armhf-armhf-libvirt-raw  9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-armhf-armhf-libvirt-xsm 14 guest-saverestore            fail   never pass
 test-amd64-amd64-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
 test-amd64-amd64-libvirt     12 migrate-support-check        fail   never pass
 test-armhf-armhf-libvirt     14 guest-saverestore            fail   never pass
 test-armhf-armhf-libvirt     12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-xsm  12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt      12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
 test-armhf-armhf-xl-xsm      13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-xsm      12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-arndale  12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-arndale  13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl          12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl          13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-multivcpu 13 saverestore-support-check    fail  never pass
 test-armhf-armhf-xl-multivcpu 12 migrate-support-check        fail  never pass
 test-amd64-amd64-libvirt-qcow2 11 migrate-support-check        fail never pass
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-amd64-amd64-libvirt-raw 11 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-vhd  11 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-vhd 11 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-raw  11 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-credit2  13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-credit2  12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-cubietruck 12 migrate-support-check        fail never pass
 test-armhf-armhf-xl-cubietruck 13 saverestore-support-check    fail never pass
 test-amd64-i386-libvirt-qcow2 11 migrate-support-check        fail  never pass
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop              fail never pass
 test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop              fail never pass

baseline version:
 flight               62085

jobs:
 build-amd64-xsm                                              pass    
 build-armhf-xsm                                              pass    
 build-i386-xsm                                               pass    
 build-amd64                                                  pass    
 build-armhf                                                  pass    
 build-i386                                                   pass    
 build-amd64-libvirt                                          pass    
 build-armhf-libvirt                                          pass    
 build-i386-libvirt                                           pass    
 build-amd64-pvops                                            pass    
 build-armhf-pvops                                            pass    
 build-i386-pvops                                             pass    
 build-amd64-rumpuserxen                                      pass    
 build-i386-rumpuserxen                                       pass    
 test-amd64-amd64-xl                                          pass    
 test-armhf-armhf-xl                                          pass    
 test-amd64-i386-xl                                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm           pass    
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm            pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm        fail    
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm         fail    
 test-amd64-amd64-libvirt-xsm                                 pass    
 test-armhf-armhf-libvirt-xsm                                 fail    
 test-amd64-i386-libvirt-xsm                                  pass    
 test-amd64-amd64-xl-xsm                                      pass    
 test-armhf-armhf-xl-xsm                                      pass    
 test-amd64-i386-xl-xsm                                       pass    
 test-amd64-amd64-xl-pvh-amd                                  fail    
 test-amd64-i386-qemut-rhel6hvm-amd                           pass    
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass    
 test-amd64-i386-freebsd10-amd64                              pass    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         fail    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          pass    
 test-amd64-amd64-rumpuserxen-amd64                           pass    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-armhf-armhf-xl-arndale                                  pass    
 test-amd64-amd64-xl-credit2                                  pass    
 test-armhf-armhf-xl-credit2                                  pass    
 test-armhf-armhf-xl-cubietruck                               pass    
 test-amd64-i386-freebsd10-i386                               pass    
 test-amd64-i386-rumpuserxen-i386                             pass    
 test-amd64-amd64-xl-pvh-intel                                fail    
 test-amd64-i386-qemut-rhel6hvm-intel                         pass    
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
 test-amd64-amd64-libvirt                                     pass    
 test-armhf-armhf-libvirt                                     fail    
 test-amd64-i386-libvirt                                      pass    
 test-amd64-amd64-xl-multivcpu                                pass    
 test-armhf-armhf-xl-multivcpu                                pass    
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         pass    
 test-amd64-amd64-libvirt-pair                                fail    
 test-amd64-i386-libvirt-pair                                 fail    
 test-amd64-amd64-amd64-pvgrub                                pass    
 test-amd64-amd64-i386-pvgrub                                 pass    
 test-amd64-amd64-pygrub                                      pass    
 test-amd64-amd64-libvirt-qcow2                               pass    
 test-armhf-armhf-libvirt-qcow2                               fail    
 test-amd64-i386-libvirt-qcow2                                pass    
 test-amd64-amd64-xl-qcow2                                    pass    
 test-armhf-armhf-xl-qcow2                                    fail    
 test-amd64-i386-xl-qcow2                                     pass    
 test-amd64-amd64-libvirt-raw                                 pass    
 test-armhf-armhf-libvirt-raw                                 fail    
 test-amd64-i386-libvirt-raw                                  pass    
 test-amd64-amd64-xl-raw                                      pass    
 test-armhf-armhf-xl-raw                                      fail    
 test-amd64-i386-xl-raw                                       pass    
 test-amd64-amd64-xl-rtds                                     pass    
 test-armhf-armhf-xl-rtds                                     fail    
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     pass    
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     pass    
 test-amd64-amd64-libvirt-vhd                                 pass    
 test-armhf-armhf-libvirt-vhd                                 fail    
 test-amd64-i386-libvirt-vhd                                  pass    
 test-amd64-amd64-xl-vhd                                      pass    
 test-armhf-armhf-xl-vhd                                      fail    
 test-amd64-i386-xl-vhd                                       pass    
 test-amd64-amd64-xl-qemut-winxpsp3                           pass    
 test-amd64-i386-xl-qemut-winxpsp3                            pass    
 test-amd64-amd64-xl-qemuu-winxpsp3                           pass    
 test-amd64-i386-xl-qemuu-winxpsp3                            pass    


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary


[-- Attachment #4: Type: text/plain, Size: 126 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

Re: Analysis: switch osstest default kernel from 3.14 to 4.1 (Was: Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED)

[Ian Campbell]

On Mon, 2015-09-21 at 13:47 +0100, Ian Campbell wrote:
> TL;DR: There are issues, but IMHO switching can be justified.

Since some time has passed here is a fresh comparison of linux-3.14 flight
64435 (latest flight which would have passed except it incorrectly tried to
build an armhf kernel) vs linux-4.1 flight 63996 (latest) pass.

Only regression is "test-amd64-amd64-rumpuserxen-amd64" which fails
occasionally on both kernel versions
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-rumpuserxen-amd64/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-rumpuserxen-amd64/linux-4.1.html
and is down to a long standing heisenbug.

So a push would still be justified IMHO. I've just noticed that I don't
seem to have posted the patch. I'll follow up with it.

Ian.

$ ./sg-report-flight --that-flight=64435 63996
63996: regressions - FAIL

flight 63996 linux-4.1 real [real]
http://osstest.test-lab.xenproject.org/~osstest/pub/logs/63996/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 64435

Regressions which are regarded as allowable (not blocking):
 test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop             fail like 64435
 test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop             fail like 64435

Tests which did not succeed, but are not blocking:
 test-amd64-amd64-xl-pvh-amd  11 guest-start                  fail   never pass
 test-amd64-amd64-xl-pvh-intel 14 guest-saverestore            fail  never pass
 test-armhf-armhf-xl-vhd       9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt-qcow2  9 debian-di-install            fail never pass
 test-armhf-armhf-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-armhf-armhf-libvirt-xsm 14 guest-saverestore            fail   never pass
 test-armhf-armhf-libvirt-raw  9 debian-di-install            fail   never pass
 test-armhf-armhf-libvirt     14 guest-saverestore            fail   never pass
 test-armhf-armhf-libvirt     12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt      12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-arndale  12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-arndale  13 saverestore-support-check    fail   never pass
 test-amd64-amd64-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt     12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-rtds     13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-rtds     12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-rtds     16 guest-start/debian.repeat    fail   never pass
 test-armhf-armhf-xl          12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl          13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-multivcpu 13 saverestore-support-check    fail  never pass
 test-armhf-armhf-xl-multivcpu 12 migrate-support-check        fail  never pass
 test-armhf-armhf-xl-credit2  13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-credit2  12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-xsm  12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-cubietruck 12 migrate-support-check        fail never pass
 test-armhf-armhf-xl-cubietruck 13 saverestore-support-check    fail never pass
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-amd64-amd64-libvirt-vhd 11 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-armhf-armhf-xl-xsm      13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-xsm      12 migrate-support-check        fail   never pass
 test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop              fail never pass
 test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop              fail never pass

baseline version:
 flight               64435

jobs:
 build-amd64-xsm                                              pass    
 build-armhf-xsm                                              pass    
 build-i386-xsm                                               pass    
 build-amd64                                                  pass    
 build-armhf                                                  pass    
 build-i386                                                   pass    
 build-amd64-libvirt                                          pass    
 build-armhf-libvirt                                          pass    
 build-i386-libvirt                                           pass    
 build-amd64-pvops                                            pass    
 build-armhf-pvops                                            pass    
 build-i386-pvops                                             pass    
 build-amd64-rumpuserxen                                      pass    
 build-i386-rumpuserxen                                       pass    
 test-amd64-amd64-xl                                          pass    
 test-armhf-armhf-xl                                          pass    
 test-amd64-i386-xl                                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm           pass    
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm            pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm        pass    
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm         pass    
 test-amd64-amd64-libvirt-xsm                                 pass    
 test-armhf-armhf-libvirt-xsm                                 fail    
 test-amd64-i386-libvirt-xsm                                  pass    
 test-amd64-amd64-xl-xsm                                      pass    
 test-armhf-armhf-xl-xsm                                      pass    
 test-amd64-i386-xl-xsm                                       pass    
 test-amd64-amd64-xl-pvh-amd                                  fail    
 test-amd64-i386-qemut-rhel6hvm-amd                           pass    
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass    
 test-amd64-i386-freebsd10-amd64                              pass    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         pass    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          pass    
 test-amd64-amd64-rumpuserxen-amd64                           fail    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-armhf-armhf-xl-arndale                                  pass    
 test-amd64-amd64-xl-credit2                                  pass    
 test-armhf-armhf-xl-credit2                                  pass    
 test-armhf-armhf-xl-cubietruck                               pass    
 test-amd64-i386-freebsd10-i386                               pass    
 test-amd64-i386-rumpuserxen-i386                             pass    
 test-amd64-amd64-xl-pvh-intel                                fail    
 test-amd64-i386-qemut-rhel6hvm-intel                         pass    
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
 test-amd64-amd64-libvirt                                     pass    
 test-armhf-armhf-libvirt                                     fail    
 test-amd64-i386-libvirt                                      pass    
 test-amd64-amd64-xl-multivcpu                                pass    
 test-armhf-armhf-xl-multivcpu                                pass    
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         pass    
 test-amd64-amd64-libvirt-pair                                pass    
 test-amd64-i386-libvirt-pair                                 pass    
 test-amd64-amd64-amd64-pvgrub                                pass    
 test-amd64-amd64-i386-pvgrub                                 pass    
 test-amd64-amd64-pygrub                                      pass    
 test-armhf-armhf-libvirt-qcow2                               fail    
 test-amd64-amd64-xl-qcow2                                    pass    
 test-armhf-armhf-libvirt-raw                                 fail    
 test-amd64-i386-xl-raw                                       pass    
 test-amd64-amd64-xl-rtds                                     pass    
 test-armhf-armhf-xl-rtds                                     fail    
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     pass    
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     pass    
 test-amd64-amd64-libvirt-vhd                                 pass    
 test-armhf-armhf-xl-vhd                                      fail    
 test-amd64-amd64-xl-qemut-winxpsp3                           pass    
 test-amd64-i386-xl-qemut-winxpsp3                            pass    
 test-amd64-amd64-xl-qemuu-winxpsp3                           pass    
 test-amd64-i386-xl-qemuu-winxpsp3                            pass    


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

[PATCH OSSTEST] ap-common: Switch default Linux branch to linux-4.1.

[Ian Campbell]

Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
---
 ap-common | 8 ++++++--
 1 file changed, 6 insertions(+), 2 deletions(-)

diff --git a/ap-common b/ap-common
index 19c7580..5e7a791 100644
--- a/ap-common
+++ b/ap-common
@@ -61,8 +61,12 @@
 
 : ${PUSH_TREE_LINUX:=$XENBITS:/home/xen/git/linux-pvops.git}
 : ${BASE_TREE_LINUX:=git://xenbits.xen.org/linux-pvops.git}
-: ${BASE_TAG_LINUX:=tested/linux-3.14}
-: ${BASE_TAG_LINUX_ARM:=tested/linux-arm-xen}
+
+# This defines the default Linux kernel to use for all !linux-* tests
+: ${BASE_TAG_LINUX:=tested/linux-4.1}
+# ARM runs can use their own default
+#: ${BASE_TAG_LINUX_ARM:=tested/linux-arm-xen}
+: ${BASE_TAG_LINUX_ARM:=${BASE_TAG_LINUX}}
 
 if [ "x${TREE_LINUX}" = x ]; then
 	: ${TREE_LINUX:=${BASE_TREE_LINUX}}
-- 
2.6.1

Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED

[Ian Campbell]

On Fri, 2015-08-21 at 17:24 +0000, osstest service owner wrote:
> flight 60785 linux-4.1 real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/60785/
> 
> Failures :-/ but no regressions.
> 
> Tests which are failing intermittently (not blocking):
>  test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 19 guest-start/debianhvm.repeat fail in 60746 pass in 60785
>  test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest-start/debianhvm.repeat fail pass in 60746
>  test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail pass in 60746
> 
> Regressions which are regarded as allowable (not blocking):
>  test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 60654
>  test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail blocked in 60654
>  test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail in 60746 like 60654

>  test-amd64-i386-xl-xsm       14 guest-saverestore            fail   like 60654
>  test-amd64-i386-xl           14 guest-saverestore            fail   like 60654
>  test-amd64-i386-pair        21 guest-migrate/src_host/dst_host fail like 60654

As noted in 
http://lists.xen.org/archives/html/xen-devel/2015-09/msg00306.html these
three are regressions vs. 3.14 which the bisector has fingered with being
3a9ace0147d4 "tools/libxc+libxl+xl: Restore v2
streams".

linux-linux is also failing in what looks like the same manner.

We perhaps ought to consider whether we think "migration broken with newer
kernels" should be a blocker for 4.6.

The bisector was working on the linux-4.1, so ended up fingering the Xen
change which exposed the bug, since it didn't consider older kernels. I'm
going to see if I can engineer some adhoc runs which will cause the
bisector to instead try and find a commit between 3.18 and 4.1 which was
tickled by the Xen change, since I suspect that will be the actual
underlying buggy thing. If any one has any intuition on where to start
looking that might help speed things along...

Also, the fact these are "fail like NNNN" is a bit odd since the history[0]
shows this used to pass, hence a bad thing got pushed at some point.

59811 and 59837 correctly has them as "fail REGR. vs. 59393", 

59909 considered one of the three "fail like 59936-bisect" and the others
as "fail REGR. vs. 59393".

Then 59960 has two as "fail like NNNNNN-bisect" and one as "fail REGR. vs.
59393".

60030 is the "bad" push which uses "fail like NNNNNN-bisect" to justify
ignoring all three.

IIRC there was a bug in the osstest machinery (now fixed by Ian) which lead
to this, but I mention it in case I'm recalling incorrectly.

Ian.

[0] http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64
-i386-pair/linux-4.1.html

Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED

[Jan Beulich]

>>> On 03.09.15 at 11:47, <ian.campbell@citrix.com> wrote:
> We perhaps ought to consider whether we think "migration broken with newer
> kernels" should be a blocker for 4.6.

I think we should, at least up until we're certain it's in fact a problem
in a Linux commit that simply got exposed by the tools side change.

Jan

Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED

[Ian Jackson]

Ian Campbell writes ("Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED"):
> 60030 is the "bad" push which uses "fail like NNNNNN-bisect" to justify
> ignoring all three.

For example, you mean the line in 60030's report saying

  test-amd64-i386-xl   13 guest-saverestore   fail like 60094-bisect

Well, 60094's report is contained within

  Date: Tue, 28 Jul 2015 21:44:28 GMT
  Subject: "[linux-4.1 bisection] complete test-amd64-i386-xl

and says

  test-amd64-i386-xl   13 guest-saverestore   fail baseline untested

There was no build job in 60094; for Linux (build-i386-pvops) it used
59826 (ie 5cf9896d) and for Xen (build-i386) 59934 (xen.git#3a9ace01).

> IIRC there was a bug in the osstest machinery (now fixed by Ian) which lead
> to this, but I mention it in case I'm recalling incorrectly.

I think that actually this is another problem: sg-report-flight when
testing X' (with a baseline of X) can justify a failure of T(X',Y,Z)
with a bisection failure of T(X,Y'',Z).

If Y'' breaks T then this makes it look to sg-report-flight like T was
already broken in X.

The simple solution is for sg-report-flight for cr-daily-branch to to
look at bisections.

The more complicated one would be for sg-report-flight to compare
versions of Y when looking for justifications, but I'm not sure this
is desirable because it would reset the justification search each time
any other tree changed.

Ian.

[OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable

[Ian Jackson]

And rewrap check_tested.

No functional change.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
 cr-daily-branch |    6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/cr-daily-branch b/cr-daily-branch
index 7402d3f..e90919d 100755
--- a/cr-daily-branch
+++ b/cr-daily-branch
@@ -75,14 +75,14 @@ case $branch in
 	treeurl=`./ap-print-url $branch`;;
 esac
 
+blessings_arg=--blessings=${DAILY_BRANCH_TESTED_BLESSING:-$OSSTEST_BLESSING}
+
 force_baseline=false
 skipidentical=true
 wantpush=$OSSTEST_PUSH
 
 check_tested () {
-	./sg-check-tested --debug --branch=$branch \
-	  --blessings=${DAILY_BRANCH_TESTED_BLESSING:-$OSSTEST_BLESSING} \
-	  "$@"
+	./sg-check-tested --debug --branch=$branch $blessings_arg "$@"
 }
 
 if [ "x$OLD_REVISION" = x ]; then
-- 
1.7.10.4

[OSSTEST PATCH 2/2] cr-daily-branch: Make sg-report-flight ignore bisections

[Ian Jackson]

sg-report-flight when testing X' (with a baseline of X) can justify a
failure of T(X',Y,Z) with a bisection failure of T(X,Y'',Z).

If Y'' breaks T then this makes it look to sg-report-flight like T was
already broken in X; cr-daily-branch could then push X' even though it
is actually broken.

This happened rarely, because cr-daily-branch's sg-report-flight would
only look at flights on the right branch, so only a bisection of T on
that branch can cause this, but nevertheless this can produce bad
pushes.

So: have cr-daily-branch pass a --blessings option to cr-daily-branch,
so that it only looks at (usually) `real' rather than the default of
`real' and also `real-bisect'.

An alternative, more complicated, approach would be for
sg-report-flight to compare versions of Y, Z, et al, when looking for
justifications, but I'm not sure this is desirable because it would
effectively reset the heisenbug compensator each time any other tree
changed.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
 cr-daily-branch |    1 +
 1 file changed, 1 insertion(+)

diff --git a/cr-daily-branch b/cr-daily-branch
index e90919d..e4c5532 100755
--- a/cr-daily-branch
+++ b/cr-daily-branch
@@ -76,6 +76,7 @@ case $branch in
 esac
 
 blessings_arg=--blessings=${DAILY_BRANCH_TESTED_BLESSING:-$OSSTEST_BLESSING}
+sgr_args+=" $blessings_arg"
 
 force_baseline=false
 skipidentical=true
-- 
1.7.10.4

Re: [OSSTEST PATCH 2/2] cr-daily-branch: Make sg-report-flight ignore bisections

[Ian Campbell]

On Thu, 2015-09-03 at 11:45 +0100, Ian Jackson wrote:
> sg-report-flight when testing X' (with a baseline of X) can justify a
> failure of T(X',Y,Z) with a bisection failure of T(X,Y'',Z).
> 
> If Y'' breaks T then this makes it look to sg-report-flight like T was
> already broken in X; cr-daily-branch could then push X' even though it
> is actually broken.
> 
> This happened rarely, because cr-daily-branch's sg-report-flight would
> only look at flights on the right branch, so only a bisection of T on
> that branch can cause this, but nevertheless this can produce bad
> pushes.
> 
> So: have cr-daily-branch pass a --blessings option to cr-daily-branch,
> so that it only looks at (usually) `real' rather than the default of
> `real' and also `real-bisect'.
> 
> An alternative, more complicated, approach would be for
> sg-report-flight to compare versions of Y, Z, et al, when looking for
> justifications, but I'm not sure this is desirable because it would
> effectively reset the heisenbug compensator each time any other tree
> changed.
> 
> Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>

Acked-by: Ian Campbell <ian.campbell@citrix.com>

Re: [OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable

[Ian Campbell]

On Thu, 2015-09-03 at 11:45 +0100, Ian Jackson wrote:
> And rewrap check_tested.
> 
> No functional change.
> 
> Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>

Acked-by: Ian Campbell <ian.campbell@citrix.com>

> ---
>  cr-daily-branch |    6 +++---
>  1 file changed, 3 insertions(+), 3 deletions(-)
> 
> diff --git a/cr-daily-branch b/cr-daily-branch
> index 7402d3f..e90919d 100755
> --- a/cr-daily-branch
> +++ b/cr-daily-branch
> @@ -75,14 +75,14 @@ case $branch in
>  	treeurl=`./ap-print-url $branch`;;
>  esac
>  
> +blessings_arg=--blessings=${DAILY_BRANCH_TESTED_BLESSING:
> -$OSSTEST_BLESSING}
> +
>  force_baseline=false
>  skipidentical=true
>  wantpush=$OSSTEST_PUSH
>  
>  check_tested () {
> -	./sg-check-tested --debug --branch=$branch \
> -	  --blessings=${DAILY_BRANCH_TESTED_BLESSING:-$OSSTEST_BLESSING} 
> \
> -	  "$@"
> +	./sg-check-tested --debug --branch=$branch $blessings_arg "$@"
>  }
>  
>  if [ "x$OLD_REVISION" = x ]; then