xen-devel.lists.xenproject.org archive mirror
 help / color / mirror / Atom feed
* [xen-unstable test] 31315: regressions - FAIL
@ 2014-11-02 17:43 xen.org
  2014-11-03 10:16 ` Jan Beulich
  0 siblings, 1 reply; 7+ messages in thread
From: xen.org @ 2014-11-02 17:43 UTC (permalink / raw)
  To: xen-devel; +Cc: ian.jackson

flight 31315 xen-unstable real [real]
http://www.chiark.greenend.org.uk/~xensrcts/logs/31315/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 test-amd64-amd64-pair         8 xen-boot/dst_host         fail REGR. vs. 31285

Regressions which are regarded as allowable (not blocking):
 test-armhf-armhf-xl           9 guest-start                  fail   like 31285
 test-amd64-amd64-xl-sedf      5 xen-boot                  fail REGR. vs. 31285
 test-amd64-i386-pair        17 guest-migrate/src_host/dst_host fail like 31285

Tests which did not succeed, but are not blocking:
 test-amd64-i386-libvirt       9 guest-start                  fail   never pass
 test-armhf-armhf-libvirt      9 guest-start                  fail   never pass
 test-amd64-amd64-xl-pcipt-intel  9 guest-start                 fail never pass
 test-amd64-amd64-libvirt      9 guest-start                  fail   never pass
 test-amd64-i386-xl-qemut-winxpsp3 14 guest-stop                fail never pass
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 14 guest-stop         fail never pass
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1 14 guest-stop         fail never pass
 test-amd64-i386-xl-qemuu-winxpsp3 14 guest-stop                fail never pass
 test-amd64-i386-xl-qemuu-win7-amd64 14 guest-stop              fail never pass
 test-amd64-i386-xl-winxpsp3-vcpus1 14 guest-stop               fail never pass
 test-amd64-amd64-xl-qemuu-win7-amd64 14 guest-stop             fail never pass
 test-amd64-amd64-xl-qemut-win7-amd64 14 guest-stop             fail never pass
 test-amd64-i386-xl-winxpsp3  14 guest-stop                   fail   never pass
 test-amd64-amd64-xl-win7-amd64 14 guest-stop                   fail never pass
 test-amd64-amd64-xl-winxpsp3 14 guest-stop                   fail   never pass
 test-amd64-amd64-xl-qemut-winxpsp3 14 guest-stop               fail never pass
 test-amd64-i386-xl-win7-amd64 14 guest-stop                   fail  never pass
 test-amd64-i386-xl-qemut-win7-amd64 14 guest-stop              fail never pass
 test-amd64-amd64-xl-qemuu-winxpsp3 14 guest-stop               fail never pass

version targeted for testing:
 xen                  5283b310e14884341f51be35253cdd59c4cb034c
baseline version:
 xen                  0f2bde078ace619fe8e26730495b6ef2c3a2e9bf

------------------------------------------------------------
People who touched revisions under test:
  Andrew Cooper <andrew.cooper3@citrix.com>
  Jan Beulich <jbeulich@suse.com>
  Kevin Tian <kevin.tian@intel.com>
------------------------------------------------------------

jobs:
 build-amd64                                                  pass    
 build-armhf                                                  pass    
 build-i386                                                   pass    
 build-amd64-libvirt                                          pass    
 build-armhf-libvirt                                          pass    
 build-i386-libvirt                                           pass    
 build-amd64-oldkern                                          pass    
 build-i386-oldkern                                           pass    
 build-amd64-pvops                                            pass    
 build-armhf-pvops                                            pass    
 build-i386-pvops                                             pass    
 build-amd64-rumpuserxen                                      pass    
 build-i386-rumpuserxen                                       pass    
 test-amd64-amd64-xl                                          pass    
 test-armhf-armhf-xl                                          fail    
 test-amd64-i386-xl                                           pass    
 test-amd64-i386-rhel6hvm-amd                                 pass    
 test-amd64-i386-qemut-rhel6hvm-amd                           pass    
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass    
 test-amd64-i386-freebsd10-amd64                              pass    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         pass    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          pass    
 test-amd64-amd64-rumpuserxen-amd64                           pass    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-amd64-amd64-xl-win7-amd64                               fail    
 test-amd64-i386-xl-win7-amd64                                fail    
 test-amd64-i386-xl-credit2                                   pass    
 test-amd64-i386-freebsd10-i386                               pass    
 test-amd64-i386-rumpuserxen-i386                             pass    
 test-amd64-amd64-xl-pcipt-intel                              fail    
 test-amd64-i386-rhel6hvm-intel                               pass    
 test-amd64-i386-qemut-rhel6hvm-intel                         pass    
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
 test-amd64-amd64-libvirt                                     fail    
 test-armhf-armhf-libvirt                                     fail    
 test-amd64-i386-libvirt                                      fail    
 test-amd64-i386-xl-multivcpu                                 pass    
 test-amd64-amd64-pair                                        fail    
 test-amd64-i386-pair                                         fail    
 test-amd64-amd64-xl-sedf-pin                                 pass    
 test-amd64-amd64-xl-sedf                                     fail    
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     fail    
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     fail    
 test-amd64-i386-xl-winxpsp3-vcpus1                           fail    
 test-amd64-amd64-xl-qemut-winxpsp3                           fail    
 test-amd64-i386-xl-qemut-winxpsp3                            fail    
 test-amd64-amd64-xl-qemuu-winxpsp3                           fail    
 test-amd64-i386-xl-qemuu-winxpsp3                            fail    
 test-amd64-amd64-xl-winxpsp3                                 fail    
 test-amd64-i386-xl-winxpsp3                                  fail    


------------------------------------------------------------
sg-report-flight on osstest.cam.xci-test.com
logs: /home/xc_osstest/logs
images: /home/xc_osstest/images

Logs, config files, etc. are available at
    http://www.chiark.greenend.org.uk/~xensrcts/logs

Test harness code can be found at
    http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary


Not pushing.

------------------------------------------------------------
commit 5283b310e14884341f51be35253cdd59c4cb034c
Author: Jan Beulich <jbeulich@suse.com>
Date:   Fri Oct 31 11:32:27 2014 +0100

    x86/HVM: only kill guest when unknown VM exit occurred in guest kernel mode
    
    A recent KVM change by Nadav Amit <namit@cs.technion.ac.il> pointed out
    that unconditional VM exits (like VMX'es ones for the INVEPT, INVVPID,
    and XSETBV instructions) may result from guest user mode activity (in
    the example cases, e.g. prior to a privilege level check being done).
    Consequently convert the unconditional domain_crash() to a conditional
    one (when guest is in kernel mode) with the alternative of injecting
    #UD (when in user mode).
    
    This is meant to be a precaution against in-guest security issues
    introduced when any such VM exit becomes possible (on newer hardware)
    without the hypervisor immediately being aware of it. There are no such
    unhandled VM exits currently (and hence this is not an active security
    issue), but old (no longer security maintained) versions exhibit issues
    in the cases given as examples above.
    
    Suggested-by: Tim Deegan <tim@xen.org>
    Signed-off-by: Jan Beulich <jbeulich@suse.com>
    Reviewed-by: Andrew Cooper <andrew.cooper3@citrix.com>
    Reviewed-by: Boris Ostrovsky <boris.ostrovsky@oracle.com>
    Acked-by: Kevin Tian <kevin.tian@intel.com>

commit 93cc5c6f1641e90eb120826d42f103b7726efb8e
Author: Jan Beulich <jbeulich@suse.com>
Date:   Fri Oct 31 11:31:11 2014 +0100

    VMX: values written to MSR_IA32_SYSENTER_E[IS]P should be canonical
    
    A recent KVM change by Nadav Amit <namit@cs.technion.ac.il> helped spot
    that we have the same issue as they did.
    
    Signed-off-by: Jan Beulich <jbeulich@suse.com>
    Reviewed-by: Tim Deegan <tim@xen.org>
    Reviewed-by: Andrew Cooper <andrew.cooper3@citrix.com>
    Acked-by: Kevin Tian <kevin.tian@intel.com>

commit 9cf71226edabd8b9bc81a5eb57823dacbe8b4bd8
Author: Andrew Cooper <andrew.cooper3@citrix.com>
Date:   Fri Oct 31 11:28:36 2014 +0100

    process softirqs while dumping domains
    
    Process softirqs once per domain, and once every 64 vcpus in a guest to avoid
    being hit by the NMI watchdog.  Discovered against a VM which had accidentally
    been assigned 8192 vcpus.
    
    Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com>
    Reviewed-by: Dario Faggioli <dario.faggioli@citrix.com>
(qemu changes not included)

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [xen-unstable test] 31315: regressions - FAIL
  2014-11-02 17:43 [xen-unstable test] 31315: regressions - FAIL xen.org
@ 2014-11-03 10:16 ` Jan Beulich
  2014-11-03 10:34   ` Ian Campbell
  0 siblings, 1 reply; 7+ messages in thread
From: Jan Beulich @ 2014-11-03 10:16 UTC (permalink / raw)
  To: ian.jackson; +Cc: xen-devel

>>> On 02.11.14 at 18:43, <Ian.Jackson@eu.citrix.com> wrote:
> flight 31315 xen-unstable real [real]
> http://www.chiark.greenend.org.uk/~xensrcts/logs/31315/ 
> 
> Regressions :-(
> 
> Tests which did not succeed and are blocking,
> including tests which could not be run:
>  test-amd64-amd64-pair         8 xen-boot/dst_host         fail REGR. vs. 31285

Looking at fire-frog's serial log I see that booting started 09:34:37
and debug output was forced at 09:35:47; the login prompt
appeared at 09:36:11. The gap between the NTP server getting
started and the login prompt appearing seems pretty large, but
is that really an indication of something being wrong in the being
tested software? The 3 commits under test don't really look like
being candidate for a boot time (performance) regression.

Jan

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [xen-unstable test] 31315: regressions - FAIL
  2014-11-03 10:16 ` Jan Beulich
@ 2014-11-03 10:34   ` Ian Campbell
  2014-11-04 17:35     ` Ian Jackson
  0 siblings, 1 reply; 7+ messages in thread
From: Ian Campbell @ 2014-11-03 10:34 UTC (permalink / raw)
  To: Jan Beulich; +Cc: xen-devel, ian.jackson

On Mon, 2014-11-03 at 10:16 +0000, Jan Beulich wrote:
> >>> On 02.11.14 at 18:43, <Ian.Jackson@eu.citrix.com> wrote:
> > flight 31315 xen-unstable real [real]
> > http://www.chiark.greenend.org.uk/~xensrcts/logs/31315/ 
> > 
> > Regressions :-(
> > 
> > Tests which did not succeed and are blocking,
> > including tests which could not be run:
> >  test-amd64-amd64-pair         8 xen-boot/dst_host         fail REGR. vs. 31285
> 
> Looking at fire-frog's serial log I see that booting started 09:34:37
> and debug output was forced at 09:35:47; the login prompt
> appeared at 09:36:11. The gap between the NTP server getting
> started and the login prompt appearing seems pretty large,

There is also a login prompt at 09:35:25. I think the one at 09:36 is
because something appeared (probably the log collection process) to
press Enter.

It's a shame /etc/init.d/osstest-confirm-booted isn't more verbose on
the console, since this is what appears to have failed (i.e. the ssh bit
seems to have worked, so I don't think it was networking/dns/etc).

>  but
> is that really an indication of something being wrong in the being
> tested software? The 3 commits under test don't really look like
> being candidate for a boot time (performance) regression.

It does seem somewhat unlikely.

Ian.

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [xen-unstable test] 31315: regressions - FAIL
  2014-11-03 10:34   ` Ian Campbell
@ 2014-11-04 17:35     ` Ian Jackson
  2014-11-04 17:36       ` [OSSTEST PATCH 1/2] poll_loop: Restore diversion of logm Ian Jackson
  2014-11-05  9:25       ` [xen-unstable test] 31315: regressions - FAIL Ian Campbell
  0 siblings, 2 replies; 7+ messages in thread
From: Ian Jackson @ 2014-11-04 17:35 UTC (permalink / raw)
  To: Ian Campbell; +Cc: xen-devel, Jan Beulich

Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 31315: regressions - FAIL"):
> It's a shame /etc/init.d/osstest-confirm-booted isn't more verbose on
> the console, since this is what appears to have failed (i.e. the ssh bit
> seems to have worked, so I don't think it was networking/dns/etc).

I have some patches to fix this, which I will send in just a moment.

Ian.

^ permalink raw reply	[flat|nested] 7+ messages in thread

* [OSSTEST PATCH 1/2] poll_loop: Restore diversion of logm
  2014-11-04 17:35     ` Ian Jackson
@ 2014-11-04 17:36       ` Ian Jackson
  2014-11-04 17:36         ` [OSSTEST PATCH 2/2] osstest-confirm-booted: Log processes Ian Jackson
  2014-11-05  9:25       ` [xen-unstable test] 31315: regressions - FAIL Ian Campbell
  1 sibling, 1 reply; 7+ messages in thread
From: Ian Jackson @ 2014-11-04 17:36 UTC (permalink / raw)
  To: xen-devel; +Cc: Ian Jackson, Ian.Campbell, JBeulich

poll_loop is supposed to divert the logging away so that you don't
have to see a pile of repetitive logging if the operation succeeds.

But this was broken when the code was moved from the perl module
Osstest to Osstest::TestSupport.  Fix it.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
 Osstest/TestSupport.pm |    2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/Osstest/TestSupport.pm b/Osstest/TestSupport.pm
index 1d77933..ef2a853 100644
--- a/Osstest/TestSupport.pm
+++ b/Osstest/TestSupport.pm
@@ -611,7 +611,7 @@ sub poll_loop ($$$&) {
         $logmtmpfile= IO::File::new_tmpfile or die $!;
 
         if (!eval {
-            local ($Osstest::logm_handle) = ($logmtmpfile);
+            local ($Osstest::TestSupport::logm_handle) = ($logmtmpfile);
             $bad= $code->();
             1;
         }) {
-- 
1.7.10.4

^ permalink raw reply related	[flat|nested] 7+ messages in thread

* [OSSTEST PATCH 2/2] osstest-confirm-booted: Log processes
  2014-11-04 17:36       ` [OSSTEST PATCH 1/2] poll_loop: Restore diversion of logm Ian Jackson
@ 2014-11-04 17:36         ` Ian Jackson
  0 siblings, 0 replies; 7+ messages in thread
From: Ian Jackson @ 2014-11-04 17:36 UTC (permalink / raw)
  To: xen-devel; +Cc: Ian Jackson, Ian.Campbell, JBeulich

Run a ps if osstest-confirm-booted does not exist, and stash the
output where we read it during log capture.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
 Osstest/TestSupport.pm |    7 ++++---
 ts-logs-capture        |    2 ++
 2 files changed, 6 insertions(+), 3 deletions(-)

diff --git a/Osstest/TestSupport.pm b/Osstest/TestSupport.pm
index ef2a853..b348a7e 100644
--- a/Osstest/TestSupport.pm
+++ b/Osstest/TestSupport.pm
@@ -914,9 +914,10 @@ sub host_reboot ($) {
     poll_loop(40,2, 'reboot-confirm-booted', sub {
         my $output;
         if (!eval {
-            $output= target_cmd_output($ho,
-                "stat /dev/shm/osstest-confirm-booted 2>&1 >/dev/null ||:",
-                                       40);
+            $output= target_cmd_output($ho, <<END, 40);
+stat /dev/shm/osstest-confirm-booted 2>&1 >/dev/null \\
+ || ps -efH >osstest-confirm-booted.log
+END
             1;
         }) {
             return $@;
diff --git a/ts-logs-capture b/ts-logs-capture
index 3ccfc00..21974a9 100755
--- a/ts-logs-capture
+++ b/ts-logs-capture
@@ -130,6 +130,8 @@ sub fetch_logs_host_guests () {
 
                   /etc/xen/*
 
+                  /home/osstest/osstest-confirm-booted.log
+
                   )];
     if (!try_fetch_logs($ho, $logs)) {
         logm("log fetching failed, trying hard host reboot...");
-- 
1.7.10.4

^ permalink raw reply related	[flat|nested] 7+ messages in thread

* Re: [xen-unstable test] 31315: regressions - FAIL
  2014-11-04 17:35     ` Ian Jackson
  2014-11-04 17:36       ` [OSSTEST PATCH 1/2] poll_loop: Restore diversion of logm Ian Jackson
@ 2014-11-05  9:25       ` Ian Campbell
  1 sibling, 0 replies; 7+ messages in thread
From: Ian Campbell @ 2014-11-05  9:25 UTC (permalink / raw)
  To: Ian Jackson; +Cc: xen-devel, Jan Beulich

On Tue, 2014-11-04 at 17:35 +0000, Ian Jackson wrote:
> Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 31315: regressions - FAIL"):
> > It's a shame /etc/init.d/osstest-confirm-booted isn't more verbose on
> > the console, since this is what appears to have failed (i.e. the ssh bit
> > seems to have worked, so I don't think it was networking/dns/etc).
> 
> I have some patches to fix this, which I will send in just a moment.

Both look good to me, Acked-by: Ian Campbell <ian.campbell@citrix.com>

^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2014-11-05  9:26 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2014-11-02 17:43 [xen-unstable test] 31315: regressions - FAIL xen.org
2014-11-03 10:16 ` Jan Beulich
2014-11-03 10:34   ` Ian Campbell
2014-11-04 17:35     ` Ian Jackson
2014-11-04 17:36       ` [OSSTEST PATCH 1/2] poll_loop: Restore diversion of logm Ian Jackson
2014-11-04 17:36         ` [OSSTEST PATCH 2/2] osstest-confirm-booted: Log processes Ian Jackson
2014-11-05  9:25       ` [xen-unstable test] 31315: regressions - FAIL Ian Campbell

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).