From: Ian Campbell <ian.campbell@citrix.com>
To: Jan Beulich <JBeulich@suse.com>,
Andrew Cooper <Andrew.Cooper3@citrix.com>
Cc: xen-devel@lists.xensource.com, ian.jackson@eu.citrix.com
Subject: Re: [xen-unstable test] 57852: regressions - FAIL
Date: Fri, 5 Jun 2015 09:45:15 +0100 [thread overview]
Message-ID: <1433493915.7108.138.camel@citrix.com> (raw)
In-Reply-To: <osstest-57852-mainreport@xen.org>
On Thu, 2015-06-04 at 12:01 +0000, osstest service user wrote:
> flight 57852 xen-unstable real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/57852/
>
> Regressions :-(
>
> Tests which did not succeed and are blocking,
> including tests which could not be run:
> test-amd64-amd64-xl-qemuu-win7-amd64 9 windows-install fail REGR. vs. 57419
Is anyone looking into this?
It seems to have been intermittent for a long time but the probability
of failure seems to have increased significantly some time around flight
52633 (see [0]). Before that it failed <5% of the time and since then it
looks to be closer to 45-50%. 5% could be put down to infrastructure or
guest flakiness, 50% seems more like something on the Xen (or qemu etc)
side.
The bisector is taking a look[1] but TBH given a 50% pass rate I think
it is unlikely to get anywhere (I suspect this isn't its first attempt
at this either, pretty sure I saw a failed attempt on an earlier range).
Taking 50370 as a rough baseline (4 consecutive passes before the first
of the more frequent failures) gives a range of
b6e7fbadbda4..5c44b5cf352e which is quite a few. It's noteworthy though
that qemuu didn't change during the interval 50370..52633 (again, from
[0]).
None of the vnc snapshots look interesting, just the windows login
screen. Neither do any of the logs look interesting.
Ian.
[0] http://logs.test-lab.xenproject.org/osstest/results/history.test-amd64-amd64-xl-qemuu-win7-amd64.xen-unstable.html
[1] http://logs.test-lab.xenproject.org/osstest/results/bisect.xen-unstable.test-amd64-amd64-xl-qemuu-win7-amd64.windows-install.html
>
> Regressions which are regarded as allowable (not blocking):
> test-amd64-amd64-libvirt-xsm 11 guest-start fail REGR. vs. 57419
> test-amd64-i386-libvirt 11 guest-start fail like 57419
> test-amd64-i386-libvirt-xsm 11 guest-start fail like 57419
> test-amd64-amd64-libvirt 11 guest-start fail like 57419
> test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail like 57419
> test-amd64-amd64-xl-qemut-win7-amd64 16 guest-stop fail like 57419
> test-armhf-armhf-libvirt-xsm 11 guest-start fail like 57419
> test-amd64-i386-xl-qemuu-win7-amd64 16 guest-stop fail like 57419
>
> Tests which did not succeed, but are not blocking:
> test-amd64-i386-xl-xsm 14 guest-localmigrate fail never pass
> test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
> test-amd64-amd64-xl-xsm 14 guest-localmigrate fail never pass
> test-amd64-amd64-xl-pvh-intel 11 guest-start fail never pass
> test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm 12 guest-localmigrate fail never pass
> test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm 12 guest-localmigrate fail never pass
> test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 12 guest-localmigrate fail never pass
> test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm 12 guest-localmigrate fail never pass
> test-amd64-i386-xl-qemut-win7-amd64 16 guest-stop fail never pass
> test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
> test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
> test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
> test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
> test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
> test-armhf-armhf-xl 12 migrate-support-check fail never pass
> test-armhf-armhf-xl-sedf 12 migrate-support-check fail never pass
> test-armhf-armhf-xl-sedf-pin 12 migrate-support-check fail never pass
> test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
>
> version targeted for testing:
> xen fed56ba0e69b251d0222ef0785cd1c1838f9e51d
> baseline version:
> xen d6b6bd8374ac30597495d457829ce7ad6e8b7016
>
> ------------------------------------------------------------
> People who touched revisions under test:
> Andrew Cooper <andrew.cooper3@citrix.com>
> Dario Faggioli <dario.faggioli@citrix.com>
> George Dunlap <george.dunlap@eu.citrix.com>
> Ian Campbell <ian.campbell@citrix.com>
> Jan Beulich <jbeulich@suse.com>
> Kevin Tian <kevin.tian@intel.com>
> Roger Pau Monné <roger.pau@citrix.com>
> Ross Lagerwall <ross.lagerwall@citrix.com>
> Tim Deegan <tim@xen.org>
> Vitaly Kuznetsov <vkuznets@redhat.com>
> Yang Hongyang <yanghy@cn.fujitsu.com>
> ------------------------------------------------------------
>
> jobs:
> build-amd64-xsm pass
> build-armhf-xsm pass
> build-i386-xsm pass
> build-amd64 pass
> build-armhf pass
> build-i386 pass
> build-amd64-libvirt pass
> build-armhf-libvirt pass
> build-i386-libvirt pass
> build-amd64-oldkern pass
> build-i386-oldkern pass
> build-amd64-pvops pass
> build-armhf-pvops pass
> build-i386-pvops pass
> build-amd64-rumpuserxen pass
> build-i386-rumpuserxen pass
> test-amd64-amd64-xl pass
> test-armhf-armhf-xl pass
> test-amd64-i386-xl pass
> test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm fail
> test-amd64-i386-xl-qemut-debianhvm-amd64-xsm fail
> test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm fail
> test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm fail
> test-amd64-amd64-libvirt-xsm fail
> test-armhf-armhf-libvirt-xsm fail
> test-amd64-i386-libvirt-xsm fail
> test-amd64-amd64-xl-xsm fail
> test-armhf-armhf-xl-xsm pass
> test-amd64-i386-xl-xsm fail
> test-amd64-amd64-xl-pvh-amd fail
> test-amd64-i386-qemut-rhel6hvm-amd pass
> test-amd64-i386-qemuu-rhel6hvm-amd pass
> test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
> test-amd64-i386-xl-qemut-debianhvm-amd64 pass
> test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
> test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
> test-amd64-i386-freebsd10-amd64 pass
> test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
> test-amd64-i386-xl-qemuu-ovmf-amd64 pass
> test-amd64-amd64-rumpuserxen-amd64 fail
> test-amd64-amd64-xl-qemut-win7-amd64 fail
> test-amd64-i386-xl-qemut-win7-amd64 fail
> test-amd64-amd64-xl-qemuu-win7-amd64 fail
> test-amd64-i386-xl-qemuu-win7-amd64 fail
> test-armhf-armhf-xl-arndale pass
> test-amd64-amd64-xl-credit2 pass
> test-armhf-armhf-xl-credit2 pass
> test-armhf-armhf-xl-cubietruck pass
> test-amd64-i386-freebsd10-i386 pass
> test-amd64-i386-rumpuserxen-i386 pass
> test-amd64-amd64-xl-pvh-intel fail
> test-amd64-i386-qemut-rhel6hvm-intel pass
> test-amd64-i386-qemuu-rhel6hvm-intel pass
> test-amd64-amd64-libvirt fail
> test-armhf-armhf-libvirt pass
> test-amd64-i386-libvirt fail
> test-amd64-amd64-xl-multivcpu pass
> test-armhf-armhf-xl-multivcpu pass
> test-amd64-amd64-pair pass
> test-amd64-i386-pair pass
> test-amd64-amd64-xl-sedf-pin pass
> test-armhf-armhf-xl-sedf-pin pass
> test-amd64-amd64-xl-sedf pass
> test-armhf-armhf-xl-sedf pass
> test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass
> test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass
> test-amd64-amd64-xl-qemut-winxpsp3 pass
> test-amd64-i386-xl-qemut-winxpsp3 pass
> test-amd64-amd64-xl-qemuu-winxpsp3 pass
> test-amd64-i386-xl-qemuu-winxpsp3 pass
>
>
> ------------------------------------------------------------
> sg-report-flight on osstest.test-lab.xenproject.org
> logs: /home/logs/logs
> images: /home/logs/images
>
> Logs, config files, etc. are available at
> http://logs.test-lab.xenproject.org/osstest/logs
>
> Test harness code can be found at
> http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
>
>
> Not pushing.
>
> ------------------------------------------------------------
> commit fed56ba0e69b251d0222ef0785cd1c1838f9e51d
> Author: Jan Beulich <jbeulich@suse.com>
> Date: Tue Jun 2 13:45:03 2015 +0200
>
> unmodified-drivers: tolerate IRQF_DISABLED being undefined
>
> It's being removed in Linux 4.1.
>
> Signed-off-by: Jan Beulich <jbeulich@suse.com>
> Acked-by: Ian Campbell <ian.campbell@citrix.com>
>
> commit 8a753b3f1cf5e4714974196df9517849bf174324
> Author: Ross Lagerwall <ross.lagerwall@citrix.com>
> Date: Tue Jun 2 13:44:24 2015 +0200
>
> efi: fix allocation problems if ExitBootServices() fails
>
> If calling ExitBootServices() fails, the required memory map size may
> have increased. When initially allocating the memory map, allocate a
> slightly larger buffer (by an arbitrary 8 entries) to fix this.
>
> The ARM code path was already allocating a larger buffer than required,
> so this moves the code to be common for all architectures.
>
> This was seen on the following machine when using the iscsidxe UEFI
> driver. The machine would consistently fail the first call to
> ExitBootServices().
> System Information
> Manufacturer: Supermicro
> Product Name: X10SLE-F/HF
> BIOS Information
> Vendor: American Megatrends Inc.
> Version: 2.00
> Release Date: 04/24/2014
>
> Signed-off-by: Ross Lagerwall <ross.lagerwall@citrix.com>
> Acked-by: Jan Beulich <jbeulich@suse.com>
> Reviewed-by: Roy Franz <roy.franz@linaro.org>
> Acked-by: Ian Campbell <ian.campbell@citrix.com>
>
> commit 376bbbabbda607d2039b8f839f15ff02721597d2
> Author: Dario Faggioli <dario.faggioli@citrix.com>
> Date: Tue Jun 2 13:43:15 2015 +0200
>
> sched_rt: print useful affinity info when dumping
>
> In fact, printing the cpupool's CPU online mask
> for each vCPU is just redundant, as that is the
> same for all the vCPUs of all the domains in the
> same cpupool, while hard affinity is already part
> of the output of dumping domains info.
>
> Instead, print the intersection between hard
> affinity and online CPUs, which is --in case of this
> scheduler-- the effective affinity always used for
> the vCPUs.
>
> This change also takes the chance to add a scratch
> cpumask area, to avoid having to either put one
> (more) cpumask_t on the stack, or dynamically
> allocate it within the dumping routine. (The former
> being bad because hypervisor stack size is limited,
> the latter because dynamic allocations can fail, if
> the hypervisor was built for a large enough number
> of CPUs.) We allocate such scratch area, for all pCPUs,
> when the first instance of the RTDS scheduler is
> activated and, in order not to loose track/leak it
> if other instances are activated in new cpupools,
> and when the last instance is deactivated, we (sort
> of) refcount it.
>
> Such scratch area can be used to kill most of the
> cpumasks{_var}_t local variables in other functions
> in the file, but that is *NOT* done in this chage.
>
> Finally, convert the file to use keyhandler scratch,
> instead of open coded string buffers.
>
> Signed-off-by: Dario Faggioli <dario.faggioli@citrix.com>
> Reviewed-by: Meng Xu <mengxu@cis.upenn.edu>
> Acked-by: George Dunlap <george.dunlap@eu.citrix.com>
>
> commit e758ed14f390342513405dd766e874934573e6cb
> Author: Andrew Cooper <andrew.cooper3@citrix.com>
> Date: Mon Jun 1 12:00:18 2015 +0200
>
> docs: clarification to terms used in hypervisor memory management
>
> Memory management is hard[citation needed]. Furthermore, it isn't helped by
> the inconsistent use of terms through the code, or that some terms have
> changed meaning over time.
>
> Describe the currently-used terms in a more practical fashon, so new code has
> a concrete reference.
>
> Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com>
> Acked-by: Tim Deegan <tim@xen.org>
>
> commit 591e1e357c29589e9d6121d8faadc4f4d3b9013e
> Author: Ross Lagerwall <ross.lagerwall@citrix.com>
> Date: Mon Jun 1 11:59:14 2015 +0200
>
> x86: don't crash when mapping a page using EFI runtime page tables
>
> When an interrupt is received during an EFI runtime service call, Xen
> may call map_domain_page() while using the EFI runtime page tables.
> This fails because, although the EFI runtime page tables are a
> copy of the idle domain's page tables, current points at a different
> domain's vCPU.
>
> To fix this, return NULL from mapcache_current_vcpu() when using the EFI
> runtime page tables which is treated equivalently to running in an idle
> vCPU.
>
> This issue can be reproduced by repeatedly calling GetVariable() from
> dom0 while using VT-d, since VT-d frequently maps a page from interrupt
> context.
>
> Example call trace:
> [<ffff82d0801615dc>] __find_next_zero_bit+0x28/0x60
> [<ffff82d08016a10e>] map_domain_page+0x4c6/0x4eb
> [<ffff82d080156ae6>] map_vtd_domain_page+0xd/0xf
> [<ffff82d08015533a>] msi_msg_read_remap_rte+0xe3/0x1d8
> [<ffff82d08014e516>] iommu_read_msi_from_ire+0x31/0x34
> [<ffff82d08016ff6c>] set_msi_affinity+0x134/0x17a
> [<ffff82d0801737b5>] move_masked_irq+0x5c/0x98
> [<ffff82d080173816>] move_native_irq+0x25/0x36
> [<ffff82d08016ffcb>] ack_nonmaskable_msi_irq+0x19/0x20
> [<ffff82d08016ffdb>] ack_maskable_msi_irq+0x9/0x37
> [<ffff82d080173e8b>] do_IRQ+0x251/0x635
> [<ffff82d080234502>] common_interrupt+0x62/0x70
> [<00000000df7ed2be>] 00000000df7ed2be
>
> Signed-off-by: Ross Lagerwall <ross.lagerwall@citrix.com>
>
> commit 47ec25a3c8cdd7a057af0a05e8e00257ef950437
> Merge: 088e9b2 818e376
> Author: Ian Campbell <ian.campbell@citrix.com>
> Date: Fri May 29 13:22:31 2015 +0100
>
> Merge branch 'staging' of ssh://xenbits.xen.org/home/xen/git/xen into staging
>
> commit 088e9b2796bd1f9ebe4fda800275cc689677b699
> Author: Yang Hongyang <yanghy@cn.fujitsu.com>
> Date: Mon May 18 15:03:56 2015 +0800
>
> libxc/restore: implement Remus checkpointed restore
>
> With Remus, the restore flow should be:
> the first full migration stream -> { periodically restore stream }
>
> Signed-off-by: Yang Hongyang <yanghy@cn.fujitsu.com>
> Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com>
> CC: Ian Campbell <Ian.Campbell@citrix.com>
> CC: Ian Jackson <Ian.Jackson@eu.citrix.com>
> CC: Wei Liu <wei.liu2@citrix.com>
> Reviewed-by: Andrew Cooper <andrew.cooper3@citrix.com>
> Acked-by: Ian Campbell <ian.campbell@citrix.com>
>
> commit a25e4e96fc95150f5c58d069de1b204aa6487ed8
> Author: Yang Hongyang <yanghy@cn.fujitsu.com>
> Date: Mon May 18 15:03:55 2015 +0800
>
> libxc/save: implement Remus checkpointed save
>
> With Remus, the save flow should be:
> live migration->{ periodically save(checkpointed save) }
>
> Signed-off-by: Yang Hongyang <yanghy@cn.fujitsu.com>
> CC: Ian Campbell <Ian.Campbell@citrix.com>
> CC: Ian Jackson <Ian.Jackson@eu.citrix.com>
> CC: Wei Liu <wei.liu2@citrix.com>
> CC: Andrew Cooper <andrew.cooper3@citrix.com>
> Reviewed-by: Andrew Cooper <andrew.cooper3@citrix.com>
> Acked-by: Ian Campbell <ian.campbell@citrix.com>
>
> commit cfa955591caea5d7ec505cdcbf4442f2d6e889e1
> Author: Yang Hongyang <yanghy@cn.fujitsu.com>
> Date: Mon May 18 15:03:54 2015 +0800
>
> libxc/save: refactor of send_domain_memory_live()
>
> Split the send_domain_memory_live() into three helper function:
> - send_memory_live() do the actually live send
> - suspend_and_send_dirty() suspend the guest and send dirty pages
> - send_memory_verify()
> The motivation of this is that when we send checkpointed stream, we
> will skip the actually live part.
>
> Signed-off-by: Yang Hongyang <yanghy@cn.fujitsu.com>
> CC: Ian Campbell <Ian.Campbell@citrix.com>
> CC: Ian Jackson <Ian.Jackson@eu.citrix.com>
> CC: Wei Liu <wei.liu2@citrix.com>
> CC: Andrew Cooper <andrew.cooper3@citrix.com>
> Reviewed-by: Andrew Cooper <andrew.cooper3@citrix.com>
> Acked-by: Ian Campbell <ian.campbell@citrix.com>
>
> commit 818e376d3b17845d39735517650224c64c9e0078
> Author: Jan Beulich <jbeulich@suse.com>
> Date: Thu May 28 12:07:33 2015 +0200
>
> Revert "use ticket locks for spin locks"
>
> This reverts commit 45fcc4568c5162b00fb3907fb158af82dd484a3d as it
> introduces yet to be explained issues on ARM.
>
> commit 02cdd81aa0a88007addc788c6cf93e2f1cb1a314
> Author: Jan Beulich <jbeulich@suse.com>
> Date: Thu May 28 12:06:47 2015 +0200
>
> Revert "spinlock: fix build with older GCC"
>
> This reverts commit 1037e33c88bb0e1fe530c164f242df17030102e1 as its
> prereq commit 45fcc4568c is about to be reverted.
>
> commit 814ca12647f06b023f4aac8eae837ba9b417acc7
> Author: Jan Beulich <jbeulich@suse.com>
> Date: Thu May 28 11:59:34 2015 +0200
>
> Revert "x86,arm: remove asm/spinlock.h from all architectures"
>
> This reverts commit e62e49e6d5d4e8d22f3df0b75443ede65a812435 as
> its prerequisite 45fcc4568c is going to be reverted.
>
> commit cf6b3ccf28faee01a078311fcfe671148c81ea75
> Author: Roger Pau Monné <roger.pau@citrix.com>
> Date: Thu May 28 10:56:08 2015 +0200
>
> x86/pvh: disable posted interrupts
>
> Enabling posted interrupts requires the virtual interrupt delivery feature,
> which is disabled for PVH guests, so make sure posted interrupts are also
> disabled or else vmlaunch will fail.
>
> Signed-off-by: Roger Pau Monné <roger.pau@citrix.com>
> Reported-and-Tested-by: Lars Eggert <lars@netapp.com>
> Acked-by: Kevin Tian <kevin.tian@intel.com>
>
> commit d4d39de054a6f6c5a474aee62999a8ea7c2fd180
> Author: Vitaly Kuznetsov <vkuznets@redhat.com>
> Date: Thu May 28 10:55:43 2015 +0200
>
> public: fix xen_domctl_monitor_op_t definition
>
> It seems xen_domctl_monitor_op_t was supposed to be a typedef for
> struct xen_domctl_monitor_op and not the non-existent xen_domctl__op.
>
> Signed-off-by: Vitaly Kuznetsov <vkuznets@redhat.com>
> (qemu changes not included)
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xen.org
> http://lists.xen.org/xen-devel
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
next prev parent reply other threads:[~2015-06-05 8:45 UTC|newest]
Thread overview: 40+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-06-04 12:01 [xen-unstable test] 57852: regressions - FAIL osstest service user
2015-06-05 8:45 ` Ian Campbell [this message]
2015-06-05 9:00 ` Jan Beulich
2015-06-05 9:07 ` Ian Campbell
2015-06-05 9:18 ` Jan Beulich
2015-06-05 10:48 ` Ian Campbell
2015-06-05 16:46 ` Ian Campbell
2015-06-08 8:07 ` Jan Beulich
2015-06-08 8:53 ` Ian Campbell
2015-06-08 9:15 ` Jan Beulich
2015-06-08 9:27 ` Ian Campbell
2015-06-08 10:17 ` Jan Beulich
2015-06-08 14:43 ` Ian Jackson
2015-06-08 12:16 ` Ian Campbell
2015-06-08 12:19 ` Andrew Cooper
2015-06-08 12:24 ` Jan Beulich
2015-06-09 8:26 ` Ian Campbell
2015-06-09 9:29 ` Jan Beulich
2015-06-10 8:50 ` Ian Campbell
2015-06-10 9:36 ` Jan Beulich
2015-06-10 11:01 ` Ian Campbell
2015-06-10 11:48 ` Jan Beulich
2015-06-10 12:56 ` Ian Campbell
2015-06-10 13:23 ` Jan Beulich
2015-06-10 13:45 ` Jan Beulich
2015-06-10 14:08 ` Ian Campbell
2015-06-11 7:02 ` Jan Beulich
2015-06-11 8:45 ` Ian Campbell
2015-06-15 8:57 ` Ian Campbell
2015-06-15 9:03 ` Jan Beulich
2015-06-10 14:34 ` Ian Campbell
2015-06-10 15:59 ` Jan Beulich
2015-06-10 16:18 ` Don Slutz
2015-06-10 18:00 ` Ian Campbell
2015-06-08 13:50 ` Konrad Rzeszutek Wilk
2015-06-08 14:02 ` Ian Campbell
2015-06-08 14:47 ` Ian Jackson
2015-06-08 15:21 ` Konrad Rzeszutek Wilk
2015-06-08 15:29 ` Ian Campbell
2015-06-08 10:10 ` Ian Campbell
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1433493915.7108.138.camel@citrix.com \
--to=ian.campbell@citrix.com \
--cc=Andrew.Cooper3@citrix.com \
--cc=JBeulich@suse.com \
--cc=ian.jackson@eu.citrix.com \
--cc=xen-devel@lists.xensource.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.