* [xen-unstable test] 61521: regressions - FAIL
@ 2015-09-08 14:30 osstest service owner
2015-09-08 14:52 ` Wei Liu
0 siblings, 1 reply; 11+ messages in thread
From: osstest service owner @ 2015-09-08 14:30 UTC (permalink / raw)
To: xen-devel, osstest-admin
flight 61521 xen-unstable real [real]
http://logs.test-lab.xenproject.org/osstest/logs/61521/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-amd64-xl-qemut-debianhvm-amd64 19 guest-start/debianhvm.repeat fail REGR. vs. 61059
Regressions which are regarded as allowable (not blocking):
test-armhf-armhf-xl-rtds 15 guest-start.2 fail blocked in 61059
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail blocked in 61059
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 9 debian-hvm-install fail like 61059
test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail like 61059
test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail like 61059
test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 61059
Tests which did not succeed, but are not blocking:
test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
test-amd64-amd64-xl-pvh-intel 11 guest-start fail never pass
test-armhf-armhf-xl-raw 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-raw 9 debian-di-install fail never pass
test-armhf-armhf-xl-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-xl-vhd 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-vhd 9 debian-di-install fail never pass
test-armhf-armhf-libvirt 14 guest-saverestore fail never pass
test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt-xsm 14 guest-saverestore fail never pass
test-armhf-armhf-libvirt-qcow2 9 debian-di-install fail never pass
test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-amd64-i386-libvirt 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-xl-rtds 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-rtds 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-raw 11 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 13 saverestore-support-check fail never pass
test-amd64-amd64-libvirt-raw 11 migrate-support-check fail never pass
test-armhf-armhf-xl 12 migrate-support-check fail never pass
test-armhf-armhf-xl 13 saverestore-support-check fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-armhf-armhf-xl-xsm 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-armhf-armhf-xl-multivcpu 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-qcow2 11 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 13 saverestore-support-check fail never pass
test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass
test-amd64-i386-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail never pass
test-amd64-amd64-libvirt-qcow2 11 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
version targeted for testing:
xen a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d
baseline version:
xen 801ab48e5556cb54f67e3cb57f077f47e8663ced
Last test of basis 61059 2015-08-30 15:26:08 Z 8 days
Failing since 61248 2015-09-01 10:13:44 Z 7 days 3 attempts
Testing same since 61521 2015-09-07 11:46:37 Z 1 days 1 attempts
------------------------------------------------------------
People who touched revisions under test:
Daniel De Graaf <dgdegra@tycho.nsa.gov>
David Scott <dave.scott@citrix.com>
David Scott <dave.scott@eu.citrix.com>
David Scott <dave@recoil.org>
Doug Goldstein <cardoe@cardoe.com>
George Dunlap <george.dunlap@citrix.com>
George Dunlap <george.dunlap@eu.citrix.com>
Ian Campbell <ian.campbell@citrix.com>
Ian Jackson <ian.jackson@eu.citrix.com>
Jan Beulich <jbeulich@suse.com>
Jen Beulich <jbeulich@suse.com>
Jim Fehlig <jfehlig@suse.com>
Jonathan Creekmore <jonathan.creekmore@gmail.com>
Julien Grall <julien.grall@citrix.com>
Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Paul Durrant <paul.durrant@citrix.com>
Razvan Cojocaru <rcojocaru@bitdefender.com>
Tamas K Lengyel <tamas@tklengyel.com>
Vijaya Kumar K <Vijaya.Kumar@caviumnetworks.com>
Wei Liu <wei.liu2@citrix.com>
Wei Liu <wei.liu2@citrix.com> [release + toolstack]
Zhigang Wang <zhigang.x.wang@oracle.com>
jobs:
build-amd64-xsm pass
build-armhf-xsm pass
build-i386-xsm pass
build-amd64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-oldkern pass
build-i386-oldkern pass
build-amd64-prev pass
build-i386-prev pass
build-amd64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
build-amd64-rumpuserxen pass
build-i386-rumpuserxen pass
test-amd64-amd64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl pass
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-amd64-libvirt-xsm pass
test-armhf-armhf-libvirt-xsm fail
test-amd64-i386-libvirt-xsm pass
test-amd64-amd64-xl-xsm pass
test-armhf-armhf-xl-xsm pass
test-amd64-i386-xl-xsm pass
test-amd64-amd64-xl-pvh-amd fail
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 fail
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-rumpuserxen-amd64 fail
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-i386-rumpuserxen-i386 pass
test-amd64-amd64-xl-pvh-intel fail
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt fail
test-amd64-i386-libvirt pass
test-amd64-amd64-migrupgrade pass
test-amd64-i386-migrupgrade pass
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-amd64-amd64-libvirt-pair fail
test-amd64-i386-libvirt-pair fail
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-pygrub pass
test-amd64-amd64-libvirt-qcow2 pass
test-armhf-armhf-libvirt-qcow2 fail
test-amd64-i386-libvirt-qcow2 pass
test-amd64-amd64-xl-qcow2 pass
test-armhf-armhf-xl-qcow2 fail
test-amd64-i386-xl-qcow2 pass
test-amd64-amd64-libvirt-raw pass
test-armhf-armhf-libvirt-raw fail
test-amd64-i386-libvirt-raw pass
test-amd64-amd64-xl-raw pass
test-armhf-armhf-xl-raw fail
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds fail
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-libvirt-vhd fail
test-amd64-i386-libvirt-vhd pass
test-amd64-amd64-xl-vhd pass
test-armhf-armhf-xl-vhd fail
test-amd64-i386-xl-vhd pass
test-amd64-amd64-xl-qemut-winxpsp3 pass
test-amd64-i386-xl-qemut-winxpsp3 pass
test-amd64-amd64-xl-qemuu-winxpsp3 pass
test-amd64-i386-xl-qemuu-winxpsp3 pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
Not pushing.
(No revision log; it would be 684 lines long.)
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [xen-unstable test] 61521: regressions - FAIL
2015-09-08 14:30 [xen-unstable test] 61521: regressions - FAIL osstest service owner
@ 2015-09-08 14:52 ` Wei Liu
2015-09-08 15:13 ` Ian Campbell
2015-09-08 15:14 ` Jan Beulich
0 siblings, 2 replies; 11+ messages in thread
From: Wei Liu @ 2015-09-08 14:52 UTC (permalink / raw)
To: osstest service owner
Cc: Ian Jackson, xen-devel, wei.liu2, Ian Campbell, Jan Beulich
On Tue, Sep 08, 2015 at 02:30:30PM +0000, osstest service owner wrote:
> flight 61521 xen-unstable real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/61521/
>
> Regressions :-(
>
> Tests which did not succeed and are blocking,
> including tests which could not be run:
> test-amd64-amd64-xl-qemut-debianhvm-amd64 19 guest-start/debianhvm.repeat fail REGR. vs. 61059
>
I suspect this failure is due to infrastructure problem.
Same test job passed in
http://logs.test-lab.xenproject.org/osstest/logs/61306/
The differences of xen-unstable between 61306 and this flight are:
a7b39c8bd libxc: add assertion to avoid setting same bit more than once
e8e9f830d libxc: don't populate same pfn more than once in populate_pfns
e00f8a1a7 libxc: fix indentation
76d75222a libxc: migration v2 prefix Memory -> Frames
477619384 libxc: clearer migration v2 debug message
Tested in migration jobs and passed.
b2700877a public/io/netif.h: move and amend multicast control documentation
09e2a619a MAINTAINERS: tools/ocaml: update David Scott's email address
06925643c build: update top-level make help
Doc update, irrelevant to failure.
f42f2cbe5 xen/dt: Handle correctly node without interrupt-map in dt_for_each_irq_map
ARM, irrelevant to failure.
d9be0990f tools/xen-access: use PRI_xen_pfn
Not tested in OSSTest
0a7167d9b xen/arm64: do not (incorrectly) limit size of xenheap
ARM, irrelevant to failure.
8747dba3b Merge branch 'staging' of ssh://xenbits.xen.org/home/xen/git/xen into staging
076cd5065 tmem: Spelling and full stop surgery.
fee800b94 tmem: Remove extra spaces at end and some hard tabbing.
880699a8b tmem: Use 'struct xen_tmem_oid' in tmem_handle and move it to sysctl header.
b657a8ad1 tmem: Use 'struct xen_tmem_oid' for every user.
987e64e05 tmem: Make the uint64_t oid[3] a proper structure: xen_tmem_oid
ad1b7a139 tmem: Remove the old tmem control XSM checks as it is part of sysctl hypercall.
d0edc15a6 tmem: Move TMEM_CONTROL subop of tmem hypercall to sysctl.
54a51b176 tmem: Remove xc_tmem_control mystical arg3
1682d2fdf tmem: Remove in xc_tmem_control_oid duplicate set_xen_guest_handle call
7646da32f tmem: Add ASSERT in obj_rb_insert for pool->rwlock lock.
7ec4b2f89 tmem: Don't crash/hang/leak hypervisor when using shared pools within an guest.
Not tested in OSSTest.
16181cbb1 tools: Honor Config.mk debug value, rather than setting our own
Passed, and irrelevant to failure.
Wei.
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [xen-unstable test] 61521: regressions - FAIL
2015-09-08 14:52 ` Wei Liu
@ 2015-09-08 15:13 ` Ian Campbell
2015-09-08 15:32 ` Wei Liu
2015-09-08 15:14 ` Jan Beulich
1 sibling, 1 reply; 11+ messages in thread
From: Ian Campbell @ 2015-09-08 15:13 UTC (permalink / raw)
To: Wei Liu, osstest service owner; +Cc: xen-devel, Ian Jackson, Jan Beulich
On Tue, 2015-09-08 at 15:52 +0100, Wei Liu wrote:
> On Tue, Sep 08, 2015 at 02:30:30PM +0000, osstest service owner wrote:
> > flight 61521 xen-unstable real [real]
> > http://logs.test-lab.xenproject.org/osstest/logs/61521/
> >
> > Regressions :-(
> >
> > Tests which did not succeed and are blocking,
> > including tests which could not be run:
> > test-amd64-amd64-xl-qemut-debianhvm-amd64 19 guest
> > -start/debianhvm.repeat fail REGR. vs. 61059
> >
>
> I suspect this failure is due to infrastructure problem.
Actually I think it is more likely that the qemut-debianhvm test is just
not 100% reliable.
Unless you have observed something in the logs which points specifically to
wards an infrastructure failure? In which case you should have mentioned it
here.
>
> Same test job passed in
> http://logs.test-lab.xenproject.org/osstest/logs/61306/
>
> The differences of xen-unstable between 61306 and this flight are:
>
> a7b39c8bd libxc: add assertion to avoid setting same bit more than once
> e8e9f830d libxc: don't populate same pfn more than once in populate_pfns
> e00f8a1a7 libxc: fix indentation
> 76d75222a libxc: migration v2 prefix Memory -> Frames
> 477619384 libxc: clearer migration v2 debug message
>
> Tested in migration jobs and passed.
>
> b2700877a public/io/netif.h: move and amend multicast control
> documentation
> 09e2a619a MAINTAINERS: tools/ocaml: update David Scott's email address
> 06925643c build: update top-level make help
>
> Doc update, irrelevant to failure.
>
> f42f2cbe5 xen/dt: Handle correctly node without interrupt-map in
> dt_for_each_irq_map
>
> ARM, irrelevant to failure.
>
> d9be0990f tools/xen-access: use PRI_xen_pfn
>
> Not tested in OSSTest
>
> 0a7167d9b xen/arm64: do not (incorrectly) limit size of xenheap
>
> ARM, irrelevant to failure.
>
> 8747dba3b Merge branch 'staging' of
> ssh://xenbits.xen.org/home/xen/git/xen into staging
> 076cd5065 tmem: Spelling and full stop surgery.
> fee800b94 tmem: Remove extra spaces at end and some hard tabbing.
> 880699a8b tmem: Use 'struct xen_tmem_oid' in tmem_handle and move it to
> sysctl header.
> b657a8ad1 tmem: Use 'struct xen_tmem_oid' for every user.
> 987e64e05 tmem: Make the uint64_t oid[3] a proper structure: xen_tmem_oid
> ad1b7a139 tmem: Remove the old tmem control XSM checks as it is part of
> sysctl hypercall.
> d0edc15a6 tmem: Move TMEM_CONTROL subop of tmem hypercall to sysctl.
> 54a51b176 tmem: Remove xc_tmem_control mystical arg3
> 1682d2fdf tmem: Remove in xc_tmem_control_oid duplicate
> set_xen_guest_handle call
> 7646da32f tmem: Add ASSERT in obj_rb_insert for pool->rwlock lock.
> 7ec4b2f89 tmem: Don't crash/hang/leak hypervisor when using shared pools
> within an guest.
>
> Not tested in OSSTest.
>
> 16181cbb1 tools: Honor Config.mk debug value, rather than setting our own
>
> Passed, and irrelevant to failure.
>
> Wei.
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [xen-unstable test] 61521: regressions - FAIL
2015-09-08 14:52 ` Wei Liu
2015-09-08 15:13 ` Ian Campbell
@ 2015-09-08 15:14 ` Jan Beulich
2015-09-08 15:35 ` Ian Jackson
1 sibling, 1 reply; 11+ messages in thread
From: Jan Beulich @ 2015-09-08 15:14 UTC (permalink / raw)
To: wei.liu2; +Cc: xen-devel, Ian Jackson, Ian Campbell
>>> On 08.09.15 at 16:52, <wei.liu2@citrix.com> wrote:
> On Tue, Sep 08, 2015 at 02:30:30PM +0000, osstest service owner wrote:
>> flight 61521 xen-unstable real [real]
>> http://logs.test-lab.xenproject.org/osstest/logs/61521/
>>
>> Regressions :-(
>>
>> Tests which did not succeed and are blocking,
>> including tests which could not be run:
>> test-amd64-amd64-xl-qemut-debianhvm-amd64 19 guest-start/debianhvm.repeat fail
> REGR. vs. 61059
>>
>
> I suspect this failure is due to infrastructure problem.
This or some random (but reoccurring) failure. Not so long ago I
already mentioned that for the purpose of just determining whether
a guest is up
ssh: connect to host 172.16.145.6 port 22: Connection refused
is sufficient, as that means there was a response (albeit a
negative one). But whether the refusal is due to something
getting corrupted in the networking stack or due to an
infrastructure problem is rather hard to tell.
Jan
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [xen-unstable test] 61521: regressions - FAIL
2015-09-08 15:13 ` Ian Campbell
@ 2015-09-08 15:32 ` Wei Liu
0 siblings, 0 replies; 11+ messages in thread
From: Wei Liu @ 2015-09-08 15:32 UTC (permalink / raw)
To: Ian Campbell
Cc: Ian Jackson, xen-devel, Wei Liu, osstest service owner,
Jan Beulich
On Tue, Sep 08, 2015 at 04:13:06PM +0100, Ian Campbell wrote:
> On Tue, 2015-09-08 at 15:52 +0100, Wei Liu wrote:
> > On Tue, Sep 08, 2015 at 02:30:30PM +0000, osstest service owner wrote:
> > > flight 61521 xen-unstable real [real]
> > > http://logs.test-lab.xenproject.org/osstest/logs/61521/
> > >
> > > Regressions :-(
> > >
> > > Tests which did not succeed and are blocking,
> > > including tests which could not be run:
> > > test-amd64-amd64-xl-qemut-debianhvm-amd64 19 guest
> > > -start/debianhvm.repeat fail REGR. vs. 61059
> > >
> >
> > I suspect this failure is due to infrastructure problem.
>
> Actually I think it is more likely that the qemut-debianhvm test is just
> not 100% reliable.
>
> Unless you have observed something in the logs which points specifically to
> wards an infrastructure failure? In which case you should have mentioned it
> here.
>
Hmm... I don't think I spot those kind of things.
Wei.
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [xen-unstable test] 61521: regressions - FAIL
2015-09-08 15:14 ` Jan Beulich
@ 2015-09-08 15:35 ` Ian Jackson
2015-09-08 15:45 ` Ian Jackson
0 siblings, 1 reply; 11+ messages in thread
From: Ian Jackson @ 2015-09-08 15:35 UTC (permalink / raw)
To: Jan Beulich; +Cc: xen-devel, wei.liu2, Ian Campbell
Jan Beulich writes ("Re: [Xen-devel] [xen-unstable test] 61521: regressions - FAIL"):
> This or some random (but reoccurring) failure.
I agree with Ian C that this isn't likely to be an infrastructure
problem. It's probably an actual bug.
> Not so long ago I already mentioned that for the purpose of just
> determining whether a guest is up
>
> ssh: connect to host 172.16.145.6 port 22: Connection refused
>
> is sufficient, as that means there was a response (albeit a
> negative one).
That depends on what you mean by `up'. The guest is not `up' in the
sense that it is not providing the services it is supposed to provide
(which include, in this case, an ssh server).
So I think that osstest is correct to regard this as a test failure.
> But whether the refusal is due to something getting corrupted in
> the networking stack or due to an infrastructure problem is rather
> hard to tell.
Both of these seem unlikely as explanations.
A more likely explanation is that the host sometimes fails to complete
its bootup within a reasonable time.
Possible root causes include but are not limited to:
* Something wrong with the network frontend/backend causes
a delay to startup
* Something else wrong means that the guest sometimes has
very poor performance
* The guest has actually locked up or partially locked up during
boot and currently only kernel interrupt processing is being done
Infrastructure problems are possible of course but I don't think they
are likely. When we had that BSD lost-gratuitous-arp bug I
investigated the networking in the colo in some depth and there was no
evidence of any packet loss, for example.
Ian.
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [xen-unstable test] 61521: regressions - FAIL
2015-09-08 15:35 ` Ian Jackson
@ 2015-09-08 15:45 ` Ian Jackson
2015-09-08 16:02 ` Jan Beulich
0 siblings, 1 reply; 11+ messages in thread
From: Ian Jackson @ 2015-09-08 15:45 UTC (permalink / raw)
To: Jan Beulich, wei.liu2, Ian Campbell, xen-devel
Ian Jackson writes ("Re: [Xen-devel] [xen-unstable test] 61521: regressions - FAIL"):
> A more likely explanation is that the host sometimes fails to complete
> its bootup within a reasonable time.
Actually, looking at a bit more of the osstest transcript:
2015-09-08 09:14:32 Z guest debianhvm.guest.osstest 5a:36:0e:51:00:2a 22 link/ip/tcp: ok. (18s)
2015-09-08 09:14:33 Z executing ssh ... root@172.16.145.6 echo guest debianhvm.guest.osstest: ok
ssh: connect to host 172.16.145.6 port 22: Connection refused
The first message means that
nc -n -v -z -w $interval $ho->{Ip} $ho->{TcpCheckPort}
succeeded. The IP address is the one from DHCP and the port is 22
as you see printed. $interval is 5.
So what this means is that the osstest controller successfully made a
tcp connection to the guest's port 22. It then went on to the next
check which is actually to try ssh'ing to the host. But ssh got
ECONNREFUSED.
This means that the guest was accepting connections on 172.16.145.6:22
and then stopped doing so (perhaps only briefly).
Ian.
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [xen-unstable test] 61521: regressions - FAIL
2015-09-08 15:45 ` Ian Jackson
@ 2015-09-08 16:02 ` Jan Beulich
2015-09-08 16:13 ` Ian Jackson
0 siblings, 1 reply; 11+ messages in thread
From: Jan Beulich @ 2015-09-08 16:02 UTC (permalink / raw)
To: Ian Jackson; +Cc: xen-devel, wei.liu2, Ian Campbell
>>> On 08.09.15 at 17:45, <Ian.Jackson@eu.citrix.com> wrote:
> Ian Jackson writes ("Re: [Xen-devel] [xen-unstable test] 61521: regressions -
> FAIL"):
>> A more likely explanation is that the host sometimes fails to complete
>> its bootup within a reasonable time.
>
> Actually, looking at a bit more of the osstest transcript:
>
> 2015-09-08 09:14:32 Z guest debianhvm.guest.osstest 5a:36:0e:51:00:2a 22
> link/ip/tcp: ok. (18s)
> 2015-09-08 09:14:33 Z executing ssh ... root@172.16.145.6 echo guest
> debianhvm.guest.osstest: ok
> ssh: connect to host 172.16.145.6 port 22: Connection refused
>
> The first message means that
> nc -n -v -z -w $interval $ho->{Ip} $ho->{TcpCheckPort}
> succeeded. The IP address is the one from DHCP and the port is 22
> as you see printed. $interval is 5.
>
> So what this means is that the osstest controller successfully made a
> tcp connection to the guest's port 22. It then went on to the next
> check which is actually to try ssh'ing to the host. But ssh got
> ECONNREFUSED.
>
> This means that the guest was accepting connections on 172.16.145.6:22
> and then stopped doing so (perhaps only briefly).
That's what I was about to say in a reply to your earlier mail. To me
this still means the guest booted up successfully (or else it wouldn't
have accepted the TCP connection). I agree its "ssh server" service
is unavailable (or unreliable), which is bad, but which then again we
have no real handle to deal with without someone running into it
outside of osstest.
Whether to use this as justification for a force push I'm not sure
anyway.
Jan
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [xen-unstable test] 61521: regressions - FAIL
2015-09-08 16:02 ` Jan Beulich
@ 2015-09-08 16:13 ` Ian Jackson
2015-09-09 8:22 ` Ian Campbell
0 siblings, 1 reply; 11+ messages in thread
From: Ian Jackson @ 2015-09-08 16:13 UTC (permalink / raw)
To: Jan Beulich; +Cc: xen-devel, wei.liu2, Ian Campbell
Jan Beulich writes ("Re: [Xen-devel] [xen-unstable test] 61521: regressions - FAIL"):
> That's what I was about to say in a reply to your earlier mail. To me
> this still means the guest booted up successfully (or else it wouldn't
> have accepted the TCP connection). I agree its "ssh server" service
> is unavailable (or unreliable), which is bad, but which then again we
> have no real handle to deal with without someone running into it
> outside of osstest.
Right.
> Whether to use this as justification for a force push I'm not sure
> anyway.
I have looked a the histories of various `debianhvm' tests in many
other osstest `branches' and there do seem to be occasional similar
failures elsewhere. So Ian C wasn't right to remember that this test
step might be unreliable.
I think based on this, and Wei's analysis, a force push is justified.
Ian.
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [xen-unstable test] 61521: regressions - FAIL
2015-09-08 16:13 ` Ian Jackson
@ 2015-09-09 8:22 ` Ian Campbell
2015-09-09 10:04 ` Ian Jackson
0 siblings, 1 reply; 11+ messages in thread
From: Ian Campbell @ 2015-09-09 8:22 UTC (permalink / raw)
To: Ian Jackson, Jan Beulich; +Cc: xen-devel, wei.liu2
On Tue, 2015-09-08 at 17:13 +0100, Ian Jackson wrote:
> Jan Beulich writes ("Re: [Xen-devel] [xen-unstable test] 61521:
> regressions - FAIL"):
> > That's what I was about to say in a reply to your earlier mail. To me
> > this still means the guest booted up successfully (or else it wouldn't
> > have accepted the TCP connection). I agree its "ssh server" service
> > is unavailable (or unreliable), which is bad, but which then again we
> > have no real handle to deal with without someone running into it
> > outside of osstest.
>
> Right.
>
> > Whether to use this as justification for a force push I'm not sure
> > anyway.
>
> I have looked a the histories of various `debianhvm' tests in many
> other osstest `branches' and there do seem to be occasional similar
> failures elsewhere. So Ian C wasn't right to remember that this test
was ???
> step might be unreliable.
>
> I think based on this, and Wei's analysis, a force push is justified.
>From the original report:
> version targeted for testing:
> xen a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d
> baseline version:
> xen 801ab48e5556cb54f67e3cb57f077f47e8663ced
Therefore I have force pushed a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d.
Ian.
$ OSSTEST_CONFIG=production-config ./ap-push xen-unstable a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d
+ branch=xen-unstable
+ revision=a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d
+ . cri-lock-repos
++ . cri-common
+++ . cri-getconfig
+++ umask 002
+++ getrepos
++++ getconfig Repos
++++ perl -e '
use Osstest;
readglobalconfig();
print $c{"Repos"} or die $!;
'
+++ local repos=/home/osstest/repos
+++ '[' -z /home/osstest/repos ']'
+++ '[' '!' -d /home/osstest/repos ']'
+++ echo /home/osstest/repos
++ repos=/home/osstest/repos
++ repos_lock=/home/osstest/repos/lock
++ '[' x '!=' x/home/osstest/repos/lock ']'
++ OSSTEST_REPOS_LOCK_LOCKED=/home/osstest/repos/lock
++ exec with-lock-ex -w /home/osstest/repos/lock ./ap-push xen-unstable a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d
+ branch=xen-unstable
+ revision=a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d
+ . cri-lock-repos
++ . cri-common
+++ . cri-getconfig
+++ umask 002
+++ getrepos
++++ getconfig Repos
++++ perl -e '
use Osstest;
readglobalconfig();
print $c{"Repos"} or die $!;
'
+++ local repos=/home/osstest/repos
+++ '[' -z /home/osstest/repos ']'
+++ '[' '!' -d /home/osstest/repos ']'
+++ echo /home/osstest/repos
++ repos=/home/osstest/repos
++ repos_lock=/home/osstest/repos/lock
++ '[' x/home/osstest/repos/lock '!=' x/home/osstest/repos/lock ']'
+ . cri-common
++ . cri-getconfig
++ umask 002
+ select_xenbranch
+ case "$branch" in
+ tree=xen
+ xenbranch=xen-unstable
+ '[' xxen = xlinux ']'
+ linuxbranch=
+ '[' x = x ']'
+ qemuubranch=qemu-upstream-unstable
+ select_prevxenbranch
+ local b
+ local p
++ ./mg-list-all-branches
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.0-testing = xxen-unstable ']'
+ p=xen-4.0-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.1-testing = xxen-unstable ']'
+ p=xen-4.1-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.2-testing = xxen-unstable ']'
+ p=xen-4.2-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.3-testing = xxen-unstable ']'
+ p=xen-4.3-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.4-testing = xxen-unstable ']'
+ p=xen-4.4-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.5-testing = xxen-unstable ']'
+ p=xen-4.5-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-unstable = xxen-unstable ']'
+ break
+ prevxenbranch=xen-4.5-testing
+ : tested/2.6.39.x
+ . ap-common
++ : osstest@xenbits.xen.org
+++ getconfig OsstestUpstream
+++ perl -e '
use Osstest;
readglobalconfig();
print $c{"OsstestUpstream"} or die $!;
'
++ :
++ : git://xenbits.xen.org/xen.git
++ : osstest@xenbits.xen.org:/home/xen/git/xen.git
++ : git://xenbits.xen.org/staging/qemu-xen-unstable.git
++ : git://git.kernel.org
++ : git://git.kernel.org/pub/scm/linux/kernel/git
++ : git
++ : git://libvirt.org/libvirt.git
++ : osstest@xenbits.xen.org:/home/xen/git/libvirt.git
++ : git://xenbits.xen.org/libvirt.git
++ : https://github.com/rumpkernel/rumprun-xen
++ : git
++ : git://xenbits.xen.org/rumpuser-xen.git
++ : osstest@xenbits.xen.org:/home/xen/git/rumpuser-xen.git
+++ besteffort_repo https://github.com/rumpkernel/rumpkernel-netbsd-src
+++ local repo=https://github.com/rumpkernel/rumpkernel-netbsd-src
+++ cached_repo https://github.com/rumpkernel/rumpkernel-netbsd-src '[fetch=try]'
+++ local repo=https://github.com/rumpkernel/rumpkernel-netbsd-src
+++ local 'options=[fetch=try]'
++++ getconfig GitCacheProxy
++++ perl -e '
use Osstest;
readglobalconfig();
print $c{"GitCacheProxy"} or die $!;
'
+++ local cache=git://cache:9419/
+++ '[' xgit://cache:9419/ '!=' x ']'
+++ echo 'git://cache:9419/https://github.com/rumpkernel/rumpkernel-netbsd-src%20[fetch=try]'
++ : 'git://cache:9419/https://github.com/rumpkernel/rumpkernel-netbsd-src%20[fetch=try]'
++ : git
++ : git://git.seabios.org/seabios.git
++ : osstest@xenbits.xen.org:/home/xen/git/osstest/seabios.git
++ : git://xenbits.xen.org/osstest/seabios.git
++ : https://github.com/tianocore/edk2.git
++ : osstest@xenbits.xen.org:/home/xen/git/osstest/ovmf.git
++ : git://xenbits.xen.org/osstest/ovmf.git
++ : git://xenbits.xen.org/osstest/linux-firmware.git
++ : osstest@xenbits.xen.org:/home/osstest/ext/linux-firmware.git
++ : git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git
++ : osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
++ : git://xenbits.xen.org/linux-pvops.git
++ : tested/linux-3.14
++ : tested/linux-arm-xen
++ '[' x = x ']'
++ : git://xenbits.xen.org/linux-pvops.git
++ : tested/linux-3.14
++ '[' x = x ']'
++ : git://xenbits.xen.org/linux-pvops.git
++ : tested/linux-arm-xen
++ : git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git
++ : tested/2.6.39.x
++ : daily-cron.xen-unstable
++ : daily-cron.xen-unstable
++ : daily-cron.xen-unstable
++ : daily-cron.xen-unstable
++ : daily-cron.xen-unstable
++ : daily-cron.xen-unstable
++ : http://hg.uk.xensource.com/carbon/trunk/linux-2.6.27
++ : git://xenbits.xen.org/staging/qemu-upstream-unstable.git
++ : daily-cron.xen-unstable
++ : git://git.qemu.org/qemu.git
++ : git://xenbits.xen.org/osstest/qemu.git
++ : osstest@xenbits.xen.org:/home/xen/git/osstest/qemu.git
++ : daily-cron.xen-unstable
+ TREE_LINUX=osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
+ TREE_QEMU_MAINLINE=osstest@xenbits.xen.org:/home/xen/git/osstest/qemu.git
+ TREE_QEMU_UPSTREAM=osstest@xenbits.xen.org:/home/xen/git/qemu-upstream-unstable.git
+ TREE_XEN=osstest@xenbits.xen.org:/home/xen/git/xen.git
+ TREE_LIBVIRT=osstest@xenbits.xen.org:/home/xen/git/libvirt.git
+ TREE_RUMPUSERXEN=osstest@xenbits.xen.org:/home/xen/git/rumpuser-xen.git
+ TREE_SEABIOS=osstest@xenbits.xen.org:/home/xen/git/osstest/seabios.git
+ TREE_OVMF=osstest@xenbits.xen.org:/home/xen/git/osstest/ovmf.git
+ info_linux_tree xen-unstable
+ case $1 in
+ return 1
+ case "$branch" in
+ cd /home/osstest/repos/xen
+ git push osstest@xenbits.xen.org:/home/xen/git/xen.git a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d:master
Total 0 (delta 0), reused 0 (delta 0)
To osstest@xenbits.xen.org:/home/xen/git/xen.git
801ab48..a7b39c8 a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d -> master
^ permalink raw reply [flat|nested] 11+ messages in thread
* Re: [xen-unstable test] 61521: regressions - FAIL
2015-09-09 8:22 ` Ian Campbell
@ 2015-09-09 10:04 ` Ian Jackson
0 siblings, 0 replies; 11+ messages in thread
From: Ian Jackson @ 2015-09-09 10:04 UTC (permalink / raw)
To: Ian Campbell; +Cc: xen-devel, wei.liu2, Jan Beulich
Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 61521: regressions - FAIL"):
> On Tue, 2015-09-08 at 17:13 +0100, Ian Jackson wrote:
> > I have looked a the histories of various `debianhvm' tests in many
> > other osstest `branches' and there do seem to be occasional similar
> > failures elsewhere. So Ian C wasn't right to remember that this test
>
> was ???
Err, yes, "was", sorry!
> >From the original report:
> > version targeted for testing:
> > xen a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d
> > baseline version:
> > xen 801ab48e5556cb54f67e3cb57f077f47e8663ced
>
> Therefore I have force pushed a7b39c8bd6cba3fe1c8012987b9e28bdbac7e92d.
Thanks,
Ian.
^ permalink raw reply [flat|nested] 11+ messages in thread
end of thread, other threads:[~2015-09-09 10:04 UTC | newest]
Thread overview: 11+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-09-08 14:30 [xen-unstable test] 61521: regressions - FAIL osstest service owner
2015-09-08 14:52 ` Wei Liu
2015-09-08 15:13 ` Ian Campbell
2015-09-08 15:32 ` Wei Liu
2015-09-08 15:14 ` Jan Beulich
2015-09-08 15:35 ` Ian Jackson
2015-09-08 15:45 ` Ian Jackson
2015-09-08 16:02 ` Jan Beulich
2015-09-08 16:13 ` Ian Jackson
2015-09-09 8:22 ` Ian Campbell
2015-09-09 10:04 ` Ian Jackson
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.