* [linux-4.9 test] 110513: regressions - FAIL
@ 2017-06-17 22:20 osstest service owner
2017-06-19 10:55 ` blkback shutdown problem ? (Re: [linux-4.9 test] 110513: regressions - FAIL) Ian Jackson
0 siblings, 1 reply; 6+ messages in thread
From: osstest service owner @ 2017-06-17 22:20 UTC (permalink / raw)
To: xen-devel, osstest-admin
[-- Attachment #1: Type: text/plain, Size: 17797 bytes --]
flight 110513 linux-4.9 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/110513/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-amd64-xl-credit2 19 guest-start/debian.repeat fail REGR. vs. 110456
test-amd64-amd64-xl-qemuu-win7-amd64 15 guest-localmigrate/x10 fail REGR. vs. 110456
Regressions which are regarded as allowable (not blocking):
test-armhf-armhf-xl-rtds 15 guest-start/debian.repeat fail REGR. vs. 110456
Tests which did not succeed, but are not blocking:
test-amd64-amd64-xl-qemut-win7-amd64 17 guest-start/win.repeat fail blocked in 110456
test-amd64-i386-xl-qemuu-win7-amd64 16 guest-stop fail like 110456
test-amd64-i386-xl-qemut-win7-amd64 16 guest-stop fail like 110456
test-amd64-amd64-xl-rtds 9 debian-install fail like 110456
test-amd64-i386-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-i386-libvirt 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-xl-qemuu-ws16-amd64 9 windows-install fail never pass
test-arm64-arm64-xl 12 migrate-support-check fail never pass
test-arm64-arm64-xl 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 13 saverestore-support-check fail never pass
test-armhf-armhf-xl 12 migrate-support-check fail never pass
test-armhf-armhf-xl 13 saverestore-support-check fail never pass
test-armhf-armhf-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt-xsm 13 saverestore-support-check fail never pass
test-amd64-amd64-xl-qemut-ws16-amd64 9 windows-install fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-arm64-arm64-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-arm64-arm64-libvirt-xsm 13 saverestore-support-check fail never pass
test-amd64-amd64-qemuu-nested-amd 16 debian-hvm-install/l1/l2 fail never pass
test-arm64-arm64-xl-credit2 12 migrate-support-check fail never pass
test-arm64-arm64-xl-credit2 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-rtds 12 migrate-support-check fail never pass
test-armhf-armhf-xl-rtds 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
test-armhf-armhf-xl-multivcpu 13 saverestore-support-check fail never pass
test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt 13 saverestore-support-check fail never pass
test-armhf-armhf-libvirt-raw 11 migrate-support-check fail never pass
test-armhf-armhf-libvirt-raw 12 saverestore-support-check fail never pass
test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
test-armhf-armhf-xl-vhd 11 migrate-support-check fail never pass
test-armhf-armhf-xl-vhd 12 saverestore-support-check fail never pass
test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-xl-xsm 13 saverestore-support-check fail never pass
test-arm64-arm64-xl-xsm 12 migrate-support-check fail never pass
test-arm64-arm64-xl-xsm 13 saverestore-support-check fail never pass
test-amd64-amd64-xl-qemuu-win10-i386 9 windows-install fail never pass
test-amd64-i386-xl-qemut-win10-i386 9 windows-install fail never pass
test-amd64-i386-xl-qemuu-win10-i386 9 windows-install fail never pass
test-amd64-i386-xl-qemuu-ws16-amd64 9 windows-install fail never pass
test-amd64-i386-xl-qemut-ws16-amd64 9 windows-install fail never pass
test-amd64-amd64-xl-qemut-win10-i386 9 windows-install fail never pass
version targeted for testing:
linux 050639ef5810e8ad17fb6a426eff3c63e616350c
baseline version:
linux 05afd4c0af6a43f6bda7caaacb01bc0116d50d3b
Last test of basis 110456 2017-06-14 22:55:22 Z 2 days
Testing same since 110513 2017-06-17 05:27:38 Z 0 days 1 attempts
------------------------------------------------------------
People who touched revisions under test:
Al Viro <viro@zeniv.linux.org.uk>
Alex Williamson <alex.williamson@redhat.com>
Alexander Potapenko <glider@google.com>
Alexey Kardashevskiy <aik@ozlabs.ru>
Alexey Khoroshilov <khoroshilov@ispras.ru>
Andrea Arcangeli <aarcange@redhat.com>
Andreas Schultz <aschultz@tpip.net>
Andrew Morton <akpm@linux-foundation.org>
Andrey Ryabinin <aryabinin@virtuozzo.com>
Andy Shevchenko <andriy.shevchenko@linux.intel.com>
Anssi Hannula <anssi.hannula@bitwise.fi>
Ard Biesheuvel <ard.biesheuvel@linaro.org>
Ariel Elior <Ariel.Elior@cavium.com>
Arnd Bergmann <arnd@arndb.de>
Arseny Solokha <asolokha@kb.kras.ru>
Babu Moger <babu.moger@oracle.com>
Ben Skeggs <bskeggs@redhat.com>
Benjamin Coddington <bcodding@redhat.com>
Benjamin Herrenschmidt <benh@kernel.crashing.org>
Bin Liu <b-liu@ti.com>
Bjorn Helgaas <bhelgaas@google.com>
Chris Wilson <chris@chris-wilson.co.uk>
Christian Borntraeger <borntraeger@de.ibm.com>
Christophe Leroy <christophe.leroy@c-s.fr>
Chuck Lever <chuck.lever@oracle.com>
Claudiu Manoil <claudiu.manoil@nxp.com>
Coly Li <colyli@suse.de>
Dan Carpenter <dan.carpenter@oracle.com>
Daniel Vetter <daniel.vetter@ffwll.ch>
Daniel Vetter <daniel.vetter@intel.com>
Dave Airlie <airlied@redhat.com>
David Howells <dhowells@redhat.com>
David Lin <dtwlin@google.com>
David S. Miller <davem@davemloft.net>
Dimitris Michailidis <dmichail@google.com>
Don Zickus <dzickus@redhat.com>
Doug Ledford <dledford@redhat.com>
Eric Dumazet <edumazet@google.com>
Florian Fainelli <f.fainelli@gmail.com>
Frank Sorenson <sorenson@redhat.com>
Greg Kroah-Hartman <gregkh@linuxfoundation.org>
Hans de Goede <hdegoede@redhat.com>
Hans Verkuil <hans.verkuil@cisco.com>
Hans Verkuil <hverkuil@xs4all.nl>
Harald Welte <laforge@netfilter.org>
Hayes Wang <hayeswang@realtek.com>
hayeswang <hayeswang@realtek.com>
Helge Deller <deller@gmx.de>
Herbert Xu <herbert@gondor.apana.org.au>
Hillf Danton <hillf.zj@alibaba-inc.com>
Imre Deak <imre.deak@intel.com>
Jack Morgenstein <jackm@dev.mellanox.co.il>
Jani Nikula <jani.nikula@intel.com>
Jean Delvare <jdelvare@suse.de>
Jeff Layton <jlayton@redhat.com>
Jens Axboe <axboe@fb.com>
Jeremy McNicoll <jeremymc@redhat.com>
Jisheng Zhang <jszhang@marvell.com>
John Crispin <john@phrozen.org>
John Thompson <thompa.atl@gmail.com>
Jon Maloy <jon.maloy@ericsson.com>
Jonas Aaberg <cja@gmx.net>
Jonathan T. Leighton <jtleight@udel.edu>
Kazuya Mizuguchi <kazuya.mizuguchi.ks@renesas.com>
Kejian Yan <yankejian@huawei.com>
Kirill A. Shutemov <kirill.shutemov@linux.intel.com>
Linus Lüssing <linus.luessing@c0d3.blue>
Linus Torvalds <torvalds@linux-foundation.org>
Linus Walleij <linus.walleij@linaro.org>
Liping Zhang <zlpnobody@gmail.com>
Luis R. Rodriguez <mcgrof@kernel.org>
Lyude <lyude@redhat.com>
Lyude Paul <lyude@redhat.com>
Maarten Lankhorst <maarten.lankhorst@linux.intel.com>
Mao Wenan <maowenan@huawei.com>
Marcus Huewe <suse-tux@gmx.de>
Martin Schwidefsky <schwidefsky@de.ibm.com>
Mauro Carvalho Chehab <mchehab@s-opensource.com>
Max Filippov <jcmvbkbc@gmail.com>
Michael Chan <michael.chan@broadcom.com>
Michael Ellerman <mpe@ellerman.id.au>
Michael S. Tsirkin <mst@redhat.com>
Michal Kalderon <Michal.Kalderon@cavium.com>
Mika Kahola <mika.kahola@intel.com>
Mika Westerberg <mika.westerberg@linux.intel.com>
Mike Kravetz <mike.kravetz@oracle.com>
Nathan Fontenot <nfont@linux.vnet.ibm.com>
Neil Horman <nhorman@tuxdriver.com>
Nong Li <nongli1031@gmail.com>
Or Gerlitz <ogerlitz@mellanox.com>
Pablo Neira Ayuso <pablo@netfilter.org>
Parav Pandit <parav@mellanox.com>
Parthasarathy Bhuvaragan <parthasarathy.bhuvaragan@ericsson.com>
Peter Ujfalusi <peter.ujfalusi@ti.com>
Peter Zijlstra (Intel) <peterz@infradead.org>
Peter Zijlstra <peterz@infradead.org>
Rafael J. Wysocki <rafael.j.wysocki@intel.com>
Ralf Baechle <ralf@linux-mips.org>
Ram Amrani <Ram.Amrani@cavium.com>
Randy Dunlap <rdunlap@infradead.org>
Ricardo Ribalda <ricardo.ribalda@gmail.com>
Ricardo Ribalda Delgado <ricardo.ribalda@gmail.com>
Richard <richard@aaazen.com>
Richard Narron <comet.berkeley@gmail.com>
Saeed Mahameed <saeedm@mellanox.com>
Salil Mehta <salil.mehta@huawei.com>
Sasha Levin <alexander.levin@verizon.com>
Sean Nyekjaer <sean.nyekjaer@prevas.dk>
Sergei Shtylyov <sergei.shtylyov@cogentembedded.com>
Simon Horman <horms+renesas@verge.net.au>
Stanislaw Gruszka <sgruszka@redhat.com>
Stefan Brüns <stefan.bruens@rwth-aachen.de>
Stefan Hajnoczi <stefanha@redhat.com>
Steve Dickson <steved@redhat.com>
Steven Rostedt <rostedt@goodmis.org>
Sudip Mukherjee <sudip.mukherjee@codethink.co.uk>
Sudip Mukherjee <sudipm.mukherjee@gmail.com>
Sunil Goutham <sgoutham@cavium.com>
Tariq Toukan <tariqt@mellanox.com>
Thanneeru Srinivasulu <tsrinivasulu@cavium.com>
Thomas Falcon <tlfalcon@linux.vnet.ibm.com>
Thomas Osterried <thomas@osterried.de>
Tony Lindgren <tony@atomide.com>
Trond Myklebust <trond.myklebust@primarydata.com>
Ville Syrjälä <ville.syrjala@linux.intel.com>
Vineet Gupta <vgupta@synopsys.com>
Wolfram Sang <wsa@the-dreams.de>
Xin Long <lucien.xin@gmail.com>
Xuan Qi <xuan.qi@oracle.com>
Y.C. Chen <yc_chen@aspeedtech.com>
Ying Xue <ying.xue@windriver.com>
jobs:
build-amd64-xsm pass
build-arm64-xsm pass
build-armhf-xsm pass
build-i386-xsm pass
build-amd64 pass
build-arm64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-arm64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-pvops pass
build-arm64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
build-amd64-rumprun pass
build-i386-rumprun pass
test-amd64-amd64-xl pass
test-arm64-arm64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl pass
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-xsm pass
test-arm64-arm64-libvirt-xsm pass
test-armhf-armhf-libvirt-xsm pass
test-amd64-i386-libvirt-xsm pass
test-amd64-amd64-xl-xsm pass
test-arm64-arm64-xl-xsm pass
test-armhf-armhf-xl-xsm pass
test-amd64-i386-xl-xsm pass
test-amd64-amd64-qemuu-nested-amd fail
test-amd64-amd64-xl-pvh-amd pass
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-rumprun-amd64 pass
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-amd64-amd64-xl-qemut-ws16-amd64 fail
test-amd64-i386-xl-qemut-ws16-amd64 fail
test-amd64-amd64-xl-qemuu-ws16-amd64 fail
test-amd64-i386-xl-qemuu-ws16-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit2 fail
test-arm64-arm64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-amd64-examine pass
test-arm64-arm64-examine pass
test-armhf-armhf-examine pass
test-amd64-i386-examine pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-i386-rumprun-i386 pass
test-amd64-amd64-xl-qemut-win10-i386 fail
test-amd64-i386-xl-qemut-win10-i386 fail
test-amd64-amd64-xl-qemuu-win10-i386 fail
test-amd64-i386-xl-qemuu-win10-i386 fail
test-amd64-amd64-qemuu-nested-intel pass
test-amd64-amd64-xl-pvh-intel pass
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt pass
test-amd64-i386-libvirt pass
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-amd64-amd64-libvirt-pair pass
test-amd64-i386-libvirt-pair pass
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-pygrub pass
test-amd64-amd64-xl-qcow2 pass
test-armhf-armhf-libvirt-raw pass
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds fail
test-armhf-armhf-xl-rtds fail
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-xl-vhd pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
Not pushing.
(No revision log; it would be 3321 lines long.)
[-- Attachment #2: Type: text/plain, Size: 127 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* blkback shutdown problem ? (Re: [linux-4.9 test] 110513: regressions - FAIL)
2017-06-17 22:20 [linux-4.9 test] 110513: regressions - FAIL osstest service owner
@ 2017-06-19 10:55 ` Ian Jackson
2017-06-19 11:27 ` Roger Pau Monné
0 siblings, 1 reply; 6+ messages in thread
From: Ian Jackson @ 2017-06-19 10:55 UTC (permalink / raw)
To: Boris Ostrovsky, Konrad Rzeszutek Wilk, Roger Pau Monné
Cc: Dario Faggioli, xen-devel
osstest service owner writes ("[linux-4.9 test] 110513: regressions - FAIL"):
> flight 110513 linux-4.9 real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/110513/
>
> Regressions :-(
>
> Tests which did not succeed and are blocking,
> including tests which could not be run:
> test-amd64-amd64-xl-credit2 19 guest-start/debian.repeat fail REGR. vs. 110456
In the spirit of trying to chase down heisenbugs: failures like this
seem to occur occasionally. Here are the job-specific logs:
http://logs.test-lab.xenproject.org/osstest/logs/110513/test-amd64-amd64-xl-credit2/info.html
My observations looking at the logs:
* The test was declared a failure because something, almost certainly
blkback, still had the LV open when osstest wanted to restart the
guest. This occurred 14 seconds after `xl shutdown -w' had
completed and `xl list' said the domain did not exist, so it is
not a simple race between the old and new domains.
* The xenstored access log shows the toolstack deleting the vbd
backend during the shutdown, as expected.
* `xl list' shows two zombie domains: 17 (the recently-shut-down
guest) and 16 (the previous one).
* The toolstack log shows that xl thinks it successfully shut down
domain 17 and then destroyed it.
* The hotplug script log is empty.
* I see nothing relevant in the dom0 serial log, before the failure
I conjecture that blkback is not shutting down properly.
I haven't investigated which osstest branches this occurs on and what
the failure frequency is like.
Ian.
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: blkback shutdown problem ? (Re: [linux-4.9 test] 110513: regressions - FAIL)
2017-06-19 10:55 ` blkback shutdown problem ? (Re: [linux-4.9 test] 110513: regressions - FAIL) Ian Jackson
@ 2017-06-19 11:27 ` Roger Pau Monné
2017-06-19 13:18 ` Konrad Rzeszutek Wilk
0 siblings, 1 reply; 6+ messages in thread
From: Roger Pau Monné @ 2017-06-19 11:27 UTC (permalink / raw)
To: Ian Jackson; +Cc: Boris Ostrovsky, xen-devel, Dario Faggioli
On Mon, Jun 19, 2017 at 11:55:14AM +0100, Ian Jackson wrote:
> osstest service owner writes ("[linux-4.9 test] 110513: regressions - FAIL"):
> > flight 110513 linux-4.9 real [real]
> > http://logs.test-lab.xenproject.org/osstest/logs/110513/
> >
> > Regressions :-(
> >
> > Tests which did not succeed and are blocking,
> > including tests which could not be run:
> > test-amd64-amd64-xl-credit2 19 guest-start/debian.repeat fail REGR. vs. 110456
>
> In the spirit of trying to chase down heisenbugs: failures like this
> seem to occur occasionally. Here are the job-specific logs:
>
> http://logs.test-lab.xenproject.org/osstest/logs/110513/test-amd64-amd64-xl-credit2/info.html
>
> My observations looking at the logs:
>
> * The test was declared a failure because something, almost certainly
> blkback, still had the LV open when osstest wanted to restart the
> guest. This occurred 14 seconds after `xl shutdown -w' had
> completed and `xl list' said the domain did not exist, so it is
> not a simple race between the old and new domains.
>
> * The xenstored access log shows the toolstack deleting the vbd
> backend during the shutdown, as expected.
>
> * `xl list' shows two zombie domains: 17 (the recently-shut-down
> guest) and 16 (the previous one).
>
> * The toolstack log shows that xl thinks it successfully shut down
> domain 17 and then destroyed it.
>
> * The hotplug script log is empty.
>
> * I see nothing relevant in the dom0 serial log, before the failure
>
> I conjecture that blkback is not shutting down properly.
>
> I haven't investigated which osstest branches this occurs on and what
> the failure frequency is like.
This has already been noticed and fixed by Juergen [0], however AFAIK
the patches are not yet in Jens/Linus tree, so it's too early to
request a backport.
Roger.
[0] http://marc.info/?l=xen-devel&m=149512136831508&w=2
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: blkback shutdown problem ? (Re: [linux-4.9 test] 110513: regressions - FAIL)
2017-06-19 11:27 ` Roger Pau Monné
@ 2017-06-19 13:18 ` Konrad Rzeszutek Wilk
2017-06-19 14:27 ` Ian Jackson
0 siblings, 1 reply; 6+ messages in thread
From: Konrad Rzeszutek Wilk @ 2017-06-19 13:18 UTC (permalink / raw)
To: Roger Pau Monné
Cc: Boris Ostrovsky, xen-devel, Ian Jackson, Dario Faggioli
On Mon, Jun 19, 2017 at 12:27:33PM +0100, Roger Pau Monné wrote:
> On Mon, Jun 19, 2017 at 11:55:14AM +0100, Ian Jackson wrote:
> > osstest service owner writes ("[linux-4.9 test] 110513: regressions - FAIL"):
> > > flight 110513 linux-4.9 real [real]
> > > http://logs.test-lab.xenproject.org/osstest/logs/110513/
> > >
> > > Regressions :-(
> > >
> > > Tests which did not succeed and are blocking,
> > > including tests which could not be run:
> > > test-amd64-amd64-xl-credit2 19 guest-start/debian.repeat fail REGR. vs. 110456
> >
> > In the spirit of trying to chase down heisenbugs: failures like this
> > seem to occur occasionally. Here are the job-specific logs:
> >
> > http://logs.test-lab.xenproject.org/osstest/logs/110513/test-amd64-amd64-xl-credit2/info.html
> >
> > My observations looking at the logs:
> >
> > * The test was declared a failure because something, almost certainly
> > blkback, still had the LV open when osstest wanted to restart the
> > guest. This occurred 14 seconds after `xl shutdown -w' had
> > completed and `xl list' said the domain did not exist, so it is
> > not a simple race between the old and new domains.
> >
> > * The xenstored access log shows the toolstack deleting the vbd
> > backend during the shutdown, as expected.
> >
> > * `xl list' shows two zombie domains: 17 (the recently-shut-down
> > guest) and 16 (the previous one).
> >
> > * The toolstack log shows that xl thinks it successfully shut down
> > domain 17 and then destroyed it.
> >
> > * The hotplug script log is empty.
> >
> > * I see nothing relevant in the dom0 serial log, before the failure
> >
> > I conjecture that blkback is not shutting down properly.
> >
> > I haven't investigated which osstest branches this occurs on and what
> > the failure frequency is like.
>
> This has already been noticed and fixed by Juergen [0], however AFAIK
> the patches are not yet in Jens/Linus tree, so it's too early to
> request a backport.
>
> Roger.
>
> [0] http://marc.info/?l=xen-devel&m=149512136831508&w=2
I will send the git pull tomorrow. Thanks.
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: blkback shutdown problem ? (Re: [linux-4.9 test] 110513: regressions - FAIL)
2017-06-19 13:18 ` Konrad Rzeszutek Wilk
@ 2017-06-19 14:27 ` Ian Jackson
2017-06-19 14:53 ` Konrad Rzeszutek Wilk
0 siblings, 1 reply; 6+ messages in thread
From: Ian Jackson @ 2017-06-19 14:27 UTC (permalink / raw)
To: Konrad Rzeszutek Wilk
Cc: Boris Ostrovsky, xen-devel, Dario Faggioli, Roger Pau Monné
Konrad Rzeszutek Wilk writes ("Re: blkback shutdown problem ? (Re: [linux-4.9 test] 110513: regressions - FAIL)"):
> On Mon, Jun 19, 2017 at 12:27:33PM +0100, Roger Pau Monné wrote:
> > This has already been noticed and fixed by Juergen [0], however AFAIK
> > the patches are not yet in Jens/Linus tree, so it's too early to
> > request a backport.
...
> I will send the git pull tomorrow. Thanks.
Thanks.
From the pov of updating osstest to Linux 4.9:
13:55 <Diziet> juergen_gross: Re your patch series "xen/blkback:
several fixes of resource management", DYK how long
this problem has existed ?
13:55 <Diziet> Specifically, DYK if it is a problem in 3.18 ?
14:10 <royger> Diziet: I think this was introduced with the multiqueue
blkback patches, or at least it make it easier to
surface
I think the last thing we want in our main kernel for osstest is more
heisenbugs. So I propose to wait for this fix to make it into
osstest-tested version of linux-4.9.
Konrad, can you please CC me on the pull request so I can track this ?
Thanks,
Ian.
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: blkback shutdown problem ? (Re: [linux-4.9 test] 110513: regressions - FAIL)
2017-06-19 14:27 ` Ian Jackson
@ 2017-06-19 14:53 ` Konrad Rzeszutek Wilk
0 siblings, 0 replies; 6+ messages in thread
From: Konrad Rzeszutek Wilk @ 2017-06-19 14:53 UTC (permalink / raw)
To: Ian Jackson
Cc: Boris Ostrovsky, xen-devel, Dario Faggioli, Roger Pau Monné
On Mon, Jun 19, 2017 at 03:27:01PM +0100, Ian Jackson wrote:
> Konrad Rzeszutek Wilk writes ("Re: blkback shutdown problem ? (Re: [linux-4.9 test] 110513: regressions - FAIL)"):
> > On Mon, Jun 19, 2017 at 12:27:33PM +0100, Roger Pau Monné wrote:
> > > This has already been noticed and fixed by Juergen [0], however AFAIK
> > > the patches are not yet in Jens/Linus tree, so it's too early to
> > > request a backport.
> ...
> > I will send the git pull tomorrow. Thanks.
>
> Thanks.
>
> >From the pov of updating osstest to Linux 4.9:
>
> 13:55 <Diziet> juergen_gross: Re your patch series "xen/blkback:
> several fixes of resource management", DYK how long
> this problem has existed ?
> 13:55 <Diziet> Specifically, DYK if it is a problem in 3.18 ?
>
> 14:10 <royger> Diziet: I think this was introduced with the multiqueue
> blkback patches, or at least it make it easier to
> surface
>
> I think the last thing we want in our main kernel for osstest is more
> heisenbugs. So I propose to wait for this fix to make it into
> osstest-tested version of linux-4.9.
>
> Konrad, can you please CC me on the pull request so I can track this ?
Of course.
>
> Thanks,
> Ian.
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2017-06-19 14:53 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2017-06-17 22:20 [linux-4.9 test] 110513: regressions - FAIL osstest service owner
2017-06-19 10:55 ` blkback shutdown problem ? (Re: [linux-4.9 test] 110513: regressions - FAIL) Ian Jackson
2017-06-19 11:27 ` Roger Pau Monné
2017-06-19 13:18 ` Konrad Rzeszutek Wilk
2017-06-19 14:27 ` Ian Jackson
2017-06-19 14:53 ` Konrad Rzeszutek Wilk
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).