Re: [adhoc osstest bisection] complete test-amd64-amd64-xl

All of lore.kernel.org
 help / color / mirror / Atom feed

* Re: [adhoc osstest bisection] complete test-amd64-amd64-xl
       [not found] <E1YvEaU-000521-KH@osstest.xs.citrite.net>
@ 2015-05-21  9:16 ` Ian Campbell
  2015-05-21  9:31   ` Jan Beulich
  0 siblings, 1 reply; 3+ messages in thread
From: Ian Campbell @ 2015-05-21  9:16 UTC (permalink / raw)
  To: Andrew Cooper, Konrad Rzeszutek Wilk, Jan Beulich; +Cc: ian.jackson, xen-devel

The osstest instance in Cambridge appears to have found a machine
specific failure which a bisect has blamed on the "x86/domctl: cleanup"
patch below.

(NB: this is not the arm releated leak check thing which is currently
hitting the xen-unstable flights in the main osstest instance)

Since the logs are internal I've put a copy of the bisection output at
http://xenbits.xen.org/people/ianc/tmp/bisect.osstest.test-amd64-amd64-xl..html

Along with the logs of the first two passes from the last good revision:
http://xenbits.xen.org/people/ianc/tmp/37537/
http://xenbits.xen.org/people/ianc/tmp/37541/
and the logs from the first two fails from the first bad revision:
http://xenbits.xen.org/people/ianc/tmp/37540/
http://xenbits.xen.org/people/ianc/tmp/37542/

The failure is in migration at e.g.

http://xenbits.xen.org/people/ianc/tmp/37540/test-amd64-amd64-xl/17.ts-guest-localmigrate.log

Anyone got any thoughts on this?

Ian.

On Thu, 2015-05-21 at 01:43 +0100, xen.org wrote:
> branch xen-unstable
> xen branch xen-unstable
> job test-amd64-amd64-xl
> test guest-localmigrate/x10
> 
> Tree: linux git://xenbits.xen.org/linux-pvops.git
> Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
> Tree: qemu git://xenbits.xen.org/staging/qemu-xen-unstable.git
> Tree: qemuu git://xenbits.xen.org/staging/qemu-upstream-unstable.git
> Tree: xen git://xenbits.xen.org/xen.git
> 
> *** Found and reproduced problem changeset ***
> 
>   Bug is in tree:  xen git://xenbits.xen.org/xen.git
>   Bug introduced:  38b37ed8270532c70df1a8ddae6aa300aa4ca09f
>   Bug not present: 4ff3449f0e9d175ceb9551d3f2aecb59273f639d
> 
> 
>   commit 38b37ed8270532c70df1a8ddae6aa300aa4ca09f
>   Author: Andrew Cooper <andrew.cooper3@citrix.com>
>   Date:   Tue Apr 21 09:04:45 2015 +0200
>   
>       x86/domctl: cleanup
>       
>        * latch curr/currd once at start
>        * drop redundant "ret = 0" and braces
>        * use "copyback = 1" when appropriate
>        * move break statements inside case-specific braced scopes
>        * don't bother check for NULL before calling xfree()
>        * eliminate trailing whitespace
>        * Xen style corrections
>       
>       Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com>
>       Reviewed-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
>       Reviewed-by: Jan Beulich <jbeulich@suse.com>
> 
> 
> For bisection revision-tuple graph see:
>    http://osstest.xs.citrite.net/~osstest/testlogs/results-adhoc/bisect.osstest.test-amd64-amd64-xl..html
> Revision IDs in each graph node refer, respectively, to the Trees above.
> 
> ----------------------------------------
> Searching for failure / basis pass:
>  37475 fail [host=bush-cricket] / 37517 ok.
> Failure / basis pass flights: 37475 / 37517
> (tree with no url: ovmf)
> (tree with no url: seabios)
> Tree: linux git://xenbits.xen.org/linux-pvops.git
> Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git
> Tree: qemu git://xenbits.xen.org/staging/qemu-xen-unstable.git
> Tree: qemuu git://xenbits.xen.org/staging/qemu-upstream-unstable.git
> Tree: xen git://xenbits.xen.org/xen.git
> Latest c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
> Basis pass 01c343844ceb1d4a1dc25763b633f73e05fe93e7 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb bf68adcadaa2b0885c5d2f1c8e2e068e209eb041
> Generating revisions with ./adhoc-revtuple-generator  git://xenbits.xen.org/linux-pvops.git#01c343844ceb1d4a1dc25763b633f73e05fe93e7-c629522ee8c9983fbd7e572e10041e0a96904d15 git://xenbits.xen.org/osstest/linux-firmware.git#c530a75c1e6a472b0eb9558310b518f0dfcd8860-c530a75c1e6a472b0eb9558310b518f0dfcd8860 git://xenbits.xen.org/staging/qemu-xen-unstable.git#3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5-3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 git://xenbits.xen.org/staging/qemu-upstream-unstable.git#727b998448e852a5e8eb570ac3a259ef62fbdacb-b2da824bc5ad35fb9f1e74a203d7be96a7b0345e git://xenbits.xen.org/xen.git#bf68adcadaa2b0885c5d2f1c8e2e068e209eb041-e13013dbf1d5997915548a3b5f1c39594d8c1d7b
> + exec
> + sh -xe
> + cd /export/home/osstest/repos/linux-pvops
> + git remote set-url origin git://drall.uk.xensource.com:9419/git://xenbits.xen.org/linux-pvops.git
> + git fetch -p origin +refs/heads/*:refs/remotes/origin/*
> + exec
> + sh -xe
> + cd /export/home/osstest/repos/qemu-upstream-unstable
> + git remote set-url origin git://drall.uk.xensource.com:9419/git://xenbits.xen.org/staging/qemu-upstream-unstable.git
> + git fetch -p origin +refs/heads/*:refs/remotes/origin/*
> + exec
> + sh -xe
> + cd /export/home/osstest/repos/xen
> + git remote set-url origin git://drall.uk.xensource.com:9419/git://xenbits.xen.org/xen.git
> + git fetch -p origin +refs/heads/*:refs/remotes/origin/*
> + exec
> + sh -xe
> + cd /export/home/osstest/repos/linux-pvops
> + git remote set-url origin git://drall.uk.xensource.com:9419/git://xenbits.xen.org/linux-pvops.git
> + git fetch -p origin +refs/heads/*:refs/remotes/origin/*
> + exec
> + sh -xe
> + cd /export/home/osstest/repos/qemu-upstream-unstable
> + git remote set-url origin git://drall.uk.xensource.com:9419/git://xenbits.xen.org/staging/qemu-upstream-unstable.git
> + git fetch -p origin +refs/heads/*:refs/remotes/origin/*
> + exec
> + sh -xe
> + cd /export/home/osstest/repos/xen
> + git remote set-url origin git://drall.uk.xensource.com:9419/git://xenbits.xen.org/xen.git
> + git fetch -p origin +refs/heads/*:refs/remotes/origin/*
> Loaded 3007 nodes in revision graph
> Searching for test results:
>  37287 [host=lace-bug]
>  37291 pass irrelevant
>  37343 [host=moss-bug]
>  37299 [host=lake-frog]
>  37348 [host=potato-beetle]
>  37341 [host=gall-mite]
>  37361 [host=leaf-beetle]
>  37368 [host=scape-moth]
>  37369 [host=rice-weevil]
>  37356 [host=itch-mite]
>  37378 [host=lake-frog]
>  37416 [host=lace-bug]
>  37482 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37505 blocked 8c56b5e2a58b2ee9e9199a6a49fbb4a42491a468 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 6a47d1ef7af7f5df35986b5084ce61a2255b649e 5fa1ce85bc661f2f945b8a5327b6cec7cf69cfba
>  37440 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37485 pass irrelevant
>  37431 blocked c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37439 blocked c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37501 pass irrelevant
>  37495 blocked 8f9a7898757387b97dcba1d35ad0f44c710cbb21 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 6a47d1ef7af7f5df35986b5084ce61a2255b649e 5c44b5cf352e4d71bb15197560a7e552f0920764
>  37467 blocked c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37475 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37481 blocked c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37472 blocked c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37496 !! flight 37496 mixed revisions for qemu: 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 and ab42b4408cb4fc4f869d73218e3d2034e6f5e8ac
> !! flight 37496 mixed revisions for qemu: 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 and ab42b4408cb4fc4f869d73218e3d2034e6f5e8ac
>  37502 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37497 !! flight 37497 mixed revisions for qemu: 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 and ab42b4408cb4fc4f869d73218e3d2034e6f5e8ac
> !! flight 37497 mixed revisions for qemu: 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 and ab42b4408cb4fc4f869d73218e3d2034e6f5e8ac
>  37511 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37488 fail irrelevant
>  37489 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37498 !! flight 37498 mixed revisions for qemu: 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 and ab42b4408cb4fc4f869d73218e3d2034e6f5e8ac
> !! flight 37498 mixed revisions for qemu: 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 and ab42b4408cb4fc4f869d73218e3d2034e6f5e8ac
>  37494 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e78e8b9bb649bf0f18d940fb12a4f6c55be34915
>  37506 pass irrelevant
>  37503 pass irrelevant
>  37499 !! flight 37499 mixed revisions for qemu: 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 and ab42b4408cb4fc4f869d73218e3d2034e6f5e8ac
> !! flight 37499 mixed revisions for qemu: 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 and ab42b4408cb4fc4f869d73218e3d2034e6f5e8ac
>  37500 !! flight 37500 mixed revisions for qemu: 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 and ab42b4408cb4fc4f869d73218e3d2034e6f5e8ac
> !! flight 37500 mixed revisions for qemu: 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 and ab42b4408cb4fc4f869d73218e3d2034e6f5e8ac
>  37509 pass irrelevant
>  37504 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37507 blocked c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37510 blocked c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37508 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37514 blocked 7b10379295be179d229783eb3a76fb0ae22097fe c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 6a47d1ef7af7f5df35986b5084ce61a2255b649e b83bf83c12bcbbd76688195048fa65e61d4b4197
>  37513 blocked 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 74fcdb636e77ca2f3b6cf71c2aebcb8f6ad768cd
>  37512 fail 7b10379295be179d229783eb3a76fb0ae22097fe c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 6a47d1ef7af7f5df35986b5084ce61a2255b649e d72a4605e18d3a61c4469ff092dbbbfa4ac919f7
>  37516 fail 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 878b5e8fb5126f52817ae3b6e5eadb3da97fcd85
>  37515 blocked 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 6a47d1ef7af7f5df35986b5084ce61a2255b649e ebd41901b96565b392e8d434a4c4ab543d5fb52b
>  37517 pass 01c343844ceb1d4a1dc25763b633f73e05fe93e7 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb bf68adcadaa2b0885c5d2f1c8e2e068e209eb041
>  37518 blocked c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37519 blocked c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37520 blocked c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37521 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37522 pass 01c343844ceb1d4a1dc25763b633f73e05fe93e7 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb bf68adcadaa2b0885c5d2f1c8e2e068e209eb041
>  37523 fail c629522ee8c9983fbd7e572e10041e0a96904d15 c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 b2da824bc5ad35fb9f1e74a203d7be96a7b0345e e13013dbf1d5997915548a3b5f1c39594d8c1d7b
>  37524 blocked 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 176d24bcb2e7e43ca9e1178b06f81b49fdbb9142
>  37537 pass 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 4ff3449f0e9d175ceb9551d3f2aecb59273f639d
>  37539 blocked 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 5d4c0952f8da103e99d9b8c1fc6814dabd397df6
>  37540 fail 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 38b37ed8270532c70df1a8ddae6aa300aa4ca09f
>  37541 pass 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 4ff3449f0e9d175ceb9551d3f2aecb59273f639d
>  37542 fail 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 38b37ed8270532c70df1a8ddae6aa300aa4ca09f
>  37543 pass 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 4ff3449f0e9d175ceb9551d3f2aecb59273f639d
>  37544 blocked 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 38b37ed8270532c70df1a8ddae6aa300aa4ca09f
>  37545 fail 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 38b37ed8270532c70df1a8ddae6aa300aa4ca09f
> Searching for interesting versions
>  Result found: flight 37517 (pass), for basis pass
>  Result found: flight 37521 (fail), for basis failure
>  Repro found: flight 37522 (pass), for basis pass
>  Repro found: flight 37523 (fail), for basis failure
>  0 revisions at 5c43c539346972b9a1d5f38dc62db5a39997488d c530a75c1e6a472b0eb9558310b518f0dfcd8860 3b45fcf0c163b9cff4d8115f7b75b42918a9b1b5 727b998448e852a5e8eb570ac3a259ef62fbdacb 4ff3449f0e9d175ceb9551d3f2aecb59273f639d
> No revisions left to test, checking graph state.
>  Result found: flight 37537 (pass), for last pass
>  Result found: flight 37540 (fail), for first failure
>  Repro found: flight 37541 (pass), for last pass
>  Repro found: flight 37542 (fail), for first failure
>  Repro found: flight 37543 (pass), for last pass
>  Repro found: flight 37545 (fail), for first failure
> 
> *** Found and reproduced problem changeset ***
> 
>   Bug is in tree:  xen git://xenbits.xen.org/xen.git
>   Bug introduced:  38b37ed8270532c70df1a8ddae6aa300aa4ca09f
>   Bug not present: 4ff3449f0e9d175ceb9551d3f2aecb59273f639d
> 
> + exec
> + sh -xe
> + cd /export/home/osstest/repos/xen
> + git remote set-url origin git://drall.uk.xensource.com:9419/git://xenbits.xen.org/xen.git
> + git fetch -p origin +refs/heads/*:refs/remotes/origin/*
> 
>   commit 38b37ed8270532c70df1a8ddae6aa300aa4ca09f
>   Author: Andrew Cooper <andrew.cooper3@citrix.com>
>   Date:   Tue Apr 21 09:04:45 2015 +0200
>   
>       x86/domctl: cleanup
>       
>        * latch curr/currd once at start
>        * drop redundant "ret = 0" and braces
>        * use "copyback = 1" when appropriate
>        * move break statements inside case-specific braced scopes
>        * don't bother check for NULL before calling xfree()
>        * eliminate trailing whitespace
>        * Xen style corrections
>       
>       Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com>
>       Reviewed-by: Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
>       Reviewed-by: Jan Beulich <jbeulich@suse.com>
> 
> Revision graph left in /export/home/osstest/public_html/testlogs/results-adhoc/bisect.osstest.test-amd64-amd64-xl..{dot,ps,png,html}.
> ----------------------------------------
> 37545: tolerable ALL FAIL
> 
> flight 37545 osstest adhoc-bisect [real]
> http://osstest.xs.citrite.net/~osstest/testlogs/logs/37545/
> 
> Failures :-/ but no regressions.
> 
> Tests which did not succeed,
> including tests which could not be run:
>  test-amd64-amd64-xl          17 guest-localmigrate/x10  fail baseline untested
> 
> 
> jobs:
>  test-amd64-amd64-xl                                          fail    
> 
> 
> ------------------------------------------------------------
> sg-report-flight on osstest.xs.citrite.net
> logs: /home/xc_osstest/logs
> images: /home/xc_osstest/images
> 
> Logs, config files, etc. are available at
>     http://osstest.xs.citrite.net/~osstest/testlogs/logs
> 
> Test harness code can be found at
>     http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary
> 

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [adhoc osstest bisection] complete test-amd64-amd64-xl
  2015-05-21  9:16 ` [adhoc osstest bisection] complete test-amd64-amd64-xl Ian Campbell
@ 2015-05-21  9:31   ` Jan Beulich
  2015-05-21 10:07     ` Andrew Cooper
  0 siblings, 1 reply; 3+ messages in thread
From: Jan Beulich @ 2015-05-21  9:31 UTC (permalink / raw)
  To: Andrew Cooper, Ian Campbell; +Cc: ian.jackson, xen-devel

>>> On 21.05.15 at 11:16, <ian.campbell@citrix.com> wrote:
> The osstest instance in Cambridge appears to have found a machine
> specific failure which a bisect has blamed on the "x86/domctl: cleanup"
> patch below.
> 
> (NB: this is not the arm releated leak check thing which is currently
> hitting the xen-unstable flights in the main osstest instance)
> 
> Since the logs are internal I've put a copy of the bisection output at
> http://xenbits.xen.org/people/ianc/tmp/bisect.osstest.test-amd64-amd64-xl..h 
> tml
> 
> Along with the logs of the first two passes from the last good revision:
> http://xenbits.xen.org/people/ianc/tmp/37537/ 
> http://xenbits.xen.org/people/ianc/tmp/37541/ 
> and the logs from the first two fails from the first bad revision:
> http://xenbits.xen.org/people/ianc/tmp/37540/ 
> http://xenbits.xen.org/people/ianc/tmp/37542/ 
> 
> The failure is in migration at e.g.
> 
> http://xenbits.xen.org/people/ianc/tmp/37540/test-amd64-amd64-xl/17.ts-guest 
> -localmigrate.log
> 
> Anyone got any thoughts on this?

Reviewing the change another time, I see nothing. Unless Andrew
has an idea, I think we'd need to revert the patch in smaller chunks
to get an understanding what's going on here. The only thing I
could remotely imagine would be something writing over the
boundaries of a stack variable, of which we may now have got a
few more of.

Jan

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [adhoc osstest bisection] complete test-amd64-amd64-xl
  2015-05-21  9:31   ` Jan Beulich
@ 2015-05-21 10:07     ` Andrew Cooper
  0 siblings, 0 replies; 3+ messages in thread
From: Andrew Cooper @ 2015-05-21 10:07 UTC (permalink / raw)
  To: Jan Beulich, Ian Campbell; +Cc: ian.jackson, xen-devel

On 21/05/15 10:31, Jan Beulich wrote:
>>>> On 21.05.15 at 11:16, <ian.campbell@citrix.com> wrote:
>> The osstest instance in Cambridge appears to have found a machine
>> specific failure which a bisect has blamed on the "x86/domctl: cleanup"
>> patch below.
>>
>> (NB: this is not the arm releated leak check thing which is currently
>> hitting the xen-unstable flights in the main osstest instance)
>>
>> Since the logs are internal I've put a copy of the bisection output at
>> http://xenbits.xen.org/people/ianc/tmp/bisect.osstest.test-amd64-amd64-xl..h 
>> tml
>>
>> Along with the logs of the first two passes from the last good revision:
>> http://xenbits.xen.org/people/ianc/tmp/37537/ 
>> http://xenbits.xen.org/people/ianc/tmp/37541/ 
>> and the logs from the first two fails from the first bad revision:
>> http://xenbits.xen.org/people/ianc/tmp/37540/ 
>> http://xenbits.xen.org/people/ianc/tmp/37542/ 
>>
>> The failure is in migration at e.g.
>>
>> http://xenbits.xen.org/people/ianc/tmp/37540/test-amd64-amd64-xl/17.ts-guest 
>> -localmigrate.log
>>
>> Anyone got any thoughts on this?
> Reviewing the change another time, I see nothing. Unless Andrew
> has an idea, I think we'd need to revert the patch in smaller chunks
> to get an understanding what's going on here. The only thing I
> could remotely imagine would be something writing over the
> boundaries of a stack variable, of which we may now have got a
> few more of.

Ian and I have just spent some time investigating this.

The failure is that libxl observes a PV guest failing to respond to a
xenstore-based request to suspend, although the guest logs themselves
appear to suggest that the guest is performing correctly.

The identified changeset clearly suggests that this is a toolstack side
behavioural change, although the actual toolstack actions using domctls
appear to be working fine.

However, it is intermittent and appears to be host specific, rather than
consistent across the board.  Also, XenServer has not experienced any
symptoms like this.

~Andrew

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2015-05-21 10:07 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
     [not found] <E1YvEaU-000521-KH@osstest.xs.citrite.net>
2015-05-21  9:16 ` [adhoc osstest bisection] complete test-amd64-amd64-xl Ian Campbell
2015-05-21  9:31   ` Jan Beulich
2015-05-21 10:07     ` Andrew Cooper

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.