xen-devel.lists.xenproject.org archive mirror
 help / color / mirror / Atom feed
* [linux-4.9 test] 110371: regressions - FAIL
@ 2017-06-13  3:58 osstest service owner
  2017-06-13 10:33 ` Dario Faggioli
  0 siblings, 1 reply; 5+ messages in thread
From: osstest service owner @ 2017-06-13  3:58 UTC (permalink / raw)
  To: xen-devel, osstest-admin

flight 110371 linux-4.9 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/110371/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 test-armhf-armhf-xl-credit2   6 xen-boot                 fail REGR. vs. 107358

Tests which are failing intermittently (not blocking):
 test-amd64-i386-libvirt    7 host-ping-check-xen fail in 110200 pass in 110371
 test-amd64-i386-xl-qemuu-win7-amd64 15 guest-localmigrate/x10 fail in 110200 pass in 110371
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 14 guest-saverestore.2 fail in 110336 pass in 110371
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm 15 guest-localmigrate/x10 fail in 110336 pass in 110371
 test-amd64-amd64-xl-qemut-win7-amd64 15 guest-localmigrate/x10 fail in 110336 pass in 110371
 test-amd64-amd64-xl-qemuu-debianhvm-amd64 15 guest-localmigrate/x10 fail in 110336 pass in 110371
 test-amd64-amd64-xl-qemuu-win7-amd64 15 guest-localmigrate/x10 fail pass in 110200
 test-amd64-i386-xl-qemut-win7-amd64 15 guest-localmigrate/x10 fail pass in 110200
 test-amd64-i386-libvirt-pair 11 host-ping-check-xen/src_host fail pass in 110336

Regressions which are regarded as allowable (not blocking):
 test-amd64-i386-xl-qemuu-win7-amd64 16 guest-stop        fail REGR. vs. 107358
 test-amd64-amd64-xl-rtds      9 debian-install           fail REGR. vs. 107358
 test-amd64-amd64-xl-qemuu-win7-amd64 16 guest-stop fail in 110200 REGR. vs. 107358

Tests which did not succeed, but are not blocking:
 test-amd64-amd64-xl-qemut-win7-amd64 17 guest-start/win.repeat fail blocked in 107358
 test-amd64-i386-xl-qemut-win7-amd64 16 guest-stop   fail in 110200 like 107358
 test-armhf-armhf-libvirt-xsm  6 xen-boot                     fail  like 107358
 test-armhf-armhf-xl-multivcpu  6 xen-boot                     fail like 107358
 test-armhf-armhf-libvirt-raw  6 xen-boot                     fail  like 107358
 test-armhf-armhf-xl-vhd       6 xen-boot                     fail  like 107358
 test-armhf-armhf-xl-rtds      6 xen-boot                     fail  like 107358
 test-armhf-armhf-xl           6 xen-boot                     fail  like 107358
 test-armhf-armhf-xl-xsm       6 xen-boot                     fail  like 107358
 test-armhf-armhf-libvirt      6 xen-boot                     fail  like 107358
 test-amd64-i386-libvirt-xsm  12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt      12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt     12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-amd64-amd64-xl-qemuu-ws16-amd64  9 windows-install        fail never pass
 test-armhf-armhf-xl-arndale   6 xen-boot                     fail   never pass
 test-arm64-arm64-xl          12 migrate-support-check        fail   never pass
 test-arm64-arm64-xl          13 saverestore-support-check    fail   never pass
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-amd64-amd64-xl-qemut-ws16-amd64  9 windows-install        fail never pass
 test-arm64-arm64-libvirt-xsm 12 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
 test-arm64-arm64-libvirt-xsm 13 saverestore-support-check    fail   never pass
 test-amd64-amd64-qemuu-nested-amd 16 debian-hvm-install/l1/l2  fail never pass
 test-arm64-arm64-xl-credit2  12 migrate-support-check        fail   never pass
 test-arm64-arm64-xl-credit2  13 saverestore-support-check    fail   never pass
 test-armhf-armhf-xl-cubietruck 12 migrate-support-check        fail never pass
 test-armhf-armhf-xl-cubietruck 13 saverestore-support-check    fail never pass
 test-amd64-amd64-libvirt-vhd 11 migrate-support-check        fail   never pass
 test-armhf-armhf-examine      6 reboot                       fail   never pass
 test-arm64-arm64-xl-xsm      12 migrate-support-check        fail   never pass
 test-arm64-arm64-xl-xsm      13 saverestore-support-check    fail   never pass
 test-amd64-i386-xl-qemut-win10-i386  9 windows-install         fail never pass
 test-amd64-i386-xl-qemuu-win10-i386  9 windows-install         fail never pass
 test-amd64-i386-xl-qemuu-ws16-amd64  9 windows-install         fail never pass
 test-amd64-i386-xl-qemut-ws16-amd64  9 windows-install         fail never pass
 test-amd64-amd64-xl-qemuu-win10-i386  9 windows-install        fail never pass
 test-amd64-amd64-xl-qemut-win10-i386  9 windows-install        fail never pass

version targeted for testing:
 linux                f1aa865ae5d4608cbfbb02f42baa1ef5ed95fce2
baseline version:
 linux                37feaf8095d352014555b82adb4a04609ca17d3f

Last test of basis   107358  2017-04-10 19:42:52 Z   63 days
Failing since        107396  2017-04-12 11:15:19 Z   61 days   94 attempts
Testing same since   110082  2017-06-07 11:34:26 Z    5 days    7 attempts

------------------------------------------------------------
605 people touched revisions under test,
not listing them all

jobs:
 build-amd64-xsm                                              pass    
 build-arm64-xsm                                              pass    
 build-armhf-xsm                                              pass    
 build-i386-xsm                                               pass    
 build-amd64                                                  pass    
 build-arm64                                                  pass    
 build-armhf                                                  pass    
 build-i386                                                   pass    
 build-amd64-libvirt                                          pass    
 build-arm64-libvirt                                          pass    
 build-armhf-libvirt                                          pass    
 build-i386-libvirt                                           pass    
 build-amd64-pvops                                            pass    
 build-arm64-pvops                                            pass    
 build-armhf-pvops                                            pass    
 build-i386-pvops                                             pass    
 build-amd64-rumprun                                          pass    
 build-i386-rumprun                                           pass    
 test-amd64-amd64-xl                                          pass    
 test-arm64-arm64-xl                                          pass    
 test-armhf-armhf-xl                                          fail    
 test-amd64-i386-xl                                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm           pass    
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm            pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm                pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm                 pass    
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm        pass    
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm         pass    
 test-amd64-amd64-libvirt-xsm                                 pass    
 test-arm64-arm64-libvirt-xsm                                 pass    
 test-armhf-armhf-libvirt-xsm                                 fail    
 test-amd64-i386-libvirt-xsm                                  pass    
 test-amd64-amd64-xl-xsm                                      pass    
 test-arm64-arm64-xl-xsm                                      pass    
 test-armhf-armhf-xl-xsm                                      fail    
 test-amd64-i386-xl-xsm                                       pass    
 test-amd64-amd64-qemuu-nested-amd                            fail    
 test-amd64-amd64-xl-pvh-amd                                  pass    
 test-amd64-i386-qemut-rhel6hvm-amd                           pass    
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass    
 test-amd64-i386-freebsd10-amd64                              pass    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         pass    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          pass    
 test-amd64-amd64-rumprun-amd64                               pass    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-amd64-amd64-xl-qemut-ws16-amd64                         fail    
 test-amd64-i386-xl-qemut-ws16-amd64                          fail    
 test-amd64-amd64-xl-qemuu-ws16-amd64                         fail    
 test-amd64-i386-xl-qemuu-ws16-amd64                          fail    
 test-armhf-armhf-xl-arndale                                  fail    
 test-amd64-amd64-xl-credit2                                  pass    
 test-arm64-arm64-xl-credit2                                  pass    
 test-armhf-armhf-xl-credit2                                  fail    
 test-armhf-armhf-xl-cubietruck                               pass    
 test-amd64-amd64-examine                                     pass    
 test-arm64-arm64-examine                                     pass    
 test-armhf-armhf-examine                                     fail    
 test-amd64-i386-examine                                      pass    
 test-amd64-i386-freebsd10-i386                               pass    
 test-amd64-i386-rumprun-i386                                 pass    
 test-amd64-amd64-xl-qemut-win10-i386                         fail    
 test-amd64-i386-xl-qemut-win10-i386                          fail    
 test-amd64-amd64-xl-qemuu-win10-i386                         fail    
 test-amd64-i386-xl-qemuu-win10-i386                          fail    
 test-amd64-amd64-qemuu-nested-intel                          pass    
 test-amd64-amd64-xl-pvh-intel                                pass    
 test-amd64-i386-qemut-rhel6hvm-intel                         pass    
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
 test-amd64-amd64-libvirt                                     pass    
 test-armhf-armhf-libvirt                                     fail    
 test-amd64-i386-libvirt                                      pass    
 test-amd64-amd64-xl-multivcpu                                pass    
 test-armhf-armhf-xl-multivcpu                                fail    
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         pass    
 test-amd64-amd64-libvirt-pair                                pass    
 test-amd64-i386-libvirt-pair                                 fail    
 test-amd64-amd64-amd64-pvgrub                                pass    
 test-amd64-amd64-i386-pvgrub                                 pass    
 test-amd64-amd64-pygrub                                      pass    
 test-amd64-amd64-xl-qcow2                                    pass    
 test-armhf-armhf-libvirt-raw                                 fail    
 test-amd64-i386-xl-raw                                       pass    
 test-amd64-amd64-xl-rtds                                     fail    
 test-armhf-armhf-xl-rtds                                     fail    
 test-amd64-amd64-libvirt-vhd                                 pass    
 test-armhf-armhf-xl-vhd                                      fail    


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary


Not pushing.

(No revision log; it would be 21621 lines long.)

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [linux-4.9 test] 110371: regressions - FAIL
  2017-06-13  3:58 [linux-4.9 test] 110371: regressions - FAIL osstest service owner
@ 2017-06-13 10:33 ` Dario Faggioli
  2017-06-13 12:13   ` Ian Jackson
  0 siblings, 1 reply; 5+ messages in thread
From: Dario Faggioli @ 2017-06-13 10:33 UTC (permalink / raw)
  To: osstest service owner, xen-devel
  Cc: Juergen Gross, Julien Grall, Boris Ostrovsky


[-- Attachment #1.1: Type: text/plain, Size: 1865 bytes --]

On Tue, 2017-06-13 at 03:58 +0000, osstest service owner wrote:
> flight 110371 linux-4.9 real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/110371/
> 
> Regressions :-(
> 
> Tests which did not succeed and are blocking,
> including tests which could not be run:
>  test-armhf-armhf-xl-credit2   6 xen-boot                 fail REGR.
> vs. 107358
> 
This caught my attention because of the 'credit2' part. I therefore
went checking and noticed from here:
http://logs.test-lab.xenproject.org/osstest/results/history/test-armhf-armhf-xl-credit2/ALL

and here:
http://logs.test-lab.xenproject.org/osstest/results/history/test-armhf-armhf-xl-credit2/ALL

That the test has been repeatedly failing, when on the linux-4.9
branch, always on arndale-bluewater.

I've checked a couple of serial logs of failing flights, and they all
look similar.

I've then looked here:
http://logs.test-lab.xenproject.org/osstest/results/host/arndale-bluewater.html

And seen that other jobs (not only -credit2 ones) are failing as well,
and in similar ways, when using the linux-4.9 branch:
http://logs.test-lab.xenproject.org/osstest/logs/110371/test-armhf-armhf-xl-multivcpu/info.html
http://logs.test-lab.xenproject.org/osstest/logs/110371/test-armhf-armhf-xl-vhd/info.html

Finally, test-armhf-armhf-xl-credit2 passes, on arndale-bluewater, when
on the linux-linus branch.

So, this appears to be something related to linux-4.9 and that
particular board, I guess?

(If this was known and being looked up already, sorry for the noise.)

Regards,
Dario
-- 
<<This happens because I choose it to happen!>> (Raistlin Majere)
-----------------------------------------------------------------
Dario Faggioli, Ph.D, http://about.me/dario.faggioli
Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)

[-- Attachment #1.2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 819 bytes --]

[-- Attachment #2: Type: text/plain, Size: 127 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [linux-4.9 test] 110371: regressions - FAIL
  2017-06-13 10:33 ` Dario Faggioli
@ 2017-06-13 12:13   ` Ian Jackson
  2017-06-19  9:48     ` Julien Grall
  0 siblings, 1 reply; 5+ messages in thread
From: Ian Jackson @ 2017-06-13 12:13 UTC (permalink / raw)
  To: Dario Faggioli; +Cc: Juergen Gross, Julien Grall, xen-devel, Boris Ostrovsky

Dario Faggioli writes ("Re: [Xen-devel] [linux-4.9 test] 110371: regressions - FAIL"):
> So, this appears to be something related to linux-4.9 and that
> particular board, I guess?

Yes, indeed.  This has been broken for some time.

> (If this was known and being looked up already, sorry for the noise.)

Julien has requested a backport of a relevant Linux patch; that was
"queued" by Greg K-H on Monday.

Normally it seems to take a week (or even two) from that happening
before the fix actually ends up in the linux-4.9.y stable branch on
kernel.org :-/.

This is, ultimately, blocking moving osstest to use Linux 4.9...

Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [linux-4.9 test] 110371: regressions - FAIL
  2017-06-13 12:13   ` Ian Jackson
@ 2017-06-19  9:48     ` Julien Grall
  2017-06-19 13:03       ` Ian Jackson
  0 siblings, 1 reply; 5+ messages in thread
From: Julien Grall @ 2017-06-19  9:48 UTC (permalink / raw)
  To: Ian Jackson, Dario Faggioli; +Cc: Juergen Gross, Boris Ostrovsky, xen-devel



On 13/06/17 13:13, Ian Jackson wrote:
> Dario Faggioli writes ("Re: [Xen-devel] [linux-4.9 test] 110371: regressions - FAIL"):
>> So, this appears to be something related to linux-4.9 and that
>> particular board, I guess?
>
> Yes, indeed.  This has been broken for some time.
>
>> (If this was known and being looked up already, sorry for the noise.)
>
> Julien has requested a backport of a relevant Linux patch; that was
> "queued" by Greg K-H on Monday.
>
> Normally it seems to take a week (or even two) from that happening
> before the fix actually ends up in the linux-4.9.y stable branch on
> kernel.org :-/.
>
> This is, ultimately, blocking moving osstest to use Linux 4.9...

There are now in Linux 4.9 stable branch. Now the testing is blocked 
because of again local migration [1]. The migration test seem less 
reliable than the Arndale these days... is there anything we can do?

Cheers,

[1] http://logs.test-lab.xenproject.org/osstest/logs/110535/


-- 
Julien Grall

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [linux-4.9 test] 110371: regressions - FAIL
  2017-06-19  9:48     ` Julien Grall
@ 2017-06-19 13:03       ` Ian Jackson
  0 siblings, 0 replies; 5+ messages in thread
From: Ian Jackson @ 2017-06-19 13:03 UTC (permalink / raw)
  To: Julien Grall; +Cc: Juergen Gross, Dario Faggioli, xen-devel, Boris Ostrovsky

Julien Grall writes ("Re: [Xen-devel] [linux-4.9 test] 110371: regressions - FAIL"):
> There are now in Linux 4.9 stable branch. Now the testing is blocked 
> because of again local migration [1]. The migration test seem less 
> reliable than the Arndale these days... is there anything we can do?

I have an osstest branch which we think will help with the Windows
migration problems.  It's currently in the osstest self-push-gate.

You'll see from my mail earlier today that I force pushed linux-4.9.

Currently I'm waiting for Juergen to tell me whether (if we know) the
bugs fixed by his series "xen/blkback: several fixes of resource
management" are present in earlier versions of Linux, such as the 3.18
that osstest is currently using.

If those bugs are present there too then moving to Linux 4.9 would not
be a regression introducing heisenbugs.  If they are then I think we
should still wait (and hope that Linux 4.9 doesn't break any further).

Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2017-06-19 13:03 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2017-06-13  3:58 [linux-4.9 test] 110371: regressions - FAIL osstest service owner
2017-06-13 10:33 ` Dario Faggioli
2017-06-13 12:13   ` Ian Jackson
2017-06-19  9:48     ` Julien Grall
2017-06-19 13:03       ` Ian Jackson

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).