All of lore.kernel.org
 help / color / mirror / Atom feed
* [xen-unstable test] 15401: regressions - FAIL
@ 2013-02-01  2:41 xen.org
  2013-02-01 11:44 ` Ian Jackson
  0 siblings, 1 reply; 15+ messages in thread
From: xen.org @ 2013-02-01  2:41 UTC (permalink / raw)
  To: xen-devel; +Cc: ian.jackson

flight 15401 xen-unstable real [real]
http://www.chiark.greenend.org.uk/~xensrcts/logs/15401/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 test-amd64-amd64-xl-qemut-win  7 windows-install          fail REGR. vs. 15179

Regressions which are regarded as allowable (not blocking):
 test-amd64-amd64-xl-sedf      5 xen-boot                     fail   like 15179
 test-amd64-amd64-xl-sedf-pin  5 xen-boot                     fail   like 15179

Tests which did not succeed, but are not blocking:
 build-armhf                   4 xen-build                    fail   never pass
 test-amd64-amd64-xl-pcipt-intel  9 guest-start                 fail never pass
 test-amd64-i386-xend-winxpsp3 16 leak-check/check             fail  never pass
 test-amd64-i386-win          16 leak-check/check             fail   never pass
 test-amd64-i386-qemut-win-vcpus1 16 leak-check/check           fail never pass
 test-amd64-i386-xl-win-vcpus1 13 guest-stop                   fail  never pass
 test-amd64-amd64-xl-qemut-win7-amd64 13 guest-stop             fail never pass
 test-amd64-amd64-xl-qemuu-winxpsp3 13 guest-stop               fail never pass
 test-amd64-amd64-xl-win7-amd64 13 guest-stop                   fail never pass
 test-amd64-i386-win-vcpus1   16 leak-check/check             fail   never pass
 test-amd64-amd64-win         16 leak-check/check             fail   never pass
 test-amd64-amd64-xl-winxpsp3 13 guest-stop                   fail   never pass
 test-amd64-i386-xl-qemut-win7-amd64 13 guest-stop              fail never pass
 test-amd64-amd64-xl-qemut-winxpsp3 13 guest-stop               fail never pass
 test-amd64-i386-xl-win7-amd64 13 guest-stop                   fail  never pass
 test-amd64-amd64-qemut-win   16 leak-check/check             fail   never pass
 test-amd64-i386-xend-qemut-winxpsp3 16 leak-check/check        fail never pass
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1 13 guest-stop         fail never pass
 test-amd64-i386-xl-winxpsp3-vcpus1 13 guest-stop               fail never pass
 test-amd64-i386-xl-qemut-win-vcpus1 13 guest-stop              fail never pass
 test-amd64-i386-qemut-win    16 leak-check/check             fail   never pass
 test-amd64-amd64-xl-win      13 guest-stop                   fail   never pass
 test-amd64-amd64-xl-qemuu-win7-amd64 13 guest-stop             fail never pass

version targeted for testing:
 xen                  d1bf3b21f783
baseline version:
 xen                  5af4f2ab06f3

------------------------------------------------------------
People who touched revisions under test:
  Dan Magenheimer <dan.magenheimer@oracle.com>
  Daniel De Graaf <dgdegra@tycho.nsa.gov>
  Dario Faggioli <dario.faggioli@citrix.com>
  David Vrabel <david.vrabel@citrix.com>
  Dongxiao Xu <dongxiao.xu@intel.com>
  Ian Campbell <ian.campbell@citrix.com>
  Ian Jackson <ian.jackson@eu.citrix.com>
  Jan Beulich <jbeulich@suse.com>
  Jim Fehlig <jfehlig@suse.com>
  Jun Nakajima <jun.nakajima@intel.com>
  Keir Fraser <keir@xen.org>
  Matt Wilson <msw@amazon.com>
  Razvan Cojocaru <rzvncj@gmail.com>
  Roger Pau Monn? <roger.pau@citrix.com>
  Samuel Thibault <samuel.thibault@ens-lyon.org>
  Stefano Stabellini <stefano.stabellini@eu.citrix.com>
  Tim Deegan <tim@xen.org>
  Tomasz Wroblewski <tomasz.wroblewski@citrix.com>
  Wei Huang <huangwei@gmail.com>
  Xiantao Zhang <xiantao.zhang@intel.com>
------------------------------------------------------------

jobs:
 build-amd64                                                  pass    
 build-armhf                                                  fail    
 build-i386                                                   pass    
 build-amd64-oldkern                                          pass    
 build-i386-oldkern                                           pass    
 build-amd64-pvops                                            pass    
 build-i386-pvops                                             pass    
 test-amd64-amd64-xl                                          pass    
 test-amd64-i386-xl                                           pass    
 test-amd64-i386-rhel6hvm-amd                                 pass    
 test-amd64-i386-qemut-rhel6hvm-amd                           pass    
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-amd64-xl-win7-amd64                               fail    
 test-amd64-i386-xl-win7-amd64                                fail    
 test-amd64-i386-xl-credit2                                   pass    
 test-amd64-amd64-xl-pcipt-intel                              fail    
 test-amd64-i386-rhel6hvm-intel                               pass    
 test-amd64-i386-qemut-rhel6hvm-intel                         pass    
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
 test-amd64-i386-xl-multivcpu                                 pass    
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         pass    
 test-amd64-amd64-xl-sedf-pin                                 fail    
 test-amd64-amd64-pv                                          pass    
 test-amd64-i386-pv                                           pass    
 test-amd64-amd64-xl-sedf                                     fail    
 test-amd64-i386-win-vcpus1                                   fail    
 test-amd64-i386-qemut-win-vcpus1                             fail    
 test-amd64-i386-xl-qemut-win-vcpus1                          fail    
 test-amd64-i386-xl-win-vcpus1                                fail    
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     fail    
 test-amd64-i386-xl-winxpsp3-vcpus1                           fail    
 test-amd64-amd64-win                                         fail    
 test-amd64-i386-win                                          fail    
 test-amd64-amd64-qemut-win                                   fail    
 test-amd64-i386-qemut-win                                    fail    
 test-amd64-amd64-xl-qemut-win                                fail    
 test-amd64-amd64-xl-win                                      fail    
 test-amd64-i386-xend-qemut-winxpsp3                          fail    
 test-amd64-amd64-xl-qemut-winxpsp3                           fail    
 test-amd64-amd64-xl-qemuu-winxpsp3                           fail    
 test-amd64-i386-xend-winxpsp3                                fail    
 test-amd64-amd64-xl-winxpsp3                                 fail    


------------------------------------------------------------
sg-report-flight on woking.cam.xci-test.com
logs: /home/xc_osstest/logs
images: /home/xc_osstest/images

Logs, config files, etc. are available at
    http://www.chiark.greenend.org.uk/~xensrcts/logs

Test harness code can be found at
    http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary


Not pushing.

(No revision log; it would be 1095 lines long.)

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-01  2:41 [xen-unstable test] 15401: regressions - FAIL xen.org
@ 2013-02-01 11:44 ` Ian Jackson
  2013-02-04 11:06   ` Ian Campbell
  0 siblings, 1 reply; 15+ messages in thread
From: Ian Jackson @ 2013-02-01 11:44 UTC (permalink / raw)
  To: Keir Fraser, Jan Beulich; +Cc: xen-devel@lists.xensource.com

xen.org writes ("[xen-unstable test] 15401: regressions - FAIL"):
> flight 15401 xen-unstable real [real]
> http://www.chiark.greenend.org.uk/~xensrcts/logs/15401/
> 
> Regressions :-(
> 
> Tests which did not succeed and are blocking,
> including tests which could not be run:
>  test-amd64-amd64-xl-qemut-win  7 windows-install     fail REGR. vs. 15179

With some handholding, I managed to get the bisector to work on this.
It found that the original "good" version is unreliable: it built Xen
5af4f2ab06f3 and in two recent tests on the same host, of the same
build, it failed once and passed once.

Under the circumstances it's not clear that the current staging is any
worse than non-staging.  I think we should push the revision reported
in this test (which was otherwise OK according to the tester) to
non-staging, with a manual "hg push".

> version targeted for testing:
>  xen                  d1bf3b21f783

I'm not sure how to do this with hg and have to go catch a train so I
don't have time to look it up, but presumably there's some rune of the
form "hg push -r d1bf3b21f783 ssh://xenbits/xen-unstable.hg"

Thanks,
Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-01 11:44 ` Ian Jackson
@ 2013-02-04 11:06   ` Ian Campbell
  2013-02-04 11:17     ` Jan Beulich
  2013-02-04 14:19     ` Ian Jackson
  0 siblings, 2 replies; 15+ messages in thread
From: Ian Campbell @ 2013-02-04 11:06 UTC (permalink / raw)
  To: Ian Jackson; +Cc: Keir Fraser, xen-devel@lists.xensource.com, Jan Beulich

On Fri, 2013-02-01 at 11:44 +0000, Ian Jackson wrote:
> xen.org writes ("[xen-unstable test] 15401: regressions - FAIL"):
> > flight 15401 xen-unstable real [real]
> > http://www.chiark.greenend.org.uk/~xensrcts/logs/15401/
> > 
> > Regressions :-(
> > 
> > Tests which did not succeed and are blocking,
> > including tests which could not be run:
> >  test-amd64-amd64-xl-qemut-win  7 windows-install     fail REGR. vs. 15179
> 
> With some handholding, I managed to get the bisector to work on this.
> It found that the original "good" version is unreliable: it built Xen
> 5af4f2ab06f3 and in two recent tests on the same host, of the same
> build, it failed once and passed once.

Hrm, did it make any progress over the w/e.

> Under the circumstances it's not clear that the current staging is any
> worse than non-staging.  I think we should push the revision reported
> in this test (which was otherwise OK according to the tester) to
> non-staging, with a manual "hg push".

This sounds like a good idea.

> > version targeted for testing:
> >  xen                  d1bf3b21f783
> 
> I'm not sure how to do this with hg and have to go catch a train so I
> don't have time to look it up, but presumably there's some rune of the
> form "hg push -r d1bf3b21f783 ssh://xenbits/xen-unstable.hg"

That looks right to me...

Shall I? (not sure I'm in the necessary group on xenbits, but I could
try ;-))

Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 11:06   ` Ian Campbell
@ 2013-02-04 11:17     ` Jan Beulich
  2013-02-04 11:22       ` Ian Campbell
  2013-02-04 14:19     ` Ian Jackson
  1 sibling, 1 reply; 15+ messages in thread
From: Jan Beulich @ 2013-02-04 11:17 UTC (permalink / raw)
  To: Ian Campbell, Ian Jackson; +Cc: Keir Fraser, xen-devel@lists.xensource.com

>>> On 04.02.13 at 12:06, Ian Campbell <Ian.Campbell@citrix.com> wrote:
> On Fri, 2013-02-01 at 11:44 +0000, Ian Jackson wrote:
>> xen.org writes ("[xen-unstable test] 15401: regressions - FAIL"):
>> > flight 15401 xen-unstable real [real]
>> > http://www.chiark.greenend.org.uk/~xensrcts/logs/15401/ 
>> > 
>> > Regressions :-(
>> > 
>> > Tests which did not succeed and are blocking,
>> > including tests which could not be run:
>> >  test-amd64-amd64-xl-qemut-win  7 windows-install     fail REGR. vs. 15179
>> 
>> With some handholding, I managed to get the bisector to work on this.
>> It found that the original "good" version is unreliable: it built Xen
>> 5af4f2ab06f3 and in two recent tests on the same host, of the same
>> build, it failed once and passed once.
> 
> Hrm, did it make any progress over the w/e.

With the failure now being consistent rather than intermittent,
we almost definitely have a state worse than before.

>> Under the circumstances it's not clear that the current staging is any
>> worse than non-staging.  I think we should push the revision reported
>> in this test (which was otherwise OK according to the tester) to
>> non-staging, with a manual "hg push".
> 
> This sounds like a good idea.

Wouldn't that set us up for the same problem again when the next
testing round fails here again?

Unless Olaf's testing with partial reverts shows otherwise, I'd be up
for reverting all non-trivial x86 HVM RTC patches I had applied
recently (where "trivial" to me would be "use RTC_* names instead of
literal numbers" and "use cached original value in RTC_REG_B writing
code", albeit the latter may not revert cleanly on its own). Should
they turn out not to be the culprit, they could always be re-applied
later.

Jan

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 11:17     ` Jan Beulich
@ 2013-02-04 11:22       ` Ian Campbell
  2013-02-04 14:22         ` Ian Jackson
  0 siblings, 1 reply; 15+ messages in thread
From: Ian Campbell @ 2013-02-04 11:22 UTC (permalink / raw)
  To: Jan Beulich; +Cc: Keir Fraser, Ian Jackson, xen-devel@lists.xensource.com

On Mon, 2013-02-04 at 11:17 +0000, Jan Beulich wrote:
> >>> On 04.02.13 at 12:06, Ian Campbell <Ian.Campbell@citrix.com> wrote:
> > On Fri, 2013-02-01 at 11:44 +0000, Ian Jackson wrote:
> >> xen.org writes ("[xen-unstable test] 15401: regressions - FAIL"):
> >> > flight 15401 xen-unstable real [real]
> >> > http://www.chiark.greenend.org.uk/~xensrcts/logs/15401/ 
> >> > 
> >> > Regressions :-(
> >> > 
> >> > Tests which did not succeed and are blocking,
> >> > including tests which could not be run:
> >> >  test-amd64-amd64-xl-qemut-win  7 windows-install     fail REGR. vs. 15179
> >> 
> >> With some handholding, I managed to get the bisector to work on this.
> >> It found that the original "good" version is unreliable: it built Xen
> >> 5af4f2ab06f3 and in two recent tests on the same host, of the same
> >> build, it failed once and passed once.
> > 
> > Hrm, did it make any progress over the w/e.
> 
> With the failure now being consistent rather than intermittent,
> we almost definitely have a state worse than before.
> 
> >> Under the circumstances it's not clear that the current staging is any
> >> worse than non-staging.  I think we should push the revision reported
> >> in this test (which was otherwise OK according to the tester) to
> >> non-staging, with a manual "hg push".
> > 
> > This sounds like a good idea.
> 
> Wouldn't that set us up for the same problem again when the next
> testing round fails here again?

Yes, that's true.

> 
> Unless Olaf's testing with partial reverts shows otherwise, I'd be up
> for reverting all non-trivial x86 HVM RTC patches I had applied
> recently (where "trivial" to me would be "use RTC_* names instead of
> literal numbers" and "use cached original value in RTC_REG_B writing
> code", albeit the latter may not revert cleanly on its own). Should
> they turn out not to be the culprit, they could always be re-applied
> later.

We should certainly see what Olaf's test shows. I'd also be interested
in what (if anything) the bisector has discovered. But then yes, if we
think these might be the culprit then reverting would be sensible.

Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 11:06   ` Ian Campbell
  2013-02-04 11:17     ` Jan Beulich
@ 2013-02-04 14:19     ` Ian Jackson
  2013-02-04 14:26       ` Ian Campbell
  1 sibling, 1 reply; 15+ messages in thread
From: Ian Jackson @ 2013-02-04 14:19 UTC (permalink / raw)
  To: Ian Campbell; +Cc: Keir Fraser, xen-devel@lists.xensource.com, Jan Beulich

Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 15401: regressions - FAIL"):
> On Fri, 2013-02-01 at 11:44 +0000, Ian Jackson wrote:
> > > Tests which did not succeed and are blocking,
> > > including tests which could not be run:
> > >  test-amd64-amd64-xl-qemut-win  7 windows-install     fail REGR. vs. 15179
> > 
> > With some handholding, I managed to get the bisector to work on this.
> > It found that the original "good" version is unreliable: it built Xen
> > 5af4f2ab06f3 and in two recent tests on the same host, of the same
> > build, it failed once and passed once.
> 
> Hrm, did it make any progress over the w/e.

It stops when it finds that the failure, or the previous pass, isn't
reproducible.

Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 11:22       ` Ian Campbell
@ 2013-02-04 14:22         ` Ian Jackson
  2013-02-04 14:24           ` Ian Campbell
  2013-02-04 14:39           ` Jan Beulich
  0 siblings, 2 replies; 15+ messages in thread
From: Ian Jackson @ 2013-02-04 14:22 UTC (permalink / raw)
  To: Ian Campbell; +Cc: Keir Fraser, xen-devel@lists.xensource.com, Jan Beulich

Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 15401: regressions - FAIL"):
> On Mon, 2013-02-04 at 11:17 +0000, Jan Beulich wrote:
> > >>> On 04.02.13 at 12:06, Ian Campbell <Ian.Campbell@citrix.com> wrote:
> > > On Fri, 2013-02-01 at 11:44 +0000, Ian Jackson wrote:
> > >> Under the circumstances it's not clear that the current staging is any
> > >> worse than non-staging.  I think we should push the revision reported
> > >> in this test (which was otherwise OK according to the tester) to
> > >> non-staging, with a manual "hg push".
> > > 
> > > This sounds like a good idea.
> > 
> > Wouldn't that set us up for the same problem again when the next
> > testing round fails here again?
> 
> Yes, that's true.

No.  Because the problem is essentially a fluke pass, not a fluke
fail.

Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 14:22         ` Ian Jackson
@ 2013-02-04 14:24           ` Ian Campbell
  2013-02-04 14:30             ` Ian Jackson
  2013-02-04 14:39           ` Jan Beulich
  1 sibling, 1 reply; 15+ messages in thread
From: Ian Campbell @ 2013-02-04 14:24 UTC (permalink / raw)
  To: Ian Jackson; +Cc: Keir Fraser, xen-devel@lists.xensource.com, Jan Beulich

On Mon, 2013-02-04 at 14:22 +0000, Ian Jackson wrote:
> Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 15401: regressions - FAIL"):
> > On Mon, 2013-02-04 at 11:17 +0000, Jan Beulich wrote:
> > > >>> On 04.02.13 at 12:06, Ian Campbell <Ian.Campbell@citrix.com> wrote:
> > > > On Fri, 2013-02-01 at 11:44 +0000, Ian Jackson wrote:
> > > >> Under the circumstances it's not clear that the current staging is any
> > > >> worse than non-staging.  I think we should push the revision reported
> > > >> in this test (which was otherwise OK according to the tester) to
> > > >> non-staging, with a manual "hg push".
> > > > 
> > > > This sounds like a good idea.
> > > 
> > > Wouldn't that set us up for the same problem again when the next
> > > testing round fails here again?
> > 
> > Yes, that's true.
> 
> No.  Because the problem is essentially a fluke pass, not a fluke
> fail.

So you are also proposing to flip something in osstest to erase the
fluke pass from its memory? Otherwise won't it see all future fails as
regressions, rather than never pass, due to the fluke pass?

Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 14:19     ` Ian Jackson
@ 2013-02-04 14:26       ` Ian Campbell
  0 siblings, 0 replies; 15+ messages in thread
From: Ian Campbell @ 2013-02-04 14:26 UTC (permalink / raw)
  To: Ian Jackson; +Cc: Keir Fraser, xen-devel@lists.xensource.com, Jan Beulich

On Mon, 2013-02-04 at 14:19 +0000, Ian Jackson wrote:
> Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 15401: regressions - FAIL"):
> > On Fri, 2013-02-01 at 11:44 +0000, Ian Jackson wrote:
> > > > Tests which did not succeed and are blocking,
> > > > including tests which could not be run:
> > > >  test-amd64-amd64-xl-qemut-win  7 windows-install     fail REGR. vs. 15179
> > > 
> > > With some handholding, I managed to get the bisector to work on this.
> > > It found that the original "good" version is unreliable: it built Xen
> > > 5af4f2ab06f3 and in two recent tests on the same host, of the same
> > > build, it failed once and passed once.
> > 
> > Hrm, did it make any progress over the w/e.
> 
> It stops when it finds that the failure, or the previous pass, isn't
> reproducible.

5af4f2ab06f3 is before 26461:78e91e9e4d61 thru 26456:1e9a8e155002 which
are Jan's RTC changes which rather rules them out I think.

Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 14:24           ` Ian Campbell
@ 2013-02-04 14:30             ` Ian Jackson
  2013-02-04 14:33               ` Ian Campbell
  0 siblings, 1 reply; 15+ messages in thread
From: Ian Jackson @ 2013-02-04 14:30 UTC (permalink / raw)
  To: Ian Campbell
  Cc: Keir Fraser, Ian Jackson, xen-devel@lists.xensource.com,
	Jan Beulich

Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 15401: regressions - FAIL"):
> On Mon, 2013-02-04 at 14:22 +0000, Ian Jackson wrote:
> > No.  Because the problem is essentially a fluke pass, not a fluke
> > fail.
> 
> So you are also proposing to flip something in osstest to erase the
> fluke pass from its memory? Otherwise won't it see all future fails as
> regressions, rather than never pass, due to the fluke pass?

No, right now I'm proposing to do a manual push of (as I proposed)
d1bf3b21f783.  The effect of that is that future pushes will be
regarded as regressions iff their test results are worse than
d1bf3b21f783's.

That is, the test system uses whatever revision non-staging has as the
baseline revision, not whatever it most recently tested.  (And if
non-staging hasn't had a test at all, it will test it.)

Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 14:30             ` Ian Jackson
@ 2013-02-04 14:33               ` Ian Campbell
  0 siblings, 0 replies; 15+ messages in thread
From: Ian Campbell @ 2013-02-04 14:33 UTC (permalink / raw)
  To: Ian Jackson; +Cc: Keir Fraser, xen-devel@lists.xensource.com, Jan Beulich

On Mon, 2013-02-04 at 14:30 +0000, Ian Jackson wrote:
> the test system uses whatever revision non-staging has as the
> baseline revision, not whatever it most recently tested.

Ah, I was expecting it went further back in history (i.e. did this test
*ever* pass).

Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 14:22         ` Ian Jackson
  2013-02-04 14:24           ` Ian Campbell
@ 2013-02-04 14:39           ` Jan Beulich
  2013-02-04 14:44             ` Ian Campbell
  1 sibling, 1 reply; 15+ messages in thread
From: Jan Beulich @ 2013-02-04 14:39 UTC (permalink / raw)
  To: Ian Campbell, Ian Jackson; +Cc: Keir Fraser, xen-devel@lists.xensource.com

>>> On 04.02.13 at 15:22, Ian Jackson <Ian.Jackson@eu.citrix.com> wrote:
> Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 15401: regressions - 
> FAIL"):
>> On Mon, 2013-02-04 at 11:17 +0000, Jan Beulich wrote:
>> > >>> On 04.02.13 at 12:06, Ian Campbell <Ian.Campbell@citrix.com> wrote:
>> > > On Fri, 2013-02-01 at 11:44 +0000, Ian Jackson wrote:
>> > >> Under the circumstances it's not clear that the current staging is any
>> > >> worse than non-staging.  I think we should push the revision reported
>> > >> in this test (which was otherwise OK according to the tester) to
>> > >> non-staging, with a manual "hg push".
>> > > 
>> > > This sounds like a good idea.
>> > 
>> > Wouldn't that set us up for the same problem again when the next
>> > testing round fails here again?
>> 
>> Yes, that's true.
> 
> No.  Because the problem is essentially a fluke pass, not a fluke
> fail.

I'm not sure - previously, iirc, we had inconsistent successes and
failures of this test (and I think another one or two). Now we
appear to have run into a consistent failure state, so something
must have changed.

Luckily there is an indication from Olaf that rather than reverting,
applying the remaining pieces of the broken up RTC emulation
changes (which I didn't post formally yet, mainly in the hope to
get a push first, considering that these bits were what originally
caused regressions when applied as a single monolithic change -
and with a bug fixed only after I split things apart - late in the
4.2 cycle) unbreaks what he reported broken.

I could certainly post that patch right away, but I'd like to give
it a little more time to see whether Olaf can confirm his initial
findings, and because with that I'm less certain that the test
failure really is to be attributed to the RTC emulation changes
at all.

Jan

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 14:39           ` Jan Beulich
@ 2013-02-04 14:44             ` Ian Campbell
  2013-02-04 14:48               ` Jan Beulich
  0 siblings, 1 reply; 15+ messages in thread
From: Ian Campbell @ 2013-02-04 14:44 UTC (permalink / raw)
  To: Jan Beulich; +Cc: Keir Fraser, Ian Jackson, xen-devel@lists.xensource.com

On Mon, 2013-02-04 at 14:39 +0000, Jan Beulich wrote:
> >>> On 04.02.13 at 15:22, Ian Jackson <Ian.Jackson@eu.citrix.com> wrote:
> > Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 15401: regressions - 
> > FAIL"):
> >> On Mon, 2013-02-04 at 11:17 +0000, Jan Beulich wrote:
> >> > >>> On 04.02.13 at 12:06, Ian Campbell <Ian.Campbell@citrix.com> wrote:
> >> > > On Fri, 2013-02-01 at 11:44 +0000, Ian Jackson wrote:
> >> > >> Under the circumstances it's not clear that the current staging is any
> >> > >> worse than non-staging.  I think we should push the revision reported
> >> > >> in this test (which was otherwise OK according to the tester) to
> >> > >> non-staging, with a manual "hg push".
> >> > > 
> >> > > This sounds like a good idea.
> >> > 
> >> > Wouldn't that set us up for the same problem again when the next
> >> > testing round fails here again?
> >> 
> >> Yes, that's true.
> > 
> > No.  Because the problem is essentially a fluke pass, not a fluke
> > fail.
> 
> I'm not sure - previously, iirc, we had inconsistent successes and
> failures of this test (and I think another one or two). Now we
> appear to have run into a consistent failure state, so something
> must have changed.
> 
> Luckily there is an indication from Olaf that rather than reverting,
> applying the remaining pieces of the broken up RTC emulation
> changes (which I didn't post formally yet, mainly in the hope to
> get a push first, considering that these bits were what originally
> caused regressions when applied as a single monolithic change -
> and with a bug fixed only after I split things apart - late in the
> 4.2 cycle) unbreaks what he reported broken.
> 
> I could certainly post that patch right away, but I'd like to give
> it a little more time to see whether Olaf can confirm his initial
> findings, and because with that I'm less certain that the test
> failure really is to be attributed to the RTC emulation changes
> at all.

Based on <1359987978.7743.56.camel@zakaz.uk.xensource.com> I don't think
the RTC changes are to blame, since Ian says the baseline was
5af4f2ab06f3 which is before then.

Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 14:44             ` Ian Campbell
@ 2013-02-04 14:48               ` Jan Beulich
  2013-02-04 15:36                 ` Ian Jackson
  0 siblings, 1 reply; 15+ messages in thread
From: Jan Beulich @ 2013-02-04 14:48 UTC (permalink / raw)
  To: Ian Campbell; +Cc: Keir Fraser, Ian Jackson, xen-devel@lists.xensource.com

>>> On 04.02.13 at 15:44, Ian Campbell <Ian.Campbell@citrix.com> wrote:
> On Mon, 2013-02-04 at 14:39 +0000, Jan Beulich wrote:
>> >>> On 04.02.13 at 15:22, Ian Jackson <Ian.Jackson@eu.citrix.com> wrote:
>> > Ian Campbell writes ("Re: [Xen-devel] [xen-unstable test] 15401: 
> regressions - 
>> > FAIL"):
>> >> On Mon, 2013-02-04 at 11:17 +0000, Jan Beulich wrote:
>> >> > >>> On 04.02.13 at 12:06, Ian Campbell <Ian.Campbell@citrix.com> wrote:
>> >> > > On Fri, 2013-02-01 at 11:44 +0000, Ian Jackson wrote:
>> >> > >> Under the circumstances it's not clear that the current staging is any
>> >> > >> worse than non-staging.  I think we should push the revision reported
>> >> > >> in this test (which was otherwise OK according to the tester) to
>> >> > >> non-staging, with a manual "hg push".
>> >> > > 
>> >> > > This sounds like a good idea.
>> >> > 
>> >> > Wouldn't that set us up for the same problem again when the next
>> >> > testing round fails here again?
>> >> 
>> >> Yes, that's true.
>> > 
>> > No.  Because the problem is essentially a fluke pass, not a fluke
>> > fail.
>> 
>> I'm not sure - previously, iirc, we had inconsistent successes and
>> failures of this test (and I think another one or two). Now we
>> appear to have run into a consistent failure state, so something
>> must have changed.
>> 
>> Luckily there is an indication from Olaf that rather than reverting,
>> applying the remaining pieces of the broken up RTC emulation
>> changes (which I didn't post formally yet, mainly in the hope to
>> get a push first, considering that these bits were what originally
>> caused regressions when applied as a single monolithic change -
>> and with a bug fixed only after I split things apart - late in the
>> 4.2 cycle) unbreaks what he reported broken.
>> 
>> I could certainly post that patch right away, but I'd like to give
>> it a little more time to see whether Olaf can confirm his initial
>> findings, and because with that I'm less certain that the test
>> failure really is to be attributed to the RTC emulation changes
>> at all.
> 
> Based on <1359987978.7743.56.camel@zakaz.uk.xensource.com> I don't think
> the RTC changes are to blame, since Ian says the baseline was
> 5af4f2ab06f3 which is before then.

Okay - I'm certainly not opposed to a manual push.

Jan

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [xen-unstable test] 15401: regressions - FAIL
  2013-02-04 14:48               ` Jan Beulich
@ 2013-02-04 15:36                 ` Ian Jackson
  0 siblings, 0 replies; 15+ messages in thread
From: Ian Jackson @ 2013-02-04 15:36 UTC (permalink / raw)
  To: Jan Beulich; +Cc: xen-devel@lists.xensource.com, Keir Fraser, Ian Campbell

Jan Beulich writes ("Re: [Xen-devel] [xen-unstable test] 15401: regressions - FAIL"):
> Okay - I'm certainly not opposed to a manual push.

Done.  Specifically, I have pushed d1bf3b21f783 to non-staging
xen-unstable.  The remaining backlog in staging will probably clear
soon too.

Ian.

^ permalink raw reply	[flat|nested] 15+ messages in thread

end of thread, other threads:[~2013-02-04 15:36 UTC | newest]

Thread overview: 15+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2013-02-01  2:41 [xen-unstable test] 15401: regressions - FAIL xen.org
2013-02-01 11:44 ` Ian Jackson
2013-02-04 11:06   ` Ian Campbell
2013-02-04 11:17     ` Jan Beulich
2013-02-04 11:22       ` Ian Campbell
2013-02-04 14:22         ` Ian Jackson
2013-02-04 14:24           ` Ian Campbell
2013-02-04 14:30             ` Ian Jackson
2013-02-04 14:33               ` Ian Campbell
2013-02-04 14:39           ` Jan Beulich
2013-02-04 14:44             ` Ian Campbell
2013-02-04 14:48               ` Jan Beulich
2013-02-04 15:36                 ` Ian Jackson
2013-02-04 14:19     ` Ian Jackson
2013-02-04 14:26       ` Ian Campbell

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.