* [linux-3.4 test] 61301: regressions - FAIL
@ 2015-09-04 8:58 osstest service owner
2015-09-09 9:44 ` linux-3.4 broken on chardonnay and huxelrebe (Re: [linux-3.4 test] 61301: regressions - FAIL) Ian Campbell
0 siblings, 1 reply; 5+ messages in thread
From: osstest service owner @ 2015-09-04 8:58 UTC (permalink / raw)
To: xen-devel, osstest-admin
flight 61301 linux-3.4 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/61301/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-amd64-xl-qemut-win7-amd64 6 xen-boot fail REGR. vs. 30511
Tests which are failing intermittently (not blocking):
test-amd64-amd64-xl-sedf-pin 6 xen-boot fail in 58831 pass in 58798
test-amd64-i386-xl-qemuu-win7-amd64 9 windows-install fail in 58831 pass in 61301
test-amd64-i386-pair 10 xen-boot/dst_host fail pass in 58831
test-amd64-i386-pair 9 xen-boot/src_host fail pass in 58831
test-amd64-amd64-xl 6 xen-boot fail pass in 59576
test-amd64-amd64-pair 10 xen-boot/dst_host fail pass in 59961
test-amd64-amd64-libvirt 6 xen-boot fail pass in 60064
test-amd64-amd64-pair 9 xen-boot/src_host fail pass in 60953
Regressions which are regarded as allowable (not blocking):
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm 6 xen-boot fail baseline untested
test-amd64-amd64-xl-multivcpu 6 xen-boot fail baseline untested
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 6 xen-boot fail baseline untested
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm 6 xen-boot fail baseline untested
test-amd64-amd64-xl-xsm 6 xen-boot fail baseline untested
test-amd64-i386-libvirt-xsm 6 xen-boot fail baseline untested
test-amd64-amd64-xl-credit2 6 xen-boot fail baseline untested
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 6 xen-boot fail baseline untested
test-amd64-amd64-libvirt-qcow2 6 xen-boot fail baseline untested
test-amd64-amd64-i386-pvgrub 6 xen-boot fail baseline untested
test-amd64-amd64-xl-rtds 6 xen-boot fail baseline untested
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm 6 xen-boot fail baseline untested
test-amd64-amd64-xl-qcow2 6 xen-boot fail baseline untested
test-amd64-i386-xl-xsm 6 xen-boot fail baseline untested
test-amd64-amd64-pygrub 6 xen-boot fail baseline untested
test-amd64-i386-libvirt-raw 17 guest-start/debian.repeat fail baseline untested
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail baseline untested
test-amd64-amd64-xl-sedf 6 xen-boot fail in 58831 like 30406
test-amd64-amd64-libvirt-xsm 6 xen-boot fail in 59576 baseline untested
test-amd64-amd64-libvirt 11 guest-start fail in 59576 like 30511
test-amd64-i386-libvirt 11 guest-start fail in 59576 like 30511
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 11 guest-saverestore fail in 59961 baseline untested
test-amd64-i386-xl-qemut-win7-amd64 15 guest-localmigrate/x10 fail in 59961 like 30394
test-amd64-i386-qemut-rhel6hvm-amd 12 guest-start/redhat.repeat fail in 60064 blocked in 30511
test-amd64-amd64-libvirt-raw 6 xen-boot fail in 60953 baseline untested
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail in 60953 baseline untested
test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 30511
test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail like 30511
test-amd64-amd64-xl-qemuu-ovmf-amd64 6 xen-boot fail like 53709-bisect
test-amd64-i386-xl 6 xen-boot fail like 53725-bisect
test-amd64-i386-freebsd10-amd64 6 xen-boot fail like 58780-bisect
test-amd64-i386-xl-qemuu-winxpsp3 6 xen-boot fail like 58786-bisect
test-amd64-i386-qemut-rhel6hvm-intel 6 xen-boot fail like 58788-bisect
test-amd64-i386-rumpuserxen-i386 6 xen-boot fail like 58799-bisect
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 6 xen-boot fail like 58801-bisect
test-amd64-amd64-xl-qemuu-debianhvm-amd64 6 xen-boot fail like 58803-bisect
test-amd64-amd64-xl-qemut-winxpsp3 6 xen-boot fail like 58804-bisect
test-amd64-i386-freebsd10-i386 6 xen-boot fail like 58805-bisect
test-amd64-i386-xl-qemuu-ovmf-amd64 6 xen-boot fail like 58806-bisect
test-amd64-amd64-xl-qemuu-winxpsp3 6 xen-boot fail like 58807-bisect
test-amd64-i386-xl-qemut-winxpsp3 6 xen-boot fail like 58808-bisect
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 6 xen-boot fail like 58809-bisect
test-amd64-amd64-rumpuserxen-amd64 6 xen-boot fail like 58810-bisect
test-amd64-i386-xl-qemuu-debianhvm-amd64 6 xen-boot fail like 58811-bisect
test-amd64-amd64-xl-qemut-debianhvm-amd64 6 xen-boot fail like 58813-bisect
test-amd64-i386-qemuu-rhel6hvm-intel 6 xen-boot fail like 58814-bisect
test-amd64-i386-xl-qemut-debianhvm-amd64 6 xen-boot fail like 58815-bisect
Tests which did not succeed, but are not blocking:
test-amd64-amd64-libvirt 12 migrate-support-check fail in 58831 never pass
test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
test-amd64-amd64-xl-pvh-intel 11 guest-start fail never pass
test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-amd64-amd64-libvirt-raw 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-raw 11 migrate-support-check fail never pass
test-amd64-i386-libvirt 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-qcow2 11 migrate-support-check fail never pass
test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail never pass
version targeted for testing:
linux cf1b3dad6c5699b977273276bada8597636ef3e2
baseline version:
linux bb4a05a0400ed6d2f1e13d1f82f289ff74300a70
Last test of basis 30511 2014-09-29 16:37:46 Z 339 days
Failing since 32004 2014-12-02 04:10:03 Z 276 days 213 attempts
Testing same since 58781 2015-06-20 14:15:50 Z 75 days 67 attempts
------------------------------------------------------------
500 people touched revisions under test,
not listing them all
jobs:
build-amd64-xsm pass
build-i386-xsm pass
build-amd64 pass
build-i386 pass
build-amd64-libvirt pass
build-i386-libvirt pass
build-amd64-pvops pass
build-i386-pvops pass
build-amd64-rumpuserxen pass
build-i386-rumpuserxen pass
test-amd64-amd64-xl fail
test-amd64-i386-xl fail
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm fail
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm fail
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm fail
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm fail
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-amd64-libvirt-xsm pass
test-amd64-i386-libvirt-xsm fail
test-amd64-amd64-xl-xsm fail
test-amd64-i386-xl-xsm fail
test-amd64-amd64-xl-pvh-amd fail
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 fail
test-amd64-i386-xl-qemut-debianhvm-amd64 fail
test-amd64-amd64-xl-qemuu-debianhvm-amd64 fail
test-amd64-i386-xl-qemuu-debianhvm-amd64 fail
test-amd64-i386-freebsd10-amd64 fail
test-amd64-amd64-xl-qemuu-ovmf-amd64 fail
test-amd64-i386-xl-qemuu-ovmf-amd64 fail
test-amd64-amd64-rumpuserxen-amd64 fail
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-amd64-amd64-xl-credit2 fail
test-amd64-i386-freebsd10-i386 fail
test-amd64-i386-rumpuserxen-i386 fail
test-amd64-amd64-xl-pvh-intel fail
test-amd64-i386-qemut-rhel6hvm-intel fail
test-amd64-i386-qemuu-rhel6hvm-intel fail
test-amd64-amd64-libvirt fail
test-amd64-i386-libvirt pass
test-amd64-amd64-xl-multivcpu fail
test-amd64-amd64-pair fail
test-amd64-i386-pair fail
test-amd64-amd64-libvirt-pair fail
test-amd64-i386-libvirt-pair fail
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub fail
test-amd64-amd64-pygrub fail
test-amd64-amd64-libvirt-qcow2 fail
test-amd64-i386-libvirt-qcow2 pass
test-amd64-amd64-xl-qcow2 fail
test-amd64-i386-xl-qcow2 pass
test-amd64-amd64-libvirt-raw pass
test-amd64-i386-libvirt-raw fail
test-amd64-amd64-xl-raw pass
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds fail
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 fail
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 fail
test-amd64-amd64-libvirt-vhd pass
test-amd64-i386-libvirt-vhd pass
test-amd64-amd64-xl-vhd pass
test-amd64-i386-xl-vhd pass
test-amd64-amd64-xl-qemut-winxpsp3 fail
test-amd64-i386-xl-qemut-winxpsp3 fail
test-amd64-amd64-xl-qemuu-winxpsp3 fail
test-amd64-i386-xl-qemuu-winxpsp3 fail
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
Not pushing.
(No revision log; it would be 17783 lines long.)
^ permalink raw reply [flat|nested] 5+ messages in thread
* linux-3.4 broken on chardonnay and huxelrebe (Re: [linux-3.4 test] 61301: regressions - FAIL)
2015-09-04 8:58 [linux-3.4 test] 61301: regressions - FAIL osstest service owner
@ 2015-09-09 9:44 ` Ian Campbell
2015-09-10 9:32 ` Ian Campbell
0 siblings, 1 reply; 5+ messages in thread
From: Ian Campbell @ 2015-09-09 9:44 UTC (permalink / raw)
To: osstest service owner, xen-devel
On Fri, 2015-09-04 at 08:58 +0000, osstest service owner wrote:
> flight 61301 linux-3.4 real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/61301/
>
> Regressions :-(
>
> Tests which did not succeed and are blocking,
> including tests which could not be run:
> test-amd64-amd64-xl-qemut-win7-amd64 6 xen-boot fail REGR. vs. 30511
linux-3.4 seems to have trouble booting on chardonnay and huxelrebe, and
has accumulated _most_ of its jobs in persistent failures on one or the
other of those hosts[1]
Skimming a couple of logs it seems the systems fail for different reasons.
chardonanys are failing to find their root disk while the huxelrebes appear
to boot ok but not get any networking.
Of the chardonnay failures
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-win7-amd64/linux-3.4.html
is interesting. All the others show a history of passing on other machines
and then eventually hitting chardonnay and beginning to fail, while
test-amd64-amd64-xl-qemut-win7-amd64 was booting on chardonnay and then at
some point started failing reliably (with one random looking boot early
on). This might provide sufficient points in the sand to try and bisection.
For the huxelrebes no such luck, I only looked at the first dozen failures
but they all have either always run (and failed) on huxelrebe or they
started failing as soon as they were scheduled on huxelrebe.
However taking test-amd64-amd64-xl-xsm it seems to have passed on huxelrebe
on linux-3.10, which gives us _something_ to go on.
So, I think I can try and convince the bisector to have another go at the
point in time where chardonnay started failing
test-amd64-amd64-xl-qemut-win7-amd64.
For huxelrebe I can try running some adhoc tests at various points between
3.4 and 3.10 (initially 3.{5,6,7,8,9}) and then the -rcs around the change,
which might point to a region fix. If not then what I really want to do is
an inverted bisect to find the point at which it was fixed...
Ian.
[1]
> select steps.job,steps.testid,steps.status,runvars.val from steps,runvars where steps.flight=runvars.flight and steps.job=runvars.job and steps.flight='61301' and steps.testid = 'xen-boot' and runvars.name like '%host' order by runvars.val;
job | testid | status | val
-------------------------------------------------------+----------+--------+-------------
test-amd64-amd64-libvirt-qcow2 | xen-boot | fail | chardonnay0
test-amd64-amd64-pygrub | xen-boot | fail | chardonnay0
test-amd64-amd64-libvirt | xen-boot | fail | chardonnay0
test-amd64-amd64-xl-qcow2 | xen-boot | fail | chardonnay0
test-amd64-amd64-xl-rtds | xen-boot | fail | chardonnay1
test-amd64-amd64-xl-qemut-win7-amd64 | xen-boot | fail | chardonnay1
test-amd64-i386-libvirt-vhd | xen-boot | pass | elbling0
test-amd64-i386-libvirt | xen-boot | pass | elbling0
test-amd64-i386-xl-qcow2 | xen-boot | pass | elbling0
test-amd64-amd64-xl-qemuu-win7-amd64 | xen-boot | pass | elbling1
test-amd64-i386-xl-qemut-win7-amd64 | xen-boot | pass | elbling1
test-amd64-amd64-xl-vhd | xen-boot | pass | fiano0
test-amd64-i386-libvirt-qcow2 | xen-boot | pass | fiano0
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm | xen-boot | pass | fiano1
test-amd64-i386-xl-qemuu-win7-amd64 | xen-boot | pass | fiano1
test-amd64-amd64-xl-pvh-intel | xen-boot | pass | fiano1
test-amd64-amd64-libvirt-raw | xen-boot | pass | godello0
test-amd64-amd64-libvirt-vhd | xen-boot | pass | godello1
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm | xen-boot | fail | huxelrebe0
test-amd64-amd64-xl-credit2 | xen-boot | fail | huxelrebe0
test-amd64-amd64-xl-qemut-winxpsp3 | xen-boot | fail | huxelrebe0
test-amd64-amd64-xl | xen-boot | fail | huxelrebe0
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 | xen-boot | fail | huxelrebe0
test-amd64-amd64-xl-qemuu-ovmf-amd64 | xen-boot | fail | huxelrebe0
test-amd64-amd64-rumpuserxen-amd64 | xen-boot | fail | huxelrebe0
test-amd64-i386-xl-qemut-winxpsp3 | xen-boot | fail | huxelrebe0
test-amd64-i386-rumpuserxen-i386 | xen-boot | fail | huxelrebe0
test-amd64-i386-xl-qemuu-winxpsp3 | xen-boot | fail | huxelrebe0
test-amd64-amd64-xl-xsm | xen-boot | fail | huxelrebe0
test-amd64-i386-freebsd10-i386 | xen-boot | fail | huxelrebe0
test-amd64-i386-qemut-rhel6hvm-intel | xen-boot | fail | huxelrebe0
test-amd64-i386-xl-qemut-debianhvm-amd64 | xen-boot | fail | huxelrebe0
test-amd64-amd64-xl-multivcpu | xen-boot | fail | huxelrebe0
test-amd64-i386-libvirt-xsm | xen-boot | fail | huxelrebe0
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm | xen-boot | fail | huxelrebe0
test-amd64-i386-xl-xsm | xen-boot | fail | huxelrebe1
test-amd64-amd64-i386-pvgrub | xen-boot | fail | huxelrebe1
test-amd64-amd64-xl-qemut-debianhvm-amd64 | xen-boot | fail | huxelrebe1
test-amd64-amd64-xl-qemuu-debianhvm-amd64 | xen-boot | fail | huxelrebe1
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm | xen-boot | fail | huxelrebe1
test-amd64-amd64-xl-qemuu-winxpsp3 | xen-boot | fail | huxelrebe1
test-amd64-i386-freebsd10-amd64 | xen-boot | fail | huxelrebe1
test-amd64-i386-qemuu-rhel6hvm-intel | xen-boot | fail | huxelrebe1
test-amd64-i386-xl | xen-boot | fail | huxelrebe1
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm | xen-boot | fail | huxelrebe1
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 | xen-boot | fail | huxelrebe1
test-amd64-i386-xl-qemuu-debianhvm-amd64 | xen-boot | fail | huxelrebe1
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm | xen-boot | fail | huxelrebe1
test-amd64-i386-xl-qemuu-ovmf-amd64 | xen-boot | fail | huxelrebe1
test-amd64-amd64-amd64-pvgrub | xen-boot | pass | italia0
test-amd64-i386-libvirt-raw | xen-boot | pass | italia0
test-amd64-amd64-libvirt-xsm | xen-boot | pass | merlot0
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm | xen-boot | pass | merlot0
test-amd64-i386-qemuu-rhel6hvm-amd | xen-boot | pass | merlot0
test-amd64-i386-qemut-rhel6hvm-amd | xen-boot | pass | merlot1
test-amd64-i386-xl-raw | xen-boot | pass | merlot1
test-amd64-i386-xl-vhd | xen-boot | pass | pinot0
test-amd64-amd64-xl-pvh-amd | xen-boot | pass | pinot1
test-amd64-amd64-xl-raw | xen-boot | pass | rimava1
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm | xen-boot | pass | rimava1
(60 rows)
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: linux-3.4 broken on chardonnay and huxelrebe (Re: [linux-3.4 test] 61301: regressions - FAIL)
2015-09-09 9:44 ` linux-3.4 broken on chardonnay and huxelrebe (Re: [linux-3.4 test] 61301: regressions - FAIL) Ian Campbell
@ 2015-09-10 9:32 ` Ian Campbell
2015-09-15 8:47 ` Ian Campbell
0 siblings, 1 reply; 5+ messages in thread
From: Ian Campbell @ 2015-09-10 9:32 UTC (permalink / raw)
To: osstest service owner, xen-devel
On Wed, 2015-09-09 at 10:44 +0100, Ian Campbell wrote:
> On Fri, 2015-09-04 at 08:58 +0000, osstest service owner wrote:
> > flight 61301 linux-3.4 real [real]
> > http://logs.test-lab.xenproject.org/osstest/logs/61301/
> >
> > Regressions :-(
> >
> > Tests which did not succeed and are blocking,
> > including tests which could not be run:
> > test-amd64-amd64-xl-qemut-win7-amd64 6 xen-boot fail REGR.
> > vs. 30511
>
> linux-3.4 seems to have trouble booting on chardonnay and huxelrebe,
I ran some adhoc tests on some jobs selected because I could see they
passed on these hosts (or their partners) on later Linux versions:
Tag Revision Flight huxelrebe0 chardonnay1
^test-amd64-amd64-libvirt
^test-amd64-amd64-xl
v3.4 76e10d158efb6d4516018846f60c2ab5501900bc 61710 FAIL PASS
v3.5 28a33cbc24e4256c143dce96c7d93bf423229f92 61713 PASS FAIL
v3.6 a0d271cbfed1dd50278c6b06bead3d00ba0a88f9 61714 PASS PASS
v3.7 29594404d7fe73cd80eaa4ee8c43dcc53970c60e 61715 PASS PASS
v3.8 19f949f52599ba7c3f67a5897ac6be14bfcb1200 61716 PASS FAIL
v3.9 c1be5a5b1b355d40e6cf79cc979eb66dafa24ad1 61717 PASS PASS
v3.10 8bb495e3f02401ee6f76d1b1d77f3ac9f079e376 61703 PASS PASS
(unfortunately due to a configuration issue I have no logs from these, just
the overall result :-(. Luckily I think for now they aren't necessary for
the analysis)
The Chardonnay case suggests that either something has been backported into
3.4.x which has broken things (current real flights, which reliably fail,
are running on 3.4.108) or that it is simply unreliable (or both). I think
I need to repeat things a few times to confirm.
The Huxelrebe case is apparently more obvious, I noticed that the Ethernet
device from [0] us a "Intel Corporation I210 Gigabit Network Connection"
which the Debian kernel detects (in [1]) as:
Aug 18 01:38:56.085002 [ 2.386215] igb 0000:03:00.0: Intel(R) Gigabit Ethernet Network Connection
Aug 18 01:38:56.133067 [ 2.393591] igb 0000:03:00.0: eth1: (PCIe:2.5Gb/s:Width x1) 44:39:c4:6d:20:60
Aug 18 01:38:56.141009 [ 2.401248] igb 0000:03:00.0: eth1: PBA No: 000300-000
But which 3.4 doesn't pick up at all in [2]. In the logs between 3.4 and
3.5 I see:
commit f96a8a0b78548c0ec06b0b4b438db6ee895d67e9
Author: Carolyn Wyborny <carolyn.wyborny@intel.com>
Date: Fri Apr 6 23:25:19 2012 +0000
igb: Add Support for new i210/i211 devices.
This patch adds new initialization functions and device support
for i210 and i211 devices.
Signed-off-by: Carolyn Wyborny <carolyn.wyborny@intel.com>
Tested-by: Jeff Pieper <jeffrey.e.pieper@intel.com>
Signed-off-by: Jeff Kirsher <jeffrey.t.kirsher@intel.com>
Which seems pretty straight forwards.
These systems actually have a pair of these devices (the other is
0000:02:00.0/eth0) and another which is detected by Debian as:
Aug 18 01:38:56.149025 [ 2.403785] e1000e 0000:00:19.0: eth2: (PCI Express:2.5GT/s:Width x1) 44:39:c4:39:a1:19
Aug 18 01:38:56.157078 [ 2.403787] e1000e 0000:00:19.0: eth2: Intel(R) PRO/1000 Network Connection
Aug 18 01:38:56.165003 [ 2.403862] e1000e 0000:00:19.0: eth2: MAC: 11, PHY: 12, PBA No: FFFFFF-0FF
But which linux-3.4 also doesn't see.
I've not confirmed whether f96a8a0b78 is the only required patch and it is
not entirely trivial so I don't know if it would be considered a valid
backport. We could perhaps consider arranging that these machines are only
used for newer kernels somehow?
Ian.
[0] http://logs.test-lab.xenproject.org/osstest/logs/60711/test-amd64-amd64-xl/huxelrebe1-output-lspci_-tv
[1] http://logs.test-lab.xenproject.org/osstest/logs/60711/test-amd64-amd64-xl/serial-huxelrebe1.log
[2] http://logs.test-lab.xenproject.org/osstest/logs/61301/test-amd64-amd64-xl/serial-huxelrebe0.log
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: linux-3.4 broken on chardonnay and huxelrebe (Re: [linux-3.4 test] 61301: regressions - FAIL)
2015-09-10 9:32 ` Ian Campbell
@ 2015-09-15 8:47 ` Ian Campbell
2015-09-15 11:04 ` Ian Campbell
0 siblings, 1 reply; 5+ messages in thread
From: Ian Campbell @ 2015-09-15 8:47 UTC (permalink / raw)
To: osstest service owner, xen-devel; +Cc: Ian.Jackson
On Thu, 2015-09-10 at 10:32 +0100, Ian Campbell wrote:
> The Chardonnay case suggests that either something has been backported into
> 3.4.x which has broken things (current real flights, which reliably fail,
> are running on 3.4.108) or that it is simply unreliable (or both). I think
> I need to repeat things a few times to confirm.
It turns out it was unreliable and these results were misleading. I setup
an adhoc job which simply installed Xen and rebooted 5 times and 3.4.x (for
x in increments of 10) failed reliably. In fact the fix wasn't until v3.7
-rc1 and some adhoc runs have fingered 65fe1f0f66a5 "ahci: implement
aggressive SATA device sleep support"[0]. I'm running a few more tests to
confirm but this looks reasonably certain.
That commit is a new feature, so it really shouldn't have the affect of
fixing bugs! I suspect this is something like a dodgy BIOS enabling the h/w
extension, which breaks until the kernel became aware of it and either
disables or explicitly copes with it being there.
Once the confirmation tests have run I will lock the machine and have a
poke around and see what I can see.
I could then take it to the Linux AHCI maintainer but I suspect that a
backport is only a slim possibility, as is someone taking the time to
determine which bit of this feature happened to fix these systems.
IOW I'm thinking that we should apply a minimum kernel version to
chardonnay as well as huxelrebe (once that feature exists).
Ian.
[0] git.kernel.org/torvalds/c/65fe1f0f66a57380229a4ced844188103135f37b
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: linux-3.4 broken on chardonnay and huxelrebe (Re: [linux-3.4 test] 61301: regressions - FAIL)
2015-09-15 8:47 ` Ian Campbell
@ 2015-09-15 11:04 ` Ian Campbell
0 siblings, 0 replies; 5+ messages in thread
From: Ian Campbell @ 2015-09-15 11:04 UTC (permalink / raw)
To: osstest service owner, xen-devel; +Cc: Ian.Jackson
On Tue, 2015-09-15 at 09:47 +0100, Ian Campbell wrote:
> On Thu, 2015-09-10 at 10:32 +0100, Ian Campbell wrote:
> > The Chardonnay case suggests that either something has been backported
> > into
> > 3.4.x which has broken things (current real flights, which reliably
> > fail,
> > are running on 3.4.108) or that it is simply unreliable (or both). I
> > think
> > I need to repeat things a few times to confirm.
>
> It turns out it was unreliable and these results were misleading. I setup
> an adhoc job which simply installed Xen and rebooted 5 times and 3.4.x
> (for
> x in increments of 10) failed reliably. In fact the fix wasn't until v3.7
> -rc1 and some adhoc runs have fingered 65fe1f0f66a5 "ahci: implement
> aggressive SATA device sleep support"[0]. I'm running a few more tests to
> confirm but this looks reasonably certain.
The tests confirmed this diagnosis.
> That commit is a new feature, so it really shouldn't have the affect of
> fixing bugs! I suspect this is something like a dodgy BIOS enabling the
> h/w
> extension, which breaks until the kernel became aware of it and either
> disables or explicitly copes with it being there.
>
> Once the confirmation tests have run I will lock the machine and have a
> poke around and see what I can see.
>
> I could then take it to the Linux AHCI maintainer but I suspect that a
> backport is only a slim possibility, as is someone taking the time to
> determine which bit of this feature happened to fix these systems.
>
> IOW I'm thinking that we should apply a minimum kernel version to
> chardonnay as well as huxelrebe (once that feature exists).
I'm looking into this now.
I'm currently dithering on whether it is worth taking this to upstream
stable or not.
>
> Ian.
>
> [0] git.kernel.org/torvalds/c/65fe1f0f66a57380229a4ced844188103135f37b
>
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2015-09-15 11:04 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-09-04 8:58 [linux-3.4 test] 61301: regressions - FAIL osstest service owner
2015-09-09 9:44 ` linux-3.4 broken on chardonnay and huxelrebe (Re: [linux-3.4 test] 61301: regressions - FAIL) Ian Campbell
2015-09-10 9:32 ` Ian Campbell
2015-09-15 8:47 ` Ian Campbell
2015-09-15 11:04 ` Ian Campbell
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).