From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ian Campbell Subject: Re: [linux-4.1 test] 79008: regressions - FAIL Date: Tue, 2 Feb 2016 14:10:03 +0000 Message-ID: <1454422203.28781.164.camel@citrix.com> References: <1453893497.25257.97.camel@citrix.com> <1453896354.26591.10.camel@citrix.com> Mime-Version: 1.0 Content-Type: multipart/mixed; boundary="=-IXa0Wuw4kFs6s0cY3lVj" Return-path: In-Reply-To: <1453896354.26591.10.camel@citrix.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: osstest service owner , xen-devel@lists.xensource.com, Ian Jackson List-Id: xen-devel@lists.xenproject.org --=-IXa0Wuw4kFs6s0cY3lVj Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Wed, 2016-01-27 at 12:05 +0000, Ian Campbell wrote: > On Wed, 2016-01-27 at 11:18 +0000, Ian Campbell wrote: > > On Tue, 2016-01-26 at 13:11 +0000, osstest service owner wrote: > > > flight 79008 linux-4.1 real [real] > > > http://logs.test-lab.xenproject.org/osstest/logs/79008/ > > >=20 > > > Regressions :-( > > >=20 > > > Tests which did not succeed and are blocking, > > > including tests which could not be run: > > > =C2=A0test-armhf-armhf-xl-credit2=C2=A0=C2=A015 guest-start/debian.re= peat fail REGR. > > > vs. 66399 > > > =C2=A0test-armhf-armhf-xl-xsm=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A015 g= uest-start/debian.repeat fail REGR. > > > vs. 66399 > >=20 > > These were both: > >=20 > > 2016-01-26 01:20:33 Z executing ssh ... root@172.16.147.101 echo guest > > debian.guest.osstest: ok=C2=A0 > > Warning: Permanently added '172.16.147.101' (ECDSA) to the list of > > known hosts. > > key_verify failed for server_host_key So I've narrowed this down a bit, but not yet sufficiently to actually diagnose. The issue only occurs when the userspace is Debian Jessie. Debian Wheezy does not, for some reason, expose this. It seems unlikely (although not impossible) to be a real issue in Jessie vs Wheezy, more likely some different behaviour in Jessie's sshd just exposes some issue somewhere else. When running Jessie userspace the issue only appeared somewhere between Linux v3.18 and v3.19, I'm currently looking at bisecting that range in case the commit which exposed the issue gives a hint (I fear it wont though). The attached ts-fetch-check-file exposes this pretty readily against either dom0 or domU (slightly differing symptoms) on effected versions. I can reproduce on the cubietruck on my desk as well as in the COLO. I cannot reproduce on the same cubietruck on my desk when running native 4.1, it only happens when running under Xen. I cannot reproduce on the arndale on my desk. I've not tried in the COLO since the test results suggest there would be no point -- there is no sign of this class of failure in the colo on arndale nor on any x86 box. Ian. --=-IXa0Wuw4kFs6s0cY3lVj Content-Disposition: attachment; filename*0="0001-ts-fetch-check-file-new-ts-to-fetch-a-file-and-check.pat"; filename*1="ch" Content-Type: text/x-patch; name="0001-ts-fetch-check-file-new-ts-to-fetch-a-file-and-check.patch"; charset="UTF-8" Content-Transfer-Encoding: base64 RnJvbSAzMzdmNjYzYzEzZTQ2ZjgxNWNlMWYxM2IwNzBiNDkyZjhkMjQ4YjBjIE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBJYW4gQ2FtcGJlbGwgPGlhbi5jYW1wYmVsbEBjaXRyaXguY29t PgpEYXRlOiBUdWUsIDIgRmViIDIwMTYgMTA6NTQ6NDIgKzAwMDAKU3ViamVjdDogW1BBVENIXSB0 cy1mZXRjaC1jaGVjay1maWxlOiBuZXcgdHMgdG8gZmV0Y2ggYSBmaWxlIGFuZCBjaGVjayBmb3IK IGNvcnJ1cHRpb24KCkNvbXBhcmVzIGEgY2hlY2tzdW0gY29tcHV0ZWQgb24gdGhlIHRhcmdldCB3 aXRoIG9uZSBjb21wdXRlZCBhZnRlcgpjYXQndGluZyB0aGUgZmlsZSBvdmVyIHNzaC4gUGlja3Mg dXAgb24gbmV0d29yayBjb3JydXB0aW9uIGVycm9ycyBldGMKd2hpY2ggbWlnaHQgYmUgbWlzc2Vk IHdpdGggc21hbGxlciBpbnRlcmFjdGlvbnMuCgpXb3JrcyBmb3IgZ3Vlc3RzIG9yIGhvc3RzLgoK VG8gc3VwcG9ydCB0aGlzIGFkZCBhIHZhcmlhbnQgb2YgdGFyZ2V0X2NtZF9vdXRwdXQgd2hpY2gg cmV0dXJucyB0aGUKZmlsZSBkZXNjcmlwdG9yIGluc3RlYWQgb2YgdGhlIGFjdHVhbCBkYXRhICh3 aGljaCBjb3VsZCBiZSBsYXJnZSksCmFsbG93aW5nIHVzIHRvIHBpcGUgaXQgdG8gdGhlIGxvY2Fs IHN1bS4KClNpZ25lZC1vZmYtYnk6IElhbiBDYW1wYmVsbCA8aWFuLmNhbXBiZWxsQGNpdHJpeC5j b20+Ci0tLQogT3NzdGVzdC9UZXN0U3VwcG9ydC5wbSB8IDEwICsrKysrKy0tCiB0cy1mZXRjaC1j aGVjay1maWxlICAgIHwgNjggKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKysrKysr KysrKysrKysrKysKIDIgZmlsZXMgY2hhbmdlZCwgNzYgaW5zZXJ0aW9ucygrKSwgMiBkZWxldGlv bnMoLSkKIGNyZWF0ZSBtb2RlIDEwMDc1NSB0cy1mZXRjaC1jaGVjay1maWxlCgpkaWZmIC0tZ2l0 IGEvT3NzdGVzdC9UZXN0U3VwcG9ydC5wbSBiL09zc3Rlc3QvVGVzdFN1cHBvcnQucG0KaW5kZXgg MjE0MTkwNS4uM2MyODdiMiAxMDA2NDQKLS0tIGEvT3NzdGVzdC9UZXN0U3VwcG9ydC5wbQorKysg Yi9Pc3N0ZXN0L1Rlc3RTdXBwb3J0LnBtCkBAIC01MSw2ICs1MSw3IEBAIEJFR0lOIHsKIAogICAg ICAgICAgICAgICAgICAgICAgIHRhcmdldF9jbWRfcm9vdCB0YXJnZXRfY21kIHRhcmdldF9jbWRf YnVpbGQKICAgICAgICAgICAgICAgICAgICAgICB0YXJnZXRfY21kX291dHB1dF9yb290IHRhcmdl dF9jbWRfb3V0cHV0CisgICAgICAgICAgICAgICAgICAgICAgdGFyZ2V0X2NtZF9zdGRvdXRmZCB0 YXJnZXRfY21kX3N0ZG91dGZkX3Jvb3QKICAgICAgICAgICAgICAgICAgICAgICB0YXJnZXRfY21k X2lucHV0Zmhfcm9vdCBzc2h1aG8KICAgICAgICAgICAgICAgICAgICAgICB0YXJnZXRfZ2V0Zmls ZSB0YXJnZXRfZ2V0ZmlsZV9yb290CiAgICAgICAgICAgICAgICAgICAgICAgdGFyZ2V0X3B1dGZp bGUgdGFyZ2V0X3B1dGZpbGVfcm9vdApAQCAtNjQ2LDkgKzY0NywxMSBAQCBzdWIgdGFyZ2V0X2Nt ZCAoJCQ7JCQpIHsgdGNtZCh1bmRlZix1bmRlZiwnb3NzdGVzdCcsQF8pOyB9CiBzdWIgdGFyZ2V0 X2NtZF9yb290ICgkJDskJCkgeyB0Y21kKHVuZGVmLHVuZGVmLCdyb290JyxAXyk7IH0KIAogc3Vi IHRjbWRvdXQgeworICAgIG15ICR3YW50ZmQgPSBzaGlmdDsKICAgICBteSAkc3Rkb3V0PSBJTzo6 RmlsZTo6bmV3X3RtcGZpbGUoKTsKICAgICB0Y21kKHVuZGVmLCRzdGRvdXQsQF8pOwogICAgICRz dGRvdXQtPnNlZWsoMCwwKSBvciBkaWUgIiRzdGRvdXQgJCEiOworICAgIHJldHVybiAkc3Rkb3V0 IGlmICR3YW50ZmQ7CiAgICAgbXkgJHI7CiAgICAgeyBsb2NhbCAoJC8pID0gdW5kZWY7CiAgICAg ICAkcj0gPCRzdGRvdXQ+OyB9CkBAIC02NTcsOCArNjYwLDExIEBAIHN1YiB0Y21kb3V0IHsKICAg ICByZXR1cm4gJHI7CiB9CiAKLXN1YiB0YXJnZXRfY21kX291dHB1dCAoJCQ7JCkgeyB0Y21kb3V0 KCdvc3N0ZXN0JyxAXyk7IH0KLXN1YiB0YXJnZXRfY21kX291dHB1dF9yb290ICgkJDskKSB7IHRj bWRvdXQoJ3Jvb3QnLEBfKTsgfQorc3ViIHRhcmdldF9jbWRfb3V0cHV0ICgkJDskKSB7IHRjbWRv dXQoMCwnb3NzdGVzdCcsQF8pOyB9CitzdWIgdGFyZ2V0X2NtZF9vdXRwdXRfcm9vdCAoJCQ7JCkg eyB0Y21kb3V0KDAsJ3Jvb3QnLEBfKTsgfQorCitzdWIgdGFyZ2V0X2NtZF9zdGRvdXRmZCAoJCQ7 JCQpIHsgdGNtZG91dCgxLCdvc3N0ZXN0JyxAXyk7IH0KK3N1YiB0YXJnZXRfY21kX3N0ZG91dGZk X3Jvb3QgKCQkOyQkKSB7IHRjbWRvdXQoMSwncm9vdCcsQF8pOyB9CiAKIHN1YiB0YXJnZXRfY21k X2lucHV0Zmhfcm9vdCAoJCQkOyQkKSB7CiAgICAgbXkgKCR0aG8sJHN0ZGluZmgsJHRjbWQsQHJl c3QpID0gQF87CmRpZmYgLS1naXQgYS90cy1mZXRjaC1jaGVjay1maWxlIGIvdHMtZmV0Y2gtY2hl Y2stZmlsZQpuZXcgZmlsZSBtb2RlIDEwMDc1NQppbmRleCAwMDAwMDAwLi5iZmNlYjZiCi0tLSAv ZGV2L251bGwKKysrIGIvdHMtZmV0Y2gtY2hlY2stZmlsZQpAQCAtMCwwICsxLDY4IEBACisjIS91 c3IvYmluL3BlcmwgLXcKKyMgVGhpcyBpcyBwYXJ0IG9mICJvc3N0ZXN0IiwgYW4gYXV0b21hdGVk IHRlc3RpbmcgZnJhbWV3b3JrIGZvciBYZW4uCisjIENvcHlyaWdodCAoQykgMjAxNiBDaXRyaXgg SW5jLgorIyAKKyMgVGhpcyBwcm9ncmFtIGlzIGZyZWUgc29mdHdhcmU6IHlvdSBjYW4gcmVkaXN0 cmlidXRlIGl0IGFuZC9vciBtb2RpZnkKKyMgaXQgdW5kZXIgdGhlIHRlcm1zIG9mIHRoZSBHTlUg QWZmZXJvIEdlbmVyYWwgUHVibGljIExpY2Vuc2UgYXMgcHVibGlzaGVkIGJ5CisjIHRoZSBGcmVl IFNvZnR3YXJlIEZvdW5kYXRpb24sIGVpdGhlciB2ZXJzaW9uIDMgb2YgdGhlIExpY2Vuc2UsIG9y CisjIChhdCB5b3VyIG9wdGlvbikgYW55IGxhdGVyIHZlcnNpb24uCisjIAorIyBUaGlzIHByb2dy YW0gaXMgZGlzdHJpYnV0ZWQgaW4gdGhlIGhvcGUgdGhhdCBpdCB3aWxsIGJlIHVzZWZ1bCwKKyMg YnV0IFdJVEhPVVQgQU5ZIFdBUlJBTlRZOyB3aXRob3V0IGV2ZW4gdGhlIGltcGxpZWQgd2FycmFu dHkgb2YKKyMgTUVSQ0hBTlRBQklMSVRZIG9yIEZJVE5FU1MgRk9SIEEgUEFSVElDVUxBUiBQVVJQ T1NFLiAgU2VlIHRoZQorIyBHTlUgQWZmZXJvIEdlbmVyYWwgUHVibGljIExpY2Vuc2UgZm9yIG1v cmUgZGV0YWlscy4KKyMgCisjIFlvdSBzaG91bGQgaGF2ZSByZWNlaXZlZCBhIGNvcHkgb2YgdGhl IEdOVSBBZmZlcm8gR2VuZXJhbCBQdWJsaWMgTGljZW5zZQorIyBhbG9uZyB3aXRoIHRoaXMgcHJv Z3JhbS4gIElmIG5vdCwgc2VlIDxodHRwOi8vd3d3LmdudS5vcmcvbGljZW5zZXMvPi4KKwordXNl IHN0cmljdCBxdyh2YXJzKTsKK3VzZSBEQkk7Cit1c2UgT3NzdGVzdDsKK3VzZSBPc3N0ZXN0OjpU ZXN0U3VwcG9ydDsKKwordXNlIElPOjpQaXBlOworCit0c3JlYWRjb25maWcoKTsKKworb3VyICgk d2hob3N0LCRndWVzdCkgPSBAQVJHVjsKKyR3aGhvc3QgfHw9ICdob3N0JzsKKworb3VyICgkaG8s JGdobyk7CitvdXIgJGZuID0gIi9iaW4vYmFzaCI7ICMgcmVhc29uYWJsZSBzaXplLCBwcmVzZW50 IGluIG1vc3QgZ3Vlc3RzIGFuZCBob3N0cworCiskaG89IHNlbGVjdGhvc3QoJHdoaG9zdCk7Cisk Z2hvPSBzZWxlY3RndWVzdCgkZ3Vlc3QsJGhvKSBpZiAkZ3Vlc3Q7CisKK3N1YiBmZXRjaF9hbmRf Y2hlY2tfZmlsZSAoJCQpIHsKKyAgICBteSAoJHQsJGZuKSA9IEBfOworCisgICAgdGFyZ2V0X2No ZWNrX2lwKCR0KTsKKworICAgIHRhcmdldF9jbWRfcm9vdCgkdCwgImxzIC1sSCAkZm4iKTsKKwor ICAgIG15ICRleHBlY3QgPSB0YXJnZXRfY21kX291dHB1dF9yb290KCR0LCJzdW0gJGZuIik7Cisg ICAgbG9nbSgkZXhwZWN0KTsKKworICAgIG15ICRzdGRvdXQ9IHRhcmdldF9jbWRfc3Rkb3V0ZmRf cm9vdCgkdCwiY2F0ICRmbiIsNSxbcXcoLXYpXSk7CisKKyAgICBteSAkcGlwZT0gSU86OlBpcGUt Pm5ldygpOworICAgIG15ICRjaGlsZD0gZm9yazsgIGRpZSAkISB1bmxlc3MgZGVmaW5lZCAkY2hp bGQ7CisgICAgaWYgKCEkY2hpbGQpIHsKKwkkcGlwZS0+d3JpdGVyKCk7CisJb3BlbiBTVERJTiwg IjwmIiwgJHN0ZG91dCBvciBkaWUgIlNURElOICQhIjsKKwlvcGVuIFNURE9VVCwgIj4mIiwgJHBp cGUgb3IgZGllICJTVERPVVQgJCEiOworCWV4ZWMoInN1bSIpIG9yIGRpZSAicGlwZSB3cml0ZXIg JCEiOworICAgIH0KKworICAgICRwaXBlLT5yZWFkZXIoKTsKKworICAgIG15ICRnb3QgPSA8JHBp cGU+OworICAgIGNob21wKCRnb3QpOworCisgICAgbG9nbSgiZXhwZWN0ZWQgJGV4cGVjdCIpOwor ICAgIGxvZ20oImdvdCAgICAgICRnb3QiKTsKKworICAgIGRpZSB1bmxlc3MgJGV4cGVjdCBlcSAk Z290OworfQorCitmZXRjaF9hbmRfY2hlY2tfZmlsZSgkZ2hvID8gJGdobyA6ICRobywgJGZuKTsK LS0gCjIuNi4xCgo= --=-IXa0Wuw4kFs6s0cY3lVj Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-devel mailing list Xen-devel@lists.xen.org http://lists.xen.org/xen-devel --=-IXa0Wuw4kFs6s0cY3lVj--