From mboxrd@z Thu Jan 1 00:00:00 1970 From: Marc Zyngier Subject: Re: [Qemu-devel] Could not boot a guest vm from kvm mode based on APM X-Gene Host and latest qemu Date: Wed, 16 Sep 2015 16:29:10 +0100 Message-ID: <55F98AC6.5050909@arm.com> References: <55F76064.8010504@hpe.com> <87y4g6mo0l.fsf@linaro.org> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 80EA841F7F for ; Wed, 16 Sep 2015 11:28:19 -0400 (EDT) Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id MzFRFBeCMzcf for ; Wed, 16 Sep 2015 11:28:14 -0400 (EDT) Received: from foss.arm.com (foss.arm.com [217.140.101.70]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 40C7E419C7 for ; Wed, 16 Sep 2015 11:28:14 -0400 (EDT) In-Reply-To: <87y4g6mo0l.fsf@linaro.org> List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: kvmarm-bounces@lists.cs.columbia.edu Sender: kvmarm-bounces@lists.cs.columbia.edu To: =?UTF-8?B?QWxleCBCZW5uw6ll?= , liang yan Cc: qemu-devel@nongnu.org, kvmarm@lists.cs.columbia.edu List-Id: kvmarm@lists.cs.columbia.edu T24gMTYvMDkvMTUgMTU6MzQsIEFsZXggQmVubsOpZSB3cm90ZToKPiAKPiBsaWFuZyB5YW4gPGxp YW5neUBocGUuY29tPiB3cml0ZXM6Cj4gCj4+IEhlbGxvLCBBbGwsCj4+Cj4+IEkgYW0gdHJ5aW5n IHRvIGVuYWJsZSBrdm0gZm9yIGEgZ3Vlc3Qgdm0gb24gYW4gQVBNIFgtR2VuZSBIb3N0IHdpdGgg Cj4+IGxhdGVzdCBxZW11LCBidXQgY291bGQgbm90IG1ha2UgaXQgd29yay4KPj4KPj4gVGhlIGhv c3QgaXMgQVBNIFgtR2VuZSA4LWNvcmUsIExpbnV4IGtlcm5lbCBpcyA0LjEuMC1yYzctMS1hcm02 NCwKPj4KPj4gR3Vlc3Qga2VybmVsIGlzIGxpbnV4LTMuMTZyYzMKPj4KPj4gUUVNVSBpcyBsYXRl c3QgdmVyc2lvbgo+Pgo+PiBIb3N0IGhhcyB0aGVzZSBkbWVzZyBpbmZvCj4+IFsgICAgMi43MDgy NTldIGt2bSBbMV06IEdJQ0ggYmFzZT0weDc4MGMwMDAwLCBHSUNWIGJhc2U9MHg3ODBlMDAwMCwg SVJRPTI1Cj4+IFsgICAgMi43MDgzMjddIGt2bSBbMV06IHRpbWVyIElSUTMwCj4+IFsgICAgMi43 MDgzMzVdIGt2bSBbMV06IEh5cCBtb2RlIGluaXRpYWxpemVkIHN1Y2Nlc3NmdWxseQo+Pgo+PiBI b3N0IGhhcyBkZXYva3ZtLgo+Pgo+PiBjb21tYW5kLWxpbmUgaXMKPj4gYWFyY2g2NC1zb2Z0bW11 L3FlbXUtc3lzdGVtLWFhcmNoNjQgLW1hY2hpbmUgdmlydCxrZXJuZWxfaXJxY2hpcD1vZmYgCj4+ IC1jcHUgY29ydGV4LWE1NyAtbWFjaGluZSBhY2NlbD1rdm0gLW5vZ3JhcGhpYyAtc21wIDEgLW0g MjA0OCAta2VybmVsIAo+PiBhYXJjaDY0LWxpbnV4LTMuMTZyYzMtYnVpbGRyb290LmltZyAgLS1h cHBlbmQgImNvbnNvbGU9dHR5QU1BMCIKPiAKPiBJIHRob3VnaHQgSSByZWNvZ25pc2VkIG9uZSBv ZiBteSBpbWFnZXMgOy0pCj4gCj4gV2h5IGFyZSB5b3UgcnVubmluZyB3aXRoIGtlcm5lbF9pcnFj aGlwPW9mZj8KPiAKPiBXaXRob3V0IGl0IEkgY2FuIGJvb3QgdGhlIGltYWdlIGZpbmUgb24gbXkg QVBNIHJ1bm5pbmcgNC4zLjAtcmMxLWFqYiBidXQKPiB3aXRoIGl0IEkgaGVscGZ1bGx5IHNlZyB0 aGUga2VybmVsOgo+IAo+IFsxNjAzNS45OTA1MThdIEJhZCBtb2RlIGluIFN5bmNocm9ub3VzIEFi b3J0IGhhbmRsZXIgZGV0ZWN0ZWQsIGNvZGUgMHg4NjAwMDAwNiAtLSBJQUJUIChjdXJyZW50IEVM KQo+IFsxNjAzNS45OTc5NzBdIENQVTogMSBQSUQ6IDIxMzI4IENvbW06IHFlbXUtc3lzdGVtLWFh ciBOb3QgdGFpbnRlZCA0LjMuMC1yYzEtYWpiICM0NDYKPiBbMTYwMzYuMDA0MjAzXSBIYXJkd2Fy ZSBuYW1lOiBBUE0gWC1HZW5lIE11c3RhbmcgYm9hcmQgKERUKQo+IFsxNjAzNi4wMDgxOTFdIHRh c2s6IGZmZmZmZmMzZWNlYTgwMDAgdGk6IGZmZmZmZmMzZDgwNzgwMDAgdGFzay50aTogZmZmZmZm YzNkODA3ODAwMAo+IFsxNjAzNi4wMTQzMzhdIFBDIGlzIGF0IDB4MAo+IFsxNjAzNi4wMTU1NjRd IExSIGlzIGF0IGt2bV92Z2ljX21hcF9yZXNvdXJjZXMrMHgzMC8weDNjCj4gWzE2MDM2LjAxOTI5 MV0gcGMgOiBbPDAwMDAwMDAwMDAwMDAwMDA+XSBsciA6IFs8ZmZmZmZmYzAwMDBhZTkwMD5dIHBz dGF0ZTogMDAwMDAxNDUKPiBbMTYwMzYuMDI1MzUwXSBzcCA6IGZmZmZmZmMzZDgwN2JiMjAKPiBb MTYwMzYuMDI3MzQ4XSB4Mjk6IGZmZmZmZmMzZDgwN2JiMjAgeDI4OiBmZmZmZmZjM2Q4MDc4MDAw IAo+IFsxNjAzNi4wMzEzNTVdIHgyNzogZmZmZmZmYzAwMDY0MjAwMCB4MjY6IDAwMDAwMDAwMDAw MDAwMWQgCj4gWzE2MDM2LjAzNTM2MV0geDI1OiAwMDAwMDAwMDAwMDAwMTFiIHgyNDogZmZmZmZm YzNkODBjMTAwMCAKPiBbMTYwMzYuMDM5MzY4XSB4MjM6IDAwMDAwMDAwMDAwMDAwMDAgeDIyOiAw MDAwMDAwMDAwMDAwMDAwIAo+IFsxNjAzNi4wNDMzNzRdIHgyMTogZmZmZmZmYzBmYTI0MDAwMCB4 MjA6IGZmZmZmZmMwZmE4MDc4MDAgCj4gWzE2MDM2LjA0NzM4MF0geDE5OiBmZmZmZmZjMGZhODA3 ODAwIHgxODogMDAwMDAwN2Y5N2FmMjBlMCAKPiBbMTYwMzYuMDUxMzg3XSB4MTc6IDAwMDAwMDdm OTljNDQ4MTAgeDE2OiBmZmZmZmZjMDAwMWZiMDMwIAo+IFsxNjAzNi4wNTUzOTRdIHgxNTogMDAw MDAwN2Y5OWNjOTU4OCB4MTQ6IDAwMDAwMDAwMDA5MjIwMDAgCj4gWzE2MDM2LjA1OTQwMV0geDEz OiAwMDAwMDAwMDAwOTdlYjgwIHgxMjogMDAwMDAwMDAwMDRkZTBmMCAKPiBbMTYwMzYuMDYzNDA2 XSB4MTE6IDAwMDAwMDAwMDAwMDAwMzggeDEwOiAwMDAwMDAwMGZmZmZmZmZmIAo+IFsxNjAzNi4w Njc0MTNdIHg5IDogMDAwMDAwN2Y5N2FmMjQ4MCB4OCA6IDAwMDAwMDAwMDAwMDAwNTAgCj4gWzE2 MDM2LjA3MTQxOV0geDcgOiBmZmZmZmZjM2VjMjRjODQwIHg2IDogMDAwMDAwMDAwMDAwMDAwMCAK PiBbMTYwMzYuMDc1NDI0XSB4NSA6IDAwMDAwMDAwMDAwMDAwMDMgeDQgOiBmZmZmZmZjM2VjZTcy MDgwIAo+IFsxNjAzNi4wNzk0MzBdIHgzIDogZmZmZmZmYzNlY2U3MjA4MCB4MiA6IDAwMDAwMDAw MDAwMDAwMDAgCj4gWzE2MDM2LjA4MzQzNl0geDEgOiBmZmZmZmZjMDAwYTI2MjYwIHgwIDogZmZm ZmZmYzBmYTgwNzgwMCAKPiAKPiBbMTYwMzYuMDg3NjI4XSBJbnRlcm5hbCBlcnJvcjogT29wcyAt IGJhZCBtb2RlOiAwIFsjMV0gU01QCj4gWzE2MDM2LjA5MTUyOF0gTW9kdWxlcyBsaW5rZWQgaW46 Cj4gWzE2MDM2LjA5MzI3OF0gQ1BVOiAxIFBJRDogMjEzMjggQ29tbTogcWVtdS1zeXN0ZW0tYWFy IE5vdCB0YWludGVkIDQuMy4wLXJjMS1hamIgIzQ0Ngo+IFsxNjAzNi4wOTk1MTBdIEhhcmR3YXJl IG5hbWU6IEFQTSBYLUdlbmUgTXVzdGFuZyBib2FyZCAoRFQpCj4gWzE2MDM2LjEwMzQ5N10gdGFz azogZmZmZmZmYzNlY2VhODAwMCB0aTogZmZmZmZmYzNkODA3ODAwMCB0YXNrLnRpOiBmZmZmZmZj M2Q4MDc4MDAwCj4gWzE2MDM2LjEwOTY0Ml0gUEMgaXMgYXQgMHgwCj4gWzE2MDM2LjExMDg2NF0g TFIgaXMgYXQga3ZtX3ZnaWNfbWFwX3Jlc291cmNlcysweDMwLzB4M2MKPiBbMTYwMzYuMTE0NTkw XSBwYyA6IFs8MDAwMDAwMDAwMDAwMDAwMD5dIGxyIDogWzxmZmZmZmZjMDAwMGFlOTAwPl0gcHN0 YXRlOiAwMDAwMDE0NQo+IFsxNjAzNi4xMjA2NDldIHNwIDogZmZmZmZmYzNkODA3YmIyMAo+IFsx NjAzNi4xMjI2NDhdIHgyOTogZmZmZmZmYzNkODA3YmIyMCB4Mjg6IGZmZmZmZmMzZDgwNzgwMDAg Cj4gWzE2MDM2LjEyNjY1NF0geDI3OiBmZmZmZmZjMDAwNjQyMDAwIHgyNjogMDAwMDAwMDAwMDAw MDAxZCAKPiBbMTYwMzYuMTMwNjU5XSB4MjU6IDAwMDAwMDAwMDAwMDAxMWIgeDI0OiBmZmZmZmZj M2Q4MGMxMDAwIAo+IFsxNjAzNi4xMzQ2NjZdIHgyMzogMDAwMDAwMDAwMDAwMDAwMCB4MjI6IDAw MDAwMDAwMDAwMDAwMDAgCj4gWzE2MDM2LjEzODY3MV0geDIxOiBmZmZmZmZjMGZhMjQwMDAwIHgy MDogZmZmZmZmYzBmYTgwNzgwMCAKPiBbMTYwMzYuMTQyNjc4XSB4MTk6IGZmZmZmZmMwZmE4MDc4 MDAgeDE4OiAwMDAwMDA3Zjk3YWYyMGUwIAo+IFsxNjAzNi4xNDY2ODVdIHgxNzogMDAwMDAwN2Y5 OWM0NDgxMCB4MTY6IGZmZmZmZmMwMDAxZmIwMzAgCj4gWzE2MDM2LjE1MDY5MF0geDE1OiAwMDAw MDA3Zjk5Y2M5NTg4IHgxNDogMDAwMDAwMDAwMDkyMjAwMCAKPiBbMTYwMzYuMTU0Njk2XSB4MTM6 IDAwMDAwMDAwMDA5N2ViODAgeDEyOiAwMDAwMDAwMDAwNGRlMGYwIAo+IFsxNjAzNi4xNTg3MDFd IHgxMTogMDAwMDAwMDAwMDAwMDAzOCB4MTA6IDAwMDAwMDAwZmZmZmZmZmYgCj4gWzE2MDM2LjE2 MjcwNl0geDkgOiAwMDAwMDA3Zjk3YWYyNDgwIHg4IDogMDAwMDAwMDAwMDAwMDA1MCAKPiBbMTYw MzYuMTY2NzEyXSB4NyA6IGZmZmZmZmMzZWMyNGM4NDAgeDYgOiAwMDAwMDAwMDAwMDAwMDAwIAo+ IFsxNjAzNi4xNzA3MTldIHg1IDogMDAwMDAwMDAwMDAwMDAwMyB4NCA6IGZmZmZmZmMzZWNlNzIw ODAgCj4gWzE2MDM2LjE3NDcyNV0geDMgOiBmZmZmZmZjM2VjZTcyMDgwIHgyIDogMDAwMDAwMDAw MDAwMDAwMCAKPiBbMTYwMzYuMTc4NzMxXSB4MSA6IGZmZmZmZmMwMDBhMjYyNjAgeDAgOiBmZmZm ZmZjMGZhODA3ODAwIAoKWWVhaCwgd2UgaGF2ZSBhIGZpeCBmb3IgdGhhdCBvbmUgKGZyb20gUGF2 ZWwpLCB0aG91Z2ggdGhpcyBoaWRlcyBhbm90aGVyCmdlbS4gUGF0Y2hlcyBvbiB0aGUgbGlzdCBz aG9ydGx5LgoKPj4gd2hlbiB1c2luZyBjcHUgImNvcnRleC1hNTciLCBnb3QgdGhlIGVycm9yICJr dm1faW5pdF92Y3B1IGZhaWxlZDogCj4+IEludmFsaWQgYXJndW1lbnQiCj4+IHdoZW4gdXNpbmcg Y3B1ICJob3N0IiwgZ290IHRoZSBlcnJvciAiRmFpbGVkIHRvIHJldHJpZXZlIGhvc3QgQ1BVIGZl YXR1cmVzISIKCkhhdmVuJ3Qgc2VlbiB0aGF0IG9uZSB5ZXQuCgoJTS4KLS0gCkphenogaXMgbm90 IGRlYWQuIEl0IGp1c3Qgc21lbGxzIGZ1bm55Li4uCl9fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fCmt2bWFybSBtYWlsaW5nIGxpc3QKa3ZtYXJtQGxpc3RzLmNz LmNvbHVtYmlhLmVkdQpodHRwczovL2xpc3RzLmNzLmNvbHVtYmlhLmVkdS9tYWlsbWFuL2xpc3Rp bmZvL2t2bWFybQo= From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:38893) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ZcEnL-0000PM-4a for qemu-devel@nongnu.org; Wed, 16 Sep 2015 11:38:52 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ZcEnG-0002x2-RQ for qemu-devel@nongnu.org; Wed, 16 Sep 2015 11:38:51 -0400 Received: from foss.arm.com ([217.140.101.70]:36007) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ZcEnG-0002wZ-GU for qemu-devel@nongnu.org; Wed, 16 Sep 2015 11:38:46 -0400 Message-ID: <55F98AC6.5050909@arm.com> Date: Wed, 16 Sep 2015 16:29:10 +0100 From: Marc Zyngier MIME-Version: 1.0 References: <55F76064.8010504@hpe.com> <87y4g6mo0l.fsf@linaro.org> In-Reply-To: <87y4g6mo0l.fsf@linaro.org> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Subject: Re: [Qemu-devel] Could not boot a guest vm from kvm mode based on APM X-Gene Host and latest qemu List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: =?UTF-8?B?QWxleCBCZW5uw6ll?= , liang yan Cc: qemu-devel@nongnu.org, Christoffer Dall , kvmarm@lists.cs.columbia.edu On 16/09/15 15:34, Alex Benn=C3=A9e wrote: >=20 > liang yan writes: >=20 >> Hello, All, >> >> I am trying to enable kvm for a guest vm on an APM X-Gene Host with=20 >> latest qemu, but could not make it work. >> >> The host is APM X-Gene 8-core, Linux kernel is 4.1.0-rc7-1-arm64, >> >> Guest kernel is linux-3.16rc3 >> >> QEMU is latest version >> >> Host has these dmesg info >> [ 2.708259] kvm [1]: GICH base=3D0x780c0000, GICV base=3D0x780e0000= , IRQ=3D25 >> [ 2.708327] kvm [1]: timer IRQ30 >> [ 2.708335] kvm [1]: Hyp mode initialized successfully >> >> Host has dev/kvm. >> >> command-line is >> aarch64-softmmu/qemu-system-aarch64 -machine virt,kernel_irqchip=3Doff= =20 >> -cpu cortex-a57 -machine accel=3Dkvm -nographic -smp 1 -m 2048 -kernel= =20 >> aarch64-linux-3.16rc3-buildroot.img --append "console=3DttyAMA0" >=20 > I thought I recognised one of my images ;-) >=20 > Why are you running with kernel_irqchip=3Doff? >=20 > Without it I can boot the image fine on my APM running 4.3.0-rc1-ajb bu= t > with it I helpfully seg the kernel: >=20 > [16035.990518] Bad mode in Synchronous Abort handler detected, code 0x8= 6000006 -- IABT (current EL) > [16035.997970] CPU: 1 PID: 21328 Comm: qemu-system-aar Not tainted 4.3.= 0-rc1-ajb #446 > [16036.004203] Hardware name: APM X-Gene Mustang board (DT) > [16036.008191] task: ffffffc3ecea8000 ti: ffffffc3d8078000 task.ti: fff= fffc3d8078000 > [16036.014338] PC is at 0x0 > [16036.015564] LR is at kvm_vgic_map_resources+0x30/0x3c > [16036.019291] pc : [<0000000000000000>] lr : [] psta= te: 00000145 > [16036.025350] sp : ffffffc3d807bb20 > [16036.027348] x29: ffffffc3d807bb20 x28: ffffffc3d8078000=20 > [16036.031355] x27: ffffffc000642000 x26: 000000000000001d=20 > [16036.035361] x25: 000000000000011b x24: ffffffc3d80c1000=20 > [16036.039368] x23: 0000000000000000 x22: 0000000000000000=20 > [16036.043374] x21: ffffffc0fa240000 x20: ffffffc0fa807800=20 > [16036.047380] x19: ffffffc0fa807800 x18: 0000007f97af20e0=20 > [16036.051387] x17: 0000007f99c44810 x16: ffffffc0001fb030=20 > [16036.055394] x15: 0000007f99cc9588 x14: 0000000000922000=20 > [16036.059401] x13: 000000000097eb80 x12: 00000000004de0f0=20 > [16036.063406] x11: 0000000000000038 x10: 00000000ffffffff=20 > [16036.067413] x9 : 0000007f97af2480 x8 : 0000000000000050=20 > [16036.071419] x7 : ffffffc3ec24c840 x6 : 0000000000000000=20 > [16036.075424] x5 : 0000000000000003 x4 : ffffffc3ece72080=20 > [16036.079430] x3 : ffffffc3ece72080 x2 : 0000000000000000=20 > [16036.083436] x1 : ffffffc000a26260 x0 : ffffffc0fa807800=20 >=20 > [16036.087628] Internal error: Oops - bad mode: 0 [#1] SMP > [16036.091528] Modules linked in: > [16036.093278] CPU: 1 PID: 21328 Comm: qemu-system-aar Not tainted 4.3.= 0-rc1-ajb #446 > [16036.099510] Hardware name: APM X-Gene Mustang board (DT) > [16036.103497] task: ffffffc3ecea8000 ti: ffffffc3d8078000 task.ti: fff= fffc3d8078000 > [16036.109642] PC is at 0x0 > [16036.110864] LR is at kvm_vgic_map_resources+0x30/0x3c > [16036.114590] pc : [<0000000000000000>] lr : [] psta= te: 00000145 > [16036.120649] sp : ffffffc3d807bb20 > [16036.122648] x29: ffffffc3d807bb20 x28: ffffffc3d8078000=20 > [16036.126654] x27: ffffffc000642000 x26: 000000000000001d=20 > [16036.130659] x25: 000000000000011b x24: ffffffc3d80c1000=20 > [16036.134666] x23: 0000000000000000 x22: 0000000000000000=20 > [16036.138671] x21: ffffffc0fa240000 x20: ffffffc0fa807800=20 > [16036.142678] x19: ffffffc0fa807800 x18: 0000007f97af20e0=20 > [16036.146685] x17: 0000007f99c44810 x16: ffffffc0001fb030=20 > [16036.150690] x15: 0000007f99cc9588 x14: 0000000000922000=20 > [16036.154696] x13: 000000000097eb80 x12: 00000000004de0f0=20 > [16036.158701] x11: 0000000000000038 x10: 00000000ffffffff=20 > [16036.162706] x9 : 0000007f97af2480 x8 : 0000000000000050=20 > [16036.166712] x7 : ffffffc3ec24c840 x6 : 0000000000000000=20 > [16036.170719] x5 : 0000000000000003 x4 : ffffffc3ece72080=20 > [16036.174725] x3 : ffffffc3ece72080 x2 : 0000000000000000=20 > [16036.178731] x1 : ffffffc000a26260 x0 : ffffffc0fa807800=20 Yeah, we have a fix for that one (from Pavel), though this hides another gem. Patches on the list shortly. >> when using cpu "cortex-a57", got the error "kvm_init_vcpu failed:=20 >> Invalid argument" >> when using cpu "host", got the error "Failed to retrieve host CPU feat= ures!" Haven't seen that one yet. M. --=20 Jazz is not dead. It just smells funny...