From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=BAYES_00,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7BBBEC07E96 for ; Thu, 15 Jul 2021 10:50:13 +0000 (UTC) Received: from mm01.cs.columbia.edu (mm01.cs.columbia.edu [128.59.11.253]) by mail.kernel.org (Postfix) with ESMTP id EE70B61380 for ; Thu, 15 Jul 2021 10:50:12 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org EE70B61380 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=kvmarm-bounces@lists.cs.columbia.edu Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 80AE94A5A0; Thu, 15 Jul 2021 06:50:12 -0400 (EDT) X-Virus-Scanned: at lists.cs.columbia.edu Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id fVgkv+xCwsdT; Thu, 15 Jul 2021 06:50:10 -0400 (EDT) Received: from mm01.cs.columbia.edu (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 7299E4A4FC; Thu, 15 Jul 2021 06:50:10 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id B385B4A4FC for ; Thu, 15 Jul 2021 06:50:08 -0400 (EDT) X-Virus-Scanned: at lists.cs.columbia.edu Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id PRXp5LTtB3Jy for ; Thu, 15 Jul 2021 06:50:07 -0400 (EDT) Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by mm01.cs.columbia.edu (Postfix) with ESMTPS id 6EE164A19E for ; Thu, 15 Jul 2021 06:50:07 -0400 (EDT) Received: from disco-boy.misterjones.org (disco-boy.misterjones.org [51.254.78.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 84B0961002; Thu, 15 Jul 2021 10:50:06 +0000 (UTC) Received: from sofa.misterjones.org ([185.219.108.64] helo=why.misterjones.org) by disco-boy.misterjones.org with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1m3ywO-00DVgb-FB; Thu, 15 Jul 2021 11:50:04 +0100 Date: Thu, 15 Jul 2021 11:49:54 +0100 Message-ID: <87o8b3kg19.wl-maz@kernel.org> From: Marc Zyngier To: Qu Wenruo Subject: Re: Any way to disable KVM VHE extension? In-Reply-To: <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> References: <37f873cf-1b39-ea7f-a5e7-6feb0200dd4c@suse.com> <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI-EPG/1.14.7 (Harue) FLIM-LB/1.14.9 (=?UTF-8?B?R29qxY0=?=) APEL-LB/10.8 EasyPG/1.0.0 Emacs/27.1 (x86_64-pc-linux-gnu) MULE/6.0 (HANACHIRUSATO) MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") X-SA-Exim-Connect-IP: 185.219.108.64 X-SA-Exim-Rcpt-To: wqu@suse.com, robin.murphy@arm.com, kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, linux-arm-kernel@lists.infradead.org X-SA-Exim-Mail-From: maz@kernel.org X-SA-Exim-Scanned: No (on disco-boy.misterjones.org); SAEximRunCond expanded to false Cc: Linux ARM , Robin Murphy , kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org X-BeenThere: kvmarm@lists.cs.columbia.edu X-Mailman-Version: 2.1.14 Precedence: list List-Id: Where KVM/ARM decisions are made List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: kvmarm-bounces@lists.cs.columbia.edu Sender: kvmarm-bounces@lists.cs.columbia.edu T24gVGh1LCAxNSBKdWwgMjAyMSAxMDo0NDozMiArMDEwMCwKUXUgV2VucnVvIDx3cXVAc3VzZS5j b20+IHdyb3RlOgo+IAo+IAo+IAo+IE9uIDIwMjEvNy8xNSDkuIvljYg1OjI4LCBSb2JpbiBNdXJw aHkgd3JvdGU6Cj4gPiBPbiAyMDIxLTA3LTE1IDA5OjU1LCBRdSBXZW5ydW8gd3JvdGU6Cj4gPj4g SGksCj4gPj4gCj4gPj4gUmVjZW50bHkgSSdtIHBsYXlpbmcgYXJvdW5kIHRoZSBOdmlkaWEgWGF2 aWVyIEFHWCBib2FyZCwgd2hpY2ggaGFzCj4gPj4gVkhFIGV4dGVuc2lvbiBzdXBwb3J0Lgo+ID4+ IAo+ID4+IEluIHRoZW9yeSwgY29uc2lkZXJpbmcgdGhlIENQVSBhbmQgbWVtb3J5LCBpdCBzaG91 bGQgYmUgcHJldHR5Cj4gPj4gcG93ZXJmdWwgY29tcGFyZWQgdG8gYm9hcmRzIGxpa2UgUlBJIENN NC4KPiA+PiAKPiA+PiBCdXQgdG8gbXkgc3VycHJpc2UsIEtWTSBydW5zIHByZXR0eSBwb29yIG9u IFhhdmllci4KPiA+PiAKPiA+PiBKdXN0IGJvb3RpbmcgdGhlIGVkazIgZmlybXdhcmUgY291bGQg dGFrZSBvdmVyIDEwcywgYW5kIDIwcyB0bwo+ID4+IGZ1bGx5IGJvb3QgdGhlIGtlcm5lbC4KPiA+ PiBFdmVuIG15IFZNIG9uIFJQSSBDTTQgaGFzIHdheSBmYXN0ZXIgYm9vdCB0aW1lLCBldmVuIGp1 c3QgcnVubmluZwo+ID4+IG9uIFBDSUUyLjAgeDEgbGFuZSBOVk1FLCBhbmQganVzdCA0IDIuMUdo eiBBNzIgY29yZS4KPiA+PiAKPiA+PiBUaGlzIGlzIGRlZmluaXRlbHkgb3V0IG9mIG15IGV4cGVj dGF0aW9uLCBJIGRvdWJsZSBjaGVja2VkIHRvIGJlCj4gPj4gc3VyZSB0aGF0IGl0J3MgcnVubmlu ZyBpbiBLVk0gbW9kZS4KPiA+PiAKPiA+PiBCdXQgZnVydGhlciBkaWdnaW5nIHNob3dzIHRoYXQs IHNpbmNlIFhhdmllciBBR1ggQ1BVIHN1cHBvcnRzIFZIRSwKPiA+PiBrdm0gaXMgcnVubmluZyBp biBWSEUgbW9kZSBvdGhlciB0aGFuIEhZUCBtb2RlIG9uIENNNC4KPiA+PiAKPiA+PiBJcyB0aGVy ZSBhbnl3YXkgdG8gbWFudWFsbHkgZGlzYWJsZSBWSEUgbW9kZSB0byB0ZXN0IHRoZSBtb3JlCj4g Pj4gY29tbW9uIEhZUCBtb2RlIG9uIFhhdmllcj8KPiA+IAo+ID4gQWNjb3JkaW5nIHRvIGtlcm5l bC1wYXJhbWV0ZXJzLnR4dCwgImt2bS1hcm0ubW9kZT1udmhlIiAob3IgaXRzCj4gPiBsb3ctbGV2 ZWwgZXF1aXZhbGVudCAiaWRfYWE2NG1tZnIxLnZoPTAiKSBvbiB0aGUgY29tbWFuZCBsaW5lIHNo b3VsZAo+ID4gZG8gdGhhdC4KPiAKPiBUaGFua3MgZm9yIHRoaXMgb25lLCBJIHN0dXBpZGx5IG9u bHkgc2VhcmNoZWQgbW9kaW5mbyBvZiBrdm0sIGFuZAo+IGRpZG4ndCBldmVuIGJvdGhlciB0byBz ZWFyY2ggYXJjaC9hcm02NC9rdm0uLi4KPiAKPiA+IAo+ID4gSG93ZXZlciBJJ2QgaW1hZ2luZSB0 aGUgZGlzY3JlcGFuY3kgaXMgbGlrZWx5IHRvIGJlIHNvbWV0aGluZyBtb3JlCj4gPiBmdW5kYW1l bnRhbCB0byB0aGUgd2lsZGx5IGRpZmZlcmVudCBtaWNyb2FyY2hpdGVjdHVyZXMuIFRoZXJlJ3MK PiA+IGNlcnRhaW5seSBubyBoYXJtIGluIGdpdmluZyBub24tVkhFIGEgZ28gZm9yIGNvbXBhcmlz b24sIGJ1dCBJCj4gPiB3b3VsZG4ndCBiZSBzdXJwcmlzZWQgaWYgaXQgdHVybnMgb3V0IGV2ZW4g c2xvd2VyLi4uCj4gCj4gWW91J3JlIHRvdGFsbHkgcmlnaHQsIHdpdGggbnZoZSBtb2RlLCBpdCdz IHN0aWxsIHRoZSBzYW1lIHNsb3cgc3BlZWQuCgpNeSBleHBlcmllbmNlIHdpdGggRGVudmVyIChO dmlkaWEncyBwcmV2aW91cyBjb3JlKSBpcyB0aGF0IGl0IGlzCmhvcnJpYmx5IHNsb3cgd2hlbiBy dW5uaW5nIEtWTS4gSSBndWVzcyB0aGF0IHRoZSBKSVQtbGlrZSBtaWNyb2FyY2gKZmFyZXMgcG9v cmx5IHdpdGggZXhjZXB0aW9ucyBhbmQgc2F2ZS1yZXN0b3JlIG9wZXJhdGlvbnMuCgo+IEJUVywg d2hhdCBkaWQgeW91IG1lYW4gYnkgdGhlICJ3aWxkbHkgZGlmZmVyZW50IG1pY3JvYXJjaCI/Cj4g SXMgQVJNdjguMiBhcmNoIHRoYXQgZGlmZmVyZW50IGZyb20gQVJNdjggb2YgUlBJND8KPiAKPiBB bmQgYW55IGV4dHJhIG1ldGhvZHMgSSBjb3VsZCB0cnkgdG8gZXhwbG9yZSB0aGUgcmVhc29uIG9m IHRoZSBzbG93bmVzcz8KPiAKPiBBdCBsZWFzdCBSUEkgQ000IGlzIGJleW9uZCBteSBleHBlY3Rh dGlvbiBhbmQgaXMgd29ya2luZyBwcmV0dHkgZmluZS4KPiAKPiBUaGFua3MsCj4gUXUKPiAKPiA+ IAo+ID4gUm9iaW4uCj4gPiAKPiA+PiBCVFcsIHRoaXMgaXMgdGhlIGRtZXNnIHJlbGF0ZWQgdG8g S1ZNIG9uIFhhdmllciwgcnVubmluZyB2NS4xMwo+ID4+IHVwc3RyZWFtIGtlcm5lbCwgd2l0aCA2 NEsgcGFnZSBzaXplOgo+ID4+IFvCoMKgwqAgMC44NTIzNTddIGt2bSBbMV06IElQQSBTaXplIExp bWl0OiA0MCBiaXRzCj4gPj4gW8KgwqDCoCAwLjg1NzM3OF0ga3ZtIFsxXTogdmdpYyBpbnRlcnJ1 cHQgSVJROQo+ID4+IFvCoMKgwqAgMC44NjIxMjJdIGt2bTogcG11IGV2ZW50IGNyZWF0aW9uIGZh aWxlZCAtMgoKQW5kIHRoaXMgaXNuJ3QgZ29pbmcgdG8gaGVscCBmaW5kaW5nIG91dCB0aGUgYm90 dGxlbmVjaywgYXMgdGhlIGtlcm5lbApkb2Vzbid0IGZpbmQgYSBQTVUuIE9uIERlbnZlciwgb25j ZSB0aGUgUE1VIGlzIGVuYWJsZWQsIHByb2ZpbGluZwphbnl0aGluZyBtYWtlcyB0aGUgd2hvbGUg dGhpbmcgZXZlbiBzbG93ZXIuIEF0IHdoaWNoIHBvaW50LCBJIGp1c3QKcGFya2VkIHRoZSBib2Fy ZCBhbmQgZm9yZ290IGFib3V0IGl0LgoKVGhhbmtzLAoKCU0uCgotLSAKV2l0aG91dCBkZXZpYXRp b24gZnJvbSB0aGUgbm9ybSwgcHJvZ3Jlc3MgaXMgbm90IHBvc3NpYmxlLgpfX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwprdm1hcm0gbWFpbGluZyBsaXN0Cmt2 bWFybUBsaXN0cy5jcy5jb2x1bWJpYS5lZHUKaHR0cHM6Ly9saXN0cy5jcy5jb2x1bWJpYS5lZHUv bWFpbG1hbi9saXN0aW5mby9rdm1hcm0K From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.7 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D2DF4C07E96 for ; Thu, 15 Jul 2021 10:52:06 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 9BADA613BC for ; Thu, 15 Jul 2021 10:52:06 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 9BADA613BC Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To: Subject:Cc:To:From:Message-ID:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=AzQT7mPJdqeHcGLCCTOCMndJjGp6OxHWvdDTXk00eZ8=; b=G5TBJcz/+BqpX4 311VC2YPNyZM3y9DVf2NOw0kmh5f/OwOpCajAS2qsagcwD1uvKWfZ66fVoqtmxBjBxrZK+NZcddSu lm77ET7YWqBTpWCLX7wyQM06XfB3j9iA0A7w6dsYfqG+tKOjKw1MQP1il4xkBdZ9TmmegJ77D765D +Ak2bVuHJAdHMgIQBb7HHlotVHubYqTlCUqWsUGy+LVRmIFfXGZmT17iXcFLBK4IP6hZav8bpv+Zm E35KruA+yac4lFsFtRj9yjXPR+IBcdvlxrsxuBRN+3WZxkVFrl4XWyRtlF1MCjv0VwjJTJAG6Z5SX QToTiJKOkR99iy3S5CmA==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1m3ywV-000V8W-60; Thu, 15 Jul 2021 10:50:11 +0000 Received: from mail.kernel.org ([198.145.29.99]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1m3ywR-000V7Z-8O for linux-arm-kernel@lists.infradead.org; Thu, 15 Jul 2021 10:50:09 +0000 Received: from disco-boy.misterjones.org (disco-boy.misterjones.org [51.254.78.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 84B0961002; Thu, 15 Jul 2021 10:50:06 +0000 (UTC) Received: from sofa.misterjones.org ([185.219.108.64] helo=why.misterjones.org) by disco-boy.misterjones.org with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1m3ywO-00DVgb-FB; Thu, 15 Jul 2021 11:50:04 +0100 Date: Thu, 15 Jul 2021 11:49:54 +0100 Message-ID: <87o8b3kg19.wl-maz@kernel.org> From: Marc Zyngier To: Qu Wenruo Cc: Robin Murphy , kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, Linux ARM Subject: Re: Any way to disable KVM VHE extension? In-Reply-To: <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> References: <37f873cf-1b39-ea7f-a5e7-6feb0200dd4c@suse.com> <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI-EPG/1.14.7 (Harue) FLIM-LB/1.14.9 (=?UTF-8?B?R29qxY0=?=) APEL-LB/10.8 EasyPG/1.0.0 Emacs/27.1 (x86_64-pc-linux-gnu) MULE/6.0 (HANACHIRUSATO) MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") X-SA-Exim-Connect-IP: 185.219.108.64 X-SA-Exim-Rcpt-To: wqu@suse.com, robin.murphy@arm.com, kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, linux-arm-kernel@lists.infradead.org X-SA-Exim-Mail-From: maz@kernel.org X-SA-Exim-Scanned: No (on disco-boy.misterjones.org); SAEximRunCond expanded to false X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210715_035007_396824_335B41F1 X-CRM114-Status: GOOD ( 31.61 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org T24gVGh1LCAxNSBKdWwgMjAyMSAxMDo0NDozMiArMDEwMCwKUXUgV2VucnVvIDx3cXVAc3VzZS5j b20+IHdyb3RlOgo+IAo+IAo+IAo+IE9uIDIwMjEvNy8xNSDkuIvljYg1OjI4LCBSb2JpbiBNdXJw aHkgd3JvdGU6Cj4gPiBPbiAyMDIxLTA3LTE1IDA5OjU1LCBRdSBXZW5ydW8gd3JvdGU6Cj4gPj4g SGksCj4gPj4gCj4gPj4gUmVjZW50bHkgSSdtIHBsYXlpbmcgYXJvdW5kIHRoZSBOdmlkaWEgWGF2 aWVyIEFHWCBib2FyZCwgd2hpY2ggaGFzCj4gPj4gVkhFIGV4dGVuc2lvbiBzdXBwb3J0Lgo+ID4+ IAo+ID4+IEluIHRoZW9yeSwgY29uc2lkZXJpbmcgdGhlIENQVSBhbmQgbWVtb3J5LCBpdCBzaG91 bGQgYmUgcHJldHR5Cj4gPj4gcG93ZXJmdWwgY29tcGFyZWQgdG8gYm9hcmRzIGxpa2UgUlBJIENN NC4KPiA+PiAKPiA+PiBCdXQgdG8gbXkgc3VycHJpc2UsIEtWTSBydW5zIHByZXR0eSBwb29yIG9u IFhhdmllci4KPiA+PiAKPiA+PiBKdXN0IGJvb3RpbmcgdGhlIGVkazIgZmlybXdhcmUgY291bGQg dGFrZSBvdmVyIDEwcywgYW5kIDIwcyB0bwo+ID4+IGZ1bGx5IGJvb3QgdGhlIGtlcm5lbC4KPiA+ PiBFdmVuIG15IFZNIG9uIFJQSSBDTTQgaGFzIHdheSBmYXN0ZXIgYm9vdCB0aW1lLCBldmVuIGp1 c3QgcnVubmluZwo+ID4+IG9uIFBDSUUyLjAgeDEgbGFuZSBOVk1FLCBhbmQganVzdCA0IDIuMUdo eiBBNzIgY29yZS4KPiA+PiAKPiA+PiBUaGlzIGlzIGRlZmluaXRlbHkgb3V0IG9mIG15IGV4cGVj dGF0aW9uLCBJIGRvdWJsZSBjaGVja2VkIHRvIGJlCj4gPj4gc3VyZSB0aGF0IGl0J3MgcnVubmlu ZyBpbiBLVk0gbW9kZS4KPiA+PiAKPiA+PiBCdXQgZnVydGhlciBkaWdnaW5nIHNob3dzIHRoYXQs IHNpbmNlIFhhdmllciBBR1ggQ1BVIHN1cHBvcnRzIFZIRSwKPiA+PiBrdm0gaXMgcnVubmluZyBp biBWSEUgbW9kZSBvdGhlciB0aGFuIEhZUCBtb2RlIG9uIENNNC4KPiA+PiAKPiA+PiBJcyB0aGVy ZSBhbnl3YXkgdG8gbWFudWFsbHkgZGlzYWJsZSBWSEUgbW9kZSB0byB0ZXN0IHRoZSBtb3JlCj4g Pj4gY29tbW9uIEhZUCBtb2RlIG9uIFhhdmllcj8KPiA+IAo+ID4gQWNjb3JkaW5nIHRvIGtlcm5l bC1wYXJhbWV0ZXJzLnR4dCwgImt2bS1hcm0ubW9kZT1udmhlIiAob3IgaXRzCj4gPiBsb3ctbGV2 ZWwgZXF1aXZhbGVudCAiaWRfYWE2NG1tZnIxLnZoPTAiKSBvbiB0aGUgY29tbWFuZCBsaW5lIHNo b3VsZAo+ID4gZG8gdGhhdC4KPiAKPiBUaGFua3MgZm9yIHRoaXMgb25lLCBJIHN0dXBpZGx5IG9u bHkgc2VhcmNoZWQgbW9kaW5mbyBvZiBrdm0sIGFuZAo+IGRpZG4ndCBldmVuIGJvdGhlciB0byBz ZWFyY2ggYXJjaC9hcm02NC9rdm0uLi4KPiAKPiA+IAo+ID4gSG93ZXZlciBJJ2QgaW1hZ2luZSB0 aGUgZGlzY3JlcGFuY3kgaXMgbGlrZWx5IHRvIGJlIHNvbWV0aGluZyBtb3JlCj4gPiBmdW5kYW1l bnRhbCB0byB0aGUgd2lsZGx5IGRpZmZlcmVudCBtaWNyb2FyY2hpdGVjdHVyZXMuIFRoZXJlJ3MK PiA+IGNlcnRhaW5seSBubyBoYXJtIGluIGdpdmluZyBub24tVkhFIGEgZ28gZm9yIGNvbXBhcmlz b24sIGJ1dCBJCj4gPiB3b3VsZG4ndCBiZSBzdXJwcmlzZWQgaWYgaXQgdHVybnMgb3V0IGV2ZW4g c2xvd2VyLi4uCj4gCj4gWW91J3JlIHRvdGFsbHkgcmlnaHQsIHdpdGggbnZoZSBtb2RlLCBpdCdz IHN0aWxsIHRoZSBzYW1lIHNsb3cgc3BlZWQuCgpNeSBleHBlcmllbmNlIHdpdGggRGVudmVyIChO dmlkaWEncyBwcmV2aW91cyBjb3JlKSBpcyB0aGF0IGl0IGlzCmhvcnJpYmx5IHNsb3cgd2hlbiBy dW5uaW5nIEtWTS4gSSBndWVzcyB0aGF0IHRoZSBKSVQtbGlrZSBtaWNyb2FyY2gKZmFyZXMgcG9v cmx5IHdpdGggZXhjZXB0aW9ucyBhbmQgc2F2ZS1yZXN0b3JlIG9wZXJhdGlvbnMuCgo+IEJUVywg d2hhdCBkaWQgeW91IG1lYW4gYnkgdGhlICJ3aWxkbHkgZGlmZmVyZW50IG1pY3JvYXJjaCI/Cj4g SXMgQVJNdjguMiBhcmNoIHRoYXQgZGlmZmVyZW50IGZyb20gQVJNdjggb2YgUlBJND8KPiAKPiBB bmQgYW55IGV4dHJhIG1ldGhvZHMgSSBjb3VsZCB0cnkgdG8gZXhwbG9yZSB0aGUgcmVhc29uIG9m IHRoZSBzbG93bmVzcz8KPiAKPiBBdCBsZWFzdCBSUEkgQ000IGlzIGJleW9uZCBteSBleHBlY3Rh dGlvbiBhbmQgaXMgd29ya2luZyBwcmV0dHkgZmluZS4KPiAKPiBUaGFua3MsCj4gUXUKPiAKPiA+ IAo+ID4gUm9iaW4uCj4gPiAKPiA+PiBCVFcsIHRoaXMgaXMgdGhlIGRtZXNnIHJlbGF0ZWQgdG8g S1ZNIG9uIFhhdmllciwgcnVubmluZyB2NS4xMwo+ID4+IHVwc3RyZWFtIGtlcm5lbCwgd2l0aCA2 NEsgcGFnZSBzaXplOgo+ID4+IFvCoMKgwqAgMC44NTIzNTddIGt2bSBbMV06IElQQSBTaXplIExp bWl0OiA0MCBiaXRzCj4gPj4gW8KgwqDCoCAwLjg1NzM3OF0ga3ZtIFsxXTogdmdpYyBpbnRlcnJ1 cHQgSVJROQo+ID4+IFvCoMKgwqAgMC44NjIxMjJdIGt2bTogcG11IGV2ZW50IGNyZWF0aW9uIGZh aWxlZCAtMgoKQW5kIHRoaXMgaXNuJ3QgZ29pbmcgdG8gaGVscCBmaW5kaW5nIG91dCB0aGUgYm90 dGxlbmVjaywgYXMgdGhlIGtlcm5lbApkb2Vzbid0IGZpbmQgYSBQTVUuIE9uIERlbnZlciwgb25j ZSB0aGUgUE1VIGlzIGVuYWJsZWQsIHByb2ZpbGluZwphbnl0aGluZyBtYWtlcyB0aGUgd2hvbGUg dGhpbmcgZXZlbiBzbG93ZXIuIEF0IHdoaWNoIHBvaW50LCBJIGp1c3QKcGFya2VkIHRoZSBib2Fy ZCBhbmQgZm9yZ290IGFib3V0IGl0LgoKVGhhbmtzLAoKCU0uCgotLSAKV2l0aG91dCBkZXZpYXRp b24gZnJvbSB0aGUgbm9ybSwgcHJvZ3Jlc3MgaXMgbm90IHBvc3NpYmxlLgoKX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KbGludXgtYXJtLWtlcm5lbCBtYWls aW5nIGxpc3QKbGludXgtYXJtLWtlcm5lbEBsaXN0cy5pbmZyYWRlYWQub3JnCmh0dHA6Ly9saXN0 cy5pbmZyYWRlYWQub3JnL21haWxtYW4vbGlzdGluZm8vbGludXgtYXJtLWtlcm5lbAo= From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=BAYES_00,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 16012C47E48 for ; Thu, 15 Jul 2021 10:50:08 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 008436120A for ; Thu, 15 Jul 2021 10:50:07 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S241712AbhGOKxA convert rfc822-to-8bit (ORCPT ); Thu, 15 Jul 2021 06:53:00 -0400 Received: from mail.kernel.org ([198.145.29.99]:58456 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232055AbhGOKw7 (ORCPT ); Thu, 15 Jul 2021 06:52:59 -0400 Received: from disco-boy.misterjones.org (disco-boy.misterjones.org [51.254.78.96]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 84B0961002; Thu, 15 Jul 2021 10:50:06 +0000 (UTC) Received: from sofa.misterjones.org ([185.219.108.64] helo=why.misterjones.org) by disco-boy.misterjones.org with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.94.2) (envelope-from ) id 1m3ywO-00DVgb-FB; Thu, 15 Jul 2021 11:50:04 +0100 Date: Thu, 15 Jul 2021 11:49:54 +0100 Message-ID: <87o8b3kg19.wl-maz@kernel.org> From: Marc Zyngier To: Qu Wenruo Cc: Robin Murphy , kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, Linux ARM Subject: Re: Any way to disable KVM VHE extension? In-Reply-To: <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> References: <37f873cf-1b39-ea7f-a5e7-6feb0200dd4c@suse.com> <0e992d47-1f17-d49f-8341-670770ac49ef@suse.com> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI-EPG/1.14.7 (Harue) FLIM-LB/1.14.9 (=?UTF-8?B?R29qxY0=?=) APEL-LB/10.8 EasyPG/1.0.0 Emacs/27.1 (x86_64-pc-linux-gnu) MULE/6.0 (HANACHIRUSATO) MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8BIT X-SA-Exim-Connect-IP: 185.219.108.64 X-SA-Exim-Rcpt-To: wqu@suse.com, robin.murphy@arm.com, kvmarm@lists.cs.columbia.edu, kvm@vger.kernel.org, linux-arm-kernel@lists.infradead.org X-SA-Exim-Mail-From: maz@kernel.org X-SA-Exim-Scanned: No (on disco-boy.misterjones.org); SAEximRunCond expanded to false Precedence: bulk List-ID: X-Mailing-List: kvm@vger.kernel.org On Thu, 15 Jul 2021 10:44:32 +0100, Qu Wenruo wrote: > > > > On 2021/7/15 下午5:28, Robin Murphy wrote: > > On 2021-07-15 09:55, Qu Wenruo wrote: > >> Hi, > >> > >> Recently I'm playing around the Nvidia Xavier AGX board, which has > >> VHE extension support. > >> > >> In theory, considering the CPU and memory, it should be pretty > >> powerful compared to boards like RPI CM4. > >> > >> But to my surprise, KVM runs pretty poor on Xavier. > >> > >> Just booting the edk2 firmware could take over 10s, and 20s to > >> fully boot the kernel. > >> Even my VM on RPI CM4 has way faster boot time, even just running > >> on PCIE2.0 x1 lane NVME, and just 4 2.1Ghz A72 core. > >> > >> This is definitely out of my expectation, I double checked to be > >> sure that it's running in KVM mode. > >> > >> But further digging shows that, since Xavier AGX CPU supports VHE, > >> kvm is running in VHE mode other than HYP mode on CM4. > >> > >> Is there anyway to manually disable VHE mode to test the more > >> common HYP mode on Xavier? > > > > According to kernel-parameters.txt, "kvm-arm.mode=nvhe" (or its > > low-level equivalent "id_aa64mmfr1.vh=0") on the command line should > > do that. > > Thanks for this one, I stupidly only searched modinfo of kvm, and > didn't even bother to search arch/arm64/kvm... > > > > > However I'd imagine the discrepancy is likely to be something more > > fundamental to the wildly different microarchitectures. There's > > certainly no harm in giving non-VHE a go for comparison, but I > > wouldn't be surprised if it turns out even slower... > > You're totally right, with nvhe mode, it's still the same slow speed. My experience with Denver (Nvidia's previous core) is that it is horribly slow when running KVM. I guess that the JIT-like microarch fares poorly with exceptions and save-restore operations. > BTW, what did you mean by the "wildly different microarch"? > Is ARMv8.2 arch that different from ARMv8 of RPI4? > > And any extra methods I could try to explore the reason of the slowness? > > At least RPI CM4 is beyond my expectation and is working pretty fine. > > Thanks, > Qu > > > > > Robin. > > > >> BTW, this is the dmesg related to KVM on Xavier, running v5.13 > >> upstream kernel, with 64K page size: > >> [    0.852357] kvm [1]: IPA Size Limit: 40 bits > >> [    0.857378] kvm [1]: vgic interrupt IRQ9 > >> [    0.862122] kvm: pmu event creation failed -2 And this isn't going to help finding out the bottleneck, as the kernel doesn't find a PMU. On Denver, once the PMU is enabled, profiling anything makes the whole thing even slower. At which point, I just parked the board and forgot about it. Thanks, M. -- Without deviation from the norm, progress is not possible.