From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 6C2FFCAC5B8 for ; Thu, 2 Oct 2025 14:41:32 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To: Subject:Cc:To:From:Message-ID:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=UL60R3VnPI11z5tz9HkE46b0y3L2dJCmlG786djfUeE=; b=zQs6eErsKcV4FK bjhUMRrif5U6uzDj/UwEC0FBeDo6TTY0tfh2EGOuiRAN02veClnbL7J8E3erk9HexrC2tp92ELx/K sil05kBGkadDt0DkGi84RZlINieY0/CyDsObTmS6ePNfaLdDt0ob0zxNH0KtxIgFcTxYbuDVG/Jds FHlDw4ZZnFnA14nNJVREWKXCGff6+VYRB6NrA2/5I0zsRK8vH1tHPBZcySnAfPl5QxFxgL4xBbY8m gzJlgSQFJsU2XjBPpf/b9CZdjkfJqPIzr/1c/VkrEL0GXTdAFhKoEah53OF+IguCLOje0jOZSMiuV 3xENWJCLGq/fOtyGmXhA==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.98.2 #2 (Red Hat Linux)) id 1v4KUu-0000000AdLJ-0aDC; Thu, 02 Oct 2025 14:41:32 +0000 Received: from tor.source.kernel.org ([172.105.4.254]) by bombadil.infradead.org with esmtps (Exim 4.98.2 #2 (Red Hat Linux)) id 1v4KUt-0000000AdK8-03GY for kvm-riscv@lists.infradead.org; Thu, 02 Oct 2025 14:41:31 +0000 Received: from smtp.kernel.org (transwarp.subspace.kernel.org [100.75.92.58]) by tor.source.kernel.org (Postfix) with ESMTP id 6064460388; Thu, 2 Oct 2025 14:41:30 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id DF784C4CEF4; Thu, 2 Oct 2025 14:41:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1759416090; bh=HcWa8+/7HpfIO4HCatnbcdT8Qggyf0k+gQ/HNIeL38o=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=NVugEe9ft5Jkhp5UvmLvmY87/yzeX0fnBUxalpGV6FkHWWeUMCfELz+u2e5HgaDeS hJAsl25RRJxePXYtCzVuZvAjLjaNEidW1JfBlSyLMQXVfcKR6euXzePe94qsNjDr97 mjH++vBvOR2p1LAP+SWbIk1KcyPe7wmgbJbpgqG4BpiZ2KcwlN7whWk0C7eunBTN62 vzZZR5YScFwOvy4dqe8ABIErGg3V1fnpUX7NUY8rH6VcgJGkdKxuad4I2JakrYIaFd 4O+eT+0mOolKRflSJ6Z2V3PKycTlJnulYUiNqg5WP5EYGa2QEmCeRQmyF/68pThyyk MMSkPRfpzC1vw== Received: from sofa.misterjones.org ([185.219.108.64] helo=goblin-girl.misterjones.org) by disco-boy.misterjones.org with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.98.2) (envelope-from ) id 1v4KUp-0000000B6Jf-0vxs; Thu, 02 Oct 2025 14:41:27 +0000 Date: Thu, 02 Oct 2025 15:41:26 +0100 Message-ID: <86a529z7qh.wl-maz@kernel.org> From: Marc Zyngier To: Vipin Sharma Cc: kvm@vger.kernel.org, kvmarm@lists.linux.dev, kvm-riscv@lists.infradead.org, seanjc@google.com, pbonzini@redhat.com, borntraeger@linux.ibm.com, frankja@linux.ibm.com, imbrenda@linux.ibm.com, anup@brainfault.org, atish.patra@linux.dev, zhaotianrui@loongson.cn, maobibo@loongson.cn, chenhuacai@kernel.org, oliver.upton@linux.dev, ajones@ventanamicro.com Subject: Re: [PATCH v3 9/9] KVM: selftests: Provide README.rst for KVM selftests runner In-Reply-To: <20251001173225.GA420255.vipinsh@google.com> References: <20250930163635.4035866-1-vipinsh@google.com> <20250930163635.4035866-10-vipinsh@google.com> <86qzvnypsp.wl-maz@kernel.org> <20251001173225.GA420255.vipinsh@google.com> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI-EPG/1.14.7 (Harue) FLIM-LB/1.14.9 (=?UTF-8?B?R29qxY0=?=) APEL-LB/10.8 EasyPG/1.0.0 Emacs/30.1 (aarch64-unknown-linux-gnu) MULE/6.0 (HANACHIRUSATO) MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") X-SA-Exim-Connect-IP: 185.219.108.64 X-SA-Exim-Rcpt-To: vipinsh@google.com, kvm@vger.kernel.org, kvmarm@lists.linux.dev, kvm-riscv@lists.infradead.org, seanjc@google.com, pbonzini@redhat.com, borntraeger@linux.ibm.com, frankja@linux.ibm.com, imbrenda@linux.ibm.com, anup@brainfault.org, atish.patra@linux.dev, zhaotianrui@loongson.cn, maobibo@loongson.cn, chenhuacai@kernel.org, oliver.upton@linux.dev, ajones@ventanamicro.com X-SA-Exim-Mail-From: maz@kernel.org X-SA-Exim-Scanned: No (on disco-boy.misterjones.org); SAEximRunCond expanded to false X-BeenThere: kvm-riscv@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "kvm-riscv" Errors-To: kvm-riscv-bounces+kvm-riscv=archiver.kernel.org@lists.infradead.org T24gV2VkLCAwMSBPY3QgMjAyNSAxODozMjoyNSArMDEwMCwKVmlwaW4gU2hhcm1hIDx2aXBpbnNo QGdvb2dsZS5jb20+IHdyb3RlOgo+IAo+IE9uIDIwMjUtMTAtMDEgMDk6NDQ6MjIsIE1hcmMgWnlu Z2llciB3cm90ZToKPiA+IE9uIFR1ZSwgMzAgU2VwIDIwMjUgMTc6MzY6MzUgKzAxMDAsCj4gPiBW aXBpbiBTaGFybWEgPHZpcGluc2hAZ29vZ2xlLmNvbT4gd3JvdGU6Cj4gPiA+IAo+ID4gPiArS1ZN IHNlbGZ0ZXN0IHJ1bm5lciBpcyBoaWdobHkgY29uZmlndXJhYmxlIHRlc3QgZXhlY3V0b3IgdGhh dCBhbGxvd3MgdG8gcnVuCj4gPiA+ICt0ZXN0cyB3aXRoIGRpZmZlcmVudCBjb25maWd1cmF0aW9u cyAobm90IGp1c3QgdGhlIGRlZmF1bHQpLCBwYXJhbGxlbHksIHNhdmUKPiA+IAo+ID4gcy9wYXJh bGxlbHkvaW4gcGFyYWxsZWwvCj4gPiAKPiAKPiBUaGFua3MsIEkgd2lsbCBmaXggaXQuCj4gCj4g PiA+ICtvdXRwdXQgdG8gZGlzayBoaWVyYXJjaGljYWxseSwgY29udHJvbCB3aGF0IGdldHMgcHJp bnRlZCBvbiBjb25zb2xlLCBwcm92aWRlCj4gPiA+ICtleGVjdXRpb24gc3RhdHVzLgo+ID4gPiAr Cj4gPiA+ICtUbyBnZW5lcmF0ZSBkZWZhdWx0IHRlc3RzIHVzZTo6Cj4gPiA+ICsKPiA+ID4gKyAg IyBtYWtlIHRlc3RzX2luc3RhbGwKPiA+ID4gKwo+ID4gPiArVGhpcyB3aWxsIGNyZWF0ZSBgYHRl c3RjYXNlc19kZWZhdWx0X2dlbmBgIGRpcmVjdG9yeSB3aGljaCB3aWxsIGhhdmUgdGVzdGNhc2Vz Cj4gPiAKPiA+IEkgZG9uJ3QgdGhpbmsgdXNpbmcgdGhlIGZ1dHVyZSB0ZW5zZSBpcyBjb3JyZWN0 IGhlcmUuIEknZCByYXRoZXIgc2VlCj4gPiBzb21ldGhpbmcgd3JpdHRlbiBpbiB0aGUgcHJlc2Vu dCB0ZW5zZSwgcG9zc2libHkgaW1wZXJhdGl2ZS4gRm9yCj4gPiBleGFtcGxlOgo+ID4gCj4gPiAi Q3JlYXRlICdibGFoJyBkaXJlY3RvcnkgY29udGFpbmluZyAnZm9vJyBmaWxlcywgb25lIHBlciB0 ZXN0LWNhc2UuCj4gPiAKPiAKPiBUaGFua3MsIEkgd2lsbCBmaXggaXQuCj4gCj4gPiA+ICtpbiBg ZGVmYXVsdC50ZXN0YCBmaWxlcy4gRWFjaCBLVk0gc2VsZnRlc3Qgd2lsbCBoYXZlIGEgZGlyZWN0 b3J5IGluICB3aGljaAo+ID4gPiArYGRlZmF1bHQudGVzdGAgZmlsZSB3aWxsIGJlIGNyZWF0ZWQg d2l0aCBleGVjdXRhYmxlIHBhdGggcmVsYXRpdmUgdG8gS1ZNCj4gPiA+ICtzZWxmdGVzdCByb290 IGRpcmVjdG9yeSBpLmUuIGAvdG9vbHMvdGVzdGluZy9zZWxmdGVzdHMva3ZtYC4KPiA+IAo+ID4g U2hvdWxkbid0IHRoaXMgaG9ub3IgdGhlIGV4aXN0aW5nIGJ1aWxkIG91dHB1dCBkaXJlY3RpdmVz PyBJZiBpdAo+ID4gYWN0dWFsbHkgZG9lcywgdGhlbiB5b3Ugd2FudCB0byBjYWxsIHRoaXMgb3V0 Lgo+ID4gCj4gCj4gVG8gZ2VuZXJhdGUgZGVmYXVsdCB0ZXN0IGZpbGVzIGluIGEgc3BlY2lmaWMg ZGlyZWN0b3J5IG9uZSBjYW4gdXNlCj4gIk9VVFBVVCIgaW4gdGhlIG1ha2UgY29tbWFuZAoKVGhl IHN0YW5kYXJkIHdheSB0byBkbyB0aGlzIGlzIGRvY3VtZW50ZWQgaW4gdGhlIHRvcCBsZXZlbCBN YWtlZmlsZToKCjxxdW90ZT4KIyBUaGlzIGRvZXMgbm90IG5lZWQgdG8gbWF0Y2ggdG8gdGhlIHJv b3Qgb2YgdGhlIGtlcm5lbCBzb3VyY2UgdHJlZS4KIwojIEZvciBleGFtcGxlLCB5b3UgY2FuIGRv IHRoaXM6CiMKIyAgY2QgL2Rpci90by9zdG9yZS9vdXRwdXQvZmlsZXM7IG1ha2UgLWYgL2Rpci90 by9rZXJuZWwvc291cmNlL01ha2VmaWxlCiMKIyBJZiB5b3Ugd2FudCB0byBzYXZlIG91dHB1dCBm aWxlcyBpbiBhIGRpZmZlcmVudCBsb2NhdGlvbiwgdGhlcmUgYXJlCiMgdHdvIHN5bnRheGVzIHRv IHNwZWNpZnkgaXQuCiMKIyAxKSBPPQojIFVzZSAibWFrZSBPPWRpci90by9zdG9yZS9vdXRwdXQv ZmlsZXMvIgojCiMgMikgU2V0IEtCVUlMRF9PVVRQVVQKIyBTZXQgdGhlIGVudmlyb25tZW50IHZh cmlhYmxlIEtCVUlMRF9PVVRQVVQgdG8gcG9pbnQgdG8gdGhlIG91dHB1dCBkaXJlY3RvcnkuCiMg ZXhwb3J0IEtCVUlMRF9PVVRQVVQ9ZGlyL3RvL3N0b3JlL291dHB1dC9maWxlcy87IG1ha2UKIwoj IFRoZSBPPSBhc3NpZ25tZW50IHRha2VzIHByZWNlZGVuY2Ugb3ZlciB0aGUgS0JVSUxEX09VVFBV VCBlbnZpcm9ubWVudAojIHZhcmlhYmxlLgo8L3F1b3RlPgoKWW91ciBuZXcgaW5mcmFzdHJ1Y3R1 cmUgc2hvdWxkIHN1cHBvcnQgdGhlIGV4aXN0aW5nIG1lY2hhbmlzbSAoYW5kCmF2b2lkIGludHJv ZHVjaW5nIGEgbmV3IG9uZSkuCgo+IAo+ICAgbWFrZSBPVVRQVVQ9In4vdGVzdC9kaXJlY3Rvcnkv cGF0aCIgdGVzdHNfaW5zdGFsbAo+IAo+IFRoaXMgYWxsb3dzIHRvIGdlbmVyYXRlIHRlc3RjYXNl c19kZWZhdWx0X2dlbiBpbiB0aGUgZ2l2ZW4gb3V0cHV0Cj4gZGlyZWN0b3J5LiBkZWZhdWx0LnRl c3QgZmlsZXMgd2lsbCBzdGlsbCBoYXZlIHRlc3QgYmluYXJ5IHBhdGggcmVsYXRpdmUKPiBrdm0g c2VsZnRlc3Qgcm9vdCBkaXJlY3RvcnkuIAo+IAo+ICRPVVRQVVQKPiDilJTilIDilIAgdGVzdGNh c2VzX2RlZmF1bHRfZ2VuCj4gICAgIOKUnOKUgOKUgCBhY2Nlc3NfdHJhY2tpbmdfcGVyZl90ZXN0 Cj4gICAgIOKUgiAgIOKUlOKUgOKUgCBkZWZhdWx0LnRlc3QKPiAgICAg4pSc4pSA4pSAIGFyY2hf dGltZXIKPiAgICAg4pSCICAg4pSU4pSA4pSAIGRlZmF1bHQudGVzdAo+ICAgICDilJzilIDilIAg YXJtNjQKPiAgICAg4pSCICAg4pSc4pSA4pSAIGFhcmNoMzJfaWRfcmVncwo+ICAgICDilIIgICDi lIIgICDilJTilIDilIAgZGVmYXVsdC50ZXN0Cj4gICAgIOKUgiAgIOKUnOKUgOKUgCBhcmNoX3Rp bWVyX2VkZ2VfY2FzZXMKPiAgICAg4pSCICAg4pSCICAg4pSU4pSA4pSAIGRlZmF1bHQudGVzdAo+ ICAgICDilIIgICDilJzilIDilIAgZGVidWctZXhjZXB0aW9ucwo+ICAgICDilIIgICDilIIgICDi lJTilIDilIAgZGVmYXVsdC50ZXN0Cj4gICAgIOKUgiAgIOKUnOKUgOKUgCBleHRlcm5hbF9hYm9y dHMKPiAgICAg4pSCICAg4pSCICAg4pSU4pSA4pSAIGRlZmF1bHQudGVzdAo+ICAgICDilIIgICDi lIIgICDilJTilIDilIAgZGVmYXVsdC50ZXN0Cj4gICAgIOKUgiAgIOKUlOKUgOKUgCAuLi4KPiAg ICAg4pSc4pSA4pSAIGNvYWxlc2NlZF9pb190ZXN0Cj4gICAgIOKUgiAgIOKUlOKUgOKUgCBkZWZh dWx0LnRlc3QKPiAgICAg4pSc4pSA4pSAIGRlbWFuZF9wYWdpbmdfdGVzdAo+ICAgICDilIIgICDi lJTilIDilIAgZGVmYXVsdC50ZXN0Cj4gICAgIOKUnOKUgOKUgCAuLi4KPiAKPiBTbywgYXJtNjQv YWFyY2gzMl9pZF9yZWdzL2RlZmF1bHQudGVzdCB3aWxsIGhhdmUgJ2FybTY0L2FhcmNoMzJfaWRf cmVncycKPiAKPiBVc2VyIGNhbiB0aGVuIHN1cHBseSAtcC8tLXBhdGggd2l0aCB0aGUgcGF0aCBv ZiBidWlsZCBvdXRwdXQgZGlyZWN0b3J5Cj4gdG8gcnVubmVyLiAKPiAKPiAgIHB5dGhvbjMgcnVu bmVyIC1wIH4vcGF0aC90by9zZWxmdGVzdC9iaW5hcmllcyAtZCAkT1VUUFVUL3Rlc3RjYXNlc19k ZWZhdWx0X2dlbgo+IAo+IElmIC1wIG5vdCBnaXZlbiB0aGVuIGN1cnJlbnQgZGlyZWN0b3J5IGlz IGNvbnNpZGVyZWQgZm9yIHRlc3QKPiBleGVjdXRhYmxlcy4KPgo+ID4gPiBGb3IgZXhhbXBsZSwg dGhlCj4gPiA+ICtgZGlydHlfbG9nX3BlcmZfdGVzdGAgd2lsbCBoYXZlOjoKPiA+ID4gKwo+ID4g PiArICAjIGNhdCB0ZXN0Y2FzZV9kZWZhdWx0X2dlbi9kaXJ0eV9sb2dfcGVyZl90ZXN0L2RlZmF1 bHQudGVzdAo+ID4gPiArICBkaXJ0eV9sb2dfcGVyZl90ZXN0Cj4gPiA+ICsKPiA+ID4gK1J1bm5l ciB3aWxsIGV4ZWN1dGUgYGRpcnR5X2xvZ19wZXJmX3Rlc3RgLiBUZXN0Y2FzZXMgZmlsZXMgY2Fu IGFsc28gcHJvdmlkZQo+ID4gPiArZXh0cmEgYXJndW1lbnRzIHRvIHRoZSB0ZXN0OjoKPiA+ID4g Kwo+ID4gPiArICAjIGNhdCB0ZXN0cy9kaXJ0eV9sb2dfcGVyZl90ZXN0LzJzbG90XzV2Y3B1XzEw aXRlci50ZXN0Cj4gPiA+ICsgIGRpcnR5X2xvZ19wZXJmX3Rlc3QgLXggMiAtdiA1IC1pIDEwCj4g PiA+ICsKPiA+ID4gK0luIHRoaXMgY2FzZSBydW5uZXIgd2lsbCBleGVjdXRlIHRoZSBgZGlydHlf bG9nX3BlcmZfdGVzdGAgd2l0aCB0aGUgb3B0aW9ucy4KPiA+ID4gKwo+ID4gCj4gPiBUaGUgYmVn aW5uaW5nIG9mIHRoZSB0ZXh0IHRhbGtzIGFib3V0ICJub24tZGVmYXVsdCcgY29uZmlndXJhdGlv bnMsCj4gPiBidXQgeW91IG9ubHkgc2VlbSB0byB0YWxrIGFib3V0IHRoZSBkZWZhdWx0IHN0dWZm LiBIb3cgZG9lcyBvbmUgZGVhbHMKPiA+IHdpdGggYSBub24tZGVmYXVsdCBjb25maWc/Cj4gPiAK PiAKPiBJbiB0aGUgcGF0Y2ggMSwgSSBjcmVhdGVkIHR3byBzYW1wbGUgdGVzdHMgZmlsZXMsCj4g MnNsb3RfNXZjcHVfMTBpdGVyLnRlc3QgYW5kIG5vX2RpcnR5X2xvZ19wcm90ZWN0LnRlc3QsIGlu IHRoZSBkaXJlY3RvcnkKPiB0b29scy90ZXN0aW5nL3NlbGZ0ZXN0cy9rdm0vdGVzdHMvZGlydHlf bG9nX3BlcmZfdGVzdC4KPiAKPiBDb250ZW50cyBvZiB0aG9zZSBmaWxlcyBwcm92aWRlIG5vbi1k ZWZhdWx0IGFyZ3VtZW50cyB0byB0ZXN0LCBmb3IgZXhhbXBsZSwKPiAyc2xvdF81dmNwdTEwaXRl ci50ZXN0IGhhcyB0aGUgY29tbWFuZDoKPiAKPiAgIGRpcnR5X2xvZ19wZXJmX3Rlc3QgLXggMiAt diA1ICAtaSAxMAo+IAo+IE9uZSBjYW4gcnVuIHRoZXNlIG5vbi1kZWZhdWx0IHRlc3RzIGFzIChh c3N1bWluZyBjdXJyZW50IGRpcmVjdG9yeSBpcwo+IGt2bSBzZWxmdGVzdHMpOgo+IAo+ICAgcHl0 aG9uMyBydW5uZXIgLWQgLi90ZXN0cwo+IAo+IE92ZXIgdGhlIHRpbWUgd2Ugd2lsbCBhZGQgbW9y ZSBvZiB0aGVzZSBub24tZGVmYXVsdCBpbnRlcmVzdGluZwo+IHRlc3RjYXNlcy4gT25lIGNhbiB0 aGVuIHJ1bjoKPiAKPiAgIHB5dGhvbjMgcnVubmVyIC1kIC4vdGVzdHMgLi90ZXN0Y2FzZXNfZGVm YXVsdF9nZW4KClRoYXQncyBub3Qgd2hhdCBJIGFtIGNvbXBsYWluaW5nIGFib3V0LiBXaGF0IHlv dSBjYWxsICJjb25maWd1cmF0aW9uIgpzZWVtcyB0byBqdXN0IGJlICJyYW5kb20gc2V0IG9mIHBh cmFtZXRlcnMgZm9yIGEgcmFuZG9tIHRlc3QiLgoKSW4gcHJhY3RpY2UsIHlvdXIgcnVubmVyIGRv ZXMgbm90IHNlZW0gY29uZmlndXJhYmxlIGF0IGFsbC4gWW91IGp1c3QKdHJlYXQgYWxsIHBvc3Np YmxlIGNvbmZpZ3VyYXRpb25zIG9mIGEgc2luZ2xlIHRlc3QgYXMgZGlmZmVyZW50IHRlc3RzLgoK TXkgKGFkbWl0dGVkbHkgdmVyeSBwZXJzb25hbCkgdmlldyBvZiB3aGF0IGEgY29uZmlndXJhdGlv biBzaG91bGQgYmUKaXMgInJ1biB0aGlzIHNpbmdsZSB0ZXN0IHdpdGggdGhlc2UgcGFyYW1ldGVy cyB2YXJ5aW5nIGluIHRoZXNlCnJhbmdlcywgZm9yIHRoaXMgbG9uZyIuCgpUaGFua3MsCgoJTS4K Ci0tIApXaXRob3V0IGRldmlhdGlvbiBmcm9tIHRoZSBub3JtLCBwcm9ncmVzcyBpcyBub3QgcG9z c2libGUuCgotLSAKa3ZtLXJpc2N2IG1haWxpbmcgbGlzdAprdm0tcmlzY3ZAbGlzdHMuaW5mcmFk ZWFkLm9yZwpodHRwOi8vbGlzdHMuaW5mcmFkZWFkLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2t2bS1y aXNjdgo= From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 2FC3B2C027F; Thu, 2 Oct 2025 14:41:30 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1759416090; cv=none; b=NMD6cysleQDQO/v/H4dMy1FuzlYcELjCAB/J3o/AkatoRMggvOmZRXSpDi9CSUWhqj7epeyp6gA7X+s7+7vlBI4nAypaTRCSseloVh6DKNHp1uze4ozWTRwoxMywdt89uDcgbiPrS6/3UhgwMvmIFzI/WPmCdT7g5TAGaNMyYbA= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1759416090; c=relaxed/simple; bh=HcWa8+/7HpfIO4HCatnbcdT8Qggyf0k+gQ/HNIeL38o=; h=Date:Message-ID:From:To:Cc:Subject:In-Reply-To:References: MIME-Version:Content-Type; b=S//G4SQjmTMMzbHGGz3Rc5P6SQRLH3LCxF3cAB6+r6tLwPerYBVEgGGu9lZfqzfmOfxkCQdUemShOETOM+9ZBHbWWc6OKO3Rs55encWp/b2bPQggb0L2EbVqrf6+3Vf1d8tsCbKy3GXtZY3q0jpgbDGYFLbozLytoKdiLFc3gCQ= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=NVugEe9f; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="NVugEe9f" Received: by smtp.kernel.org (Postfix) with ESMTPSA id DF784C4CEF4; Thu, 2 Oct 2025 14:41:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1759416090; bh=HcWa8+/7HpfIO4HCatnbcdT8Qggyf0k+gQ/HNIeL38o=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=NVugEe9ft5Jkhp5UvmLvmY87/yzeX0fnBUxalpGV6FkHWWeUMCfELz+u2e5HgaDeS hJAsl25RRJxePXYtCzVuZvAjLjaNEidW1JfBlSyLMQXVfcKR6euXzePe94qsNjDr97 mjH++vBvOR2p1LAP+SWbIk1KcyPe7wmgbJbpgqG4BpiZ2KcwlN7whWk0C7eunBTN62 vzZZR5YScFwOvy4dqe8ABIErGg3V1fnpUX7NUY8rH6VcgJGkdKxuad4I2JakrYIaFd 4O+eT+0mOolKRflSJ6Z2V3PKycTlJnulYUiNqg5WP5EYGa2QEmCeRQmyF/68pThyyk MMSkPRfpzC1vw== Received: from sofa.misterjones.org ([185.219.108.64] helo=goblin-girl.misterjones.org) by disco-boy.misterjones.org with esmtpsa (TLS1.3) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.98.2) (envelope-from ) id 1v4KUp-0000000B6Jf-0vxs; Thu, 02 Oct 2025 14:41:27 +0000 Date: Thu, 02 Oct 2025 15:41:26 +0100 Message-ID: <86a529z7qh.wl-maz@kernel.org> From: Marc Zyngier To: Vipin Sharma Cc: kvm@vger.kernel.org, kvmarm@lists.linux.dev, kvm-riscv@lists.infradead.org, seanjc@google.com, pbonzini@redhat.com, borntraeger@linux.ibm.com, frankja@linux.ibm.com, imbrenda@linux.ibm.com, anup@brainfault.org, atish.patra@linux.dev, zhaotianrui@loongson.cn, maobibo@loongson.cn, chenhuacai@kernel.org, oliver.upton@linux.dev, ajones@ventanamicro.com Subject: Re: [PATCH v3 9/9] KVM: selftests: Provide README.rst for KVM selftests runner In-Reply-To: <20251001173225.GA420255.vipinsh@google.com> References: <20250930163635.4035866-1-vipinsh@google.com> <20250930163635.4035866-10-vipinsh@google.com> <86qzvnypsp.wl-maz@kernel.org> <20251001173225.GA420255.vipinsh@google.com> User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI-EPG/1.14.7 (Harue) FLIM-LB/1.14.9 (=?UTF-8?B?R29qxY0=?=) APEL-LB/10.8 EasyPG/1.0.0 Emacs/30.1 (aarch64-unknown-linux-gnu) MULE/6.0 (HANACHIRUSATO) Precedence: bulk X-Mailing-List: kvm@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-SA-Exim-Connect-IP: 185.219.108.64 X-SA-Exim-Rcpt-To: vipinsh@google.com, kvm@vger.kernel.org, kvmarm@lists.linux.dev, kvm-riscv@lists.infradead.org, seanjc@google.com, pbonzini@redhat.com, borntraeger@linux.ibm.com, frankja@linux.ibm.com, imbrenda@linux.ibm.com, anup@brainfault.org, atish.patra@linux.dev, zhaotianrui@loongson.cn, maobibo@loongson.cn, chenhuacai@kernel.org, oliver.upton@linux.dev, ajones@ventanamicro.com X-SA-Exim-Mail-From: maz@kernel.org X-SA-Exim-Scanned: No (on disco-boy.misterjones.org); SAEximRunCond expanded to false On Wed, 01 Oct 2025 18:32:25 +0100, Vipin Sharma wrote: >=20 > On 2025-10-01 09:44:22, Marc Zyngier wrote: > > On Tue, 30 Sep 2025 17:36:35 +0100, > > Vipin Sharma wrote: > > >=20 > > > +KVM selftest runner is highly configurable test executor that allows= to run > > > +tests with different configurations (not just the default), parallel= y, save > >=20 > > s/parallely/in parallel/ > >=20 >=20 > Thanks, I will fix it. >=20 > > > +output to disk hierarchically, control what gets printed on console,= provide > > > +execution status. > > > + > > > +To generate default tests use:: > > > + > > > + # make tests_install > > > + > > > +This will create ``testcases_default_gen`` directory which will have= testcases > >=20 > > I don't think using the future tense is correct here. I'd rather see > > something written in the present tense, possibly imperative. For > > example: > >=20 > > "Create 'blah' directory containing 'foo' files, one per test-case. > >=20 >=20 > Thanks, I will fix it. >=20 > > > +in `default.test` files. Each KVM selftest will have a directory in = which > > > +`default.test` file will be created with executable path relative to= KVM > > > +selftest root directory i.e. `/tools/testing/selftests/kvm`. > >=20 > > Shouldn't this honor the existing build output directives? If it > > actually does, then you want to call this out. > >=20 >=20 > To generate default test files in a specific directory one can use > "OUTPUT" in the make command The standard way to do this is documented in the top level Makefile: # This does not need to match to the root of the kernel source tree. # # For example, you can do this: # # cd /dir/to/store/output/files; make -f /dir/to/kernel/source/Makefile # # If you want to save output files in a different location, there are # two syntaxes to specify it. # # 1) O=3D # Use "make O=3Ddir/to/store/output/files/" # # 2) Set KBUILD_OUTPUT # Set the environment variable KBUILD_OUTPUT to point to the output directo= ry. # export KBUILD_OUTPUT=3Ddir/to/store/output/files/; make # # The O=3D assignment takes precedence over the KBUILD_OUTPUT environment # variable. Your new infrastructure should support the existing mechanism (and avoid introducing a new one). >=20 > make OUTPUT=3D"~/test/directory/path" tests_install >=20 > This allows to generate testcases_default_gen in the given output > directory. default.test files will still have test binary path relative > kvm selftest root directory.=20 >=20 > $OUTPUT > =E2=94=94=E2=94=80=E2=94=80 testcases_default_gen > =E2=94=9C=E2=94=80=E2=94=80 access_tracking_perf_test > =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 default.test > =E2=94=9C=E2=94=80=E2=94=80 arch_timer > =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 default.test > =E2=94=9C=E2=94=80=E2=94=80 arm64 > =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 aarch32_id_regs > =E2=94=82 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 default.test > =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 arch_timer_edge_cases > =E2=94=82 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 default.test > =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 debug-exceptions > =E2=94=82 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 default.test > =E2=94=82 =E2=94=9C=E2=94=80=E2=94=80 external_aborts > =E2=94=82 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 default.test > =E2=94=82 =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 default.test > =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 ... > =E2=94=9C=E2=94=80=E2=94=80 coalesced_io_test > =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 default.test > =E2=94=9C=E2=94=80=E2=94=80 demand_paging_test > =E2=94=82 =E2=94=94=E2=94=80=E2=94=80 default.test > =E2=94=9C=E2=94=80=E2=94=80 ... >=20 > So, arm64/aarch32_id_regs/default.test will have 'arm64/aarch32_id_regs' >=20 > User can then supply -p/--path with the path of build output directory > to runner.=20 >=20 > python3 runner -p ~/path/to/selftest/binaries -d $OUTPUT/testcases_defa= ult_gen >=20 > If -p not given then current directory is considered for test > executables. > > > > For example, the > > > +`dirty_log_perf_test` will have:: > > > + > > > + # cat testcase_default_gen/dirty_log_perf_test/default.test > > > + dirty_log_perf_test > > > + > > > +Runner will execute `dirty_log_perf_test`. Testcases files can also = provide > > > +extra arguments to the test:: > > > + > > > + # cat tests/dirty_log_perf_test/2slot_5vcpu_10iter.test > > > + dirty_log_perf_test -x 2 -v 5 -i 10 > > > + > > > +In this case runner will execute the `dirty_log_perf_test` with the = options. > > > + > >=20 > > The beginning of the text talks about "non-default' configurations, > > but you only seem to talk about the default stuff. How does one deals > > with a non-default config? > >=20 >=20 > In the patch 1, I created two sample tests files, > 2slot_5vcpu_10iter.test and no_dirty_log_protect.test, in the directory > tools/testing/selftests/kvm/tests/dirty_log_perf_test. >=20 > Contents of those files provide non-default arguments to test, for exampl= e, > 2slot_5vcpu10iter.test has the command: >=20 > dirty_log_perf_test -x 2 -v 5 -i 10 >=20 > One can run these non-default tests as (assuming current directory is > kvm selftests): >=20 > python3 runner -d ./tests >=20 > Over the time we will add more of these non-default interesting > testcases. One can then run: >=20 > python3 runner -d ./tests ./testcases_default_gen That's not what I am complaining about. What you call "configuration" seems to just be "random set of parameters for a random test". In practice, your runner does not seem configurable at all. You just treat all possible configurations of a single test as different tests. My (admittedly very personal) view of what a configuration should be is "run this single test with these parameters varying in these ranges, for this long". Thanks, M. --=20 Without deviation from the norm, progress is not possible.