From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3155AEB64DD for ; Fri, 23 Jun 2023 07:37:00 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S230348AbjFWHg7 (ORCPT ); Fri, 23 Jun 2023 03:36:59 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35062 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S230009AbjFWHg5 (ORCPT ); Fri, 23 Jun 2023 03:36:57 -0400 Received: from out-47.mta1.migadu.com (out-47.mta1.migadu.com [IPv6:2001:41d0:203:375::2f]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 90A43E4B for ; Fri, 23 Jun 2023 00:36:55 -0700 (PDT) Date: Fri, 23 Jun 2023 09:36:52 +0200 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1687505813; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=pTiOfTe224l8ooTt5tnO7x3Y4JHJCg2Hz8HKYxr1f/Y=; b=KFUUcpyt8dRiG69DEYg+uw9zt0i8cgdXNQ6X/09muwQDPmSRoSt0OgKBCnuBlyTwQev7nm X4aSonWYCHv3ks53UGe4NCU6BujbPdIr9bMJhkzz0/OZ5fmiI4pqd1JsxgmeEpgKIyZ6Mj 6I8Nm27aZ/Azu2HW/S1AEySAkFurF1k= X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. From: Andrew Jones To: Gavin Shan Cc: kvmarm@lists.linux.dev, kvm@vger.kernel.org, kvm-ppc@vger.kernel.org, linux-s390@vger.kernel.org, lvivier@redhat.com, thuth@redhat.com, frankja@linux.ibm.com, imbrenda@linux.ibm.com, david@redhat.com, pbonzini@redhat.com, nrb@linux.ibm.com, shan.gavin@gmail.com Subject: Re: [kvm-unit-tests PATCH v3] runtime: Allow to specify properties for accelerator Message-ID: <20230623-0a0d13b3f0f018282d68c2e8@orel> References: <20230615062148.19883-1-gshan@redhat.com> <20230619-339675e424da033000049f83@orel> <766a1dc4-a5ad-725a-b25e-438bf1387a4f@redhat.com> <20230620-f496c5f56a78acc5529762a4@orel> <7482963d-4312-dba1-e376-40f03d166f2c@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <7482963d-4312-dba1-e376-40f03d166f2c@redhat.com> X-Migadu-Flow: FLOW_OUT Precedence: bulk List-ID: X-Mailing-List: kvm@vger.kernel.org On Fri, Jun 23, 2023 at 02:22:42PM +1000, Gavin Shan wrote: > Hi Drew, > > On 6/20/23 19:06, Andrew Jones wrote: > > On Tue, Jun 20, 2023 at 02:13:22PM +1000, Gavin Shan wrote: > > > On 6/19/23 18:45, Andrew Jones wrote: > > > > On Thu, Jun 15, 2023 at 04:21:48PM +1000, Gavin Shan wrote: > > > > > There are extra properties for accelerators to enable the specific > > > > > features. For example, the dirty ring for KVM accelerator can be > > > > > enabled by "-accel kvm,dirty-ring-size=65536". Unfortuntely, the > > > > > extra properties for the accelerators aren't supported. It makes > > > > > it's impossible to test the combination of KVM and dirty ring > > > > > as the following error message indicates. > > > > > > > > > > # cd /home/gavin/sandbox/kvm-unit-tests/tests > > > > > # QEMU=/home/gavin/sandbox/qemu.main/build/qemu-system-aarch64 \ > > > > > ACCEL=kvm,dirty-ring-size=65536 ./its-migration > > > > > : > > > > > BUILD_HEAD=2fffb37e > > > > > timeout -k 1s --foreground 90s /home/gavin/sandbox/qemu.main/build/qemu-system-aarch64 \ > > > > > -nodefaults -machine virt -accel kvm,dirty-ring-size=65536 -cpu cortex-a57 \ > > > > > -device virtio-serial-device -device virtconsole,chardev=ctd -chardev testdev,id=ctd \ > > > > > -device pci-testdev -display none -serial stdio -kernel _NO_FILE_4Uhere_ -smp 160 \ > > > > > -machine gic-version=3 -append its-pending-migration # -initrd /tmp/tmp.gfDLa1EtWk > > > > > qemu-system-aarch64: kvm_init_vcpu: kvm_arch_init_vcpu failed (0): Invalid argument > > > > > > > > > > Allow to specify extra properties for accelerators. With this, the > > > > > "its-migration" can be tested for the combination of KVM and dirty > > > > > ring. > > > > > > > > > > Signed-off-by: Gavin Shan > > > > > --- > > > > > v3: Split $ACCEL to $ACCEL and $ACCEL_PROPS in get_qemu_accelerator() > > > > > and don't print them as output, suggested by Drew. > > > > > --- > > > > > arm/run | 12 ++++-------- > > > > > powerpc/run | 5 ++--- > > > > > s390x/run | 5 ++--- > > > > > scripts/arch-run.bash | 21 +++++++++++++-------- > > > > > x86/run | 5 ++--- > > > > > 5 files changed, 23 insertions(+), 25 deletions(-) > > > > > > > > > > diff --git a/arm/run b/arm/run > > > > > index c6f25b8..d9ebe59 100755 > > > > > --- a/arm/run > > > > > +++ b/arm/run > > > > > @@ -10,10 +10,8 @@ if [ -z "$KUT_STANDALONE" ]; then > > > > > fi > > > > > processor="$PROCESSOR" > > > > > -accel=$(get_qemu_accelerator) || > > > > > - exit $? > > > > > - > > > > > -if [ "$accel" = "kvm" ]; then > > > > > +get_qemu_accelerator || exit $? > > > > > +if [ "$ACCEL" = "kvm" ]; then > > > > > QEMU_ARCH=$HOST > > > > > fi > > > > > @@ -23,11 +21,9 @@ qemu=$(search_qemu_binary) || > > > > > if [ "$QEMU" ] && [ -z "$ACCEL" ] && > > > > > [ "$HOST" = "aarch64" ] && [ "$ARCH" = "arm" ] && > > > > > [ "$(basename $QEMU)" = "qemu-system-arm" ]; then > > > > > - accel=tcg > > > > > + ACCEL="tcg" > > > > > fi > > > > > > > > As I pointed out in the v2 review we can't just s/accel/ACCEL/ without > > > > other changes. Now ACCEL will also be set when the above condition > > > > is checked, making it useless. Please ensure the test case that commit > > > > c7d6c7f00e7c ("arm/run: Use TCG with qemu-system-arm on arm64 systems") > > > > fixed still works with your patch. > > > > > > > > > > Sorry that I missed your comments for v2. In order to make the test case > > > in c7d6c7f00e7c working, we just need to call set_qemu_accelerator() after > > > the chunk of code, like below. When $ACCEL is set to "tcg" by the conditional > > > code, it won't be changed in the following set_qemu_accelerator(). > > > > > > Could you Please confirm if it looks good to you so that I can integrate > > > the changes to v4 and post it. > > > > > > arm/run > > > -------- > > > > > > processor="$PROCESSOR" > > > > > > if [ "$QEMU" ] && [ -z "$ACCEL" ] && > > > [ "$HOST" = "aarch64" ] && [ "$ARCH" = "arm" ] && > > > [ "$(basename $QEMU)" = "qemu-system-arm" ]; then > > > ACCEL="tcg" > > > fi > > > > > > set_qemu_accelerator || exit $? > > > if [ "$ACCEL" = "kvm" ]; then > > > QEMU_ARCH=$HOST > > > fi > > > > > > > Looks fine, but please give it a test run. > > > > Thanks, Drew. v4 has been posted for further review. Since I don't have a 'arm' > host around, I adjust $ARCH to "arm64" for a simulation and the test case included > in commit c7d6c7f00e7c should be working fine: We eventually have "tcg" instead of > "kvm" accelerator for the combination, which is expected by commit c7d6c7f00e7c You don't need an arm host. Indeed $HOST should be aarch64 for this case. You just need to compile the tests for arm instead of aarch64. That's easy to do with a cross compiler ./configure --arch=arm --cross-prefix=arm-linux-gnu- But hacking the condition is fine too for this simple case. Thanks, drew > > v4: https://lore.kernel.org/kvmarm/20230623035750.312679-1-gshan@redhat.com/T/#u > > Thanks, > Gavin >