From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mm01.cs.columbia.edu (mm01.cs.columbia.edu [128.59.11.253]) by smtp.lore.kernel.org (Postfix) with ESMTP id B1AE0C433EF for ; Sat, 16 Apr 2022 06:23:58 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 2CA2A49ED6; Sat, 16 Apr 2022 02:23:58 -0400 (EDT) X-Virus-Scanned: at lists.cs.columbia.edu Authentication-Results: mm01.cs.columbia.edu (amavisd-new); dkim=softfail (fail, message has been altered) header.i=@google.com Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9OF7YJT3+SXa; Sat, 16 Apr 2022 02:23:57 -0400 (EDT) Received: from mm01.cs.columbia.edu (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 0321F49EE3; Sat, 16 Apr 2022 02:23:57 -0400 (EDT) Received: from localhost (localhost [127.0.0.1]) by mm01.cs.columbia.edu (Postfix) with ESMTP id 3DDB749EE3 for ; Sat, 16 Apr 2022 02:23:55 -0400 (EDT) X-Virus-Scanned: at lists.cs.columbia.edu Received: from mm01.cs.columbia.edu ([127.0.0.1]) by localhost (mm01.cs.columbia.edu [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hWMb48+AIt1t for ; Sat, 16 Apr 2022 02:23:54 -0400 (EDT) Received: from mail-il1-f170.google.com (mail-il1-f170.google.com [209.85.166.170]) by mm01.cs.columbia.edu (Postfix) with ESMTPS id 3333549ED6 for ; Sat, 16 Apr 2022 02:23:54 -0400 (EDT) Received: by mail-il1-f170.google.com with SMTP id y11so387233ilp.4 for ; Fri, 15 Apr 2022 23:23:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=7kGQzOanbVYOn3E2/I6eHWRNeF8kbJWDccGBZinYNyA=; b=rBmeWm6Xh+wdDYz5RPh2Ezh8mTuDrZ8Mz6yu3hX/xrzi0KrXHeGg5fQOMpAcGwa7XQ D/4DlrKL0TuDE5GPF55FXnCOyyrejef3SexMyLDkah+mHcvIDOEHVuh8yoy1yWkYOdC9 DGFvbrGMS4cskIXRvDRG6GlMHXumEloo72d4GtrD2uGABdHkVhp+QwE/6eJD38UGyqfR cNJAEP2KkCUZw0LySL/SZ3vwN9c7hwog2Diek3Mo+I+DATDBG2ZKCIfvSU7iK0Mz878m 9Xr5nh9E42A0lzxvShmg6W4DNDINRq2eEzdxbhoC2SuxZD4WO520ggYTJmAswNKS/F4b STzA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=7kGQzOanbVYOn3E2/I6eHWRNeF8kbJWDccGBZinYNyA=; b=MRlONUGlhGsOAT/DiVu3yynr4UkugeCzTmErd2fcCy5Tb03R+QeZJt6yuoPVdXWijP HOYovL6w9PP+VIT88Nvi9neLI41zF5y27mRKiiwJG+ThTA0PaMUeym7L+qTMRjmMpNOC lz+B134eLFwtRXiAoW+z/PVoa4ahmsNJiZobaoI9NpuFaC4e1Yqd1yHXo3irtZBCkH+I OAStObyhJQuECwsVotehtcCP1g4SLigXk680B0PYmCb4zs6yNopJtZ7XkbZzbI86yMs/ +3KbpvTSUba25KaLR9TwdJ9qDYvegVnpamuQSeJSOU0t3NWGVIs9wJ1xb8AOVr1ifbvw Qewg== X-Gm-Message-State: AOAM53230tuI6yDSntb3ZPholzebGCQHg3oMgCk5rONFcAq4j9ujHMAg 5jTCO4Gvs3QMcQLxM/9v/uuISOcw1tfwqg== X-Google-Smtp-Source: ABdhPJx4jhYq1M16sthiEkXqSurfMvFzfqy3CGbYFohSNEFKufgt1T3p0m6z4tUXcXTYLx8II2g5Zw== X-Received: by 2002:a05:6e02:1d85:b0:2cb:fa5e:73fa with SMTP id h5-20020a056e021d8500b002cbfa5e73famr861577ila.294.1650090233095; Fri, 15 Apr 2022 23:23:53 -0700 (PDT) Received: from google.com (194.225.68.34.bc.googleusercontent.com. [34.68.225.194]) by smtp.gmail.com with ESMTPSA id y4-20020a92d204000000b002ca9d47d5d0sm3814128ily.20.2022.04.15.23.23.50 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 15 Apr 2022 23:23:50 -0700 (PDT) Date: Sat, 16 Apr 2022 06:23:46 +0000 From: Oliver Upton To: kvmarm@lists.cs.columbia.edu Subject: Re: [RFC PATCH 00/17] KVM: arm64: Parallelize stage 2 fault handling Message-ID: References: <20220415215901.1737897-1-oupton@google.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20220415215901.1737897-1-oupton@google.com> Cc: kvm@vger.kernel.org, Marc Zyngier , Ben Gardon , Peter Shier , David Matlack , Paolo Bonzini , linux-arm-kernel@lists.infradead.org X-BeenThere: kvmarm@lists.cs.columbia.edu X-Mailman-Version: 2.1.14 Precedence: list List-Id: Where KVM/ARM decisions are made List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: kvmarm-bounces@lists.cs.columbia.edu Sender: kvmarm-bounces@lists.cs.columbia.edu On Fri, Apr 15, 2022 at 09:58:44PM +0000, Oliver Upton wrote: [...] > > Smoke tested with KVM selftests + kvm_page_table_test w/ 2M hugetlb to > exercise the table pruning code. Haven't done anything beyond this, > sending as an RFC now to get eyes on the code. Ok, got around to testing this thing a bit harder. Keep in mind that permission faults at PAGE_SIZE granularity already go on the read side of the lock. I used the dirty_log_perf_test with 4G/vCPU and anonymous THP all the way up to 48 vCPUs. Here is the data as it compares to 5.18-rc2. Dirty log time (split 2M -> 4K): +-------+----------+-------------------+ | vCPUs | 5.18-rc2 | 5.18-rc2 + series | +-------+----------+-------------------+ | 1 | 0.83s | 0.85s | | 2 | 0.95s | 1.07s | | 4 | 2.65s | 1.13s | | 8 | 4.88s | 1.33s | | 16 | 9.71s | 1.73s | | 32 | 20.43s | 3.99s | | 48 | 29.15s | 6.28s | +-------+----------+-------------------+ The scaling of prefaulting pass looks better too (same config): +-------+----------+-------------------+ | vCPUs | 5.18-rc2 | 5.18-rc2 + series | +-------+----------+-------------------+ | 1 | 0.42s | 0.18s | | 2 | 0.55s | 0.19s | | 4 | 0.79s | 0.27s | | 8 | 1.29s | 0.35s | | 16 | 2.03s | 0.53s | | 32 | 4.03s | 1.01s | | 48 | 6.10s | 1.51s | +-------+----------+-------------------+ -- Thanks, Oliver _______________________________________________ kvmarm mailing list kvmarm@lists.cs.columbia.edu https://lists.cs.columbia.edu/mailman/listinfo/kvmarm From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 63132C433F5 for ; Sat, 16 Apr 2022 06:25:28 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=mn2W9ZsgTz6+AiShBUeo0gY7d5n0Qp/hmHGXuziZQBY=; b=Zic8bDaehwA1Zy sxEKuWzXTl6GpJn5TlGYn8dr2qVoKAMhDFYaJ4RdDCCJCYOpppV/Ls1Yd+0+14vpFxUZqBdStZISd zeAi4V6YrVCDreGHHvK/AdG2qtWfH0+qlGO95i/VqnhzUsKM0A1Cbortx3cQjY0q/3QJyoJGlo0Mt ks4B+XxMxMfVaPOs1Eg3JdF0ca3k+R0U9cdQsjcmuFgCPYxOIg9g8bmuGbwoi63ywYvA1n7P50I2k 2LjeFb/rT1cnugZyyFb2KkrlLVVVOKth6aKM/PvFRpqghUWEshAHUXT4FD/RQZabt1ik9FC31qmpe VkfDgxU43XgsPNlLIa8Q==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1nfbqh-00CLDv-4H; Sat, 16 Apr 2022 06:23:59 +0000 Received: from mail-il1-x12d.google.com ([2607:f8b0:4864:20::12d]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1nfbqd-00CLDB-9O for linux-arm-kernel@lists.infradead.org; Sat, 16 Apr 2022 06:23:57 +0000 Received: by mail-il1-x12d.google.com with SMTP id 14so5821446ily.11 for ; Fri, 15 Apr 2022 23:23:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=7kGQzOanbVYOn3E2/I6eHWRNeF8kbJWDccGBZinYNyA=; b=rBmeWm6Xh+wdDYz5RPh2Ezh8mTuDrZ8Mz6yu3hX/xrzi0KrXHeGg5fQOMpAcGwa7XQ D/4DlrKL0TuDE5GPF55FXnCOyyrejef3SexMyLDkah+mHcvIDOEHVuh8yoy1yWkYOdC9 DGFvbrGMS4cskIXRvDRG6GlMHXumEloo72d4GtrD2uGABdHkVhp+QwE/6eJD38UGyqfR cNJAEP2KkCUZw0LySL/SZ3vwN9c7hwog2Diek3Mo+I+DATDBG2ZKCIfvSU7iK0Mz878m 9Xr5nh9E42A0lzxvShmg6W4DNDINRq2eEzdxbhoC2SuxZD4WO520ggYTJmAswNKS/F4b STzA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=7kGQzOanbVYOn3E2/I6eHWRNeF8kbJWDccGBZinYNyA=; b=XZ1jLzHuv3E9nQ1gDOGT4VcdAIop+k3WSAxCo1OByiTsmrBbTaBT6ok6iCnDuf2OoN tSf3N4x7U1X3vhVL3OgMmQtv+qVELomwOyOKM6TCi+FkMY3uxCh/ljbg7WwboA0mUlLK WIqnefrjHe9xichjuZC801ZOhgibdgpexVWaHNLh9kAh48PiAu8g8dT8M2HCvrAfrBva j0HNKXN6qxcw8tytnwp3FzlNNfaCmficG/lSy+buvrKK+ErCsILTku9iJAaBD6Qa9DJI 6vimL+zNVzVCwuFgCQZ7IDHOYYq5Om3ixtFjZQ2c0r98VpxRNpajUqbctW4H2d4F4+YX vapw== X-Gm-Message-State: AOAM533Qxl1FtTv1Cve2hcXz9xTQC6v3YHeDzdy1hknNAXqHYFHIV8JQ bJkUHJb1CbDrFh1USKLUkcnGMg== X-Google-Smtp-Source: ABdhPJx4jhYq1M16sthiEkXqSurfMvFzfqy3CGbYFohSNEFKufgt1T3p0m6z4tUXcXTYLx8II2g5Zw== X-Received: by 2002:a05:6e02:1d85:b0:2cb:fa5e:73fa with SMTP id h5-20020a056e021d8500b002cbfa5e73famr861577ila.294.1650090233095; Fri, 15 Apr 2022 23:23:53 -0700 (PDT) Received: from google.com (194.225.68.34.bc.googleusercontent.com. [34.68.225.194]) by smtp.gmail.com with ESMTPSA id y4-20020a92d204000000b002ca9d47d5d0sm3814128ily.20.2022.04.15.23.23.50 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 15 Apr 2022 23:23:50 -0700 (PDT) Date: Sat, 16 Apr 2022 06:23:46 +0000 From: Oliver Upton To: kvmarm@lists.cs.columbia.edu Cc: kvm@vger.kernel.org, Marc Zyngier , James Morse , Alexandru Elisei , Suzuki K Poulose , linux-arm-kernel@lists.infradead.org, Peter Shier , Ricardo Koller , Reiji Watanabe , Paolo Bonzini , Sean Christopherson , Ben Gardon , David Matlack Subject: Re: [RFC PATCH 00/17] KVM: arm64: Parallelize stage 2 fault handling Message-ID: References: <20220415215901.1737897-1-oupton@google.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20220415215901.1737897-1-oupton@google.com> X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20220415_232355_385020_A6EFF4D0 X-CRM114-Status: GOOD ( 12.16 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Fri, Apr 15, 2022 at 09:58:44PM +0000, Oliver Upton wrote: [...] > > Smoke tested with KVM selftests + kvm_page_table_test w/ 2M hugetlb to > exercise the table pruning code. Haven't done anything beyond this, > sending as an RFC now to get eyes on the code. Ok, got around to testing this thing a bit harder. Keep in mind that permission faults at PAGE_SIZE granularity already go on the read side of the lock. I used the dirty_log_perf_test with 4G/vCPU and anonymous THP all the way up to 48 vCPUs. Here is the data as it compares to 5.18-rc2. Dirty log time (split 2M -> 4K): +-------+----------+-------------------+ | vCPUs | 5.18-rc2 | 5.18-rc2 + series | +-------+----------+-------------------+ | 1 | 0.83s | 0.85s | | 2 | 0.95s | 1.07s | | 4 | 2.65s | 1.13s | | 8 | 4.88s | 1.33s | | 16 | 9.71s | 1.73s | | 32 | 20.43s | 3.99s | | 48 | 29.15s | 6.28s | +-------+----------+-------------------+ The scaling of prefaulting pass looks better too (same config): +-------+----------+-------------------+ | vCPUs | 5.18-rc2 | 5.18-rc2 + series | +-------+----------+-------------------+ | 1 | 0.42s | 0.18s | | 2 | 0.55s | 0.19s | | 4 | 0.79s | 0.27s | | 8 | 1.29s | 0.35s | | 16 | 2.03s | 0.53s | | 32 | 4.03s | 1.01s | | 48 | 6.10s | 1.51s | +-------+----------+-------------------+ -- Thanks, Oliver _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id 98FA9C433EF for ; Sat, 16 Apr 2022 06:23:56 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S229651AbiDPG0Z (ORCPT ); Sat, 16 Apr 2022 02:26:25 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:39816 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229379AbiDPG0Y (ORCPT ); Sat, 16 Apr 2022 02:26:24 -0400 Received: from mail-il1-x129.google.com (mail-il1-x129.google.com [IPv6:2607:f8b0:4864:20::129]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id DB42CC74B9 for ; Fri, 15 Apr 2022 23:23:53 -0700 (PDT) Received: by mail-il1-x129.google.com with SMTP id b5so5871276ile.0 for ; Fri, 15 Apr 2022 23:23:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20210112; h=date:from:to:cc:subject:message-id:references:mime-version :content-disposition:in-reply-to; bh=7kGQzOanbVYOn3E2/I6eHWRNeF8kbJWDccGBZinYNyA=; b=rBmeWm6Xh+wdDYz5RPh2Ezh8mTuDrZ8Mz6yu3hX/xrzi0KrXHeGg5fQOMpAcGwa7XQ D/4DlrKL0TuDE5GPF55FXnCOyyrejef3SexMyLDkah+mHcvIDOEHVuh8yoy1yWkYOdC9 DGFvbrGMS4cskIXRvDRG6GlMHXumEloo72d4GtrD2uGABdHkVhp+QwE/6eJD38UGyqfR cNJAEP2KkCUZw0LySL/SZ3vwN9c7hwog2Diek3Mo+I+DATDBG2ZKCIfvSU7iK0Mz878m 9Xr5nh9E42A0lzxvShmg6W4DNDINRq2eEzdxbhoC2SuxZD4WO520ggYTJmAswNKS/F4b STzA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:date:from:to:cc:subject:message-id:references :mime-version:content-disposition:in-reply-to; bh=7kGQzOanbVYOn3E2/I6eHWRNeF8kbJWDccGBZinYNyA=; b=lEALbA8Xr0gGA53vtTrQmbBCE3w9V5c9PbeA3zVaxkvhYBh7F/cIhFEcEVSXzq8qu3 HbVi4vFU4dvdhUgQMHgfNNcB6dgTh3AxWltWrV9gmBX74Psiz4FCd8kgYyk55rdOcoZ2 mkBluba/ZVguqCjgv45R/OkQ5in7eEuVufPryHpYXBbLxVmMGEQQ8af4Tj0gE8QZhZo9 UCR7FlogZ90PUpTf63T8IXB8caeTjGw8DkMjiB8F0jDc82EeoR1ZFZadfpVi3HGPF3/W peQP9LooNagemkm2zaXnzZUyuukAA6UHbteytC4r81o2T2aY1f8TwFVMvNlmYYKwfc4w MDow== X-Gm-Message-State: AOAM531QN7X8RBKreeemAX6daWQfiFdoIedYQPU/T/sE7IKAU4SNy7XC TT2ffpFmBdnWa4E+h4YHCflcGg== X-Google-Smtp-Source: ABdhPJx4jhYq1M16sthiEkXqSurfMvFzfqy3CGbYFohSNEFKufgt1T3p0m6z4tUXcXTYLx8II2g5Zw== X-Received: by 2002:a05:6e02:1d85:b0:2cb:fa5e:73fa with SMTP id h5-20020a056e021d8500b002cbfa5e73famr861577ila.294.1650090233095; Fri, 15 Apr 2022 23:23:53 -0700 (PDT) Received: from google.com (194.225.68.34.bc.googleusercontent.com. [34.68.225.194]) by smtp.gmail.com with ESMTPSA id y4-20020a92d204000000b002ca9d47d5d0sm3814128ily.20.2022.04.15.23.23.50 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 15 Apr 2022 23:23:50 -0700 (PDT) Date: Sat, 16 Apr 2022 06:23:46 +0000 From: Oliver Upton To: kvmarm@lists.cs.columbia.edu Cc: kvm@vger.kernel.org, Marc Zyngier , James Morse , Alexandru Elisei , Suzuki K Poulose , linux-arm-kernel@lists.infradead.org, Peter Shier , Ricardo Koller , Reiji Watanabe , Paolo Bonzini , Sean Christopherson , Ben Gardon , David Matlack Subject: Re: [RFC PATCH 00/17] KVM: arm64: Parallelize stage 2 fault handling Message-ID: References: <20220415215901.1737897-1-oupton@google.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20220415215901.1737897-1-oupton@google.com> Precedence: bulk List-ID: X-Mailing-List: kvm@vger.kernel.org On Fri, Apr 15, 2022 at 09:58:44PM +0000, Oliver Upton wrote: [...] > > Smoke tested with KVM selftests + kvm_page_table_test w/ 2M hugetlb to > exercise the table pruning code. Haven't done anything beyond this, > sending as an RFC now to get eyes on the code. Ok, got around to testing this thing a bit harder. Keep in mind that permission faults at PAGE_SIZE granularity already go on the read side of the lock. I used the dirty_log_perf_test with 4G/vCPU and anonymous THP all the way up to 48 vCPUs. Here is the data as it compares to 5.18-rc2. Dirty log time (split 2M -> 4K): +-------+----------+-------------------+ | vCPUs | 5.18-rc2 | 5.18-rc2 + series | +-------+----------+-------------------+ | 1 | 0.83s | 0.85s | | 2 | 0.95s | 1.07s | | 4 | 2.65s | 1.13s | | 8 | 4.88s | 1.33s | | 16 | 9.71s | 1.73s | | 32 | 20.43s | 3.99s | | 48 | 29.15s | 6.28s | +-------+----------+-------------------+ The scaling of prefaulting pass looks better too (same config): +-------+----------+-------------------+ | vCPUs | 5.18-rc2 | 5.18-rc2 + series | +-------+----------+-------------------+ | 1 | 0.42s | 0.18s | | 2 | 0.55s | 0.19s | | 4 | 0.79s | 0.27s | | 8 | 1.29s | 0.35s | | 16 | 2.03s | 0.53s | | 32 | 4.03s | 1.01s | | 48 | 6.10s | 1.51s | +-------+----------+-------------------+ -- Thanks, Oliver