From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-17.7 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,INCLUDES_CR_TRAILER,INCLUDES_PATCH,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 7B832C433ED for ; Tue, 11 May 2021 16:10:54 +0000 (UTC) Received: from desiato.infradead.org (desiato.infradead.org [90.155.92.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id DAD0D60C41 for ; Tue, 11 May 2021 16:10:53 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org DAD0D60C41 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=desiato.20200630; h=Sender:Content-Transfer-Encoding :Content-Type:List-Subscribe:List-Help:List-Post:List-Archive: List-Unsubscribe:List-Id:MIME-Version:References:In-Reply-To:Message-Id:Date: Subject:Cc:To:From:Reply-To:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=owEf/u8D/KSji2pEOCBfz8Rr9DrZ8kETbc5XwpHndSY=; b=D5swoTujc15JTF3iJVwEIa+Yb IVRIwrwgd9w6hlbme+7HS9zkRI79VeYgRHB0Ws605NnsgMTdv7/4qe1UayuC689kIChXhtOsZtTIK jCo/T0nad2t+CRwVdyw7aMrUFgC3aj/CyVoGrU2AhVMQzEKKion9jo6QdHh19nIX5xYt+IHaADoVn D0gS3ZVsetWst//WHD52O4bjxQon8FcSnS669E9nJydJKH3KHsQ7oWHwavvbTvP3RXKMn5C1fvw3W NamkwnbCLU/7kp9DB4IJTh1uOpUtNbkRVwmY4fPzL0etRyXeOrrnNjgftVYmbrxZXPlf3r+l3gb5E eboLmGuQQ==; Received: from localhost ([::1] helo=desiato.infradead.org) by desiato.infradead.org with esmtp (Exim 4.94 #2 (Red Hat Linux)) id 1lgUwr-000g12-AB; Tue, 11 May 2021 16:09:30 +0000 Received: from bombadil.infradead.org ([2607:7c80:54:e::133]) by desiato.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lgUv1-000fh0-Vz for linux-arm-kernel@desiato.infradead.org; Tue, 11 May 2021 16:07:36 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=bombadil.20210309; h=Content-Transfer-Encoding: MIME-Version:References:In-Reply-To:Message-Id:Date:Subject:Cc:To:From:Sender :Reply-To:Content-Type:Content-ID:Content-Description; bh=kmyjBOenrmx0ddQ/UeYrDhg1qgTXM8lsg5CS8Rc/jJY=; b=QnqbzonmRm9sUUcZIbbsEk/3p8 eZU8t5/GQaZDwmEHaQ8c7Tk+bjYUZIr3ap4MYom6Hwza+rL3lnYnfozvap8gJ/8H7pWmM/bWrPqCf BV/ZqvylGDVKwiB5NTTscYtnaCOj+VFGJwWl311faWVJaBhBUigxETcXHlKY2bpzzR38zJUJZ9q51 OumpZbbnn4HJaMmUoVF81DOpGI6IHW9SBhjKqW78dbAO1CPMsXrvwE1JQVUP1yCcNzQc02pN5MLCK c2UxVMnrJ9VlEV60ywqjW3foJIRvV96e9MbuqEaYNkct1+Ar0iL77zI5rTDjGTigusqOuz+FkNLNg vxb1rAtg==; Received: from mail.kernel.org ([198.145.29.99]) by bombadil.infradead.org with esmtps (Exim 4.94 #2 (Red Hat Linux)) id 1lgUuz-009k17-Az for linux-arm-kernel@lists.infradead.org; Tue, 11 May 2021 16:07:34 +0000 Received: by mail.kernel.org (Postfix) with ESMTPSA id 5893461154; Tue, 11 May 2021 16:07:32 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1620749252; bh=cTjB/GI5+LUHdChIjVdq/b9SRw6d3uhgfnk5yyDbcQg=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=NcWdG6PaFRUDicVEwvSW3i47WtCFOg3uPyPX4P4acidnqk9I0Vqacm6KnXMypFXlR wdIte6c9U7Wa1B+wb54dg30/glLVsHUX3zPV512L26/vuTqfQO19g7+6lwEQsBuE8B jwLxPTEwugI1CfErQKnQUuc1tyOh9M+ByBQ+xx+EQFb4DoD7Fb8yC+HFHWD2nfm1tx 5toBrFuPU28QbpdsmwYTmlmdtHCuU45SkmqyDM1fpi5LDcyDuUuFgc6y6msc14r4C3 T2Ih/T1KUmFmLesnF1gSmQMWl7vnXPeNDLnPn4lnUY/c4j9n7khABN5wWCGFoyN4po aqfKhnAoP4+Nw== From: Mark Brown To: Catalin Marinas , Will Deacon Cc: Dave Martin , linux-arm-kernel@lists.infradead.org, Mark Brown Subject: [PATCH v2 3/3] arm64/sve: Skip flushing Z registers with 128 bit vectors Date: Tue, 11 May 2021 17:04:46 +0100 Message-Id: <20210511160446.42871-4-broonie@kernel.org> X-Mailer: git-send-email 2.20.1 In-Reply-To: <20210511160446.42871-1-broonie@kernel.org> References: <20210511160446.42871-1-broonie@kernel.org> MIME-Version: 1.0 X-Patch-Hashes: v=1; h=sha256; i=dFqv+IEGzD35KuPbEbZHcDzanCpxU72L9ocHqttmAwA=; m=P/GMwtZTr1KsXYreaMS7GLhn0bTQRSLx8cU5Yd7/bqA=; p=nhTo2ZCC7f98VU/ptxYehsk86GXBVGS0fp65KXmqi9g=; g=4640f49f8879d0154f69ac40b5464c9a379b872f X-Patch-Sig: m=pgp; i=broonie@kernel.org; s=0xC3F436CA30F5D8EB; b=iQEzBAABCgAdFiEEreZoqmdXGLWf4p/qJNaLcl1Uh9AFAmCaqxwACgkQJNaLcl1Uh9AiAwf8CvI LZMwEzH5MoFPmz10/vgYETgKHz+znYJcZjP9HeN4WsyA6wAESNVD7jazY+n2nA2OG3vmVfABcviUT k+2vm5zTFsto4xiCaKBC0sOFuglgouPIAbGOQ6ZJ0aeX11SgkZXCcR9BG/J20q6H8UU9Qo+pZrWdM 2jMqROX8FrdaAVQnIxuKCk+aU3PRry3B/bJ/7WYz7uHxo+WNoJGdVjIc50SV/90Pg+NKoh5WVmj3G q/gNJPuRYLCnYLJoYhZIUbcJKeZIUWgTXJyidxOXvRXbfqTrAfAZNe6oTCy3cncSw2WnFW+knpsxj AGvMSY2DSEWRCmcyrc0rGytEJT0oyHw== X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20210511_090733_468063_310E2A30 X-CRM114-Status: GOOD ( 12.13 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org When the SVE vector length is 128 bits then there are no bits in the Z registers which are not shared with the V registers so we can skip them when zeroing state not shared with FPSIMD, this results in a minor performance improvement. Signed-off-by: Mark Brown --- arch/arm64/include/asm/fpsimd.h | 2 +- arch/arm64/kernel/entry-fpsimd.S | 9 +++++++-- arch/arm64/kernel/fpsimd.c | 6 ++++-- 3 files changed, 12 insertions(+), 5 deletions(-) diff --git a/arch/arm64/include/asm/fpsimd.h b/arch/arm64/include/asm/fpsimd.h index 2599504674b5..c072161d5c65 100644 --- a/arch/arm64/include/asm/fpsimd.h +++ b/arch/arm64/include/asm/fpsimd.h @@ -69,7 +69,7 @@ static inline void *sve_pffr(struct thread_struct *thread) extern void sve_save_state(void *state, u32 *pfpsr); extern void sve_load_state(void const *state, u32 const *pfpsr, unsigned long vq_minus_1); -extern void sve_flush_live(void); +extern void sve_flush_live(unsigned long vq_minus_1); extern void sve_load_from_fpsimd_state(struct user_fpsimd_state const *state, unsigned long vq_minus_1); extern unsigned int sve_get_vl(void); diff --git a/arch/arm64/kernel/entry-fpsimd.S b/arch/arm64/kernel/entry-fpsimd.S index dd8382e5ce82..87ef25836963 100644 --- a/arch/arm64/kernel/entry-fpsimd.S +++ b/arch/arm64/kernel/entry-fpsimd.S @@ -69,10 +69,15 @@ SYM_FUNC_START(sve_load_from_fpsimd_state) ret SYM_FUNC_END(sve_load_from_fpsimd_state) -/* Zero all SVE registers but the first 128-bits of each vector */ +/* + * Zero all SVE registers but the first 128-bits of each vector + * + * x0 = VQ - 1 + */ SYM_FUNC_START(sve_flush_live) + cbz x0, 1f // A VQ-1 of 0 is 128 bits so no extra Z state sve_flush_z - sve_flush_p_ffr +1: sve_flush_p_ffr ret SYM_FUNC_END(sve_flush_live) diff --git a/arch/arm64/kernel/fpsimd.c b/arch/arm64/kernel/fpsimd.c index ad3dd34a83cf..e57b23f95284 100644 --- a/arch/arm64/kernel/fpsimd.c +++ b/arch/arm64/kernel/fpsimd.c @@ -957,8 +957,10 @@ void do_sve_acc(unsigned int esr, struct pt_regs *regs) * disabling the trap, otherwise update our in-memory copy. */ if (!test_thread_flag(TIF_FOREIGN_FPSTATE)) { - sve_set_vq(sve_vq_from_vl(current->thread.sve_vl) - 1); - sve_flush_live(); + unsigned long vq_minus_one = + sve_vq_from_vl(current->thread.sve_vl) - 1; + sve_set_vq(vq_minus_one); + sve_flush_live(vq_minus_one); fpsimd_bind_task_to_cpu(); } else { fpsimd_to_sve(current); -- 2.20.1 _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel