From: Dave.Martin@arm.com (Dave Martin)
To: linux-arm-kernel@lists.infradead.org
Subject: [PATCH v7 11/16] arm64/sve: Move sve_pffr() to fpsimd.h and make inline
Date: Wed, 9 May 2018 17:13:00 +0100 [thread overview]
Message-ID: <1525882385-29181-12-git-send-email-Dave.Martin@arm.com> (raw)
In-Reply-To: <1525882385-29181-1-git-send-email-Dave.Martin@arm.com>
In order to make sve_save_state()/sve_load_state() more easily
reusable and to get rid of a potential branch on context switch
critical paths, this patch makes sve_pffr() inline and moves it to
fpsimd.h.
<asm/processor.h> must be included in fpsimd.h in order to make
this work, and this creates an #include cycle that is tricky to
avoid without modifying core code, due to the way the PR_SVE_*()
prctl helpers are included in the core prctl implementation.
Instead of breaking the cycle, this patch defers inclusion of
<asm/fpsimd.h> in <asm/processor.h> until the point where it is
actually needed: i.e., immediately before the prctl definitions.
No functional change.
Signed-off-by: Dave Martin <Dave.Martin@arm.com>
Acked-by: Catalin Marinas <catalin.marinas@arm.com>
Acked-by: Marc Zyngier <marc.zyngier@arm.com>
---
arch/arm64/include/asm/fpsimd.h | 13 +++++++++++++
arch/arm64/include/asm/processor.h | 3 ++-
arch/arm64/kernel/fpsimd.c | 12 ------------
3 files changed, 15 insertions(+), 13 deletions(-)
diff --git a/arch/arm64/include/asm/fpsimd.h b/arch/arm64/include/asm/fpsimd.h
index fb60b22..fa92747 100644
--- a/arch/arm64/include/asm/fpsimd.h
+++ b/arch/arm64/include/asm/fpsimd.h
@@ -18,6 +18,8 @@
#include <asm/ptrace.h>
#include <asm/errno.h>
+#include <asm/processor.h>
+#include <asm/sigcontext.h>
#ifndef __ASSEMBLY__
@@ -61,6 +63,17 @@ extern void sve_flush_cpu_state(void);
/* Maximum VL that SVE VL-agnostic software can transparently support */
#define SVE_VL_ARCH_MAX 0x100
+/* Offset of FFR in the SVE register dump */
+static inline size_t sve_ffr_offset(int vl)
+{
+ return SVE_SIG_FFR_OFFSET(sve_vq_from_vl(vl)) - SVE_SIG_REGS_OFFSET;
+}
+
+static inline void *sve_pffr(struct thread_struct *thread)
+{
+ return (char *)thread->sve_state + sve_ffr_offset(thread->sve_vl);
+}
+
extern void sve_save_state(void *state, u32 *pfpsr);
extern void sve_load_state(void const *state, u32 const *pfpsr,
unsigned long vq_minus_1);
diff --git a/arch/arm64/include/asm/processor.h b/arch/arm64/include/asm/processor.h
index f902b6d..ebaadb1 100644
--- a/arch/arm64/include/asm/processor.h
+++ b/arch/arm64/include/asm/processor.h
@@ -40,7 +40,6 @@
#include <asm/alternative.h>
#include <asm/cpufeature.h>
-#include <asm/fpsimd.h>
#include <asm/hw_breakpoint.h>
#include <asm/lse.h>
#include <asm/pgtable-hwdef.h>
@@ -245,6 +244,8 @@ void cpu_enable_pan(const struct arm64_cpu_capabilities *__unused);
void cpu_enable_cache_maint_trap(const struct arm64_cpu_capabilities *__unused);
void cpu_clear_disr(const struct arm64_cpu_capabilities *__unused);
+#include <asm/fpsimd.h>
+
/* Userspace interface for PR_SVE_{SET,GET}_VL prctl()s: */
#define SVE_SET_VL(arg) sve_set_current_vl(arg)
#define SVE_GET_VL() sve_get_current_vl()
diff --git a/arch/arm64/kernel/fpsimd.c b/arch/arm64/kernel/fpsimd.c
index 6e05a2b..13fa681 100644
--- a/arch/arm64/kernel/fpsimd.c
+++ b/arch/arm64/kernel/fpsimd.c
@@ -161,18 +161,6 @@ static void sve_free(struct task_struct *task)
__sve_free(task);
}
-
-/* Offset of FFR in the SVE register dump */
-static size_t sve_ffr_offset(int vl)
-{
- return SVE_SIG_FFR_OFFSET(sve_vq_from_vl(vl)) - SVE_SIG_REGS_OFFSET;
-}
-
-static void *sve_pffr(struct thread_struct *thread)
-{
- return (char *)thread->sve_state + sve_ffr_offset(thread->sve_vl);
-}
-
static void change_cpacr(u64 val, u64 mask)
{
u64 cpacr = read_sysreg(CPACR_EL1);
--
2.1.4
next prev parent reply other threads:[~2018-05-09 16:13 UTC|newest]
Thread overview: 38+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-05-09 16:12 [PATCH v7 00/16] KVM: arm64: Optimise FPSIMD context switching Dave Martin
2018-05-09 16:12 ` [PATCH v7 01/16] thread_info: Add update_thread_flag() helpers Dave Martin
2018-05-10 16:15 ` Catalin Marinas
2018-05-09 16:12 ` [PATCH v7 02/16] arm64: Use update{,_tsk}_thread_flag() Dave Martin
2018-05-09 16:17 ` Will Deacon
2018-05-09 16:27 ` Dave Martin
2018-05-09 16:55 ` Marc Zyngier
2018-05-09 17:08 ` Dave Martin
2018-05-10 16:16 ` Catalin Marinas
2018-05-09 16:12 ` [PATCH v7 03/16] KVM: arm/arm64: Introduce kvm_arch_vcpu_run_pid_change Dave Martin
2018-05-09 16:12 ` [PATCH v7 04/16] KVM: arm64: Convert lazy FPSIMD context switch trap to C Dave Martin
2018-05-09 16:12 ` [PATCH v7 05/16] arm64: fpsimd: Generalise context saving for non-task contexts Dave Martin
2018-05-10 16:17 ` Catalin Marinas
2018-05-09 16:12 ` [PATCH v7 06/16] arm64/sve: Refactor user SVE trap maintenance for external use Dave Martin
2018-05-09 16:36 ` Marc Zyngier
2018-05-09 16:41 ` Dave Martin
2018-05-09 16:47 ` Marc Zyngier
2018-05-10 16:41 ` Catalin Marinas
2018-05-09 16:12 ` [PATCH v7 07/16] KVM: arm64: Repurpose vcpu_arch.debug_flags for general-purpose flags Dave Martin
2018-05-15 10:55 ` Christoffer Dall
2018-05-09 16:12 ` [PATCH v7 08/16] KVM: arm64: Optimise FPSIMD handling to reduce guest/host thrashing Dave Martin
2018-05-09 16:54 ` Marc Zyngier
2018-05-09 17:00 ` Dave Martin
2018-05-10 16:44 ` Catalin Marinas
2018-05-15 10:55 ` Christoffer Dall
2018-05-15 12:48 ` Dave Martin
2018-05-09 16:12 ` [PATCH v7 09/16] arm64/sve: Move read_zcr_features() out of cpufeature.h Dave Martin
2018-05-09 16:12 ` [PATCH v7 10/16] arm64/sve: Switch sve_pffr() argument from task to thread Dave Martin
2018-05-09 16:13 ` Dave Martin [this message]
2018-05-09 16:13 ` [PATCH v7 12/16] KVM: arm64: Save host SVE context as appropriate Dave Martin
2018-05-10 16:52 ` Catalin Marinas
2018-05-09 16:13 ` [PATCH v7 13/16] KVM: arm64: Remove eager host SVE state saving Dave Martin
2018-05-10 16:53 ` Catalin Marinas
2018-05-09 16:13 ` [PATCH v7 14/16] KVM: arm64: Remove redundant *exit_code changes in fpsimd_guest_exit() Dave Martin
2018-05-15 10:46 ` Christoffer Dall
2018-05-09 16:13 ` [PATCH v7 15/16] KVM: arm64: Fold redundant exit code checks out of fixup_guest_exit() Dave Martin
2018-05-09 16:13 ` [PATCH v7 16/16] KVM: arm64: Invoke FPSIMD context switch trap from C Dave Martin
2018-05-15 10:57 ` Christoffer Dall
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1525882385-29181-12-git-send-email-Dave.Martin@arm.com \
--to=dave.martin@arm.com \
--cc=linux-arm-kernel@lists.infradead.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).