From: Dave.Martin@arm.com (Dave Martin)
To: linux-arm-kernel@lists.infradead.org
Subject: [PATCH v6 10/15] arm64/sve: Move sve_pffr() to fpsimd.h and make inline
Date: Tue, 8 May 2018 17:44:55 +0100 [thread overview]
Message-ID: <1525797900-5548-11-git-send-email-Dave.Martin@arm.com> (raw)
In-Reply-To: <1525797900-5548-1-git-send-email-Dave.Martin@arm.com>
In order to make sve_save_state()/sve_load_state() more easily
reusable and to get rid of a potential branch on context switch
critical paths, this patch makes sve_pffr() inline and moves it to
fpsimd.h.
<asm/processor.h> must be included in fpsimd.h in order to make
this work, and this creates an #include cycle that is tricky to
avoid without modifying core code, due to the way the PR_SVE_*()
prctl helpers are included in the core prctl implementation.
Instead of breaking the cycle, this patch defers inclusion of
<asm/fpsimd.h> in <asm/processor.h> until the point where it is
actually needed: i.e., immediately before the prctl definitions.
No functional change.
Signed-off-by: Dave Martin <Dave.Martin@arm.com>
Acked-by: Catalin Marinas <catalin.marinas@arm.com>
---
arch/arm64/include/asm/fpsimd.h | 13 +++++++++++++
arch/arm64/include/asm/processor.h | 3 ++-
arch/arm64/kernel/fpsimd.c | 12 ------------
3 files changed, 15 insertions(+), 13 deletions(-)
diff --git a/arch/arm64/include/asm/fpsimd.h b/arch/arm64/include/asm/fpsimd.h
index f4d80ae..0026a92 100644
--- a/arch/arm64/include/asm/fpsimd.h
+++ b/arch/arm64/include/asm/fpsimd.h
@@ -18,6 +18,8 @@
#include <asm/ptrace.h>
#include <asm/errno.h>
+#include <asm/processor.h>
+#include <asm/sigcontext.h>
#ifndef __ASSEMBLY__
@@ -60,6 +62,17 @@ extern void sve_flush_cpu_state(void);
/* Maximum VL that SVE VL-agnostic software can transparently support */
#define SVE_VL_ARCH_MAX 0x100
+/* Offset of FFR in the SVE register dump */
+static inline size_t sve_ffr_offset(int vl)
+{
+ return SVE_SIG_FFR_OFFSET(sve_vq_from_vl(vl)) - SVE_SIG_REGS_OFFSET;
+}
+
+static inline void *sve_pffr(struct thread_struct *thread)
+{
+ return (char *)thread->sve_state + sve_ffr_offset(thread->sve_vl);
+}
+
extern void sve_save_state(void *state, u32 *pfpsr);
extern void sve_load_state(void const *state, u32 const *pfpsr,
unsigned long vq_minus_1);
diff --git a/arch/arm64/include/asm/processor.h b/arch/arm64/include/asm/processor.h
index f902b6d..ebaadb1 100644
--- a/arch/arm64/include/asm/processor.h
+++ b/arch/arm64/include/asm/processor.h
@@ -40,7 +40,6 @@
#include <asm/alternative.h>
#include <asm/cpufeature.h>
-#include <asm/fpsimd.h>
#include <asm/hw_breakpoint.h>
#include <asm/lse.h>
#include <asm/pgtable-hwdef.h>
@@ -245,6 +244,8 @@ void cpu_enable_pan(const struct arm64_cpu_capabilities *__unused);
void cpu_enable_cache_maint_trap(const struct arm64_cpu_capabilities *__unused);
void cpu_clear_disr(const struct arm64_cpu_capabilities *__unused);
+#include <asm/fpsimd.h>
+
/* Userspace interface for PR_SVE_{SET,GET}_VL prctl()s: */
#define SVE_SET_VL(arg) sve_set_current_vl(arg)
#define SVE_GET_VL() sve_get_current_vl()
diff --git a/arch/arm64/kernel/fpsimd.c b/arch/arm64/kernel/fpsimd.c
index d811679..152d834 100644
--- a/arch/arm64/kernel/fpsimd.c
+++ b/arch/arm64/kernel/fpsimd.c
@@ -161,18 +161,6 @@ static void sve_free(struct task_struct *task)
__sve_free(task);
}
-
-/* Offset of FFR in the SVE register dump */
-static size_t sve_ffr_offset(int vl)
-{
- return SVE_SIG_FFR_OFFSET(sve_vq_from_vl(vl)) - SVE_SIG_REGS_OFFSET;
-}
-
-static void *sve_pffr(struct thread_struct *thread)
-{
- return (char *)thread->sve_state + sve_ffr_offset(thread->sve_vl);
-}
-
static void change_cpacr(u64 val, u64 mask)
{
u64 cpacr = read_sysreg(CPACR_EL1);
--
2.1.4
next prev parent reply other threads:[~2018-05-08 16:44 UTC|newest]
Thread overview: 31+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-05-08 16:44 [PATCH v6 00/15] KVM: arm64: Optimise FPSIMD context switching Dave Martin
2018-05-08 16:44 ` [PATCH v6 01/15] thread_info: Add update_thread_flag() helpers Dave Martin
2018-05-08 17:08 ` Steven Rostedt
2018-05-09 9:07 ` Marc Zyngier
2018-05-08 16:44 ` [PATCH v6 02/15] arm64: Use update{,_tsk}_thread_flag() Dave Martin
2018-05-09 9:09 ` Marc Zyngier
2018-05-08 16:44 ` [PATCH v6 03/15] KVM: arm/arm64: Introduce kvm_arch_vcpu_run_pid_change Dave Martin
2018-05-08 16:44 ` [PATCH v6 04/15] KVM: arm64: Convert lazy FPSIMD context switch trap to C Dave Martin
2018-05-08 16:44 ` [PATCH v6 05/15] arm64: fpsimd: Generalise context saving for non-task contexts Dave Martin
2018-05-08 16:44 ` [PATCH v6 06/15] KVM: arm64: Repurpose vcpu_arch.debug_flags for general-purpose flags Dave Martin
2018-05-09 8:27 ` Marc Zyngier
2018-05-08 16:44 ` [PATCH v6 07/15] KVM: arm64: Optimise FPSIMD handling to reduce guest/host thrashing Dave Martin
2018-05-09 8:24 ` Marc Zyngier
2018-05-09 9:17 ` Dave Martin
2018-05-09 9:46 ` Marc Zyngier
2018-05-09 10:00 ` Dave Martin
2018-05-08 16:44 ` [PATCH v6 08/15] arm64/sve: Move read_zcr_features() out of cpufeature.h Dave Martin
2018-05-09 8:28 ` Marc Zyngier
2018-05-08 16:44 ` [PATCH v6 09/15] arm64/sve: Switch sve_pffr() argument from task to thread Dave Martin
2018-05-09 8:44 ` Marc Zyngier
2018-05-08 16:44 ` Dave Martin [this message]
2018-05-09 8:46 ` [PATCH v6 10/15] arm64/sve: Move sve_pffr() to fpsimd.h and make inline Marc Zyngier
2018-05-08 16:44 ` [PATCH v6 11/15] KVM: arm64: Save host SVE context as appropriate Dave Martin
2018-05-09 8:50 ` Marc Zyngier
2018-05-09 9:30 ` Dave Martin
2018-05-08 16:44 ` [PATCH v6 12/15] KVM: arm64: Remove eager host SVE state saving Dave Martin
2018-05-09 8:56 ` Marc Zyngier
2018-05-08 16:44 ` [PATCH v6 13/15] KVM: arm64: Remove redundant *exit_code changes in fpsimd_guest_exit() Dave Martin
2018-05-08 16:44 ` [PATCH v6 14/15] KVM: arm64: Fold redundant exit code checks out of fixup_guest_exit() Dave Martin
2018-05-09 9:05 ` Marc Zyngier
2018-05-08 16:45 ` [PATCH v6 15/15] KVM: arm64: Invoke FPSIMD context switch trap from C Dave Martin
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1525797900-5548-11-git-send-email-Dave.Martin@arm.com \
--to=dave.martin@arm.com \
--cc=linux-arm-kernel@lists.infradead.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).