From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-ed1-f74.google.com (mail-ed1-f74.google.com [209.85.208.74]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 31E4839E18C for ; Fri, 1 May 2026 11:19:52 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.208.74 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1777634393; cv=none; b=YmIIR7i/fEQKZmly2/4M5hBM5G7ZbD2/ednZr4PAJryeQpzk3dOM+g/GVklL6UOwMX5FqMqISPxeW5RLDDGdnSYiGd4+dMLLBkx/LXmFaRwoOIm3nvmG6x4mqeTqO5FXnha9pvbkXwE6srCDFc6lJ6RUNeW0Q4HC/ch/QXV3nak= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1777634393; c=relaxed/simple; bh=hQvMJPmlY2Hj6FmtUqvk5LfujDesEr9peo98uTnWvUw=; h=Date:In-Reply-To:Mime-Version:References:Message-ID:Subject:From: To:Cc:Content-Type; b=gZLL9VkK8bSA1FNFzd1MFL63LbRNACp23RF52MJIZJLRqe3qqEdw747DGOzSA+03SulKFWuu8ehcXh5/4+agYkUx2h1r2Lc/s7uh7m13Ob1KH3SDAbQfwtsI4M1dpx54K9sa0m3FQpnVOMJ0Ct0Ohm7bseeQMiOaQpECle+vOcA= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com; spf=pass smtp.mailfrom=flex--smostafa.bounces.google.com; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b=G79gI5qk; arc=none smtp.client-ip=209.85.208.74 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=reject dis=none) header.from=google.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=flex--smostafa.bounces.google.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="G79gI5qk" Received: by mail-ed1-f74.google.com with SMTP id 4fb4d7f45d1cf-6729caff479so1912096a12.2 for ; Fri, 01 May 2026 04:19:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20251104; t=1777634390; x=1778239190; darn=vger.kernel.org; h=cc:to:from:subject:message-id:references:mime-version:in-reply-to :date:from:to:cc:subject:date:message-id:reply-to; bh=ycktJLz1KBPXSpg6NVU24LQdR/O3V/jOKSZRApslagY=; b=G79gI5qkTjLIJ2F9NwfFpPJ08nWFW/r56B17m6es6A5uyELxEu8Ula9P+JrnjTB+kn BPRhFhzUZK0Ncy1SiS2YfQb+wd2ORhYWYJGLXqSW601Juw+IENNDCt9M/3mKoEtZfmLa hPdfM9Aftfa6YcO9ehhwN7DDHNWpAu2uD4dAhNd17nVZe6Fq6dKj3eedcdhmULvrX153 4Ul12pqimpXNnJARdiF14wTLmzlUkyCSHhvyC4eieQ5WOxnsrizA+Fab9ndGzqVQ9a3j z0Jyr/HhefFfZTdvNw94a2Z0BckJZYKUPOkLqNJ/yGd8umZruPLyY+YzJWQ7cMopH7Zp Zxhw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1777634390; x=1778239190; h=cc:to:from:subject:message-id:references:mime-version:in-reply-to :date:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=ycktJLz1KBPXSpg6NVU24LQdR/O3V/jOKSZRApslagY=; b=WotM9q5GntF1Sudtv2I3iMXe94LFvgE3EBXSWYOqf7mTS82ODMX3HHDgbgMALQWazY ypVYPRch1PO7rxcgLO+BReLeMDegK+S6VmnIhQ2ZrqGrUYBSULftFszysFasgBP1NiG+ cy8HshqMiiDEt7CSKGSSqTGBeT+gv3woK2gygK+U5o7Ymoyr4ZmiGcF05wzErarTKEsY JMqvNdIzmXo7jR4B6sSRX5NoSj6IYqUtwLWekNWZjTcBS0LF4GweOvKOiR+VggkhzKOO q5N+pKUfukh2DpqjU6PljL+1LJWpkGu2mujlv4nzHZqg5gsfZC3K8tOe6zb6se/xh8z2 tznw== X-Forwarded-Encrypted: i=1; AFNElJ9+/F/JI1XIxvgo8CJOa5OIkY5a9Gfp2bXxBb0lSdLby2aci1BhRZpi1PsO2UX6fG3/jJigj4QVcU6ANtk=@vger.kernel.org X-Gm-Message-State: AOJu0Yww/P7k2cwBpOn+4TWZpGN0EGZMiZfoL4x/FRlbTH7zpHrUyLeK YX6uLpG+KJeOxGLYQSn5W/RnmP4KicYmV2O2uJpL6upuxepD5NP0VmdCMQAt0K1oFRDYud/idzC zEnIUDzLY5dpnqA== X-Received: from edag36.prod.google.com ([2002:a05:6402:3224:b0:66e:76b4:2912]) (user=smostafa job=prod-delivery.src-stubby-dispatcher) by 2002:a05:6402:46d8:b0:678:a507:e81b with SMTP id 4fb4d7f45d1cf-67b5d97defdmr2810112a12.21.1777634390386; Fri, 01 May 2026 04:19:50 -0700 (PDT) Date: Fri, 1 May 2026 11:19:03 +0000 In-Reply-To: <20260501111928.259252-1-smostafa@google.com> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: Mime-Version: 1.0 References: <20260501111928.259252-1-smostafa@google.com> X-Mailer: git-send-email 2.54.0.545.g6539524ca2-goog Message-ID: <20260501111928.259252-2-smostafa@google.com> Subject: [PATCH v6 01/25] KVM: arm64: Generalize trace clock From: Mostafa Saleh To: linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, kvmarm@lists.linux.dev, iommu@lists.linux.dev Cc: catalin.marinas@arm.com, will@kernel.org, maz@kernel.org, oliver.upton@linux.dev, joey.gouly@arm.com, suzuki.poulose@arm.com, yuzenghui@huawei.com, joro@8bytes.org, jean-philippe@linaro.org, jgg@ziepe.ca, mark.rutland@arm.com, qperret@google.com, tabba@google.com, vdonnefort@google.com, sebastianene@google.com, keirf@google.com, Mostafa Saleh Content-Type: text/plain; charset="UTF-8" IOMMU drivers need to track time, mainly for timeouts. Generalize the tracing clock functions in the hypervsior, so they can be used from IOMMU drivers. 1) Make the compilation independent from tracing. 2) As drivers might need to use that quite early, provide default values for the clock data based on cntfrq_el0, the driver can keep using these values without calling hyp_clock_update() as they don't need to sync with the host timers. This is mainly used for timeouts, so a malicious host can DoS the system or cause premature timeouts which likely end up in hyp panic, that should be acceptable as neither of those would undermine the security guarantees. Signed-off-by: Mostafa Saleh --- arch/arm64/kvm/hyp/include/nvhe/clock.h | 11 ++----- arch/arm64/kvm/hyp/nvhe/Makefile | 4 +-- arch/arm64/kvm/hyp/nvhe/clock.c | 44 ++++++++++++++++++++++--- arch/arm64/kvm/hyp/nvhe/setup.c | 5 +++ arch/arm64/kvm/hyp/nvhe/trace.c | 4 +-- 5 files changed, 51 insertions(+), 17 deletions(-) diff --git a/arch/arm64/kvm/hyp/include/nvhe/clock.h b/arch/arm64/kvm/hyp/include/nvhe/clock.h index 9f429f5c0664..e6a0e43af88d 100644 --- a/arch/arm64/kvm/hyp/include/nvhe/clock.h +++ b/arch/arm64/kvm/hyp/include/nvhe/clock.h @@ -5,12 +5,7 @@ #include -#ifdef CONFIG_NVHE_EL2_TRACING -void trace_clock_update(u32 mult, u32 shift, u64 epoch_ns, u64 epoch_cyc); -u64 trace_clock(void); -#else -static inline void -trace_clock_update(u32 mult, u32 shift, u64 epoch_ns, u64 epoch_cyc) { } -static inline u64 trace_clock(void) { return 0; } -#endif +void hyp_clock_update(u32 mult, u32 shift, u64 epoch_ns, u64 epoch_cyc); +u64 hyp_clock_ns(void); +int hyp_clock_init(void); #endif diff --git a/arch/arm64/kvm/hyp/nvhe/Makefile b/arch/arm64/kvm/hyp/nvhe/Makefile index 62cdfbff7562..89d0533921f9 100644 --- a/arch/arm64/kvm/hyp/nvhe/Makefile +++ b/arch/arm64/kvm/hyp/nvhe/Makefile @@ -26,10 +26,10 @@ hyp-obj-y := timer-sr.o sysreg-sr.o debug-sr.o switch.o tlb.o hyp-init.o host.o hyp-main.o hyp-smp.o psci-relay.o early_alloc.o page_alloc.o \ cache.o setup.o mm.o mem_protect.o sys_regs.o pkvm.o stacktrace.o ffa.o hyp-obj-y += ../vgic-v3-sr.o ../aarch32.o ../vgic-v2-cpuif-proxy.o ../entry.o \ - ../fpsimd.o ../hyp-entry.o ../exception.o ../pgtable.o ../vgic-v5-sr.o + ../fpsimd.o ../hyp-entry.o ../exception.o ../pgtable.o ../vgic-v5-sr.o clock.o hyp-obj-y += ../../../kernel/smccc-call.o hyp-obj-$(CONFIG_LIST_HARDENED) += list_debug.o -hyp-obj-$(CONFIG_NVHE_EL2_TRACING) += clock.o trace.o events.o +hyp-obj-$(CONFIG_NVHE_EL2_TRACING) += trace.o events.o hyp-obj-y += $(lib-objs) # Path to simple_ring_buffer.c diff --git a/arch/arm64/kvm/hyp/nvhe/clock.c b/arch/arm64/kvm/hyp/nvhe/clock.c index 32fc4313fe43..53d0bd55e866 100644 --- a/arch/arm64/kvm/hyp/nvhe/clock.c +++ b/arch/arm64/kvm/hyp/nvhe/clock.c @@ -18,7 +18,41 @@ static struct clock_data { u64 cyc_overflow64; } data[2]; u64 cur; -} trace_clock_data; +} clock_data; + +#define HYP_CLK_SEC_TO_NS 1000000000UL + +int hyp_clock_init(void) +{ + u32 timer_freq = read_sysreg(cntfrq_el0); + u32 shift = 32; + u64 mult; + + /* + * KVM will not initialize if FW didn't set cntfrq_el0, that is already + * part of the boot protocol. + */ + if (!timer_freq) + return -ENODEV; + + /* Timer freq can't be larger than 1Ghz by spec. */ + if (timer_freq > HYP_CLK_SEC_TO_NS) + return -EINVAL; + + /* Simplified logic from clocks_calc_mult_shift() */ + do { + mult = (HYP_CLK_SEC_TO_NS << shift); + mult = div_u64(mult, timer_freq); + if (mult <= (~0U)) + break; + shift--; + } while (shift > 0); + + clock_data.data[0].shift = shift; + clock_data.data[0].mult = mult; + clock_data.data[0].cyc_overflow64 = ULONG_MAX / mult; + return 0; +} static u64 __clock_mult_uint128(u64 cyc, u32 mult, u32 shift) { @@ -30,9 +64,9 @@ static u64 __clock_mult_uint128(u64 cyc, u32 mult, u32 shift) } /* Does not guarantee no reader on the modified bank. */ -void trace_clock_update(u32 mult, u32 shift, u64 epoch_ns, u64 epoch_cyc) +void hyp_clock_update(u32 mult, u32 shift, u64 epoch_ns, u64 epoch_cyc) { - struct clock_data *clock = &trace_clock_data; + struct clock_data *clock = &clock_data; u64 bank = clock->cur ^ 1; clock->data[bank].mult = mult; @@ -45,9 +79,9 @@ void trace_clock_update(u32 mult, u32 shift, u64 epoch_ns, u64 epoch_cyc) } /* Use untrusted host data */ -u64 trace_clock(void) +u64 hyp_clock_ns(void) { - struct clock_data *clock = &trace_clock_data; + struct clock_data *clock = &clock_data; u64 bank = smp_load_acquire(&clock->cur); u64 cyc, ns; diff --git a/arch/arm64/kvm/hyp/nvhe/setup.c b/arch/arm64/kvm/hyp/nvhe/setup.c index d8e5b563fd3d..8041f6e80cd1 100644 --- a/arch/arm64/kvm/hyp/nvhe/setup.c +++ b/arch/arm64/kvm/hyp/nvhe/setup.c @@ -10,6 +10,7 @@ #include #include +#include #include #include #include @@ -312,6 +313,10 @@ void __noreturn __pkvm_init_finalise(void) }; pkvm_pgtable.mm_ops = &pkvm_pgtable_mm_ops; + ret = hyp_clock_init(); + if (ret) + goto out; + ret = fix_host_ownership(); if (ret) goto out; diff --git a/arch/arm64/kvm/hyp/nvhe/trace.c b/arch/arm64/kvm/hyp/nvhe/trace.c index a6ca27b18e15..e30de840e6c2 100644 --- a/arch/arm64/kvm/hyp/nvhe/trace.c +++ b/arch/arm64/kvm/hyp/nvhe/trace.c @@ -35,7 +35,7 @@ static bool hyp_trace_buffer_loaded(struct hyp_trace_buffer *trace_buffer) void *tracing_reserve_entry(unsigned long length) { return simple_ring_buffer_reserve(this_cpu_ptr(trace_buffer.simple_rbs), length, - trace_clock()); + hyp_clock_ns()); } void tracing_commit_entry(void) @@ -285,7 +285,7 @@ void __tracing_update_clock(u32 mult, u32 shift, u64 epoch_ns, u64 epoch_cyc) } /* ...we can now override the old one and swap. */ - trace_clock_update(mult, shift, epoch_ns, epoch_cyc); + hyp_clock_update(mult, shift, epoch_ns, epoch_cyc); } int __tracing_reset(unsigned int cpu) -- 2.54.0.545.g6539524ca2-goog