From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id ED6F9C5472E for ; Mon, 26 Aug 2024 08:30:34 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:In-Reply-To:Content-Type: MIME-Version:References:Message-ID:Subject:Cc:To:From:Date:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=3yKGdAKluc2NQUo65fBsP9jvVBslRg7guaM8PI25v9Y=; b=NEruYbJCzrsjYvT0WH/Eg8dgiV s31vu+yQrWIhIAehh4PZYN7DYBdCDUOEJtUEq17uQUFvFccxu+EYMJabQUG9+Qmpn9Ti6JbJOzDJh 94Gv08wwWutq3Dbaqx07lnB64nyThNo+2UUAymkPUGrNM/02QyM7oFuwJoLqUunopVoxwOSw9WtWZ R73uCs2wfZK+XeqCNZYZ/6Aoxwfi6JzUxUkp/M5KhmIvBB98zcj0VLtQUkoZmJamSNBJrX/F3o24d MrMcheete3xhbDxeOzbh9GdcrOrta2qnv2e0ml/irXlLxy9L54gh6QaYqhcdtqfhBgm2D13adNPr4 QuEH+Nhg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.97.1 #2 (Red Hat Linux)) id 1siV7I-00000006VGW-1hoi; Mon, 26 Aug 2024 08:30:24 +0000 Received: from desiato.infradead.org ([2001:8b0:10b:1:d65d:64ff:fe57:4e05]) by bombadil.infradead.org with esmtps (Exim 4.97.1 #2 (Red Hat Linux)) id 1siU4z-00000006FYY-1qSl for linux-arm-kernel@bombadil.infradead.org; Mon, 26 Aug 2024 07:23:57 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=desiato.20200630; h=In-Reply-To:Content-Type:MIME-Version: References:Message-ID:Subject:Cc:To:From:Date:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description; bh=3yKGdAKluc2NQUo65fBsP9jvVBslRg7guaM8PI25v9Y=; b=agovqw1lyQiHkvTmF7Jg9zvhtu /ywuFL/o+LqUvw/U8EUN/2vDVLOgJC0t+tS9xD7J0OJq1qDyNJSdb6v/FhojB95B0aRkobEcJeXoD gUceGJ6faD+MT7tzu9pdO2phwDHvg+nq7koIIy18AHC4j0XDVNW/okTNLls4YSt1+NhayayUCMFxg Xb73kfuTShfEuRkIx0Xo4L5AutqXbUnXt4XwuxrCxT3naK85Z8JIZDYyzvuIEsv4JozKCoMb4RAPI h1df+ePf83vqo5hVt67T+bY5M7XocmbPZK//iajA27TYQA8PsnhSEeXjytBIiQj2rS29Bj9nkffFl 1/wyHr3w==; Received: from foss.arm.com ([217.140.110.172]) by desiato.infradead.org with esmtp (Exim 4.97.1 #2 (Red Hat Linux)) id 1siU4v-0000000Aa74-1JVc for linux-arm-kernel@lists.infradead.org; Mon, 26 Aug 2024 07:23:56 +0000 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id E17E2339; Mon, 26 Aug 2024 00:24:14 -0700 (PDT) Received: from arm.com (usa-sjc-imap-foss1.foss.arm.com [10.121.207.14]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 8F8F13F66E; Mon, 26 Aug 2024 00:23:45 -0700 (PDT) Date: Mon, 26 Aug 2024 09:23:34 +0200 From: Beata Michalska To: Jie Zhan Cc: linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org, ionela.voinescu@arm.com, sudeep.holla@arm.com, will@kernel.org, catalin.marinas@arm.com, vincent.guittot@linaro.org, vanshikonda@os.amperecomputing.com, sumitg@nvidia.com, yang@os.amperecomputing.com, lihuisong@huawei.com, viresh.kumar@linaro.org, rafael@kernel.org Subject: Re: [PATCH v6 3/4] arm64: Provide an AMU-based version of arch_freq_get_on_cpu Message-ID: References: <20240603082154.3830591-1-beata.michalska@arm.com> <20240603082154.3830591-4-beata.michalska@arm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20240826_082353_873830_0B68854F X-CRM114-Status: GOOD ( 34.29 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org On Wed, Aug 14, 2024 at 02:46:16PM +0800, Jie Zhan wrote: > Hi Beata, Hi Jie, > > On 03/06/2024 16:21, Beata Michalska wrote: > > With the Frequency Invariance Engine (FIE) being already wired up with > > sched tick and making use of relevant (core counter and constant > > counter) AMU counters, getting the current frequency for a given CPU, > > can be achieved by utilizing the frequency scale factor which reflects > > an average CPU frequency for the last tick period length. > > > > The solution is partially based on APERF/MPERF implementation of > > arch_freq_get_on_cpu. > > > > Suggested-by: Ionela Voinescu > > Signed-off-by: Beata Michalska > > --- > > arch/arm64/kernel/topology.c | 110 +++++++++++++++++++++++++++++++---- > > 1 file changed, 100 insertions(+), 10 deletions(-) > ... > > + > > +#define AMU_SAMPLE_EXP_MS 20 > > + > > +unsigned int arch_freq_get_on_cpu(int cpu) > > +{ > > + struct amu_cntr_sample *amu_sample; > > + unsigned int start_cpu = cpu; > > + unsigned long last_update; > > + unsigned int freq = 0; > > + u64 scale; > > + > > + if (!amu_fie_cpu_supported(cpu) || !arch_scale_freq_ref(cpu)) > > + return 0; > > + > > +retry: > > + amu_sample = per_cpu_ptr(&cpu_amu_samples, cpu); > > + > > + last_update = amu_sample->last_update; > > + > > + /* > > + * For those CPUs that are in full dynticks mode, > > + * and those that have not seen tick for a while > > + * try an alternative source for the counters (and thus freq scale), > > + * if available, for given policy: > > + * this boils down to identifying an active cpu within the same freq > > + * domain, if any. > > + */ > > + if (!housekeeping_cpu(cpu, HK_TYPE_TICK) || > > + time_is_before_jiffies(last_update + msecs_to_jiffies(AMU_SAMPLE_EXP_MS))) { > One question here. > > The 2nd condition, providing the addtional code in patch 4, would be: > (!idle_cpu(cpu) && time_is_before_jiffies(last_update + > msecs_to_jiffies(AMU_SAMPLE_EXP_MS))) > That means trying another cpu in the same freq domain if this cpu is running > and not having a tick recently. > > In this case, if it fails to find an alternative cpu in the following code, > can it just jump to the calculation > part and return an 'old' frequency rather than return 0? > The freq here won't be older than the freq when the cpu went idle last time > -- yet the freq before last idle > is returned if the cpu were idle (patch 4). To be fair, I will be dropping the idle_cpu check from this condition so that we do keep the cap on the validity of the scale factor: meaning if the cpu remains idle for longer than assumed 20ms we will either look for alternative or return 0. I'm not entirely convinced returning somewhat stale information on the freq for CPUs that remain idle for a while will be useful. One note here: as per discussion in [1] this functionality will be moved to new sysfs attribute so it will no longer be used via scaling_cur_freq. > > > + struct cpufreq_policy *policy = cpufreq_cpu_get(cpu); > > + int ref_cpu = cpu; > > + > > + if (!policy) > > + goto leave; > > + > > + if (!policy_is_shared(policy)) { > > + cpufreq_cpu_put(policy); > > + goto leave; > > + } > > + > > + do { > > + ref_cpu = cpumask_next_wrap(ref_cpu, policy->cpus, > > + start_cpu, false); > start_cpu is only used here. looks like we can s/start_cpu/cpu/ and remove > its definition above? It is indeed but it is needed for the cpumask_next_wrap to know when to stop the iteration after wrapping. --- [1] https://lore.kernel.org/all/20240603081331.3829278-1-beata.michalska@arm.com/ --- BR Beata > > + > > + } while (ref_cpu < nr_cpu_ids && idle_cpu(ref_cpu)); > > + > > + cpufreq_cpu_put(policy); > > + > > + if (ref_cpu >= nr_cpu_ids) > > + /* No alternative to pull info from */ > > + goto leave; > > + > > + cpu = ref_cpu; > > + goto retry; > > + } > > + /* > > + * Reversed computation to the one used to determine > > + * the arch_freq_scale value > > + * (see amu_scale_freq_tick for details) > > + */ > > + scale = arch_scale_freq_capacity(cpu); > > + freq = scale * arch_scale_freq_ref(cpu); > > + freq >>= SCHED_CAPACITY_SHIFT; > > +leave: > > + return freq; > > +} > > + > > static void amu_fie_setup(const struct cpumask *cpus) > > { > > int cpu; >