Re: Why do I sometimes "lose" the "psys" RAPL counter?

[Srinivas Pandruvada <srinivas.pandruvada@linux.intel.com>]

On Thu, 2020-03-26 at 11:16 -0700, Kenneth R. Crudup wrote:
> I'm assuming by now you've seen the other emails fully answering
> yours and Zhang's questions?

I tried on the Dell 7390 2-in-1 and see the behavior you reported.
The problem is that the energy counter is 0 during probe (msr 0x64d is
0), which is not correct. So you rmmod intel_rapl_msr and modprobe
again, you will see psys domain.
Even the counter values are not correct. The delta between two reads of
energy_uj is less than the package domain energy_uj delta.
So psys domain is not useful on this system.

Sent again as the original email was not plain text.

Thanks,
Srinivas

> 
> 
> 
> -- 
> Sent from my Tab S4
> 
> 
> -------- Original message --------
> From: Srinivas Pandruvada <srinivas.pandruvada@linux.intel.com>
> Date: 3/26/20 08:23 (GMT-08:00)
> To: "Rafael J. Wysocki" <rafael@kernel.org>, "Kenneth R. Crudup" <
> kenny@panix.com>
> Cc: Linux PM <linux-pm@vger.kernel.org>
> Subject: Re: Why do I sometimes "lose" the "psys" RAPL counter?
> 
> On Thu, 2020-03-26 at 09:13 +0100, Rafael J. Wysocki wrote:
> > +Srinivas
> > 
> > On Thu, Mar 26, 2020 at 6:46 AM Kenneth R. Crudup <kenny@panix.com>
> > wrote:
> > > 
> > > (Re-sent, as I think I had the wrong mailing list address before)
> > > 
> > > I'm running Linus' latest master of today (and have seen this for
> a
> > > while
> > > now). I've got an IceLake CPU (i7-1065G7 running on a Dell 7390
> 2-
> > > in-1, but
> > > I'm pretty sure I've seen issue this on my HP Spectre 13 with a
> > > 9th-gen CPU).
> > > 
> > > Sometimes when I boot, I get 4 RAPL "fixed counters" and
> sometimes
> > > I only
> > > get 3, and it's always the "psys" domain that's missing when it
> > > does. See
> > > attached output from various dmesg runs (and a snippet below).
> When you say counters, where is this missing from:
> 1. /sys/class/powercap/intel-rapl/intel-rapl:1
> 2. /sys/bus/event_source/devices/power/events/
> 3. Both of the above folders
> 
> Also what do you see?
> rdmsr 0x65c
> rdmsr 0x64d
> 
> Thanks,
> Srinivas
> 
> 
> > > 
> > > Is this a bug?
> > > Do you know what may cause this?
> > > 
> > > If you need more info to help me help you guys with this (if it's
> > > truly an
> > > issue), please let me know.
> > > 
> > > Thanks,
> > > 
> > >         -Kenny
> > > 
> > > ----
> > > Mar 22 05:02:48 xps-7390 kernel: [    0.756890] RAPL PMU: API
> unit
> > > is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer
> > > Mar 22 05:02:48 xps-7390 kernel: [    0.756892] RAPL PMU: hw unit
> > > of domain pp0-core 2^-14 Joules
> > > Mar 22 05:02:48 xps-7390 kernel: [    0.756893] RAPL PMU: hw unit
> > > of domain package 2^-14 Joules
> > > Mar 22 05:02:48 xps-7390 kernel: [    0.756894] RAPL PMU: hw unit
> > > of domain pp1-gpu 2^-14 Joules
> > > Mar 22 05:02:48 xps-7390 kernel: [    2.178267]
> intel_rapl_common:
> > > Found RAPL domain package
> > > Mar 22 05:02:48 xps-7390 kernel: [    3.056499]
> intel_rapl_common:
> > > Found RAPL domain package
> > > Mar 22 05:02:48 xps-7390 kernel: [    3.058417]
> intel_rapl_common:
> > > Found RAPL domain core
> > > Mar 22 05:02:48 xps-7390 kernel: [    3.062290]
> intel_rapl_common:
> > > Found RAPL domain uncore
> > > Mar 22 05:17:50 xps-7390 kernel: [    1.770794] RAPL PMU: API
> unit
> > > is 2^-32 Joules, 3 fixed counters, 655360 ms ovfl timer
> > > Mar 22 05:17:50 xps-7390 kernel: [    1.770799] RAPL PMU: hw unit
> > > of domain pp0-core 2^-14 Joules
> > > Mar 22 05:17:50 xps-7390 kernel: [    1.770802] RAPL PMU: hw unit
> > > of domain package 2^-14 Joules
> > > Mar 22 05:17:50 xps-7390 kernel: [    1.770814] RAPL PMU: hw unit
> > > of domain pp1-gpu 2^-14 Joules
> > > Mar 22 05:17:50 xps-7390 kernel: [    3.176324]
> intel_rapl_common:
> > > Found RAPL domain package
> > > Mar 22 05:17:50 xps-7390 kernel: [    4.060045]
> intel_rapl_common:
> > > Found RAPL domain package
> > > Mar 22 05:17:50 xps-7390 kernel: [    4.061739]
> intel_rapl_common:
> > > Found RAPL domain core
> > > Mar 22 05:17:50 xps-7390 kernel: [    4.063129]
> intel_rapl_common:
> > > Found RAPL domain uncore
> > > Mar 22 05:28:05 xps-7390 kernel: [    1.770320] RAPL PMU: API
> unit
> > > is 2^-32 Joules, 4 fixed counters, 655360 ms ovfl timer
> > > Mar 22 05:28:05 xps-7390 kernel: [    1.770326] RAPL PMU: hw unit
> > > of domain pp0-core 2^-14 Joules
> > > Mar 22 05:28:05 xps-7390 kernel: [    1.770329] RAPL PMU: hw unit
> > > of domain package 2^-14 Joules
> > > Mar 22 05:28:05 xps-7390 kernel: [    1.770332] RAPL PMU: hw unit
> > > of domain pp1-gpu 2^-14 Joules
> > > Mar 22 05:28:05 xps-7390 kernel: [    1.770335] RAPL PMU: hw unit
> > > of domain psys 2^-14 Joules
> > > Mar 22 05:28:05 xps-7390 kernel: [    3.148050]
> intel_rapl_common:
> > > Found RAPL domain package
> > > Mar 22 05:28:05 xps-7390 kernel: [    4.043621]
> intel_rapl_common:
> > > Found RAPL domain package
> > > Mar 22 05:28:05 xps-7390 kernel: [    4.045295]
> intel_rapl_common:
> > > Found RAPL domain core
> > > Mar 22 05:28:05 xps-7390 kernel: [    4.046823]
> intel_rapl_common:
> > > Found RAPL domain uncore
> > > Mar 22 05:37:11 xps-7390 kernel: [    1.635660] RAPL PMU: API
> unit
> > > is 2^-32 Joules, 4 fixed counters, 655360 ms ovfl timer
> > > Mar 22 05:37:11 xps-7390 kernel: [    1.635667] RAPL PMU: hw unit
> > > of domain pp0-core 2^-14 Joules
> > > Mar 22 05:37:11 xps-7390 kernel: [    1.635670] RAPL PMU: hw unit
> > > of domain package 2^-14 Joules
> > > Mar 22 05:37:11 xps-7390 kernel: [    1.635673] RAPL PMU: hw unit
> > > of domain pp1-gpu 2^-14 Joules
> > > Mar 22 05:37:11 xps-7390 kernel: [    1.635676] RAPL PMU: hw unit
> > > of domain psys 2^-14 Joules
> > > Mar 22 05:37:11 xps-7390 kernel: [    3.043397]
> intel_rapl_common:
> > > Found RAPL domain package
> > > Mar 22 05:37:11 xps-7390 kernel: [    4.043265]
> intel_rapl_common:
> > > Found RAPL domain package
> > > Mar 22 05:37:11 xps-7390 kernel: [    4.045524]
> intel_rapl_common:
> > > Found RAPL domain core
> > > Mar 22 05:37:11 xps-7390 kernel: [    4.048153]
> intel_rapl_common:
> > > Found RAPL domain uncore
> > > ----
> > > 
> > > 
> > > --
> > > Kenneth R. Crudup  Sr. SW Engineer, Scott County Consulting,
> > > Silicon Valley
>