Linux-ARM-Kernel Archive on lore.kernel.org
 help / color / mirror / Atom feed
From: James Clark <james.clark@linaro.org>
To: Leo Yan <leo.yan@arm.com>, Suzuki K Poulose <suzuki.poulose@arm.com>
Cc: Mike Leach <mike.leach@arm.com>, Suyash Mahar <smahar@meta.com>,
	Yeoreum Yun <yeoreum.yun@arm.com>,
	Greg Kroah-Hartman <gregkh@linuxfoundation.org>,
	Qi Liu <liuqi115@huawei.com>, Junhao He <hejunhao3@huawei.com>,
	coresight@lists.linaro.org, linux-arm-kernel@lists.infradead.org,
	linux-kernel@vger.kernel.org, Jonathan Cameron <jic23@kernel.org>
Subject: Re: [PATCH v3 4/8] coresight: tmc-etr: Prevent per-thread events from sharing a sink
Date: Fri, 9 Oct 2026 15:27:29 +0100	[thread overview]
Message-ID: <77e7e412-9ee9-4a6c-9576-db4f8f673bf2@linaro.org> (raw)
In-Reply-To: <20260819084515.GF8904@e132581.arm.com>



On 19/08/2026 09:45, Leo Yan wrote:
> On Fri, Aug 14, 2026 at 10:09:01AM +0100, James Clark wrote:
> 
> [...]
> 
>> There isn't any sharing with "another perf session", unless there is a
>> mistake somewhere? Checking that the owners are equivalent enforces this. Or
>> do you mean another event owned by the same process?
> 
> Now I understand that the problem is constrained to different events
> within the same session.
> 
>> I'm not sure the exact model you had in mind was that still supports this
>> and fixes the bugs?
> 
> Let me try to describe my understanding of the problem.
> 
>    ./perf test -w named_threads 2 1000000 &
>    ./perf record -e cs_etm//u --per-thread --pid $!
> 
> We can simplify the flow as:
> 
>                  | T1 |
>    CPU0        ------------------------------
>                     |   T2      |
>    CPU1        ------------------------------
>                                 `> T2 stops and the driver reports
>                                    the warning when trying to sync
>                                    ETR_BUF(T1), while T2 is associated
>                                    with ETR_BUF(T2).
> 
>    AUX_BUF(T1) |                            |
>    ETR_BUF(T1) | Bounce buf0                |  -> Used by H/W trace
> 
> 
>    AUX_BUF(T2) |                            |
>    ETR_BUF(T2) | Bounce buf1                |  -> Not used by H/W trace
> 
> With `--per-thread --pid $PID`, perf creates separate events for the
> child threads, say T1 and T2. Perf allocates a separate AUX buffer
> for each event, and the ETR driver also allocates a separate bounce
> buffer for each event. However, because there is only one shared ETR
> sink, only one of those bounce buffers can actually be used by the
> hardware at a time.
> 
> If T1 stops while T2 is still running, the ETR remains enabled. Later,
> when T2 stops, the ETR is still using ETR_BUF(T1). This mismatch
> triggers the warning and prevents the data from being copied.
> 
> I am just wandering if we can improve the sink driver to only allocate
> a single bounce buffer that is independent of any threads (and any
> associated events).
> 
>                  | T1 |
>    CPU0        ------------------------------
>                     |   T2      |
>    CPU1        ------------------------------
>                                 `> T2 stops and can sync trace
>                                    from the shared bounce buffer
>                                    to AUX_BUF(T2).
> 
>    AUX_BUF(T1) |                            |
>    AUX_BUF(T2) |                            |
> 
>    ETR_BUF     | Bounce buf                 |  -> Used by H/W trace
> 
> This might also simplify the CPU-wide case. Each CPU would still have
> its own AUX buffer, but the ETR driver would maintain only one bounce
> buffer for the shared sink. A reference count could track how many
> events are using the sink, with the final event responsible for
> stopping the sink and copying the trace data from bounce buffer to aux
> buffer.
> 
>> The one in this change is pretty complete and only does 4 comparisons,
>> which seems quite simple to me.
> 
> Before going further with the heavily sink buffer refactoring, perhaps
> a more pragmatic solution would be to reject the problematic case for
> now. Can we do something like below?
> 
> +void coresight_trace_id_is_perf_started(struct coresight_trace_id_map *id_map)
> +{
> +	PERF_SESSION(atomic_read(&id_map->perf_cs_etm_session_active));
> +}
> 
> @@ -399,6 +399,15 @@ etm_event_build_path(struct perf_event *event, int cpu,
>   			goto out;
>   	}
>   
> +	if (!coresight_trace_id_is_perf_started(&sink->perf_sink_id_map)) {
> +		sink->perf_owner = event->owner;
> +		sink->perf_target = event->hw.target;
> +	} else {
> +		if (sink->perf_owner != event->owner ||
> +		    sink->perf_target != event->hw.target)
> +			goto out;
> +	}
> +
> 
> We use a central place etm_event_build_path() to record and compare
> event's owner and target process, then we don't need to spread the
> check into sink drivers. We only care about if owner and target must
> be consistent.
> 
> Regard of the inherit/inherit_thread, I always see they are consistent
> within the same session. Should we ignore them?
> 
> Thanks,
> Leo

Yeah I think we can do something like this, but we only need to do it if 
the sink has multiple ETMs reachable, otherwise we don't need to do any 
ownership check at all. And we don't need to check the target either.

Something like this:

   if (sink->has_multiple_etms) {
     if (!coresight_trace_id_is_perf_started(&sink->perf_sink_id_map))
       sink->perf_owner = event->owner;
     if (sink->perf_owner != event->owner)
       goto out;
   }

If there is a 1:1 sink/ETM mapping, then the perf core exclusive PMU 
rules already prevent all bad sharing cases. Then multiple concurrent 
ATTACH_TASK sessions/users are supported:

   perf record -e cs_etm// -- sleep 100 &
   perf record -e cs_etm// -- true

This is allowed by the exclusive PMU rules because the two different 
processes can never be running on one ETM at once, and if there are no 
shared sinks we can allow it too.

If one of the sinks on one of those sessions is shared, then the new 
behavior is that the second session fails to open. (If a system had a 
mix of shared and not shared sinks, I think Perf might handle the 
failures gracefully and continue with a partial set of events/CPUs 
opened, but it warns about this)

We don't need to check hw.target because "perf --per-thread" already 
attaches to all existing threads (which are different), and we don't 
want to report busy in that case. We do need to turn context IDs on for 
per-thread mode though, because shared sinks mean that you might get 
trace from multiple different threads even in per-thread mode. But 
that's fine as long as the owner is the same, same as the existing 
per-CPU mode.





  parent reply	other threads:[~2026-10-09 14:27 UTC|newest]

Thread overview: 23+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-07-28 15:00 [PATCH v3 0/8] coresight: Prevent per-thread events from sharing a sink James Clark
2026-07-28 15:00 ` [PATCH v3 1/8] coresight: tmc-etr: Don't stop Perf cleanup for active sysfs reads James Clark
2026-08-12 16:45   ` Leo Yan
2026-08-13  9:02     ` James Clark
2026-07-28 15:00 ` [PATCH v3 2/8] coresight: configfs: Don't assume active until cscfg_mgr is set James Clark
2026-08-13  9:09   ` Leo Yan
2026-08-13  9:24     ` James Clark
2026-07-28 15:00 ` [PATCH v3 3/8] coresight: etm-perf: Flush workqueue before unloading module James Clark
2026-08-13 14:19   ` Leo Yan
2026-08-14  8:55     ` James Clark
2026-07-28 15:00 ` [PATCH v3 4/8] coresight: tmc-etr: Prevent per-thread events from sharing a sink James Clark
2026-08-13 16:05   ` Leo Yan
2026-08-14  9:09     ` James Clark
2026-08-19  8:45       ` Leo Yan
2026-08-20 11:09         ` James Clark
2026-08-20 11:27           ` James Clark
2026-08-25 17:32           ` Leo Yan
2026-08-26  8:40             ` James Clark
2026-10-09 14:27         ` James Clark [this message]
2026-07-28 15:00 ` [PATCH v3 5/8] coresight: tmc-etr: Use session ID for buffer ownership James Clark
2026-07-28 15:00 ` [PATCH v3 6/8] coresight: tmc-etf: Prevent per-thread events from sharing a sink James Clark
2026-07-28 15:00 ` [PATCH v3 7/8] coresight: etb10: " James Clark
2026-07-28 15:00 ` [PATCH v3 8/8] coresight: ultrasoc-smb: " James Clark

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=77e7e412-9ee9-4a6c-9576-db4f8f673bf2@linaro.org \
    --to=james.clark@linaro.org \
    --cc=coresight@lists.linaro.org \
    --cc=gregkh@linuxfoundation.org \
    --cc=hejunhao3@huawei.com \
    --cc=jic23@kernel.org \
    --cc=leo.yan@arm.com \
    --cc=linux-arm-kernel@lists.infradead.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=liuqi115@huawei.com \
    --cc=mike.leach@arm.com \
    --cc=smahar@meta.com \
    --cc=suzuki.poulose@arm.com \
    --cc=yeoreum.yun@arm.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox