From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from desiato.infradead.org (desiato.infradead.org [90.155.92.199]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 86125361641; Mon, 22 Jun 2026 12:32:53 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=90.155.92.199 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1782131577; cv=none; b=bejQW6NW9d9YI0xpaOMsW743e1PUpnSzkD/x1Mf8j6uKZWGPHxeCfLijst1qQNsq6OCT8OQfiuSQl09zR+oC9yrv0g18+z0jgpuml2xr8Vy+94qK5EI+SaC92LryXd5Kulcp/L64gqNWKxzZ3PYOhp8ihLW00wlRXikCNCffaDo= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1782131577; c=relaxed/simple; bh=h2uS0kWah7tJXsJnvk1/vM9s6NLROF9DJMtTxV1rOag=; h=Date:From:To:Cc:Subject:Message-ID:MIME-Version:Content-Type: Content-Disposition; b=jR405Vfhpd9CCWnoAUTUttL5CT0FCojmT+CWyiYx9rpwvz44lllfe1tUFnkzSzf2KgrhEMnl/aagRN7Y0VzdweeI3y6RkFDTwWX+BjXA1QEAbIDhmowUpCn4zU2B+P29tYDKYXDVS41B3CLteQL0qL48GetrzpXhbHKbbAseZw0= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=infradead.org; spf=pass smtp.mailfrom=infradead.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b=GniacP8g; arc=none smtp.client-ip=90.155.92.199 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=infradead.org Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=infradead.org Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=infradead.org header.i=@infradead.org header.b="GniacP8g" DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=desiato.20200630; h=Content-Type:MIME-Version:Message-ID: Subject:Cc:To:From:Date:Sender:Reply-To:Content-Transfer-Encoding:Content-ID: Content-Description:In-Reply-To:References; bh=QuErbYDD5kyKhATeqyLFTlHQ8KgPUBJ9ZvYZzYtYobY=; b=GniacP8gXmjrtrN/AwesUksp1a sQpn5zSrpBJ7aOPVd4wN10eFXgCZllVm4QSEVJnLc21o6AMDeEF94kJ8xNCaMLXy8mJtr/hSC50Va gDkDx8XbRvFk33+HetS57ZyL8uPstMbtuBDKJkU0R6FI9SHt0FkAb9ZmYJpej+H8eqicGgv6bw9qm aQD8wFbdbAq7ir/YYuRjIJolS1UVRNgXHnNfrDB8pgpxnKzNODuw2NmjwalchGCW7/L4rO6jH6gJ5 wFoMGpgQ3hbd62i2oe4GUvHRv2IAIXqkSlRRbikSEBicADLJhjNV24zZ1TjUi3NKSlbmfUb/XAfoi /1hyhqTQ==; Received: from 77-249-17-252.cable.dynamic.v4.ziggo.nl ([77.249.17.252] helo=noisy.programming.kicks-ass.net) by desiato.infradead.org with esmtpsa (Exim 4.99.2 #2 (Red Hat Linux)) id 1wbdpY-0000000HRib-13Qt; Mon, 22 Jun 2026 12:32:48 +0000 Received: by noisy.programming.kicks-ass.net (Postfix, from userid 1000) id 83560300B5F; Mon, 22 Jun 2026 14:32:45 +0200 (CEST) Date: Mon, 22 Jun 2026 14:32:45 +0200 From: Peter Zijlstra To: mingo@kernel.org Cc: acme@kernel.org, namhyung@kernel.org, mark.rutland@arm.com, alexander.shishkin@linux.intel.com, jolsa@kernel.org, irogers@google.com, adrian.hunter@intel.com, james.clark@linaro.org, linux-perf-users@vger.kernel.org, linux-kernel@vger.kernel.org, suzuki.poulose@arm.com, mike.leach@arm.com, leo.yan@arm.com Subject: [RFC][PATCH] perf: Fix perf_addr_filters_afjust() Message-ID: <20260622123245.GS48970@noisy.programming.kicks-ass.net> Precedence: bulk X-Mailing-List: linux-perf-users@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline - adjust lock order; since perf_event_addr_filters_apply() takes mmap_lock inside child_mutex. - note that perf_event_mmap() is called by the thread doing the mmap()/mprotect()/.. operation, but not the other threads in the address space that might have inherited the same event. - have perf_addr_filters_adjust() iterate the child_list to find all other events for tasks that have the same mm. - since this can now adjust addr_filter_ranges[] for remote events, make sure to adjust things while holding ctx->lock; local_irq_disable() as implied by the ifh->lock is no longer suffient to serialize against event scheduling. - per the previous locking order; perf_event_mmap(), which is called holding mmap_lock, cannot take child_mutex, as such, make child_list RCU protected and iterate under RCU. Signed-off-by: Peter Zijlstra (Intel) --- kernel/events/core.c | 69 ++++++++++++++++++++++++++++++++++++--------------- 1 file changed, 49 insertions(+), 20 deletions(-) --- a/kernel/events/core.c +++ b/kernel/events/core.c @@ -1454,10 +1454,11 @@ static void put_ctx(struct perf_event_co * perf_event_context::mutex * perf_event::child_mutex; * perf_event_context::lock - * mmap_lock - * perf_event::mmap_mutex - * perf_buffer::aux_mutex - * perf_addr_filters_head::lock + * perf_addr_filters_head::lock + * mmap_lock + * perf_event::mmap_mutex + * perf_buffer::aux_mutex + * perf_addr_filters_head::lock * * cpu_hotplug_lock * pmus_lock @@ -2429,7 +2430,7 @@ static void perf_child_detach(struct per lockdep_assert_held(&parent_event->child_mutex); */ - list_del_init(&event->child_list); + list_del_rcu(&event->child_list); } static bool is_orphaned_event(struct perf_event *event) @@ -9902,35 +9903,64 @@ static bool perf_addr_filter_vma_adjust( return true; } -static void __perf_addr_filters_adjust(struct perf_event *event, void *data) +static int perf_child_addr_filters_adjust(struct perf_event *event, + struct vm_area_struct *vma) { struct perf_addr_filters_head *ifh = perf_event_addr_filters(event); - struct vm_area_struct *vma = data; - struct perf_addr_filter *filter; unsigned int restart = 0, count = 0; - unsigned long flags; - - if (!has_addr_filter(event)) - return; + struct perf_addr_filter *filter; - if (!vma->vm_file) - return; + guard(raw_spinlock)(&ifh->lock); - raw_spin_lock_irqsave(&ifh->lock, flags); list_for_each_entry(filter, &ifh->list, entry) { if (perf_addr_filter_vma_adjust(filter, vma, &event->addr_filter_ranges[count])) restart++; count++; + } if (restart) event->addr_filters_gen++; - raw_spin_unlock_irqrestore(&ifh->lock, flags); - if (restart) - perf_event_stop(event, 1); + return restart; +} + +static void __perf_addr_filters_adjust(struct perf_event *event, void *data) +{ + struct perf_event *child, *parent = event->parent ?: event; + struct vm_area_struct *vma = data; + + if (!has_addr_filter(event)) + return; + + if (!vma->vm_file) + return; + + list_for_each_entry_rcu(child, &parent->child_list, child_list) { + struct perf_event_context *ctx; + struct task_struct *task; + int restart = 0; + +again: + ctx = READ_ONCE(child->ctx); + scoped_guard (raw_spinlock_irqsave, &ctx->lock) { + if (child->ctx != ctx) + goto again; + + task = ctx->task; + if (!task || task == TASK_TOMBSTONE) + continue; + + if (vma->vm_mm != task->mm) + continue; + + restart = perf_child_addr_filters_adjust(child, vma); + } + if (restart) + perf_event_stop(child, 1); + } } /* @@ -9947,11 +9977,10 @@ static void perf_addr_filters_adjust(str if (!(vma->vm_flags & VM_EXEC)) return; - rcu_read_lock(); + guard(rcu)(); ctx = rcu_dereference(current->perf_event_ctxp); if (ctx) perf_iterate_ctx(ctx, __perf_addr_filters_adjust, vma, true); - rcu_read_unlock(); } void perf_event_mmap(struct vm_area_struct *vma)