From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-pg1-f170.google.com (mail-pg1-f170.google.com [209.85.215.170]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id AAD982E6CA0 for ; Fri, 12 Sep 2025 10:12:51 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.215.170 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1757671974; cv=none; b=V9rLWIeX1PBfLxXcXd3Pli1EF74SLx9nZmjKwb1K93/tLJJIgzx8zeuKjOZ3enrm+/VKvi/xsm4yiCzpBw55EMLNYsmbjVgAYwREpZrYzPGM/zXYfg2u5PL1wt+SsXOELgnJsGoztiiQzf0uQsLZwMT8o00LeAbFyFuvNBzSqvY= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1757671974; c=relaxed/simple; bh=a5HXFEXCxWNRHDDVyZZfIidS3SNN062TjXO3sF8vxcw=; h=From:To:Cc:Subject:Date:Message-ID:In-Reply-To:References: MIME-Version; b=I7BCmBpWxV4sALlJgRAfp8va0D6E+6m+MhStdyn0GfZZ0b8tG7p+r7UryQgAmY4VQ0j62cx7g1F7eKGpSHflAFN8vmdoNeIU6OPavBCAkYcTW9tpvTezll/dN78H5vY0Mqll9Gf5mjo7bcn4lVFP84stayR1yJZ1xh4SoyRUGdM= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b=NvBdPD36; arc=none smtp.client-ip=209.85.215.170 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="NvBdPD36" Received: by mail-pg1-f170.google.com with SMTP id 41be03b00d2f7-b54b55c6eabso21907a12.2 for ; Fri, 12 Sep 2025 03:12:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1757671971; x=1758276771; darn=lists.linux.dev; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=bEzQtMPq9PK+5+yYtP/oNug9OWMsSiZGEa798p9Mz9w=; b=NvBdPD36EWHn4u0kiV3rlHNZZK4KeyK+DZ7WvQISS7+bHLErWGAToRPAfCLIcueHDh cWQ2uE5VT/CwCsPkxkLoqCh+7KtIAEQZX3a/jLu7u0UjdttqXLJ06pTT5nXd4gUuipDB hvZkqxY1BrcGZa1UbzdpM/RDaeLjVDujbuQoqXvmjhymk6HExmKLChhQJeQC5Z8CblWQ FQuHbTtM9WH85Fqcge4OJC/PcCdlYmNu+v357iztIDwIKa7Q2GRQGyhknj7FLE0CaLxW La6OwHZS3DIIs3mRMdkJu1wxvCvsZH9MOIXuwBx0VK8flhnmYNqtfjzIr3v4eaX6WMM4 /M/A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1757671971; x=1758276771; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=bEzQtMPq9PK+5+yYtP/oNug9OWMsSiZGEa798p9Mz9w=; b=FUO0Gk1VDxXi3ZDOxHJT4fpBn/8j5yzDdXu0p6BJzT4rVEb9Eo9W00oR8DNiiiZe/d 8+besaKc6q3YG0DHTqNyoWCUYlHRyFVMtS2ehdGrXyXrxQ+chDBkaDhFtvCQeUkMgvsN LM8cZzqAucDEfQSA1ZtmptU3DsAF9GH9TBw14hXufbrdSlvKUND/roaGIy0UzzKjocpz HeGU3rj8e1suLnhRYycoflliidCixIoNt0FO5GVkOCBy5feURJloieSFopn4jNUSY9br QBGDv9NTRok34seoWGmVfe+GNgUo2gSin8If2GsN8JmUiq3GrScy73y6u9ia2ahlMhjH 4vRQ== X-Forwarded-Encrypted: i=1; AJvYcCXLvjJF1b1L+0IvcmXcAtMDEgtZxlsCc6HO+TPC5t/UCfD0Aaho5bnOGuezhxwR2bMCHWRB@lists.linux.dev X-Gm-Message-State: AOJu0Ywvy+mWukSFexSjDIgJGJUPqXoJ8dP+AyS5tRV5Mn7WG/A5tS2D 8kKOE8eLxBcCWBESN7n2b49nMHxjZPG0IuehX5tgs2j/43UIx3Umn6jq X-Gm-Gg: ASbGncsAl7jSJzfM/k8/ONqkSWGCqJ1/PMNHF4aMNr7uIhbOnNdjBXzfIQktZo+SaK1 RGtMs45g388XROKf9s6dsf4ydjuGFZ6ue2AHpvVkh6kBC0urhQZ779NmblGRPauNlh/oyXpk9vi /efjnB8enNy9uQAM2p4pb7Vp11g3o4c4Zuh7eHMfybBCht3dp1DMCDL4vvbdFkXj36EG6qexcXW EZgVgBxZ+uOkRHwpp2VcwsfQznU9e0UallJ9qORp+3n7aNXAaEsclMuf55GM21zmPqIAhvsHFj3 VdBMudKe2p+pWfABjt0xJXQLbGm0FZMaToV7qrf4nLhagt2EEChKu7qZU4bXBg9McCARQjKs7mX e86v4RFInTgEivctK3nAtqXXiIpngtDD7WjtgcZROkNOIRvkNBjFipzjYlz+X X-Google-Smtp-Source: AGHT+IFjzeds5aG6Wb+p60MOU157xCW/uyAMBkC8kYhjKV3VQWNhWnO7RA/JWobHVFlYljAoloxrVg== X-Received: by 2002:a17:902:d490:b0:25c:18d:893 with SMTP id d9443c01a7336-25d24bb33f9mr25149495ad.22.1757671970918; Fri, 12 Sep 2025 03:12:50 -0700 (PDT) Received: from localhost ([185.49.34.62]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-25c37293f0asm45159835ad.43.2025.09.12.03.12.49 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 12 Sep 2025 03:12:50 -0700 (PDT) From: Jinchao Wang To: Andrew Morton , Masami Hiramatsu , Peter Zijlstra , Mike Rapoport , Alexander Potapenko , Jonathan Corbet , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , x86@kernel.org, "H. Peter Anvin" , Juri Lelli , Vincent Guittot , Dietmar Eggemann , Steven Rostedt , Ben Segall , Mel Gorman , Valentin Schneider , Arnaldo Carvalho de Melo , Namhyung Kim , Mark Rutland , Alexander Shishkin , Jiri Olsa , Ian Rogers , Adrian Hunter , "Liang, Kan" , David Hildenbrand , Lorenzo Stoakes , "Liam R. Howlett" , Vlastimil Babka , Suren Baghdasaryan , Michal Hocko , Nathan Chancellor , Nick Desaulniers , Bill Wendling , Justin Stitt , Kees Cook , Alice Ryhl , Sami Tolvanen , Miguel Ojeda , Masahiro Yamada , Rong Xu , Naveen N Rao , David Kaplan , Andrii Nakryiko , Jinjie Ruan , Nam Cao , workflows@vger.kernel.org, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, linux-perf-users@vger.kernel.org, linux-mm@kvack.org, llvm@lists.linux.dev, Andrey Ryabinin , Andrey Konovalov , Dmitry Vyukov , Vincenzo Frascino , kasan-dev@googlegroups.com, "David S. Miller" , Mathieu Desnoyers , linux-trace-kernel@vger.kernel.org Cc: Jinchao Wang Subject: [PATCH v4 11/21] mm/ksw: add probe management helpers Date: Fri, 12 Sep 2025 18:11:21 +0800 Message-ID: <20250912101145.465708-12-wangjinchao600@gmail.com> X-Mailer: git-send-email 2.43.0 In-Reply-To: <20250912101145.465708-1-wangjinchao600@gmail.com> References: <20250912101145.465708-1-wangjinchao600@gmail.com> Precedence: bulk X-Mailing-List: llvm@lists.linux.dev List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit Provide ksw_stack_init() and ksw_stack_exit() to manage entry and exit probes for the target function from ksw_get_config(). The entry/exit probe handlers use atomic ksw_stack_pid to ensure a singleton watch and current->kstackwatch_ctx.depth to track recursion depth. A watch is set up only when depth reaches the configured value. Signed-off-by: Jinchao Wang --- mm/kstackwatch/kstackwatch.h | 4 ++ mm/kstackwatch/stack.c | 113 +++++++++++++++++++++++++++++++++++ 2 files changed, 117 insertions(+) diff --git a/mm/kstackwatch/kstackwatch.h b/mm/kstackwatch/kstackwatch.h index 0786fa961011..5ea2db76cdfb 100644 --- a/mm/kstackwatch/kstackwatch.h +++ b/mm/kstackwatch/kstackwatch.h @@ -38,6 +38,10 @@ struct ksw_config { // singleton, only modified in kernel.c const struct ksw_config *ksw_get_config(void); +/* stack management */ +int ksw_stack_init(void); +void ksw_stack_exit(void); + /* watch management */ int ksw_watch_init(void); void ksw_watch_exit(void); diff --git a/mm/kstackwatch/stack.c b/mm/kstackwatch/stack.c index cec594032515..ac52a9f81486 100644 --- a/mm/kstackwatch/stack.c +++ b/mm/kstackwatch/stack.c @@ -1 +1,114 @@ // SPDX-License-Identifier: GPL-2.0 +#define pr_fmt(fmt) KBUILD_MODNAME ": " fmt + +#include +#include +#include +#include +#include + +#include "kstackwatch.h" + +static struct kprobe entry_probe; +static struct fprobe exit_probe; +#define INVALID_PID -1 +static atomic_t ksw_stack_pid = ATOMIC_INIT(INVALID_PID); + +static int ksw_stack_prepare_watch(struct pt_regs *regs, + const struct ksw_config *config, + ulong *watch_addr, u16 *watch_len) +{ + /* implement logic will be added in following patches */ + *watch_addr = 0; + *watch_len = 0; + return 0; +} + +static void ksw_stack_entry_handler(struct kprobe *p, struct pt_regs *regs, + unsigned long flags) +{ + struct kstackwatch_ctx *ctx = ¤t->kstackwatch_ctx; + ulong watch_addr; + u16 watch_len; + int ret; + + if (ctx->depth++ != ksw_get_config()->depth) + return; + + if (atomic_cmpxchg(&ksw_stack_pid, INVALID_PID, current->pid) != + INVALID_PID) + return; + + ret = ksw_stack_prepare_watch(regs, ksw_get_config(), &watch_addr, + &watch_len); + if (ret) { + atomic_set(&ksw_stack_pid, INVALID_PID); + pr_err("failed to prepare watch target: %d\n", ret); + return; + } + + ret = ksw_watch_on(watch_addr, watch_len); + if (ret) { + atomic_set(&ksw_stack_pid, INVALID_PID); + pr_err("failed to watch on depth:%d addr:0x%lx len:%u %d\n", + ksw_get_config()->depth, watch_addr, watch_len, ret); + return; + } + + ctx->watch_addr = watch_addr; + ctx->watch_len = watch_len; + ctx->watch_on = true; +} + +static void ksw_stack_exit_handler(struct fprobe *fp, unsigned long ip, + unsigned long ret_ip, + struct ftrace_regs *regs, void *data) +{ + struct kstackwatch_ctx *ctx = ¤t->kstackwatch_ctx; + + if (--ctx->depth != ksw_get_config()->depth) + return; + + if (atomic_read(&ksw_stack_pid) != current->pid) + return; + WARN_ON_ONCE(!ctx->watch_on); + WARN_ON_ONCE(ksw_watch_off(ctx->watch_addr, ctx->watch_len)); + ctx->watch_on = false; + + atomic_set(&ksw_stack_pid, INVALID_PID); +} + +int ksw_stack_init(void) +{ + int ret; + char *symbuf = NULL; + + memset(&entry_probe, 0, sizeof(entry_probe)); + entry_probe.symbol_name = ksw_get_config()->function; + entry_probe.offset = ksw_get_config()->ip_offset; + entry_probe.post_handler = ksw_stack_entry_handler; + ret = register_kprobe(&entry_probe); + if (ret) { + pr_err("Failed to register kprobe ret %d\n", ret); + return ret; + } + + memset(&exit_probe, 0, sizeof(exit_probe)); + exit_probe.exit_handler = ksw_stack_exit_handler; + symbuf = (char *)ksw_get_config()->function; + + ret = register_fprobe_syms(&exit_probe, (const char **)&symbuf, 1); + if (ret < 0) { + pr_err("register_fprobe_syms fail %d\n", ret); + unregister_kprobe(&entry_probe); + return ret; + } + + return 0; +} + +void ksw_stack_exit(void) +{ + unregister_fprobe(&exit_probe); + unregister_kprobe(&entry_probe); +} -- 2.43.0