From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 04C781EB5C2; Wed, 25 Jun 2025 06:05:58 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1750831559; cv=none; b=pe9D5+wP2C4nuNOJCT3GCS6X99iSS/fPlTXpJiYk4SZ09wF7g+mNQeuxSsdOXlk90uie6Maz/6mAJQfS8xWI+58ZahSpuD14UodrwZ0YT8/QtDlF++XpKbkt0BSSJtL36tT6sDVtHQ9GFsWdUlRrzhAbxaPChmd/ilEf8gsTlI4= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1750831559; c=relaxed/simple; bh=Q28EoRlCHxoMaNgGOkukCqmPjyIq/8jmbDgvCGiLJew=; h=Date:From:To:Cc:Subject:Message-Id:In-Reply-To:References: Mime-Version:Content-Type; b=FV4CVQ62lALDYATehd4J85um+2fWt4RR88oCmdExlwwvXRhGSZs4ou+OVL0DeS2tgHtvMIFogXfT/xBfYULR5RJkJy1ZNtcLLHTpCHiDvTTPQdtSeBlOfM7ETX79zPBYhuixWYhmVVZsl/zrHeon4W38YJcQgeF1+fwfbuLlDiU= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=DFa5ibB8; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="DFa5ibB8" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 23D90C4CEEE; Wed, 25 Jun 2025 06:05:56 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1750831558; bh=Q28EoRlCHxoMaNgGOkukCqmPjyIq/8jmbDgvCGiLJew=; h=Date:From:To:Cc:Subject:In-Reply-To:References:From; b=DFa5ibB8Ln+ZaEf5b2ISYENoa//luatjioX7AXXTUyOq4JdCpf6iXP+txHPyDNSn9 Vmj1Z4xrs6G7Q/SQtKCVMGo1QSAGT6m81iYdIJo/tz4evIQhLSHP3xDD6p3eON8lzQ VxBPRELlVZ0f9bk2v0/qXCIU+lsRGCkfvYCkGB45H1A8UsdueFrIOcwraDhaIZW8H1 zvZsNcyWc83jGmE/OIdnKqP254cDkmgB1VRBjnYkQLVgiTRjFL3NvYpShWbsJcSsrB XkigCbNiCzUlkO8QQOgcR3OI2ynAa1/VXsfHYdqBUcbwiXOlY0Ws1H6XSE0Q0qkZQS Sb1pd7cokohBg== Date: Wed, 25 Jun 2025 15:05:54 +0900 From: Masami Hiramatsu (Google) To: Jiri Olsa Cc: Peter Zijlstra , Oleg Nesterov , Andrii Nakryiko , Alejandro Colomar , Eyal Birger , kees@kernel.org, bpf@vger.kernel.org, linux-kernel@vger.kernel.org, linux-trace-kernel@vger.kernel.org, x86@kernel.org, Song Liu , Yonghong Song , John Fastabend , Hao Luo , Steven Rostedt , Alan Maguire , David Laight , Thomas =?UTF-8?B?V2Vpw59zY2h1aA==?= , Ingo Molnar Subject: Re: [PATCHv3 perf/core 00/22] uprobes: Add support to optimize usdt probes on x86_64 Message-Id: <20250625150554.e87f4231180082e4c0a86024@kernel.org> In-Reply-To: References: <20250605132350.1488129-1-jolsa@kernel.org> X-Mailer: Sylpheed 3.8.0beta1 (GTK+ 2.24.33; x86_64-pc-linux-gnu) Precedence: bulk X-Mailing-List: linux-trace-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Hi Jiri, Sorry I missed the series. Let me review it. I think it should go through x86 tree because this is targetting x86 code. Thanks, On Tue, 24 Jun 2025 10:36:29 +0200 Jiri Olsa wrote: > ping > > On Tue, Jun 17, 2025 at 03:08:08PM +0200, Jiri Olsa wrote: > > hi, ping > > > > thanks, > > jirka > > > > On Thu, Jun 05, 2025 at 03:23:27PM +0200, Jiri Olsa wrote: > > > hi, > > > this patchset adds support to optimize usdt probes on top of 5-byte > > > nop instruction. > > > > > > The generic approach (optimize all uprobes) is hard due to emulating > > > possible multiple original instructions and its related issues. The > > > usdt case, which stores 5-byte nop seems much easier, so starting > > > with that. > > > > > > The basic idea is to replace breakpoint exception with syscall which > > > is faster on x86_64. For more details please see changelog of patch 8. > > > > > > The run_bench_uprobes.sh benchmark triggers uprobe (on top of different > > > original instructions) in a loop and counts how many of those happened > > > per second (the unit below is million loops). > > > > > > There's big speed up if you consider current usdt implementation > > > (uprobe-nop) compared to proposed usdt (uprobe-nop5): > > > > > > current: > > > usermode-count : 152.501 ± 0.012M/s > > > syscall-count : 14.463 ± 0.062M/s > > > --> uprobe-nop : 3.160 ± 0.005M/s > > > uprobe-push : 3.003 ± 0.003M/s > > > uprobe-ret : 1.100 ± 0.003M/s > > > uprobe-nop5 : 3.132 ± 0.012M/s > > > uretprobe-nop : 2.103 ± 0.002M/s > > > uretprobe-push : 2.027 ± 0.004M/s > > > uretprobe-ret : 0.914 ± 0.002M/s > > > uretprobe-nop5 : 2.115 ± 0.002M/s > > > > > > after the change: > > > usermode-count : 152.343 ± 0.400M/s > > > syscall-count : 14.851 ± 0.033M/s > > > uprobe-nop : 3.204 ± 0.005M/s > > > uprobe-push : 3.040 ± 0.005M/s > > > uprobe-ret : 1.098 ± 0.003M/s > > > --> uprobe-nop5 : 7.286 ± 0.017M/s > > > uretprobe-nop : 2.144 ± 0.001M/s > > > uretprobe-push : 2.069 ± 0.002M/s > > > uretprobe-ret : 0.922 ± 0.000M/s > > > uretprobe-nop5 : 3.487 ± 0.001M/s > > > > > > I see bit more speed up on Intel (above) compared to AMD. The big nop5 > > > speed up is partly due to emulating nop5 and partly due to optimization. > > > > > > The key speed up we do this for is the USDT switch from nop to nop5: > > > uprobe-nop : 3.160 ± 0.005M/s > > > uprobe-nop5 : 7.286 ± 0.017M/s > > > > > > > > > Changes from v2: > > > - rebased on top of tip/master + mm/mm-stable + 1 extra change [1] > > > - added acks [Oleg,Andrii] > > > - more details changelog for patch 1 [Masami] > > > - several tests changes [Andrii] > > > - add explicit PAGE_SIZE low limit to vm_unmapped_area call [Andrii] > > > > > > > > > This patchset is adding new syscall, here are notes to check list items > > > in Documentation/process/adding-syscalls.rst: > > > > > > - System Call Alternatives > > > New syscall seems like the best way in here, because we need > > > just to quickly enter kernel with no extra arguments processing, > > > which we'd need to do if we decided to use another syscall. > > > > > > - Designing the API: Planning for Extension > > > The uprobe syscall is very specific and most likely won't be > > > extended in the future. > > > > > > - Designing the API: Other Considerations > > > N/A because uprobe syscall does not return reference to kernel > > > object. > > > > > > - Proposing the API > > > Wiring up of the uprobe system call is in separate change, > > > selftests and man page changes are part of the patchset. > > > > > > - Generic System Call Implementation > > > There's no CONFIG option for the new functionality because it > > > keeps the same behaviour from the user POV. > > > > > > - x86 System Call Implementation > > > It's 64-bit syscall only. > > > > > > - Compatibility System Calls (Generic) > > > N/A uprobe syscall has no arguments and is not supported > > > for compat processes. > > > > > > - Compatibility System Calls (x86) > > > N/A uprobe syscall is not supported for compat processes. > > > > > > - System Calls Returning Elsewhere > > > N/A. > > > > > > - Other Details > > > N/A. > > > > > > - Testing > > > Adding new bpf selftests. > > > > > > - Man Page > > > Attached. > > > > > > - Do not call System Calls in the Kernel > > > N/A > > > > > > pending todo (or follow ups): > > > - use PROCMAP_QUERY in tests > > > - alloc 'struct uprobes_state' for mm_struct only when needed [Andrii] > > > - use mm_cpumask(vma->vm_mm) in text_poke_sync > > > > > > thanks, > > > jirka > > > > > > > > > Cc: Alejandro Colomar > > > Cc: Eyal Birger > > > Cc: kees@kernel.org > > > > > > [1] https://lore.kernel.org/linux-trace-kernel/20250514101809.2010193-1-jolsa@kernel.org/T/#u > > > --- > > > Jiri Olsa (21): > > > uprobes: Remove breakpoint in unapply_uprobe under mmap_write_lock > > > uprobes: Rename arch_uretprobe_trampoline function > > > uprobes: Make copy_from_page global > > > uprobes: Add uprobe_write function > > > uprobes: Add nbytes argument to uprobe_write > > > uprobes: Add is_register argument to uprobe_write and uprobe_write_opcode > > > uprobes: Add do_ref_ctr argument to uprobe_write function > > > uprobes/x86: Add mapping for optimized uprobe trampolines > > > uprobes/x86: Add uprobe syscall to speed up uprobe > > > uprobes/x86: Add support to optimize uprobes > > > selftests/bpf: Import usdt.h from libbpf/usdt project > > > selftests/bpf: Reorg the uprobe_syscall test function > > > selftests/bpf: Rename uprobe_syscall_executed prog to test_uretprobe_multi > > > selftests/bpf: Add uprobe/usdt syscall tests > > > selftests/bpf: Add hit/attach/detach race optimized uprobe test > > > selftests/bpf: Add uprobe syscall sigill signal test > > > selftests/bpf: Add optimized usdt variant for basic usdt test > > > selftests/bpf: Add uprobe_regs_equal test > > > selftests/bpf: Change test_uretprobe_regs_change for uprobe and uretprobe > > > seccomp: passthrough uprobe systemcall without filtering > > > selftests/seccomp: validate uprobe syscall passes through seccomp > > > > > > arch/arm/probes/uprobes/core.c | 2 +- > > > arch/x86/entry/syscalls/syscall_64.tbl | 1 + > > > arch/x86/include/asm/uprobes.h | 7 ++ > > > arch/x86/kernel/uprobes.c | 525 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++- > > > include/linux/syscalls.h | 2 + > > > include/linux/uprobes.h | 20 +++- > > > kernel/events/uprobes.c | 100 ++++++++++++----- > > > kernel/fork.c | 1 + > > > kernel/seccomp.c | 32 ++++-- > > > kernel/sys_ni.c | 1 + > > > tools/testing/selftests/bpf/prog_tests/uprobe_syscall.c | 523 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++------ > > > tools/testing/selftests/bpf/prog_tests/usdt.c | 38 ++++--- > > > tools/testing/selftests/bpf/progs/uprobe_syscall.c | 4 +- > > > tools/testing/selftests/bpf/progs/uprobe_syscall_executed.c | 60 +++++++++- > > > tools/testing/selftests/bpf/test_kmods/bpf_testmod.c | 11 +- > > > tools/testing/selftests/bpf/usdt.h | 545 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++ > > > tools/testing/selftests/seccomp/seccomp_bpf.c | 107 ++++++++++++++---- > > > 17 files changed, 1867 insertions(+), 112 deletions(-) > > > create mode 100644 tools/testing/selftests/bpf/usdt.h > > > > > > > > > Jiri Olsa (1): > > > man2: Add uprobe syscall page > > > > > > man/man2/uprobe.2 | 1 + > > > man/man2/uretprobe.2 | 36 ++++++++++++++++++++++++------------ > > > 2 files changed, 25 insertions(+), 12 deletions(-) > > > create mode 100644 man/man2/uprobe.2 -- Masami Hiramatsu (Google)