From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 8867CFF885C for ; Sat, 25 Apr 2026 22:41:48 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender:List-Subscribe:List-Help :List-Post:List-Archive:List-Unsubscribe:List-Id:Content-Type:Cc:To:From: Subject:Message-ID:References:Mime-Version:In-Reply-To:Date:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Owner; bh=Cgg9pxOBDT4Y06vN8qjxLVQi04KtOHQGog1xFmbU/gs=; b=LQqbM9jf42Sj9IDD0VuTOTPUUB Ec2m2WwnlHnU2xOs4FH6bdFCnkJXUTA5QDOjkZSqC2S1LeKGVJrg5JBbU7nS1TFjMK+UjnzxdVjem YvNkPBcsEzJxPtidx9rU5nD55r0lv6VphQn29OrKi44TsdvBaDhYp0TOag5UNFELy/XAjOBx8gbnu L2UM+iiQaKu0/gfFm9A4VtPncTdXjYJHzbq+mNEwzT/BZfXVXrore1ZCmD4FIl+uWtuo6SVr4jfN1 DUkXcqw3G604gxuZgsyods/F070WN5P2kWdhQ7UUabkSYfn8+khdk3CENm0/Vz0c7gwqq4aenuTIZ L5Xo++Zw==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.98.2 #2 (Red Hat Linux)) id 1wGlgs-0000000Esif-34XC; Sat, 25 Apr 2026 22:41:34 +0000 Received: from mail-dy1-x1349.google.com ([2607:f8b0:4864:20::1349]) by bombadil.infradead.org with esmtps (Exim 4.98.2 #2 (Red Hat Linux)) id 1wGlgp-0000000Esi3-2wVG for linux-arm-kernel@lists.infradead.org; Sat, 25 Apr 2026 22:41:33 +0000 Received: by mail-dy1-x1349.google.com with SMTP id 5a478bee46e88-2cc75e79b97so24536005eec.1 for ; Sat, 25 Apr 2026 15:41:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20251104; t=1777156890; x=1777761690; darn=lists.infradead.org; h=cc:to:from:subject:message-id:references:mime-version:in-reply-to :date:from:to:cc:subject:date:message-id:reply-to; bh=Cgg9pxOBDT4Y06vN8qjxLVQi04KtOHQGog1xFmbU/gs=; b=P2EKeSAX8nIKXO8aN/dQ+clF7Rv6E7RawsVeSnk+Krr/Sbf4/Wtb1XjUYNaVWe+yBV diKTlF/7b8VzTQWiEObT0MuswaNpQ+5a/1GxuvVZuMumRKzGC2P3kWtVBMx8IbQIykhl AR2+Q03kpJKKXA+1vHHBzBzkno3VwrjD/FPt17vDg+4RfjiqixK5soluvAXvWRZJFbTJ Ps/dFmK9saAsbUfyH6Xl19ydupcxHGWBT20bP1Skm9rqvpspVDOEDUO2XCOF0JMEt0FY siIv75REmbk+g3LwddHyKVgnP+OF3uaFn3/PuWeYWBqHNH06GgzKt9vua493UkOcsq7c aUdQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1777156890; x=1777761690; h=cc:to:from:subject:message-id:references:mime-version:in-reply-to :date:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=Cgg9pxOBDT4Y06vN8qjxLVQi04KtOHQGog1xFmbU/gs=; b=hesNZtF0Bm1RrcAZOATkQoAPRy3Ix9nDYap2ejYnrGvS4WJEd9s1VhfxO+KJDB4W2D sOCMm9/HdTpPHrl/XvcTFXEfgGVJ5ZB7HLZfn9pPvlWLF1Yds0dT2OWHRBYRpiMTVZ91 qeqsi3PZcz7oUL/8mWaztgPy5r+4g4Iitdyy/ogaPtEKPsezGHTYu/na5EpP7x5Y/tGL 602e4R+8BWgjOKZ6cHlVmQLZCcJlhBiS2Sk7rz7u31m4nv5JAqplOeRLz+M4d57TeQJ5 ywBCKFuJAY6SPHwnOXOJm1ZlbAV2imtGEwUtKDKMP3vm6Y5IrtJZ0iRJVw3L7soco5JP 35vw== X-Forwarded-Encrypted: i=1; AFNElJ83dVi5xmbNJvaMDkoqRi//SG7JQIgsEf+RM+qP4IAR/tswArO3CFlCh53EgeON6nt4KlGYNHV5V/LVIBo+Z3lk@lists.infradead.org X-Gm-Message-State: AOJu0YwzLSMlboQMz7uqakuHijched8R8B9+39/TcMWZx+4IbH8aq+15 GRxJvxtaQpGUbumfBlAWi8gHCRoo9RPsRQfq4ci/HYroj/vIVbaMfvPv8JPbipuhC8BoXL9zRN7 n/VDhTjIylQ== X-Received: from dyz11.prod.google.com ([2002:a05:693c:408b:b0:2d9:912f:7ec1]) (user=irogers job=prod-delivery.src-stubby-dispatcher) by 2002:a05:7300:fd18:b0:2ce:3aa1:d39b with SMTP id 5a478bee46e88-2e4790144a1mr20046325eec.20.1777156889946; Sat, 25 Apr 2026 15:41:29 -0700 (PDT) Date: Sat, 25 Apr 2026 15:40:25 -0700 In-Reply-To: <20260425174858.3922152-1-irogers@google.com> Mime-Version: 1.0 References: <20260425174858.3922152-1-irogers@google.com> X-Mailer: git-send-email 2.54.0.545.g6539524ca2-goog Message-ID: <20260425224125.160890-1-irogers@google.com> Subject: [PATCH v7 00/59] perf: Reorganize scripting support From: Ian Rogers To: acme@kernel.org, adrian.hunter@intel.com, james.clark@linaro.org, leo.yan@linux.dev, namhyung@kernel.org, tmricht@linux.ibm.com Cc: alice.mei.rogers@gmail.com, dapeng1.mi@linux.intel.com, linux-arm-kernel@lists.infradead.org, linux-kernel@vger.kernel.org, linux-perf-users@vger.kernel.org, mingo@redhat.com, peterz@infradead.org, Ian Rogers Content-Type: text/plain; charset="UTF-8" X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20260425_154131_802949_1BCC8AA4 X-CRM114-Status: GOOD ( 21.02 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org The perf script command has long supported running Python and Perl scripts by embedding libpython and libperl. This approach has several drawbacks: - overhead by creating Python dictionaries for every event (whether used or not), - complex build dependencies on specific Python/Perl versions, - complications with threading due to perf being the interpreter, - no clear way to run standalone scripts like ilist.py. This series takes a different approach with some initial implementation posted as an RFC last October: https://lore.kernel.org/linux-perf-users/20251029053413.355154-1-irogers@google.com/ with the motivation coming up on the mailing list earlier: https://lore.kernel.org/lkml/CAP-5=fWDqE8SYfOLZkg_0=4Ayx6E7O+h7uUp4NDeCFkiN4b7-w@mail.gmail.com/ The changes remove the embedded libpython and libperl support from perf entirely. Instead, they expand the existing perf Python module to provide full access to perf data files and events, allowing scripts to be run as standalone Python applications. To demonstrate the benefits, we ported all existing Python and Perl scripts to use the new Python session API. The performance improvement is dramatic. For example, porting mem-phys-addr.py: Before (using embedded libpython in perf script): ``` $ perf mem record a sleep 1 $ time perf script tools/perf/scripts/python/mem-phys-addr.py Event: cpu_core/mem-loads-aux/ Memory type count percentage --------------------------------------- ---------- ---------- 0-fff : Reserved 3217 100.0 real 0m3.754s user 0m0.023s sys 0m0.018s ``` After (using standalone Python script with perf module): ``` $ PYTHONPATH=/tmp/perf/python time python3 tools/perf/python/mem-phys-addr.py Event: evsel(cpu_core/mem-loads-aux/) Memory type count percentage --------------------------------------- ---------- ---------- 0-fff : Reserved 3217 100.0 real 0m0.106s user 0m0.021s sys 0m0.020s ``` This is a roughly 35x speedup! The change is large (11291 insertions, 15964 deletions, net 4673 deletions) due to porting all existing perl and python code to the new API. Gemini was used to achieve this and to improve the code quality. Removing support may be controversial, however, the first 52 patches are additive and merging those would allow us to focus on the remaining 6 patches that finalize the new perf script behavior. --- v7 Changes ---------- - Fixed heap out-of-bounds in `pyrf_event__new` by adding comprehensive size checks for all event types. - Fixed undefined symbol `syscalltbl__id` when building without libtraceevent by making `syscalltbl.o` unconditional in `Build`. - Fixed several issues in `python.c`: - Handled NULL return from `thread__comm_str` in `pyrf_thread__comm`. - Avoided swallowing exceptions in module initialization. - Added custom `tp_new` methods for `evlist`, `evsel`, and `data` types to zero-initialize pointers and avoid crashes on re-initialization. - Fixed lower priority review comments: - Avoided permanent iterator exhaustion on `brstack` in `perf_brstack_max.py` by converting it to a list. - Removed dead code (unused `self.unhandled` dictionary) in `failed-syscalls-by-pid.py`. v6 Changes ---------- - Refactored `pyrf_event__new` to take `evsel` and `session` arguments, and use dynamic allocation based on the actual event size to improve memory safety and efficiency. - Moved callchain and branch stack resolution logic from `pyrf_session_tool__sample` into `pyrf_event__new`, centralizing initialization. - Added an optional keyword-only `elf_machine` argument to `syscall_name` and `syscall_id` functions to allow specifying non-host architectures, defaulting to `EM_HOST`. - Renamed `process` method to `find_thread` in the Python API and C implementation for better intention-revealing naming. - Fixed a terminal injection vulnerability in `flamegraph.py` by not printing unverified downloaded content in the prompt. - Fixed CWD exposure and symlink attack risks in `gecko.py` by using a secure temporary directory for the HTTP server. - Fixed a severe performance issue in `event_analyzing_sample.py` by removing SQLite autocommit mode and batching commits. - Fixed `AttributeError` crashes in `rw-by-file.py` and `rw-by-pid.py` by correctly extracting event names. - Fixed man page formatting issues in `perf-script-python.txt` by using indented code blocks. - Updated `perf.pyi` stubs file to reflect all API changes. - Verified all commit messages with `checkpatch.pl` and ensured lines are wrapped appropriately. - Fixed segmentation faults in `perf sched stats` in diff mode. v5 Changes ---------- Resending due to partial send of v4 due to a quota limit. v4 Changes ---------- 1. Git Fixup Cleanups - Squashed the lingering `fixup!` commit remaining from the previous session back into `perf check-perf-trace: Port check-perf-trace to use python module`. v3 Changes ---------- 1. Memory Safety & Reference Counting Fixes - Stored transient mmap event data inside the Python object's permanent `pevent->event` and invoked `evsel__parse_sample()` to safely point attributes into it, resolving Use-After-Free vulnerabilities. - Nullified `sample->evsel` after calling `evsel__put()` in `perf_sample__exit()` to protect against potential refcount double-put crashes in error paths. - Reordered operations inside `evlist__remove()` to invoke `perf_evlist__remove()` before reference release. - Patched an `evsel` reference leak inside `evlist__deliver_deferred_callchain()`. 2. Sashiko AI Review Cleanups - Corrected the broken event name equality check in `gecko.py` to search for a substring match within the parsed event string. - Fixed a latent `AttributeError` crash in `task-analyzer.py` by properly assigning the session instance. - Safeguarded thread reporting in `check-perf-trace.py` by utilizing `sample_tid` instead of `sample_pid`, and wrapping the session thread resolution in a try-except block. 3. Omitted Minor Issues - The minor review comments (such as permanent iterator exhaustion on `brstack`, or dead-code in `failed-syscalls-by-pid.py`) have been omitted because they do not affect correctness, lead to crashes, or require significant architectural rework. v2 Changes ---------- 1. String Match and Event Name Accuracy - Replaced loose substring event matching across the script suite with exact matches or specific prefix constraints (syscalls:sys_exit_, evsel(skb:kfree_skb), etc.). - Added getattr() safety checks to prevent script failures caused by unresolved attributes from older kernel traces. 2. OOM and Memory Protections - Refactored netdev-times.py to compute and process network statistics chronologically on-the-fly, eliminating an unbounded in-memory list that caused Out-Of-Memory crashes on large files. - Implemented threshold limits on intel-pt-events.py to cap memory allocation during event interleaving. - Optimized export-to-sqlite.py to periodically commit database transactions (every 10,000 samples) to reduce temporary SQLite journal sizes. 3. Portability & Environment Independence - Re-keyed internal tracking dictionaries in scripts like powerpc-hcalls.py to use thread PIDs instead of CPUs, ensuring correctness when threads migrate. - Switched net_dropmonitor.py from host-specific /proc/kallsyms parsing to perf's built-in symbol resolution API. - Added the --iomem parameter to mem-phys-addr.py to support offline analysis of data collected on different architectures. 4. Standalone Scripting Improvements - Patched builtin-script.c to ensure --input parameters are successfully passed down to standalone execution pipelines via execvp(). - Guarded against string buffer overflows during .py extension path resolving. 5. Code Cleanups - Removed stale perl subdirectories from being detected by the TUI script browser. - Ran the entire script suite through mypy and pylint to achieve strict static type checking and resolve unreferenced variables. Ian Rogers (59): perf inject: Fix itrace branch stack synthesis perf arch arm: Sort includes and add missed explicit dependencies perf arch x86: Sort includes and add missed explicit dependencies perf tests: Sort includes and add missed explicit dependencies perf script: Sort includes and add missed explicit dependencies perf util: Sort includes and add missed explicit dependencies perf python: Add missed explicit dependencies perf evsel/evlist: Avoid unnecessary #includes perf data: Add open flag perf evlist: Add reference count perf evsel: Add reference count perf evlist: Add reference count checking perf python: Use evsel in sample in pyrf_event perf python: Add wrapper for perf_data file abstraction perf python: Add python session abstraction wrapping perf's session perf python: Add syscall name/id to convert syscall number and name perf python: Refactor and add accessors to sample event perf python: Add callchain support perf python: Add config file access perf python: Extend API for stat events in python.c perf python: Expose brstack in sample event perf python: Add perf.pyi stubs file perf python: Add LiveSession helper perf python: Move exported-sql-viewer.py and parallel-perf.py to tools/perf/python/ perf stat-cpi: Port stat-cpi to use python module perf mem-phys-addr: Port mem-phys-addr to use python module perf syscall-counts: Port syscall-counts to use python module perf syscall-counts-by-pid: Port syscall-counts-by-pid to use python module perf futex-contention: Port futex-contention to use python module perf flamegraph: Port flamegraph to use python module perf gecko: Port gecko to use python module perf arm-cs-trace-disasm: Port arm-cs-trace-disasm to use python module perf check-perf-trace: Port check-perf-trace to use python module perf compaction-times: Port compaction-times to use python module perf event_analyzing_sample: Port event_analyzing_sample to use python module perf export-to-sqlite: Port export-to-sqlite to use python module perf export-to-postgresql: Port export-to-postgresql to use python module perf failed-syscalls-by-pid: Port failed-syscalls-by-pid to use python module perf intel-pt-events: Port intel-pt-events/libxed to use python module perf net_dropmonitor: Port net_dropmonitor to use python module perf netdev-times: Port netdev-times to use python module perf powerpc-hcalls: Port powerpc-hcalls to use python module perf sched-migration: Port sched-migration/SchedGui to use python module perf sctop: Port sctop to use python module perf stackcollapse: Port stackcollapse to use python module perf task-analyzer: Port task-analyzer to use python module perf failed-syscalls: Port failed-syscalls to use python module perf rw-by-file: Port rw-by-file to use python module perf rw-by-pid: Port rw-by-pid to use python module perf rwtop: Port rwtop to use python module perf wakeup-latency: Port wakeup-latency to use python module perf test: Migrate Intel PT virtual LBR test to use Python API perf: Remove libperl support, legacy Perl scripts and tests perf: Remove libpython support and legacy Python scripts perf Makefile: Update Python script installation path perf script: Refactor to support standalone scripts and remove legacy features perf Documentation: Update for standalone Python scripts and remove obsolete data perf python: Improve perf script -l descriptions perf sched stats: Fix segmentation faults in diff mode tools/build/Makefile.feature | 5 +- tools/build/feature/Makefile | 23 +- tools/build/feature/test-all.c | 6 +- tools/build/feature/test-libperl.c | 10 - tools/build/feature/test-libpython.c | 10 - tools/build/feature/test-python-module.c | 12 + tools/perf/Documentation/perf-check.txt | 2 - tools/perf/Documentation/perf-script-perl.txt | 216 -- .../perf/Documentation/perf-script-python.txt | 713 +----- tools/perf/Documentation/perf-script.txt | 70 +- tools/perf/Makefile.config | 37 +- tools/perf/Makefile.perf | 22 +- tools/perf/arch/arm/util/cs-etm.c | 36 +- tools/perf/arch/arm64/util/arm-spe.c | 8 +- tools/perf/arch/arm64/util/hisi-ptt.c | 2 +- tools/perf/arch/x86/tests/hybrid.c | 22 +- tools/perf/arch/x86/tests/topdown.c | 2 +- tools/perf/arch/x86/util/auxtrace.c | 2 +- tools/perf/arch/x86/util/intel-bts.c | 26 +- tools/perf/arch/x86/util/intel-pt.c | 38 +- tools/perf/arch/x86/util/iostat.c | 8 +- tools/perf/bench/evlist-open-close.c | 29 +- tools/perf/bench/inject-buildid.c | 9 +- tools/perf/builtin-annotate.c | 2 +- tools/perf/builtin-check.c | 3 +- tools/perf/builtin-ftrace.c | 14 +- tools/perf/builtin-inject.c | 81 +- tools/perf/builtin-kvm.c | 14 +- tools/perf/builtin-kwork.c | 8 +- tools/perf/builtin-lock.c | 2 +- tools/perf/builtin-record.c | 95 +- tools/perf/builtin-report.c | 6 +- tools/perf/builtin-sched.c | 111 +- tools/perf/builtin-script.c | 895 +++---- tools/perf/builtin-stat.c | 81 +- tools/perf/builtin-top.c | 104 +- tools/perf/builtin-trace.c | 60 +- tools/perf/python/SchedGui.py | 219 ++ tools/perf/python/arm-cs-trace-disasm.py | 338 +++ tools/perf/python/check-perf-trace.py | 113 + tools/perf/python/compaction-times.py | 326 +++ tools/perf/python/counting.py | 1 + tools/perf/python/event_analyzing_sample.py | 297 +++ tools/perf/python/export-to-postgresql.py | 701 ++++++ tools/perf/python/export-to-sqlite.py | 372 +++ .../python/exported-sql-viewer.py | 6 +- tools/perf/python/failed-syscalls-by-pid.py | 116 + tools/perf/python/failed-syscalls.py | 78 + tools/perf/python/flamegraph.py | 250 ++ tools/perf/python/futex-contention.py | 87 + tools/perf/python/gecko.py | 385 +++ tools/perf/python/intel-pt-events.py | 435 ++++ tools/perf/python/libxed.py | 122 + .../{scripts => }/python/mem-phys-addr.py | 66 +- tools/perf/python/net_dropmonitor.py | 58 + tools/perf/python/netdev-times.py | 472 ++++ .../{scripts => }/python/parallel-perf.py | 0 tools/perf/python/perf.pyi | 581 +++++ tools/perf/python/perf_live.py | 48 + tools/perf/python/powerpc-hcalls.py | 211 ++ tools/perf/python/rw-by-file.py | 103 + tools/perf/python/rw-by-pid.py | 158 ++ tools/perf/python/rwtop.py | 219 ++ tools/perf/python/sched-migration.py | 469 ++++ tools/perf/python/sctop.py | 186 ++ tools/perf/python/stackcollapse.py | 126 + tools/perf/python/stat-cpi.py | 151 ++ tools/perf/python/syscall-counts-by-pid.py | 88 + tools/perf/python/syscall-counts.py | 72 + tools/perf/python/task-analyzer.py | 547 ++++ tools/perf/python/tracepoint.py | 1 + tools/perf/python/twatch.py | 1 + tools/perf/python/wakeup-latency.py | 88 + tools/perf/scripts/Build | 4 - tools/perf/scripts/perl/Perf-Trace-Util/Build | 9 - .../scripts/perl/Perf-Trace-Util/Context.c | 122 - .../scripts/perl/Perf-Trace-Util/Context.xs | 42 - .../scripts/perl/Perf-Trace-Util/Makefile.PL | 18 - .../perf/scripts/perl/Perf-Trace-Util/README | 59 - .../Perf-Trace-Util/lib/Perf/Trace/Context.pm | 55 - .../Perf-Trace-Util/lib/Perf/Trace/Core.pm | 192 -- .../Perf-Trace-Util/lib/Perf/Trace/Util.pm | 94 - .../perf/scripts/perl/Perf-Trace-Util/typemap | 1 - .../scripts/perl/bin/check-perf-trace-record | 2 - .../scripts/perl/bin/failed-syscalls-record | 3 - .../scripts/perl/bin/failed-syscalls-report | 10 - tools/perf/scripts/perl/bin/rw-by-file-record | 3 - tools/perf/scripts/perl/bin/rw-by-file-report | 10 - tools/perf/scripts/perl/bin/rw-by-pid-record | 2 - tools/perf/scripts/perl/bin/rw-by-pid-report | 3 - tools/perf/scripts/perl/bin/rwtop-record | 2 - tools/perf/scripts/perl/bin/rwtop-report | 20 - .../scripts/perl/bin/wakeup-latency-record | 6 - .../scripts/perl/bin/wakeup-latency-report | 3 - tools/perf/scripts/perl/check-perf-trace.pl | 106 - tools/perf/scripts/perl/failed-syscalls.pl | 47 - tools/perf/scripts/perl/rw-by-file.pl | 106 - tools/perf/scripts/perl/rw-by-pid.pl | 184 -- tools/perf/scripts/perl/rwtop.pl | 203 -- tools/perf/scripts/perl/wakeup-latency.pl | 107 - .../perf/scripts/python/Perf-Trace-Util/Build | 4 - .../scripts/python/Perf-Trace-Util/Context.c | 225 -- .../Perf-Trace-Util/lib/Perf/Trace/Core.py | 116 - .../lib/Perf/Trace/EventClass.py | 97 - .../lib/Perf/Trace/SchedGui.py | 184 -- .../Perf-Trace-Util/lib/Perf/Trace/Util.py | 92 - .../scripts/python/arm-cs-trace-disasm.py | 355 --- .../python/bin/compaction-times-record | 2 - .../python/bin/compaction-times-report | 4 - .../python/bin/event_analyzing_sample-record | 8 - .../python/bin/event_analyzing_sample-report | 3 - .../python/bin/export-to-postgresql-record | 8 - .../python/bin/export-to-postgresql-report | 29 - .../python/bin/export-to-sqlite-record | 8 - .../python/bin/export-to-sqlite-report | 29 - .../python/bin/failed-syscalls-by-pid-record | 3 - .../python/bin/failed-syscalls-by-pid-report | 10 - .../perf/scripts/python/bin/flamegraph-record | 2 - .../perf/scripts/python/bin/flamegraph-report | 3 - .../python/bin/futex-contention-record | 2 - .../python/bin/futex-contention-report | 4 - tools/perf/scripts/python/bin/gecko-record | 2 - tools/perf/scripts/python/bin/gecko-report | 7 - .../scripts/python/bin/intel-pt-events-record | 13 - .../scripts/python/bin/intel-pt-events-report | 3 - .../scripts/python/bin/mem-phys-addr-record | 19 - .../scripts/python/bin/mem-phys-addr-report | 3 - .../scripts/python/bin/net_dropmonitor-record | 2 - .../scripts/python/bin/net_dropmonitor-report | 4 - .../scripts/python/bin/netdev-times-record | 8 - .../scripts/python/bin/netdev-times-report | 5 - .../scripts/python/bin/powerpc-hcalls-record | 2 - .../scripts/python/bin/powerpc-hcalls-report | 2 - .../scripts/python/bin/sched-migration-record | 2 - .../scripts/python/bin/sched-migration-report | 3 - tools/perf/scripts/python/bin/sctop-record | 3 - tools/perf/scripts/python/bin/sctop-report | 24 - .../scripts/python/bin/stackcollapse-record | 8 - .../scripts/python/bin/stackcollapse-report | 3 - .../python/bin/syscall-counts-by-pid-record | 3 - .../python/bin/syscall-counts-by-pid-report | 10 - .../scripts/python/bin/syscall-counts-record | 3 - .../scripts/python/bin/syscall-counts-report | 10 - .../scripts/python/bin/task-analyzer-record | 2 - .../scripts/python/bin/task-analyzer-report | 3 - tools/perf/scripts/python/check-perf-trace.py | 84 - tools/perf/scripts/python/compaction-times.py | 311 --- .../scripts/python/event_analyzing_sample.py | 192 -- .../scripts/python/export-to-postgresql.py | 1114 --------- tools/perf/scripts/python/export-to-sqlite.py | 799 ------ .../scripts/python/failed-syscalls-by-pid.py | 79 - tools/perf/scripts/python/flamegraph.py | 267 -- tools/perf/scripts/python/futex-contention.py | 57 - tools/perf/scripts/python/gecko.py | 395 --- tools/perf/scripts/python/intel-pt-events.py | 494 ---- tools/perf/scripts/python/libxed.py | 107 - tools/perf/scripts/python/net_dropmonitor.py | 78 - tools/perf/scripts/python/netdev-times.py | 473 ---- tools/perf/scripts/python/powerpc-hcalls.py | 202 -- tools/perf/scripts/python/sched-migration.py | 462 ---- tools/perf/scripts/python/sctop.py | 89 - tools/perf/scripts/python/stackcollapse.py | 127 - tools/perf/scripts/python/stat-cpi.py | 79 - .../scripts/python/syscall-counts-by-pid.py | 75 - tools/perf/scripts/python/syscall-counts.py | 65 - tools/perf/scripts/python/task-analyzer.py | 934 ------- tools/perf/tests/backward-ring-buffer.c | 26 +- tools/perf/tests/code-reading.c | 14 +- tools/perf/tests/dlfilter-test.c | 8 +- tools/perf/tests/event-times.c | 6 +- tools/perf/tests/event_update.c | 4 +- tools/perf/tests/evsel-roundtrip-name.c | 8 +- tools/perf/tests/evsel-tp-sched.c | 4 +- tools/perf/tests/expand-cgroup.c | 12 +- tools/perf/tests/hists_cumulate.c | 2 +- tools/perf/tests/hists_filter.c | 2 +- tools/perf/tests/hists_link.c | 2 +- tools/perf/tests/hists_output.c | 2 +- tools/perf/tests/hwmon_pmu.c | 21 +- tools/perf/tests/keep-tracking.c | 10 +- tools/perf/tests/make | 9 +- tools/perf/tests/mmap-basic.c | 42 +- tools/perf/tests/openat-syscall-all-cpus.c | 6 +- tools/perf/tests/openat-syscall-tp-fields.c | 26 +- tools/perf/tests/openat-syscall.c | 6 +- tools/perf/tests/parse-events.c | 139 +- tools/perf/tests/parse-metric.c | 8 +- tools/perf/tests/parse-no-sample-id-all.c | 2 +- tools/perf/tests/perf-record.c | 38 +- tools/perf/tests/perf-time-to-tsc.c | 12 +- tools/perf/tests/pfm.c | 12 +- tools/perf/tests/pmu-events.c | 11 +- tools/perf/tests/pmu.c | 4 +- tools/perf/tests/sample-parsing.c | 39 +- .../perf/tests/shell/lib/perf_brstack_max.py | 43 + tools/perf/tests/shell/script.sh | 4 +- tools/perf/tests/shell/script_perl.sh | 102 - tools/perf/tests/shell/script_python.sh | 113 - .../tests/shell/test_arm_coresight_disasm.sh | 12 +- tools/perf/tests/shell/test_intel_pt.sh | 35 +- tools/perf/tests/shell/test_task_analyzer.sh | 79 +- tools/perf/tests/sw-clock.c | 20 +- tools/perf/tests/switch-tracking.c | 10 +- tools/perf/tests/task-exit.c | 20 +- tools/perf/tests/time-utils-test.c | 14 +- tools/perf/tests/tool_pmu.c | 7 +- tools/perf/tests/topology.c | 4 +- tools/perf/ui/browsers/annotate.c | 2 +- tools/perf/ui/browsers/hists.c | 22 +- tools/perf/ui/browsers/scripts.c | 21 +- tools/perf/util/Build | 3 +- tools/perf/util/amd-sample-raw.c | 2 +- tools/perf/util/annotate-data.c | 2 +- tools/perf/util/annotate.c | 10 +- tools/perf/util/arm-spe.c | 7 +- tools/perf/util/auxtrace.c | 14 +- tools/perf/util/block-info.c | 4 +- tools/perf/util/bpf_counter.c | 2 +- tools/perf/util/bpf_counter_cgroup.c | 10 +- tools/perf/util/bpf_ftrace.c | 9 +- tools/perf/util/bpf_lock_contention.c | 12 +- tools/perf/util/bpf_off_cpu.c | 44 +- tools/perf/util/bpf_trace_augment.c | 8 +- tools/perf/util/cgroup.c | 26 +- tools/perf/util/cs-etm.c | 6 +- tools/perf/util/data-convert-bt.c | 2 +- tools/perf/util/data.c | 26 +- tools/perf/util/data.h | 4 +- tools/perf/util/evlist.c | 487 ++-- tools/perf/util/evlist.h | 273 +- tools/perf/util/evsel.c | 109 +- tools/perf/util/evsel.h | 35 +- tools/perf/util/expr.c | 2 +- tools/perf/util/header.c | 51 +- tools/perf/util/header.h | 2 +- tools/perf/util/intel-bts.c | 3 +- tools/perf/util/intel-pt.c | 13 +- tools/perf/util/intel-tpebs.c | 7 +- tools/perf/util/map.h | 9 +- tools/perf/util/metricgroup.c | 12 +- tools/perf/util/parse-events.c | 10 +- tools/perf/util/parse-events.y | 2 +- tools/perf/util/perf_api_probe.c | 20 +- tools/perf/util/pfm.c | 4 +- tools/perf/util/print-events.c | 2 +- tools/perf/util/print_insn.h | 5 +- tools/perf/util/python.c | 2098 ++++++++++++++-- tools/perf/util/record.c | 11 +- tools/perf/util/s390-sample-raw.c | 19 +- tools/perf/util/sample-raw.c | 4 +- tools/perf/util/sample.c | 17 +- tools/perf/util/scripting-engines/Build | 9 - .../util/scripting-engines/trace-event-perl.c | 773 ------ .../scripting-engines/trace-event-python.c | 2209 ----------------- tools/perf/util/session.c | 59 +- tools/perf/util/sideband_evlist.c | 40 +- tools/perf/util/sort.c | 2 +- tools/perf/util/stat-display.c | 6 +- tools/perf/util/stat-shadow.c | 24 +- tools/perf/util/stat.c | 20 +- tools/perf/util/stream.c | 4 +- tools/perf/util/synthetic-events.c | 36 +- tools/perf/util/synthetic-events.h | 6 +- tools/perf/util/time-utils.c | 12 +- tools/perf/util/top.c | 4 +- tools/perf/util/trace-event-parse.c | 65 - tools/perf/util/trace-event-scripting.c | 410 --- tools/perf/util/trace-event.h | 75 +- 268 files changed, 11592 insertions(+), 16034 deletions(-) delete mode 100644 tools/build/feature/test-libperl.c delete mode 100644 tools/build/feature/test-libpython.c create mode 100644 tools/build/feature/test-python-module.c delete mode 100644 tools/perf/Documentation/perf-script-perl.txt create mode 100755 tools/perf/python/SchedGui.py create mode 100755 tools/perf/python/arm-cs-trace-disasm.py create mode 100755 tools/perf/python/check-perf-trace.py create mode 100755 tools/perf/python/compaction-times.py create mode 100755 tools/perf/python/event_analyzing_sample.py create mode 100755 tools/perf/python/export-to-postgresql.py create mode 100755 tools/perf/python/export-to-sqlite.py rename tools/perf/{scripts => }/python/exported-sql-viewer.py (99%) create mode 100755 tools/perf/python/failed-syscalls-by-pid.py create mode 100755 tools/perf/python/failed-syscalls.py create mode 100755 tools/perf/python/flamegraph.py create mode 100755 tools/perf/python/futex-contention.py create mode 100755 tools/perf/python/gecko.py create mode 100755 tools/perf/python/intel-pt-events.py create mode 100755 tools/perf/python/libxed.py rename tools/perf/{scripts => }/python/mem-phys-addr.py (73%) mode change 100644 => 100755 create mode 100755 tools/perf/python/net_dropmonitor.py create mode 100755 tools/perf/python/netdev-times.py rename tools/perf/{scripts => }/python/parallel-perf.py (100%) create mode 100644 tools/perf/python/perf.pyi create mode 100755 tools/perf/python/perf_live.py create mode 100755 tools/perf/python/powerpc-hcalls.py create mode 100755 tools/perf/python/rw-by-file.py create mode 100755 tools/perf/python/rw-by-pid.py create mode 100755 tools/perf/python/rwtop.py create mode 100755 tools/perf/python/sched-migration.py create mode 100755 tools/perf/python/sctop.py create mode 100755 tools/perf/python/stackcollapse.py create mode 100755 tools/perf/python/stat-cpi.py create mode 100755 tools/perf/python/syscall-counts-by-pid.py create mode 100755 tools/perf/python/syscall-counts.py create mode 100755 tools/perf/python/task-analyzer.py create mode 100755 tools/perf/python/wakeup-latency.py delete mode 100644 tools/perf/scripts/perl/Perf-Trace-Util/Build delete mode 100644 tools/perf/scripts/perl/Perf-Trace-Util/Context.c delete mode 100644 tools/perf/scripts/perl/Perf-Trace-Util/Context.xs delete mode 100644 tools/perf/scripts/perl/Perf-Trace-Util/Makefile.PL delete mode 100644 tools/perf/scripts/perl/Perf-Trace-Util/README delete mode 100644 tools/perf/scripts/perl/Perf-Trace-Util/lib/Perf/Trace/Context.pm delete mode 100644 tools/perf/scripts/perl/Perf-Trace-Util/lib/Perf/Trace/Core.pm delete mode 100644 tools/perf/scripts/perl/Perf-Trace-Util/lib/Perf/Trace/Util.pm delete mode 100644 tools/perf/scripts/perl/Perf-Trace-Util/typemap delete mode 100644 tools/perf/scripts/perl/bin/check-perf-trace-record delete mode 100644 tools/perf/scripts/perl/bin/failed-syscalls-record delete mode 100644 tools/perf/scripts/perl/bin/failed-syscalls-report delete mode 100644 tools/perf/scripts/perl/bin/rw-by-file-record delete mode 100644 tools/perf/scripts/perl/bin/rw-by-file-report delete mode 100644 tools/perf/scripts/perl/bin/rw-by-pid-record delete mode 100644 tools/perf/scripts/perl/bin/rw-by-pid-report delete mode 100644 tools/perf/scripts/perl/bin/rwtop-record delete mode 100644 tools/perf/scripts/perl/bin/rwtop-report delete mode 100644 tools/perf/scripts/perl/bin/wakeup-latency-record delete mode 100644 tools/perf/scripts/perl/bin/wakeup-latency-report delete mode 100644 tools/perf/scripts/perl/check-perf-trace.pl delete mode 100644 tools/perf/scripts/perl/failed-syscalls.pl delete mode 100644 tools/perf/scripts/perl/rw-by-file.pl delete mode 100644 tools/perf/scripts/perl/rw-by-pid.pl delete mode 100644 tools/perf/scripts/perl/rwtop.pl delete mode 100644 tools/perf/scripts/perl/wakeup-latency.pl delete mode 100644 tools/perf/scripts/python/Perf-Trace-Util/Build delete mode 100644 tools/perf/scripts/python/Perf-Trace-Util/Context.c delete mode 100644 tools/perf/scripts/python/Perf-Trace-Util/lib/Perf/Trace/Core.py delete mode 100755 tools/perf/scripts/python/Perf-Trace-Util/lib/Perf/Trace/EventClass.py delete mode 100644 tools/perf/scripts/python/Perf-Trace-Util/lib/Perf/Trace/SchedGui.py delete mode 100644 tools/perf/scripts/python/Perf-Trace-Util/lib/Perf/Trace/Util.py delete mode 100755 tools/perf/scripts/python/arm-cs-trace-disasm.py delete mode 100644 tools/perf/scripts/python/bin/compaction-times-record delete mode 100644 tools/perf/scripts/python/bin/compaction-times-report delete mode 100644 tools/perf/scripts/python/bin/event_analyzing_sample-record delete mode 100644 tools/perf/scripts/python/bin/event_analyzing_sample-report delete mode 100644 tools/perf/scripts/python/bin/export-to-postgresql-record delete mode 100644 tools/perf/scripts/python/bin/export-to-postgresql-report delete mode 100644 tools/perf/scripts/python/bin/export-to-sqlite-record delete mode 100644 tools/perf/scripts/python/bin/export-to-sqlite-report delete mode 100644 tools/perf/scripts/python/bin/failed-syscalls-by-pid-record delete mode 100644 tools/perf/scripts/python/bin/failed-syscalls-by-pid-report delete mode 100755 tools/perf/scripts/python/bin/flamegraph-record delete mode 100755 tools/perf/scripts/python/bin/flamegraph-report delete mode 100644 tools/perf/scripts/python/bin/futex-contention-record delete mode 100644 tools/perf/scripts/python/bin/futex-contention-report delete mode 100644 tools/perf/scripts/python/bin/gecko-record delete mode 100755 tools/perf/scripts/python/bin/gecko-report delete mode 100644 tools/perf/scripts/python/bin/intel-pt-events-record delete mode 100644 tools/perf/scripts/python/bin/intel-pt-events-report delete mode 100644 tools/perf/scripts/python/bin/mem-phys-addr-record delete mode 100644 tools/perf/scripts/python/bin/mem-phys-addr-report delete mode 100755 tools/perf/scripts/python/bin/net_dropmonitor-record delete mode 100755 tools/perf/scripts/python/bin/net_dropmonitor-report delete mode 100644 tools/perf/scripts/python/bin/netdev-times-record delete mode 100644 tools/perf/scripts/python/bin/netdev-times-report delete mode 100644 tools/perf/scripts/python/bin/powerpc-hcalls-record delete mode 100644 tools/perf/scripts/python/bin/powerpc-hcalls-report delete mode 100644 tools/perf/scripts/python/bin/sched-migration-record delete mode 100644 tools/perf/scripts/python/bin/sched-migration-report delete mode 100644 tools/perf/scripts/python/bin/sctop-record delete mode 100644 tools/perf/scripts/python/bin/sctop-report delete mode 100755 tools/perf/scripts/python/bin/stackcollapse-record delete mode 100755 tools/perf/scripts/python/bin/stackcollapse-report delete mode 100644 tools/perf/scripts/python/bin/syscall-counts-by-pid-record delete mode 100644 tools/perf/scripts/python/bin/syscall-counts-by-pid-report delete mode 100644 tools/perf/scripts/python/bin/syscall-counts-record delete mode 100644 tools/perf/scripts/python/bin/syscall-counts-report delete mode 100755 tools/perf/scripts/python/bin/task-analyzer-record delete mode 100755 tools/perf/scripts/python/bin/task-analyzer-report delete mode 100644 tools/perf/scripts/python/check-perf-trace.py delete mode 100644 tools/perf/scripts/python/compaction-times.py delete mode 100644 tools/perf/scripts/python/event_analyzing_sample.py delete mode 100644 tools/perf/scripts/python/export-to-postgresql.py delete mode 100644 tools/perf/scripts/python/export-to-sqlite.py delete mode 100644 tools/perf/scripts/python/failed-syscalls-by-pid.py delete mode 100755 tools/perf/scripts/python/flamegraph.py delete mode 100644 tools/perf/scripts/python/futex-contention.py delete mode 100644 tools/perf/scripts/python/gecko.py delete mode 100644 tools/perf/scripts/python/intel-pt-events.py delete mode 100644 tools/perf/scripts/python/libxed.py delete mode 100755 tools/perf/scripts/python/net_dropmonitor.py delete mode 100644 tools/perf/scripts/python/netdev-times.py delete mode 100644 tools/perf/scripts/python/powerpc-hcalls.py delete mode 100644 tools/perf/scripts/python/sched-migration.py delete mode 100644 tools/perf/scripts/python/sctop.py delete mode 100755 tools/perf/scripts/python/stackcollapse.py delete mode 100644 tools/perf/scripts/python/stat-cpi.py delete mode 100644 tools/perf/scripts/python/syscall-counts-by-pid.py delete mode 100644 tools/perf/scripts/python/syscall-counts.py delete mode 100755 tools/perf/scripts/python/task-analyzer.py create mode 100644 tools/perf/tests/shell/lib/perf_brstack_max.py delete mode 100755 tools/perf/tests/shell/script_perl.sh delete mode 100755 tools/perf/tests/shell/script_python.sh delete mode 100644 tools/perf/util/scripting-engines/Build delete mode 100644 tools/perf/util/scripting-engines/trace-event-perl.c delete mode 100644 tools/perf/util/scripting-engines/trace-event-python.c delete mode 100644 tools/perf/util/trace-event-scripting.c -- 2.54.0.545.g6539524ca2-goog