From: Adrian Hunter <adrian.hunter@intel.com>
To: Ian Rogers <irogers@google.com>
Cc: Arnaldo Carvalho de Melo <acme@kernel.org>,
Jiri Olsa <jolsa@kernel.org>, Namhyung Kim <namhyung@kernel.org>,
Andi Kleen <ak@linux.intel.com>,
linux-kernel@vger.kernel.org, linux-perf-users@vger.kernel.org
Subject: Re: [PATCH V2] perf scripts python: Add a script to run instances of perf script in parallel
Date: Fri, 12 Apr 2024 09:07:50 +0300 [thread overview]
Message-ID: <3a238616-1fd0-4755-b7b7-fdc9c412fb03@intel.com> (raw)
In-Reply-To: <CAP-5=fW1bH8qQkD7LrO6_3fJ3NsqoW1GrX8=s-sfaTbrvk58+A@mail.gmail.com>
On 11/04/24 21:19, Ian Rogers wrote:
> On Wed, Mar 13, 2024 at 5:36 AM Adrian Hunter <adrian.hunter@intel.com> wrote:
>>
>> Add a Python script to run a perf script command multiple times in
>> parallel, using perf script options --cpu and --time so that each job
>> processes a different chunk of the data.
>>
>> The script supports the use of normal perf script options like
>> --dlfilter and --script, so that the benefit of running parallel jobs
>> naturally extends to them also. In addition, a command can be provided
>> (refer --pipe-to option) to pipe standard output to a custom command.
>>
>> Refer to the script's own help text at the end of the patch for more
>> details.
>>
>> The script is useful for Intel PT traces, that can be efficiently
>> decoded by perf script when split by CPU and/or time ranges. Running
>> jobs in parallel can decrease the overall decoding time.
>>
>> Signed-off-by: Adrian Hunter <adrian.hunter@intel.com>
>> ---
>>
>>
>> Changes in V2:
>>
>> Added option to pipe to a custom command
>> Added option to set a minimum time interval
>> Minor tidying
>>
>>
>> tools/perf/scripts/python/parallel-perf.py | 989 +++++++++++++++++++++
>> 1 file changed, 989 insertions(+)
>> create mode 100755 tools/perf/scripts/python/parallel-perf.py
>>
>> diff --git a/tools/perf/scripts/python/parallel-perf.py b/tools/perf/scripts/python/parallel-perf.py
>> new file mode 100755
>> index 000000000000..8fe398f81a42
>> --- /dev/null
>> +++ b/tools/perf/scripts/python/parallel-perf.py
>> @@ -0,0 +1,989 @@
>> +#!/usr/bin/env python3
>> +# SPDX-License-Identifier: GPL-2.0
>
> With the python summer of code proposal, that no-one applied to, I
> wanted to package things like a perf.data IO library in some public
> package index. As GPL 2 isn't permissive then we may need to
> reimplement this code because of this. Fwiw, my preference is
> GPL-2.0-only or BSD.
GPL-2.0 is GPL-2.0-only
next prev parent reply other threads:[~2024-04-12 6:08 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-03-13 12:36 [PATCH V2] perf scripts python: Add a script to run instances of perf script in parallel Adrian Hunter
2024-04-11 12:04 ` Adrian Hunter
2024-04-11 18:19 ` Ian Rogers
2024-04-12 6:07 ` Adrian Hunter [this message]
2024-04-23 13:40 ` Adrian Hunter
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=3a238616-1fd0-4755-b7b7-fdc9c412fb03@intel.com \
--to=adrian.hunter@intel.com \
--cc=acme@kernel.org \
--cc=ak@linux.intel.com \
--cc=irogers@google.com \
--cc=jolsa@kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-perf-users@vger.kernel.org \
--cc=namhyung@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox