From: Simon Glass <sjg@chromium.org>
To: Chen-Yu Tsai <wenst@chromium.org>
Cc: linux-arm-kernel@lists.infradead.org,
"Thomas Weißschuh" <thomas.weissschuh@linutronix.de>,
"Masahiro Yamada" <masahiroy@kernel.org>,
"Tom Rini" <trini@konsulko.com>,
"Ahmad Fatoum" <a.fatoum@pengutronix.de>,
"J . Neuschäfer" <j.ne@posteo.net>,
"Nicolas Schier" <nicolas@fjasle.eu>,
"David Sterba" <dsterba@suse.com>,
"Nick Terrell" <terrelln@fb.com>,
linux-kernel@vger.kernel.org
Subject: Re: [PATCH v6 7/8] scripts/make_fit: Support a few more parallel compressors
Date: Thu, 11 Dec 2025 06:29:28 -0700 [thread overview]
Message-ID: <CAFLszThEu4j+Fcxm4VYYVTtqf-9Yp_OnEKes0sD+TACkoHuhbQ@mail.gmail.com> (raw)
In-Reply-To: <CAGXv+5HiV7EE9CNPRT5EbL8AM8n68Ac1r-=esQL5dgaPDKPTWQ@mail.gmail.com>
Hi Chen-Yu,
On Tue, 2 Dec 2025 at 03:18, Chen-Yu Tsai <wenst@chromium.org> wrote:
>
> On Thu, Nov 20, 2025 at 2:14 AM Simon Glass <sjg@chromium.org> wrote:
> >
> > Add support for pbzip2 and plzip which can compress in parallel. This
> > speeds up the ramdisk compression.
> >
> > Signed-off-by: Simon Glass <sjg@chromium.org>
> > ---
> >
> > (no changes since v1)
> >
> > scripts/make_fit.py | 11 ++++++++---
> > 1 file changed, 8 insertions(+), 3 deletions(-)
> >
> > diff --git a/scripts/make_fit.py b/scripts/make_fit.py
> > index 9dfef11fc4b3..64038f17a51e 100755
> > --- a/scripts/make_fit.py
> > +++ b/scripts/make_fit.py
> > @@ -57,10 +57,10 @@ import libfdt
> > CompTool = collections.namedtuple('CompTool', 'ext,tools')
> >
> > COMP_TOOLS = {
> > - 'bzip2': CompTool('.bz2', 'bzip2'),
> > + 'bzip2': CompTool('.bz2', 'pbzip2,bzip2'),
> > 'gzip': CompTool('.gz', 'pigz,gzip'),
> > 'lz4': CompTool('.lz4', 'lz4'),
> > - 'lzma': CompTool('.lzma', 'lzma'),
> > + 'lzma': CompTool('.lzma', 'plzip,lzma'),
> > 'lzo': CompTool('.lzo', 'lzop'),
> > 'zstd': CompTool('.zstd', 'zstd'),
> > }
> > @@ -220,7 +220,12 @@ def compress_data(inf, compress):
> > done = False
> > for tool in comp.tools.split(','):
> > try:
> > - subprocess.call([tool, '-c'], stdin=inf, stdout=outf)
> > + # Add parallel flags for tools that support them
> > + cmd = [tool]
> > + if tool in ('zstd', 'xz'):
>
> There's no 'xz' tool in the list though.
>
> And this hunk isn't mentioned or explained in the commit message.
OK I will update it.
>
> > + cmd.extend(['-T0']) # Use all available cores
>
> Zero is already the default for 'xz' in 5.8.1.
My system is fairly up-to-date (Noble) and I have:
xz -V
xz (XZ Utils) 5.4.5
liblzma 5.4.5
Does the new version reject -T0 ? If not, then I think it is best to
provide it in this script.
>
>
> ChenYu
>
> > + cmd.append('-c')
> > + subprocess.call(cmd, stdin=inf, stdout=outf)
> > done = True
> > break
> > except FileNotFoundError:
> > --
> > 2.43.0
> >
Regards,
Simon
next prev parent reply other threads:[~2025-12-11 13:29 UTC|newest]
Thread overview: 29+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-11-19 18:13 [PATCH v6 0/8] scripts/make_fit: Support ramdisks and faster operations Simon Glass
2025-11-19 18:13 ` [PATCH v6 1/8] scripts/make_fit: Speed up operation Simon Glass
2025-11-26 9:24 ` Ahmad Fatoum
2025-12-02 10:28 ` Chen-Yu Tsai
2025-11-19 18:13 ` [PATCH v6 2/8] scripts/make_fit: Support an initial ramdisk Simon Glass
2025-11-26 10:56 ` Ahmad Fatoum
2025-11-19 18:13 ` [PATCH v6 3/8] scripts/make_fit: Move dtb processing into a function Simon Glass
2025-11-26 11:01 ` Ahmad Fatoum
2025-12-02 10:54 ` Chen-Yu Tsai
2025-11-19 18:13 ` [PATCH v6 4/8] scripts/make_fit: Provide a way to add built modules Simon Glass
2025-11-26 11:09 ` Ahmad Fatoum
2025-12-11 13:20 ` Simon Glass
2025-11-19 18:13 ` [PATCH v6 5/8] kbuild: Split out module targets into a variable Simon Glass
2025-11-19 20:20 ` Nicolas Schier
2025-11-26 11:10 ` Ahmad Fatoum
2025-11-19 18:13 ` [PATCH v6 6/8] kbuild: Allow adding modules into the FIT ramdisk Simon Glass
2025-11-19 20:20 ` Nicolas Schier
2025-11-20 7:49 ` Thomas Weißschuh
2025-11-20 20:09 ` Nicolas Schier
2025-11-25 21:58 ` Simon Glass
2025-11-26 7:16 ` Thomas Weißschuh
2025-11-26 11:26 ` Ahmad Fatoum
2025-12-02 10:31 ` Thomas Weißschuh
2025-12-11 13:31 ` Simon Glass
2025-12-11 13:49 ` Ahmad Fatoum
2025-11-19 18:13 ` [PATCH v6 7/8] scripts/make_fit: Support a few more parallel compressors Simon Glass
2025-12-02 10:17 ` Chen-Yu Tsai
2025-12-11 13:29 ` Simon Glass [this message]
2025-11-19 18:13 ` [PATCH v6 8/8] scripts/make_fit: Compress dtbs in parallel Simon Glass
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAFLszThEu4j+Fcxm4VYYVTtqf-9Yp_OnEKes0sD+TACkoHuhbQ@mail.gmail.com \
--to=sjg@chromium.org \
--cc=a.fatoum@pengutronix.de \
--cc=dsterba@suse.com \
--cc=j.ne@posteo.net \
--cc=linux-arm-kernel@lists.infradead.org \
--cc=linux-kernel@vger.kernel.org \
--cc=masahiroy@kernel.org \
--cc=nicolas@fjasle.eu \
--cc=terrelln@fb.com \
--cc=thomas.weissschuh@linutronix.de \
--cc=trini@konsulko.com \
--cc=wenst@chromium.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).