From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id A4F17C88E72 for ; Thu, 17 Sep 2026 14:33:21 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=D0myfJBz2MfQcgKu1dmt5nR3F34vszgp8AhPQtbHn5s=; b=hhXoaULihTTEwv efoaQt9FH8wNZP5htCfFcleGm8Z5IFrZBOy1Up1ONnY29CwF3VcTwfbtsPvI39ICzUS4OQ7lQK4y8 QwZpd7n2IsvMu7AWIYQCcfW8XVLNcSZT/cMHDHyR1qsbCjAEIhunu/jGJFTH0c51KzyPZIxKb6UwJ uLRgkM05oNKJTN7TlSfomrAmbxHkHy0vjj/cYUMcSTk0Gi32qShJESlTWhYX96kUv8IGA7QsJe6E8 0MuhJL+Oz/5DENW2iEvChzadxfZB77PL7PG7Qbinubg3EYkjrYIx5hsZstGb/WZMfrSGuyNjvuXAp f1FbnKkHaZsN8j6cxvDw==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.99.1 #2 (Red Hat Linux)) id 1x7DAk-0000000BY3b-0B41; Thu, 17 Sep 2026 14:33:10 +0000 Received: from tor.source.kernel.org ([2600:3c04:e001:324:0:1991:8:25]) by bombadil.infradead.org with esmtps (Exim 4.99.1 #2 (Red Hat Linux)) id 1x7DAh-0000000BY3J-15mN; Thu, 17 Sep 2026 14:33:07 +0000 Received: from smtp.kernel.org (quasi.space.kernel.org [100.103.45.18]) by tor.source.kernel.org (Postfix) with ESMTP id A194D60204; Thu, 17 Sep 2026 14:33:06 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id A9F561F000FF; Thu, 17 Sep 2026 14:32:53 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel.org; s=k20260515; t=1789655586; bh=I2ExORUgMX+BoF88CQ1iPiIm+UZCCdszdxXlk48uD6I=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=h4w3XnKm6CpCBPP6zxny3WxSdq5eHBOnoxot5LhCUHJeGcoeuU7IaQSIAvaInWz8g oHRzCzcN2u5rXZnA8BwBN5B5MY03vwci3WigqJqDc1kf6T86OrB4ddM/4HDTZZQWoV MP2s55Oe1E1FrVud9JJWXPXpFBCgyVUhIsI7VkIlePqbXJN52WONNSdUfXggIJ9j0N U5i9lY0iDsScv6yl2/amtlJJYtlYjnw9GuXokt+SVh3xhwljkgeUCImquvwQHO3LCD gu2VPG0CaGQHuN2mxx+azKf+oE90lG4FG0Nkd1LvBYZbZPRFv6nU4BhGP3iIyXfp05 vN8bbHIolSSrQ== Date: Thu, 17 Sep 2026 15:32:50 +0100 From: "Lorenzo Stoakes (ARM)" To: Kees Cook Cc: Arnd Bergmann , Linus Torvalds , Nathan Chancellor , Nicolas Schier , Nick Desaulniers , Bill Wendling , Justin Stitt , Masahiro Yamada , Alexey Gladkov , Thomas Gleixner , Ingo Molnar , Borislav Petkov , Dave Hansen , x86@kernel.org, "H. Peter Anvin" , Paul Walmsley , Palmer Dabbelt , Albert Ou , Alexandre Ghiti , Catalin Marinas , Will Deacon , Mark Rutland , Ard Biesheuvel , Ilias Apalodimas , Josh Poimboeuf , Peter Zijlstra , Miguel Ojeda , Boqun Feng , Gary Guo , =?utf-8?B?QmrDtnJu?= Roy Baron , Benno Lossin , Andreas Hindborg , Alice Ryhl , Trevor Gross , Danilo Krummrich , Daniel Almeida , Tamir Duberstein , Alexandre Courbot , Onur =?utf-8?B?w5Z6a2Fu?= , Jonathan Corbet , Randy Dunlap , "Gustavo A. R. Silva" , linux-kbuild@vger.kernel.org, linux-kernel@vger.kernel.org, llvm@lists.linux.dev, linux-riscv@lists.infradead.org, Linux-Arch , linux-arm-kernel@lists.infradead.org, linux-efi@vger.kernel.org, rust-for-linux@vger.kernel.org, linux-doc@vger.kernel.org, Jens Axboe , linux-hardening@vger.kernel.org Subject: Re: [PATCH v2 21/21] kbuild: use pigz for gzip compression if available Message-ID: References: <20260914-build-speedup-v2-0-39817ec5db23@kernel.org> <20260914-build-speedup-v2-21-39817ec5db23@kernel.org> <202609151758.BA5732348@keescook> <081b2b60-e295-4cd7-b201-d996a88c5f28@app.fastmail.com> <202609160809.78E97DC34F@keescook> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <202609160809.78E97DC34F@keescook> X-BeenThere: linux-riscv@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-riscv" Errors-To: linux-riscv-bounces+linux-riscv=archiver.kernel.org@lists.infradead.org On Wed, Sep 16, 2026 at 08:27:09AM -0700, Kees Cook wrote: > On Wed, Sep 16, 2026 at 08:38:33AM +0200, Arnd Bergmann wrote: > > On Wed, Sep 16, 2026, at 03:06, Kees Cook wrote: > > > On Mon, Sep 14, 2026 at 10:22:20AM +0100, Lorenzo Stoakes (ARM) wrote: > > > > > > Makefile: > > > > > > KPGZIP := $(if $(shell command -v pigz 2>/dev/null),$(PYTHON3) > > > $(abs_srctree)/scripts/jobserver-exec > > > $(abs_srctree)/scripts/parallel-gzip,gzip) > > > > > > and the same scripts/parallel-gzip: > > > > > > #!/bin/sh > > > exec pigz -p ${PARALLELISM:-1} "$@" > > > > > > And then replace the /boot/ KGZIP uses with KPGZIP. Then we don't need > > > to change modules, config_data, new users, nor cmd_gzip, etc, which all > > > continue to use the regular KGZIP and the "use python" part for the > > > KPGZIP case becomes is a 1-time cost? > > > > Nice, I like the idea and this this will work. I didn't know about > > scripts/jobserver-exec, but this does seem like a perfect fit. > > > > I checked the other compression tools we support, and found that > > zstd is another one that has built-in support for parallel > > compression, so we probably want to have it there as well. > > Follow-up idea: > > Having to make a dedicated wrapper script to use jobserver-exec is a bit > clunky, so maybe the ergonomics need to be improved there slightly? > Maybe we can add a simple template thingy to > tools/lib/python/jobserver.py's "run" to replace, say, '%PARALLELISM%' > automatically, then it becomes: > > KPGZIP := $(if $(shell command -v pigz 2>/dev/null),$(PYTHON3) \ > $(abs_srctree)/scripts/jobserver-exec \ > pigz -p %PARALLELISM% Nice, that seems like a good little cleanup will fold that in, do some checks then send the v3 out soon :) > > -Kees > > -- > Kees Cook -- Cheers, Lorenzo _______________________________________________ linux-riscv mailing list linux-riscv@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-riscv