From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from fout-a3-smtp.messagingengine.com (fout-a3-smtp.messagingengine.com [103.168.172.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id EE9FB387359; Wed, 16 Sep 2026 06:38:57 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=103.168.172.146 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1789540740; cv=none; b=m11oz6Tby2tcJT5hODgMGdcYZ6c62tbjRxzW6VkLJ2+HWj/nbQgSJ3d9pqiSNrM4qGbDALwH7oa9SJ4+/O0LRFTy2aCTjeP8ckVWT2qOm/2W3CbNMM7m4i86OoUmuEdaBz0CgexUabHEh7Ub+PcYHE+2fFOeZ0mUT2NFcfW4wmY= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1789540740; c=relaxed/simple; bh=iU6G2m+wrmWgfgn/0yBm7PYayX0WyU1SDB3L2Fyqpfs=; h=MIME-Version:Date:From:To:Cc:Message-Id:In-Reply-To:References: Subject:Content-Type; b=XKBlvbVIRYSRnXhH+Udpl4piM0eDFPxpB5WAG1Y+IXUJTbc3u9P/6Kjg5xEZsl50nHa7MD2jmw3OsQtNAz7KVVDgHbXop9g8wCE3+XUWW2ngEljXTCQnRGEnxO06vtD22+TZ1TO9QGUuJw8mrZylgrEScTlRUx7Ywc/RNqN0jdQ= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=arndb.de; spf=pass smtp.mailfrom=arndb.de; dkim=pass (2048-bit key) header.d=arndb.de header.i=@arndb.de header.b=WF8L+S0u; dkim=pass (2048-bit key) header.d=messagingengine.com header.i=@messagingengine.com header.b=i/DWAvvF; arc=none smtp.client-ip=103.168.172.146 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=arndb.de Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=arndb.de Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=arndb.de header.i=@arndb.de header.b="WF8L+S0u"; dkim=pass (2048-bit key) header.d=messagingengine.com header.i=@messagingengine.com header.b="i/DWAvvF" Received: from ams-compute-02.internal (ams-compute-02.internal [10.64.2.62]) by mailfout.phl.internal (Postfix) with ESMTP id 6CA02EC0E91; Wed, 16 Sep 2026 02:38:56 -0400 (EDT) Received: from ams-imap-03 ([10.64.2.23]) by ams-compute-02.internal (MEProxy); Wed, 16 Sep 2026 02:38:56 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=arndb.de; h=cc :cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm3; t=1789540736; x=1789627136; bh=uVDBK2xNAXhHDNCHOU+SjarglqFyyWlJ3wc704FVprE=; b= WF8L+S0ufzaPlWCsrRRscgGvgAxgZTFT+tJOeBIsio2KJN8+5FOYORwMwAkYdAOn WyeMCKtF8mm6kAVkl3ezLOHPn4sWcfrc3TtTlIAVkU4Z+lC7DeFfiJxi9WUYc98v xn6tB9DwYlFirjYuSyT2YIzx5LvmzTHXkA+Tyapwgr7/Ao1mghZIe0vXYCmEDt+7 lbXCembmc9Cb8C6tbXyDJura9NlgqslmfHKo1IyLcoHsYVSetjh24+avMUhllgSr /QXXceV15HR5ULX4gpX4QQSe1yHg1LCrqr7/SWm9qR8HbV1R5tsY/ZXsNjnvBHC8 S4t6xtOCNjXtUKAflg7x3w== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1789540736; x= 1789627136; bh=uVDBK2xNAXhHDNCHOU+SjarglqFyyWlJ3wc704FVprE=; b=i /DWAvvFomsvvHufwVst9thwX7fYCHQ2oKF0GOO8jVQBP9AOAWpiEWNiwy7iXoYuo GVSODLAIaKAd4VwPl8FFtJ2ISCnR54cx2cfornWk1fpfK2pqQ4EcpeLV33LsEcyH lO2bSNLqLWXa6BteDpaKhzFMCVZ9y+WDRf+yvcAYLUEqMf/AFnTSdlN9JQNgfuM4 uqbmAIzc+5ArvcKN/yNNUa7txHOX8ShOwyYSaUkecYH4MGoUW5iRatiT8nyxhwqw 9htHm5Uzj5D+MIx69PR0d6gDl2QXZ7oxN9e44hgjUmIuaD+YrUJ66oWoklLUOj/E wPxRgiFz8nPw3KhMU/yRA== X-ME-Sender: X-ME-Proxy-Cause: dmFkZTFo6N+eyntVtdIU1AxyJCq4N9vnDxbCRp4nPjWrobmdZ9js/OvMMkuzKPVwg4e0XZ KNa2/VrO5RBb0uLVonnkDz+3YlkFRo2YlsW3HfyBsnKAr33GeTytpiCOIwFe4kvaO8XuaF UZahZ2N+1OqfNlHSjPd9W6d33Sl8sxqQUeYQRHlRR/idMGQHnNnj0Rf4gT6Gta+IqwfyJ3 /YQm3d0DvEYCvlE32FAUIP+fXws4+CzyhhD5Rny9z3/OH94gPlFQ/V2WMT9+ntOdGffMjp 1pBjB47EOGmdkWcGuNXmLdWlkxeJllX456XEd1f4jRNfcVOiBdTto84ZiSgTK8DC/XcFra A5/RHA96DZHO48W9Zh+mbKakBgEHdZ6UNONXOjj0u3bcE81qxt2G8I19a35lqX9/a+JClc X1IWP2OeEplF0bcl/INad4jbwjFZlpjyQ6u543mAJdtEz8rXvUO8UPhgdhkI8fuy+IE866 hObaIc7Cbw+i5mS7TTL/cj3W0aLToECIbQhNbon1tNVqHBn48ZDsnUyY/hebBu9rEz6NEw 2ySakRM0UbA97qmfTNzUUadV+57wKRI2sOzxWZjVJvv4V9qZ0lmzUmnDZt0cRyCb3HvwlR B56SjiXOfV7HHm91yFsWFGbYK7K8PcEoM91m6HTdE2pK3aEw3swkohYrMYOQ X-ME-Proxy: Feedback-ID: i56a14606:Fastmail Received: by mailuser.ams.internal (Postfix, from userid 501) id EA77F32A0085; Wed, 16 Sep 2026 02:38:53 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface Precedence: bulk X-Mailing-List: linux-kbuild@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 X-ThreadId: ArHA-gVR6p-N Date: Wed, 16 Sep 2026 08:38:33 +0200 From: "Arnd Bergmann" To: "Kees Cook" , "Lorenzo Stoakes" Cc: "Linus Torvalds" , "Nathan Chancellor" , "Nicolas Schier" , "Nick Desaulniers" , "Bill Wendling" , "Justin Stitt" , "Masahiro Yamada" , "Alexey Gladkov" , "Thomas Gleixner" , "Ingo Molnar" , "Borislav Petkov" , "Dave Hansen" , x86@kernel.org, "H. Peter Anvin" , "Paul Walmsley" , "Palmer Dabbelt" , "Albert Ou" , "Alexandre Ghiti" , "Catalin Marinas" , "Will Deacon" , "Mark Rutland" , "Ard Biesheuvel" , "Ilias Apalodimas" , "Josh Poimboeuf" , "Peter Zijlstra" , "Miguel Ojeda" , "Boqun Feng" , "Gary Guo" , =?UTF-8?Q?Bj=C3=B6rn_Roy_Baron?= , "Benno Lossin" , "Andreas Hindborg" , "Alice Ryhl" , "Trevor Gross" , "Danilo Krummrich" , "Daniel Almeida" , "Tamir Duberstein" , "Alexandre Courbot" , =?UTF-8?Q?Onur_=C3=96zkan?= , "Jonathan Corbet" , "Randy Dunlap" , "Gustavo A. R. Silva" , linux-kbuild@vger.kernel.org, linux-kernel@vger.kernel.org, llvm@lists.linux.dev, linux-riscv@lists.infradead.org, Linux-Arch , linux-arm-kernel@lists.infradead.org, linux-efi@vger.kernel.org, rust-for-linux@vger.kernel.org, linux-doc@vger.kernel.org, "Jens Axboe" , linux-hardening@vger.kernel.org Message-Id: <081b2b60-e295-4cd7-b201-d996a88c5f28@app.fastmail.com> In-Reply-To: <202609151758.BA5732348@keescook> References: <20260914-build-speedup-v2-0-39817ec5db23@kernel.org> <20260914-build-speedup-v2-21-39817ec5db23@kernel.org> <202609151758.BA5732348@keescook> Subject: Re: [PATCH v2 21/21] kbuild: use pigz for gzip compression if available Content-Type: text/plain Content-Transfer-Encoding: 7bit On Wed, Sep 16, 2026, at 03:06, Kees Cook wrote: > On Mon, Sep 14, 2026 at 10:22:20AM +0100, Lorenzo Stoakes (ARM) wrote: > > Makefile: > > KPGZIP := $(if $(shell command -v pigz 2>/dev/null),$(PYTHON3) > $(abs_srctree)/scripts/jobserver-exec > $(abs_srctree)/scripts/parallel-gzip,gzip) > > and the same scripts/parallel-gzip: > > #!/bin/sh > exec pigz -p ${PARALLELISM:-1} "$@" > > And then replace the /boot/ KGZIP uses with KPGZIP. Then we don't need > to change modules, config_data, new users, nor cmd_gzip, etc, which all > continue to use the regular KGZIP and the "use python" part for the > KPGZIP case becomes is a 1-time cost? Nice, I like the idea and this this will work. I didn't know about scripts/jobserver-exec, but this does seem like a perfect fit. I checked the other compression tools we support, and found that zstd is another one that has built-in support for parallel compression, so we probably want to have it there as well. Arnd From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 14CB0C88E5C for ; Wed, 16 Sep 2026 06:39:43 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:Subject:References:In-Reply-To: Message-Id:Cc:To:From:Date:MIME-Version:Reply-To:Content-ID: Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc :Resent-Message-ID:List-Owner; bh=VVC5xk94YCtDXzJgKXIwUPGxLeY5Bkz2gLheANJJG9c=; b=yPX4aDKi+kxoOO4VwazxZxTZKV zC91IEZoSwUXZZiMBMXTwfHIWLcPwK+w69Vbg19Y4muzgM6LVIbZSFsZcdPLVgj3S/AvlT+VhYrKx CuNAXh4b0kPFauC7drBKtDctKLbZ2BUt7juXUyPbgll8MDQNK22F5ckct6oCIAdFlVWA6ZioJVxbt gUmmNjjVr/VnMcgYhOwKg+IWliCI1qHikyNjqpuuRJkQMPIEMsrdqwM6mRWUv7Wg6FjYXV2sCauw8 UNnx2/q6XEm5Kc5YyGnDAantco5QcAMKnGySG48Xvy3dfOCXNnyK26FvAT2tnAe4K25VTZSs/xinf sVCaHuPg==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.99.1 #2 (Red Hat Linux)) id 1x6jIg-00000008Uts-2PUt; Wed, 16 Sep 2026 06:39:24 +0000 Received: from desiato.infradead.org ([2001:8b0:10b:1:d65d:64ff:fe57:4e05]) by bombadil.infradead.org with esmtps (Exim 4.99.1 #2 (Red Hat Linux)) id 1x6jIa-00000008Usp-40i8; Wed, 16 Sep 2026 06:39:17 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=desiato.20200630; h=Content-Transfer-Encoding:Content-Type :Subject:References:In-Reply-To:Message-Id:Cc:To:From:Date:MIME-Version: Sender:Reply-To:Content-ID:Content-Description; bh=uVDBK2xNAXhHDNCHOU+SjarglqFyyWlJ3wc704FVprE=; b=JacOtMFOqa4NS+E/xhMesr8tBq e8hjkJVi3nV8J+dxRZwMO1hUD6uWQYzT5UkYIyzsZdENmpOsZxmN6MSKHU0P3Goyg2px2dXFAY/f1 +bAFfZrYjjpTdj0TNcLuSxx9QhEyjl3ZP4Ikf1qwPAlPF3+QFKvhW05hKyz0TVMkSKz1WGqfXfkd+ nKnB+EQw+zs26N/dKC5Mcl54YEzYlY4/ugLeWNa2Za7MXRBtD0iADRaG7KEbn1EsBZFSAPt5bGcoL iNkfGMtivUxZHLGUzgMWiCnDWpFW2iBZrHr37pWFY3vwMLlo8LgLinEt3x5O2WTkTjR6OEKenQBw/ kcUCU4EA==; Received: from flow-a5-smtp.messagingengine.com ([103.168.172.140]) by desiato.infradead.org with esmtps (Exim 4.99.2 #2 (Red Hat Linux)) id 1x6jIX-00000007XlV-2KSS; Wed, 16 Sep 2026 06:39:15 +0000 Received: from ams-compute-02.internal (ams-compute-02.internal [10.64.2.62]) by mailflow.phl.internal (Postfix) with ESMTP id 0617A138019A; Wed, 16 Sep 2026 02:39:06 -0400 (EDT) Received: from ams-imap-03 ([10.64.2.23]) by ams-compute-02.internal (MEProxy); Wed, 16 Sep 2026 02:39:10 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=arndb.de; h=cc :cc:content-transfer-encoding:content-type:content-type:date :date:from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm3; t=1789540746; x=1789547946; bh=uVDBK2xNAXhHDNCHOU+SjarglqFyyWlJ3wc704FVprE=; b= hM+QMgL4AS7CuAQEgPY/QESyH1qSIMZM/PiTjgz4TNQ7lYyddA3jppvmlI/5IRtp aLcPPSNyOwZ4ONFBjLRiTqDIPlY3kJ+iV4FjtzA/Jf9ExeZkGWFtHMAC1apX2a0o JxG9Sm/MY81KGVD79EG76UngndQxb50JJkMNvH391CRijk5PQKuEQLxqHqbhc7aw U6a9xwdt0VNRDZLHdO5kGUU4Dy1ykntORbxgDQvM1R9XJSRtFEPXz+ydch/mp5pK Vk4vumi5TLTNChz5cDYk6D26dHyiJTy5AwBer+/nPsYPOG3drXMIF0gaP31z2rze xJV1PP23jlnY8LgHB/VqQw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1789540746; x= 1789547946; bh=uVDBK2xNAXhHDNCHOU+SjarglqFyyWlJ3wc704FVprE=; b=g gZJYzQ/CXO0ZSXUW9zkiwFdCtlScWZRoKQ59VDODFeKbchxdoJRfGVhNB6de1zAk Igmrs/HG/KIktDBDX5I62AOCECbxn3CR2QbyoBLBAbC3cEeponmdReOksRDiSe9q OTcPBrLridMkOw6nE1aScTu+vm9BOJTRg0cVXnmQ/RekVjvXfgGSAPeg0NIeMhBh 8KtzxT0E9acGFkTvcgiVBxN0jUAPfrmFFpZqFDVEjJF7sR9+PWmJHcS79+es9Hqe Y+50DhmmirNy5aZpgXmGHT+b8LXtxiNGfE1XqVtVmARtuUlsPSt2BK2wlPS3A51z fM8arZOK+hOXDQfEkKw+A== X-ME-Sender: X-ME-Proxy-Cause: dmFkZTFiOvX0hSiRFkM2Qokbvc+IueVqJCGvgtt3OAIf0qT3xs2bOXFJbjdsyY8EBf6a3G wBCuVkHp4QXzYkIot+hObLZCDrcnpZNKnpfFLgzQAVfSFunvh+182qDL/bjJdZsRhVnu9N Rg8qcQzNoSLXgIKivflL/NB+ZAAB62DKqF6eukoIpU/rwKNOR5bsSXqO1BYRbMg1zYNqN4 oDPyOTYhMAJIKADNwdJOv6Ou9XDvSo8ddi0YiltF66PEiXc7a9FuDksrLfsfqL/XuqAsHP Y9CbQ4YvBgsWEAs7PYbhaU0vN1Tvx0ewh8X5yu5fjf+KRn2neEB4wnaNF9X+YH4Sh8f2IZ TMnCjUGn0ubvPi6ZhHHWHmRfG8Sb4PiHdpFOGZxXR/fGxogQNqik6N+b7W9Y66lFVF9kfA ZfgNIGxbV0r4VtA8proereo7T+tN2tZ3l+eECqT0E2xOtfLCzH6Sy45Pkr7MIiczYxZRTL ojXbeTO2DmADXmQu2KlswHGHk+E3MWyNQjGEYTIAL9pnYs19jLARyw5v7gwrdv3vVLVrn1 yf0WILLhluhmhnW+96OjgVLZMQZsTe+SCOMhGafvJe3m0q/F8vb96Rzj20Mx8LYjh9lnUU YuFaw0rQJ8zgvbkLtbtjlx6b6GFIj5Ly0fkpKPiFmCaW0ccGDMIj4dDXXp+Q X-ME-Proxy: Feedback-ID: i56a14606:Fastmail Received: by mailuser.ams.internal (Postfix, from userid 501) id EA77F32A0085; Wed, 16 Sep 2026 02:38:53 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface MIME-Version: 1.0 X-ThreadId: ArHA-gVR6p-N Date: Wed, 16 Sep 2026 08:38:33 +0200 From: "Arnd Bergmann" To: "Kees Cook" , "Lorenzo Stoakes" Cc: "Linus Torvalds" , "Nathan Chancellor" , "Nicolas Schier" , "Nick Desaulniers" , "Bill Wendling" , "Justin Stitt" , "Masahiro Yamada" , "Alexey Gladkov" , "Thomas Gleixner" , "Ingo Molnar" , "Borislav Petkov" , "Dave Hansen" , x86@kernel.org, "H. Peter Anvin" , "Paul Walmsley" , "Palmer Dabbelt" , "Albert Ou" , "Alexandre Ghiti" , "Catalin Marinas" , "Will Deacon" , "Mark Rutland" , "Ard Biesheuvel" , "Ilias Apalodimas" , "Josh Poimboeuf" , "Peter Zijlstra" , "Miguel Ojeda" , "Boqun Feng" , "Gary Guo" , =?UTF-8?Q?Bj=C3=B6rn_Roy_Baron?= , "Benno Lossin" , "Andreas Hindborg" , "Alice Ryhl" , "Trevor Gross" , "Danilo Krummrich" , "Daniel Almeida" , "Tamir Duberstein" , "Alexandre Courbot" , =?UTF-8?Q?Onur_=C3=96zkan?= , "Jonathan Corbet" , "Randy Dunlap" , "Gustavo A. R. Silva" , linux-kbuild@vger.kernel.org, linux-kernel@vger.kernel.org, llvm@lists.linux.dev, linux-riscv@lists.infradead.org, Linux-Arch , linux-arm-kernel@lists.infradead.org, linux-efi@vger.kernel.org, rust-for-linux@vger.kernel.org, linux-doc@vger.kernel.org, "Jens Axboe" , linux-hardening@vger.kernel.org Message-Id: <081b2b60-e295-4cd7-b201-d996a88c5f28@app.fastmail.com> In-Reply-To: <202609151758.BA5732348@keescook> References: <20260914-build-speedup-v2-0-39817ec5db23@kernel.org> <20260914-build-speedup-v2-21-39817ec5db23@kernel.org> <202609151758.BA5732348@keescook> Subject: Re: [PATCH v2 21/21] kbuild: use pigz for gzip compression if available X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.9.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20260916_073914_119679_70D9E855 X-CRM114-Status: GOOD ( 13.92 ) X-BeenThere: linux-riscv@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-riscv" Errors-To: linux-riscv-bounces+linux-riscv=archiver.kernel.org@lists.infradead.org On Wed, Sep 16, 2026, at 03:06, Kees Cook wrote: > On Mon, Sep 14, 2026 at 10:22:20AM +0100, Lorenzo Stoakes (ARM) wrote: > > Makefile: > > KPGZIP := $(if $(shell command -v pigz 2>/dev/null),$(PYTHON3) > $(abs_srctree)/scripts/jobserver-exec > $(abs_srctree)/scripts/parallel-gzip,gzip) > > and the same scripts/parallel-gzip: > > #!/bin/sh > exec pigz -p ${PARALLELISM:-1} "$@" > > And then replace the /boot/ KGZIP uses with KPGZIP. Then we don't need > to change modules, config_data, new users, nor cmd_gzip, etc, which all > continue to use the regular KGZIP and the "use python" part for the > KPGZIP case becomes is a 1-time cost? Nice, I like the idea and this this will work. I didn't know about scripts/jobserver-exec, but this does seem like a perfect fit. I checked the other compression tools we support, and found that zstd is another one that has built-in support for parallel compression, so we probably want to have it there as well. Arnd _______________________________________________ linux-riscv mailing list linux-riscv@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-riscv