From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.b="dwv0s4Gw" Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 6F4D0D46 for ; Thu, 23 Nov 2023 00:27:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1700728040; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=clHFl9DyukhU/KNoZLAq0QP1VqRYJXancPu2G75tCi0=; b=dwv0s4GwYTTp3oANrUkSlik/LXGZ+viG81ul6mJUCDrdMLxs4VNpbR/6O+M8uCd/p1+3zJ fovcJM0yaHQvVOUGtm7TXuVJ8luMXudaxZJichxx+Bv6xigso6XTH2u7fVV3luDymWx/w1 YgJPIH2JHFki0f7uHTo9fpLDkjgwpLE= Received: from mimecast-mx02.redhat.com (mimecast-mx02.redhat.com [66.187.233.88]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-141-xbU-EiHFNt2UCn3fOV12Bg-1; Thu, 23 Nov 2023 03:27:17 -0500 X-MC-Unique: xbU-EiHFNt2UCn3fOV12Bg-1 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.rdu2.redhat.com [10.11.54.4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 574DB101A53B; Thu, 23 Nov 2023 08:27:16 +0000 (UTC) Received: from localhost (unknown [10.72.112.97]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 2C8B82026D4C; Thu, 23 Nov 2023 08:27:12 +0000 (UTC) Date: Thu, 23 Nov 2023 16:27:09 +0800 From: Baoquan He To: Ignat Korchagin Cc: eric_devolder@yahoo.com, linux@armlinux.org.uk, catalin.marinas@arm.com, will@kernel.org, chenhuacai@kernel.org, geert@linux-m68k.org, tsbogend@alpha.franken.de, James Bottomley , deller@gmx.de, ysato@users.sourceforge.jp, dalias@libc.org, glaubitz@physik.fu-berlin.de, Thomas Gleixner , Ingo Molnar , Borislav Petkov , dave.hansen@linux.intel.com, x86@kernel.org, linux-kernel , linux-arm-kernel@lists.infradead.org, linux-ia64@vger.kernel.org, loongarch@lists.linux.dev, linux-m68k@lists.linux-m68k.org, linux-mips@vger.kernel.org, linux-parisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-riscv@lists.infradead.org, linux-s390@vger.kernel.org, linux-sh@vger.kernel.org, kernel@xen0n.name, mpe@ellerman.id.au, npiggin@gmail.com, christophe.leroy@csgroup.eu, paul.walmsley@sifive.com, palmer@dabbelt.com, aou@eecs.berkeley.edu, hca@linux.ibm.com, gor@linux.ibm.com, agordeev@linux.ibm.com, borntraeger@linux.ibm.com, svens@linux.ibm.com, hpa@zytor.com, keescook@chromium.org, paulmck@kernel.org, Peter Zijlstra , frederic@kernel.org, Andrew Morton , Ard Biesheuvel , samitolvanen@google.com, juerg.haefliger@canonical.com, arnd@arndb.de, rmk+kernel@armlinux.org.uk, linus.walleij@linaro.org, sebastian.reichel@collabora.com, rppt@kernel.org, kirill.shutemov@linux.intel.com, anshuman.khandual@arm.com, ziy@nvidia.com, masahiroy@kernel.org, ndesaulniers@google.com, mhiramat@kernel.org, ojeda@kernel.org, thunder.leizhen@huawei.com, xin3.li@intel.com, tj@kernel.org, Greg KH , tsi@tuyoix.net, hbathini@linux.ibm.com, sourabhjain@linux.ibm.com, boris.ostrovsky@oracle.com, konrad.wilk@oracle.com, kernel-team Subject: Re: Potential config regression after 89cde455 ("kexec: consolidate kexec and crash options into kernel/Kconfig.kexec") Message-ID: References: Precedence: bulk X-Mailing-List: linux-ia64@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Scanned-By: MIMEDefang 3.4.1 on 10.11.54.4 On 11/22/23 at 09:47am, Ignat Korchagin wrote: > On Wed, Nov 22, 2023 at 9:34 AM Baoquan He wrote: > > > > On 11/21/23 at 09:43am, Ignat Korchagin wrote: > > > On Tue, Nov 21, 2023 at 7:53 AM Ignat Korchagin wrote: > > > > > > > > On Tue, Nov 21, 2023 at 1:50 AM Baoquan He wrote: > > > > > > > > > > Eric DeVolder's Oracle mail address is not available anymore, add his > > > > > current mail address he told me. > > > > > > > > Thank you! > > > > > > > > > On 11/20/23 at 10:52pm, Ignat Korchagin wrote: > > > > > > Good day! > > > > > > > > > > > > We have recently started to evaluate Linux 6.6 and noticed that we > > > > > > cannot disable CONFIG_KEXEC anymore, but keep CONFIG_CRASH_DUMP > > > > > > enabled. It seems to be related to commit 89cde455 ("kexec: > > > > > > consolidate kexec and crash options into kernel/Kconfig.kexec"), where > > > > > > a CONFIG_KEXEC dependency was added to CONFIG_CRASH_DUMP. > > > > > > > > > > > > In our current kernel (Linux 6.1) we only enable CONFIG_KEXEC_FILE > > > > > > with enforced signature check to support the kernel crash dumping > > > > > > functionality and would like to keep CONFIG_KEXEC disabled for > > > > > > security reasons [1]. > > > > > > > > > > > > I was reading the long commit message, but the reason for adding > > > > > > CONFIG_KEXEC as a dependency for CONFIG_CRASH_DUMP evaded me. And I > > > > > > believe from the implementation perspective CONFIG_KEXEC_FILE should > > > > > > suffice here (as we successfully used it for crashdumps on Linux 6.1). > > > > > > > > > > > > Is there a reason for adding this dependency or is it just an > > > > > > oversight? Would some solution of requiring either CONFIG_KEXEC or > > > > > > CONFIG_KEXEC_FILE work here? > > > > > > > > > > I searched the patch history, found Eric didn't add the dependency on > > > > > CONFIG_KEXEC at the beginning. Later a linux-next building failure with > > > > > randconfig was reported, in there CONFIG_CRASH_DUMP enabled, while > > > > > CONFIG_KEXEC is disabled. Finally Eric added the KEXEC dependency for > > > > > CRASH_DUMP. Please see below link for more details: > > > > > > > > > > https://lore.kernel.org/all/3e8eecd1-a277-2cfb-690e-5de2eb7b988e@oracle.com/T/#u > > > > > > > > Thank you for digging this up. However I'm still confused, because > > > > this is exactly how we configure Linux 6.1 (although we do have > > > > CONFIG_KEXEC_FILE enabled) and we don't have any problems. I believe > > > > we did not investigate this issue properly. > > > > > > I did some preliminary investigation for this. If I patch out the > > > dependency on CONFIG_KEXEC the kernel builds just fine for x86 > > > (without CONFIG_CRASH_HOTPLUG - which is probably another issue) - so > > > this was the previous behaviour. I can see that the reported error is > > > for arm architecture and was able to reproduce it with a simple cross > > > compiler in Debian. However, I think it is still somehow related to > > > this patchset as the previous kernels (up to 6.5) build fine with just > > > CONFIG_CRASH_DUMP and without CONFIG_KEXEC for arm as well. So even > > > for arm it was introduced in 6.6. > > > > Thanks for the information. > > > > I haven't run the reproducer of issue reported on Eric's old patchset, > > while checkout to kernel 6.1, only s390 selected KEXEC for CRASH_DUMP > > already. And with the ARM building breakage, the simplest idea is > > to select KEXEC only for ARM or S390 CRASH_DUMP. I plan to try the > > reproducer later. If you have any idea or draft patch, please feel free > > to post. > > The thing is - before 6.6 even ARM did not require KEXEC for > CRASH_DUMP (at least to successfully compile), so I think we should > understand what changed first before adding a dependency for ARM. I'll > try to investigate more, if I have time. I did a cross compiling of arm on x86_64, it clearly requires KEXEC for CRASH_DUMP if the select of KEXEC for CRASH_DUMP is removed and CONFIG_KEXEC=n is set. 1) building error, only copy the first one: ========================================== In file included from ../include/linux/ima.h:13, from ../security/keys/key.c:16: ../include/linux/kexec.h:38:2: error: #error KEXEC_SOURCE_MEMORY_LIMIT not defined 38 | #error KEXEC_SOURCE_MEMORY_LIMIT not defined | ^~~~~ ../include/linux/kexec.h:42:2: error: #error KEXEC_DESTINATION_MEMORY_LIMIT not defined 42 | #error KEXEC_DESTINATION_MEMORY_LIMIT not defined | ^~~~~ ../include/linux/kexec.h:46:2: error: #error KEXEC_CONTROL_MEMORY_LIMIT not defined 46 | #error KEXEC_CONTROL_MEMORY_LIMIT not defined | ^~~~~ ../include/linux/kexec.h:54:2: error: #error KEXEC_CONTROL_PAGE_SIZE not defined 54 | #error KEXEC_CONTROL_PAGE_SIZE not defined | ^~~~~ ../include/linux/kexec.h:58:2: error: #error KEXEC_ARCH not defined 58 | #error KEXEC_ARCH not defined | ^~~~~ In file included from ../drivers/misc/pvpanic/pvpanic.c:13: 2) Kconfig items I enabled: ==== CONFIG_CRASH_CORE=y CONFIG_KEXEC_CORE=y # CONFIG_KEXEC is not set CONFIG_CRASH_DUMP=y 3) KEXEC select is dropped so as not to enable KEXEC automatically: ===== diff --git a/kernel/Kconfig.kexec b/kernel/Kconfig.kexec index 7aff28ded2f4..1cc3b1c595d7 100644 --- a/kernel/Kconfig.kexec +++ b/kernel/Kconfig.kexec @@ -97,7 +97,6 @@ config CRASH_DUMP depends on ARCH_SUPPORTS_KEXEC select CRASH_CORE select KEXEC_CORE - select KEXEC help Generate crash dump after being started by kexec. This should be normally only set in special crash dump kernels > > > diff --git a/kernel/Kconfig.kexec b/kernel/Kconfig.kexec > > index 7aff28ded2f4..382dcd8d7a9d 100644 > > --- a/kernel/Kconfig.kexec > > +++ b/kernel/Kconfig.kexec > > @@ -97,7 +97,7 @@ config CRASH_DUMP > > depends on ARCH_SUPPORTS_KEXEC > > select CRASH_CORE > > select KEXEC_CORE > > - select KEXEC > > + select KEXEC if (ARM || S390) > > > > > > arch/s390/Kconfig in kernel 6.1: > > config CRASH_DUMP > > bool "kernel crash dumps" > > select KEXEC > > help > > Generate crash dump after being started by kexec. > > Crash dump kernels are loaded in the main kernel with kexec-tools > > into a specially reserved region and then later executed after > > a crash by kdump/kexec. > > Refer to for more details on this. > > This option also enables s390 zfcpdump. > > See also > > > > > > > > > > And besides, the newly added CONFIG_CRASH_HOTPLUG also needs > > > > > CONFIG_KEXEC if the elfcorehdr is allowed to be manipulated when > > > > > cpu/memory hotplug hapened. > > > > > > > > This still feels like a regression to me: any crash dump support > > > > should be independent of KEXEC syscalls being present. While probably > > > > the common case (including us) that the crashing kernel and recovery > > > > kernel are the same, they don't have to be. We need kexec syscall in > > > > the crashing kernel, but crashdump support in the recovery kernel (but > > > > the recovery kernel not having the kexec syscalls should be totally > > > > fine). If we do require some code definitions from kexec - at most we > > > > should put them under CONFIG_KEXEC_CORE. > > > > > > > > > Thanks > > > > > Baoquan > > > > > > > > > > > Ignat > > > > > > From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 8D9BFC5AD4C for ; Thu, 23 Nov 2023 08:27:37 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:In-Reply-To:MIME-Version:References: Message-ID:Subject:Cc:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=8rgTpStQWfKrBJt0Ng3Q/CW9Xi9c8R24fcbqMI5sajk=; b=d41YtNa5/7oGLr AsrTYcyThsVRZ0U4+Ub8cz5i43T7phgEfs0u0dCEkCm9q+wCqz7flo6DGuR0VfgPun4lTkKX25o4t PmczMNt0kyYm19GR0EAPA5Wkyy2//NQZGva6nEp1Xi800CSDfBUBBAWsuuAd0FILXxdCxnOLGG9XH dK0izScgzioYQhPsWTcjJXbJXPRoBiRqn1GU3VpKdhx1H1uSMDFKl28UT89zp1r47FEBQVXNwJ/zf IoG99UvYrqiYe5wWmJ6aijD7JmKrlURjV7ATIMdESPAKcJ57SJk7lHbQrEtQNvnBFHJwNEe2K7ovR iJ9e4RbUC5eK5kWi7eew==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.96 #2 (Red Hat Linux)) id 1r653X-0048kE-1X; Thu, 23 Nov 2023 08:27:27 +0000 Received: from us-smtp-delivery-124.mimecast.com ([170.10.129.124]) by bombadil.infradead.org with esmtps (Exim 4.96 #2 (Red Hat Linux)) id 1r653U-0048gz-1D for linux-riscv@lists.infradead.org; Thu, 23 Nov 2023 08:27:26 +0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1700728040; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=clHFl9DyukhU/KNoZLAq0QP1VqRYJXancPu2G75tCi0=; b=dwv0s4GwYTTp3oANrUkSlik/LXGZ+viG81ul6mJUCDrdMLxs4VNpbR/6O+M8uCd/p1+3zJ fovcJM0yaHQvVOUGtm7TXuVJ8luMXudaxZJichxx+Bv6xigso6XTH2u7fVV3luDymWx/w1 YgJPIH2JHFki0f7uHTo9fpLDkjgwpLE= Received: from mimecast-mx02.redhat.com (mimecast-mx02.redhat.com [66.187.233.88]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-141-xbU-EiHFNt2UCn3fOV12Bg-1; Thu, 23 Nov 2023 03:27:17 -0500 X-MC-Unique: xbU-EiHFNt2UCn3fOV12Bg-1 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.rdu2.redhat.com [10.11.54.4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 574DB101A53B; Thu, 23 Nov 2023 08:27:16 +0000 (UTC) Received: from localhost (unknown [10.72.112.97]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 2C8B82026D4C; Thu, 23 Nov 2023 08:27:12 +0000 (UTC) Date: Thu, 23 Nov 2023 16:27:09 +0800 From: Baoquan He To: Ignat Korchagin Cc: eric_devolder@yahoo.com, linux@armlinux.org.uk, catalin.marinas@arm.com, will@kernel.org, chenhuacai@kernel.org, geert@linux-m68k.org, tsbogend@alpha.franken.de, James Bottomley , deller@gmx.de, ysato@users.sourceforge.jp, dalias@libc.org, glaubitz@physik.fu-berlin.de, Thomas Gleixner , Ingo Molnar , Borislav Petkov , dave.hansen@linux.intel.com, x86@kernel.org, linux-kernel , linux-arm-kernel@lists.infradead.org, linux-ia64@vger.kernel.org, loongarch@lists.linux.dev, linux-m68k@lists.linux-m68k.org, linux-mips@vger.kernel.org, linux-parisc@vger.kernel.org, linuxppc-dev@lists.ozlabs.org, linux-riscv@lists.infradead.org, linux-s390@vger.kernel.org, linux-sh@vger.kernel.org, kernel@xen0n.name, mpe@ellerman.id.au, npiggin@gmail.com, christophe.leroy@csgroup.eu, paul.walmsley@sifive.com, palmer@dabbelt.com, aou@eecs.berkeley.edu, hca@linux.ibm.com, gor@linux.ibm.com, agordeev@linux.ibm.com, borntraeger@linux.ibm.com, svens@linux.ibm.com, hpa@zytor.com, keescook@chromium.org, paulmck@kernel.org, Peter Zijlstra , frederic@kernel.org, Andrew Morton , Ard Biesheuvel , samitolvanen@google.com, juerg.haefliger@canonical.com, arnd@arndb.de, rmk+kernel@armlinux.org.uk, linus.walleij@linaro.org, sebastian.reichel@collabora.com, rppt@kernel.org, kirill.shutemov@linux.intel.com, anshuman.khandual@arm.com, ziy@nvidia.com, masahiroy@kernel.org, ndesaulniers@google.com, mhiramat@kernel.org, ojeda@kernel.org, thunder.leizhen@huawei.com, xin3.li@intel.com, tj@kernel.org, Greg KH , tsi@tuyoix.net, hbathini@linux.ibm.com, sourabhjain@linux.ibm.com, boris.ostrovsky@oracle.com, konrad.wilk@oracle.com, kernel-team Subject: Re: Potential config regression after 89cde455 ("kexec: consolidate kexec and crash options into kernel/Kconfig.kexec") Message-ID: References: MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: X-Scanned-By: MIMEDefang 3.4.1 on 10.11.54.4 X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20231123_002724_506061_40FA85B4 X-CRM114-Status: GOOD ( 58.95 ) X-BeenThere: linux-riscv@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: "linux-riscv" Errors-To: linux-riscv-bounces+linux-riscv=archiver.kernel.org@lists.infradead.org T24gMTEvMjIvMjMgYXQgMDk6NDdhbSwgSWduYXQgS29yY2hhZ2luIHdyb3RlOgo+IE9uIFdlZCwg Tm92IDIyLCAyMDIzIGF0IDk6MzTigK9BTSBCYW9xdWFuIEhlIDxiaGVAcmVkaGF0LmNvbT4gd3Jv dGU6Cj4gPgo+ID4gT24gMTEvMjEvMjMgYXQgMDk6NDNhbSwgSWduYXQgS29yY2hhZ2luIHdyb3Rl Ogo+ID4gPiBPbiBUdWUsIE5vdiAyMSwgMjAyMyBhdCA3OjUz4oCvQU0gSWduYXQgS29yY2hhZ2lu IDxpZ25hdEBjbG91ZGZsYXJlLmNvbT4gd3JvdGU6Cj4gPiA+ID4KPiA+ID4gPiBPbiBUdWUsIE5v diAyMSwgMjAyMyBhdCAxOjUw4oCvQU0gQmFvcXVhbiBIZSA8YmhlQHJlZGhhdC5jb20+IHdyb3Rl Ogo+ID4gPiA+ID4KPiA+ID4gPiA+IEVyaWMgRGVWb2xkZXIncyBPcmFjbGUgbWFpbCBhZGRyZXNz IGlzIG5vdCBhdmFpbGFibGUgYW55bW9yZSwgYWRkIGhpcwo+ID4gPiA+ID4gY3VycmVudCBtYWls IGFkZHJlc3MgaGUgdG9sZCBtZS4KPiA+ID4gPgo+ID4gPiA+IFRoYW5rIHlvdSEKPiA+ID4gPgo+ ID4gPiA+ID4gT24gMTEvMjAvMjMgYXQgMTA6NTJwbSwgSWduYXQgS29yY2hhZ2luIHdyb3RlOgo+ ID4gPiA+ID4gPiBHb29kIGRheSEKPiA+ID4gPiA+ID4KPiA+ID4gPiA+ID4gV2UgaGF2ZSByZWNl bnRseSBzdGFydGVkIHRvIGV2YWx1YXRlIExpbnV4IDYuNiBhbmQgbm90aWNlZCB0aGF0IHdlCj4g PiA+ID4gPiA+IGNhbm5vdCBkaXNhYmxlIENPTkZJR19LRVhFQyBhbnltb3JlLCBidXQga2VlcCBD T05GSUdfQ1JBU0hfRFVNUAo+ID4gPiA+ID4gPiBlbmFibGVkLiBJdCBzZWVtcyB0byBiZSByZWxh dGVkIHRvIGNvbW1pdCA4OWNkZTQ1NSAoImtleGVjOgo+ID4gPiA+ID4gPiBjb25zb2xpZGF0ZSBr ZXhlYyBhbmQgY3Jhc2ggb3B0aW9ucyBpbnRvIGtlcm5lbC9LY29uZmlnLmtleGVjIiksIHdoZXJl Cj4gPiA+ID4gPiA+IGEgQ09ORklHX0tFWEVDIGRlcGVuZGVuY3kgd2FzIGFkZGVkIHRvIENPTkZJ R19DUkFTSF9EVU1QLgo+ID4gPiA+ID4gPgo+ID4gPiA+ID4gPiBJbiBvdXIgY3VycmVudCBrZXJu ZWwgKExpbnV4IDYuMSkgd2Ugb25seSBlbmFibGUgQ09ORklHX0tFWEVDX0ZJTEUKPiA+ID4gPiA+ ID4gd2l0aCBlbmZvcmNlZCBzaWduYXR1cmUgY2hlY2sgdG8gc3VwcG9ydCB0aGUga2VybmVsIGNy YXNoIGR1bXBpbmcKPiA+ID4gPiA+ID4gZnVuY3Rpb25hbGl0eSBhbmQgd291bGQgbGlrZSB0byBr ZWVwIENPTkZJR19LRVhFQyBkaXNhYmxlZCBmb3IKPiA+ID4gPiA+ID4gc2VjdXJpdHkgcmVhc29u cyBbMV0uCj4gPiA+ID4gPiA+Cj4gPiA+ID4gPiA+IEkgd2FzIHJlYWRpbmcgdGhlIGxvbmcgY29t bWl0IG1lc3NhZ2UsIGJ1dCB0aGUgcmVhc29uIGZvciBhZGRpbmcKPiA+ID4gPiA+ID4gQ09ORklH X0tFWEVDIGFzIGEgZGVwZW5kZW5jeSBmb3IgQ09ORklHX0NSQVNIX0RVTVAgZXZhZGVkIG1lLiBB bmQgSQo+ID4gPiA+ID4gPiBiZWxpZXZlIGZyb20gdGhlIGltcGxlbWVudGF0aW9uIHBlcnNwZWN0 aXZlIENPTkZJR19LRVhFQ19GSUxFIHNob3VsZAo+ID4gPiA+ID4gPiBzdWZmaWNlIGhlcmUgKGFz IHdlIHN1Y2Nlc3NmdWxseSB1c2VkIGl0IGZvciBjcmFzaGR1bXBzIG9uIExpbnV4IDYuMSkuCj4g PiA+ID4gPiA+Cj4gPiA+ID4gPiA+IElzIHRoZXJlIGEgcmVhc29uIGZvciBhZGRpbmcgdGhpcyBk ZXBlbmRlbmN5IG9yIGlzIGl0IGp1c3QgYW4KPiA+ID4gPiA+ID4gb3ZlcnNpZ2h0PyBXb3VsZCBz b21lIHNvbHV0aW9uIG9mIHJlcXVpcmluZyBlaXRoZXIgQ09ORklHX0tFWEVDIG9yCj4gPiA+ID4g PiA+IENPTkZJR19LRVhFQ19GSUxFIHdvcmsgaGVyZT8KPiA+ID4gPiA+Cj4gPiA+ID4gPiBJIHNl YXJjaGVkIHRoZSBwYXRjaCBoaXN0b3J5LCBmb3VuZCBFcmljIGRpZG4ndCBhZGQgdGhlIGRlcGVu ZGVuY3kgb24KPiA+ID4gPiA+IENPTkZJR19LRVhFQyBhdCB0aGUgYmVnaW5uaW5nLiBMYXRlciBh IGxpbnV4LW5leHQgYnVpbGRpbmcgZmFpbHVyZSB3aXRoCj4gPiA+ID4gPiByYW5kY29uZmlnIHdh cyByZXBvcnRlZCwgaW4gdGhlcmUgQ09ORklHX0NSQVNIX0RVTVAgZW5hYmxlZCwgd2hpbGUKPiA+ ID4gPiA+IENPTkZJR19LRVhFQyBpcyBkaXNhYmxlZC4gRmluYWxseSBFcmljIGFkZGVkIHRoZSBL RVhFQyBkZXBlbmRlbmN5IGZvcgo+ID4gPiA+ID4gQ1JBU0hfRFVNUC4gUGxlYXNlIHNlZSBiZWxv dyBsaW5rIGZvciBtb3JlIGRldGFpbHM6Cj4gPiA+ID4gPgo+ID4gPiA+ID4gaHR0cHM6Ly9sb3Jl Lmtlcm5lbC5vcmcvYWxsLzNlOGVlY2QxLWEyNzctMmNmYi02OTBlLTVkZTJlYjdiOTg4ZUBvcmFj bGUuY29tL1QvI3UKPiA+ID4gPgo+ID4gPiA+IFRoYW5rIHlvdSBmb3IgZGlnZ2luZyB0aGlzIHVw LiBIb3dldmVyIEknbSBzdGlsbCBjb25mdXNlZCwgYmVjYXVzZQo+ID4gPiA+IHRoaXMgaXMgZXhh Y3RseSBob3cgd2UgY29uZmlndXJlIExpbnV4IDYuMSAoYWx0aG91Z2ggd2UgZG8gaGF2ZQo+ID4g PiA+IENPTkZJR19LRVhFQ19GSUxFIGVuYWJsZWQpIGFuZCB3ZSBkb24ndCBoYXZlIGFueSBwcm9i bGVtcy4gSSBiZWxpZXZlCj4gPiA+ID4gd2UgZGlkIG5vdCBpbnZlc3RpZ2F0ZSB0aGlzIGlzc3Vl IHByb3Blcmx5Lgo+ID4gPgo+ID4gPiBJIGRpZCBzb21lIHByZWxpbWluYXJ5IGludmVzdGlnYXRp b24gZm9yIHRoaXMuIElmIEkgcGF0Y2ggb3V0IHRoZQo+ID4gPiBkZXBlbmRlbmN5IG9uIENPTkZJ R19LRVhFQyB0aGUga2VybmVsIGJ1aWxkcyBqdXN0IGZpbmUgZm9yIHg4Ngo+ID4gPiAod2l0aG91 dCBDT05GSUdfQ1JBU0hfSE9UUExVRyAtIHdoaWNoIGlzIHByb2JhYmx5IGFub3RoZXIgaXNzdWUp IC0gc28KPiA+ID4gdGhpcyB3YXMgdGhlIHByZXZpb3VzIGJlaGF2aW91ci4gSSBjYW4gc2VlIHRo YXQgdGhlIHJlcG9ydGVkIGVycm9yIGlzCj4gPiA+IGZvciBhcm0gYXJjaGl0ZWN0dXJlIGFuZCB3 YXMgYWJsZSB0byByZXByb2R1Y2UgaXQgd2l0aCBhIHNpbXBsZSBjcm9zcwo+ID4gPiBjb21waWxl ciBpbiBEZWJpYW4uIEhvd2V2ZXIsIEkgdGhpbmsgaXQgaXMgc3RpbGwgc29tZWhvdyByZWxhdGVk IHRvCj4gPiA+IHRoaXMgcGF0Y2hzZXQgYXMgdGhlIHByZXZpb3VzIGtlcm5lbHMgKHVwIHRvIDYu NSkgYnVpbGQgZmluZSB3aXRoIGp1c3QKPiA+ID4gQ09ORklHX0NSQVNIX0RVTVAgYW5kIHdpdGhv dXQgQ09ORklHX0tFWEVDIGZvciBhcm0gYXMgd2VsbC4gU28gZXZlbgo+ID4gPiBmb3IgYXJtIGl0 IHdhcyBpbnRyb2R1Y2VkIGluIDYuNi4KPiA+Cj4gPiBUaGFua3MgZm9yIHRoZSBpbmZvcm1hdGlv bi4KPiA+Cj4gPiBJIGhhdmVuJ3QgcnVuIHRoZSByZXByb2R1Y2VyIG9mIGlzc3VlIHJlcG9ydGVk IG9uIEVyaWMncyBvbGQgcGF0Y2hzZXQsCj4gPiB3aGlsZSBjaGVja291dCB0byBrZXJuZWwgNi4x LCBvbmx5IHMzOTAgc2VsZWN0ZWQgS0VYRUMgZm9yIENSQVNIX0RVTVAKPiA+IGFscmVhZHkuIEFu ZCB3aXRoIHRoZSBBUk0gYnVpbGRpbmcgYnJlYWthZ2UsIHRoZSBzaW1wbGVzdCBpZGVhIGlzCj4g PiB0byBzZWxlY3QgS0VYRUMgb25seSBmb3IgQVJNIG9yIFMzOTAgQ1JBU0hfRFVNUC4gSSBwbGFu IHRvIHRyeSB0aGUKPiA+IHJlcHJvZHVjZXIgbGF0ZXIuIElmIHlvdSBoYXZlIGFueSBpZGVhIG9y IGRyYWZ0IHBhdGNoLCBwbGVhc2UgZmVlbCBmcmVlCj4gPiB0byBwb3N0Lgo+IAo+IFRoZSB0aGlu ZyBpcyAtIGJlZm9yZSA2LjYgZXZlbiBBUk0gZGlkIG5vdCByZXF1aXJlIEtFWEVDIGZvcgo+IENS QVNIX0RVTVAgKGF0IGxlYXN0IHRvIHN1Y2Nlc3NmdWxseSBjb21waWxlKSwgc28gSSB0aGluayB3 ZSBzaG91bGQKPiB1bmRlcnN0YW5kIHdoYXQgY2hhbmdlZCBmaXJzdCBiZWZvcmUgYWRkaW5nIGEg ZGVwZW5kZW5jeSBmb3IgQVJNLiBJJ2xsCj4gdHJ5IHRvIGludmVzdGlnYXRlIG1vcmUsIGlmIEkg aGF2ZSB0aW1lLgoKSSBkaWQgYSBjcm9zcyBjb21waWxpbmcgb2YgYXJtIG9uIHg4Nl82NCwgaXQg Y2xlYXJseSByZXF1aXJlcyBLRVhFQyBmb3IKQ1JBU0hfRFVNUCBpZiB0aGUgc2VsZWN0IG9mIEtF WEVDIGZvciBDUkFTSF9EVU1QIGlzIHJlbW92ZWQgYW5kCkNPTkZJR19LRVhFQz1uIGlzIHNldC4K CjEpIGJ1aWxkaW5nIGVycm9yLCBvbmx5IGNvcHkgdGhlIGZpcnN0IG9uZToKPT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09CkluIGZpbGUgaW5jbHVkZWQgZnJvbSAuLi9p bmNsdWRlL2xpbnV4L2ltYS5oOjEzLAogICAgICAgICAgICAgICAgIGZyb20gLi4vc2VjdXJpdHkv a2V5cy9rZXkuYzoxNjoKLi4vaW5jbHVkZS9saW51eC9rZXhlYy5oOjM4OjI6IGVycm9yOiAjZXJy b3IgS0VYRUNfU09VUkNFX01FTU9SWV9MSU1JVCBub3QgZGVmaW5lZAogICAzOCB8ICNlcnJvciBL RVhFQ19TT1VSQ0VfTUVNT1JZX0xJTUlUIG5vdCBkZWZpbmVkCiAgICAgIHwgIF5+fn5+Ci4uL2lu Y2x1ZGUvbGludXgva2V4ZWMuaDo0MjoyOiBlcnJvcjogI2Vycm9yIEtFWEVDX0RFU1RJTkFUSU9O X01FTU9SWV9MSU1JVCBub3QgZGVmaW5lZAogICA0MiB8ICNlcnJvciBLRVhFQ19ERVNUSU5BVElP Tl9NRU1PUllfTElNSVQgbm90IGRlZmluZWQKICAgICAgfCAgXn5+fn4KLi4vaW5jbHVkZS9saW51 eC9rZXhlYy5oOjQ2OjI6IGVycm9yOiAjZXJyb3IgS0VYRUNfQ09OVFJPTF9NRU1PUllfTElNSVQg bm90IGRlZmluZWQKICAgNDYgfCAjZXJyb3IgS0VYRUNfQ09OVFJPTF9NRU1PUllfTElNSVQgbm90 IGRlZmluZWQKICAgICAgfCAgXn5+fn4KLi4vaW5jbHVkZS9saW51eC9rZXhlYy5oOjU0OjI6IGVy cm9yOiAjZXJyb3IgS0VYRUNfQ09OVFJPTF9QQUdFX1NJWkUgbm90IGRlZmluZWQKICAgNTQgfCAj ZXJyb3IgS0VYRUNfQ09OVFJPTF9QQUdFX1NJWkUgbm90IGRlZmluZWQKICAgICAgfCAgXn5+fn4K Li4vaW5jbHVkZS9saW51eC9rZXhlYy5oOjU4OjI6IGVycm9yOiAjZXJyb3IgS0VYRUNfQVJDSCBu b3QgZGVmaW5lZAogICA1OCB8ICNlcnJvciBLRVhFQ19BUkNIIG5vdCBkZWZpbmVkCiAgICAgIHwg IF5+fn5+CkluIGZpbGUgaW5jbHVkZWQgZnJvbSAuLi9kcml2ZXJzL21pc2MvcHZwYW5pYy9wdnBh bmljLmM6MTM6CgoyKSBLY29uZmlnIGl0ZW1zIEkgZW5hYmxlZDoKPT09PQpDT05GSUdfQ1JBU0hf Q09SRT15CkNPTkZJR19LRVhFQ19DT1JFPXkKIyBDT05GSUdfS0VYRUMgaXMgbm90IHNldApDT05G SUdfQ1JBU0hfRFVNUD15CgoKCjMpIEtFWEVDIHNlbGVjdCBpcyBkcm9wcGVkIHNvIGFzIG5vdCB0 byBlbmFibGUgS0VYRUMgYXV0b21hdGljYWxseToKPT09PT0KZGlmZiAtLWdpdCBhL2tlcm5lbC9L Y29uZmlnLmtleGVjIGIva2VybmVsL0tjb25maWcua2V4ZWMKaW5kZXggN2FmZjI4ZGVkMmY0Li4x Y2MzYjFjNTk1ZDcgMTAwNjQ0Ci0tLSBhL2tlcm5lbC9LY29uZmlnLmtleGVjCisrKyBiL2tlcm5l bC9LY29uZmlnLmtleGVjCkBAIC05Nyw3ICs5Nyw2IEBAIGNvbmZpZyBDUkFTSF9EVU1QCiAgICAg ICAgZGVwZW5kcyBvbiBBUkNIX1NVUFBPUlRTX0tFWEVDCiAgICAgICAgc2VsZWN0IENSQVNIX0NP UkUKICAgICAgICBzZWxlY3QgS0VYRUNfQ09SRQotICAgICAgIHNlbGVjdCBLRVhFQwogICAgICAg IGhlbHAKICAgICAgICAgIEdlbmVyYXRlIGNyYXNoIGR1bXAgYWZ0ZXIgYmVpbmcgc3RhcnRlZCBi eSBrZXhlYy4KICAgICAgICAgIFRoaXMgc2hvdWxkIGJlIG5vcm1hbGx5IG9ubHkgc2V0IGluIHNw ZWNpYWwgY3Jhc2ggZHVtcCBrZXJuZWxzCj4gCj4gPiBkaWZmIC0tZ2l0IGEva2VybmVsL0tjb25m aWcua2V4ZWMgYi9rZXJuZWwvS2NvbmZpZy5rZXhlYwo+ID4gaW5kZXggN2FmZjI4ZGVkMmY0Li4z ODJkY2Q4ZDdhOWQgMTAwNjQ0Cj4gPiAtLS0gYS9rZXJuZWwvS2NvbmZpZy5rZXhlYwo+ID4gKysr IGIva2VybmVsL0tjb25maWcua2V4ZWMKPiA+IEBAIC05Nyw3ICs5Nyw3IEBAIGNvbmZpZyBDUkFT SF9EVU1QCj4gPiAgICAgICAgIGRlcGVuZHMgb24gQVJDSF9TVVBQT1JUU19LRVhFQwo+ID4gICAg ICAgICBzZWxlY3QgQ1JBU0hfQ09SRQo+ID4gICAgICAgICBzZWxlY3QgS0VYRUNfQ09SRQo+ID4g LSAgICAgICBzZWxlY3QgS0VYRUMKPiA+ICsgICAgICAgc2VsZWN0IEtFWEVDIGlmIChBUk0gfHwg UzM5MCkKPiA+Cj4gPgo+ID4gYXJjaC9zMzkwL0tjb25maWcgaW4ga2VybmVsIDYuMToKPiA+IGNv bmZpZyBDUkFTSF9EVU1QCj4gPiAgICAgICAgIGJvb2wgImtlcm5lbCBjcmFzaCBkdW1wcyIKPiA+ ICAgICAgICAgc2VsZWN0IEtFWEVDCj4gPiAgICAgICAgIGhlbHAKPiA+ICAgICAgICAgICBHZW5l cmF0ZSBjcmFzaCBkdW1wIGFmdGVyIGJlaW5nIHN0YXJ0ZWQgYnkga2V4ZWMuCj4gPiAgICAgICAg ICAgQ3Jhc2ggZHVtcCBrZXJuZWxzIGFyZSBsb2FkZWQgaW4gdGhlIG1haW4ga2VybmVsIHdpdGgg a2V4ZWMtdG9vbHMKPiA+ICAgICAgICAgICBpbnRvIGEgc3BlY2lhbGx5IHJlc2VydmVkIHJlZ2lv biBhbmQgdGhlbiBsYXRlciBleGVjdXRlZCBhZnRlcgo+ID4gICAgICAgICAgIGEgY3Jhc2ggYnkg a2R1bXAva2V4ZWMuCj4gPiAgICAgICAgICAgUmVmZXIgdG8gPGZpbGU6RG9jdW1lbnRhdGlvbi9z MzkwL3pmY3BkdW1wLnJzdD4gZm9yIG1vcmUgZGV0YWlscyBvbiB0aGlzLgo+ID4gICAgICAgICAg IFRoaXMgb3B0aW9uIGFsc28gZW5hYmxlcyBzMzkwIHpmY3BkdW1wLgo+ID4gICAgICAgICAgIFNl ZSBhbHNvIDxmaWxlOkRvY3VtZW50YXRpb24vczM5MC96ZmNwZHVtcC5yc3Q+Cj4gPgo+ID4gPgo+ ID4gPiA+ID4gQW5kIGJlc2lkZXMsIHRoZSBuZXdseSBhZGRlZCBDT05GSUdfQ1JBU0hfSE9UUExV RyBhbHNvIG5lZWRzCj4gPiA+ID4gPiBDT05GSUdfS0VYRUMgaWYgdGhlIGVsZmNvcmVoZHIgaXMg YWxsb3dlZCB0byBiZSBtYW5pcHVsYXRlZCB3aGVuCj4gPiA+ID4gPiBjcHUvbWVtb3J5IGhvdHBs dWcgaGFwZW5lZC4KPiA+ID4gPgo+ID4gPiA+IFRoaXMgc3RpbGwgZmVlbHMgbGlrZSBhIHJlZ3Jl c3Npb24gdG8gbWU6IGFueSBjcmFzaCBkdW1wIHN1cHBvcnQKPiA+ID4gPiBzaG91bGQgYmUgaW5k ZXBlbmRlbnQgb2YgS0VYRUMgc3lzY2FsbHMgYmVpbmcgcHJlc2VudC4gV2hpbGUgcHJvYmFibHkK PiA+ID4gPiB0aGUgY29tbW9uIGNhc2UgKGluY2x1ZGluZyB1cykgdGhhdCB0aGUgY3Jhc2hpbmcg a2VybmVsIGFuZCByZWNvdmVyeQo+ID4gPiA+IGtlcm5lbCBhcmUgdGhlIHNhbWUsIHRoZXkgZG9u J3QgaGF2ZSB0byBiZS4gV2UgbmVlZCBrZXhlYyBzeXNjYWxsIGluCj4gPiA+ID4gdGhlIGNyYXNo aW5nIGtlcm5lbCwgYnV0IGNyYXNoZHVtcCBzdXBwb3J0IGluIHRoZSByZWNvdmVyeSBrZXJuZWwg KGJ1dAo+ID4gPiA+IHRoZSByZWNvdmVyeSBrZXJuZWwgbm90IGhhdmluZyB0aGUga2V4ZWMgc3lz Y2FsbHMgc2hvdWxkIGJlIHRvdGFsbHkKPiA+ID4gPiBmaW5lKS4gSWYgd2UgZG8gcmVxdWlyZSBz b21lIGNvZGUgZGVmaW5pdGlvbnMgZnJvbSBrZXhlYyAtIGF0IG1vc3Qgd2UKPiA+ID4gPiBzaG91 bGQgcHV0IHRoZW0gdW5kZXIgQ09ORklHX0tFWEVDX0NPUkUuCj4gPiA+ID4KPiA+ID4gPiA+IFRo YW5rcwo+ID4gPiA+ID4gQmFvcXVhbgo+ID4gPiA+ID4KPiA+ID4KPiA+ID4gSWduYXQKPiA+ID4K PiA+Cj4gCgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18K bGludXgtcmlzY3YgbWFpbGluZyBsaXN0CmxpbnV4LXJpc2N2QGxpc3RzLmluZnJhZGVhZC5vcmcK aHR0cDovL2xpc3RzLmluZnJhZGVhZC5vcmcvbWFpbG1hbi9saXN0aW5mby9saW51eC1yaXNjdgo= From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from lists.ozlabs.org (lists.ozlabs.org [112.213.38.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 46E4CC61D85 for ; Thu, 23 Nov 2023 22:23:09 +0000 (UTC) Authentication-Results: lists.ozlabs.org; dkim=fail reason="signature verification failed" (1024-bit key; unprotected) header.d=redhat.com header.i=@redhat.com header.a=rsa-sha256 header.s=mimecast20190719 header.b=dwv0s4Gw; dkim=fail reason="signature verification failed" (1024-bit key) header.d=redhat.com header.i=@redhat.com header.a=rsa-sha256 header.s=mimecast20190719 header.b=dwv0s4Gw; dkim-atps=neutral Received: from boromir.ozlabs.org (localhost [IPv6:::1]) by lists.ozlabs.org (Postfix) with ESMTP id 4Sbt0q4rTyz3dVf for ; Fri, 24 Nov 2023 09:23:07 +1100 (AEDT) Authentication-Results: lists.ozlabs.org; dkim=pass (1024-bit key; unprotected) header.d=redhat.com header.i=@redhat.com header.a=rsa-sha256 header.s=mimecast20190719 header.b=dwv0s4Gw; dkim=pass (1024-bit key) header.d=redhat.com header.i=@redhat.com header.a=rsa-sha256 header.s=mimecast20190719 header.b=dwv0s4Gw; dkim-atps=neutral Authentication-Results: lists.ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=redhat.com (client-ip=170.10.129.124; helo=us-smtp-delivery-124.mimecast.com; envelope-from=bhe@redhat.com; receiver=lists.ozlabs.org) Received: from us-smtp-delivery-124.mimecast.com (us-smtp-delivery-124.mimecast.com [170.10.129.124]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by lists.ozlabs.org (Postfix) with ESMTPS id 4SbWSb3626z2xYt for ; Thu, 23 Nov 2023 19:27:26 +1100 (AEDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1700728040; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=clHFl9DyukhU/KNoZLAq0QP1VqRYJXancPu2G75tCi0=; b=dwv0s4GwYTTp3oANrUkSlik/LXGZ+viG81ul6mJUCDrdMLxs4VNpbR/6O+M8uCd/p1+3zJ fovcJM0yaHQvVOUGtm7TXuVJ8luMXudaxZJichxx+Bv6xigso6XTH2u7fVV3luDymWx/w1 YgJPIH2JHFki0f7uHTo9fpLDkjgwpLE= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1700728040; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=clHFl9DyukhU/KNoZLAq0QP1VqRYJXancPu2G75tCi0=; b=dwv0s4GwYTTp3oANrUkSlik/LXGZ+viG81ul6mJUCDrdMLxs4VNpbR/6O+M8uCd/p1+3zJ fovcJM0yaHQvVOUGtm7TXuVJ8luMXudaxZJichxx+Bv6xigso6XTH2u7fVV3luDymWx/w1 YgJPIH2JHFki0f7uHTo9fpLDkjgwpLE= Received: from mimecast-mx02.redhat.com (mimecast-mx02.redhat.com [66.187.233.88]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-141-xbU-EiHFNt2UCn3fOV12Bg-1; Thu, 23 Nov 2023 03:27:17 -0500 X-MC-Unique: xbU-EiHFNt2UCn3fOV12Bg-1 Received: from smtp.corp.redhat.com (int-mx04.intmail.prod.int.rdu2.redhat.com [10.11.54.4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mimecast-mx02.redhat.com (Postfix) with ESMTPS id 574DB101A53B; Thu, 23 Nov 2023 08:27:16 +0000 (UTC) Received: from localhost (unknown [10.72.112.97]) by smtp.corp.redhat.com (Postfix) with ESMTPS id 2C8B82026D4C; Thu, 23 Nov 2023 08:27:12 +0000 (UTC) Date: Thu, 23 Nov 2023 16:27:09 +0800 From: Baoquan He To: Ignat Korchagin Subject: Re: Potential config regression after 89cde455 ("kexec: consolidate kexec and crash options into kernel/Kconfig.kexec") Message-ID: References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Scanned-By: MIMEDefang 3.4.1 on 10.11.54.4 X-Mailman-Approved-At: Fri, 24 Nov 2023 09:22:20 +1100 X-BeenThere: linuxppc-dev@lists.ozlabs.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux on PowerPC Developers Mail List List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: chenhuacai@kernel.org, linux-ia64@vger.kernel.org, linux-sh@vger.kernel.org, Peter Zijlstra , catalin.marinas@arm.com, linus.walleij@linaro.org, dave.hansen@linux.intel.com, linux-mips@vger.kernel.org, James Bottomley , dalias@libc.org, eric_devolder@yahoo.com, linux-riscv@lists.infradead.org, will@kernel.org, kernel@xen0n.name, tsi@tuyoix.net, linux-s390@vger.kernel.org, agordeev@linux.ibm.com, rmk+kernel@armlinux.org.uk, hpa@zytor.com, paulmck@kernel.org, ysato@users.sourceforge.jp, kernel-team , deller@gmx.de, x86@kernel.org, linux@armlinux.org.uk, paul.walmsley@sifive.com, Ingo Molnar , geert@linux-m68k.org, hbathini@linux.ibm.com, samitolvanen@google.com, ojeda@kernel.org, juerg.haefliger@canonical.com, borntraeger@linux.ibm.com, frederic@kernel.org, arnd@arndb.de, mhiramat@kernel.org, Ard Biesheuvel , thunder.leizhen@huawei.com, aou@eecs.berkeley.edu, keescook@chromium.org, gor@linux.ibm.com, anshuman.khandual@arm.com, hca@linux.ibm.com, xin3.li@intel.com, npiggin@gmail.com, konrad.wilk@oracle.com, linux-m68k@lists.linux-m68k.org, Borislav Petkov , loongarch@lists.linux.dev, glaubitz@physik.fu-berlin.de, Thomas Gleixner , ziy@nvidia.com, linux-arm-kernel@lists.infradead.org, boris.ostrovsky@oracle.com, tsbogend@alpha.franken.de, sebastian.reichel@collabora.com, linux-parisc@vger.kernel.org, Greg KH , kirill.shutemov@linux.intel.com, ndesaulniers@google.com, linux-kernel , sourabhjain@linux.ibm.com, palmer@dabbelt.com, svens@linux.ibm.com, tj@kernel.org, Andrew Morton , linuxppc-dev@lists.ozlabs.org, masahiroy@kernel.org, rppt@kernel.org Errors-To: linuxppc-dev-bounces+linuxppc-dev=archiver.kernel.org@lists.ozlabs.org Sender: "Linuxppc-dev" On 11/22/23 at 09:47am, Ignat Korchagin wrote: > On Wed, Nov 22, 2023 at 9:34 AM Baoquan He wrote: > > > > On 11/21/23 at 09:43am, Ignat Korchagin wrote: > > > On Tue, Nov 21, 2023 at 7:53 AM Ignat Korchagin wrote: > > > > > > > > On Tue, Nov 21, 2023 at 1:50 AM Baoquan He wrote: > > > > > > > > > > Eric DeVolder's Oracle mail address is not available anymore, add his > > > > > current mail address he told me. > > > > > > > > Thank you! > > > > > > > > > On 11/20/23 at 10:52pm, Ignat Korchagin wrote: > > > > > > Good day! > > > > > > > > > > > > We have recently started to evaluate Linux 6.6 and noticed that we > > > > > > cannot disable CONFIG_KEXEC anymore, but keep CONFIG_CRASH_DUMP > > > > > > enabled. It seems to be related to commit 89cde455 ("kexec: > > > > > > consolidate kexec and crash options into kernel/Kconfig.kexec"), where > > > > > > a CONFIG_KEXEC dependency was added to CONFIG_CRASH_DUMP. > > > > > > > > > > > > In our current kernel (Linux 6.1) we only enable CONFIG_KEXEC_FILE > > > > > > with enforced signature check to support the kernel crash dumping > > > > > > functionality and would like to keep CONFIG_KEXEC disabled for > > > > > > security reasons [1]. > > > > > > > > > > > > I was reading the long commit message, but the reason for adding > > > > > > CONFIG_KEXEC as a dependency for CONFIG_CRASH_DUMP evaded me. And I > > > > > > believe from the implementation perspective CONFIG_KEXEC_FILE should > > > > > > suffice here (as we successfully used it for crashdumps on Linux 6.1). > > > > > > > > > > > > Is there a reason for adding this dependency or is it just an > > > > > > oversight? Would some solution of requiring either CONFIG_KEXEC or > > > > > > CONFIG_KEXEC_FILE work here? > > > > > > > > > > I searched the patch history, found Eric didn't add the dependency on > > > > > CONFIG_KEXEC at the beginning. Later a linux-next building failure with > > > > > randconfig was reported, in there CONFIG_CRASH_DUMP enabled, while > > > > > CONFIG_KEXEC is disabled. Finally Eric added the KEXEC dependency for > > > > > CRASH_DUMP. Please see below link for more details: > > > > > > > > > > https://lore.kernel.org/all/3e8eecd1-a277-2cfb-690e-5de2eb7b988e@oracle.com/T/#u > > > > > > > > Thank you for digging this up. However I'm still confused, because > > > > this is exactly how we configure Linux 6.1 (although we do have > > > > CONFIG_KEXEC_FILE enabled) and we don't have any problems. I believe > > > > we did not investigate this issue properly. > > > > > > I did some preliminary investigation for this. If I patch out the > > > dependency on CONFIG_KEXEC the kernel builds just fine for x86 > > > (without CONFIG_CRASH_HOTPLUG - which is probably another issue) - so > > > this was the previous behaviour. I can see that the reported error is > > > for arm architecture and was able to reproduce it with a simple cross > > > compiler in Debian. However, I think it is still somehow related to > > > this patchset as the previous kernels (up to 6.5) build fine with just > > > CONFIG_CRASH_DUMP and without CONFIG_KEXEC for arm as well. So even > > > for arm it was introduced in 6.6. > > > > Thanks for the information. > > > > I haven't run the reproducer of issue reported on Eric's old patchset, > > while checkout to kernel 6.1, only s390 selected KEXEC for CRASH_DUMP > > already. And with the ARM building breakage, the simplest idea is > > to select KEXEC only for ARM or S390 CRASH_DUMP. I plan to try the > > reproducer later. If you have any idea or draft patch, please feel free > > to post. > > The thing is - before 6.6 even ARM did not require KEXEC for > CRASH_DUMP (at least to successfully compile), so I think we should > understand what changed first before adding a dependency for ARM. I'll > try to investigate more, if I have time. I did a cross compiling of arm on x86_64, it clearly requires KEXEC for CRASH_DUMP if the select of KEXEC for CRASH_DUMP is removed and CONFIG_KEXEC=n is set. 1) building error, only copy the first one: ========================================== In file included from ../include/linux/ima.h:13, from ../security/keys/key.c:16: ../include/linux/kexec.h:38:2: error: #error KEXEC_SOURCE_MEMORY_LIMIT not defined 38 | #error KEXEC_SOURCE_MEMORY_LIMIT not defined | ^~~~~ ../include/linux/kexec.h:42:2: error: #error KEXEC_DESTINATION_MEMORY_LIMIT not defined 42 | #error KEXEC_DESTINATION_MEMORY_LIMIT not defined | ^~~~~ ../include/linux/kexec.h:46:2: error: #error KEXEC_CONTROL_MEMORY_LIMIT not defined 46 | #error KEXEC_CONTROL_MEMORY_LIMIT not defined | ^~~~~ ../include/linux/kexec.h:54:2: error: #error KEXEC_CONTROL_PAGE_SIZE not defined 54 | #error KEXEC_CONTROL_PAGE_SIZE not defined | ^~~~~ ../include/linux/kexec.h:58:2: error: #error KEXEC_ARCH not defined 58 | #error KEXEC_ARCH not defined | ^~~~~ In file included from ../drivers/misc/pvpanic/pvpanic.c:13: 2) Kconfig items I enabled: ==== CONFIG_CRASH_CORE=y CONFIG_KEXEC_CORE=y # CONFIG_KEXEC is not set CONFIG_CRASH_DUMP=y 3) KEXEC select is dropped so as not to enable KEXEC automatically: ===== diff --git a/kernel/Kconfig.kexec b/kernel/Kconfig.kexec index 7aff28ded2f4..1cc3b1c595d7 100644 --- a/kernel/Kconfig.kexec +++ b/kernel/Kconfig.kexec @@ -97,7 +97,6 @@ config CRASH_DUMP depends on ARCH_SUPPORTS_KEXEC select CRASH_CORE select KEXEC_CORE - select KEXEC help Generate crash dump after being started by kexec. This should be normally only set in special crash dump kernels > > > diff --git a/kernel/Kconfig.kexec b/kernel/Kconfig.kexec > > index 7aff28ded2f4..382dcd8d7a9d 100644 > > --- a/kernel/Kconfig.kexec > > +++ b/kernel/Kconfig.kexec > > @@ -97,7 +97,7 @@ config CRASH_DUMP > > depends on ARCH_SUPPORTS_KEXEC > > select CRASH_CORE > > select KEXEC_CORE > > - select KEXEC > > + select KEXEC if (ARM || S390) > > > > > > arch/s390/Kconfig in kernel 6.1: > > config CRASH_DUMP > > bool "kernel crash dumps" > > select KEXEC > > help > > Generate crash dump after being started by kexec. > > Crash dump kernels are loaded in the main kernel with kexec-tools > > into a specially reserved region and then later executed after > > a crash by kdump/kexec. > > Refer to for more details on this. > > This option also enables s390 zfcpdump. > > See also > > > > > > > > > > And besides, the newly added CONFIG_CRASH_HOTPLUG also needs > > > > > CONFIG_KEXEC if the elfcorehdr is allowed to be manipulated when > > > > > cpu/memory hotplug hapened. > > > > > > > > This still feels like a regression to me: any crash dump support > > > > should be independent of KEXEC syscalls being present. While probably > > > > the common case (including us) that the crashing kernel and recovery > > > > kernel are the same, they don't have to be. We need kexec syscall in > > > > the crashing kernel, but crashdump support in the recovery kernel (but > > > > the recovery kernel not having the kexec syscalls should be totally > > > > fine). If we do require some code definitions from kexec - at most we > > > > should put them under CONFIG_KEXEC_CORE. > > > > > > > > > Thanks > > > > > Baoquan > > > > > > > > > > > Ignat > > > > > >