From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from lists.ozlabs.org (lists.ozlabs.org [112.213.38.117]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 7E039C61DD6 for ; Fri, 4 Sep 2026 11:00:42 +0000 (UTC) Received: from boromir.ozlabs.org (localhost [127.0.0.1]) by lists.ozlabs.org (Postfix) with ESMTP id 4hbtmT07whz2y2b; Fri, 04 Sep 2026 21:00:41 +1000 (AEST) Authentication-Results: lists.ozlabs.org; arc=none smtp.remote-ip=37.157.195.192 ARC-Seal: i=1; a=rsa-sha256; d=lists.ozlabs.org; s=201707; t=1788519640; cv=none; b=D0r3t40fImo4odLO0eHWLfcXtFXRypb+ZV2o+BAXCsKWoKe4fUzaz/ClZfzJrUD37OrbBLNNVYvuwqn9R8Ebj8rOa0Cv5LAEmstgiBbASTsYdTVWPwkTSWFTlwquA034wev3bAmUpkkivbEhLfXbX31YrgKDF5TsK2mPIW7ls+EpwMJCjzlcepDHIJwN8H2Sj5K67j1JETUwicjCcSJIrUWiJtK4S8l6EvZP9qsSPYM9X7e00JxfLhrR4ytjbHLVtu0+JA6hGnJ82DwAO7kNRCmeg/J+VDmXkO4ANgIfIL7vF/VsVOuDcZNSJfWtpTU3Fu3XmHrYthCCUWDBfiHSvw== ARC-Message-Signature: i=1; a=rsa-sha256; d=lists.ozlabs.org; s=201707; t=1788519640; c=relaxed/relaxed; bh=AzCqPBTtPBL/sAhJpoaTQ2eRTLxeOM+YBGdqfo+T+24=; h=Date:From:To:Subject:Message-Id:Mime-Version:Content-Type; b=eDM6RBCJC4Xlfcgp8LjXH/6QZQWwD8HUmqVuI3KrWuFhEBwOdZ6J5LjIkskUyyTkJ4+NQ124CYeGZBxPAvyY2+dMjUXz4bmP3hEvETZubCIVcgAYA0wiVb2VPcKtpih7ImrkD4OWtefw8DHIy0gOPN79FB24z0m1axtWO9tvOs8tVwVbICzs/zIE4DsPBINGqW7al7hAJOsG9t5BlIkIQFyY63O65Dr6V0Oxh1RVK1hPHw1RIe8RI/UTiJh0Ues2QxfhjxZY16FgWWEjCoHjpXW8f8Rv/Msc6tlGIymRW8FD2WALLkCm5fjqVwUCcc4tvwNWmB3av8Xl/2bXfaeI0Q== ARC-Authentication-Results: i=1; lists.ozlabs.org; dmarc=none (p=none dis=none) header.from=danny.cz; spf=pass (client-ip=37.157.195.192; helo=redcrew.org; envelope-from=dan@danny.cz; receiver=lists.ozlabs.org) smtp.mailfrom=danny.cz Authentication-Results: lists.ozlabs.org; dmarc=none (p=none dis=none) header.from=danny.cz Authentication-Results: lists.ozlabs.org; spf=pass (sender SPF authorized) smtp.mailfrom=danny.cz (client-ip=37.157.195.192; helo=redcrew.org; envelope-from=dan@danny.cz; receiver=lists.ozlabs.org) X-Greylist: delayed 404 seconds by postgrey-1.37 at boromir; Fri, 04 Sep 2026 21:00:38 AEST Received: from redcrew.org (redcrew.org [37.157.195.192]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.ozlabs.org (Postfix) with ESMTPS id 4hbtmQ6jBcz2y22 for ; Fri, 04 Sep 2026 21:00:37 +1000 (AEST) Received: from server.danny.cz (85-71-161-19.rce.o2.cz [85.71.161.19]) by redcrew.org (Postfix) with ESMTP id 8E4E1E8 for ; Fri, 4 Sep 2026 12:53:50 +0200 (CEST) DKIM-Filter: OpenDKIM Filter v2.11.0 redcrew.org 8E4E1E8 Received: from talos.danny.cz (talos [IPv6:2001:470:5c11:160:47df:83f6:718e:218]) by server.danny.cz (Postfix) with SMTP id 42A6217A004 for ; Fri, 4 Sep 2026 12:53:50 +0200 (CEST) Date: Fri, 4 Sep 2026 12:53:49 +0200 From: Dan =?UTF-8?B?SG9yw6Fr?= To: linuxppc-dev@lists.ozlabs.org Subject: systemd-journal segfaulting with 7.3-rc1 on ppc64le Message-Id: <20260904125349.15b764f80bc54296b88e8f87@danny.cz> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; powerpc64le-redhat-linux-gnu) X-Mailing-List: linuxppc-dev@lists.ozlabs.org List-Id: List-Help: List-Owner: List-Post: List-Archive: , List-Subscribe: , , List-Unsubscribe: Precedence: list Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Hi, I am using the rc kernels via https://fedoraproject.org/wiki/RawhideKernelNodebug on my Fedora 44 Power9 based system (Talos II) and after installing kernel-7.3.0-0.rc1.18.fc46.ppc64le my system failed to boot successfully and I have found systemd-journal segfaults in the boot log like this [ 12.485876] systemd-coredump[1464]: Process 1409 (systemd-journal) of user 0 terminated abnormally with signal 6/ABRT, processing... [ 12.578533] systemd-coredump[1464]: Process 1409 (systemd-journal) of user 0 dumped core. [ 12.578554] systemd-coredump[1464]: Coredump diverted to /var/lib/systemd/coredump/core.systemd-journal.0.b7f8bc16143c4cc1832aeb4c64ff16a4.1409.1788339090000000.zst [ 12.578560] systemd-coredump[1464]: Module libpcre2-8.so.0 from rpm pcre2-10.47-1.fc44.1.ppc64le [ 12.578566] systemd-coredump[1464]: Module libselinux.so.1 from rpm libselinux-3.11-1.fc44.ppc64le [ 12.578572] systemd-coredump[1464]: Module libz.so.1 from rpm zlib-ng-2.3.3-3.fc44.ppc64le [ 12.578578] systemd-coredump[1464]: Module libcrypto.so.3 from rpm openssl-3.5.8-1.fc44.ppc64le [ 12.578583] systemd-coredump[1464]: Module libcrypt.so.2 from rpm libxcrypt-4.5.2-3.fc44.ppc64le [ 12.578596] systemd-coredump[1464]: Module libsystemd-shared-259.8-1.fc44.so from rpm systemd-259.8-1.fc44.ppc64le [ 12.578602] systemd-coredump[1464]: Module systemd-journald from rpm systemd-259.8-1.fc44.ppc64le [ 12.578608] systemd-coredump[1464]: Stack trace of thread 1409: [ 12.578613] systemd-coredump[1464]: #0 0x00007fffaa82ae74 abort (libc.so.6 + 0x2ae74) [ 12.578619] systemd-coredump[1464]: #1 0x00007fffaa8a4e60 __libc_message_impl (libc.so.6 + 0xa4e60) [ 12.578624] systemd-coredump[1464]: #2 0x00007fffaa8a4eec __libc_fatal (libc.so.6 + 0xa4eec) [ 12.578630] systemd-coredump[1464]: #3 0x00007fffaa8b54bc start_thread (libc.so.6 + 0xb54bc) [ 12.578635] systemd-coredump[1464]: #4 0x00007fffaa9613e8 __clone (libc.so.6 + 0x1613e8) [ 12.578641] systemd-coredump[1464]: #5 0x00007fffaa9613e8 __clone (libc.so.6 + 0x1613e8) [ 12.578646] systemd-coredump[1464]: #6 0x00007fffaa8b4e40 create_thread.constprop.0 (libc.so.6 + 0xb4e40) [ 12.578652] systemd-coredump[1464]: #7 0x00007fffe66094a0 n/a (n/a + 0x0) [ 12.578657] systemd-coredump[1464]: ELF object binary architecture: PowerPC64 [ 12.646917] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 2. I have reproduced the behaviour with the latest mainline kernel and my bisecting points to https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/commit/?id=3424d8c18a7da1010d03391a22e728b857d0d5c5 (which is not that helpful as it is a merge commit). There are also messages about "dbus-broker.service: Failed with result 'exit-code'", so the journal crash might be a symptom of another root cause. Using the Fedora prebuilt kernels - kernel-7.3.0-0.rc0.260818g0f23d56f17fd.3.fc46.ppc64le = OK - kernel-7.3.0-0.rc0.260819gbd5f485f3f02.5.fc46.ppc64le = BAD doesn't help much in narrowing as it is when the big merges happened. --- git bisect start # status: waiting for both 'good' and 'bad' commits # good: [8d3ae59288f1e7d58d76558a6ee96d533bc5019f] Linux 7.2 git bisect good 8d3ae59288f1e7d58d76558a6ee96d533bc5019f # status: waiting for 'bad' commit, 1 'good' commit known # bad: [cee9395acd8043be0644b25c34bfa86623f2b935] Linux 7.3-rc1 git bisect bad cee9395acd8043be0644b25c34bfa86623f2b935 # bad: [55ab7e14222e5f0b0fd9f7711ca391d2924b35e3] Merge tag 'for-7.3/block-20260819' of git://git.kernel.org/pub/scm/linux/kernel/git/axboe/linux git bisect bad 55ab7e14222e5f0b0fd9f7711ca391d2924b35e3 # bad: [e5c91aac491def6ab3f90c4cc246e3fcb0f8f058] Merge tag 'sound-7.3-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/tiwai/sound git bisect bad e5c91aac491def6ab3f90c4cc246e3fcb0f8f058 # bad: [cbe8aadf1551f3f4a853f24b3b96d9f0eea49c53] Merge tag 'soc-dt-7.3' of git://git.kernel.org/pub/scm/linux/kernel/git/soc/soc git bisect bad cbe8aadf1551f3f4a853f24b3b96d9f0eea49c53 # bad: [762fffa407d8d24288513538cf5d17c2c5425258] Merge tag 'irq-core-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect bad 762fffa407d8d24288513538cf5d17c2c5425258 # good: [a5778046a02570fd23bdf0b48dce330237d1996c] Merge tag 'pm-7.3-rc1' of git://git.kernel.org/pub/scm/linux/kernel/git/rafael/linux-pm git bisect good a5778046a02570fd23bdf0b48dce330237d1996c # good: [85cdaca6970028bf6f544c355c90035586836ddf] Merge tag 'arm64-upstream' of git://git.kernel.org/pub/scm/linux/kernel/git/arm64/linux git bisect good 85cdaca6970028bf6f544c355c90035586836ddf # good: [8915457146a11d20a6c0786396376afda65eec40] Merge tag 'perf-core-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good 8915457146a11d20a6c0786396376afda65eec40 # good: [e2457a664ea02c414c6b9828bff3a0df4c300f63] Merge tag 'sched-core-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good e2457a664ea02c414c6b9828bff3a0df4c300f63 # good: [3a0dd7ba4f44cdc116d83712f61e7c1a95be3588] Merge tag 'x86-documentation-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect good 3a0dd7ba4f44cdc116d83712f61e7c1a95be3588 # good: [fb419d53f2619e29bf4f96613d9a614e1c263736] x86/entry: Simplify the syscall number logic git bisect good fb419d53f2619e29bf4f96613d9a614e1c263736 # bad: [6138016752322261e26ac88eaeb64c0c890f98a2] Merge tag 'core-rseq-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect bad 6138016752322261e26ac88eaeb64c0c890f98a2 # good: [71ff30013f19ca46c2c72c25731c32b6cc7b5620] entry: Make return type of syscall_trace_enter() bool git bisect good 71ff30013f19ca46c2c72c25731c32b6cc7b5620 # good: [2a98ffac7733e77a178af7240f9fa9392ca45aad] selftests/rseq: Add missing test binaries to .gitignore git bisect good 2a98ffac7733e77a178af7240f9fa9392ca45aad # bad: [3424d8c18a7da1010d03391a22e728b857d0d5c5] Merge tag 'core-entry-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip git bisect bad 3424d8c18a7da1010d03391a22e728b857d0d5c5 # good: [05c033db7e9ad3c34f6968ec568cb6ee01051c57] entry, treewide: Make syscall_enter_from_user_mode[_work]() indicate syscall execution git bisect good 05c033db7e9ad3c34f6968ec568cb6ee01051c57 # first 'bad' commit: [3424d8c18a7da1010d03391a22e728b857d0d5c5] Merge tag 'core-entry-2026-08-17' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip --- Also can be reproduced by using the recent Fedora Rawhide installers which won't initialize properly. Thanks, Dan