From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from smtp.kernel.org (aws-us-west-2-korg-mail-1.web.codeaurora.org [10.30.226.201]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 513A52139D2; Tue, 4 Feb 2025 14:50:07 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=10.30.226.201 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1738680608; cv=none; b=HHx3cW4W8qDuNsk5yAUhuigTsFSQ+nj4X7VzXCHMbdIXr+ov/hK9J//GT49q0yPsOkvpMH6/rlmWBe5fqgVnetn7YD7ALnYKX76PBgK6ZLm39smn3HsQ6H0nrAvw7jnJsyanLmEJ2ouj6kbgqM7c0eEZcSPqKiTdQFEhymlMDJs= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1738680608; c=relaxed/simple; bh=6oUouKp7uR/JpMO1k+/4EobZmOrqM2qkaM9b819xH9A=; h=From:To:Cc:Subject:In-Reply-To:References:Date:Message-ID: MIME-Version:Content-Type; b=h8nm5EWWFq1aCyco+mWOqEnLLtJVrRIJnNWqjawCoV7GbEMslHz5lPXRWJvH30PcOQVD3onpU23VlAbvB4mJybmF6ClryJ4BfrcBWfRebb8PZrJWV9N+d3906uo5W+kLNynBzj8MxRIfc4pPGrFo0WwvmhcHFXF7aU4tR6b/Zf4= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b=fQrmBLtV; arc=none smtp.client-ip=10.30.226.201 Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=kernel.org header.i=@kernel.org header.b="fQrmBLtV" Received: by smtp.kernel.org (Postfix) with ESMTPSA id 726C7C4CEDF; Tue, 4 Feb 2025 14:50:07 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1738680607; bh=6oUouKp7uR/JpMO1k+/4EobZmOrqM2qkaM9b819xH9A=; h=From:To:Cc:Subject:In-Reply-To:References:Date:From; b=fQrmBLtVaRu1YyNdrLfWKt47C2vhv7/FM52dr6hjnB2AAYXUvsL0A2OuTL3xcb7QG uyKXrNPDNRjnNQjdu2KznYONWo7qQWBcRGM4VqJwEo8CaP/StdUcSvI4Y7IRWr1bbK gRFzaZjzM3vEplbEAfolwp2WzgidqeF1Q5vxpsxsQcvOSZk2VCW5gtDLXIifJ04TXt 3AT4EFJHyZasnzb/tf9YyE0AgNMwDiUxrxzusuQuJTlwVIuVsoEZQFqu5lTnXcLOiY EwaWYdHnPZ5A4iFRfDKTCkv2TCO9DZmF0ig3F9OzrwURTZKTmGCU6MaH4+siqFJGiy Lpb0JOt7U/pQA== From: Puranjay Mohan To: Weinan Liu , Josh Poimboeuf , Steven Rostedt , Indu Bhagat , Peter Zijlstra Cc: Mark Rutland , roman.gushchin@linux.dev, Will Deacon , Ian Rogers , linux-toolchains@vger.kernel.org, linux-kernel@vger.kernel.org, live-patching@vger.kernel.org, joe.lawrence@redhat.com, linux-arm-kernel@lists.infradead.org, Weinan Liu Subject: Re: [PATCH 0/8] unwind, arm64: add sframe unwinder for kernel In-Reply-To: <20250127213310.2496133-1-wnliu@google.com> References: <20250127213310.2496133-1-wnliu@google.com> Date: Tue, 04 Feb 2025 14:49:49 +0000 Message-ID: Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" --=-=-= Content-Type: text/plain Weinan Liu writes: > This patchset implements a generic kernel sframe-based [1] unwinder. > The main goal is to support reliable stacktraces on arm64. > > On x86 orc unwinder provides reliable stacktraces. But arm64 misses the > required support from objtool: it cannot generate orc unwind tables for > arm64. > > Currently, there's already a sframe unwinder proposed for userspace: [2]. > Since the sframe unwind table algorithm is similar, these two proposal > could integrate common functionality in the future. > > There are some incomplete features or challenges: > - The unwinder doesn't yet work with kernel modules. The `start_addr` of > FRE from kernel modules doesn't appear correct, preventing us from > unwinding functions from kernel modules. > - Currently, only GCC supports sframe. > > Ref: > [1]: https://sourceware.org/binutils/docs/sframe-spec.html > [2]: https://lore.kernel.org/lkml/cover.1730150953.git.jpoimboe@kernel.org/ > Hi Weinan, Thanks for working on this. I tested this set on my setup and faced some issues, here are the details: Here is my setup [on AWS c6gd.16xlarge instance]: ------------------------------------------------- [root@ip-172-31-32-86 linux-upstream]# uname -a Linux ip-172-31-32-86.ec2.internal 6.14.0-rc1+ #1 SMP Tue Feb 4 14:15:55 UTC 2025 aarch64 aarch64 aarch64 GNU/Linux [root@ip-172-31-32-86 linux-upstream]# git log --oneline e9a702365 (HEAD -> master) arm64: Enable livepatch for ARM64 5dedc956e arm64: Define TIF_PATCH_PENDING for livepatch ba563b31a unwind: arm64: add reliable stacktrace support for arm64 d807d392d unwind: arm64: Add sframe unwinder on arm64 7872f050b unwind: Implement generic sframe unwinder library 03d2ad003 unwind: add sframe v2 header 5e95cc051 arm64: entry: add unwind info for various kernel entries faff6cbc3 unwind: build kernel with sframe info 0de63bb7d (origin/master, origin/HEAD) Merge tag 'pull-fix' of git://git.kernel.org/pub/scm/linux/kernel/git/viro/vfs 902e09c8a fix braino in "9p: fix ->rename_sem exclusion" f286757b6 Merge tag 'timers-urgent-2025-02-03' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip a360f3ffd (grafted) Merge tag 'irq-urgent-2025-02-03' of git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip bb2784d9a (grafted) jiffies: Cast to unsigned long in secs_to_jiffies() conversion 30d61efe1 (grafted) 9p: fix ->rename_sem exclusion [root@ip-172-31-32-86 linux-upstream]# grep SFRAME .config CONFIG_AS_HAS_SFRAME_SUPPORT=y CONFIG_SFRAME_UNWIND_TABLE=y CONFIG_SFRAME_UNWINDER=y [root@ip-172-31-32-86 linux-upstream]# grep LIVEPATCH .config CONFIG_HAVE_LIVEPATCH=y CONFIG_LIVEPATCH=y CONFIG_SAMPLE_LIVEPATCH=m [root@ip-172-31-32-86 linux-upstream]# as --version GNU assembler version 2.41-50.al2023.0.2 Copyright (C) 2023 Free Software Foundation, Inc. This program is free software; you may redistribute it under the terms of the GNU General Public License version 3 or later. This program has absolutely no warranty. This assembler was configured for a target of `aarch64-amazon-linux'. [root@ip-172-31-32-86 linux-upstream]# gcc --version gcc (GCC) 11.4.1 20230605 (Red Hat 11.4.1-2) Copyright (C) 2021 Free Software Foundation, Inc. This is free software; see the source for copying conditions. There is NO warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. Loading the livepatch-sameple module: ------------------------------------- [root@ip-172-31-32-86 linux-upstream]# kpatch load /lib/modules/6.14.0-rc1+/kernel/samples/livepatch/livepatch-sample.ko loading patch module: /lib/modules/6.14.0-rc1+/kernel/samples/livepatch/livepatch-sample.ko waiting (up to 15 seconds) for patch transition to complete... patch transition has stalled! <4>kpatch: Livepatch process signaling is performed automatically on your system. <4>kpatch: Skipping manual process signaling. waiting (up to 60 seconds) for patch transition to complete... Stalled processes: 340 kdevtmpfs stack: [<0>] devtmpfs_work_loop+0x2cc/0x2d8 [<0>] devtmpfsd+0x4c/0x58 [<0>] kthread+0xf0/0x100 [<0>] ret_from_fork+0x10/0x20 module livepatch_sample did not complete its transition, unloading... disabling patch module: livepatch_sample waiting (up to 15 seconds) for patch transition to complete... transition complete (3 seconds) unloading patch module: livepatch_sample <4>kpatch: error: failed to load module livepatch_sample (transition stalled) Useful messages from kernel log [pr_debug enabled]: --------------------------------------------------- livepatch: enabling patch 'livepatch_sample' livepatch: 'livepatch_sample': initializing patching transition livepatch: 'livepatch_sample': starting patching transition livepatch: klp_try_switch_task: kdevtmpfs:340 has an unreliable stack livepatch: klp_try_switch_task: insmod:9226 has an unreliable stack livepatch: klp_try_switch_task: swapper/63:0 is running [......SNIP.......] livepatch: klp_try_switch_task: kdevtmpfs:340 has an unreliable stack [......SNIP.......] livepatch: signaling remaining tasks livepatch: klp_try_switch_task: kdevtmpfs:340 has an unreliable stack livepatch: 'livepatch_sample': reversing transition from patching to unpatching livepatch: 'livepatch_sample': starting unpatching transition livepatch: klp_try_switch_task: swapper/45:0 is running livepatch: 'livepatch_sample': completing unpatching transition livepatch: 'livepatch_sample': unpatching complete Please let me know if you are aware of this already or if this is expected behaviour with this version. I will try to debug this from my side as well. Also let me know if you need more details for debugging this. P.S. - I also saw multiple build warning like: ld: warning: orphan section `.eh_frame' from `arch/arm64/kernel/entry.o' being placed in section `.eh_frame' ld: warning: orphan section `.init.sframe' from `arch/arm64/kernel/pi/lib-fdt.pi.o' being placed in section `.init.sframe' Thanks, Puranjay --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iIoEARYKADIWIQQ3wHGvVs/5bdl78BKwwPkjG3B2nQUCZ6IpDhQccHVyYW5qYXlA a2VybmVsLm9yZwAKCRCwwPkjG3B2ncTKAPwMyQYhH9SeQE1efMJ3svM0mOSDNKQP sdWn5z6J5QcjHQD7BOPVMZoBRetNo0/gEu1kDe6zVoV+uma42/iOhGGvRgA= =oCKP -----END PGP SIGNATURE----- --=-=-=--