From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id DC974CDB474 for ; Tue, 17 Oct 2023 15:32:28 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1344330AbjJQPc2 (ORCPT ); Tue, 17 Oct 2023 11:32:28 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:33184 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229459AbjJQPc0 (ORCPT ); Tue, 17 Oct 2023 11:32:26 -0400 Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 3D16292; Tue, 17 Oct 2023 08:32:25 -0700 (PDT) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 61EBDC433C8; Tue, 17 Oct 2023 15:32:24 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1697556744; bh=gEjMKkoJZQgKHA815iyJtPqk+ih8igqa9RyW+EN97CE=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=gOjHqgEIBPUKbXerOqT4j3GgldYb+fLWbr/jxY2/CGAsZVBJellxxATXsMp0TLFOr v7DueZntYAQQdRmuDg05xw+zEcIsGnVfL0t2k9RoZV3rPTiWvf3rrOcDWN+Dq5ZN2w hTlffSw8MCOHdD8iLUJgRSW/Kb31gGwK9w3+yZRgwNwGQ7zBjZSYadSVHWzIWZZxGF 3P+63BnLCNyqHko13Pdsinh1akIWIeLqUrLNmTnfCr+ue/8bZ+bESAkhdln+oJOEVD M1nAXIw6WEqP0qBhZnp/fSh0RfvyhG+iZxLEsE8lipGQPYpEJ9WjeFPwkRAKGkqbQG wprIGMwCwOz1g== Date: Tue, 17 Oct 2023 08:32:22 -0700 From: Nathan Chancellor To: Josh Poimboeuf Cc: "Kaplan, David" , Borislav Petkov , "linux-kernel@vger.kernel.org" , "linux-tip-commits@vger.kernel.org" , Ingo Molnar , "Peter Zijlstra (Intel)" , "x86@kernel.org" , "llvm@lists.linux.dev" Subject: Re: [tip: x86/bugs] x86/retpoline: Ensure default return thunk isn't used at runtime Message-ID: <20231017153222.GA707258@dev-arch.thelio-3990X> References: <20231012141031.GHZSf+V1NjjUJTc9a9@fat_crate.local> <169713303534.3135.10558074245117750218.tip-bot2@tip-bot2> <20231016211040.GA3789555@dev-arch.thelio-3990X> <20231016212944.GGZS2rSCbIsViqZBDe@fat_crate.local> <20231016214810.GA3942238@dev-arch.thelio-3990X> <20231017052834.v53regh66hspv45n@treble> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20231017052834.v53regh66hspv45n@treble> Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Mon, Oct 16, 2023 at 10:28:34PM -0700, Josh Poimboeuf wrote: > On Tue, Oct 17, 2023 at 04:31:09AM +0000, Kaplan, David wrote: > > I think I found the problem, although I'm not sure the best way to fix it. > > > > When KCSAN is enabled, GCC generates lots of constructor functions named _sub_I_00099_0 which call __tsan_init and then return. The returns in these are generally annotated normally by objtool and fixed up at runtime. But objtool runs on vmlinux.o and vmlinux.o does not include a couple of object files that are in vmlinux, like init/version-timestamp.o and .vmlinux.export.o, both of which contain _sub_I_00099_0 functions. As a result, the returns in these functions are not annotated, and the panic occurs when we call one of them in do_ctors and it uses the default return thunk. > > > > This difference can be seen by counting the number of these functions in the object files: > > $ objdump -d vmlinux.o|grep -c "<_sub_I_00099_0>:" > > 2601 > > $ objdump -d vmlinux|grep -c "<_sub_I_00099_0>:" > > 2603 > > > > If these functions are only run during kernel boot, there is no speculation concern. My first thought is that these two object files perhaps should be built without -mfunction-return=thunk-extern. The use of that flag requires objtool to have the intended behavior and objtool isn't seeing these files. > > > > Perhaps another option would be to not compile these two files with KCSAN, as they are already excluded from KASAN and GCOV it looks like. > > I think the latter would be the easy fix, does this make it go away? Tested-by: Nathan Chancellor Thanks for figuring this out! > diff --git a/init/Makefile b/init/Makefile > index ec557ada3c12..cbac576c57d6 100644 > --- a/init/Makefile > +++ b/init/Makefile > @@ -60,4 +60,5 @@ include/generated/utsversion.h: FORCE > $(obj)/version-timestamp.o: include/generated/utsversion.h > CFLAGS_version-timestamp.o := -include include/generated/utsversion.h > KASAN_SANITIZE_version-timestamp.o := n > +KCSAN_SANITIZE_version-timestamp.o := n > GCOV_PROFILE_version-timestamp.o := n > diff --git a/scripts/Makefile.vmlinux b/scripts/Makefile.vmlinux > index 3cd6ca15f390..c9f3e03124d7 100644 > --- a/scripts/Makefile.vmlinux > +++ b/scripts/Makefile.vmlinux > @@ -19,6 +19,7 @@ quiet_cmd_cc_o_c = CC $@ > > ifdef CONFIG_MODULES > KASAN_SANITIZE_.vmlinux.export.o := n > +KCSAN_SANITIZE_.vmlinux.export.o := n > GCOV_PROFILE_.vmlinux.export.o := n > targets += .vmlinux.export.o > vmlinux: .vmlinux.export.o