From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-15.8 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 035DCC4332E for ; Thu, 18 Mar 2021 17:24:29 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id DA0E964F10 for ; Thu, 18 Mar 2021 17:24:28 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232342AbhCRRYE (ORCPT ); Thu, 18 Mar 2021 13:24:04 -0400 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:35972 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232020AbhCRRXg (ORCPT ); Thu, 18 Mar 2021 13:23:36 -0400 Received: from desiato.infradead.org (desiato.infradead.org [IPv6:2001:8b0:10b:1:d65d:64ff:fe57:4e05]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id DE04CC06174A for ; Thu, 18 Mar 2021 10:23:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=infradead.org; s=desiato.20200630; h=Content-Type:MIME-Version:References: Subject:Cc:To:From:Date:Message-ID:Sender:Reply-To:Content-Transfer-Encoding: Content-ID:Content-Description:In-Reply-To; bh=fff8wSjsFEVSScoLrEbNTADtep5HrGXAsNkRLBAqrKs=; b=p5xydzFnzKFJTr+jh//KAO2628 Pm1v/8yAYlXZqfTKwnp/y3pgrFG+oJsjbfqGz3JGDH752IjDp29XtZF7xfZF9Dybk275CHqInPuyY tpH5TE1r+yRkDPGCx0MuFVWDCPs6AZMdR4lk1kYKpP1UY5K3eCrD71mSXL1dEFDAfShHywLO0zLPs WEVDROgK0FqNyNhax/nkMkrcXNL0T9YeNXc6F7vvHAT+sIchXlyImWGwWddupsGrcwlSAKRYsjwMd pdlPl3yeAb23xIcVR8CmBt4X/NL/SEFnlt9oGIyxaUd46zYejJj0AG2CyPdI+PwVVTbin9dBtS+9J 7EqDHXEQ==; Received: from j217100.upc-j.chello.nl ([24.132.217.100] helo=noisy.programming.kicks-ass.net) by desiato.infradead.org with esmtpsa (Exim 4.94 #2 (Red Hat Linux)) id 1lMwMq-005kF2-MI; Thu, 18 Mar 2021 17:23:28 +0000 Received: from hirez.programming.kicks-ass.net (hirez.programming.kicks-ass.net [192.168.1.225]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by noisy.programming.kicks-ass.net (Postfix) with ESMTPS id 595C930796A; Thu, 18 Mar 2021 18:23:27 +0100 (CET) Received: by hirez.programming.kicks-ass.net (Postfix, from userid 0) id 4AE3A213C0F58; Thu, 18 Mar 2021 18:23:27 +0100 (CET) Message-ID: <20210318171920.131630843@infradead.org> User-Agent: quilt/0.66 Date: Thu, 18 Mar 2021 18:11:15 +0100 From: Peter Zijlstra To: x86@kernel.org, jpoimboe@redhat.com, jgross@suse.com, mbenes@suse.com Cc: linux-kernel@vger.kernel.org, peterz@infradead.org Subject: [PATCH v2 12/14] objtool: Allow archs to rewrite retpolines References: <20210318171103.577093939@infradead.org> MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org When retpolines are employed, compilers typically emit calls to retpoline thunks. Objtool recognises these calls and marks them as dynamic calls. Provide infrastructure for architectures to rewrite/augment what the compiler wrote for us. Signed-off-by: Peter Zijlstra (Intel) --- tools/objtool/check.c | 23 +++++++++++++++++++++-- tools/objtool/include/objtool/arch.h | 3 +++ 2 files changed, 24 insertions(+), 2 deletions(-) --- a/tools/objtool/check.c +++ b/tools/objtool/check.c @@ -852,6 +852,14 @@ __weak bool arch_is_retpoline(struct sym return false; } + +__weak int arch_rewrite_retpoline(struct objtool_file *file, + struct instruction *insn, + struct reloc *reloc) +{ + return 0; +} + /* * Find the destination instructions for all jumps. */ @@ -885,6 +893,9 @@ static int add_jump_destinations(struct insn->type = INSN_JUMP_DYNAMIC_CONDITIONAL; insn->retpoline_safe = true; + + arch_rewrite_retpoline(file, insn, reloc); + continue; } else if (insn->func) { /* internal or external sibling call (with reloc) */ @@ -1036,6 +1047,8 @@ static int add_call_destinations(struct insn->type = INSN_CALL_DYNAMIC; insn->retpoline_safe = true; + arch_rewrite_retpoline(file, insn, reloc); + remove_insn_ops(insn); continue; @@ -1212,6 +1225,8 @@ static int handle_group_alt(struct objto dest_off = arch_jump_destination(insn); if (dest_off == special_alt->new_off + special_alt->new_len) insn->jump_dest = next_insn_same_sec(file, last_orig_insn); + else + insn->jump_dest = find_insn(file, insn->sec, dest_off); if (!insn->jump_dest) { WARN_FUNC("can't find alternative jump destination", @@ -1797,11 +1812,15 @@ static int decode_sections(struct objtoo if (ret) return ret; - ret = add_jump_destinations(file); + /* + * Must be before add_{jump,call}_destination; for they can add + * magic alternatives. + */ + ret = add_special_section_alts(file); if (ret) return ret; - ret = add_special_section_alts(file); + ret = add_jump_destinations(file); if (ret) return ret; --- a/tools/objtool/include/objtool/arch.h +++ b/tools/objtool/include/objtool/arch.h @@ -82,6 +82,9 @@ unsigned long arch_jump_destination(stru unsigned long arch_dest_reloc_offset(int addend); const char *arch_nop_insn(int len); +int arch_rewrite_retpoline(struct objtool_file *file, + struct instruction *insn, + struct reloc *reloc); int arch_decode_hint_reg(struct instruction *insn, u8 sp_reg);