public inbox for bpf@vger.kernel.org
 help / color / mirror / Atom feed
From: Yonghong Song <yonghong.song@linux.dev>
To: David Faust <david.faust@oracle.com>,
	Alan Maguire <alan.maguire@oracle.com>,
	mattbobrowski@google.com
Cc: eddyz87@gmail.com, ihor.solodrai@linux.dev, jolsa@kernel.org,
	andrii@kernel.org, ast@kernel.org, dwarves@vger.kernel.org,
	bpf@vger.kernel.org,
	"Jose E. Marchesi" <jose.marchesi@oracle.com>
Subject: Re: [PATCH dwarves 3/4] btf_encoder: Add true_signature feature support for "."-suffixed functions
Date: Wed, 14 Jan 2026 19:27:16 -0800	[thread overview]
Message-ID: <3c92a9f7-de65-438f-b785-a14ef441d257@linux.dev> (raw)
In-Reply-To: <9ad1097b-a450-401b-80ab-9c02a9700ede@oracle.com>



On 1/14/26 10:22 AM, David Faust wrote:
>
> On 1/14/26 08:55, Alan Maguire wrote:
>> On 14/01/2026 16:15, Yonghong Song wrote:
>>>
>>> On 1/13/26 5:13 AM, Alan Maguire wrote:
>>>> Currently we collate function information by name and add functions
>>>> provided there are no inconsistencies across various representations.
>>>>
>>>> For true_signature support - where we wish to add the real signature
>>>> of a function even if it differs from source level - we need to do
>>>> a few things:
>>>>
>>>> 1. For "."-suffixed functions, we need to match from DWARF->ELF;
>>>>      we can do this via the address associated with the function.
>>>>      In doing this, we can then be confident that the debug info
>>>>      for foo.isra.0 is the right info for the function at that
>>>>      address.
>>>>
>>>> 2. When adding saved functions we need to look for such cases
>>>>      and provided they do not violate other constraints around BTF
>>>>      representation - unexpected reg usage for function, uncertain
>>>>      parameter location or ambiguous address - we add them with
>>>>      their "."-suffixed name.  The latter can be used as a signal
>>>>      that the function is transformed from the original.
>>>>
>>>> Doing this adds 500 functions to BTF.  These are traceable with
>>>> their "."-suffix names and because we have excluded ambiguous
>>>> address cases we know exactly which function address they refer
>>>> to.
>>>>
>>>> Signed-off-by: Alan Maguire <alan.maguire@oracle.com>
>>>> ---
>>>>    btf_encoder.c | 73 ++++++++++++++++++++++++++++++++++++++++++++++-----
>>>>    dwarves.h     |  1 +
>>>>    pahole.c      |  1 +
>>>>    3 files changed, 68 insertions(+), 7 deletions(-)
>>>>
>>>> diff --git a/btf_encoder.c b/btf_encoder.c
>>>> index 5bc61cb..01fd469 100644
>>>> --- a/btf_encoder.c
>>>> +++ b/btf_encoder.c
>>>> @@ -77,9 +77,16 @@ struct btf_encoder_func_annot {
>>>>        int16_t component_idx;
>>>>    };
>>>>    +struct elf_function_sym {
>>>> +    const char *name;
>>>> +    uint64_t addr;
>>>> +};
>>>> +
>>>>    /* state used to do later encoding of saved functions */
>>>>    struct btf_encoder_func_state {
>>>>        struct elf_function *elf;
>>>> +    struct elf_function_sym *sym;
>>>> +    uint64_t addr;
>>>>        uint32_t type_id_off;
>>>>        uint16_t nr_parms;
>>>>        uint16_t nr_annots;
>>>> @@ -94,11 +101,6 @@ struct btf_encoder_func_state {
>>>>        struct btf_encoder_func_annot *annots;
>>>>    };
>>>>    -struct elf_function_sym {
>>>> -    const char *name;
>>>> -    uint64_t addr;
>>>> -};
>>>> -
>>>>    struct elf_function {
>>>>        char        *name;
>>>>        struct elf_function_sym *syms;
>>>> @@ -145,7 +147,8 @@ struct btf_encoder {
>>>>                  skip_encoding_decl_tag,
>>>>                  tag_kfuncs,
>>>>                  gen_distilled_base,
>>>> -              encode_attributes;
>>>> +              encode_attributes,
>>>> +              true_signature;
>>>>        uint32_t      array_index_id;
>>>>        struct elf_secinfo *secinfo;
>>>>        size_t             seccnt;
>>>> @@ -1271,14 +1274,34 @@ static int32_t btf_encoder__save_func(struct btf_encoder *encoder, struct functi
>>>>                goto out;
>>>>            }
>>>>        }
>>>> +    if (encoder->true_signature && fn->lexblock.ip.addr) {
>>>> +        int i;
>>>> +
>>>> +        for (i = 0; i < func->sym_cnt; i++) {
>>>> +            if (fn->lexblock.ip.addr != func->syms[i].addr)
>>>> +                continue;
>>>> +            /* Only need to record address for '.'-suffixed
>>>> +             * functions, since we only currently need true
>>>> +             * signatures for them.
>>>> +             */
>>>> +            if (!strchr(func->syms[i].name, '.'))
>>>> +                continue;
>>>> +            state->sym = &func->syms[i];
>>>> +            break;
>>>> +        }
>>>> +    }
>>>>        state->inconsistent_proto = ftype->inconsistent_proto;
>>>>        state->unexpected_reg = ftype->unexpected_reg;
>>>>        state->optimized_parms = ftype->optimized_parms;
>>>>        state->uncertain_parm_loc = ftype->uncertain_parm_loc;
>>>>        state->reordered_parm = ftype->reordered_parm;
>>>>        ftype__for_each_parameter(ftype, param) {
>>>> -        const char *name = parameter__name(param) ?: "";
>>>> +        const char *name;
>>>>    +        /* No location info + reordered means optimized out. */
>>>> +        if (ftype->reordered_parm && !param->has_loc)
>>>> +            continue;
>>>> +        name = parameter__name(param) ?: "";
>>>>            str_off = btf__add_str(btf, name);
>>>>            if (str_off < 0) {
>>>>                err = str_off;
>>>> @@ -1367,6 +1390,9 @@ static int32_t btf_encoder__add_func(struct btf_encoder *encoder,
>>>>          btf_fnproto_id = btf_encoder__add_func_proto_for_state(encoder, state);
>>>>        name = func->name;
>>>> +    if (encoder->true_signature && state->sym)
>>>> +        name = state->sym->name;
>>>> +
>>>>        if (btf_fnproto_id >= 0)
>>>>            btf_fn_id = btf_encoder__add_ref_type(encoder, BTF_KIND_FUNC, btf_fnproto_id,
>>>>                                  name, false);
>>>> @@ -1509,6 +1535,38 @@ static int btf_encoder__add_saved_funcs(struct btf_encoder *encoder, bool skip_e
>>>>            while (j < nr_saved_fns && saved_functions_combine(encoder, &saved_fns[i], &saved_fns[j]) == 0)
>>>>                j++;
>>>>    +        /* Add true signatures for case where we have an exact
>>>> +         * symbol match by address from DWARF->ELF and have a
>>>> +         * "." suffixed name.
>>>> +         */
>>>> +        if (encoder->true_signature) {
>>>> +            int k;
>>>> +
>>>> +            for (k = i; k < nr_saved_fns; k++) {
>>>> +                struct btf_encoder_func_state *true_state = &saved_fns[k];
>>>> +
>>>> +                if (state->elf != true_state->elf)
>>>> +                    break;
>>>> +                if (!true_state->sym)
>>>> +                    continue;
>>>> +                /* Unexpected reg, uncertain parm loc and
>>>> +                 * ambiguous address mean we cannot trust fentry.
>>>> +                 */
>>>> +                if (true_state->unexpected_reg ||
>>>> +                    true_state->uncertain_parm_loc ||
>>>> +                    true_state->ambiguous_addr)
>>>> +                    continue;
>>>> +                err = btf_encoder__add_func(encoder, true_state);
>>>> +                if (err < 0)
>>>> +                    goto out;
>>>> +                break;
>>>> +            }
>>>> +        }
>>>> +
>>>> +        /* True symbol that was handled above; skip. */
>>>> +        if (state->sym)
>>>> +            continue;
>>>> +
>>>>            /* do not exclude functions with optimized-out parameters; they
>>>>             * may still be _called_ with the right parameter values, they
>>>>             * just do not _use_ them.  Only exclude functions with
>>>> @@ -2585,6 +2643,7 @@ struct btf_encoder *btf_encoder__new(struct cu *cu, const char *detached_filenam
>>>>            encoder->tag_kfuncs     = conf_load->btf_decl_tag_kfuncs;
>>>>            encoder->gen_distilled_base = conf_load->btf_gen_distilled_base;
>>>>            encoder->encode_attributes = conf_load->btf_attributes;
>>>> +        encoder->true_signature = conf_load->true_signature;
>>>>            encoder->verbose     = verbose;
>>>>            encoder->has_index_type  = false;
>>>>            encoder->need_index_type = false;
>>>> diff --git a/dwarves.h b/dwarves.h
>>>> index 78bedf5..d7c6474 100644
>>>> --- a/dwarves.h
>>>> +++ b/dwarves.h
>>>> @@ -101,6 +101,7 @@ struct conf_load {
>>>>        bool            btf_decl_tag_kfuncs;
>>>>        bool            btf_gen_distilled_base;
>>>>        bool            btf_attributes;
>>>> +    bool            true_signature;
>>>>        uint8_t            hashtable_bits;
>>>>        uint8_t            max_hashtable_bits;
>>>>        uint16_t        kabi_prefix_len;
>>>> diff --git a/pahole.c b/pahole.c
>>>> index ef01e58..02a0d19 100644
>>>> --- a/pahole.c
>>>> +++ b/pahole.c
>>>> @@ -1234,6 +1234,7 @@ struct btf_feature {
>>>>        BTF_NON_DEFAULT_FEATURE(global_var, encode_btf_global_vars, false),
>>>>        BTF_NON_DEFAULT_FEATURE_CHECK(attributes, btf_attributes, false,
>>>>                          attributes_check),
>>>> +    BTF_NON_DEFAULT_FEATURE(true_signature, true_signature, false),
>>>>    };
>>>>      #define BTF_MAX_FEATURE_STR    1024
>>> Currently, in pahole, when checking whether signature has changed during
>>> optimization or not, we only check parameters.
>>>
>>> But compiler optimization may optimize away return value and such
>>> information is not available in dwarf.
>>>
>>> For example,
>>>
>>> $ cat test.c
>>> #include <stdio.h>
>>> unsigned tar(int a);
>>> __attribute__((noinline)) static int foo(int a, int b)
>>> {
>>>    return tar(a) + tar(a + 1);
>>> }
>>> __attribute__((noinline)) int bar(int a)
>>> {
>>>    foo(a, 1);
>>>    return 0;
>>> }
>>>
>>> In this particular case, the return value of foo() is actually not used
>>> and the compiler will optimize it away with returning void (at least
>>> for llvm).
>>>
>>> $ /opt/rh/gcc-toolset-15/root/usr/bin/gcc -O2 -g -c test.c
>>> $ llvm-dwarfdump test.o
>>> ...
>>> 0x000000d9:   DW_TAG_subprogram
>>>                  DW_AT_name      ("foo")
>>>                  DW_AT_decl_file ("/home/yhs/tests/sig-change/deadret/test.c")
>>>                  DW_AT_decl_line (3)
>>>                  DW_AT_decl_column       (38)
>>>                  DW_AT_prototyped        (true)
>>>                  DW_AT_type      (0x0000005d "int")
>>>                  DW_AT_inline    (DW_INL_inlined)
>>>                  DW_AT_sibling   (0x000000fb)
>>>                                                                                                                      0x000000ea:     DW_TAG_formal_parameter
>>>                    DW_AT_name    ("a")
>>>                    DW_AT_decl_file       ("/home/yhs/tests/sig-change/deadret/test.c")
>>>                    DW_AT_decl_line       (3)
>>>                    DW_AT_decl_column     (46)
>>>                    DW_AT_type    (0x0000005d "int")
>>>                                                                                                                      0x000000f2:     DW_TAG_formal_parameter
>>>                    DW_AT_name    ("b")
>>>                    DW_AT_decl_file       ("/home/yhs/tests/sig-change/deadret/test.c")
>>>                    DW_AT_decl_line       (3)
>>>                    DW_AT_decl_column     (53)
>>>                    DW_AT_type    (0x0000005d "int")
>>>
>>> 0x000000fa:     NULL
>>>
>>> 0x000000fb:   DW_TAG_subprogram
>>>                  DW_AT_abstract_origin   (0x000000d9 "foo")
>>>                  DW_AT_low_pc    (0x0000000000000000)
>>>                  DW_AT_high_pc   (0x0000000000000011)
>>>                  DW_AT_frame_base        (DW_OP_call_frame_cfa)
>>>                  DW_AT_call_all_calls    (true)
>>>
>>> 0x00000112:     DW_TAG_formal_parameter
>>>                    DW_AT_abstract_origin (0x000000ea "a")
>>>                    DW_AT_location        (0x00000026:
>>>                       [0x0000000000000000, 0x0000000000000007): DW_OP_reg5 RDI
>>>                       [0x0000000000000007, 0x000000000000000c): DW_OP_reg3 RBX
>>>                       [0x000000000000000c, 0x0000000000000010): DW_OP_breg5 RDI-1, DW_OP_stack_value
>>>                       [0x0000000000000010, 0x0000000000000011): DW_OP_entry_value(DW_OP_reg5 RDI), DW_OP_stack_value)
>>>                    DW_AT_GNU_locviews    (0x0000001e)
>>>
>>> 0x0000011f:     DW_TAG_formal_parameter
>>>                    DW_AT_abstract_origin (0x000000f2 "b")
>>>                    DW_AT_const_value     (0x01)
>>> ...
>>>
>>> Assembly code:
>>> 0000000000000000 <foo.constprop.0.isra.0>:
>>>         0: 53                            pushq   %rbx
>>>         1: 89 fb                         movl    %edi, %ebx
>>>         3: e8 00 00 00 00                callq   0x8 <foo.constprop.0.isra.0+0x8>
>>>         8: 8d 7b 01                      leal    0x1(%rbx), %edi
>>>         b: 5b                            popq    %rbx
>>>         c: e9 00 00 00 00                jmp     0x11 <foo.constprop.0.isra.0+0x11>
>>>        11: 66 66 2e 0f 1f 84 00 00 00 00 00      nopw    %cs:(%rax,%rax)
>>>        1c: 0f 1f 40 00                   nopl    (%rax)
>>>
>>> 0000000000000020 <bar>:
>>>        20: 48 83 ec 08                   subq    $0x8, %rsp
>>>        24: e8 d7 ff ff ff                callq   0x0 <foo.constprop.0.isra.0>
>>>        29: 31 c0                         xorl    %eax, %eax
>>>        2b: 48 83 c4 08                   addq    $0x8, %rsp
>>>        2f: c3                            retq
>>>
>>> $ clang -O2 -g -c test.c
>>> $ llvm-dwarfdump test.o
>>> ...
>>> 0x0000004e:   DW_TAG_subprogram
>>>                  DW_AT_low_pc    (0x0000000000000010)
>>>                  DW_AT_high_pc   (0x0000000000000022)
>>>                  DW_AT_frame_base        (DW_OP_reg7 RSP)
>>>                  DW_AT_call_all_calls    (true)
>>>                  DW_AT_name      ("foo")
>>>                  DW_AT_decl_file ("/home/yhs/tests/sig-change/deadret/test.c")
>>>                  DW_AT_decl_line (3)
>>>                  DW_AT_prototyped        (true)
>>>                  DW_AT_calling_convention        (DW_CC_nocall)
>>>                  DW_AT_type      (0x00000096 "int")
>>>
>>> 0x0000005e:     DW_TAG_formal_parameter
>>>                    DW_AT_location        (indexed (0x1) loclist = 0x00000022:
>>>                       [0x0000000000000010, 0x0000000000000018): DW_OP_reg5 RDI
>>>                       [0x0000000000000018, 0x000000000000001a): DW_OP_reg3 RBX
>>>                       [0x000000000000001a, 0x0000000000000022): DW_OP_entry_value(DW_OP_reg5 RDI), DW_OP_stack_value)
>>>                    DW_AT_name    ("a")
>>>                    DW_AT_decl_file       ("/home/yhs/tests/sig-change/deadret/test.c")
>>>                    DW_AT_decl_line       (3)
>>>                    DW_AT_type    (0x00000096 "int")
>>>
>>> 0x00000067:     DW_TAG_formal_parameter
>>>                    DW_AT_name    ("b")
>>>                    DW_AT_decl_file       ("/home/yhs/tests/sig-change/deadret/test.c")
>>>                    DW_AT_decl_line       (3)
>>>                    DW_AT_type    (0x00000096 "int")
>>> ...
>>> Assembly code:encs
>>> 0000000000000000 <bar>:
>>>         0: 50                            pushq   %rax
>>>         1: e8 0a 00 00 00                callq   0x10 <foo>
>>>         6: 31 c0                         xorl    %eax, %eax
>>>         8: 59                            popq    %rcx
>>>         9: c3                            retq
>>>         a: 66 0f 1f 44 00 00             nopw    (%rax,%rax)
>>>
>>> 0000000000000010 <foo>:
>>>        10: 53                            pushq   %rbx
>>>        11: 89 fb                         movl    %edi, %ebx
>>>        13: e8 00 00 00 00                callq   0x18 <foo+0x8>
>>>        18: ff c3                         incl    %ebx
>>>        1a: 89 df                         movl    %ebx, %edi
>>>        1c: 5b                            popq    %rbx
>>>        1d: e9 00 00 00 00                jmp     0x22 <foo+0x12>
>>>
>>>
>>> The compiler knows whether the return type has changed or not.
>>> Unfortunately the information is not available in dwarf. So
>>> BTF will encode source level return type even if the actual
>>> return type could be void due to optimization.
>>>
>>> This is not perfect but at least it is an improvement
>>> for true signature. But it would be great if llvm/gcc
>>> side can coordinate to propose something in compiler/dwarf
>>> to encode return type change as well. In llvm,
>>> AFAIK, the only return type change will be
>>> 'original non-void type' -> 'void type'.
>>>
>> Yeah, we dug into this a bit on the gcc side with David's help and it
>> appears the only mechanism used seems to be abstract origin reference
>> unfortunately. It seems to me that in theory the compiler could encode
>> the actual type for return types and any parameters that change type
>> from the abstract to concrete representation, and we could end up with
>> a mix of abstract origin refererences for the types that don't change and
>> non-abstract for the types that do.
>>
>> David, Jose, I'm wondering if the information is available to gcc to do
>> that at late DWARF encoding time? Thanks!
> Yes, at least to some degree.  For non-inlined cases, I don't currently know
> of a case where we do not have the information.  For inlined cases I am
> less confident that it's still available.
>
> I spent some time looking at this last year, thinking that we could at least
> use this to improve gcc-emitted BTF with the final signatures for non-inline
> funcs, even if there is no perfect way to encode it in DWARF.
>
> For example, I have:
>
>    __attribute__((noinline))
>    static int callee (struct tcphdr *tcp, int x, int y)
>    {...}
>
> In this case both the return value and the param 'x' are dropped by
> optimizations.
>
> At late DWARF time we have a function_decl node for the optimized version
> 'callee.constprop.isra' which has a return type of void and arg type list
> reflecting the remaining two parameters.  We can also get a pointer to
> the original pre-optimized decl to compare against. i.e. we have both:
>
>    callee.constprop.isra
>      return type: void
>      arg types:   struct tcphdr*, int, void
>    callee
>      return type: int
>      arg types:   struct tcphdr*, int, int, void

So gcc is able to encode both functions since their func names
are different and both can be in dwarf. The pahole can find out
callee.constprop.isra is matching the same function name in
kallsyms and pahole will be able to encode callee.constprop.isra
function in vmlinux BTF.

But unfortunately, llvm does not have this luxury since llvm
will not allow suffixes even after function signature gets
changed. So only the original signature is encoded in dwarf.

Let us say we could recover true signatures through locations.
 From llvm side,
   DW_AT_calling_convention        (DW_CC_nocall)
can help indicate there is a signature change. But there is
no way to find whether return type is changed or not if
some parameters are changed/removed. Any suggestion?

>
> This also extends to more complicated cases where IPA-SRA splits
> aggregate parameters into individual pieces (e.g. split a pass-by-value
> struct into only passing the relevant fields which are used).
> I think some of these transformations are not always reflected in DWARF.
>
> For a simpler case like the one here, it is currently reflected in DWARF
> via the abstract_origin subprogram DIE for callee in which only the
> remaining two parameters have concrete AT_location.
> (Although IMO it is rather ambiguous whether the abstract_origin DIE's
>   lack of AT_type means "return type is unchanged" or "return type is void")
>
>
>> Alan


  reply	other threads:[~2026-01-15  3:27 UTC|newest]

Thread overview: 19+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-01-13 13:13 [PATCH dwarves 0/4] Improve BTF concrete function accuracy Alan Maguire
2026-01-13 13:13 ` [PATCH dwarves 1/4] dwarf_loader/btf_encoder: Detect reordered parameters Alan Maguire
2026-01-20 16:07   ` Yonghong Song
2026-01-13 13:13 ` [PATCH dwarves 2/4] btf_encoder: Refactor elf_functions__new() with struct btf_encoder as argument Alan Maguire
2026-01-13 18:32   ` Ihor Solodrai
2026-01-13 18:57     ` Yonghong Song
2026-01-13 20:59     ` Alan Maguire
2026-01-13 13:13 ` [PATCH dwarves 3/4] btf_encoder: Add true_signature feature support for "."-suffixed functions Alan Maguire
2026-01-14 16:15   ` Yonghong Song
2026-01-14 16:55     ` Alan Maguire
2026-01-14 18:22       ` David Faust
2026-01-15  3:27         ` Yonghong Song [this message]
2026-01-15 18:38         ` Yonghong Song
2026-01-20 17:53   ` Yonghong Song
2026-01-22 18:21     ` Alan Maguire
2026-01-22 18:36       ` Yonghong Song
2026-01-13 13:13 ` [PATCH dwarves 4/4] btf_encoder: Prefer strong function definitions for BTF generation Alan Maguire
2026-01-20 17:54   ` Yonghong Song
2026-01-20  9:52 ` [PATCH dwarves 0/4] Improve BTF concrete function accuracy Alan Maguire

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=3c92a9f7-de65-438f-b785-a14ef441d257@linux.dev \
    --to=yonghong.song@linux.dev \
    --cc=alan.maguire@oracle.com \
    --cc=andrii@kernel.org \
    --cc=ast@kernel.org \
    --cc=bpf@vger.kernel.org \
    --cc=david.faust@oracle.com \
    --cc=dwarves@vger.kernel.org \
    --cc=eddyz87@gmail.com \
    --cc=ihor.solodrai@linux.dev \
    --cc=jolsa@kernel.org \
    --cc=jose.marchesi@oracle.com \
    --cc=mattbobrowski@google.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox