From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.remote-ip=209.85.128.44 ARC-Seal: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; cv=none; t=1793313228; b=X9awFVUFlMBo+ehHXJTYbIHuZmmOagU0cf7hIcUqgzp1oQUhJBknjbOVZSG5syRHsUm1 uqItzyG7OqaqKihjbwqia34N7SbaYznYbadFSPHJwi/JPpfRtYa8UVj4MqZ7sOsS/Znlq RTt0PQncjk/JqoP0JVtDzL6vBoH+SO1LukvyxsPbbPWKzmTG5/ZXsl9x8BZ+hVEZTYGDa kTPc9v+fgTnF3CxaLZQGLZzACYl6TGPyKoBmXEFHp2b33Az78hTm/MEXfMfDuxQc5Op13 pvE8dxUmjqWQcktjLjXDsyTqx0omPlBaWIA7kebiDdJadZr1YTMkSWwjFrDrHTr5L0g== ARC-Message-Signature: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; c=relaxed/relaxed; t=1793313228; h=DMARC-Filter:Received:DKIM-Signature:X-Google-DKIM-Signature: X-Forwarded-Encrypted:X-Gm-Message-State:X-Gm-Gg:X-Received:Received: Date:From:To:Cc:Subject:Message-ID:In-Reply-To:References:X-Mailer: MIME-Version:Content-Type:Content-Transfer-Encoding; bh=2C16if6DY4JWsOG2lgpyOm+rUUE2AWwmlNktllWtOWQ=; b=m6fNWF+k2qJChysBSqxFqsdii7XwkEss/oQjEPAlmOgxq+AAKDJ9i/OzBPMlZALod0Qu dqS2jGolh5N9lEP6th95LOsTFmlAlgVEsG8qCEifhgoMFTiuzQwnSADlyrEviGoMPBDDO OS8PmS0AhyNL/e8ZLCT7H8jetYqcvjntc0KNTb6CnEouPt+P/yAKfQyRsjSAfIimefN+1 mfhjVWFTSW2LnhXKLmK5a9Z4kacS9LuQ/txoheLCWq9mNeFfCcZ0wImNNe3nlomHGyegt 2QNM5OY7r2x5gwAWwy4cJd8J/DMWDNQdg4kFfydi4WKxMFsWw7Gis+Tq/AjaVQ+H1iQ== ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dmarc=pass header.from=gmail.com; spf=pass smtp.mailfrom=gmail.com; dkim=pass header.d=gmail.com header.i=@gmail.com header.a=rsa-sha256 header.s=20260707 header.b="t/bNGN/n"; arc=none smtp.remote-ip=209.85.128.44 Received: from mail-wm1-f44.google.com (mail-wm1-f44.google.com [209.85.128.44]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 1B9D5606A31D for ; Thu, 29 Oct 2026 22:33:48 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.2 smtp.subspace.kernel.org 1B9D5606A31D Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=gmail.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=gmail.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key, unprotected) header.d=gmail.com header.i=@gmail.com header.a=rsa-sha256 header.s=20260707 header.b=t/bNGN/n Received: by mail-wm1-f44.google.com with SMTP id 5b1f17b1804b1-4a9a8d6cea8so1200545e9.1 for ; Thu, 29 Oct 2026 15:33:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20260707; t=1793313226; x=1793918026; darn=vger.kernel.org; h=content-transfer-encoding:content-type:mime-version:references :in-reply-to:message-id:subject:cc:to:from:date:from:to:cc:subject :date:message-id:reply-to:content-type; bh=2C16if6DY4JWsOG2lgpyOm+rUUE2AWwmlNktllWtOWQ=; b=t/bNGN/ntazoGXxm7cEZZ+GwsGGsVh+C/0Yut+b49ElxU09W4nXbv1RAqNfYKvcJHq gOGys9TQp9AY0Af1UtWfeQ94USgYjsksf7rqxv43aOs4K/6L4QwE/YkFsmJPISOhN3Ib /nbmG8zYiEi8kSCiQybCdUzIBXmdKKb6/yNOgeJ/0pNXqt7/CSdeVO2Q2JdQCILUuTF7 qwCtWsvbTtAAjeMV4A4cwc8R16QkWvQsJ/IU6Cz0mRo6BSolCCS4gHWpxoa7KDLD3O0t uVtXEeLvOC1hcynSXlCTgEgiaRd5A1TtFFfR21YrZO4HhQE0tjgHG9m1BJNgGd0EVTZp VZDg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20260707; t=1793313226; x=1793918026; h=content-transfer-encoding:content-type:mime-version:references :in-reply-to:message-id:subject:cc:to:from:date:x-gm-gg :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to :content-type; bh=2C16if6DY4JWsOG2lgpyOm+rUUE2AWwmlNktllWtOWQ=; b=teY6lB0Tdu5+nXd13IX4b+tbmEAWWYt2HYO3znK4LLIuNqCJSxq/wxVRLNzG04evlf BNRMc5Xqt8wffDYE1PMimczWDRohQCfCyUCg8S0rU16gS+qqxLc3Nbi+cNqx+N1mUzMM XT9QtqbiJn3s5sz48GIiFxpcDHqlXmJKN2fBOqpTSxZKNIFOm5FUG6YLs1V5r3atYrLe y/oAmCEt2PILWOH1pmWRoj75S1rn4v3j9Lc3SSk7gvF+zq1FYJd/nlNk+fi1VMQD/HWe z5hjNaAx9klXuFa9MXMdEOfFBLbiD8/GwZRwL+UqkFjPjmPKmTJ6qqS7Y8NEcbGxpaGw A30w== X-Forwarded-Encrypted: i=1; AKwUvBzGLxMpObEPF65NjXF9Mp+gCP1eizQZnDfsTmMAdn3Sg6+ZI9cncJA4wIPm3PUVv/ucL15T1GjMlYc=@vger.kernel.org X-Gm-Message-State: AFq9FYL1kX2STiUPoiFNI7HoO8LaCI3Gn83MwhSz+vqkfBY6C7NHo3tH Ap0cUaNN/AHhg8wIzYMXNKOl6Zj40pTXYyyf5m6p4F6l2rNtyirvXedq X-Gm-Gg: AYBFou3AdABl8bVReCM7NRoSHRGPt7D7XN2pMi+GTLC6QZhMLYb9O1n124Te50ajCix 7FptOLscJ2bMFsZ34Choobl9tnK/vSKYNkotSyuOCq56Jtpppcjv5tvZ0T3JxShHYnL4zojSDIz 5qEKbaRQmv6E87GHOZcofycLp7jkcz3xmpR9HCXNukBgcPyXIKG4F6xmrbizzXYUFQvfPRlWooG KdIfVj1Sjeu5cgfVAaJJpRr6XyVW62ZZ9dMAzasHFciB63RxY8IGL+yDGmVsZ8lIKVq4fEOhDwA cItCSyou5ij3NMoUdFurJD1Djt70i2rmr+ihwYn5UOPvtDComCWunLCJckDxhy/oDrr58XnBAo1 EFyFUdK+JRpMLghDftNb///jzun+4ATE2ZalMoCGEPD0klZZyC+Mz0R8vNKXAHIZdIQ9rWYrnO8 FZOJB6kVzLwE8a0sJOpSQv7FJ41JaEmPj+89121NpSkyhR2gy/ntZT+K4D3AM1ZrkdIRUjuha7z 3dLYANtwY+08B8xx9KZUu2ffhawf+dqUl82wC8PsVxqVgGtjwoMLe0EKKzMTNOSYf83CqQYNupD 9J6jN962SjCnorinca9TGS9lEoN2gidzj6/UQyi/OG5CFfbjUyJ7b0SBvJxp1eCofg8bD5buGKr REEUM82Np424= X-Received: by 2002:a05:600c:4687:b0:4a2:10f9:37db with SMTP id 5b1f17b1804b1-4ac16fa4dadmr7994095e9.7.1793313226338; Thu, 29 Oct 2026 15:33:46 -0700 (PDT) Received: from pumpkin (82-69-66-36.dsl.in-addr.zen.co.uk. [82.69.66.36]) by smtp.gmail.com with ESMTPSA id 5b1f17b1804b1-4aa7f3229dbsm91077035e9.1.2026.10.29.15.33.45 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 29 Oct 2026 15:33:46 -0700 (PDT) Date: Thu, 29 Oct 2026 22:33:44 +0000 From: David Laight To: Samuel Wu Cc: Jiri Olsa , Jonathan Corbet , Shuah Khan , Randy Dunlap , Alexander Viro , Christian Brauner , Jan Kara , Andrii Nakryiko , Eduard Zingerman , Ihor Solodrai , Alexei Starovoitov , Daniel Borkmann , Kumar Kartikeya Dwivedi , Martin KaFai Lau , Song Liu , Yonghong Song , Emil Tsalapatis , Nathan Chancellor , Nick Desaulniers , Bill Wendling , Justin Stitt , kernel-team@android.com, linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org, linux-doc@vger.kernel.org, bpf@vger.kernel.org, linux-kselftest@vger.kernel.org, llvm@lists.linux.dev Subject: Re: [PATCH bpf-next v2 4/6] libbpf: Resolve typeless ksyms via KALLSYMS_QUERY ioctl Message-ID: <20261029223344.5dbe60d5@pumpkin> In-Reply-To: References: <20261023001603.560210-8-wusamuel@google.com> <20261023001603.560210-12-wusamuel@google.com> <20261028140127.7bfeab46@pumpkin> X-Mailer: Claws Mail 4.1.1 (GTK 3.24.38; arm-unknown-linux-gnueabihf) X-Mailing-List: linux-doc@vger.kernel.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Thu, 29 Oct 2026 14:35:36 -0700 Samuel Wu wrote: > On Wed, Oct 28, 2026 at 7:01=E2=80=AFAM David Laight > wrote: > > > > On Tue, 27 Oct 2026 15:07:44 -0700 > > Samuel Wu wrote: > > =20 > > > On Mon, Oct 26, 2026 at 2:28=E2=80=AFAM Jiri Olsa wrote: =20 > > > > > > > > On Thu, Oct 22, 2026 at 05:16:05PM -0700, Samuel Wu wrote: > > > > > > > > SNIP > > > > =20 > > > > > +static int bpf_object__query_ksyms(struct bpf_object *obj) > > > > > +{ > > > > > + struct kallsyms_query q; > > > > > + struct extern_desc *ext; > > > > > + int err =3D 0; > > > > > + int fd; > > > > > + int i; > > > > > + > > > > > + fd =3D open("/proc/kallsyms", O_RDONLY | O_CLOEXEC); > > > > > + if (fd < 0) > > > > > + return -errno; > > > > > + > > > > > + for (i =3D 0; i < obj->nr_extern; i++) { > > > > > + ext =3D &obj->externs[i]; > > > > > + if (ext->type !=3D EXT_KSYM || ext->ksym.type_id) > > > > > + continue; > > > > > + > > > > > + q =3D (struct kallsyms_query){ > > > > > + .size =3D sizeof(q), > > > > > + .query_flags =3D KALLSYMS_QUERY_BY_SYMBOL, > > > > > + .sym_name_addr =3D ptr_to_u64(ext->name), > > > > > + }; > > > > > + > > > > > + err =3D -errno; > > > > > + if (err =3D=3D -ENOENT) { > > > > > + err =3D 0; > > > > > + continue; > > > > > + } > > > > > + if (err =3D=3D -EADDRNOTAVAIL) > > > > > + pr_warn("extern (ksym) '%s': resolu= tion is ambiguous\n", > > > > > + ext->name); > > > > > + break; > > > > > + } > > > > > + ext->is_set =3D true; > > > > > + ext->ksym.addr =3D q.sym_addr; > > > > > + pr_debug("extern (ksym) '%s': resolved in kernel to= 0x%llx\n", > > > > > + ext->name, ext->ksym.addr); > > > > > + } > > > > > + close(fd); > > > > > + return err; > > > > > +} > > > > > + > > > > > +static int bpf_object__resolve_typeless_ksyms(struct bpf_object = *obj) > > > > > { > > > > > + int err; > > > > > + > > > > > + err =3D bpf_object__query_ksyms(obj); =20 > > > > > > > > hi, > > > > we could also add similar support for libbpf_available_kallsyms_par= se and > > > > probably in some other places like bpf_get_ksyms.. which makes me t= hink it > > > > could be useful to have KALLSYMS_QUERY support for multiple symbols > > > > > > > > thanks, > > > > jirka > > > > =20 > > > > > > Thanks for lookiing over this Jiri! > > > > > > Using KALLSYMS_QUERY for libbpf_available_kallsyms_parse() would > > > theoretically by O(m*log(n)) instead of O(n*log(m)), where m is the > > > number of tracefs symbols, and n is lines in kallsyms, with n >> m. > > > But AFAICT, libbpf_available_kallsyms_parse() would only be called in > > > pre-6.5 kernels, for kernels without commit 83f74441 (ftrace: Show all > > > functions with addresses in available_filter_functions_addrs); so this > > > ioctl could never be called. =20 > > > > Isn't that code also O(n*log(m)) ? =20 >=20 > Yes, sorry maybe I wasn't clear before, but the current code is > O(n*log(m)), and the ioctl approach would be better since it's m > lookups of O(log(n)) for vmlinux symbols, where n >> m. However, this > is a red herring because that path only runs on pre-6.5 kernels, which > won't have this ioctl. I was thinking of the ftrace_lookup_symbols() code (called from bbf_kprobe_multi_link_attach) which O(n*log(m)) (the wrong way around). David >=20 > > I've got a patch (I might send it after the merge window) that changes > > one of the ftrace functions to look up every symbol by name, not just > > when only asked to look up one. > > It can also use the 'callback' function to detect duplicates. > > That should be massively faster - especially with my ~18 fold improveme= nt > > (also waiting for the merge window to end before posting a new > > (not much changed) version). =20 >=20 > Excellent, I'll keep an eye out for it! >=20 > > Does look the the code could do with getting the 'symbol name table ind= ex' > > for the symbol so that it can read the entries sequentially from that > > point onwards. > > > > David > > =20 > > > > > > And regarding bpf_get_ksyms(), it loads all traceable functions and > > > needs the full syms table, so a /proc/kallsyms should fits better. > > > > > > I did profile a slightly different form of querying multiple symbols > > > at once [1], but didn't see much benefit. struct kallsyms_query is > > > extensible via size and query_flags, so we can update in the future as > > > needed. > > > > > > [1]: https://lore.kernel.org/all/CAG2KctozPSev+EXSpHitM3JWfjufQaEjsPJ= HS_1HJ1wSm7sJ1w@mail.gmail.com/ > > > > > > [...] > > > =20 > > =20