From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from mail-qv1-f44.google.com (mail-qv1-f44.google.com [209.85.219.44]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 2624D256C95 for ; Sat, 10 May 2025 12:35:11 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.85.219.44 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1746880514; cv=none; b=X2WuxCwEf2vvpq4zPrpoF2+F+ocnV93DbqYcTbY/cWvhE8LNnFDu8KkvKJid0Uq4awXFIvwX2v/0jK4/Ri+vFmNKiS/JYplhWUUvnDGBG8hzUS80+M76nQv3+w4+ybOl7NixrFKqjzXZ0RJdnj/i85Re7H5aN/2EE5aNRQ4xjyc= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1746880514; c=relaxed/simple; bh=/ckQmMjYXPc0qzguSPFnO/DSHuOJdODbmEv9P7rc2OY=; h=From:Subject:Date:Message-Id:MIME-Version:Content-Type:To:Cc; b=SbPAdY5+mQzRvC67xNwBimnybzJOr4Awzlcz3QWpX2nFiiV1BCpDsyifk01DxtnEgk5HgqdBBdfYfAFmepSA2c30i3m1YruumqSXXHC50nueJ2Ae7SS2jrBKI5+ky8HTqFl+Fn0P3UcnLc7rKb7R/apFlQZIbPd1eU1bc+KiAQE= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=isovalent.com; spf=pass smtp.mailfrom=isovalent.com; dkim=pass (2048-bit key) header.d=isovalent.com header.i=@isovalent.com header.b=UPNfGyDJ; arc=none smtp.client-ip=209.85.219.44 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=isovalent.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=isovalent.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=isovalent.com header.i=@isovalent.com header.b="UPNfGyDJ" Received: by mail-qv1-f44.google.com with SMTP id 6a1803df08f44-6f5373067b3so42980396d6.2 for ; Sat, 10 May 2025 05:35:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=isovalent.com; s=google; t=1746880511; x=1747485311; darn=vger.kernel.org; h=cc:to:content-transfer-encoding:mime-version:message-id:date :subject:from:from:to:cc:subject:date:message-id:reply-to; bh=ZvudCl1s3CkH612+A5JcVTVNc6EQKQEW50vE6gNIcf0=; b=UPNfGyDJZum5T92EIlTtyK+OdXkq+lcbL0uJ/YF0UyVkf2s7vu/LMEzaFFhy+0TooD KYnxt1q0/uP+0y8mg4uvdu67/cPavgnUbUoqBwSn6syNmHbOoBgqg0xL6AN61Kcuzw0F sd56vPtgBrDWz1ghv+DCCi5Db1XI2s4Vr82LnOVzsRv3fancz0JpgZ3s3X2za0GGg6hi UxNZH9cTO1mS4A7rVvXVO9HFtRRktjJB2hSloOq3mQC1b639d83OMy2e6YEAHh6nWgwH Pp6Rf/AtP0jjoLOsis1P4VKs4F7vmtr+4W4ZkwtwHj7XHXhTcfGu6czdJOJXy3aAWvFT w1Sw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1746880511; x=1747485311; h=cc:to:content-transfer-encoding:mime-version:message-id:date :subject:from:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ZvudCl1s3CkH612+A5JcVTVNc6EQKQEW50vE6gNIcf0=; b=TxyBo4U/Y6U6rmttcp1+0FDvbJ7iNkN5LeOA+sbFiRVGdNMDIHtgr9BQK9i/chT0S6 51nzR8kFFbYJVcQtBctQWzIXNl/JXfutYob7ECp4FsPBlaYY24j1ZG8FIFsk3GgUWWTc Zd9dxfyhBMs1NI6Im/mdoq81ICZ1oNDsMaS3VVG5TpeHa+pNO3A9XHgtWGttfyLNtTOq ilAuk0+m4S321YeZXd1bvIZTfJX9I2SbcstxBdAEmL34igtcw5RnXRh36aiIGEEojux/ ZonSlrWCJzq/H1/5BdfIOObqGcHHb14uFP+lbceCnoApC2P/LqKu27SYxZqK9wsz/5jM ngyA== X-Gm-Message-State: AOJu0Yzs4Wg64j++6zFGZ+wlDS2seuZROGF39qR1OpX0ydOpG+fTcNGq Gw3c+Rghr6C7SO8aiIeO+kErMbr7JDULOIUYx/8RXrUm0VxYCBYPW8HuRmMGQqY= X-Gm-Gg: ASbGncuNPYqyIPn+8vu/cghLXQ+B4VREwQOr+GUnp+hNgUzREJlR+UGGqOTeB3E+6xa dRv83+Z4O+s0DLOjqmRxyJFiNqdBZOEK4vsrc9hH0UEWgrWy4aFYh55nqeUqB3teqoPWjDkecxq Z+evZqMSAb8Y0zeyFGXhLWJBNrxMm5EZtKYeXLj/FJx7LYEiWuG321VEsHVJJE3vEmBdUabs6rv M8Dgzu0h43P0ccgi24XNJfJiblm87Sylt2daOxWkDx9XP5jCOnArkin2N5PX4ETmsksnUb97NDy 3UsGM+c7g0+wk+/Qhv5ElU/WS0O/ZiIAdfyg3zPr3re5IbENHfqPsz1u3s9C6lNiT6Z74xmWs1O qpIBVaFo= X-Google-Smtp-Source: AGHT+IGV3CkDLoaVZ5BDOeHt3RqBddq11DlW+JHa+EzdYifXCxWkWda7wfe6HMzsvO+ohUEdlIZpIA== X-Received: by 2002:a05:6214:c64:b0:6ea:d033:2855 with SMTP id 6a1803df08f44-6f6e47cb39fmr99649916d6.26.1746880510957; Sat, 10 May 2025 05:35:10 -0700 (PDT) Received: from [192.168.1.45] (ool-182edad1.dyn.optonline.net. [24.46.218.209]) by smtp.gmail.com with ESMTPSA id 6a1803df08f44-6f6e39f588asm25725556d6.49.2025.05.10.05.35.09 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 10 May 2025 05:35:10 -0700 (PDT) From: Lorenz Bauer Subject: [PATCH bpf-next v4 0/3] Allow mmap of /sys/kernel/btf/vmlinux Date: Sat, 10 May 2025 08:34:53 -0400 Message-Id: <20250510-vmlinux-mmap-v4-0-69e424b2a672@isovalent.com> Precedence: bulk X-Mailing-List: linux-arch@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit X-B4-Tracking: v=1; b=H4sIAO1HH2gC/23OQQ6CMBAF0KuYrq1ppwyIK+9hXNQySBNoCcUGQ 7i7DSuCLH9+5v2ZWaDBUmC308wGijZY71LIzidmGu3exG2VMgMBKFBIHrvWus/Eu073HMgg5so oqiVLJ/1AtZ1W7sFefc0dTSN7pqaxYfTDd92Jcu2PySi54FpDARkWgOX1boOPuiU3XozvVizCF oAdAAko0UAhM5WhLI8AtQVwB6gEYIVK11rkgv4+WJblB/OdXWE4AQAA X-Change-ID: 20250501-vmlinux-mmap-2ec5563c3ef1 To: Arnd Bergmann , Alexei Starovoitov , Daniel Borkmann , Andrii Nakryiko , Martin KaFai Lau , Eduard Zingerman , Song Liu , Yonghong Song , John Fastabend , KP Singh , Stanislav Fomichev , Hao Luo , Jiri Olsa , Mykola Lysenko , Shuah Khan Cc: linux-arch@vger.kernel.org, linux-kernel@vger.kernel.org, bpf@vger.kernel.org, linux-kselftest@vger.kernel.org, Lorenz Bauer X-Mailer: b4 0.14.2 I'd like to cut down the memory usage of parsing vmlinux BTF in ebpf-go. With some upcoming changes the library is sitting at 5MiB for a parse. Most of that memory is simply copying the BTF blob into user space. By allowing vmlinux BTF to be mmapped read-only into user space I can cut memory usage by about 75%. Signed-off-by: Lorenz Bauer --- Changes in v4: - Go back to remap_pfn_range for aarch64 compat - Dropped btf_new_no_copy (Andrii) - Fixed nits in selftests (Andrii) - Clearer error handling in the mmap handler (Andrii) - Fixed build on s390 - Link to v3: https://lore.kernel.org/r/20250505-vmlinux-mmap-v3-0-5d53afa060e8@isovalent.com Changes in v3: - Remove slightly confusing calculation of trailing (Alexei) - Use vm_insert_page (Alexei) - Simplified libbpf code - Link to v2: https://lore.kernel.org/r/20250502-vmlinux-mmap-v2-0-95c271434519@isovalent.com Changes in v2: - Use btf__new in selftest - Avoid vm_iomap_memory in btf_vmlinux_mmap - Add VM_DONTDUMP - Add support to libbpf - Link to v1: https://lore.kernel.org/r/20250501-vmlinux-mmap-v1-0-aa2724572598@isovalent.com --- Lorenz Bauer (3): btf: allow mmap of vmlinux btf selftests: bpf: add a test for mmapable vmlinux BTF libbpf: Use mmap to parse vmlinux BTF from sysfs include/asm-generic/vmlinux.lds.h | 3 +- kernel/bpf/sysfs_btf.c | 32 ++++++++ tools/lib/bpf/btf.c | 85 ++++++++++++++++++---- tools/testing/selftests/bpf/prog_tests/btf_sysfs.c | 81 +++++++++++++++++++++ 4 files changed, 184 insertions(+), 17 deletions(-) --- base-commit: 7220eabff8cb4af3b93cd021aa853b9f5df2923f change-id: 20250501-vmlinux-mmap-2ec5563c3ef1 Best regards, -- Lorenz Bauer