From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6A318C4332F for ; Mon, 7 Nov 2022 22:42:43 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id E72956B0074; Mon, 7 Nov 2022 17:42:42 -0500 (EST) Received: by kanga.kvack.org (Postfix, from userid 40) id E228C6B0075; Mon, 7 Nov 2022 17:42:42 -0500 (EST) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id CEAAF6B0078; Mon, 7 Nov 2022 17:42:42 -0500 (EST) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0016.hostedemail.com [216.40.44.16]) by kanga.kvack.org (Postfix) with ESMTP id BD9C36B0074 for ; Mon, 7 Nov 2022 17:42:42 -0500 (EST) Received: from smtpin18.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay09.hostedemail.com (Postfix) with ESMTP id 9067780832 for ; Mon, 7 Nov 2022 22:42:42 +0000 (UTC) X-FDA: 80108122164.18.90F3606 Received: from mx0a-00082601.pphosted.com (mx0a-00082601.pphosted.com [67.231.145.42]) by imf02.hostedemail.com (Postfix) with ESMTP id 114DA80006 for ; Mon, 7 Nov 2022 22:42:41 +0000 (UTC) Received: from pps.filterd (m0148461.ppops.net [127.0.0.1]) by mx0a-00082601.pphosted.com (8.17.1.5/8.17.1.5) with ESMTP id 2A7LKrwq026863 for ; Mon, 7 Nov 2022 14:42:41 -0800 Received: from maileast.thefacebook.com ([163.114.130.16]) by mx0a-00082601.pphosted.com (PPS) with ESMTPS id 3knmxsujv2-6 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT) for ; Mon, 07 Nov 2022 14:42:40 -0800 Received: from twshared25017.14.frc2.facebook.com (2620:10d:c0a8:1b::d) by mail.thefacebook.com (2620:10d:c0a8:83::6) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.31; Mon, 7 Nov 2022 14:42:36 -0800 Received: by devbig932.frc1.facebook.com (Postfix, from userid 4523) id EA67CF6B36FB; Mon, 7 Nov 2022 14:39:30 -0800 (PST) From: Song Liu To: , CC: , , , , , , , , Song Liu Subject: [PATCH bpf-next v2 4/5] vmalloc: introduce register_text_tail_vm() Date: Mon, 7 Nov 2022 14:39:20 -0800 Message-ID: <20221107223921.3451913-5-song@kernel.org> X-Mailer: git-send-email 2.30.2 In-Reply-To: <20221107223921.3451913-1-song@kernel.org> References: <20221107223921.3451913-1-song@kernel.org> MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable X-FB-Internal: Safe Content-Type: text/plain X-Proofpoint-ORIG-GUID: 6jtmAuFF5KrLwaXLip64KcYYqVwTYkF3 X-Proofpoint-GUID: 6jtmAuFF5KrLwaXLip64KcYYqVwTYkF3 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.219,Aquarius:18.0.895,Hydra:6.0.545,FMLib:17.11.122.1 definitions=2022-11-07_11,2022-11-07_02,2022-06-22_01 ARC-Authentication-Results: i=1; imf02.hostedemail.com; dkim=none; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=kernel.org (policy=none); spf=pass (imf02.hostedemail.com: domain of "prvs=2310266901=songliubraving@meta.com" designates 67.231.145.42 as permitted sender) smtp.mailfrom="prvs=2310266901=songliubraving@meta.com" ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1667860962; a=rsa-sha256; cv=none; b=ivHvr+wPfIAV+yJCEgHhoi6a+rqaCnlZ0LJ2iwjwVtV2lDAfbL3gXtQ9zXHkMtYjC5XcSz 1EXisHhwtYeCs5I34DmXvNotWmVKQHQ9pvE+J1jeRRUrQFf0+//SjZmPTtEWQOjWO0jqi1 70lzxYptklUsD6/zkxNuNm1FKeXc+/k= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1667860962; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1Xgpv5/0w6i2NG9XXRx6Kpn8H/g3e6cryh2qFZ5XW1A=; b=WTbIRq5x1F+a9CROG3L/O2HTx/yQQIIiBK7uEzzF42jMk//XMawkM/Yx9evCbg3j5OiyVa YX7sXsxe8e2ot/Z7iLdqWGsn3WuMW54i8AzhiXce1UO53gbXTAw8HzZ6ycYgg3It8gpkty w9n/Nyi0cKVu0sJb68mTEWryK2EtiiA= X-Rspam-User: Authentication-Results: imf02.hostedemail.com; dkim=none; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=kernel.org (policy=none); spf=pass (imf02.hostedemail.com: domain of "prvs=2310266901=songliubraving@meta.com" designates 67.231.145.42 as permitted sender) smtp.mailfrom="prvs=2310266901=songliubraving@meta.com" X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: 114DA80006 X-Stat-Signature: ak84b1zjxyd47rrofmrquxmos83c5fdn X-HE-Tag: 1667860961-981173 X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: Allow arch code to register some memory to be used by execmem_alloc(). One possible use case is to allocate PMD pages for kernl text up to PMD_ALIGN(_etext), and use (_etext, PMD_ALIGN(_etext)) for execmem_alloc. Currently, only one such region is supported. Signed-off-by: Song Liu --- include/linux/vmalloc.h | 4 ++++ mm/vmalloc.c | 34 ++++++++++++++++++++++++++++++++++ 2 files changed, 38 insertions(+) diff --git a/include/linux/vmalloc.h b/include/linux/vmalloc.h index 30aa8c187d40..2babbe3031a5 100644 --- a/include/linux/vmalloc.h +++ b/include/linux/vmalloc.h @@ -132,11 +132,15 @@ extern void vm_unmap_aliases(void); #ifdef CONFIG_MMU extern void __init vmalloc_init(void); extern unsigned long vmalloc_nr_pages(void); +void register_text_tail_vm(unsigned long start, unsigned long end); #else static inline void vmalloc_init(void) { } static inline unsigned long vmalloc_nr_pages(void) { return 0; } +void register_text_tail_vm(unsigned long start, unsigned long end) +{ +} #endif =20 extern void *vmalloc(unsigned long size) __alloc_size(1); diff --git a/mm/vmalloc.c b/mm/vmalloc.c index 6cc72c795ee5..cb54bce3725e 100644 --- a/mm/vmalloc.c +++ b/mm/vmalloc.c @@ -77,6 +77,9 @@ static const bool vmap_allow_huge =3D false; #endif #define PMD_ALIGN_DOWN(addr) ALIGN_DOWN(addr, PMD_SIZE) =20 +static struct vm_struct text_tail_vm; +static struct vmap_area text_tail_va; + bool is_vmalloc_addr(const void *x) { unsigned long addr =3D (unsigned long)kasan_reset_tag(x); @@ -655,6 +658,8 @@ int is_vmalloc_or_module_addr(const void *x) unsigned long addr =3D (unsigned long)kasan_reset_tag(x); if (addr >=3D MODULES_VADDR && addr < MODULES_END) return 1; + if (addr >=3D text_tail_va.va_start && addr < text_tail_va.va_end) + return 1; #endif return is_vmalloc_addr(x); } @@ -2439,6 +2444,35 @@ static void vmap_init_free_space(void) } } =20 +/* + * register_text_tail_vm() allows arch code to register memory regions + * for execmem_alloc. Unlike regular memory regions used by execmem_allo= c, + * this region is never freed by vfree_exec. + * + * One possible use case is to allocate PMD pages for kernl text up to + * PMD_ALIGN(_etext), and use (_etext, PMD_ALIGN(_etext)) for + * execmem_alloc. + */ +void register_text_tail_vm(unsigned long start, unsigned long end) +{ + struct vmap_area *va; + + /* only support one region */ + if (WARN_ON_ONCE(text_tail_vm.addr)) + return; + + va =3D kmem_cache_zalloc(vmap_area_cachep, GFP_NOWAIT); + if (WARN_ON_ONCE(!va)) + return; + text_tail_vm.addr =3D (void *)start; + text_tail_vm.size =3D end - start; + text_tail_va.va_start =3D start; + text_tail_va.va_end =3D end; + text_tail_va.vm =3D &text_tail_vm; + memcpy(va, &text_tail_va, sizeof(*va)); + insert_vmap_area_augment(va, NULL, &free_text_area_root, &free_text_are= a_list); +} + void __init vmalloc_init(void) { struct vmap_area *va; --=20 2.30.2