From mboxrd@z Thu Jan 1 00:00:00 1970 Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.remote-ip=100.103.45.18 ARC-Seal: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; cv=none; t=1793439646; b=v0PPl+2n7MNnvFzfRW9sRfi8tugKIc+iE8COWUwi/nCaBLBJWxOZYXDbfB/lv+kpV15c XPnyqQ8ipLY6vAENO548bvhefMKRGFPvXxIM5LJSOe8uWOhxJYrRxaQBrO0w2GLIv9Wvw vK1cRYxUrK8NVDoUOjIXWswqPuiAWsUsZpDrhd2UPOCZfhU5rJWRfDKW39Xu5I3e6Q1J2 GRDdFIkDF4qC6IofXQS50W0Q1FRb8gx9PwI67WCh3fZgbO6WaznZmIjmRq9tdIr+WeVaC iVewxsICgFV7puyavyW3sudnvr7fc6Xs+VbLtnBdW2MT4K93ORj9YRW8csdfTGzajEQ== ARC-Message-Signature: i=1; d=subspace.kernel.org; s=arc20261015; a=rsa-sha256; c=relaxed/relaxed; t=1793439646; h=Received:DKIM-Signature:From:Date:Subject:MIME-Version:Content-Type: Content-Transfer-Encoding:Message-Id:References:In-Reply-To:To:Cc: X-Mailer:X-Developer-Signature:X-Developer-Key; bh=I7DjIkLabOacdFYfsEcmvwX1npwCjDikHaQkTvm2Neo=; b=j0bUsgxrDWWA0jp1eAlIj69SfIWWNWp7rr320dbrrCOzc5447/nTSgwf7XwQ5fLFN/g5 Ocu16KcnhCpH6PL0GlwwfO3aiHG1ebtGFkaXHko0WOOs1F8hpo/BCybcr1xlzCtNYnVoN Xvh3DB0rMdcIFnylVfqhuQOnslpQJ3tklucw4ukr4xSHaQtBsALY05wwOhvByHiDf442C zUezrIVNROTBfUvoquygEeQ6CB3d0uCceKrq5S9vtWr2xwUbiiG4Q5hya7gOWg7YaCImc Q6wY4SPYRcSRtgxtA+iax+dgPH5UPyTKgng9H8PnD8rELgYu4mSDdABDykQx3eIoadQ== ARC-Authentication-Results: i=1; smtp.subspace.kernel.org; dkim=pass header.d=kernel.org header.i=@kernel.org header.a=rsa-sha256 header.s=k20260515 header.b=dVGmBXf2; arc=none smtp.remote-ip=100.103.45.18 Received: from smtp.kernel.org (quasi.space.kernel.org [100.103.45.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id B9A4A606A31D; Sat, 31 Oct 2026 09:40:45 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key, unprotected) header.d=kernel.org header.i=@kernel.org header.a=rsa-sha256 header.s=k20260515 header.b=dVGmBXf2 Received: by smtp.kernel.org (Postfix) with ESMTPSA id D97431F00A02; Sat, 31 Oct 2026 09:40:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kernel.org; s=k20260515; t=1793439645; bh=I7DjIkLabOacdFYfsEcmvwX1npwCjDikHaQkTvm2Neo=; h=From:Date:Subject:References:In-Reply-To:To:Cc; b=dVGmBXf2iikJF+RHAcOZfze4+LkziBHwXt9DI/UnL0jUTHBa085R2oXvkLkVuSfjZ 8i+fAkkvD9ZDOLT6kR8xxRhJtpqZRaZEaXumXD9UPN0M1VHQw5Nfbr2R8OYus6lIIZ 2IXfIU3MQePN9yX0aw2Ag9ERRVurHYrxKdRQzWge8T7uptXBgPTBOiXiqAg5FgY+gt sp+jZGXNY4nkdQJggTFM1NrA3tVqh3rR7DJk0ivQMbXQb9pn9oNNXxeF3m/tCBvjL9 GgVFKQvpsfugBNxgOkXDBSOylwZfOnJZJIe2t/MmpmLNBcjSEDRpC1HgKaHM7dm+01 vlh8CF6VUE6HQ== From: "David Hildenbrand (Arm)" Date: Sat, 31 Oct 2026 10:39:31 +0100 Subject: [PATCH v3 02/47] fork: take mmap_lock before copying mm_struct X-Mailing-List: linux-fsdevel@vger.kernel.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Message-Id: <20261031-fixes_core-v3-2-d6437171ecc3@kernel.org> References: <20261031-fixes_core-v3-0-d6437171ecc3@kernel.org> In-Reply-To: <20261031-fixes_core-v3-0-d6437171ecc3@kernel.org> To: Andrew Morton , Johannes Weiner , Michal Hocko , Qi Zheng , Shakeel Butt , Lorenzo Stoakes , Kairui Song , Barry Song , Axel Rasmussen , Yuanchu Xie , Wei Xu , Baoquan He , Baolin Wang , "Liam R. Howlett" , Vlastimil Babka , Mike Rapoport , Suren Baghdasaryan , Michal Hocko , Kees Cook , Peter Zijlstra , Jann Horn , Pedro Falcato , Hugh Dickins , Pasha Tatashin , Pratyush Yadav , "Matthew Wilcox (Oracle)" , Jan Kara , Zi Yan , Lance Yang , Rik van Riel , Harry Yoo , Alistair Popple , Nico Pache , Ryan Roberts , Dev Jain , Usama Arif , Kiryl Shutsemau , Matthew Brost , John Hubbard , Peter Xu , Will Deacon , "Aneesh Kumar K.V" , Nick Piggin , Oscar Salvador , Minchan Kim , Muchun Song , Xu Xin , Chengming Zhou , Chris Li , Kemeng Shi , Nhat Pham , Youngjun Park , Gregory Price , Joshua Hahn , Rakie Kim , Ying Huang , Jason Gunthorpe Cc: linux-mm@kvack.org, linux-kernel@vger.kernel.org, kexec@lists.infradead.org, linux-fsdevel@vger.kernel.org, linux-arch@vger.kernel.org, linux-cxl@vger.kernel.org, stable@vger.kernel.org, Josef Bacik , SJ Park , Muhammad Usama Anjum , "David Hildenbrand (Arm)" X-Mailer: b4 0.16.0 X-Developer-Signature: v=1; a=openpgp-sha256; l=3836; i=david@kernel.org; h=from:subject:message-id; bh=OsYjjyoQURJ77TW7YgFGtQVMoukPf386zkXqzXlwm/c=; b=owGbwMvMwCF2/OVpCdfQ3ZWMp9WSGLKebk892Sx5i/lgf/GuFPXwkNTFNVZr/b7sks9m0FzSL cOnuWxyRykLgxgHg6yYIktQ8H2Dly/X1Va78THDzGFlAhnCwMUpABM5ncrI8LdjxoM3X/9VfXqY n/6E+4WBi/C/iET+pVPqfC3KdFe972b4K7jXaYGk6gF2hjPHlvEevNbjdHOiaoj71rgGH7FVPs8 NOAE= X-Developer-Key: i=david@kernel.org; a=openpgp; fpr=1BD9CAAD735C4C3A460DFCCA4DDE10F700FF835A dup_mm() copies the parent's mm_struct before dup_mmap() takes the mmap_lock. A concurrent brk() can leave the child with a stale mm->brk and newer heap mappings, causing later brk() requests to fail. Other operations (e.g., PR_SET_MM) on the parent's mm_struct can similarly cause inconsistencies. As a simple and robust fix, grab the parent's mmap_lock earlier. This way we don't need to update individual mm fields in dup_mmap() and keep missing ones. Stop updating the 4 existing members (total_vm, data_vm, exec_vm, stack_vm), as that is now no longer required. Keep releasing the parent's mmap_lock in dup_mmap(), before userfaultfd completion, to avoid moving the userfaultfd handling into the caller. This should get cleaned up later. Move uprobe_start_dup_mmap() to preserve the lock ordering. Fixes: 1da177e4c3f4 ("Linux-2.6.12-rc2") Cc: stable@vger.kernel.org Reported-by: Josef Bacik Reviewed-by: Lorenzo Stoakes (ARM) Reviewed-by: Rik van Riel Reviewed-by: Vlastimil Babka (SUSE) Reviewed-by: Barry Song Reviewed-by: Pedro Falcato Reviewed-by: Harry Yoo (Meta) Reviewed-by: Kiryl Shutsemau (Meta) Reviewed-by: SJ Park Tested-by: Muhammad Usama Anjum Signed-off-by: David Hildenbrand (Arm) --- kernel/fork.c | 20 ++++++++++++++------ mm/mmap.c | 8 +------- mm/nommu.c | 2 +- 3 files changed, 16 insertions(+), 14 deletions(-) diff --git a/kernel/fork.c b/kernel/fork.c index 18b6dd8516427..ee40142dab31e 100644 --- a/kernel/fork.c +++ b/kernel/fork.c @@ -1533,12 +1533,19 @@ static struct mm_struct *dup_mm(struct task_struct *tsk, if (!mm) goto fail_nomem; + uprobe_start_dup_mmap(); + if (mmap_write_lock_killable(oldmm)) { + free_mm(mm); + goto fail_uprobe; + } + memcpy(mm, oldmm, sizeof(*mm)); - if (!mm_init(mm, tsk)) - goto fail_nomem; + if (!mm_init(mm, tsk)) { + mmap_write_unlock(oldmm); + goto fail_uprobe; + } - uprobe_start_dup_mmap(); err = dup_mmap(mm, oldmm); if (err) goto free_pt; @@ -1557,9 +1564,10 @@ static struct mm_struct *dup_mm(struct task_struct *tsk, mm->binfmt = NULL; mm_init_owner(mm, NULL); mmput(mm); - if (err) - uprobe_end_dup_mmap(); - + if (!err) + return NULL; +fail_uprobe: + uprobe_end_dup_mmap(); fail_nomem: return NULL; } diff --git a/mm/mmap.c b/mm/mmap.c index 148ba01c03739..7618e72766a52 100644 --- a/mm/mmap.c +++ b/mm/mmap.c @@ -1713,8 +1713,7 @@ __latent_entropy int dup_mmap(struct mm_struct *mm, struct mm_struct *oldmm) LIST_HEAD(uf); VMA_ITERATOR(vmi, mm, 0); - if (mmap_write_lock_killable(oldmm)) - return -EINTR; + mmap_assert_write_locked(oldmm); flush_cache_dup_mm(oldmm); uprobe_dup_mmap(oldmm, mm); /* @@ -1725,11 +1724,6 @@ __latent_entropy int dup_mmap(struct mm_struct *mm, struct mm_struct *oldmm) /* No ordering required: file already has been exposed. */ dup_mm_exe_file(mm, oldmm); - mm->total_vm = oldmm->total_vm; - mm->data_vm = oldmm->data_vm; - mm->exec_vm = oldmm->exec_vm; - mm->stack_vm = oldmm->stack_vm; - /* Use __mt_dup() to efficiently build an identical maple tree. */ retval = __mt_dup(&oldmm->mm_mt, &mm->mm_mt, GFP_KERNEL); if (unlikely(retval)) diff --git a/mm/nommu.c b/mm/nommu.c index 91ab65afda705..6c6f953296746 100644 --- a/mm/nommu.c +++ b/mm/nommu.c @@ -1887,7 +1887,7 @@ subsys_initcall(init_admin_reserve); int dup_mmap(struct mm_struct *mm, struct mm_struct *oldmm) { - mmap_write_lock(oldmm); + mmap_assert_write_locked(oldmm); dup_mm_exe_file(mm, oldmm); mmap_write_unlock(oldmm); return 0; -- 2.43.0