From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from out-173.mta0.migadu.com (out-173.mta0.migadu.com [91.218.175.173]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 56DA821FF46 for ; Thu, 15 Jan 2026 07:17:18 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=91.218.175.173 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1768461440; cv=none; b=ZCHqatZH+oIGHd5oIXBgIF4HfQiDaPg3wK3kkpRqvIv+PJWze55smyr0H44bZCsXv5yO0WyMZ3VxoXkWNftiIdzqK+TAzFWsl3vrH11IzZWW+YByx4JkHLVbQxeWTG9lFTtBhocCNtXM5Q6ITAdNOjEC7Gqic1wzfirOkNiQOR4= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1768461440; c=relaxed/simple; bh=HyuhJUhLdLBXjHDbvfVPafRj0zqqSLJ3Sj7g/zYiiGY=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version; b=ZeqMuDTZ2Ia5L4jn1R/ose0XQ8/VN4HxXLr9NYJ7rGyv91gYffG7ZAGR65/ZoPUpcJqNtt/MnHS82cIS9zZoINGXcUpbeGhVYoZBEKG9jlOCExW04HyGciEdBHi1mGnw75BPQ72Zl+2CfCOloiOwpZ5NxXVS1VEI70nVPldlJCM= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.dev; spf=pass smtp.mailfrom=linux.dev; dkim=pass (1024-bit key) header.d=linux.dev header.i=@linux.dev header.b=ci14WHJv; arc=none smtp.client-ip=91.218.175.173 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=none dis=none) header.from=linux.dev Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=linux.dev Authentication-Results: smtp.subspace.kernel.org; dkim=pass (1024-bit key) header.d=linux.dev header.i=@linux.dev header.b="ci14WHJv" X-Report-Abuse: Please report any abuse attempt to abuse@migadu.com and include these headers. DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=linux.dev; s=key1; t=1768461435; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding; bh=SroIRR9h8UXJM6S3Ve2lceLMWS0gr9k4kwONMIjUn/k=; b=ci14WHJv7NH7WnbwlVuHcNEQhsWYNL+j395Xrodh+Yc3WM2M332D4vE43Ph+kFX1baYNY2 DZtEuPtOqrabF9xiVHFKRWLJtbtSfWPNUFNmJUXfgXbj3x9psJCKupWq71gMEYVgniXWai lQdR7XyZURPUjHt+LQCcmlqsSd+up5o= From: Lance Yang To: akpm@linux-foundation.org, david@kernel.org Cc: ioworker0@gmail.com, lorenzo.stoakes@oracle.com, Liam.Howlett@oracle.com, vbabka@suse.cz, rppt@kernel.org, surenb@google.com, mhocko@suse.com, ziy@nvidia.com, baolin.wang@linux.alibaba.com, npache@redhat.com, ryan.roberts@arm.com, dev.jain@arm.com, baohua@kernel.org, linux-mm@kvack.org, linux-kernel@vger.kernel.org, Lance Yang Subject: [PATCH v1 1/1] mm/khugepaged: move tlb_remove_table_sync_one out from under PTL Date: Thu, 15 Jan 2026 15:16:51 +0800 Message-ID: <20260115071651.42626-1-lance.yang@linux.dev> Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Migadu-Flow: FLOW_OUT From: Lance Yang tlb_remove_table_sync_one() sends IPIs to all CPUs and waits for them, which we really don't want to do while holding PTL. Just move the call to after we release PTL, and drop the macro wrapper while we're at it. Signed-off-by: Lance Yang --- include/linux/pgtable.h | 4 ---- mm/khugepaged.c | 5 +++-- 2 files changed, 3 insertions(+), 6 deletions(-) diff --git a/include/linux/pgtable.h b/include/linux/pgtable.h index eb8aacba3698..fb04ed22052c 100644 --- a/include/linux/pgtable.h +++ b/include/linux/pgtable.h @@ -755,7 +755,6 @@ static inline pmd_t pmdp_get_lockless(pmd_t *pmdp) return pmd; } #define pmdp_get_lockless pmdp_get_lockless -#define pmdp_get_lockless_sync() tlb_remove_table_sync_one() #endif /* CONFIG_PGTABLE_LEVELS > 2 */ #endif /* CONFIG_GUP_GET_PXX_LOW_HIGH */ @@ -774,9 +773,6 @@ static inline pmd_t pmdp_get_lockless(pmd_t *pmdp) { return pmdp_get(pmdp); } -static inline void pmdp_get_lockless_sync(void) -{ -} #endif #ifdef CONFIG_TRANSPARENT_HUGEPAGE diff --git a/mm/khugepaged.c b/mm/khugepaged.c index 9f790ec34400..0a6cebf880e0 100644 --- a/mm/khugepaged.c +++ b/mm/khugepaged.c @@ -1664,10 +1664,10 @@ static enum scan_result try_collapse_pte_mapped_thp(struct mm_struct *mm, unsign } } pgt_pmd = pmdp_collapse_flush(vma, haddr, pmd); - pmdp_get_lockless_sync(); pte_unmap_unlock(start_pte, ptl); if (ptl != pml) spin_unlock(pml); + tlb_remove_table_sync_one(); mmu_notifier_invalidate_range_end(&range); @@ -1818,7 +1818,6 @@ static void retract_page_tables(struct address_space *mapping, pgoff_t pgoff) */ if (likely(file_backed_vma_is_retractable(vma))) { pgt_pmd = pmdp_collapse_flush(vma, addr, pmd); - pmdp_get_lockless_sync(); success = true; } @@ -1826,6 +1825,8 @@ static void retract_page_tables(struct address_space *mapping, pgoff_t pgoff) spin_unlock(ptl); drop_pml: spin_unlock(pml); + if (success) + tlb_remove_table_sync_one(); mmu_notifier_invalidate_range_end(&range); -- 2.49.0