From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from va-2-42.ptr.blmpb.com (va-2-42.ptr.blmpb.com [209.127.231.42]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by smtp.subspace.kernel.org (Postfix) with ESMTPS id 2046040FD87 for ; Thu, 9 Jul 2026 11:20:58 +0000 (UTC) Authentication-Results: smtp.subspace.kernel.org; arc=none smtp.client-ip=209.127.231.42 ARC-Seal:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1783596062; cv=none; b=WJ+7+njvR/470ziQhwNsFkQKjQTKNgiXY2Gr8aPijL7lnyUBDau9vQgQq4ZlvXC35uFdnJLbb/nTSc2auRsVd5q3lrcogZNwPAGBqJ5u1RYoBKd3mlvbabp3H5xrp0p0W86kR23nM21aUT9HvkYveTsoo1Kex4M8TOBnHMPmGq8= ARC-Message-Signature:i=1; a=rsa-sha256; d=subspace.kernel.org; s=arc-20240116; t=1783596062; c=relaxed/simple; bh=JBC2H15kbYIhVOJay9YYty+zGvtqcmtfJC9vigVTYPs=; h=From:Content-Disposition:Cc:Subject:Date:Message-Id:Mime-Version: Content-Type:To; b=hXB/vAXjusYlTSguWFT5wUfek/WIpLAluzX/FHjD83lTmuHeQO7TKJwHB0TlIGrx6L3GfKi1ddkbgv8PrAJvm6kl0fro83fTv8T3tRkpsgURuCEIM1wr4fb1t0H9u9Vr8gHkCzl8Ty0Jwcm6WA3aZxWu0nnqvyi/+9ubeyxgcHo= ARC-Authentication-Results:i=1; smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=picoheart.com; spf=pass smtp.mailfrom=picoheart.com; dkim=pass (2048-bit key) header.d=picoheart.com header.i=@picoheart.com header.b=X/F+HME9; arc=none smtp.client-ip=209.127.231.42 Authentication-Results: smtp.subspace.kernel.org; dmarc=pass (p=quarantine dis=none) header.from=picoheart.com Authentication-Results: smtp.subspace.kernel.org; spf=pass smtp.mailfrom=picoheart.com Authentication-Results: smtp.subspace.kernel.org; dkim=pass (2048-bit key) header.d=picoheart.com header.i=@picoheart.com header.b="X/F+HME9" DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; s=feishu2604151535; d=picoheart.com; t=1783596048; h=from:subject: mime-version:from:date:message-id:subject:to:cc:reply-to:content-type: mime-version:in-reply-to:message-id; bh=D2i8ZuHJ2F1jxfLrB94uIt8iw3y4WkoHGS9SYRro9x8=; b=X/F+HME9r0iL7fojyFPEE4q9Gcwz429CZiWGD5Knc5sDA6jX0GWz99jCuvw0CSKei84rs9 25k0xK0wUfjkwQPL2EziGH3qHBXFbOQnZbE26OT9PSOnMGeSQ4401pFOl/BGWFsR0TMKMI vOg9ERjdyzpZvSg4GZ4PU17cNrYOu+MrbY4j1Q+IVOM7sJMqid95vcM2lRZ5h9fBeOGXCe uBaXJClTCPNiYwnfKL0UrXI+/+btjaqUizFKk8NQ3NRMgxXVHWV+cgPP64YAIUTIj5w0Qu 2uPybnh5Indp+HCpKEvjo6RdqpozFyUKcaJsCobGh01/oWdmcEf+RSN+LsN+fg== From: "Zhaoyu Liu" Content-Disposition: inline Content-Transfer-Encoding: 7bit Cc: , X-Lms-Return-Path: X-Original-From: Zhaoyu Liu Received: from hostpc ([183.129.139.234]) by smtp.feishu.cn with ESMTPS; Thu, 09 Jul 2026 19:20:45 +0800 Subject: [PATCH] gpu: buddy: avoid repeated builds of root dfs when alloc range Date: Thu, 9 Jul 2026 19:20:43 +0800 Message-Id: Precedence: bulk X-Mailing-List: linux-kernel@vger.kernel.org List-Id: List-Subscribe: List-Unsubscribe: Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 To: , , , , The buddy allocator previously pre-built a DFS list by inserting all root blocks via list_add_tail() before every allocation call in __alloc_range_bias() and __gpu_buddy_alloc_range(). This is wasteful when the allocation can be satisfied by the first root or by sub-blocks produced from splits, as the remaining roots are never consumed. Introduce __get_candidate_block() which unifies the block acquisition logic for both __alloc_range_bias() and __alloc_range(): it first checks the DFS list (populated by splits during allocation or pre-filled by the caller for trim), and only when the list is exhausted does it lazily fetch the next root block through a cursor. When the caller pre-fills the DFS list (trim scenario), the cursor is initialized to mm->n_roots to disable root iteration entirely, preserving the original behavior. Signed-off-by: Zhaoyu Liu --- drivers/gpu/buddy.c | 61 ++++++++++++++++++++++++++++++--------------- 1 file changed, 41 insertions(+), 20 deletions(-) diff --git a/drivers/gpu/buddy.c b/drivers/gpu/buddy.c index dc81fe0301ce..2cebb87020c7 100644 --- a/drivers/gpu/buddy.c +++ b/drivers/gpu/buddy.c @@ -700,6 +700,41 @@ static void __gpu_buddy_undo_splits(struct gpu_buddy *mm, } } +/** + * __get_candidate_block - Get a candidate block for allocation. + * @mm: GPU buddy manager + * @dfs: List of candidate blocks. Populated in two ways: (1) pre-filled by + * the caller before allocation with blocks available for allocation, + * and (2) extended during allocation by block splits, which add the + * resulting sub-blocks for subsequent finer-grained allocation. + * @cursor: Pointer to current root index, advanced when iterating roots. + * Pass in a value >= mm->n_roots to disable root iteration entirely, + * restricting block acquisition to @dfs only; this is used in the + * trim scenario where only pre-split sub-blocks should be considered. + * + * Return: Pointer to the acquired block on success, ERR_PTR(-ENOSPC) when no + * more blocks are available. + */ +static struct gpu_buddy_block* +__get_candidate_block(struct gpu_buddy *mm, struct list_head *dfs, + uint32_t *cursor) +{ + struct gpu_buddy_block *block; + + block = list_first_entry_or_null(dfs, + struct gpu_buddy_block, + tmp_link); + if (block) { + list_del(&block->tmp_link); + return block; + } + + if (*cursor >= mm->n_roots) + return ERR_PTR(-ENOSPC); + + return mm->roots[(*cursor)++]; +} + static struct gpu_buddy_block * __alloc_range_bias(struct gpu_buddy *mm, u64 start, u64 end, @@ -711,25 +746,18 @@ __alloc_range_bias(struct gpu_buddy *mm, struct gpu_buddy_block *block; LIST_HEAD(dfs); int err; - int i; + uint32_t cursor = 0; end = end - 1; - for (i = 0; i < mm->n_roots; ++i) - list_add_tail(&mm->roots[i]->tmp_link, &dfs); - do { u64 block_start; u64 block_end; - block = list_first_entry_or_null(&dfs, - struct gpu_buddy_block, - tmp_link); - if (!block) + block = __get_candidate_block(mm, &dfs, &cursor); + if (IS_ERR(block)) break; - list_del(&block->tmp_link); - if (gpu_buddy_block_order(block) < order) continue; @@ -1023,6 +1051,7 @@ static int __alloc_range(struct gpu_buddy *mm, LIST_HEAD(allocated); u64 end; int err; + uint32_t cursor = list_empty(dfs) ? 0 : mm->n_roots; end = start + size - 1; @@ -1030,14 +1059,10 @@ static int __alloc_range(struct gpu_buddy *mm, u64 block_start; u64 block_end; - block = list_first_entry_or_null(dfs, - struct gpu_buddy_block, - tmp_link); - if (!block) + block = __get_candidate_block(mm, dfs, &cursor); + if (IS_ERR(block)) break; - list_del(&block->tmp_link); - block_start = gpu_buddy_block_offset(block); block_end = block_start + gpu_buddy_block_size(mm, block) - 1; @@ -1109,10 +1134,6 @@ static int __gpu_buddy_alloc_range(struct gpu_buddy *mm, struct list_head *blocks) { LIST_HEAD(dfs); - int i; - - for (i = 0; i < mm->n_roots; ++i) - list_add_tail(&mm->roots[i]->tmp_link, &dfs); return __alloc_range(mm, &dfs, start, size, blocks, total_allocated_on_err); -- 2.34.1