From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 893CCC7EE2A for ; Mon, 30 Jun 2025 04:50:48 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 09E406B00A0; Mon, 30 Jun 2025 00:50:48 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 04E3E6B00A1; Mon, 30 Jun 2025 00:50:47 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id E7FA26B00A2; Mon, 30 Jun 2025 00:50:47 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0015.hostedemail.com [216.40.44.15]) by kanga.kvack.org (Postfix) with ESMTP id D5BAD6B00A0 for ; Mon, 30 Jun 2025 00:50:47 -0400 (EDT) Received: from smtpin20.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay06.hostedemail.com (Postfix) with ESMTP id 55B1D1051CA for ; Mon, 30 Jun 2025 04:50:47 +0000 (UTC) X-FDA: 83610841734.20.214B07C Received: from us-smtp-delivery-44.mimecast.com (us-smtp-delivery-44.mimecast.com [207.211.30.44]) by imf16.hostedemail.com (Postfix) with ESMTP id 7CD8E180004 for ; Mon, 30 Jun 2025 04:50:45 +0000 (UTC) Authentication-Results: imf16.hostedemail.com; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (imf16.hostedemail.com: 207.211.30.44 is neither permitted nor denied by domain of airlied@gmail.com) smtp.mailfrom=airlied@gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1751259045; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cmqO44LJTpRhAhGl1nBNv6MNWMkZYAQ6sf7mXOuSfw4=; b=0Uba5KKGOhGxVsU5XVUduUR7RDWnh0Y+rKZ/02/+9pj2qmhmenELRYL3P6i/tW/02Hoeqo EOAKjRf3rbXDu8B/dVthcXOsohSP/nVyW70Vb64Iq7ccA2asKcKBsus1LsFrnWgTbATxxv tBDbAH8XE+sg9nK/XuKz9AlJ2VTIVtw= ARC-Authentication-Results: i=1; imf16.hostedemail.com; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=gmail.com (policy=none); spf=softfail (imf16.hostedemail.com: 207.211.30.44 is neither permitted nor denied by domain of airlied@gmail.com) smtp.mailfrom=airlied@gmail.com ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1751259045; a=rsa-sha256; cv=none; b=BHD/x5UZ89N2Jt5A+zmQTHZU8tRvBoTWB4GyBHA5NGmW8qNVsFCUTBfzzSHNl2qX2QrJbZ l6YiGrROImDnaZyYYbJXVwQJBUXaM+K+o1Q1FM2k5XHiilv5637XJlYwU9XlG25s6ggU2S GqEQT0yKjoxIn4GJgHEaYwChd/fklNw= Received: from mx-prod-mc-08.mail-002.prod.us-west-2.aws.redhat.com (ec2-35-165-154-97.us-west-2.compute.amazonaws.com [35.165.154.97]) by relay.mimecast.com with ESMTP with STARTTLS (version=TLSv1.3, cipher=TLS_AES_256_GCM_SHA384) id us-mta-5-5BNGUrAFPra0dvw-jg1Fmw-1; Mon, 30 Jun 2025 00:50:39 -0400 X-MC-Unique: 5BNGUrAFPra0dvw-jg1Fmw-1 X-Mimecast-MFC-AGG-ID: 5BNGUrAFPra0dvw-jg1Fmw_1751259038 Received: from mx-prod-int-05.mail-002.prod.us-west-2.aws.redhat.com (mx-prod-int-05.mail-002.prod.us-west-2.aws.redhat.com [10.30.177.17]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by mx-prod-mc-08.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTPS id 7F27018011CD; Mon, 30 Jun 2025 04:50:37 +0000 (UTC) Received: from dreadlord.redhat.com (unknown [10.67.24.96]) by mx-prod-int-05.mail-002.prod.us-west-2.aws.redhat.com (Postfix) with ESMTP id EF3F51956095; Mon, 30 Jun 2025 04:50:30 +0000 (UTC) From: Dave Airlie To: dri-devel@lists.freedesktop.org, linux-mm@kvack.org, Johannes Weiner , Christian Koenig Cc: Dave Chinner , Kairui Song , Dave Airlie , Matthew Brost , Andrew Morton Subject: [PATCH 02/17] drm/ttm: use gpu mm stats to track gpu memory allocations. (v2) Date: Mon, 30 Jun 2025 14:49:21 +1000 Message-ID: <20250630045005.1337339-3-airlied@gmail.com> In-Reply-To: <20250630045005.1337339-1-airlied@gmail.com> References: <20250630045005.1337339-1-airlied@gmail.com> MIME-Version: 1.0 X-Scanned-By: MIMEDefang 3.0 on 10.30.177.17 X-Mimecast-Spam-Score: 0 X-Mimecast-MFC-PROC-ID: 0GTPaN1HLA68Y4T8e0I_cxSiOUj63cp25MVICG1tydw_1751259038 X-Mimecast-Originator: gmail.com Content-Transfer-Encoding: quoted-printable content-type: text/plain; charset=WINDOWS-1252; x-default=true X-Rspamd-Server: rspam02 X-Rspamd-Queue-Id: 7CD8E180004 X-Stat-Signature: phg4hndc1mpphwap5xjoyym7dgotf1ew X-Rspam-User: X-HE-Tag: 1751259045-179099 X-HE-Meta: U2FsdGVkX19EBMXErR9W/CpQfqJkq8ojaVd3c0IcKwfNiLSff7gswirIO6nuel2CEIYyDUzHhn7UXsMDWnqDYXcJbhrb9s91VL1ySDOMrHRRnv6l9cLo2lYNjwXrNAPqgVKuhbjmfzpJnDyCsqqa1hfDbXYKAhWRzZWYz0MSPgUj1CKVNGusyVyIevXIZsE9JueJambyvQ+phuZ6UhLjelBvClR6ZOdX7t+PR9tNTPduGky2MgUCLLnN45dQQMdLT6hGfCnuMEZ6nx2TWpeaASKeE1oZ9AYi0EwwV43r/dASAf31k9UkhWu0I1vM1Zb13YDtQB+ok8BZMWpTF+MB1Pbn0z77oYTUB37bHfs+9k+S9z4SPhtC8a+VUmhl1HqF7FFvXJcBZMjN4J+lmFd6VO//vrzugv/bAXAcg/Ps8+RENKJUqKGiE4dmrTbDkzdqwxKE3Wl+zZamSi9JaZE80pK2ZqWpGZAW5gPW5BLRC63bgy+othxCpygad9WtamjjaSd83YCmHkolebB6OFlR1CctKoCWP2tUMcMJxBcijDShihWtxfFFCJy71oaX8ZbriDXcK4EUioLyRhdW4YFQ8rjGWv/ILRg9GsrKKJxabdbSu6ZX0eWqBk5PFTQXNum1MsroMjrAPHs1KBsUMrowJ6YRpJbSFsy+5JGQLopkrczC4wpko8/dcgjmU843GV5b1uR4CiS3TduDb6GKit0OAhrcSDxQ15raZ6vOqbc1RM9UmORJw4zPOSe4GGNV9oTx0fdFNwNd9SqJZiaEnLfdqx1MVrf602h8z11MUi9KZSmPf0TUIrf2MWdTTURoeFQhc6gUxVKI9jnr6p+CaEk/oFx/hh+itD34+TXXFLoWltZxz+sV5/bIEVpvZlhXyzSiIFBnm9KQEX6fe/DctBepxV1pzkRYdWWm5qu/AqrCs+ctAM0Hymdv8oG2iKLcUq4VzfUHQZQQc8CYfUM8LLr KpriFqoI iXOx4U9nBH89MXpADIa8t+g345FdYNDreP+9574hUAqkXsZFqHpnY2Z3U2AwgyFFwIjYvs45eZtJz8XGc/CLYG9cby1BaG0K/Zv3NLleZyEqMg236VRf+oTbYMGAP7MUri37T+co7fPoQrQdv6t4NgawlX+0RsTAjxDrlr/ecCZ2BG1FgpSeY0IBpcztPqOF3rtktUy9iTosVMAfj+QDEGuw87ePpBCSCXBhy2R4R7JmQvkFEgGCtQ+q+T3xtNCntK+mYcQ5sgh4wDOYnyeT/V0nGQdhNsqnTCkeSb7hSaUNlKi84cLBgQHnBJSxbwRomVHHiXeIqcw+zQhrveVT7vD1Eq0GiB4n9UNsd8bg4qPtpIAefn7oc3MQhs/YztHrh9BU1F47VpT48M1q109fRVx93sNQnUabSY1SmxnhkiZmrrEIhtukVpFGL0sc1gZRVDniCulkYA2F2KwAm9YKO7FIRVkpOvBkqX5AEsOtFx2zKLGBBrDXtw1dIq27+aU9gjA2ERIrebg5uzD6tSBg2WbjZz4ozbA8Chhtv5wI4+44xWnrKpzGnXBTM/gI9lXTtLeowwOk4Og4zLQmLvohxKTZd2EFMnwwkdAsh4B8z6gB5hlXpi46ILF+fX5VMKOR/HjR9DlthqgZXQaE= X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: List-Subscribe: List-Unsubscribe: From: Dave Airlie This uses the newly introduced per-node gpu tracking stats, to track GPU memory allocated via TTM and reclaimable memory in the TTM page pools. These stats will be useful later for system information and later when mem cgroups are integrated. Cc: Christian Koenig Cc: Matthew Brost Cc: Johannes Weiner Cc: linux-mm@kvack.org Cc: Andrew Morton Signed-off-by: Dave Airlie --- v2: add reclaim parameters and adjust the right counters. --- drivers/gpu/drm/ttm/ttm_pool.c | 34 ++++++++++++++++++++++++++++------ 1 file changed, 28 insertions(+), 6 deletions(-) diff --git a/drivers/gpu/drm/ttm/ttm_pool.c b/drivers/gpu/drm/ttm/ttm_pool.= c index baf27c70a419..11a5777b4a85 100644 --- a/drivers/gpu/drm/ttm/ttm_pool.c +++ b/drivers/gpu/drm/ttm/ttm_pool.c @@ -131,6 +131,16 @@ static struct list_head shrinker_list; static struct shrinker *mm_shrinker; static DECLARE_RWSEM(pool_shrink_rwsem); =20 +/* helper to get a current valid node id from a pool */ +static int ttm_pool_nid(struct ttm_pool *pool) { +=09int nid =3D NUMA_NO_NODE; +=09if (pool) +=09=09nid =3D pool->nid; +=09if (nid =3D=3D NUMA_NO_NODE) +=09=09nid =3D numa_node_id(); +=09return nid; +} + /* Allocate pages of size 1 << order with the given gfp_flags */ static struct page *ttm_pool_alloc_page(struct ttm_pool *pool, gfp_t gfp_f= lags, =09=09=09=09=09unsigned int order) @@ -150,8 +160,10 @@ static struct page *ttm_pool_alloc_page(struct ttm_poo= l *pool, gfp_t gfp_flags, =20 =09if (!pool->use_dma_alloc) { =09=09p =3D alloc_pages_node(pool->nid, gfp_flags, order); -=09=09if (p) +=09=09if (p) { =09=09=09p->private =3D order; +=09=09=09mod_node_page_state(NODE_DATA(ttm_pool_nid(pool)), NR_GPU_ACTIVE,= (1 << order)); +=09=09} =09=09return p; =09} =20 @@ -186,7 +198,7 @@ static struct page *ttm_pool_alloc_page(struct ttm_pool= *pool, gfp_t gfp_flags, =20 /* Reset the caching and pages of size 1 << order */ static void ttm_pool_free_page(struct ttm_pool *pool, enum ttm_caching cac= hing, -=09=09=09 unsigned int order, struct page *p) +=09=09=09 unsigned int order, struct page *p, bool reclaim) { =09unsigned long attr =3D DMA_ATTR_FORCE_CONTIGUOUS; =09struct ttm_pool_dma *dma; @@ -201,6 +213,9 @@ static void ttm_pool_free_page(struct ttm_pool *pool, e= num ttm_caching caching, #endif =20 =09if (!pool || !pool->use_dma_alloc) { +=09=09mod_node_page_state(NODE_DATA(ttm_pool_nid(pool)), +=09=09=09=09 reclaim ? NR_GPU_RECLAIM : NR_GPU_ACTIVE, +=09=09=09=09 -(1 << order)); =09=09__free_pages(p, order); =09=09return; =09} @@ -276,6 +291,7 @@ static void ttm_pool_unmap(struct ttm_pool *pool, dma_a= ddr_t dma_addr, static void ttm_pool_type_give(struct ttm_pool_type *pt, struct page *p) { =09unsigned int i, num_pages =3D 1 << pt->order; +=09int nid =3D ttm_pool_nid(pt->pool); =20 =09for (i =3D 0; i < num_pages; ++i) { =09=09if (PageHighMem(p)) @@ -288,17 +304,23 @@ static void ttm_pool_type_give(struct ttm_pool_type *= pt, struct page *p) =09list_add(&p->lru, &pt->pages); =09spin_unlock(&pt->lock); =09atomic_long_add(1 << pt->order, &allocated_pages); + +=09mod_node_page_state(NODE_DATA(nid), NR_GPU_ACTIVE, -num_pages); +=09mod_node_page_state(NODE_DATA(nid), NR_GPU_RECLAIM, num_pages); } =20 /* Take pages from a specific pool_type, return NULL when nothing availabl= e */ static struct page *ttm_pool_type_take(struct ttm_pool_type *pt) { =09struct page *p; +=09int nid =3D ttm_pool_nid(pt->pool); =20 =09spin_lock(&pt->lock); =09p =3D list_first_entry_or_null(&pt->pages, typeof(*p), lru); =09if (p) { =09=09atomic_long_sub(1 << pt->order, &allocated_pages); +=09=09mod_node_page_state(NODE_DATA(nid), NR_GPU_ACTIVE, (1 << pt->order))= ; +=09=09mod_node_page_state(NODE_DATA(nid), NR_GPU_RECLAIM, -(1 << pt->order= )); =09=09list_del(&p->lru); =09} =09spin_unlock(&pt->lock); @@ -331,7 +353,7 @@ static void ttm_pool_type_fini(struct ttm_pool_type *pt= ) =09spin_unlock(&shrinker_lock); =20 =09while ((p =3D ttm_pool_type_take(pt))) -=09=09ttm_pool_free_page(pt->pool, pt->caching, pt->order, p); +=09=09ttm_pool_free_page(pt->pool, pt->caching, pt->order, p, true); } =20 /* Return the pool_type to use for the given caching and order */ @@ -383,7 +405,7 @@ static unsigned int ttm_pool_shrink(void) =20 =09p =3D ttm_pool_type_take(pt); =09if (p) { -=09=09ttm_pool_free_page(pt->pool, pt->caching, pt->order, p); +=09=09ttm_pool_free_page(pt->pool, pt->caching, pt->order, p, true); =09=09num_pages =3D 1 << pt->order; =09} else { =09=09num_pages =3D 0; @@ -475,7 +497,7 @@ static pgoff_t ttm_pool_unmap_and_free(struct ttm_pool = *pool, struct page *page, =09if (pt) =09=09ttm_pool_type_give(pt, page); =09else -=09=09ttm_pool_free_page(pool, caching, order, page); +=09=09ttm_pool_free_page(pool, caching, order, page, false); =20 =09return nr; } @@ -780,7 +802,7 @@ static int __ttm_pool_alloc(struct ttm_pool *pool, stru= ct ttm_tt *tt, =09return 0; =20 error_free_page: -=09ttm_pool_free_page(pool, page_caching, order, p); +=09ttm_pool_free_page(pool, page_caching, order, p, false); =20 error_free_all: =09if (tt->restore) --=20 2.49.0