From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from kanga.kvack.org (kanga.kvack.org [205.233.56.17]) by smtp.lore.kernel.org (Postfix) with ESMTP id 53951C001DC for ; Sat, 29 Jul 2023 06:38:05 +0000 (UTC) Received: by kanga.kvack.org (Postfix) id 78E0F8D0001; Sat, 29 Jul 2023 02:38:04 -0400 (EDT) Received: by kanga.kvack.org (Postfix, from userid 40) id 73E3A6B0072; Sat, 29 Jul 2023 02:38:04 -0400 (EDT) X-Delivered-To: int-list-linux-mm@kvack.org Received: by kanga.kvack.org (Postfix, from userid 63042) id 5DEFB8D0001; Sat, 29 Jul 2023 02:38:04 -0400 (EDT) X-Delivered-To: linux-mm@kvack.org Received: from relay.hostedemail.com (smtprelay0013.hostedemail.com [216.40.44.13]) by kanga.kvack.org (Postfix) with ESMTP id 4BFCB6B0071 for ; Sat, 29 Jul 2023 02:38:04 -0400 (EDT) Received: from smtpin13.hostedemail.com (a10.router.float.18 [10.200.18.1]) by unirelay02.hostedemail.com (Postfix) with ESMTP id 051AD120721 for ; Sat, 29 Jul 2023 06:38:03 +0000 (UTC) X-FDA: 81063694488.13.829641B Received: from dfw.source.kernel.org (dfw.source.kernel.org [139.178.84.217]) by imf03.hostedemail.com (Postfix) with ESMTP id 4370520002 for ; Sat, 29 Jul 2023 06:38:02 +0000 (UTC) Authentication-Results: imf03.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=TMIOZzfC; spf=pass (imf03.hostedemail.com: domain of rppt@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=rppt@kernel.org; dmarc=pass (policy=none) header.from=kernel.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=hostedemail.com; s=arc-20220608; t=1690612682; h=from:from:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:content-transfer-encoding: in-reply-to:in-reply-to:references:references:dkim-signature; bh=Yyt8gzbQmnG9aHMFWkUyCELs8roJ7zP+ltpGwf1+oEc=; b=otZeSefxPM8Ritle/laOYDGFwXS05lWroF2vjNsZ1/c3Xi5pMPSAmTh4AiUSMflAjcCM7W IFCEgcy0nvpm/GffjAl122EUS08BtNxQTUGyzaTzW9sVTWJ4LFx5B0t+HTSO5ZSZykYOZO CqknM1J9PG1wl5AEQxg5dA/W/mkaikw= ARC-Seal: i=1; s=arc-20220608; d=hostedemail.com; t=1690612682; a=rsa-sha256; cv=none; b=dQ+/3GGsxgJu6hGeJ9vmCoVVcPMCPJNNEkCvOD2gvpgRIn19t+vWfB7MLqcutSHzwbHgxO ABGYX5XQVa+vmyDy9bAF430Wmo0+quIWUXQOdraClIjFL6MwPHRcRCdDWmh5RR2tWs9bZX hH/qXQdTQTDLSTHF6KSd/13WMi+fvrM= ARC-Authentication-Results: i=1; imf03.hostedemail.com; dkim=pass header.d=kernel.org header.s=k20201202 header.b=TMIOZzfC; spf=pass (imf03.hostedemail.com: domain of rppt@kernel.org designates 139.178.84.217 as permitted sender) smtp.mailfrom=rppt@kernel.org; dmarc=pass (policy=none) header.from=kernel.org Received: from smtp.kernel.org (relay.kernel.org [52.25.139.140]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by dfw.source.kernel.org (Postfix) with ESMTPS id 1BFD96069A; Sat, 29 Jul 2023 06:38:01 +0000 (UTC) Received: by smtp.kernel.org (Postfix) with ESMTPSA id 61CCBC433C7; Sat, 29 Jul 2023 06:37:57 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1690612680; bh=iusrxNKSk2oyUHVoBertANw633DmyTvL1U04sE+xDBc=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=TMIOZzfCFi7pQOv5BFBEe61MgYy7v7C3JVeKz+7PQGRb7aOPUztE4uEytcAZZ2NZu jeUwqjvLtCLInQ2R8G4bNQbY+yFGwN+XNoK+eOHUl5LzoZx55jLOcCigZUy9aRnb3V xEJgIZvkxUKUhJ43LEOLUAgJxjjFfYcYVmbS0FmF8yqnDL5QqZ4j+6oP6e7MJON24y HlNxtjlH94i38/e2lsiQGw4+M+VkCH4X+FOT5jaoZu0HM6lg7m2+cQ7SSxIFR55v1b TmasMtH5P0TDO2egPSyF9fmfMSYo+cyoM8hKEgd6CIdkNTuS5S0Ha2O8+IYLUU39wj xkQVmlnBdXRCA== Date: Sat, 29 Jul 2023 09:37:21 +0300 From: Mike Rapoport To: Usama Arif Cc: linux-mm@kvack.org, muchun.song@linux.dev, mike.kravetz@oracle.com, linux-kernel@vger.kernel.org, fam.zheng@bytedance.com, liangma@liangbit.com, simon.evans@bytedance.com, punit.agrawal@bytedance.com Subject: Re: [v1 1/6] mm: hugetlb: Skip prep of tail pages when HVO is enabled Message-ID: <20230729063721.GD1901145@kernel.org> References: <20230727204624.1942372-1-usama.arif@bytedance.com> <20230727204624.1942372-2-usama.arif@bytedance.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20230727204624.1942372-2-usama.arif@bytedance.com> X-Rspamd-Queue-Id: 4370520002 X-Rspam-User: X-Rspamd-Server: rspam11 X-Stat-Signature: g7s68aekzkojns5dfgaa9thogr1pm63c X-HE-Tag: 1690612682-242937 X-HE-Meta: U2FsdGVkX18PfvxV7S2JC4m9O37vet2EmA5fSeCRmwcv8e2YJj+Qxtxg2T339UdTM9OBEpx0RB9eolHMOnQ4wwOJuzQFGKn9fSQjnbSzCfJvOrdkTj1MudsJK/qh8V/dg5hobjdhjK/FyQZbNKDHz+LH28jPCVQTKQSLC9GZvYRM3B/baEpw4NcyPZyS4FK/uOWN/mQMp4ZpI46gk95C0lByoStGw1Anl8yWLG+fGEMxFkEBamL5QG3168gWjOK0GQp/On/E9FlqwrpTHBTq4bK/hPXtC+klRa7gPL2Qi9X/gDDzPCXB3ZxHPgfo7ABPSvxnusw5yqss5HYl4U315iaA98zHqT/ocsib/nwNibOAqu5kDixynsRgFU1rO+7M5WvCsApTrKpS0VE8DBho9EJJO2LrR6TIfWD7TpFIVaIEVjMAjLM58L/17NNXewNYm8REi81D1k8YebtrfBTxO69RL6KdzLc5FEDSySml9YR8ot2XbH28W2eac3OmPr82pmupMkyVhxBBT70TiLsIr30AO4mXDQY127btDGaBatwA7cEclfyidqK8JtMTX+ySfVkClj8jn6nGMzqMqPfI7EU0Ud3ilmM8HCvHcrr/s+1qyWzFcuGvPf9QDMMxTH/9mo4RrWQH72OHduaQvOaYSw59wMxf5Ht1mMsaQMMST4TiOqS+7Qvy4mp5GD7TzCQxKfw9akPsBHeDH1dW8N/4wBDdWyU/hscrUWHLYr7uE1RB5OKM3hNgVM+JTUOGOkbOSxUzjfx3EfEZ4ETBYagkMeIzxB6ozIGpJm9Cf/Q6IjlRN9fWKs5g0uubRf6S5ErNs5IZfwamFX8eqqK6kSQjxdkkYfTxvUSMgkMSh5+z3F4RyZ8ijSOmNeCFdJMQq80fnnB1m3ffF5UJECuV4NFatPY27X513OBgqNFM31a+IBOz1hxx4HYz1lchWj1KilBK/f6Py3z0IbsjQKNkmYS DPV87RMa AvLfrpAFobspW8PonxJiBpGEhJ3J/rD872o4QbYKVRP/2nVfTdRPrbnNPUVzn7LlOZxexh1GZJqUAGmUn/kCVHYrqSJ0FoAc9ow+eJ46vSr3TPAP45evbKBGbEbXAy5E4VLGcjR5dPHoA8qjsea/xAh8sZu5CCmSCJaIQTf+VHjIPcC0iXBG+gUe7JVJgJHArEpPQlT6qyC6vHVGEmKrJF8+PW4Uby2nB8QjzhdQt5CcUuy3wh+cjGP0r5GwkB5V7yZE3hpX+GyyEdk7V678TYM2oKTVJYjgWIWXb63Yfgxfr61YaeWgz+hs+iltlZEPD2WkTrVyvVqtEBe/Xp+B3iDYcugCrcIQX04Td X-Bogosity: Ham, tests=bogofilter, spamicity=0.000000, version=1.2.4 Sender: owner-linux-mm@kvack.org Precedence: bulk X-Loop: owner-majordomo@kvack.org List-ID: On Thu, Jul 27, 2023 at 09:46:19PM +0100, Usama Arif wrote: > When vmemmap is optimizable, it will free all the > duplicated tail pages in hugetlb_vmemmap_optimize while > preparing the new hugepage. Hence, there is no need to > prepare them. > > For 1G x86 hugepages, it avoids preparing > 262144 - 64 = 262080 struct pages per hugepage. > > Signed-off-by: Usama Arif > --- > mm/hugetlb.c | 32 +++++++++++++++++++++++--------- > mm/hugetlb_vmemmap.c | 2 +- > mm/hugetlb_vmemmap.h | 7 +++++++ > 3 files changed, 31 insertions(+), 10 deletions(-) > > diff --git a/mm/hugetlb.c b/mm/hugetlb.c > index 64a3239b6407..58cf5978bee1 100644 > --- a/mm/hugetlb.c > +++ b/mm/hugetlb.c > @@ -1943,13 +1943,24 @@ static void prep_new_hugetlb_folio(struct hstate *h, struct folio *folio, int ni > } > > static bool __prep_compound_gigantic_folio(struct folio *folio, > - unsigned int order, bool demote) > + unsigned int order, bool demote, > + bool hvo) I think it would be cleaner to pass struct hstate * instead of order here so that order and hvo can be computed locally. > { > int i, j; > int nr_pages = 1 << order; > struct page *p; > > __folio_clear_reserved(folio); > + > +#ifdef CONFIG_HUGETLB_PAGE_OPTIMIZE_VMEMMAP > + /* > + * No need to prep pages that will be freed later by hugetlb_vmemmap_optimize > + * in prep_new_huge_page. Hence, reduce nr_pages to the pages that will be kept. > + */ > + if (hvo) if (IS_ENABLED(CONFIG_HUGETLB_PAGE_OPTIMIZE_VMEMMAP) && hvo) is better than ifdef IMO. > + nr_pages = HUGETLB_VMEMMAP_RESERVE_SIZE / sizeof(struct page); > +#endif > + > for (i = 0; i < nr_pages; i++) { > p = folio_page(folio, i); > > @@ -2020,15 +2031,15 @@ static bool __prep_compound_gigantic_folio(struct folio *folio, > } > > static bool prep_compound_gigantic_folio(struct folio *folio, > - unsigned int order) > + unsigned int order, bool hvo) > { > - return __prep_compound_gigantic_folio(folio, order, false); > + return __prep_compound_gigantic_folio(folio, order, false, hvo); > } > > static bool prep_compound_gigantic_folio_for_demote(struct folio *folio, > - unsigned int order) > + unsigned int order, bool hvo) > { > - return __prep_compound_gigantic_folio(folio, order, true); > + return __prep_compound_gigantic_folio(folio, order, true, hvo); > } > > /* > @@ -2185,7 +2196,8 @@ static struct folio *alloc_fresh_hugetlb_folio(struct hstate *h, > if (!folio) > return NULL; > if (hstate_is_gigantic(h)) { > - if (!prep_compound_gigantic_folio(folio, huge_page_order(h))) { > + if (!prep_compound_gigantic_folio(folio, huge_page_order(h), > + vmemmap_should_optimize(h, &folio->page))) { > /* > * Rare failure to convert pages to compound page. > * Free pages and try again - ONCE! > @@ -3201,7 +3213,8 @@ static void __init gather_bootmem_prealloc(void) > > VM_BUG_ON(!hstate_is_gigantic(h)); > WARN_ON(folio_ref_count(folio) != 1); > - if (prep_compound_gigantic_folio(folio, huge_page_order(h))) { > + if (prep_compound_gigantic_folio(folio, huge_page_order(h), > + vmemmap_should_optimize(h, page))) { > WARN_ON(folio_test_reserved(folio)); > prep_new_hugetlb_folio(h, folio, folio_nid(folio)); > free_huge_page(page); /* add to the hugepage allocator */ > @@ -3624,8 +3637,9 @@ static int demote_free_hugetlb_folio(struct hstate *h, struct folio *folio) > subpage = folio_page(folio, i); > inner_folio = page_folio(subpage); > if (hstate_is_gigantic(target_hstate)) > - prep_compound_gigantic_folio_for_demote(inner_folio, > - target_hstate->order); > + prep_compound_gigantic_folio_for_demote(folio, > + target_hstate->order, > + vmemmap_should_optimize(target_hstate, subpage)); > else > prep_compound_page(subpage, target_hstate->order); > folio_change_private(inner_folio, NULL); > diff --git a/mm/hugetlb_vmemmap.c b/mm/hugetlb_vmemmap.c > index c2007ef5e9b0..b721e87de2b3 100644 > --- a/mm/hugetlb_vmemmap.c > +++ b/mm/hugetlb_vmemmap.c > @@ -486,7 +486,7 @@ int hugetlb_vmemmap_restore(const struct hstate *h, struct page *head) > } > > /* Return true iff a HugeTLB whose vmemmap should and can be optimized. */ > -static bool vmemmap_should_optimize(const struct hstate *h, const struct page *head) > +bool vmemmap_should_optimize(const struct hstate *h, const struct page *head) > { > if (!READ_ONCE(vmemmap_optimize_enabled)) > return false; > diff --git a/mm/hugetlb_vmemmap.h b/mm/hugetlb_vmemmap.h > index 25bd0e002431..07555d2dc0cb 100644 > --- a/mm/hugetlb_vmemmap.h > +++ b/mm/hugetlb_vmemmap.h > @@ -13,6 +13,7 @@ > #ifdef CONFIG_HUGETLB_PAGE_OPTIMIZE_VMEMMAP > int hugetlb_vmemmap_restore(const struct hstate *h, struct page *head); > void hugetlb_vmemmap_optimize(const struct hstate *h, struct page *head); > +bool vmemmap_should_optimize(const struct hstate *h, const struct page *head); > > /* > * Reserve one vmemmap page, all vmemmap addresses are mapped to it. See > @@ -51,6 +52,12 @@ static inline unsigned int hugetlb_vmemmap_optimizable_size(const struct hstate > { > return 0; > } > + > +bool vmemmap_should_optimize(const struct hstate *h, const struct page *head) > +{ > + return false; > +} > + > #endif /* CONFIG_HUGETLB_PAGE_OPTIMIZE_VMEMMAP */ > > static inline bool hugetlb_vmemmap_optimizable(const struct hstate *h) > -- > 2.25.1 > -- Sincerely yours, Mike.