From: Xishi Qiu <qiuxishi@huawei.com>
To: David Rientjes <rientjes@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
Vlastimil Babka <vbabka@suse.cz>,
Joonsoo Kim <iamjoonsoo.kim@lge.com>,
Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>,
Linux MM <linux-mm@kvack.org>,
LKML <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH] mem-hotplug: use GFP_HIGHUSER_MOVABLE and alloc from next node in alloc_migrate_target()
Date: Fri, 15 Jul 2016 09:19:27 +0800 [thread overview]
Message-ID: <57883A1F.8070600@huawei.com> (raw)
In-Reply-To: <alpine.DEB.2.10.1607141513320.72383@chino.kir.corp.google.com>
On 2016/7/15 6:17, David Rientjes wrote:
> On Thu, 14 Jul 2016, Xishi Qiu wrote:
>
>> alloc_migrate_target() is called from migrate_pages(), and the page
>> is always from user space, so we can add __GFP_HIGHMEM directly.
>>
>> Second, when we offline a node, the new page should alloced from other
>> nodes instead of the current node, because re-migrate is a waste of
>> time.
>>
>
> alloc_migrate_target() is not only used from memory hotplug, it is also
> used for CMA: we won't be isolating PageHuge() pages in
> isolate_migratepages_range(), so this would cause a regression where we'd
> be migrating memory to a remote NUMA node rather than preferring to
> allocate locally.
>
> You may find it useful to use the 'private' field of the migrate_pages()
> callback to specify the node the page should preferably be migrated to.
>
OK, I know, I'll rewrite v2.
>> Signed-off-by: Xishi Qiu <qiuxishi@huawei.com>
>> ---
>> mm/page_isolation.c | 16 ++++++----------
>> 1 file changed, 6 insertions(+), 10 deletions(-)
>>
>> diff --git a/mm/page_isolation.c b/mm/page_isolation.c
>> index 612122b..83848dc 100644
>> --- a/mm/page_isolation.c
>> +++ b/mm/page_isolation.c
>> @@ -282,20 +282,16 @@ int test_pages_isolated(unsigned long start_pfn, unsigned long end_pfn,
>> struct page *alloc_migrate_target(struct page *page, unsigned long private,
>> int **resultp)
>> {
>> - gfp_t gfp_mask = GFP_USER | __GFP_MOVABLE;
>> -
>> /*
>> - * TODO: allocate a destination hugepage from a nearest neighbor node,
>> + * TODO: allocate a destination page from a nearest neighbor node,
>> * accordance with memory policy of the user process if possible. For
>> * now as a simple work-around, we use the next node for destination.
>> */
>> + int nid = next_node_in(page_to_nid(page), node_online_map);
>> +
>> if (PageHuge(page))
>> return alloc_huge_page_node(page_hstate(compound_head(page)),
>> - next_node_in(page_to_nid(page),
>> - node_online_map));
>> -
>> - if (PageHighMem(page))
>> - gfp_mask |= __GFP_HIGHMEM;
>> -
>> - return alloc_page(gfp_mask);
>> + nid);
>> + else
>> + return __alloc_pages_node(nid, GFP_HIGHUSER_MOVABLE, 0);
>
> I don't think this __alloc_pages_node() does what you think it does, it
> only prefers nid here and will readily fallback to other nodes if
> necessary. That is different than alloc_huge_page_node() which does no
> fallback. So there's two issues with this change: (1) inconsistency
> between PageHuge() and !PageHuge() behavior, and (2) the use of
> __alloc_pages_node() does not match the commit description which states
> "re-migrate is a waste of time."
>
Yes, you are right, how about change the changelog, one is membind, the
other is prefer?
Thanks,
Xishi Qiu
> .
>
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
WARNING: multiple messages have this Message-ID (diff)
From: Xishi Qiu <qiuxishi@huawei.com>
To: David Rientjes <rientjes@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
Vlastimil Babka <vbabka@suse.cz>,
Joonsoo Kim <iamjoonsoo.kim@lge.com>,
Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>,
Linux MM <linux-mm@kvack.org>,
LKML <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH] mem-hotplug: use GFP_HIGHUSER_MOVABLE and alloc from next node in alloc_migrate_target()
Date: Fri, 15 Jul 2016 09:19:27 +0800 [thread overview]
Message-ID: <57883A1F.8070600@huawei.com> (raw)
In-Reply-To: <alpine.DEB.2.10.1607141513320.72383@chino.kir.corp.google.com>
On 2016/7/15 6:17, David Rientjes wrote:
> On Thu, 14 Jul 2016, Xishi Qiu wrote:
>
>> alloc_migrate_target() is called from migrate_pages(), and the page
>> is always from user space, so we can add __GFP_HIGHMEM directly.
>>
>> Second, when we offline a node, the new page should alloced from other
>> nodes instead of the current node, because re-migrate is a waste of
>> time.
>>
>
> alloc_migrate_target() is not only used from memory hotplug, it is also
> used for CMA: we won't be isolating PageHuge() pages in
> isolate_migratepages_range(), so this would cause a regression where we'd
> be migrating memory to a remote NUMA node rather than preferring to
> allocate locally.
>
> You may find it useful to use the 'private' field of the migrate_pages()
> callback to specify the node the page should preferably be migrated to.
>
OK, I know, I'll rewrite v2.
>> Signed-off-by: Xishi Qiu <qiuxishi@huawei.com>
>> ---
>> mm/page_isolation.c | 16 ++++++----------
>> 1 file changed, 6 insertions(+), 10 deletions(-)
>>
>> diff --git a/mm/page_isolation.c b/mm/page_isolation.c
>> index 612122b..83848dc 100644
>> --- a/mm/page_isolation.c
>> +++ b/mm/page_isolation.c
>> @@ -282,20 +282,16 @@ int test_pages_isolated(unsigned long start_pfn, unsigned long end_pfn,
>> struct page *alloc_migrate_target(struct page *page, unsigned long private,
>> int **resultp)
>> {
>> - gfp_t gfp_mask = GFP_USER | __GFP_MOVABLE;
>> -
>> /*
>> - * TODO: allocate a destination hugepage from a nearest neighbor node,
>> + * TODO: allocate a destination page from a nearest neighbor node,
>> * accordance with memory policy of the user process if possible. For
>> * now as a simple work-around, we use the next node for destination.
>> */
>> + int nid = next_node_in(page_to_nid(page), node_online_map);
>> +
>> if (PageHuge(page))
>> return alloc_huge_page_node(page_hstate(compound_head(page)),
>> - next_node_in(page_to_nid(page),
>> - node_online_map));
>> -
>> - if (PageHighMem(page))
>> - gfp_mask |= __GFP_HIGHMEM;
>> -
>> - return alloc_page(gfp_mask);
>> + nid);
>> + else
>> + return __alloc_pages_node(nid, GFP_HIGHUSER_MOVABLE, 0);
>
> I don't think this __alloc_pages_node() does what you think it does, it
> only prefers nid here and will readily fallback to other nodes if
> necessary. That is different than alloc_huge_page_node() which does no
> fallback. So there's two issues with this change: (1) inconsistency
> between PageHuge() and !PageHuge() behavior, and (2) the use of
> __alloc_pages_node() does not match the commit description which states
> "re-migrate is a waste of time."
>
Yes, you are right, how about change the changelog, one is membind, the
other is prefer?
Thanks,
Xishi Qiu
> .
>
next prev parent reply other threads:[~2016-07-15 1:21 UTC|newest]
Thread overview: 6+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-07-14 2:25 [PATCH] mem-hotplug: use GFP_HIGHUSER_MOVABLE and alloc from next node in alloc_migrate_target() Xishi Qiu
2016-07-14 2:25 ` Xishi Qiu
2016-07-14 22:17 ` David Rientjes
2016-07-14 22:17 ` David Rientjes
2016-07-15 1:19 ` Xishi Qiu [this message]
2016-07-15 1:19 ` Xishi Qiu
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=57883A1F.8070600@huawei.com \
--to=qiuxishi@huawei.com \
--cc=akpm@linux-foundation.org \
--cc=iamjoonsoo.kim@lge.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=n-horiguchi@ah.jp.nec.com \
--cc=rientjes@google.com \
--cc=vbabka@suse.cz \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.