All of lore.kernel.org
 help / color / mirror / Atom feed
From: Vlastimil Babka <vbabka@suse.cz>
To: David Rientjes <rientjes@google.com>,
	Andrew Morton <akpm@linux-foundation.org>
Cc: Greg Thelen <gthelen@google.com>,
	"Aneesh Kumar K.V" <aneesh.kumar@linux.vnet.ibm.com>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: [patch v2 for-4.0] mm, thp: really limit transparent hugepage allocation to local node
Date: Wed, 25 Feb 2015 11:52:28 +0100	[thread overview]
Message-ID: <54EDA96C.4000609@suse.cz> (raw)
In-Reply-To: <alpine.DEB.2.10.1502241522590.9480@chino.kir.corp.google.com>

On 02/25/2015 12:24 AM, David Rientjes wrote:
> From: Greg Thelen <gthelen@google.com>
>
> Commit 077fcf116c8c ("mm/thp: allocate transparent hugepages on local
> node") restructured alloc_hugepage_vma() with the intent of only
> allocating transparent hugepages locally when there was not an effective
> interleave mempolicy.
>
> alloc_pages_exact_node() does not limit the allocation to the single
> node, however, but rather prefers it.  This is because __GFP_THISNODE is
> not set which would cause the node-local nodemask to be passed.  Without
> it, only a nodemask that prefers the local node is passed.

Oops, good catch.
But I believe we have the same problem with khugepaged_alloc_page(), 
rendering the recent node determination and zone_reclaim strictness 
patches partially useless.

Then I start to wonder about other alloc_pages_exact_node() users. Some 
do pass __GFP_THISNODE, others not - are they also mistaken? I guess the 
function is a misnomer - when I see "exact_node", I expect the 
__GFP_THISNODE behavior.

I think to avoid such hidden catches, we should create 
alloc_pages_preferred_node() variant, change the exact_node() variant to 
pass __GFP_THISNODE, and audit and adjust all callers accordingly.

Also, you pass __GFP_NOWARN but that should be covered by GFP_TRANSHUGE 
already. Of course, nothing guarantees that hugepage == true implies 
that gfp == GFP_TRANSHUGE... but current in-tree callers conform to that.

> Fix this by passing __GFP_THISNODE and falling back to small pages when
> the allocation fails.
>
> Fixes: 077fcf116c8c ("mm/thp: allocate transparent hugepages on local node")
> Signed-off-by: Greg Thelen <gthelen@google.com>
> Signed-off-by: David Rientjes <rientjes@google.com>
> ---
>   v2: GFP_THISNODE actually defers compaction and reclaim entirely based on
>       the combination of gfp flags.  We want to try compaction and reclaim,
>       so only set __GFP_THISNODE.  We still set __GFP_NOWARN to suppress
>       oom warnings in the kernel log when we can simply fallback to small
>       pages.
>
>   mm/mempolicy.c | 5 ++++-
>   1 file changed, 4 insertions(+), 1 deletion(-)
>
> diff --git a/mm/mempolicy.c b/mm/mempolicy.c
> --- a/mm/mempolicy.c
> +++ b/mm/mempolicy.c
> @@ -1985,7 +1985,10 @@ retry_cpuset:
>   		nmask = policy_nodemask(gfp, pol);
>   		if (!nmask || node_isset(node, *nmask)) {
>   			mpol_cond_put(pol);
> -			page = alloc_pages_exact_node(node, gfp, order);
> +			page = alloc_pages_exact_node(node, gfp |
> +							    __GFP_THISNODE |
> +							    __GFP_NOWARN,
> +						      order);
>   			goto out;
>   		}
>   	}
>

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Vlastimil Babka <vbabka@suse.cz>
To: David Rientjes <rientjes@google.com>,
	Andrew Morton <akpm@linux-foundation.org>
Cc: Greg Thelen <gthelen@google.com>,
	"Aneesh Kumar K.V" <aneesh.kumar@linux.vnet.ibm.com>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: [patch v2 for-4.0] mm, thp: really limit transparent hugepage allocation to local node
Date: Wed, 25 Feb 2015 11:52:28 +0100	[thread overview]
Message-ID: <54EDA96C.4000609@suse.cz> (raw)
In-Reply-To: <alpine.DEB.2.10.1502241522590.9480@chino.kir.corp.google.com>

On 02/25/2015 12:24 AM, David Rientjes wrote:
> From: Greg Thelen <gthelen@google.com>
>
> Commit 077fcf116c8c ("mm/thp: allocate transparent hugepages on local
> node") restructured alloc_hugepage_vma() with the intent of only
> allocating transparent hugepages locally when there was not an effective
> interleave mempolicy.
>
> alloc_pages_exact_node() does not limit the allocation to the single
> node, however, but rather prefers it.  This is because __GFP_THISNODE is
> not set which would cause the node-local nodemask to be passed.  Without
> it, only a nodemask that prefers the local node is passed.

Oops, good catch.
But I believe we have the same problem with khugepaged_alloc_page(), 
rendering the recent node determination and zone_reclaim strictness 
patches partially useless.

Then I start to wonder about other alloc_pages_exact_node() users. Some 
do pass __GFP_THISNODE, others not - are they also mistaken? I guess the 
function is a misnomer - when I see "exact_node", I expect the 
__GFP_THISNODE behavior.

I think to avoid such hidden catches, we should create 
alloc_pages_preferred_node() variant, change the exact_node() variant to 
pass __GFP_THISNODE, and audit and adjust all callers accordingly.

Also, you pass __GFP_NOWARN but that should be covered by GFP_TRANSHUGE 
already. Of course, nothing guarantees that hugepage == true implies 
that gfp == GFP_TRANSHUGE... but current in-tree callers conform to that.

> Fix this by passing __GFP_THISNODE and falling back to small pages when
> the allocation fails.
>
> Fixes: 077fcf116c8c ("mm/thp: allocate transparent hugepages on local node")
> Signed-off-by: Greg Thelen <gthelen@google.com>
> Signed-off-by: David Rientjes <rientjes@google.com>
> ---
>   v2: GFP_THISNODE actually defers compaction and reclaim entirely based on
>       the combination of gfp flags.  We want to try compaction and reclaim,
>       so only set __GFP_THISNODE.  We still set __GFP_NOWARN to suppress
>       oom warnings in the kernel log when we can simply fallback to small
>       pages.
>
>   mm/mempolicy.c | 5 ++++-
>   1 file changed, 4 insertions(+), 1 deletion(-)
>
> diff --git a/mm/mempolicy.c b/mm/mempolicy.c
> --- a/mm/mempolicy.c
> +++ b/mm/mempolicy.c
> @@ -1985,7 +1985,10 @@ retry_cpuset:
>   		nmask = policy_nodemask(gfp, pol);
>   		if (!nmask || node_isset(node, *nmask)) {
>   			mpol_cond_put(pol);
> -			page = alloc_pages_exact_node(node, gfp, order);
> +			page = alloc_pages_exact_node(node, gfp |
> +							    __GFP_THISNODE |
> +							    __GFP_NOWARN,
> +						      order);
>   			goto out;
>   		}
>   	}
>


  reply	other threads:[~2015-02-25 10:52 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-02-24 22:24 [patch for-4.0] mm, thp: really limit transparent hugepage allocation to local node David Rientjes
2015-02-24 22:24 ` David Rientjes
2015-02-24 23:24 ` [patch v2 " David Rientjes
2015-02-24 23:24   ` David Rientjes
2015-02-25 10:52   ` Vlastimil Babka [this message]
2015-02-25 10:52     ` Vlastimil Babka
2015-02-25 21:24     ` David Rientjes
2015-02-25 21:24       ` David Rientjes
2015-02-25 23:55       ` Vlastimil Babka
2015-02-25 23:55         ` Vlastimil Babka
2015-04-21  7:31         ` Aneesh Kumar K.V
2015-04-21  7:31           ` Aneesh Kumar K.V
2015-05-05  9:12           ` Vlastimil Babka
2015-05-05  9:12             ` Vlastimil Babka
2015-05-05 13:22             ` Aneesh Kumar K.V
2015-05-05 13:22               ` Aneesh Kumar K.V

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=54EDA96C.4000609@suse.cz \
    --to=vbabka@suse.cz \
    --cc=akpm@linux-foundation.org \
    --cc=aneesh.kumar@linux.vnet.ibm.com \
    --cc=gthelen@google.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=rientjes@google.com \
    --cc=torvalds@linux-foundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.