All of lore.kernel.org
 help / color / mirror / Atom feed
From: Simon Jeons <simon.jeons@gmail.com>
To: Hugh Dickins <hughd@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Petr Holasek <pholasek@redhat.com>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Izik Eidus <izik.eidus@ravellosystems.com>,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: [PATCH 5/11] ksm: get_ksm_page locked
Date: Sat, 26 Jan 2013 20:48:47 -0600	[thread overview]
Message-ID: <1359254927.4159.11.camel@kernel> (raw)
In-Reply-To: <alpine.LNX.2.00.1301251759470.29196@eggly.anvils>

On Fri, 2013-01-25 at 18:00 -0800, Hugh Dickins wrote:
> In some places where get_ksm_page() is used, we need the page to be locked.
> 
> When KSM migration is fully enabled, we shall want that to make sure that
> the page just acquired cannot be migrated beneath us (raised page count is
> only effective when there is serialization to make sure migration notices).
> Whereas when navigating through the stable tree, we certainly do not want
> to lock each node (raised page count is enough to guarantee the memcmps,
> even if page is migrated to another node).
> 
> Since we're about to add another use case, add the locked argument to
> get_ksm_page() now.
> 
> Hmm, what's that rcu_read_lock() about?  Complete misunderstanding, I
> really got the wrong end of the stick on that!  There's a configuration
> in which page_cache_get_speculative() can do something cheaper than
> get_page_unless_zero(), relying on its caller's rcu_read_lock() to have
> disabled preemption for it.  There's no need for rcu_read_lock() around
> get_page_unless_zero() (and mapping checks) here.  Cut out that
> silliness before making this any harder to understand.

BTW, what's the meaning of ksm page forked? 

> 
> Signed-off-by: Hugh Dickins <hughd@google.com>
> ---
>  mm/ksm.c |   23 +++++++++++++----------
>  1 file changed, 13 insertions(+), 10 deletions(-)
> 
> --- mmotm.orig/mm/ksm.c	2013-01-25 14:36:53.244205966 -0800
> +++ mmotm/mm/ksm.c	2013-01-25 14:36:58.856206099 -0800
> @@ -514,15 +514,14 @@ static void remove_node_from_stable_tree
>   * but this is different - made simpler by ksm_thread_mutex being held, but
>   * interesting for assuming that no other use of the struct page could ever
>   * put our expected_mapping into page->mapping (or a field of the union which
> - * coincides with page->mapping).  The RCU calls are not for KSM at all, but
> - * to keep the page_count protocol described with page_cache_get_speculative.
> + * coincides with page->mapping).
>   *
>   * Note: it is possible that get_ksm_page() will return NULL one moment,
>   * then page the next, if the page is in between page_freeze_refs() and
>   * page_unfreeze_refs(): this shouldn't be a problem anywhere, the page
>   * is on its way to being freed; but it is an anomaly to bear in mind.
>   */
> -static struct page *get_ksm_page(struct stable_node *stable_node)
> +static struct page *get_ksm_page(struct stable_node *stable_node, bool locked)
>  {
>  	struct page *page;
>  	void *expected_mapping;
> @@ -530,7 +529,6 @@ static struct page *get_ksm_page(struct
>  	page = pfn_to_page(stable_node->kpfn);
>  	expected_mapping = (void *)stable_node +
>  				(PAGE_MAPPING_ANON | PAGE_MAPPING_KSM);
> -	rcu_read_lock();
>  	if (page->mapping != expected_mapping)
>  		goto stale;
>  	if (!get_page_unless_zero(page))
> @@ -539,10 +537,16 @@ static struct page *get_ksm_page(struct
>  		put_page(page);
>  		goto stale;
>  	}
> -	rcu_read_unlock();
> +	if (locked) {
> +		lock_page(page);
> +		if (page->mapping != expected_mapping) {
> +			unlock_page(page);
> +			put_page(page);
> +			goto stale;
> +		}
> +	}
>  	return page;
>  stale:
> -	rcu_read_unlock();
>  	remove_node_from_stable_tree(stable_node);
>  	return NULL;
>  }
> @@ -558,11 +562,10 @@ static void remove_rmap_item_from_tree(s
>  		struct page *page;
>  
>  		stable_node = rmap_item->head;
> -		page = get_ksm_page(stable_node);
> +		page = get_ksm_page(stable_node, true);
>  		if (!page)
>  			goto out;
>  
> -		lock_page(page);
>  		hlist_del(&rmap_item->hlist);
>  		unlock_page(page);
>  		put_page(page);
> @@ -1042,7 +1045,7 @@ static struct page *stable_tree_search(s
>  
>  		cond_resched();
>  		stable_node = rb_entry(node, struct stable_node, node);
> -		tree_page = get_ksm_page(stable_node);
> +		tree_page = get_ksm_page(stable_node, false);
>  		if (!tree_page)
>  			return NULL;
>  
> @@ -1086,7 +1089,7 @@ static struct stable_node *stable_tree_i
>  
>  		cond_resched();
>  		stable_node = rb_entry(*new, struct stable_node, node);
> -		tree_page = get_ksm_page(stable_node);
> +		tree_page = get_ksm_page(stable_node, false);
>  		if (!tree_page)
>  			return NULL;
>  
> 
> --
> To unsubscribe, send a message with 'unsubscribe linux-mm' in
> the body to majordomo@kvack.org.  For more info on Linux MM,
> see: http://www.linux-mm.org/ .
> Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Simon Jeons <simon.jeons@gmail.com>
To: Hugh Dickins <hughd@google.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Petr Holasek <pholasek@redhat.com>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Izik Eidus <izik.eidus@ravellosystems.com>,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: [PATCH 5/11] ksm: get_ksm_page locked
Date: Sat, 26 Jan 2013 20:48:47 -0600	[thread overview]
Message-ID: <1359254927.4159.11.camel@kernel> (raw)
In-Reply-To: <alpine.LNX.2.00.1301251759470.29196@eggly.anvils>

On Fri, 2013-01-25 at 18:00 -0800, Hugh Dickins wrote:
> In some places where get_ksm_page() is used, we need the page to be locked.
> 
> When KSM migration is fully enabled, we shall want that to make sure that
> the page just acquired cannot be migrated beneath us (raised page count is
> only effective when there is serialization to make sure migration notices).
> Whereas when navigating through the stable tree, we certainly do not want
> to lock each node (raised page count is enough to guarantee the memcmps,
> even if page is migrated to another node).
> 
> Since we're about to add another use case, add the locked argument to
> get_ksm_page() now.
> 
> Hmm, what's that rcu_read_lock() about?  Complete misunderstanding, I
> really got the wrong end of the stick on that!  There's a configuration
> in which page_cache_get_speculative() can do something cheaper than
> get_page_unless_zero(), relying on its caller's rcu_read_lock() to have
> disabled preemption for it.  There's no need for rcu_read_lock() around
> get_page_unless_zero() (and mapping checks) here.  Cut out that
> silliness before making this any harder to understand.

BTW, what's the meaning of ksm page forked? 

> 
> Signed-off-by: Hugh Dickins <hughd@google.com>
> ---
>  mm/ksm.c |   23 +++++++++++++----------
>  1 file changed, 13 insertions(+), 10 deletions(-)
> 
> --- mmotm.orig/mm/ksm.c	2013-01-25 14:36:53.244205966 -0800
> +++ mmotm/mm/ksm.c	2013-01-25 14:36:58.856206099 -0800
> @@ -514,15 +514,14 @@ static void remove_node_from_stable_tree
>   * but this is different - made simpler by ksm_thread_mutex being held, but
>   * interesting for assuming that no other use of the struct page could ever
>   * put our expected_mapping into page->mapping (or a field of the union which
> - * coincides with page->mapping).  The RCU calls are not for KSM at all, but
> - * to keep the page_count protocol described with page_cache_get_speculative.
> + * coincides with page->mapping).
>   *
>   * Note: it is possible that get_ksm_page() will return NULL one moment,
>   * then page the next, if the page is in between page_freeze_refs() and
>   * page_unfreeze_refs(): this shouldn't be a problem anywhere, the page
>   * is on its way to being freed; but it is an anomaly to bear in mind.
>   */
> -static struct page *get_ksm_page(struct stable_node *stable_node)
> +static struct page *get_ksm_page(struct stable_node *stable_node, bool locked)
>  {
>  	struct page *page;
>  	void *expected_mapping;
> @@ -530,7 +529,6 @@ static struct page *get_ksm_page(struct
>  	page = pfn_to_page(stable_node->kpfn);
>  	expected_mapping = (void *)stable_node +
>  				(PAGE_MAPPING_ANON | PAGE_MAPPING_KSM);
> -	rcu_read_lock();
>  	if (page->mapping != expected_mapping)
>  		goto stale;
>  	if (!get_page_unless_zero(page))
> @@ -539,10 +537,16 @@ static struct page *get_ksm_page(struct
>  		put_page(page);
>  		goto stale;
>  	}
> -	rcu_read_unlock();
> +	if (locked) {
> +		lock_page(page);
> +		if (page->mapping != expected_mapping) {
> +			unlock_page(page);
> +			put_page(page);
> +			goto stale;
> +		}
> +	}
>  	return page;
>  stale:
> -	rcu_read_unlock();
>  	remove_node_from_stable_tree(stable_node);
>  	return NULL;
>  }
> @@ -558,11 +562,10 @@ static void remove_rmap_item_from_tree(s
>  		struct page *page;
>  
>  		stable_node = rmap_item->head;
> -		page = get_ksm_page(stable_node);
> +		page = get_ksm_page(stable_node, true);
>  		if (!page)
>  			goto out;
>  
> -		lock_page(page);
>  		hlist_del(&rmap_item->hlist);
>  		unlock_page(page);
>  		put_page(page);
> @@ -1042,7 +1045,7 @@ static struct page *stable_tree_search(s
>  
>  		cond_resched();
>  		stable_node = rb_entry(node, struct stable_node, node);
> -		tree_page = get_ksm_page(stable_node);
> +		tree_page = get_ksm_page(stable_node, false);
>  		if (!tree_page)
>  			return NULL;
>  
> @@ -1086,7 +1089,7 @@ static struct stable_node *stable_tree_i
>  
>  		cond_resched();
>  		stable_node = rb_entry(*new, struct stable_node, node);
> -		tree_page = get_ksm_page(stable_node);
> +		tree_page = get_ksm_page(stable_node, false);
>  		if (!tree_page)
>  			return NULL;
>  
> 
> --
> To unsubscribe, send a message with 'unsubscribe linux-mm' in
> the body to majordomo@kvack.org.  For more info on Linux MM,
> see: http://www.linux-mm.org/ .
> Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>



  parent reply	other threads:[~2013-01-27  2:48 UTC|newest]

Thread overview: 138+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-01-26  1:53 [PATCH 0/11] ksm: NUMA trees and page migration Hugh Dickins
2013-01-26  1:53 ` Hugh Dickins
2013-01-26  1:54 ` [PATCH 1/11] ksm: allow trees per NUMA node Hugh Dickins
2013-01-26  1:54   ` Hugh Dickins
2013-01-27  1:14   ` Simon Jeons
2013-01-27  1:14     ` Simon Jeons
2013-01-27  2:54     ` Hugh Dickins
2013-01-27  2:54       ` Hugh Dickins
2013-01-27  3:16       ` Simon Jeons
2013-01-27  3:16         ` Simon Jeons
2013-01-27 21:55         ` Hugh Dickins
2013-01-27 21:55           ` Hugh Dickins
2013-01-28 23:03   ` Andrew Morton
2013-01-28 23:03     ` Andrew Morton
2013-01-29  1:17     ` Hugh Dickins
2013-01-29  1:17       ` Hugh Dickins
2013-01-28 23:08   ` Andrew Morton
2013-01-28 23:08     ` Andrew Morton
2013-01-29  1:38     ` Hugh Dickins
2013-01-29  1:38       ` Hugh Dickins
2013-02-05 16:41   ` Mel Gorman
2013-02-05 16:41     ` Mel Gorman
2013-02-07 23:57     ` Hugh Dickins
2013-02-07 23:57       ` Hugh Dickins
2013-01-26  1:56 ` [PATCH 2/11] ksm: add sysfs ABI Documentation Hugh Dickins
2013-01-26  1:56   ` Hugh Dickins
2013-01-26  1:58 ` [PATCH 3/11] ksm: trivial tidyups Hugh Dickins
2013-01-26  1:58   ` Hugh Dickins
2013-01-28 23:11   ` Andrew Morton
2013-01-28 23:11     ` Andrew Morton
2013-01-29  1:44     ` Hugh Dickins
2013-01-29  1:44       ` Hugh Dickins
2013-01-26  1:59 ` [PATCH 4/11] ksm: reorganize ksm_check_stable_tree Hugh Dickins
2013-01-26  1:59   ` Hugh Dickins
2013-02-05 16:48   ` Mel Gorman
2013-02-05 16:48     ` Mel Gorman
2013-02-08  0:07     ` Hugh Dickins
2013-02-08  0:07       ` Hugh Dickins
2013-02-14 11:30       ` Mel Gorman
2013-02-14 11:30         ` Mel Gorman
2013-01-26  2:00 ` [PATCH 5/11] ksm: get_ksm_page locked Hugh Dickins
2013-01-26  2:00   ` Hugh Dickins
2013-01-27  2:36   ` Simon Jeons
2013-01-27  2:36     ` Simon Jeons
2013-01-27 22:08     ` Hugh Dickins
2013-01-27 22:08       ` Hugh Dickins
2013-01-28  0:36       ` Simon Jeons
2013-01-28  0:36         ` Simon Jeons
2013-01-28  3:35         ` Hugh Dickins
2013-01-28  3:35           ` Hugh Dickins
2013-01-27  2:48   ` Simon Jeons [this message]
2013-01-27  2:48     ` Simon Jeons
2013-01-27 22:10     ` Hugh Dickins
2013-01-27 22:10       ` Hugh Dickins
2013-02-05 17:18   ` Mel Gorman
2013-02-05 17:18     ` Mel Gorman
2013-02-08  0:33     ` Hugh Dickins
2013-02-08  0:33       ` Hugh Dickins
2013-02-14 11:34       ` Mel Gorman
2013-02-14 11:34         ` Mel Gorman
2013-01-26  2:01 ` [PATCH 6/11] ksm: remove old stable nodes more thoroughly Hugh Dickins
2013-01-26  2:01   ` Hugh Dickins
2013-01-27  4:55   ` Simon Jeons
2013-01-27  4:55     ` Simon Jeons
2013-01-27 23:05     ` Hugh Dickins
2013-01-27 23:05       ` Hugh Dickins
2013-01-28  1:42       ` Simon Jeons
2013-01-28  1:42         ` Simon Jeons
2013-01-28  4:14         ` Hugh Dickins
2013-01-28  4:14           ` Hugh Dickins
2013-01-28  2:12   ` Simon Jeons
2013-01-28  2:12     ` Simon Jeons
2013-01-28  4:19     ` Hugh Dickins
2013-01-28  4:19       ` Hugh Dickins
2013-01-28  6:36   ` Simon Jeons
2013-01-28  6:36     ` Simon Jeons
2013-01-28 23:44   ` Andrew Morton
2013-01-28 23:44     ` Andrew Morton
2013-01-29  2:03     ` Hugh Dickins
2013-01-29  2:03       ` Hugh Dickins
2013-02-05 17:55   ` Mel Gorman
2013-02-05 17:55     ` Mel Gorman
2013-02-08 19:33     ` Hugh Dickins
2013-02-08 19:33       ` Hugh Dickins
2013-02-14 11:58       ` Mel Gorman
2013-02-14 11:58         ` Mel Gorman
2013-02-14 22:19         ` Hugh Dickins
2013-02-14 22:19           ` Hugh Dickins
2013-01-26  2:03 ` [PATCH 7/11] ksm: make KSM page migration possible Hugh Dickins
2013-01-26  2:03   ` Hugh Dickins
2013-01-27  5:47   ` Simon Jeons
2013-01-27  5:47     ` Simon Jeons
2013-01-27 23:12     ` Hugh Dickins
2013-01-27 23:12       ` Hugh Dickins
2013-01-28  0:41       ` Simon Jeons
2013-01-28  0:41         ` Simon Jeons
2013-01-28  3:44         ` Hugh Dickins
2013-01-28  3:44           ` Hugh Dickins
2013-02-05 19:11   ` Mel Gorman
2013-02-05 19:11     ` Mel Gorman
2013-02-08 20:52     ` Hugh Dickins
2013-02-08 20:52       ` Hugh Dickins
2013-01-26  2:05 ` [PATCH 8/11] ksm: make !merge_across_nodes migration safe Hugh Dickins
2013-01-26  2:05   ` Hugh Dickins
2013-01-27  8:49   ` Simon Jeons
2013-01-27  8:49     ` Simon Jeons
2013-01-27 23:25     ` Hugh Dickins
2013-01-27 23:25       ` Hugh Dickins
2013-01-28  3:44   ` Simon Jeons
2013-01-28  3:44     ` Simon Jeons
2013-01-26  2:06 ` [PATCH 9/11] ksm: enable KSM page migration Hugh Dickins
2013-01-26  2:06   ` Hugh Dickins
2013-01-26  2:07 ` [PATCH 10/11] mm: remove offlining arg to migrate_pages Hugh Dickins
2013-01-26  2:07   ` Hugh Dickins
2013-01-26  2:10 ` [PATCH 11/11] ksm: stop hotremove lockdep warning Hugh Dickins
2013-01-26  2:10   ` Hugh Dickins
2013-01-27  6:23   ` Simon Jeons
2013-01-27  6:23     ` Simon Jeons
2013-01-27 23:35     ` Hugh Dickins
2013-01-27 23:35       ` Hugh Dickins
2013-02-08 18:45   ` Gerald Schaefer
2013-02-08 18:45     ` Gerald Schaefer
2013-02-11 22:13     ` Hugh Dickins
2013-02-11 22:13       ` Hugh Dickins
2013-01-28 23:54 ` [PATCH 0/11] ksm: NUMA trees and page migration Andrew Morton
2013-01-28 23:54   ` Andrew Morton
2013-01-29  0:49   ` Izik Eidus
2013-01-29  0:49     ` Izik Eidus
2013-01-29  2:26     ` Izik Eidus
2013-01-29  2:26       ` Izik Eidus
2013-01-29 16:51       ` Andrea Arcangeli
2013-01-29 16:51         ` Andrea Arcangeli
2013-01-31  0:05         ` Ric Mason
2013-01-31  0:05           ` Ric Mason
2013-01-29  1:07   ` Hugh Dickins
2013-01-29  1:07     ` Hugh Dickins
2013-01-29 10:45     ` Gleb Natapov
2013-01-29 10:45       ` Gleb Natapov

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1359254927.4159.11.camel@kernel \
    --to=simon.jeons@gmail.com \
    --cc=aarcange@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=hughd@google.com \
    --cc=izik.eidus@ravellosystems.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=pholasek@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.