All of lore.kernel.org
 help / color / mirror / Atom feed
From: Rik van Riel <riel@redhat.com>
To: Mel Gorman <mel@csn.ul.ie>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Linux-MM <linux-mm@kvack.org>,
	LKML <linux-kernel@vger.kernel.org>,
	Minchan Kim <minchan.kim@gmail.com>,
	KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>,
	Christoph Lameter <cl@linux.com>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	Peter Zijlstra <peterz@infradead.org>
Subject: Re: [PATCH 1/2] mm,migration: Prevent rmap_walk_[anon|ksm] seeing the wrong VMA information
Date: Thu, 06 May 2010 11:44:57 -0400	[thread overview]
Message-ID: <4BE2E3F9.9090708@redhat.com> (raw)
In-Reply-To: <1273159987-10167-2-git-send-email-mel@csn.ul.ie>

On 05/06/2010 11:33 AM, Mel Gorman wrote:

> @@ -1368,16 +1424,25 @@ static int rmap_walk_anon(struct page *page, int (*rmap_one)(struct page *,
>   	 * are holding mmap_sem. Users without mmap_sem are required to
>   	 * take a reference count to prevent the anon_vma disappearing
>   	 */
> -	anon_vma = page_anon_vma(page);
> +	anon_vma = page_anon_vma_lock_root(page);
>   	if (!anon_vma)
>   		return ret;
> -	spin_lock(&anon_vma->lock);
>   	list_for_each_entry(avc,&anon_vma->head, same_anon_vma) {

One conceptual problem here.  By taking the oldest anon_vma,
instead of the anon_vma of the page, we may end up searching
way too many processes.

Eg. if the page is the page of a child process in a forking
server workload, the above code will end up searching the
parent and all of the siblings - even for a private page, in
the child process's private anon_vma.

For an Apache or Oracle system with 1000 clients (and child
processes), that could be quite a drag - searching 1000 times
as many processes as we should.

WARNING: multiple messages have this Message-ID (diff)
From: Rik van Riel <riel@redhat.com>
To: Mel Gorman <mel@csn.ul.ie>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Linux-MM <linux-mm@kvack.org>,
	LKML <linux-kernel@vger.kernel.org>,
	Minchan Kim <minchan.kim@gmail.com>,
	KAMEZAWA Hiroyuki <kamezawa.hiroyu@jp.fujitsu.com>,
	Christoph Lameter <cl@linux.com>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	Peter Zijlstra <peterz@infradead.org>
Subject: Re: [PATCH 1/2] mm,migration: Prevent rmap_walk_[anon|ksm] seeing the wrong VMA information
Date: Thu, 06 May 2010 11:44:57 -0400	[thread overview]
Message-ID: <4BE2E3F9.9090708@redhat.com> (raw)
In-Reply-To: <1273159987-10167-2-git-send-email-mel@csn.ul.ie>

On 05/06/2010 11:33 AM, Mel Gorman wrote:

> @@ -1368,16 +1424,25 @@ static int rmap_walk_anon(struct page *page, int (*rmap_one)(struct page *,
>   	 * are holding mmap_sem. Users without mmap_sem are required to
>   	 * take a reference count to prevent the anon_vma disappearing
>   	 */
> -	anon_vma = page_anon_vma(page);
> +	anon_vma = page_anon_vma_lock_root(page);
>   	if (!anon_vma)
>   		return ret;
> -	spin_lock(&anon_vma->lock);
>   	list_for_each_entry(avc,&anon_vma->head, same_anon_vma) {

One conceptual problem here.  By taking the oldest anon_vma,
instead of the anon_vma of the page, we may end up searching
way too many processes.

Eg. if the page is the page of a child process in a forking
server workload, the above code will end up searching the
parent and all of the siblings - even for a private page, in
the child process's private anon_vma.

For an Apache or Oracle system with 1000 clients (and child
processes), that could be quite a drag - searching 1000 times
as many processes as we should.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2010-05-06 15:45 UTC|newest]

Thread overview: 100+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-05-06 15:33 [PATCH 0/2] Fix migration races in rmap_walk() V6 Mel Gorman
2010-05-06 15:33 ` Mel Gorman
2010-05-06 15:33 ` [PATCH 1/2] mm,migration: Prevent rmap_walk_[anon|ksm] seeing the wrong VMA information Mel Gorman
2010-05-06 15:33   ` Mel Gorman
2010-05-06 15:44   ` Rik van Riel [this message]
2010-05-06 15:44     ` Rik van Riel
2010-05-06 15:51     ` Mel Gorman
2010-05-06 15:51       ` Mel Gorman
2010-05-06 15:59   ` Linus Torvalds
2010-05-06 15:59     ` Linus Torvalds
2010-05-06 17:07     ` Mel Gorman
2010-05-06 17:07       ` Mel Gorman
2010-05-06 15:33 ` [PATCH 2/2] mm,migration: Fix race between shift_arg_pages and rmap_walk by guaranteeing rmap_walk finds PTEs created within the temporary stack Mel Gorman
2010-05-06 15:33   ` Mel Gorman
  -- strict thread matches above, loose matches on Subject: below --
2010-05-06 23:20 [PATCH 0/2] Fix migration races in rmap_walk() V7 Mel Gorman
2010-05-06 23:20 ` [PATCH 1/2] mm,migration: Prevent rmap_walk_[anon|ksm] seeing the wrong VMA information Mel Gorman
2010-05-06 23:20   ` Mel Gorman
2010-05-07  0:56   ` KAMEZAWA Hiroyuki
2010-05-07  0:56     ` KAMEZAWA Hiroyuki
2010-05-07 16:26     ` Mel Gorman
2010-05-07 16:26       ` Mel Gorman
2010-05-08 15:39   ` Andrea Arcangeli
2010-05-08 15:39     ` Andrea Arcangeli
2010-05-08 17:02     ` Linus Torvalds
2010-05-08 17:02       ` Linus Torvalds
2010-05-08 18:04       ` Andrea Arcangeli
2010-05-08 18:04         ` Andrea Arcangeli
2010-05-08 19:51         ` Linus Torvalds
2010-05-08 19:51           ` Linus Torvalds
2010-05-09 19:23     ` Mel Gorman
2010-05-09 19:23       ` Mel Gorman
2010-05-05 13:14 [PATCH 0/2] Fix migration races in rmap_walk() V5 Mel Gorman
2010-05-05 13:14 ` [PATCH 1/2] mm,migration: Prevent rmap_walk_[anon|ksm] seeing the wrong VMA information Mel Gorman
2010-05-05 13:14   ` Mel Gorman
2010-05-05 14:34   ` Linus Torvalds
2010-05-05 14:34     ` Linus Torvalds
2010-05-05 14:56     ` Mel Gorman
2010-05-05 14:56       ` Mel Gorman
2010-05-05 15:31       ` Linus Torvalds
2010-05-05 15:31         ` Linus Torvalds
2010-05-05 15:54         ` Mel Gorman
2010-05-05 15:54           ` Mel Gorman
2010-05-05 16:13           ` Andrea Arcangeli
2010-05-05 16:13             ` Andrea Arcangeli
2010-05-05 19:11             ` Peter Zijlstra
2010-05-05 19:11               ` Peter Zijlstra
2010-05-05 19:57               ` Andrea Arcangeli
2010-05-05 19:57                 ` Andrea Arcangeli
2010-05-21  0:27               ` Andrea Arcangeli
2010-05-21  0:27                 ` Andrea Arcangeli
2010-05-06 10:37             ` Mel Gorman
2010-05-06 10:37               ` Mel Gorman
2010-05-05 17:34           ` Linus Torvalds
2010-05-05 17:34             ` Linus Torvalds
2010-05-05 17:57             ` Linus Torvalds
2010-05-05 17:57               ` Linus Torvalds
2010-05-05 18:14             ` Mel Gorman
2010-05-05 18:14               ` Mel Gorman
2010-05-05 18:34               ` Linus Torvalds
2010-05-05 18:34                 ` Linus Torvalds
2010-05-06 11:03                 ` Mel Gorman
2010-05-06 11:03                   ` Mel Gorman
2010-05-06 13:40             ` Rik van Riel
2010-05-06 13:40               ` Rik van Riel
2010-05-06 13:45               ` Mel Gorman
2010-05-06 13:45                 ` Mel Gorman
2010-05-05 17:53         ` Mel Gorman
2010-05-05 17:53           ` Mel Gorman
2010-05-05 18:02           ` Linus Torvalds
2010-05-05 18:02             ` Linus Torvalds
2010-05-05 18:17             ` Mel Gorman
2010-05-05 18:17               ` Mel Gorman
2010-05-06  0:22             ` Mel Gorman
2010-05-06  0:22               ` Mel Gorman
2010-05-06  0:42               ` Linus Torvalds
2010-05-06  0:42                 ` Linus Torvalds
2010-05-06 10:02                 ` Mel Gorman
2010-05-06 10:02                   ` Mel Gorman
2010-05-06 14:15                   ` Linus Torvalds
2010-05-06 14:15                     ` Linus Torvalds
2010-05-06 14:25                     ` Mel Gorman
2010-05-06 14:25                       ` Mel Gorman
2010-05-06  9:47               ` Minchan Kim
2010-05-06  9:47                 ` Minchan Kim
2010-05-06  9:54                 ` Mel Gorman
2010-05-06  9:54                   ` Mel Gorman
2010-05-06 10:01                   ` Minchan Kim
2010-05-06 10:01                     ` Minchan Kim
2010-05-06 10:10                     ` Mel Gorman
2010-05-06 10:10                       ` Mel Gorman
2010-05-06 14:06                 ` Linus Torvalds
2010-05-06 14:06                   ` Linus Torvalds
2010-05-06 15:59                   ` Minchan Kim
2010-05-06 15:59                     ` Minchan Kim
2010-05-06  7:38   ` KAMEZAWA Hiroyuki
2010-05-06  7:38     ` KAMEZAWA Hiroyuki
2010-05-06  9:46     ` Mel Gorman
2010-05-06  9:46       ` Mel Gorman
2010-05-06 23:52       ` KAMEZAWA Hiroyuki
2010-05-06 23:52         ` KAMEZAWA Hiroyuki
2010-05-07  5:49         ` KAMEZAWA Hiroyuki
2010-05-07  5:49           ` KAMEZAWA Hiroyuki

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4BE2E3F9.9090708@redhat.com \
    --to=riel@redhat.com \
    --cc=aarcange@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=cl@linux.com \
    --cc=kamezawa.hiroyu@jp.fujitsu.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mel@csn.ul.ie \
    --cc=minchan.kim@gmail.com \
    --cc=peterz@infradead.org \
    --cc=torvalds@linux-foundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.