All of lore.kernel.org
 help / color / mirror / Atom feed
From: Ray Bryant <raybry@sgi.com>
To: Dave Hansen <haveblue@us.ibm.com>
Cc: Robin Holt <holt@sgi.com>,
	Hirokazu Takahashi <taka@valinux.co.jp>,
	Hugh DIckins <hugh@veritas.com>, Andrew Morton <akpm@osdl.org>,
	Marcello Tosatti <marcello@cyclades.com>,
	Ray Bryant <raybry@austin.rr.com>, linux-mm <linux-mm@kvack.org>,
	linux-kernel <linux-kernel@vger.kernel.org>
Subject: Re: [RFC 2.6.11-rc2-mm2 7/7] mm: manual page migration --	sys_page_migrate
Date: Tue, 15 Feb 2005 12:54:09 -0600	[thread overview]
Message-ID: <42124551.8060401@sgi.com> (raw)
In-Reply-To: <1108492753.6154.82.camel@localhost>

Dave Hansen wrote:
> On Tue, 2005-02-15 at 04:50 -0600, Robin Holt wrote:
> 
>>What is the fundamental opposition to an array from from-to node mappings?
>>They are not that difficult to follow.  They make the expensive traversal
>>of ptes the single pass operation.  The time to scan the list of from nodes
>>to locate the node this page belongs to is relatively quick when compared
>>to the time to scan ptes and will result in probably no cache trashing
>>like the long traversal of all ptes in the system required for multiple
>>system calls.  I can not see the node array as anything but the right way
>>when compared to multiple system calls.  What am I missing?
> 
> 
> I don't really have any fundamental opposition.  I'm just trying to make
> sure that there's not a simpler (better) way of doing it.  You've
> obviously thought about it a lot more than I have, and I'm trying to
> understand your process.
> 
> As far as the execution speed with a simpler system call.  Yes, it will
> likely be slower.  However, I'm not sure that the increase in scan time
> is all that significant compared to the migration code (it's pretty
> slow).
> 
> -- Dave
> 
> 
I'm worried about doing all of those find_get_page() things over and over
when the mapped file we are migrating is large.  I suppose one can argue
that that is never going to be the case (e. g. no one in their right mind
would migrate a job with a 300 GB mapped file).  So we are back to the
overlapping set of nodes issue.  Let me look into this some more.

-- 
-----------------------------------------------
Ray Bryant
512-453-9679 (work)         512-507-7807 (cell)
raybry@sgi.com             raybry@austin.rr.com
The box said: "Requires Windows 98 or better",
	 so I installed Linux.
-----------------------------------------------

WARNING: multiple messages have this Message-ID (diff)
From: Ray Bryant <raybry@sgi.com>
To: Dave Hansen <haveblue@us.ibm.com>
Cc: Robin Holt <holt@sgi.com>,
	Hirokazu Takahashi <taka@valinux.co.jp>,
	Hugh DIckins <hugh@veritas.com>, Andrew Morton <akpm@osdl.org>,
	Marcello Tosatti <marcello@cyclades.com>,
	Ray Bryant <raybry@austin.rr.com>, linux-mm <linux-mm@kvack.org>,
	linux-kernel <linux-kernel@vger.kernel.org>
Subject: Re: [RFC 2.6.11-rc2-mm2 7/7] mm: manual page migration --	sys_page_migrate
Date: Tue, 15 Feb 2005 12:54:09 -0600	[thread overview]
Message-ID: <42124551.8060401@sgi.com> (raw)
In-Reply-To: <1108492753.6154.82.camel@localhost>

Dave Hansen wrote:
> On Tue, 2005-02-15 at 04:50 -0600, Robin Holt wrote:
> 
>>What is the fundamental opposition to an array from from-to node mappings?
>>They are not that difficult to follow.  They make the expensive traversal
>>of ptes the single pass operation.  The time to scan the list of from nodes
>>to locate the node this page belongs to is relatively quick when compared
>>to the time to scan ptes and will result in probably no cache trashing
>>like the long traversal of all ptes in the system required for multiple
>>system calls.  I can not see the node array as anything but the right way
>>when compared to multiple system calls.  What am I missing?
> 
> 
> I don't really have any fundamental opposition.  I'm just trying to make
> sure that there's not a simpler (better) way of doing it.  You've
> obviously thought about it a lot more than I have, and I'm trying to
> understand your process.
> 
> As far as the execution speed with a simpler system call.  Yes, it will
> likely be slower.  However, I'm not sure that the increase in scan time
> is all that significant compared to the migration code (it's pretty
> slow).
> 
> -- Dave
> 
> 
I'm worried about doing all of those find_get_page() things over and over
when the mapped file we are migrating is large.  I suppose one can argue
that that is never going to be the case (e. g. no one in their right mind
would migrate a job with a 300 GB mapped file).  So we are back to the
overlapping set of nodes issue.  Let me look into this some more.

-- 
-----------------------------------------------
Ray Bryant
512-453-9679 (work)         512-507-7807 (cell)
raybry@sgi.com             raybry@austin.rr.com
The box said: "Requires Windows 98 or better",
	 so I installed Linux.
-----------------------------------------------
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"aart@kvack.org"> aart@kvack.org </a>

  reply	other threads:[~2005-02-15 18:54 UTC|newest]

Thread overview: 191+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2005-02-12  3:25 [RFC 2.6.11-rc2-mm2 0/7] mm: manual page migration -- overview Ray Bryant
2005-02-12  3:25 ` Ray Bryant
2005-02-12  3:25 ` [RFC 2.6.11-rc2-mm2 1/7] mm: manual page migration -- cleanup 1 Ray Bryant
2005-02-12  3:25   ` Ray Bryant
2005-02-12  3:25 ` [RFC 2.6.11-rc2-mm2 2/7] mm: manual page migration -- cleanup 2 Ray Bryant
2005-02-12  3:25   ` Ray Bryant
2005-02-12  3:25 ` [RFC 2.6.11-rc2-mm2 3/7] mm: manual page migration -- cleanup 3 Ray Bryant
2005-02-12  3:25   ` Ray Bryant
2005-02-12  3:26 ` [RFC 2.6.11-rc2-mm2 4/7] mm: manual page migration -- cleanup 4 Ray Bryant
2005-02-12  3:26   ` Ray Bryant
2005-02-12  3:26 ` [RFC 2.6.11-rc2-mm2 5/7] mm: manual page migration -- cleanup 5 Ray Bryant
2005-02-12  3:26   ` Ray Bryant
2005-02-12  3:26 ` [RFC 2.6.11-rc2-mm2 6/7] mm: manual page migration -- add node_map arg to try_to_migrate_pages() Ray Bryant
2005-02-12  3:26   ` Ray Bryant
2005-02-12  3:26 ` [RFC 2.6.11-rc2-mm2 7/7] mm: manual page migration -- sys_page_migrate Ray Bryant
2005-02-12  3:26   ` Ray Bryant
2005-02-12  8:08   ` Paul Jackson
2005-02-12  8:08     ` Paul Jackson
2005-02-12 12:34   ` Arjan van de Ven
2005-02-12 12:34     ` Arjan van de Ven
2005-02-12 14:48     ` Andi Kleen
2005-02-12 14:48       ` Andi Kleen
2005-02-12 20:51       ` Paul Jackson
2005-02-12 20:51         ` Paul Jackson
2005-02-12 21:04   ` Dave Hansen
2005-02-12 21:04     ` Dave Hansen
2005-02-12 21:44     ` Paul Jackson
2005-02-12 21:44       ` Paul Jackson
2005-02-14 13:52     ` Robin Holt
2005-02-14 13:52       ` Robin Holt
2005-02-14 18:50       ` Dave Hansen
2005-02-14 18:50         ` Dave Hansen
2005-02-14 22:01         ` Robin Holt
2005-02-14 22:01           ` Robin Holt
2005-02-14 22:22           ` Dave Hansen
2005-02-14 22:22             ` Dave Hansen
2005-02-15 10:50             ` Robin Holt
2005-02-15 10:50               ` Robin Holt
2005-02-15 15:38               ` Paul Jackson
2005-02-15 15:38                 ` Paul Jackson
2005-02-15 18:39               ` Dave Hansen
2005-02-15 18:39                 ` Dave Hansen
2005-02-15 18:54                 ` Ray Bryant [this message]
2005-02-15 18:54                   ` Ray Bryant
2005-02-15 15:49           ` Paul Jackson
2005-02-15 15:49             ` Paul Jackson
2005-02-15 16:21             ` Robin Holt
2005-02-15 16:21               ` Robin Holt
2005-02-15 16:35               ` Paul Jackson
2005-02-15 16:35                 ` Paul Jackson
2005-02-15 18:59                 ` Robin Holt
2005-02-15 18:59                   ` Robin Holt
2005-02-15 20:54                   ` Dave Hansen
2005-02-15 20:54                     ` Dave Hansen
2005-02-15 21:58                   ` Peter Chubb
2005-02-15 22:10                     ` Paul Jackson
2005-02-15 22:10                       ` Paul Jackson
2005-02-15 22:51                     ` Robin Holt
2005-02-15 22:51                       ` Robin Holt
2005-02-15 23:00                       ` Paul Jackson
2005-02-15 23:00                         ` Paul Jackson
2005-02-15 23:21                     ` Ray Bryant
2005-02-15 23:51                       ` Martin J. Bligh
2005-02-16  0:38                         ` Ray Bryant
2005-02-16  0:44                           ` Andi Kleen
2005-02-16  0:54                             ` Martin J. Bligh
2005-02-16 10:02                               ` Andi Kleen
2005-02-16 15:21                                 ` Martin J. Bligh
2005-02-16 15:49                                   ` Paul Jackson
2005-02-16 16:08                                     ` Andi Kleen
2005-02-16 16:55                                       ` Martin J. Bligh
2005-02-16 23:35                                         ` Ray Bryant
2005-02-16  0:50                           ` Martin J. Bligh
2005-02-15 15:40         ` Paul Jackson
2005-02-15 15:40           ` Paul Jackson
2005-02-12 11:17 ` [RFC 2.6.11-rc2-mm2 0/7] mm: manual page migration -- overview Andi Kleen
2005-02-12 11:17   ` Andi Kleen
2005-02-12 12:12   ` Robin Holt
2005-02-12 12:12     ` Robin Holt
2005-02-14 19:18     ` Andi Kleen
2005-02-14 19:18       ` Andi Kleen
2005-02-15  1:02       ` Steve Longerbeam
2005-02-15  1:02         ` Steve Longerbeam
2005-02-12 15:54   ` Marcelo Tosatti
2005-02-12 15:54     ` Marcelo Tosatti
2005-02-12 16:18     ` Marcelo Tosatti
2005-02-12 16:18       ` Marcelo Tosatti
2005-02-12 21:29     ` Andi Kleen
2005-02-12 21:29       ` Andi Kleen
2005-02-14 16:38       ` Robin Holt
2005-02-14 16:38         ` Robin Holt
2005-02-14 19:15         ` Andi Kleen
2005-02-14 19:15           ` Andi Kleen
2005-02-14 23:49           ` Ray Bryant
2005-02-14 23:49             ` Ray Bryant
2005-02-15  3:16             ` Paul Jackson
2005-02-15  3:16               ` Paul Jackson
2005-02-15  9:14               ` Ray Bryant
2005-02-15  9:14                 ` Ray Bryant
2005-02-15 15:21                 ` Paul Jackson
2005-02-15 15:21                   ` Paul Jackson
2005-02-15  0:29   ` Ray Bryant
2005-02-15  0:29     ` Ray Bryant
2005-02-15 11:05     ` Robin Holt
2005-02-15 11:05       ` Robin Holt
2005-02-15 17:44       ` Ray Bryant
2005-02-15 17:44         ` Ray Bryant
2005-02-15 11:53     ` Andi Kleen
2005-02-15 11:53       ` Andi Kleen
2005-02-15 12:15       ` Robin Holt
2005-02-15 12:15         ` Robin Holt
2005-02-15 15:07         ` Paul Jackson
2005-02-15 15:07           ` Paul Jackson
2005-02-15 15:11         ` Paul Jackson
2005-02-15 15:11           ` Paul Jackson
2005-02-15 18:16       ` Ray Bryant
2005-02-15 18:16         ` Ray Bryant
2005-02-15 18:24         ` Andi Kleen
2005-02-15 18:24           ` Andi Kleen
2005-02-15 12:14     ` [RFC 2.6.11-rc2-mm2 0/7] mm: manual page migration -- overview II Andi Kleen
2005-02-15 12:14       ` Andi Kleen
2005-02-15 18:38       ` Ray Bryant
2005-02-15 18:38         ` Ray Bryant
2005-02-15 21:48         ` Andi Kleen
2005-02-15 21:48           ` Andi Kleen
2005-02-15 22:37           ` Paul Jackson
2005-02-15 22:37             ` Paul Jackson
2005-02-16  3:44           ` Ray Bryant
2005-02-16  3:44             ` Ray Bryant
2005-02-17 23:54             ` Andi Kleen
2005-02-17 23:54               ` Andi Kleen
2005-02-18  8:38               ` Ray Bryant
2005-02-18  8:38                 ` Ray Bryant
2005-02-18 13:02                 ` Andi Kleen
2005-02-18 13:02                   ` Andi Kleen
2005-02-18 16:18                   ` Paul Jackson
2005-02-18 16:18                     ` Paul Jackson
2005-02-18 16:20                   ` Paul Jackson
2005-02-18 16:20                     ` Paul Jackson
2005-02-18 16:22                   ` Paul Jackson
2005-02-18 16:22                     ` Paul Jackson
2005-02-18 16:25                   ` Paul Jackson
2005-02-18 16:25                     ` Paul Jackson
2005-02-19  1:01                   ` Ray Bryant
2005-02-19  1:01                     ` Ray Bryant
2005-02-20 21:49                     ` Andi Kleen
2005-02-20 21:49                       ` Andi Kleen
2005-02-20 22:30                       ` Paul Jackson
2005-02-20 22:30                         ` Paul Jackson
2005-02-20 22:35                         ` Andi Kleen
2005-02-20 22:35                           ` Andi Kleen
2005-02-21  1:50                           ` Paul Jackson
2005-02-21  1:50                             ` Paul Jackson
2005-02-21  7:39                             ` Ray Bryant
2005-02-21  7:39                               ` Ray Bryant
2005-02-21  7:29                           ` Ray Bryant
2005-02-21  7:29                             ` Ray Bryant
2005-02-21  9:57                             ` Andi Kleen
2005-02-21  9:57                               ` Andi Kleen
2005-02-21 12:02                               ` Paul Jackson
2005-02-21 12:02                                 ` Paul Jackson
2005-02-21  8:42                           ` Ray Bryant
2005-02-21  8:42                             ` Ray Bryant
2005-02-21 12:10                             ` Andi Kleen
2005-02-21 12:10                               ` Andi Kleen
2005-02-21 17:12                               ` Ray Bryant
2005-02-21 17:12                                 ` Ray Bryant
2005-02-22 18:03                                 ` Andi Kleen
2005-02-22 18:03                                   ` Andi Kleen
2005-02-23  3:33                                   ` Ray Bryant
2005-02-22  6:40                               ` Ray Bryant
2005-02-22  6:40                                 ` Ray Bryant
2005-02-22 18:01                                 ` Andi Kleen
2005-02-22 18:01                                   ` Andi Kleen
2005-02-22 18:45                                   ` Ray Bryant
2005-02-22 18:45                                     ` Ray Bryant
2005-02-22 18:49                                     ` Andi Kleen
2005-02-22 18:49                                       ` Andi Kleen
2005-02-26 18:22                                       ` Ray Bryant
2005-02-22 22:04                                   ` Ray Bryant
2005-02-22 22:04                                     ` Ray Bryant
2005-02-22  6:44                               ` Ray Bryant
2005-02-22  6:44                                 ` Ray Bryant
2005-02-21  4:20                       ` Ray Bryant
2005-02-21  4:20                         ` Ray Bryant
2005-02-18 16:58               ` Ray Bryant
2005-02-18 16:58                 ` Ray Bryant
2005-02-18 17:02               ` Ray Bryant
2005-02-18 17:02                 ` Ray Bryant
2005-02-18 17:11               ` Ray Bryant
2005-02-18 17:11                 ` Ray Bryant

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=42124551.8060401@sgi.com \
    --to=raybry@sgi.com \
    --cc=akpm@osdl.org \
    --cc=haveblue@us.ibm.com \
    --cc=holt@sgi.com \
    --cc=hugh@veritas.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=marcello@cyclades.com \
    --cc=raybry@austin.rr.com \
    --cc=taka@valinux.co.jp \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.