All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Martin J. Bligh" <mbligh@aracnet.com>
To: Andrew Morton <akpm@digeo.com>, Andrea Arcangeli <andrea@suse.de>
Cc: mingo@elte.hu, hugh@veritas.com, dmccr@us.ibm.com,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: objrmap and vmtruncate
Date: Fri, 04 Apr 2003 18:13:52 -0800	[thread overview]
Message-ID: <12880000.1049508832@flay> (raw)
In-Reply-To: <20030404163154.77f19d9e.akpm@digeo.com>

> Perhaps it is useful to itemise the prblems which we're trying to solve here:
> 
> - ZONE_NORMAL consumption by pte_chains
> 
>   Solved by objrmap and presumably page clustering.
> 
> - ZONE_NORMAL consumption by VMAs
> 
>   Solved by remap_file_pages.  Neither objrmap nor page clustering will
>   help here.

I'm not convinced that we can't do something with nonlinear mappings for
this ... we just need to keep a list of linear areas within the nonlinear
vmas, and use that to do the objrmap stuff with. Dave and I talked about
this yesterday ... we both had different terminology, but I think the
same underlying fundamental concept ... I was calling them "sub-vmas"
for each linear region within the nonlinear space. 

The fundamental problem I came to (and I think Dave had the same problem) 
is that I couldn't see what problem remap_file_pages was trying to solve,
so it was tricky to see if we'd cause the same thing or not. sub-vmas
could certainly be a lot smaller, but we weren't thinking of 128K of the
damned things, so ... the other thing is of course the setup and teardown
time ... but the could be a btree or something for the structure.

Of course, if we did this, it would get rid of the whole conversion
to and from object based stuff ;-) I think Dave had some other bright
idea on this too, but I don't recall what it was ;-(

> - pte_chain setup and teardown CPU cost.
> 
>   objrmap does not seem to help.  Page clustering might, but is unlikely to
>   be enabled on the machines which actually care about the overhead.

eh? Not sure what you mean by that. It helped massively ...
diffprofile from kernbench showed:

     -4666   -74.9% page_add_rmap
    -10666   -92.0% page_remove_rmap

I'd say that about an 85% reduction in cost is pretty damned fine ;-)
And that was about a 20% overall reduction in the system time for the
test too ... that was all for partial objrmap (file backed, not anon).

M.

WARNING: multiple messages have this Message-ID (diff)
From: "Martin J. Bligh" <mbligh@aracnet.com>
To: Andrew Morton <akpm@digeo.com>, Andrea Arcangeli <andrea@suse.de>
Cc: mingo@elte.hu, hugh@veritas.com, dmccr@us.ibm.com,
	linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: objrmap and vmtruncate
Date: Fri, 04 Apr 2003 18:13:52 -0800	[thread overview]
Message-ID: <12880000.1049508832@flay> (raw)
In-Reply-To: <20030404163154.77f19d9e.akpm@digeo.com>

> Perhaps it is useful to itemise the prblems which we're trying to solve here:
> 
> - ZONE_NORMAL consumption by pte_chains
> 
>   Solved by objrmap and presumably page clustering.
> 
> - ZONE_NORMAL consumption by VMAs
> 
>   Solved by remap_file_pages.  Neither objrmap nor page clustering will
>   help here.

I'm not convinced that we can't do something with nonlinear mappings for
this ... we just need to keep a list of linear areas within the nonlinear
vmas, and use that to do the objrmap stuff with. Dave and I talked about
this yesterday ... we both had different terminology, but I think the
same underlying fundamental concept ... I was calling them "sub-vmas"
for each linear region within the nonlinear space. 

The fundamental problem I came to (and I think Dave had the same problem) 
is that I couldn't see what problem remap_file_pages was trying to solve,
so it was tricky to see if we'd cause the same thing or not. sub-vmas
could certainly be a lot smaller, but we weren't thinking of 128K of the
damned things, so ... the other thing is of course the setup and teardown
time ... but the could be a btree or something for the structure.

Of course, if we did this, it would get rid of the whole conversion
to and from object based stuff ;-) I think Dave had some other bright
idea on this too, but I don't recall what it was ;-(

> - pte_chain setup and teardown CPU cost.
> 
>   objrmap does not seem to help.  Page clustering might, but is unlikely to
>   be enabled on the machines which actually care about the overhead.

eh? Not sure what you mean by that. It helped massively ...
diffprofile from kernbench showed:

     -4666   -74.9% page_add_rmap
    -10666   -92.0% page_remove_rmap

I'd say that about an 85% reduction in cost is pretty damned fine ;-)
And that was about a 20% overall reduction in the system time for the
test too ... that was all for partial objrmap (file backed, not anon).

M.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"aart@kvack.org">aart@kvack.org</a>

  parent reply	other threads:[~2003-04-05  2:12 UTC|newest]

Thread overview: 210+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2003-04-04 14:34 objrmap and vmtruncate Hugh Dickins
2003-04-04 14:34 ` Hugh Dickins
2003-04-04 16:14 ` William Lee Irwin III
2003-04-04 16:14   ` William Lee Irwin III
2003-04-04 16:29   ` Hugh Dickins
2003-04-04 16:29     ` Hugh Dickins
2003-04-04 18:54 ` Andrew Morton
2003-04-04 18:54   ` Andrew Morton
2003-04-04 21:43   ` Hugh Dickins
2003-04-04 21:43     ` Hugh Dickins
2003-04-04 21:45   ` Andrea Arcangeli
2003-04-04 21:45     ` Andrea Arcangeli
2003-04-04 21:58     ` Benjamin LaHaise
2003-04-04 21:58       ` Benjamin LaHaise
2003-04-04 23:07     ` Andrew Morton
2003-04-04 23:07       ` Andrew Morton
2003-04-05  0:03       ` Andrea Arcangeli
2003-04-05  0:03         ` Andrea Arcangeli
2003-04-05  0:31         ` Andrew Morton
2003-04-05  0:31           ` Andrew Morton
2003-04-05  1:31           ` Andrea Arcangeli
2003-04-05  1:31             ` Andrea Arcangeli
2003-04-05  1:52             ` Benjamin LaHaise
2003-04-05  1:52               ` Benjamin LaHaise
2003-04-05  2:22               ` Andrea Arcangeli
2003-04-05  2:22                 ` Andrea Arcangeli
2003-04-05 10:01                 ` Jamie Lokier
2003-04-05 10:01                   ` Jamie Lokier
2003-04-05 10:11                   ` William Lee Irwin III
2003-04-05 10:11                     ` William Lee Irwin III
2003-04-05  2:06             ` Andrew Morton
2003-04-05  2:06               ` Andrew Morton
2003-04-05  2:24               ` Andrea Arcangeli
2003-04-05  2:24                 ` Andrea Arcangeli
2003-04-05  2:13           ` Martin J. Bligh [this message]
2003-04-05  2:13             ` Martin J. Bligh
2003-04-05  2:44             ` Andrea Arcangeli
2003-04-05  2:44               ` Andrea Arcangeli
2003-04-05  3:24               ` Andrew Morton
2003-04-05  3:24                 ` Andrew Morton
2003-04-05 12:06                 ` Andrew Morton
2003-04-05 12:06                   ` Andrew Morton
2003-04-05 15:11                   ` Martin J. Bligh
2003-04-05 15:11                     ` Martin J. Bligh
2003-04-06  0:17                     ` Andrew Morton
2003-04-06  0:17                       ` Andrew Morton
2003-04-06  7:07                       ` William Lee Irwin III
2003-04-06  7:07                         ` William Lee Irwin III
2003-04-05 16:30                   ` Andrea Arcangeli
2003-04-05 16:30                     ` Andrea Arcangeli
2003-04-05 19:01                     ` Andrea Arcangeli
2003-04-05 19:01                       ` Andrea Arcangeli
2003-04-05 20:14                       ` Andrew Morton
2003-04-05 20:14                         ` Andrew Morton
2003-04-05 21:24                     ` Andrew Morton
2003-04-05 21:24                       ` Andrew Morton
2003-04-05 22:06                       ` Andrea Arcangeli
2003-04-05 22:06                         ` Andrea Arcangeli
2003-04-05 22:31                         ` Andrew Morton
2003-04-05 22:31                           ` Andrew Morton
2003-04-05 23:10                           ` Andrea Arcangeli
2003-04-05 23:10                             ` Andrea Arcangeli
2003-04-06  1:58                             ` Andrew Morton
2003-04-06  1:58                               ` Andrew Morton
2003-04-06 14:47                               ` Andrea Arcangeli
2003-04-06 14:47                                 ` Andrea Arcangeli
2003-04-06 21:35                                 ` William Lee Irwin III
2003-04-06 21:35                                   ` William Lee Irwin III
2003-04-06  7:38                             ` William Lee Irwin III
2003-04-06  7:38                               ` William Lee Irwin III
2003-04-06 14:51                               ` Andrea Arcangeli
2003-04-06 14:51                                 ` Andrea Arcangeli
2003-04-06 12:37                           ` Jamie Lokier
2003-04-06 12:37                             ` Jamie Lokier
2003-04-06 13:12                             ` William Lee Irwin III
2003-04-06 13:12                               ` William Lee Irwin III
2003-04-22 11:00                           ` Ingo Molnar
2003-04-22 11:00                             ` Ingo Molnar
2003-04-22 11:54                             ` William Lee Irwin III
2003-04-22 11:54                               ` William Lee Irwin III
2003-04-22 14:31                               ` Ingo Molnar
2003-04-22 14:31                                 ` Ingo Molnar
2003-04-22 14:56                                 ` William Lee Irwin III
2003-04-22 14:56                                   ` William Lee Irwin III
2003-04-22 15:26                                   ` Ingo Molnar
2003-04-22 15:26                                     ` Ingo Molnar
2003-04-22 16:20                                     ` William Lee Irwin III
2003-04-22 16:20                                       ` William Lee Irwin III
2003-04-22 16:57                                       ` Andrea Arcangeli
2003-04-22 16:57                                         ` Andrea Arcangeli
2003-04-22 17:21                                         ` William Lee Irwin III
2003-04-22 17:21                                           ` William Lee Irwin III
2003-04-22 18:08                                           ` Andrea Arcangeli
2003-04-22 18:08                                             ` Andrea Arcangeli
2003-04-22 17:34                                         ` Ingo Molnar
2003-04-22 17:34                                           ` Ingo Molnar
2003-04-22 18:04                                           ` Benjamin LaHaise
2003-04-22 18:04                                             ` Benjamin LaHaise
2003-04-22 16:58                                       ` Martin J. Bligh
2003-04-22 16:58                                         ` Martin J. Bligh
2003-04-22 12:37                             ` Andrea Arcangeli
2003-04-22 12:37                               ` Andrea Arcangeli
2003-04-22 13:20                               ` William Lee Irwin III
2003-04-22 13:20                                 ` William Lee Irwin III
2003-04-22 14:38                                 ` Martin J. Bligh
2003-04-22 14:38                                   ` Martin J. Bligh
2003-04-22 15:10                                   ` William Lee Irwin III
2003-04-22 15:10                                     ` William Lee Irwin III
2003-04-22 15:53                                     ` Martin J. Bligh
2003-04-22 15:53                                       ` Martin J. Bligh
2003-04-22 14:52                                 ` Andrea Arcangeli
2003-04-22 14:52                                   ` Andrea Arcangeli
2003-04-22 14:29                             ` Martin J. Bligh
2003-04-22 14:29                               ` Martin J. Bligh
2003-04-22 15:07                               ` Ingo Molnar
2003-04-22 15:07                                 ` Ingo Molnar
2003-04-22 15:42                                 ` William Lee Irwin III
2003-04-22 15:42                                   ` William Lee Irwin III
2003-04-22 15:55                                   ` Ingo Molnar
2003-04-22 15:55                                     ` Ingo Molnar
2003-04-22 16:58                                     ` William Lee Irwin III
2003-04-22 16:58                                       ` William Lee Irwin III
2003-04-22 17:07                                       ` Ingo Molnar
2003-04-22 17:07                                         ` Ingo Molnar
2003-04-22 15:16                               ` Andrea Arcangeli
2003-04-22 15:16                                 ` Andrea Arcangeli
2003-04-22 15:49                               ` Ingo Molnar
2003-04-22 15:49                                 ` Ingo Molnar
2003-04-22 16:16                                 ` Martin J. Bligh
2003-04-22 16:16                                   ` Martin J. Bligh
2003-04-22 17:24                                   ` Ingo Molnar
2003-04-22 17:24                                     ` Ingo Molnar
2003-04-22 17:45                                   ` John Bradford
2003-04-22 17:45                                     ` John Bradford
2003-04-22 14:32                             ` Martin J. Bligh
2003-04-22 14:32                               ` Martin J. Bligh
2003-04-22 15:09                               ` Ingo Molnar
2003-04-22 15:09                                 ` Ingo Molnar
2003-04-05 21:34                     ` Rik van Riel
2003-04-05 21:34                       ` Rik van Riel
2003-04-06  9:29                     ` Benjamin LaHaise
2003-04-06  9:29                       ` Benjamin LaHaise
2003-04-05 23:25                   ` William Lee Irwin III
2003-04-05 23:25                     ` William Lee Irwin III
2003-04-05 23:57                     ` Andrew Morton
2003-04-05 23:57                       ` Andrew Morton
2003-04-06  0:14                       ` Andrea Arcangeli
2003-04-06  0:14                         ` Andrea Arcangeli
2003-04-06  1:39                         ` Andrew Morton
2003-04-06  1:39                           ` Andrew Morton
2003-04-06  2:13                       ` William Lee Irwin III
2003-04-06  2:13                         ` William Lee Irwin III
2003-04-06  9:26                     ` Benjamin LaHaise
2003-04-06  9:26                       ` Benjamin LaHaise
2003-04-06  9:41                       ` William Lee Irwin III
2003-04-06  9:41                         ` William Lee Irwin III
2003-04-06  9:54                         ` William Lee Irwin III
2003-04-06  9:54                           ` William Lee Irwin III
2003-04-06  2:23                   ` Martin J. Bligh
2003-04-06  2:23                     ` Martin J. Bligh
2003-04-06  3:55                     ` Andrew Morton
2003-04-06  3:55                       ` Andrew Morton
2003-04-06  3:08                       ` Martin J. Bligh
2003-04-06  3:08                         ` Martin J. Bligh
2003-04-06  7:42                         ` William Lee Irwin III
2003-04-06  7:42                           ` William Lee Irwin III
2003-04-06 14:49                     ` Alan Cox
2003-04-06 14:49                       ` Alan Cox
2003-04-06 16:13                       ` Martin J. Bligh
2003-04-06 16:13                         ` Martin J. Bligh
2003-04-06 21:34                         ` subobj-rmap Martin J. Bligh
2003-04-06 21:34                           ` subobj-rmap Martin J. Bligh
2003-04-06 21:42                           ` subobj-rmap Rik van Riel
2003-04-06 21:42                             ` subobj-rmap Rik van Riel
2003-04-06 21:52                             ` subobj-rmap Davide Libenzi
2003-04-06 21:55                             ` subobj-rmap Jamie Lokier
2003-04-06 21:55                               ` subobj-rmap Jamie Lokier
2003-04-06 22:39                               ` subobj-rmap William Lee Irwin III
2003-04-06 22:39                                 ` subobj-rmap William Lee Irwin III
2003-04-06 22:03                             ` subobj-rmap Martin J. Bligh
2003-04-06 22:03                               ` subobj-rmap Martin J. Bligh
2003-04-06 22:06                               ` subobj-rmap Martin J. Bligh
2003-04-06 22:06                                 ` subobj-rmap Martin J. Bligh
2003-04-06 22:15                               ` subobj-rmap Andrea Arcangeli
2003-04-06 22:15                                 ` subobj-rmap Andrea Arcangeli
2003-04-06 22:25                                 ` subobj-rmap Martin J. Bligh
2003-04-06 22:25                                   ` subobj-rmap Martin J. Bligh
2003-04-07 21:25                                   ` subobj-rmap Andrea Arcangeli
2003-04-07 21:25                                     ` subobj-rmap Andrea Arcangeli
2003-04-06 23:06                               ` subobj-rmap Jamie Lokier
2003-04-06 23:06                                 ` subobj-rmap Jamie Lokier
2003-04-06 23:26                                 ` subobj-rmap Martin J. Bligh
2003-04-06 23:26                                   ` subobj-rmap Martin J. Bligh
2003-04-05  3:45               ` objrmap and vmtruncate Martin J. Bligh
2003-04-05  3:45                 ` Martin J. Bligh
2003-04-05  3:59               ` Rik van Riel
2003-04-05  3:59                 ` Rik van Riel
2003-04-05  4:10                 ` William Lee Irwin III
2003-04-05  4:10                   ` William Lee Irwin III
2003-04-05  4:49                   ` Martin J. Bligh
2003-04-05  4:49                     ` Martin J. Bligh
2003-04-05 13:31                     ` Rik van Riel
2003-04-05 13:31                       ` Rik van Riel
2003-04-05  4:52               ` Martin J. Bligh
2003-04-05  4:52                 ` Martin J. Bligh
2003-04-05  3:22             ` Andrew Morton
2003-04-05  3:22               ` Andrew Morton
2003-04-05  3:35               ` Martin J. Bligh
2003-04-05  3:35                 ` Martin J. Bligh
2003-04-05  3:53       ` Rik van Riel
2003-04-05  3:53         ` Rik van Riel

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=12880000.1049508832@flay \
    --to=mbligh@aracnet.com \
    --cc=akpm@digeo.com \
    --cc=andrea@suse.de \
    --cc=dmccr@us.ibm.com \
    --cc=hugh@veritas.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mingo@elte.hu \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.