From: Izik Eidus <ieidus@redhat.com>
To: Hugh Dickins <hugh.dickins@tiscali.co.uk>
Cc: Andrea Arcangeli <aarcange@redhat.com>,
Rik van Riel <riel@redhat.com>, Chris Wright <chrisw@redhat.com>,
Nick Piggin <nickpiggin@yahoo.com.au>,
Andrew Morton <akpm@linux-foundation.org>,
linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: [PATCH 3/12] ksm: pages_unshared and pages_volatile
Date: Mon, 03 Aug 2009 17:54:00 +0300 [thread overview]
Message-ID: <4A76FA08.9090903@redhat.com> (raw)
In-Reply-To: <Pine.LNX.4.64.0908031311061.16754@sister.anvils>
Hugh Dickins wrote:
> The pages_shared and pages_sharing counts give a good picture of how
> successful KSM is at sharing; but no clue to how much wasted work it's
> doing to get there. Add pages_unshared (count of unique pages waiting
> in the unstable tree, hoping to find a mate) and pages_volatile.
>
> pages_volatile is harder to define. It includes those pages changing
> too fast to get into the unstable tree, but also whatever other edge
> conditions prevent a page getting into the trees: a high value may
> deserve investigation. Don't try to calculate it from the various
> conditions: it's the total of rmap_items less those accounted for.
>
> Also show full_scans: the number of completed scans of everything
> registered in the mm list.
>
> The locking for all these counts is simply ksm_thread_mutex.
>
> Signed-off-by: Hugh Dickins <hugh.dickins@tiscali.co.uk>
> ---
>
> mm/ksm.c | 52 +++++++++++++++++++++++++++++++++++++++++++++++++++-
> 1 file changed, 51 insertions(+), 1 deletion(-)
>
> --- ksm2/mm/ksm.c 2009-08-02 13:49:43.000000000 +0100
> +++ ksm3/mm/ksm.c 2009-08-02 13:49:51.000000000 +0100
> @@ -155,6 +155,12 @@ static unsigned long ksm_pages_shared;
> /* The number of page slots additionally sharing those nodes */
> static unsigned long ksm_pages_sharing;
>
> +/* The number of nodes in the unstable tree */
> +static unsigned long ksm_pages_unshared;
> +
> +/* The number of rmap_items in use: to calculate pages_volatile */
> +static unsigned long ksm_rmap_items;
> +
> /* Limit on the number of unswappable pages used */
> static unsigned long ksm_max_kernel_pages;
>
> @@ -204,11 +210,17 @@ static void __init ksm_slab_free(void)
>
> static inline struct rmap_item *alloc_rmap_item(void)
> {
> - return kmem_cache_zalloc(rmap_item_cache, GFP_KERNEL);
> + struct rmap_item *rmap_item;
> +
> + rmap_item = kmem_cache_zalloc(rmap_item_cache, GFP_KERNEL);
> + if (rmap_item)
> + ksm_rmap_items++;
> + return rmap_item;
> }
>
> static inline void free_rmap_item(struct rmap_item *rmap_item)
> {
> + ksm_rmap_items--;
> rmap_item->mm = NULL; /* debug safety */
> kmem_cache_free(rmap_item_cache, rmap_item);
> }
> @@ -419,6 +431,7 @@ static void remove_rmap_item_from_tree(s
> BUG_ON(age > 2);
> if (!age)
> rb_erase(&rmap_item->node, &root_unstable_tree);
> + ksm_pages_unshared--;
> }
>
> rmap_item->address &= PAGE_MASK;
> @@ -1002,6 +1015,7 @@ static struct rmap_item *unstable_tree_s
> rb_link_node(&rmap_item->node, parent, new);
> rb_insert_color(&rmap_item->node, &root_unstable_tree);
>
> + ksm_pages_unshared++;
> return NULL;
> }
>
> @@ -1098,6 +1112,8 @@ static void cmp_and_merge_page(struct pa
> if (!err) {
> rb_erase(&tree_rmap_item->node, &root_unstable_tree);
> tree_rmap_item->address &= ~NODE_FLAG;
> + ksm_pages_unshared--;
> +
> /*
> * If we fail to insert the page into the stable tree,
> * we will have 2 virtual addresses that are pointing
> @@ -1481,6 +1497,37 @@ static ssize_t pages_sharing_show(struct
> }
> KSM_ATTR_RO(pages_sharing);
>
> +static ssize_t pages_unshared_show(struct kobject *kobj,
> + struct kobj_attribute *attr, char *buf)
> +{
> + return sprintf(buf, "%lu\n", ksm_pages_unshared);
> +}
> +KSM_ATTR_RO(pages_unshared);
> +
> +static ssize_t pages_volatile_show(struct kobject *kobj,
> + struct kobj_attribute *attr, char *buf)
> +{
> + long ksm_pages_volatile;
> +
> + ksm_pages_volatile = ksm_rmap_items - ksm_pages_shared
> + - ksm_pages_sharing - ksm_pages_unshared;
> + /*
> + * It was not worth any locking to calculate that statistic,
> + * but it might therefore sometimes be negative: conceal that.
> + */
> + if (ksm_pages_volatile < 0)
> + ksm_pages_volatile = 0;
> + return sprintf(buf, "%ld\n", ksm_pages_volatile);
ACK.
WARNING: multiple messages have this Message-ID (diff)
From: Izik Eidus <ieidus@redhat.com>
To: Hugh Dickins <hugh.dickins@tiscali.co.uk>
Cc: Andrea Arcangeli <aarcange@redhat.com>,
Rik van Riel <riel@redhat.com>, Chris Wright <chrisw@redhat.com>,
Nick Piggin <nickpiggin@yahoo.com.au>,
Andrew Morton <akpm@linux-foundation.org>,
linux-kernel@vger.kernel.org, linux-mm@kvack.org
Subject: Re: [PATCH 3/12] ksm: pages_unshared and pages_volatile
Date: Mon, 03 Aug 2009 17:54:00 +0300 [thread overview]
Message-ID: <4A76FA08.9090903@redhat.com> (raw)
In-Reply-To: <Pine.LNX.4.64.0908031311061.16754@sister.anvils>
Hugh Dickins wrote:
> The pages_shared and pages_sharing counts give a good picture of how
> successful KSM is at sharing; but no clue to how much wasted work it's
> doing to get there. Add pages_unshared (count of unique pages waiting
> in the unstable tree, hoping to find a mate) and pages_volatile.
>
> pages_volatile is harder to define. It includes those pages changing
> too fast to get into the unstable tree, but also whatever other edge
> conditions prevent a page getting into the trees: a high value may
> deserve investigation. Don't try to calculate it from the various
> conditions: it's the total of rmap_items less those accounted for.
>
> Also show full_scans: the number of completed scans of everything
> registered in the mm list.
>
> The locking for all these counts is simply ksm_thread_mutex.
>
> Signed-off-by: Hugh Dickins <hugh.dickins@tiscali.co.uk>
> ---
>
> mm/ksm.c | 52 +++++++++++++++++++++++++++++++++++++++++++++++++++-
> 1 file changed, 51 insertions(+), 1 deletion(-)
>
> --- ksm2/mm/ksm.c 2009-08-02 13:49:43.000000000 +0100
> +++ ksm3/mm/ksm.c 2009-08-02 13:49:51.000000000 +0100
> @@ -155,6 +155,12 @@ static unsigned long ksm_pages_shared;
> /* The number of page slots additionally sharing those nodes */
> static unsigned long ksm_pages_sharing;
>
> +/* The number of nodes in the unstable tree */
> +static unsigned long ksm_pages_unshared;
> +
> +/* The number of rmap_items in use: to calculate pages_volatile */
> +static unsigned long ksm_rmap_items;
> +
> /* Limit on the number of unswappable pages used */
> static unsigned long ksm_max_kernel_pages;
>
> @@ -204,11 +210,17 @@ static void __init ksm_slab_free(void)
>
> static inline struct rmap_item *alloc_rmap_item(void)
> {
> - return kmem_cache_zalloc(rmap_item_cache, GFP_KERNEL);
> + struct rmap_item *rmap_item;
> +
> + rmap_item = kmem_cache_zalloc(rmap_item_cache, GFP_KERNEL);
> + if (rmap_item)
> + ksm_rmap_items++;
> + return rmap_item;
> }
>
> static inline void free_rmap_item(struct rmap_item *rmap_item)
> {
> + ksm_rmap_items--;
> rmap_item->mm = NULL; /* debug safety */
> kmem_cache_free(rmap_item_cache, rmap_item);
> }
> @@ -419,6 +431,7 @@ static void remove_rmap_item_from_tree(s
> BUG_ON(age > 2);
> if (!age)
> rb_erase(&rmap_item->node, &root_unstable_tree);
> + ksm_pages_unshared--;
> }
>
> rmap_item->address &= PAGE_MASK;
> @@ -1002,6 +1015,7 @@ static struct rmap_item *unstable_tree_s
> rb_link_node(&rmap_item->node, parent, new);
> rb_insert_color(&rmap_item->node, &root_unstable_tree);
>
> + ksm_pages_unshared++;
> return NULL;
> }
>
> @@ -1098,6 +1112,8 @@ static void cmp_and_merge_page(struct pa
> if (!err) {
> rb_erase(&tree_rmap_item->node, &root_unstable_tree);
> tree_rmap_item->address &= ~NODE_FLAG;
> + ksm_pages_unshared--;
> +
> /*
> * If we fail to insert the page into the stable tree,
> * we will have 2 virtual addresses that are pointing
> @@ -1481,6 +1497,37 @@ static ssize_t pages_sharing_show(struct
> }
> KSM_ATTR_RO(pages_sharing);
>
> +static ssize_t pages_unshared_show(struct kobject *kobj,
> + struct kobj_attribute *attr, char *buf)
> +{
> + return sprintf(buf, "%lu\n", ksm_pages_unshared);
> +}
> +KSM_ATTR_RO(pages_unshared);
> +
> +static ssize_t pages_volatile_show(struct kobject *kobj,
> + struct kobj_attribute *attr, char *buf)
> +{
> + long ksm_pages_volatile;
> +
> + ksm_pages_volatile = ksm_rmap_items - ksm_pages_shared
> + - ksm_pages_sharing - ksm_pages_unshared;
> + /*
> + * It was not worth any locking to calculate that statistic,
> + * but it might therefore sometimes be negative: conceal that.
> + */
> + if (ksm_pages_volatile < 0)
> + ksm_pages_volatile = 0;
> + return sprintf(buf, "%ld\n", ksm_pages_volatile);
ACK.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2009-08-03 14:55 UTC|newest]
Thread overview: 106+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-08-03 12:08 [PATCH 0/12] ksm: stats, oom, doc, misc Hugh Dickins
2009-08-03 12:08 ` Hugh Dickins
2009-08-03 12:10 ` [PATCH 1/12] ksm: rename kernel_pages_allocated Hugh Dickins
2009-08-03 12:10 ` Hugh Dickins
2009-08-03 14:21 ` Izik Eidus
2009-08-03 14:21 ` Izik Eidus
2009-08-03 16:48 ` Andrea Arcangeli
2009-08-03 16:48 ` Andrea Arcangeli
2009-08-03 12:11 ` [PATCH 2/12] ksm: move pages_sharing updates Hugh Dickins
2009-08-03 12:11 ` Hugh Dickins
2009-08-03 14:34 ` Izik Eidus
2009-08-03 14:34 ` Izik Eidus
2009-08-03 16:53 ` Andrea Arcangeli
2009-08-03 16:53 ` Andrea Arcangeli
2009-08-03 17:34 ` Hugh Dickins
2009-08-03 17:34 ` Hugh Dickins
2009-08-03 12:11 ` [PATCH 3/12] ksm: pages_unshared and pages_volatile Hugh Dickins
2009-08-03 12:11 ` Hugh Dickins
2009-08-03 14:54 ` Izik Eidus [this message]
2009-08-03 14:54 ` Izik Eidus
2009-08-04 21:49 ` Andrew Morton
2009-08-04 21:49 ` Andrew Morton
2009-08-05 11:39 ` Hugh Dickins
2009-08-05 11:39 ` Hugh Dickins
2009-08-05 15:11 ` Andrea Arcangeli
2009-08-05 15:11 ` Andrea Arcangeli
2009-08-03 12:12 ` [PATCH 4/12] ksm: break cow once unshared Hugh Dickins
2009-08-03 12:12 ` Hugh Dickins
2009-08-03 16:00 ` Izik Eidus
2009-08-03 16:00 ` Izik Eidus
2009-08-03 12:14 ` [PATCH 5/12] ksm: keep quiet while list empty Hugh Dickins
2009-08-03 12:14 ` Hugh Dickins
2009-08-03 16:55 ` Izik Eidus
2009-08-03 16:55 ` Izik Eidus
2009-08-04 21:59 ` Andrew Morton
2009-08-04 21:59 ` Andrew Morton
2009-08-05 11:54 ` Hugh Dickins
2009-08-05 11:54 ` Hugh Dickins
2009-08-03 12:15 ` [PATCH 6/12] ksm: five little cleanups Hugh Dickins
2009-08-03 12:15 ` Hugh Dickins
2009-08-04 12:41 ` Izik Eidus
2009-08-04 12:41 ` Izik Eidus
2009-08-03 12:16 ` [PATCH 7/12] ksm: fix endless loop on oom Hugh Dickins
2009-08-03 12:16 ` Hugh Dickins
2009-08-04 12:55 ` Izik Eidus
2009-08-04 12:55 ` Izik Eidus
2009-08-03 12:17 ` [PATCH 8/12] ksm: distribute remove_mm_from_lists Hugh Dickins
2009-08-03 12:17 ` Hugh Dickins
2009-08-04 13:03 ` Izik Eidus
2009-08-04 13:03 ` Izik Eidus
2009-08-03 12:18 ` [PATCH 9/12] ksm: fix oom deadlock Hugh Dickins
2009-08-03 12:18 ` Hugh Dickins
2009-08-04 19:32 ` Izik Eidus
2009-08-04 19:32 ` Izik Eidus
2009-08-25 14:58 ` Andrea Arcangeli
2009-08-25 14:58 ` Andrea Arcangeli
2009-08-25 15:22 ` [PATCH 13/12] ksm: fix munlock during exit_mmap deadlock Andrea Arcangeli
2009-08-25 15:22 ` Andrea Arcangeli
2009-08-25 17:49 ` Hugh Dickins
2009-08-25 17:49 ` Hugh Dickins
2009-08-25 18:10 ` Andrea Arcangeli
2009-08-25 18:10 ` Andrea Arcangeli
2009-08-25 18:58 ` Hugh Dickins
2009-08-25 18:58 ` Hugh Dickins
2009-08-25 19:45 ` Andrea Arcangeli
2009-08-25 19:45 ` Andrea Arcangeli
2009-08-26 16:18 ` Justin M. Forbes
2009-08-26 16:18 ` Justin M. Forbes
2009-08-26 19:17 ` Hugh Dickins
2009-08-26 19:17 ` Hugh Dickins
2009-08-26 19:44 ` Andrea Arcangeli
2009-08-26 19:44 ` Andrea Arcangeli
2009-08-26 19:57 ` Hugh Dickins
2009-08-26 19:57 ` Hugh Dickins
2009-08-26 20:28 ` Andrea Arcangeli
2009-08-26 20:28 ` Andrea Arcangeli
2009-08-26 20:54 ` Izik Eidus
2009-08-26 20:54 ` Izik Eidus
2009-08-26 21:14 ` Andrea Arcangeli
2009-08-26 21:14 ` Andrea Arcangeli
2009-08-26 21:49 ` Izik Eidus
2009-08-26 21:49 ` Izik Eidus
2009-08-27 19:11 ` Hugh Dickins
2009-08-27 19:11 ` Hugh Dickins
2009-08-27 19:35 ` Izik Eidus
2009-08-27 19:35 ` Izik Eidus
2009-08-26 22:00 ` David Rientjes
2009-08-26 22:00 ` David Rientjes
2009-08-26 20:29 ` Hugh Dickins
2009-08-26 20:29 ` Hugh Dickins
2009-08-25 17:35 ` [PATCH 9/12] ksm: fix oom deadlock Hugh Dickins
2009-08-25 17:35 ` Hugh Dickins
2009-08-25 17:47 ` Andrea Arcangeli
2009-08-25 17:47 ` Andrea Arcangeli
2009-08-03 12:19 ` [PATCH 10/12] ksm: sysfs and defaults Hugh Dickins
2009-08-03 12:19 ` Hugh Dickins
2009-08-04 19:34 ` Izik Eidus
2009-08-04 19:34 ` Izik Eidus
2009-08-03 12:21 ` [PATCH 11/12] ksm: add some documentation Hugh Dickins
2009-08-03 12:21 ` Hugh Dickins
2009-08-04 19:35 ` Izik Eidus
2009-08-04 19:35 ` Izik Eidus
2009-08-03 12:22 ` [PATCH 12/12] ksm: remove VM_MERGEABLE_FLAGS Hugh Dickins
2009-08-03 12:22 ` Hugh Dickins
2009-08-04 19:35 ` Izik Eidus
2009-08-04 19:35 ` Izik Eidus
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4A76FA08.9090903@redhat.com \
--to=ieidus@redhat.com \
--cc=aarcange@redhat.com \
--cc=akpm@linux-foundation.org \
--cc=chrisw@redhat.com \
--cc=hugh.dickins@tiscali.co.uk \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=nickpiggin@yahoo.com.au \
--cc=riel@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.