From: Wu Fengguang <fengguang.wu@intel.com>
To: "Rafael J. Wysocki" <rjw@sisk.pl>
Cc: pm list <linux-pm@lists.linux-foundation.org>,
Andrew Morton <akpm@linux-foundation.org>,
LKML <linux-kernel@vger.kernel.org>, Pavel Machek <pavel@ucw.cz>,
Nigel Cunningham <nigel@tuxonice.net>,
David Rientjes <rientjes@google.com>,
"linux-mm@kvack.org" <linux-mm@kvack.org>
Subject: Re: [RFC][PATCH 6/6] PM/Hibernate: Do not try to allocate too much memory too hard
Date: Sun, 17 May 2009 22:07:12 +0800 [thread overview]
Message-ID: <20090517140712.GE3254@localhost> (raw)
In-Reply-To: <200905171455.06120.rjw@sisk.pl>
On Sun, May 17, 2009 at 08:55:05PM +0800, Rafael J. Wysocki wrote:
> On Sunday 17 May 2009, Wu Fengguang wrote:
> > > +static unsigned long minimum_image_size(unsigned long saveable)
> > > +{
> > > + unsigned long size;
> > > +
> > > + /* Compute the number of saveable pages we can free. */
> > > + size = global_page_state(NR_SLAB_RECLAIMABLE)
> > > + + global_page_state(NR_ACTIVE_ANON)
> > > + + global_page_state(NR_INACTIVE_ANON)
> > > + + global_page_state(NR_ACTIVE_FILE)
> > > + + global_page_state(NR_INACTIVE_FILE);
> >
> > For example, we could drop the 1.25 ratio and calculate the above
> > reclaimable size with more meaningful constraints:
> >
> > /* slabs are not easy to reclaim */
> > size = global_page_state(NR_SLAB_RECLAIMABLE) / 2;
>
> Why 1/2?
Also a very coarse value:
- we don't want to stress icache/dcache too much
(unless they grow too large)
- my experience was that the icache/dcache are scanned in a slower
pace than lru pages.
- most importantly, inside the NR_SLAB_RECLAIMABLE pages, maybe half
of the pages are actually *in use* and cannot be freed:
% cat /proc/sys/fs/inode-nr
30450 16605
% cat /proc/sys/fs/dentry-state
41598 35731 45 0 0 0
See? More than half entries are in-use. Sure many of them will actually
become unused when dentries are freed, but in the mean time the internal
fragmentations in the slabs can go up.
> > /* keep NR_ACTIVE_ANON */
> > size += global_page_state(NR_INACTIVE_ANON);
>
> Why exactly did you omit ACTIVE_ANON?
To keep the "core working set" :)
> > /* keep mapped files */
> > size += global_page_state(NR_ACTIVE_FILE);
> > size += global_page_state(NR_INACTIVE_FILE);
> > size -= global_page_state(NR_FILE_MAPPED);
> >
> > That restores the hard core working set logic in the reverse way ;)
>
> I think the 1/2 factor for NR_SLAB_RECLAIMABLE may be too high in some cases,
> but I'm going to check that.
Yes, after updatedb. In that case simple magics numbers may not help.
In that case we should really first call shrink_slab() in a loop to
cut down the slab pages to a sane number.
Thanks,
Fengguang
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2009-05-17 14:07 UTC|newest]
Thread overview: 58+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <200905070040.08561.rjw@sisk.pl>
2009-05-07 21:48 ` [RFC][PATCH 0/5] PM/Hibernate: Rework memory shrinking (rev. 2) Rafael J. Wysocki
2009-05-07 21:50 ` [RFC][PATCH 1/5] mm: Introduce __GFP_NO_OOM_KILL Rafael J. Wysocki
2009-05-07 22:24 ` [RFC][PATCH] PM/Freezer: Disable OOM killer when tasks are frozen (was: Re: [RFC][PATCH 1/5] mm: Introduce __GFP_NO_OOM_KILL) Rafael J. Wysocki
2009-05-07 21:51 ` [RFC][PATCH 2/5] PM/Suspend: Do not shrink memory before suspend Rafael J. Wysocki
2009-05-08 8:52 ` Wu Fengguang
2009-05-07 21:51 ` [RFC][PATCH 3/5] PM/Hibernate: Move memory shrinking to snapshot.c (rev. 2) Rafael J. Wysocki
2009-05-08 8:53 ` Wu Fengguang
2009-05-07 21:53 ` [RFC][PATCH 4/5] PM/Hibernate: Rework shrinking of memory Rafael J. Wysocki
2009-05-07 21:55 ` [RFC][PATCH 5/5] PM/Hibernate: Do not release preallocated memory unnecessarily Rafael J. Wysocki
2009-05-10 13:48 ` [RFC][PATCH 0/6] PM/Hibernate: Rework memory shrinking (rev. 3) Rafael J. Wysocki
2009-05-10 13:50 ` [RFC][PATCH 1/6] mm: Introduce __GFP_NO_OOM_KILL Rafael J. Wysocki
2009-05-11 20:12 ` David Rientjes
2009-05-11 22:14 ` Rafael J. Wysocki
2009-05-11 22:33 ` Andrew Morton
2009-05-11 23:04 ` Rafael J. Wysocki
2009-05-10 13:50 ` [RFC][PATCH 2/6] PM/Suspend: Do not shrink memory before suspend Rafael J. Wysocki
2009-05-10 13:51 ` [RFC][PATCH 3/6] PM/Hibernate: Move memory shrinking to snapshot.c (rev. 2) Rafael J. Wysocki
2009-05-10 13:53 ` [RFC][PATCH 4/6] PM/Hibernate: Rework shrinking of memory Rafael J. Wysocki
2009-05-10 13:57 ` [RFC][PATCH 5/6] PM/Hibernate: Do not release preallocated memory unnecessarily Rafael J. Wysocki
2009-05-10 19:49 ` Rafael J. Wysocki
2009-05-10 14:12 ` [RFC][PATCH 6/6] PM/Hibernate: Estimate hard core working set size Rafael J. Wysocki
2009-05-10 19:53 ` Rafael J. Wysocki
2009-05-13 8:32 ` [RFC][PATCH 0/6] PM/Hibernate: Rework memory shrinking (rev. 4) Rafael J. Wysocki
2009-05-13 8:34 ` [PATCH 1/6] PM/Suspend: Do not shrink memory before suspend Rafael J. Wysocki
2009-05-13 8:35 ` [PATCH 2/6] PM/Hibernate: Move memory shrinking to snapshot.c (rev. 2) Rafael J. Wysocki
2009-05-13 8:37 ` [PATCH 3/6] mm, PM/Freezer: Disable OOM killer when tasks are frozen Rafael J. Wysocki
2009-05-13 9:19 ` Pavel Machek
2009-05-13 22:35 ` David Rientjes
2009-05-13 22:47 ` Andrew Morton
2009-05-13 23:01 ` David Rientjes
2009-05-13 8:39 ` [PATCH 4/6] PM/Hibernate: Rework shrinking of memory Rafael J. Wysocki
2009-05-13 19:34 ` Andrew Morton
2009-05-13 20:55 ` Rafael J. Wysocki
2009-05-13 21:16 ` Andrew Morton
2009-05-13 21:56 ` Rafael J. Wysocki
2009-05-14 9:40 ` Pavel Machek
2009-05-14 17:49 ` Rafael J. Wysocki
2009-05-15 13:09 ` Pavel Machek
2009-05-14 18:26 ` Rafael J. Wysocki
2009-05-13 8:40 ` [PATCH 5/6] PM/Hibernate: Do not release preallocated memory unnecessarily (rev. 2) Rafael J. Wysocki
2009-05-14 11:09 ` Pavel Machek
2009-05-14 17:52 ` Rafael J. Wysocki
2009-05-15 13:11 ` Pavel Machek
2009-05-15 14:52 ` Rafael J. Wysocki
2009-05-13 8:42 ` [RFC][PATCH 6/6] PM/Hibernate: Do not try to allocate too much memory too hard Rafael J. Wysocki
2009-05-14 11:14 ` Pavel Machek
2009-05-14 17:59 ` Rafael J. Wysocki
2009-05-15 13:14 ` Pavel Machek
2009-05-15 14:40 ` Rafael J. Wysocki
2009-05-17 12:06 ` Wu Fengguang
2009-05-17 12:55 ` Rafael J. Wysocki
2009-05-17 14:07 ` Wu Fengguang [this message]
2009-05-17 16:53 ` Rafael J. Wysocki
2009-05-18 8:32 ` Wu Fengguang
2009-05-17 21:14 ` Rafael J. Wysocki
2009-05-18 8:56 ` Wu Fengguang
2009-05-18 17:07 ` Rafael J. Wysocki
2009-05-19 0:47 ` Wu Fengguang
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20090517140712.GE3254@localhost \
--to=fengguang.wu@intel.com \
--cc=akpm@linux-foundation.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=linux-pm@lists.linux-foundation.org \
--cc=nigel@tuxonice.net \
--cc=pavel@ucw.cz \
--cc=rientjes@google.com \
--cc=rjw@sisk.pl \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).