From: Rik van Riel <riel@redhat.com>
To: Minchan Kim <minchan@kernel.org>
Cc: Andrew Morton <akpm@linux-foundation.org>,
linux-mm@kvack.org, linux-kernel@vger.kernel.org,
Dan Magenheimer <dan.magenheimer@oracle.com>,
Sonny Rao <sonnyrao@google.com>, Bryan Freed <bfreed@google.com>,
Hugh Dickins <hughd@google.com>,
Johannes Weiner <hannes@cmpxchg.org>
Subject: Re: [PATCH 1/2] mm: prevent to add a page to swap if may_writepage is unset
Date: Mon, 21 Jan 2013 09:39:06 -0500 [thread overview]
Message-ID: <50FD530A.6010500@redhat.com> (raw)
In-Reply-To: <20130121015222.GA3666@blaptop>
On 01/20/2013 08:52 PM, Minchan Kim wrote:
> From 94086dc7152359d052802c55c82ef19509fe8cce Mon Sep 17 00:00:00 2001
> From: Minchan Kim <minchan@kernel.org>
> Date: Mon, 21 Jan 2013 10:43:43 +0900
> Subject: [PATCH] mm: Use up free swap space before reaching OOM kill
>
> Recently, Luigi reported there are lots of free swap space when
> OOM happens. It's easily reproduced on zram-over-swap, where
> many instance of memory hogs are running and laptop_mode is enabled.
> He said there was no problem when he disabled laptop_mode.
> The problem when I investigate problem is following as.
>
> Assumption for easy explanation: There are no page cache page in system
> because they all are already reclaimed.
>
> 1. try_to_free_pages disable may_writepage when laptop_mode is enabled.
> 2. shrink_inactive_list isolates victim pages from inactive anon lru list.
> 3. shrink_page_list adds them to swapcache via add_to_swap but it doesn't
> pageout because sc->may_writepage is 0 so the page is rotated back into
> inactive anon lru list. The add_to_swap made the page Dirty by SetPageDirty.
> 4. 3 couldn't reclaim any pages so do_try_to_free_pages increase priority and
> retry reclaim with higher priority.
> 5. shrink_inactlive_list try to isolate victim pages from inactive anon lru list
> but got failed because it try to isolate pages with ISOLATE_CLEAN mode but
> inactive anon lru list is full of dirty pages by 3 so it just returns
> without any reclaim progress.
> 6. do_try_to_free_pages doesn't set may_writepage due to zero total_scanned.
> Because sc->nr_scanned is increased by shrink_page_list but we don't call
> shrink_page_list in 5 due to short of isolated pages.
>
> Above loop is continued until OOM happens.
> The problem didn't happen before [1] was merged because old logic's
> isolatation in shrink_inactive_list was successful and tried to call
> shrink_page_list to pageout them but it still ends up failed to page out
> by may_writepage. But important point is that sc->nr_scanned was increased
> although we couldn't swap out them so do_try_to_free_pages could set
> may_writepages.
>
> Since [1] was introduced, it's not a good idea any more to depends on
> only the number of scanned pages for setting may_writepage. So this patch
> adds new trigger point of setting may_writepage as below DEF_PRIOIRTY - 2
> which is used to show the significant memory pressure in VM so it's good
> fit for our purpose which would be better to lose power saving or clickety
> rather than OOM killing.
>
> [1] f80c067[mm: zone_reclaim: make isolate_lru_page() filter-aware]
>
> Reported-by: Luigi Semenzato <semenzato@google.com>
> Signed-off-by: Minchan Kim <minchan@kernel.org>
Your patch is a nice simplification. I am ok with the
change, provided it works for Luigi :)
Acked-by: Rik van Riel <riel@redhat.com>
--
All rights reversed
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2013-01-21 14:39 UTC|newest]
Thread overview: 30+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-01-09 6:21 [PATCH 0/2] Use up free swap space before reaching OOM kill Minchan Kim
2013-01-09 6:21 ` [PATCH 1/2] mm: prevent to add a page to swap if may_writepage is unset Minchan Kim
2013-01-09 6:56 ` Johannes Weiner
2013-01-09 7:10 ` Minchan Kim
2013-01-10 0:18 ` Andrew Morton
2013-01-10 2:03 ` Minchan Kim
2013-01-10 23:24 ` Luigi Semenzato
2013-01-10 23:27 ` Luigi Semenzato
2013-01-11 4:03 ` Minchan Kim
2013-01-10 0:20 ` Andrew Morton
2013-01-16 21:41 ` Andrew Morton
2013-01-17 0:53 ` Minchan Kim
2013-01-17 22:22 ` Andrew Morton
2013-01-17 23:36 ` Minchan Kim
2013-01-21 1:52 ` Minchan Kim
2013-01-21 14:39 ` Rik van Riel [this message]
2013-01-22 0:09 ` Minchan Kim
2013-02-05 1:43 ` Minchan Kim
2013-01-09 6:21 ` [PATCH 2/2] mm: forcely swapout when we are out of page cache Minchan Kim
2013-01-10 0:26 ` Andrew Morton
2013-01-10 2:23 ` Minchan Kim
2013-01-10 21:58 ` Andrew Morton
2013-01-11 4:43 ` Minchan Kim
2013-01-16 0:09 ` Andrew Morton
2013-01-16 0:32 ` Sonny Rao
2013-01-16 0:50 ` Andrew Morton
2013-01-16 1:21 ` Sonny Rao
2013-01-16 4:47 ` Minchan Kim
2013-01-16 20:08 ` Sonny Rao
2013-01-16 4:43 ` Minchan Kim
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=50FD530A.6010500@redhat.com \
--to=riel@redhat.com \
--cc=akpm@linux-foundation.org \
--cc=bfreed@google.com \
--cc=dan.magenheimer@oracle.com \
--cc=hannes@cmpxchg.org \
--cc=hughd@google.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=minchan@kernel.org \
--cc=sonnyrao@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).