From: Minchan Kim <minchan.kim@gmail.com>
To: Mel Gorman <mel@csn.ul.ie>
Cc: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
Andrew Morton <akpm@linux-foundation.org>,
linux-mm <linux-mm@kvack.org>,
LKML <linux-kernel@vger.kernel.org>,
Ben Gamari <bgamari.foss@gmail.com>,
Wu Fengguang <fengguang.wu@intel.com>,
Johannes Weiner <hannes@cmpxchg.org>,
Nick Piggin <npiggin@kernel.dk>
Subject: Re: [PATCH 2/3] Reclaim invalidated page ASAP
Date: Tue, 30 Nov 2010 23:01:52 +0900 [thread overview]
Message-ID: <20101130140152.GA1528@barrios-desktop> (raw)
In-Reply-To: <20101130091822.GJ13268@csn.ul.ie>
On Tue, Nov 30, 2010 at 09:18:22AM +0000, Mel Gorman wrote:
> On Tue, Nov 30, 2010 at 10:10:20AM +0900, KOSAKI Motohiro wrote:
> > > invalidate_mapping_pages is very big hint to reclaimer.
> > > It means user doesn't want to use the page any more.
> > > So in order to prevent working set page eviction, this patch
> > > move the page into tail of inactive list by PG_reclaim.
> > >
> > > Please, remember that pages in inactive list are working set
> > > as well as active list. If we don't move pages into inactive list's
> > > tail, pages near by tail of inactive list can be evicted although
> > > we have a big clue about useless pages. It's totally bad.
> > >
> > > Now PG_readahead/PG_reclaim is shared.
> > > fe3cba17 added ClearPageReclaim into clear_page_dirty_for_io for
> > > preventing fast reclaiming readahead marker page.
> > >
> > > In this series, PG_reclaim is used by invalidated page, too.
> > > If VM find the page is invalidated and it's dirty, it sets PG_reclaim
> > > to reclaim asap. Then, when the dirty page will be writeback,
> > > clear_page_dirty_for_io will clear PG_reclaim unconditionally.
> > > It disturbs this serie's goal.
> > >
> > > I think it's okay to clear PG_readahead when the page is dirty, not
> > > writeback time. So this patch moves ClearPageReadahead.
> > >
> > > Signed-off-by: Minchan Kim <minchan.kim@gmail.com>
> > > Acked-by: Rik van Riel <riel@redhat.com>
> > > Cc: Wu Fengguang <fengguang.wu@intel.com>
> > > Cc: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>
> > > Cc: Johannes Weiner <hannes@cmpxchg.org>
> > > Cc: Nick Piggin <npiggin@kernel.dk>
> > > Cc: Mel Gorman <mel@csn.ul.ie>
> >
> > I still dislike this one. I doubt this trick makes much benefit in real
> > world workload.
> >
>
> I would agree except as said elsewhere, it's a chicken and egg problem.
> We don't have a real world test because fadvise is not useful in its
> current iteration. I'm hoping that there will be a test comparing
>
> rsync on vanilla kernel
> rsync on patched kernel
> rsync+patch on vanilla kernel
> rsync+patch on patched kernel
>
> Are the results of such a test likely to happen?
Ben, Could you get the rsync execution time(user/sys) and
'cat /proc/vmstat' result before/after?
If Ben is busy, I will try to get a data. but I need enough time.
I expect rsync+patch on patched kernel should have a less allocstall, less pgscan
so fast execution time.
>
> --
> Mel Gorman
> Part-time Phd Student Linux Technology Center
> University of Limerick IBM Dublin Software Lab
--
Kind regards,
Minchan Kim
WARNING: multiple messages have this Message-ID (diff)
From: Minchan Kim <minchan.kim@gmail.com>
To: Mel Gorman <mel@csn.ul.ie>
Cc: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
Andrew Morton <akpm@linux-foundation.org>,
linux-mm <linux-mm@kvack.org>,
LKML <linux-kernel@vger.kernel.org>,
Ben Gamari <bgamari.foss@gmail.com>,
Wu Fengguang <fengguang.wu@intel.com>,
Johannes Weiner <hannes@cmpxchg.org>,
Nick Piggin <npiggin@kernel.dk>
Subject: Re: [PATCH 2/3] Reclaim invalidated page ASAP
Date: Tue, 30 Nov 2010 23:01:52 +0900 [thread overview]
Message-ID: <20101130140152.GA1528@barrios-desktop> (raw)
In-Reply-To: <20101130091822.GJ13268@csn.ul.ie>
On Tue, Nov 30, 2010 at 09:18:22AM +0000, Mel Gorman wrote:
> On Tue, Nov 30, 2010 at 10:10:20AM +0900, KOSAKI Motohiro wrote:
> > > invalidate_mapping_pages is very big hint to reclaimer.
> > > It means user doesn't want to use the page any more.
> > > So in order to prevent working set page eviction, this patch
> > > move the page into tail of inactive list by PG_reclaim.
> > >
> > > Please, remember that pages in inactive list are working set
> > > as well as active list. If we don't move pages into inactive list's
> > > tail, pages near by tail of inactive list can be evicted although
> > > we have a big clue about useless pages. It's totally bad.
> > >
> > > Now PG_readahead/PG_reclaim is shared.
> > > fe3cba17 added ClearPageReclaim into clear_page_dirty_for_io for
> > > preventing fast reclaiming readahead marker page.
> > >
> > > In this series, PG_reclaim is used by invalidated page, too.
> > > If VM find the page is invalidated and it's dirty, it sets PG_reclaim
> > > to reclaim asap. Then, when the dirty page will be writeback,
> > > clear_page_dirty_for_io will clear PG_reclaim unconditionally.
> > > It disturbs this serie's goal.
> > >
> > > I think it's okay to clear PG_readahead when the page is dirty, not
> > > writeback time. So this patch moves ClearPageReadahead.
> > >
> > > Signed-off-by: Minchan Kim <minchan.kim@gmail.com>
> > > Acked-by: Rik van Riel <riel@redhat.com>
> > > Cc: Wu Fengguang <fengguang.wu@intel.com>
> > > Cc: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>
> > > Cc: Johannes Weiner <hannes@cmpxchg.org>
> > > Cc: Nick Piggin <npiggin@kernel.dk>
> > > Cc: Mel Gorman <mel@csn.ul.ie>
> >
> > I still dislike this one. I doubt this trick makes much benefit in real
> > world workload.
> >
>
> I would agree except as said elsewhere, it's a chicken and egg problem.
> We don't have a real world test because fadvise is not useful in its
> current iteration. I'm hoping that there will be a test comparing
>
> rsync on vanilla kernel
> rsync on patched kernel
> rsync+patch on vanilla kernel
> rsync+patch on patched kernel
>
> Are the results of such a test likely to happen?
Ben, Could you get the rsync execution time(user/sys) and
'cat /proc/vmstat' result before/after?
If Ben is busy, I will try to get a data. but I need enough time.
I expect rsync+patch on patched kernel should have a less allocstall, less pgscan
so fast execution time.
>
> --
> Mel Gorman
> Part-time Phd Student Linux Technology Center
> University of Limerick IBM Dublin Software Lab
--
Kind regards,
Minchan Kim
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom policy in Canada: sign http://dissolvethecrtc.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2010-11-30 14:02 UTC|newest]
Thread overview: 44+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-11-29 15:23 [PATCH v3 0/3] f/madivse(DONTNEED) support Minchan Kim
2010-11-29 15:23 ` Minchan Kim
2010-11-29 15:23 ` [PATCH v3 1/3] deactivate invalidated pages Minchan Kim
2010-11-29 15:23 ` Minchan Kim
2010-11-30 1:01 ` KOSAKI Motohiro
2010-11-30 1:01 ` KOSAKI Motohiro
2010-11-30 5:22 ` Johannes Weiner
2010-11-30 5:22 ` Johannes Weiner
2010-11-30 6:18 ` Minchan Kim
2010-11-30 6:18 ` Minchan Kim
2010-11-29 15:23 ` [PATCH 2/3] Reclaim invalidated page ASAP Minchan Kim
2010-11-29 15:23 ` Minchan Kim
2010-11-29 16:57 ` Mel Gorman
2010-11-29 16:57 ` Mel Gorman
2010-11-29 22:41 ` Minchan Kim
2010-11-29 22:41 ` Minchan Kim
2010-11-30 9:16 ` Mel Gorman
2010-11-30 9:16 ` Mel Gorman
2010-11-30 14:04 ` Minchan Kim
2010-11-30 14:04 ` Minchan Kim
2010-11-30 11:20 ` Johannes Weiner
2010-11-30 11:20 ` Johannes Weiner
2010-11-30 14:03 ` Minchan Kim
2010-11-30 14:03 ` Minchan Kim
2010-11-30 1:10 ` KOSAKI Motohiro
2010-11-30 1:10 ` KOSAKI Motohiro
2010-11-30 9:18 ` Mel Gorman
2010-11-30 9:18 ` Mel Gorman
2010-11-30 14:01 ` Minchan Kim [this message]
2010-11-30 14:01 ` Minchan Kim
2010-11-30 14:11 ` Ben Gamari
2010-11-30 14:11 ` Ben Gamari
2010-11-29 15:23 ` [PATCH v3 3/3] Prevent activation of page in madvise_dontneed Minchan Kim
2010-11-29 15:23 ` Minchan Kim
2010-11-30 1:08 ` KOSAKI Motohiro
2010-11-30 1:08 ` KOSAKI Motohiro
2010-11-30 11:35 ` Johannes Weiner
2010-11-30 11:35 ` Johannes Weiner
2010-12-01 0:50 ` Minchan Kim
2010-12-01 0:50 ` Minchan Kim
2010-11-30 18:34 ` Hugh Dickins
2010-11-30 18:34 ` Hugh Dickins
2010-12-01 0:49 ` Minchan Kim
2010-12-01 0:49 ` Minchan Kim
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20101130140152.GA1528@barrios-desktop \
--to=minchan.kim@gmail.com \
--cc=akpm@linux-foundation.org \
--cc=bgamari.foss@gmail.com \
--cc=fengguang.wu@intel.com \
--cc=hannes@cmpxchg.org \
--cc=kosaki.motohiro@jp.fujitsu.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mel@csn.ul.ie \
--cc=npiggin@kernel.dk \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.