From: Shaohua Li <shaohua.li@intel.com>
To: Minchan Kim <minchan.kim@gmail.com>
Cc: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
linux-mm <linux-mm@kvack.org>,
Andrew Morton <akpm@linux-foundation.org>,
Mel Gorman <mel@csn.ul.ie>
Subject: Re: [patch]vmscan: make kswapd use a correct order
Date: Thu, 02 Dec 2010 09:05:08 +0800 [thread overview]
Message-ID: <1291251908.12777.94.camel@sli10-conroe> (raw)
In-Reply-To: <AANLkTi=p9s=2pRNw5fT7Lw_hYbi7GM-hrnQ-X+ETVhNZ@mail.gmail.com>
On Thu, 2010-12-02 at 08:54 +0800, Minchan Kim wrote:
> On Thu, Dec 2, 2010 at 9:29 AM, Shaohua Li <shaohua.li@intel.com> wrote:
> > On Wed, 2010-12-01 at 23:58 +0800, Minchan Kim wrote:
> >> On Wed, Dec 01, 2010 at 06:44:27PM +0900, KOSAKI Motohiro wrote:
> >> > > T0: Task1 wakeup_kswapd(order=3)
> >> > > T1: kswapd enters balance_pgdat
> >> > > T2: Task2 wakeup_kswapd(order=2), because pages reclaimed by kswapd are used
> >> > > quickly
> >> > > T3: kswapd exits balance_pgdat. kswapd will do check. Now new order=2,
> >> > > pgdat->kswapd_max_order will become 0, but order=3, if sleeping_prematurely,
> >> > > then order will become pgdat->kswapd_max_order(0), while at this time the
> >> > > order should 2
> >> > > This isn't a big deal, but we do have a small window the order is wrong.
> >> > >
> >> > > Signed-off-by: Shaohua Li <shaohua.li@intel.com>
> >> > >
> >> > > diff --git a/mm/vmscan.c b/mm/vmscan.c
> >> > > index d31d7ce..15cd0d2 100644
> >> > > --- a/mm/vmscan.c
> >> > > +++ b/mm/vmscan.c
> >> > > @@ -2450,7 +2450,7 @@ static int kswapd(void *p)
> >> > > }
> >> > > }
> >> > >
> >> > > - order = pgdat->kswapd_max_order;
> >> > > + order = max_t(unsigned long, new_order, pgdat->kswapd_max_order);
> >> > > }
> >> > > finish_wait(&pgdat->kswapd_wait, &wait);
> >> >
> >> > Good catch!
> >> >
> >> > But unfortunatelly, the code is not correct. At least, don't fit corrent
> >> > design.
> >> >
> >> > 1) if "order < new_order" condition is false, we already decided to don't
> >> > use new_order. So, we shouldn't use new_order after kswapd_try_to_sleep()
> >> > 2) if sleeping_prematurely() return false, it probably mean
> >> > zone_watermark_ok_safe(zone, order, high_wmark) return false.
> >> > therefore, we have to retry reclaim by using old 'order' parameter.
> >>
> >> Good catch, too.
> >>
> >> In Shaohua's scenario, if Task1 gets the order-3 page after kswapd's reclaiming,
> >> it's no problem.
> >> But if Task1 doesn't get the order-3 page and others used the order-3 page for Task1,
> >> Kswapd have to reclaim order-3 for Task1, again.
> > why? it's just a possibility. Task1 might get its pages too. If Task1
> > doesn't get its pages, it will wakeup kswapd too with its order.
> >
> >> In addtion, new order is always less than old order in that context.
> >> so big order page reclaim makes much safe for low order pages.
> > big order page reclaim makes we have more chances to reclaim useful
> > pages by lumpy, why it's safe?
>
> For example, It assume tat Task1 continues to fail get the order-3
> page of GFP_ATOMIC since other tasks continues to allocate order-2
> pages so that they steal pages.
but even you reclaim order-3, you can't guarantee task1 can get the
pages too. order-3 page can be steal by order-2 allocation
> Then, your patch makes continue to
> reclaim order-2 page in this scenario. Task1 never get the order-3
> pages if it doesn't have a merge luck.
Task1 will wakeup kswapd again for order-3, so kswapd will reclaim
order-3 very soon after the order-2 reclaim.
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom policy in Canada: sign http://dissolvethecrtc.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
next prev parent reply other threads:[~2010-12-02 1:05 UTC|newest]
Thread overview: 35+ messages / expand[flat|nested] mbox.gz Atom feed top
2010-12-01 3:08 [patch]vmscan: make kswapd use a correct order Shaohua Li
2010-12-01 4:21 ` Minchan Kim
2010-12-01 5:42 ` Shaohua Li
2010-12-01 9:44 ` KOSAKI Motohiro
2010-12-01 15:58 ` Minchan Kim
2010-12-02 0:09 ` KOSAKI Motohiro
2010-12-02 0:29 ` KOSAKI Motohiro
2010-12-02 0:58 ` Minchan Kim
2010-12-02 0:19 ` Andrew Morton
2010-12-02 9:40 ` Mel Gorman
2010-12-02 0:29 ` Shaohua Li
2010-12-02 0:54 ` Minchan Kim
2010-12-02 1:05 ` Shaohua Li [this message]
2010-12-02 1:23 ` Minchan Kim
2010-12-02 1:36 ` Minchan Kim
2010-12-02 9:42 ` Mel Gorman
2010-12-02 15:25 ` Minchan Kim
2010-12-02 2:39 ` Shaohua Li
2010-12-02 1:28 ` KOSAKI Motohiro
2010-12-02 10:12 ` Mel Gorman
2010-12-02 15:35 ` Minchan Kim
2010-12-02 15:42 ` Mel Gorman
2010-12-02 20:53 ` Simon Kirby
2010-12-03 12:00 ` Mel Gorman
2010-12-04 12:07 ` Simon Kirby
2010-12-06 12:03 ` Mel Gorman
2010-12-09 23:44 ` Simon Kirby
2010-12-10 11:32 ` Mel Gorman
2010-12-10 23:42 ` Simon Kirby
2010-12-14 9:52 ` Mel Gorman
-- strict thread matches above, loose matches on Subject: below --
2010-12-02 16:00 [PATCH] vmscan: " Minchan Kim
2010-12-03 12:11 ` Mel Gorman
2010-12-09 22:13 ` Andrew Morton
2010-12-10 3:53 ` Minchan Kim
2010-12-10 11:17 ` Mel Gorman
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1291251908.12777.94.camel@sli10-conroe \
--to=shaohua.li@intel.com \
--cc=akpm@linux-foundation.org \
--cc=kosaki.motohiro@jp.fujitsu.com \
--cc=linux-mm@kvack.org \
--cc=mel@csn.ul.ie \
--cc=minchan.kim@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).