linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Shaohua Li <shaohua.li@intel.com>
To: Minchan Kim <minchan.kim@gmail.com>
Cc: KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
	linux-mm <linux-mm@kvack.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Mel Gorman <mel@csn.ul.ie>
Subject: Re: [patch]vmscan: make kswapd use a correct order
Date: Thu, 02 Dec 2010 09:05:08 +0800	[thread overview]
Message-ID: <1291251908.12777.94.camel@sli10-conroe> (raw)
In-Reply-To: <AANLkTi=p9s=2pRNw5fT7Lw_hYbi7GM-hrnQ-X+ETVhNZ@mail.gmail.com>

On Thu, 2010-12-02 at 08:54 +0800, Minchan Kim wrote:
> On Thu, Dec 2, 2010 at 9:29 AM, Shaohua Li <shaohua.li@intel.com> wrote:
> > On Wed, 2010-12-01 at 23:58 +0800, Minchan Kim wrote:
> >> On Wed, Dec 01, 2010 at 06:44:27PM +0900, KOSAKI Motohiro wrote:
> >> > > T0: Task1 wakeup_kswapd(order=3)
> >> > > T1: kswapd enters balance_pgdat
> >> > > T2: Task2 wakeup_kswapd(order=2), because pages reclaimed by kswapd are used
> >> > > quickly
> >> > > T3: kswapd exits balance_pgdat. kswapd will do check. Now new order=2,
> >> > > pgdat->kswapd_max_order will become 0, but order=3, if sleeping_prematurely,
> >> > > then order will become pgdat->kswapd_max_order(0), while at this time the
> >> > > order should 2
> >> > > This isn't a big deal, but we do have a small window the order is wrong.
> >> > >
> >> > > Signed-off-by: Shaohua Li <shaohua.li@intel.com>
> >> > >
> >> > > diff --git a/mm/vmscan.c b/mm/vmscan.c
> >> > > index d31d7ce..15cd0d2 100644
> >> > > --- a/mm/vmscan.c
> >> > > +++ b/mm/vmscan.c
> >> > > @@ -2450,7 +2450,7 @@ static int kswapd(void *p)
> >> > >                           }
> >> > >                   }
> >> > >
> >> > > -                 order = pgdat->kswapd_max_order;
> >> > > +                 order = max_t(unsigned long, new_order, pgdat->kswapd_max_order);
> >> > >           }
> >> > >           finish_wait(&pgdat->kswapd_wait, &wait);
> >> >
> >> > Good catch!
> >> >
> >> > But unfortunatelly, the code is not correct. At least, don't fit corrent
> >> > design.
> >> >
> >> > 1) if "order < new_order" condition is false, we already decided to don't
> >> >    use new_order. So, we shouldn't use new_order after kswapd_try_to_sleep()
> >> > 2) if sleeping_prematurely() return false, it probably mean
> >> >    zone_watermark_ok_safe(zone, order, high_wmark) return false.
> >> >    therefore, we have to retry reclaim by using old 'order' parameter.
> >>
> >> Good catch, too.
> >>
> >> In Shaohua's scenario, if Task1 gets the order-3 page after kswapd's reclaiming,
> >> it's no problem.
> >> But if Task1 doesn't get the order-3 page and others used the order-3 page for Task1,
> >> Kswapd have to reclaim order-3 for Task1, again.
> > why? it's just a possibility. Task1 might get its pages too. If Task1
> > doesn't get its pages, it will wakeup kswapd too with its order.
> >
> >> In addtion, new order is always less than old order in that context.
> >> so big order page reclaim makes much safe for low order pages.
> > big order page reclaim makes we have more chances to reclaim useful
> > pages by lumpy, why it's safe?
> 
> For example, It assume tat Task1 continues to fail get the order-3
> page of GFP_ATOMIC since other tasks continues to allocate order-2
> pages so that they steal pages. 
but even you reclaim order-3, you can't guarantee task1 can get the
pages too. order-3 page can be steal by order-2 allocation

> Then, your patch makes continue to
> reclaim order-2 page in this scenario. Task1 never get the order-3
> pages if it doesn't have a merge luck.
Task1 will wakeup kswapd again for order-3, so kswapd will reclaim
order-3 very soon after the order-2 reclaim.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom policy in Canada: sign http://dissolvethecrtc.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2010-12-02  1:05 UTC|newest]

Thread overview: 35+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-12-01  3:08 [patch]vmscan: make kswapd use a correct order Shaohua Li
2010-12-01  4:21 ` Minchan Kim
2010-12-01  5:42   ` Shaohua Li
2010-12-01  9:44 ` KOSAKI Motohiro
2010-12-01 15:58   ` Minchan Kim
2010-12-02  0:09     ` KOSAKI Motohiro
2010-12-02  0:29       ` KOSAKI Motohiro
2010-12-02  0:58         ` Minchan Kim
2010-12-02  0:19     ` Andrew Morton
2010-12-02  9:40       ` Mel Gorman
2010-12-02  0:29     ` Shaohua Li
2010-12-02  0:54       ` Minchan Kim
2010-12-02  1:05         ` Shaohua Li [this message]
2010-12-02  1:23           ` Minchan Kim
2010-12-02  1:36             ` Minchan Kim
2010-12-02  9:42               ` Mel Gorman
2010-12-02 15:25                 ` Minchan Kim
2010-12-02  2:39             ` Shaohua Li
2010-12-02  1:28       ` KOSAKI Motohiro
2010-12-02 10:12     ` Mel Gorman
2010-12-02 15:35       ` Minchan Kim
2010-12-02 15:42         ` Mel Gorman
2010-12-02 20:53           ` Simon Kirby
2010-12-03 12:00             ` Mel Gorman
2010-12-04 12:07               ` Simon Kirby
2010-12-06 12:03                 ` Mel Gorman
2010-12-09 23:44                   ` Simon Kirby
2010-12-10 11:32                     ` Mel Gorman
2010-12-10 23:42                       ` Simon Kirby
2010-12-14  9:52                         ` Mel Gorman
  -- strict thread matches above, loose matches on Subject: below --
2010-12-02 16:00 [PATCH] vmscan: " Minchan Kim
2010-12-03 12:11 ` Mel Gorman
2010-12-09 22:13 ` Andrew Morton
2010-12-10  3:53   ` Minchan Kim
2010-12-10 11:17   ` Mel Gorman

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1291251908.12777.94.camel@sli10-conroe \
    --to=shaohua.li@intel.com \
    --cc=akpm@linux-foundation.org \
    --cc=kosaki.motohiro@jp.fujitsu.com \
    --cc=linux-mm@kvack.org \
    --cc=mel@csn.ul.ie \
    --cc=minchan.kim@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).