All of lore.kernel.org
 help / color / mirror / Atom feed
From: Mel Gorman <mel@csn.ul.ie>
To: Tobi Oetiker <tobi@oetiker.ch>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
	Frans Pop <elendil@planet.nl>, Jiri Kosina <jkosina@suse.cz>,
	Sven Geggus <lists@fuchsschwanzdomain.de>,
	Karol Lewandowski <karol.k.lewandowski@gmail.com>,
	linux-kernel@vger.kernel.org,
	"linux-mm@kvack.org" <linux-mm@kvack.org>,
	Pekka Enberg <penberg@cs.helsinki.fi>,
	Rik van Riel <riel@redhat.com>,
	Christoph Lameter <cl@linux-foundation.org>,
	Stephan von Krawczynski <skraw@ithnet.com>,
	"Rafael J. Wysocki" <rjw@sisk.pl>,
	Kernel Testers List <kernel-testers@vger.kernel.org>
Subject: Re: still getting allocation failures (was Re: [PATCH] vmscan: Stop kswapd waiting on congestion when the min watermark is not being met V2)
Date: Wed, 2 Dec 2009 11:32:41 +0000	[thread overview]
Message-ID: <20091202113241.GC1457@csn.ul.ie> (raw)
In-Reply-To: <alpine.DEB.2.00.0911290834470.20857@sebohet.brgvxre.pu>

On Sun, Nov 29, 2009 at 08:42:09AM +0100, Tobi Oetiker wrote:
> Hi Mel,
> 
> Thursday Tobias Oetiker wrote:
> > Hi Mel,
> >
> > Nov 13 Mel Gorman wrote:
> >
> > > The last version has a stupid bug in it. Sorry.
> > >
> > > Changelog since V1
> > >   o Fix incorrect negation
> > >   o Rename kswapd_no_congestion_wait to kswapd_skip_congestion_wait as
> > >     suggested by Rik
> > >
> > > If reclaim fails to make sufficient progress, the priority is raised.
> > > Once the priority is higher, kswapd starts waiting on congestion.  However,
> > > if the zone is below the min watermark then kswapd needs to continue working
> > > without delay as there is a danger of an increased rate of GFP_ATOMIC
> > > allocation failure.
> > >
> > > This patch changes the conditions under which kswapd waits on
> > > congestion by only going to sleep if the min watermarks are being met.
> >
> > I finally got around to test this together with the whole series on
> > 2.6.31.6. after running it for a day I have not yet seen a single
> > order:5 allocation problem ... (while I had several an hour before)
> 
> > for the record, my kernel is now running with the following
> > patches:
> >
> > patch1:Date: Thu, 12 Nov 2009 19:30:31 +0000
> > patch1:Subject: [PATCH 1/5] page allocator: Always wake kswapd when restarting an allocation attempt after direct reclaim failed
> >
> > patch2:Date: Thu, 12 Nov 2009 19:30:32 +0000
> > patch2:Subject: [PATCH 2/5] page allocator: Do not allow interrupts to use ALLOC_HARDER
> >
> > patch3:Date: Thu, 12 Nov 2009 19:30:33 +0000
> > patch3:Subject: [PATCH 3/5] page allocator: Wait on both sync and async congestion after direct reclaim
> >
> > patch4:Date: Thu, 12 Nov 2009 19:30:34 +0000
> > patch4:Subject: [PATCH 4/5] vmscan: Have kswapd sleep for a short interval and double check it should be asleep
> >
> > patch5:Date: Fri, 13 Nov 2009 20:03:57 +0000
> > patch5:Subject: [PATCH] vmscan: Stop kswapd waiting on congestion when the min watermark is not being met V2
> >
> > patch6:Date: Tue, 17 Nov 2009 10:34:21 +0000
> > patch6:Subject: [PATCH] vmscan: Have kswapd sleep for a short interval and double check it should be asleep fix 1
> >
> I have now been running the new kernel for a few days and I am
> sorry to report that about a day after booting the allocation
> failures started showing again. More order:4 instead of order:5 ...
> 

Why has the order changed?

Also, what allocator were you using in 2.6.30 and 2.6.31.6, SLAB or
SLUB? Did you happen to change them when upgrading the kernel?

-- 
Mel Gorman
Part-time Phd Student                          Linux Technology Center
University of Limerick                         IBM Dublin Software Lab

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Mel Gorman <mel@csn.ul.ie>
To: Tobi Oetiker <tobi@oetiker.ch>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
	Frans Pop <elendil@planet.nl>, Jiri Kosina <jkosina@suse.cz>,
	Sven Geggus <lists@fuchsschwanzdomain.de>,
	Karol Lewandowski <karol.k.lewandowski@gmail.com>,
	linux-kernel@vger.kernel.org,
	"linux-mm@kvack.org" <linux-mm@kvack.org>,
	Pekka Enberg <penberg@cs.helsinki.fi>,
	Rik van Riel <riel@redhat.com>,
	Christoph Lameter <cl@linux-foundation.org>,
	Stephan von Krawczynski <skraw@ithnet.com>,
	"Rafael J. Wysocki" <rjw@sisk.pl>,
	Kernel Testers List <kernel-testers@vger.kernel.org>
Subject: Re: still getting allocation failures (was Re: [PATCH] vmscan: Stop kswapd waiting on congestion when the min watermark is not being met V2)
Date: Wed, 2 Dec 2009 11:32:41 +0000	[thread overview]
Message-ID: <20091202113241.GC1457@csn.ul.ie> (raw)
In-Reply-To: <alpine.DEB.2.00.0911290834470.20857@sebohet.brgvxre.pu>

On Sun, Nov 29, 2009 at 08:42:09AM +0100, Tobi Oetiker wrote:
> Hi Mel,
> 
> Thursday Tobias Oetiker wrote:
> > Hi Mel,
> >
> > Nov 13 Mel Gorman wrote:
> >
> > > The last version has a stupid bug in it. Sorry.
> > >
> > > Changelog since V1
> > >   o Fix incorrect negation
> > >   o Rename kswapd_no_congestion_wait to kswapd_skip_congestion_wait as
> > >     suggested by Rik
> > >
> > > If reclaim fails to make sufficient progress, the priority is raised.
> > > Once the priority is higher, kswapd starts waiting on congestion.  However,
> > > if the zone is below the min watermark then kswapd needs to continue working
> > > without delay as there is a danger of an increased rate of GFP_ATOMIC
> > > allocation failure.
> > >
> > > This patch changes the conditions under which kswapd waits on
> > > congestion by only going to sleep if the min watermarks are being met.
> >
> > I finally got around to test this together with the whole series on
> > 2.6.31.6. after running it for a day I have not yet seen a single
> > order:5 allocation problem ... (while I had several an hour before)
> 
> > for the record, my kernel is now running with the following
> > patches:
> >
> > patch1:Date: Thu, 12 Nov 2009 19:30:31 +0000
> > patch1:Subject: [PATCH 1/5] page allocator: Always wake kswapd when restarting an allocation attempt after direct reclaim failed
> >
> > patch2:Date: Thu, 12 Nov 2009 19:30:32 +0000
> > patch2:Subject: [PATCH 2/5] page allocator: Do not allow interrupts to use ALLOC_HARDER
> >
> > patch3:Date: Thu, 12 Nov 2009 19:30:33 +0000
> > patch3:Subject: [PATCH 3/5] page allocator: Wait on both sync and async congestion after direct reclaim
> >
> > patch4:Date: Thu, 12 Nov 2009 19:30:34 +0000
> > patch4:Subject: [PATCH 4/5] vmscan: Have kswapd sleep for a short interval and double check it should be asleep
> >
> > patch5:Date: Fri, 13 Nov 2009 20:03:57 +0000
> > patch5:Subject: [PATCH] vmscan: Stop kswapd waiting on congestion when the min watermark is not being met V2
> >
> > patch6:Date: Tue, 17 Nov 2009 10:34:21 +0000
> > patch6:Subject: [PATCH] vmscan: Have kswapd sleep for a short interval and double check it should be asleep fix 1
> >
> I have now been running the new kernel for a few days and I am
> sorry to report that about a day after booting the allocation
> failures started showing again. More order:4 instead of order:5 ...
> 

Why has the order changed?

Also, what allocator were you using in 2.6.30 and 2.6.31.6, SLAB or
SLUB? Did you happen to change them when upgrading the kernel?

-- 
Mel Gorman
Part-time Phd Student                          Linux Technology Center
University of Limerick                         IBM Dublin Software Lab

  reply	other threads:[~2009-12-02 11:32 UTC|newest]

Thread overview: 154+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2009-11-12 19:30 [PATCH 0/5] Reduce GFP_ATOMIC allocation failures, candidate fix V3 Mel Gorman
2009-11-12 19:30 ` Mel Gorman
2009-11-12 19:30 ` Mel Gorman
2009-11-12 19:30 ` [PATCH 1/5] page allocator: Always wake kswapd when restarting an allocation attempt after direct reclaim failed Mel Gorman
2009-11-12 19:30   ` Mel Gorman
2009-11-12 19:30   ` Mel Gorman
2009-11-13  5:23   ` KOSAKI Motohiro
2009-11-13  5:23     ` KOSAKI Motohiro
2009-11-13 13:55     ` Mel Gorman
2009-11-13 13:55       ` Mel Gorman
2009-11-12 19:30 ` [PATCH 2/5] page allocator: Do not allow interrupts to use ALLOC_HARDER Mel Gorman
2009-11-12 19:30   ` Mel Gorman
2009-11-12 19:30   ` Mel Gorman
     [not found]   ` <1258054235-3208-3-git-send-email-mel-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-13  5:24     ` KOSAKI Motohiro
2009-11-13  5:24       ` KOSAKI Motohiro
2009-11-13  5:24       ` KOSAKI Motohiro
2009-11-13 13:56       ` Mel Gorman
2009-11-13 13:56         ` Mel Gorman
2009-11-12 19:30 ` [PATCH 3/5] page allocator: Wait on both sync and async congestion after direct reclaim Mel Gorman
2009-11-12 19:30   ` Mel Gorman
2009-11-12 19:30   ` Mel Gorman
     [not found]   ` <1258054235-3208-4-git-send-email-mel-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-13 11:20     ` KOSAKI Motohiro
2009-11-13 11:20       ` KOSAKI Motohiro
2009-11-13 11:20       ` KOSAKI Motohiro
     [not found]       ` <20091113142526.33B3.A69D9226-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2009-11-13 11:55         ` Jens Axboe
2009-11-13 11:55           ` Jens Axboe
2009-11-13 11:55           ` Jens Axboe
     [not found]           ` <20091113115558.GY8742-tSWWG44O7X1aa/9Udqfwiw@public.gmane.org>
2009-11-13 12:28             ` Mel Gorman
2009-11-13 12:28               ` Mel Gorman
2009-11-13 12:28               ` Mel Gorman
     [not found]               ` <20091113122821.GC29804-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-13 13:32                 ` Jens Axboe
2009-11-13 13:32                   ` Jens Axboe
2009-11-13 13:32                   ` Jens Axboe
     [not found]                   ` <20091113133211.GA8742-tSWWG44O7X1aa/9Udqfwiw@public.gmane.org>
2009-11-13 13:41                     ` Pekka Enberg
2009-11-13 13:41                       ` Pekka Enberg
2009-11-13 13:41                       ` Pekka Enberg
2009-11-13 15:22                       ` Chris Mason
2009-11-13 15:22                         ` Chris Mason
2009-11-13 14:16                     ` Mel Gorman
2009-11-13 14:16                       ` Mel Gorman
2009-11-13 14:16                       ` Mel Gorman
2009-11-20 14:56                   ` Mel Gorman
2009-11-20 14:56                     ` Mel Gorman
2009-11-12 19:30 ` [PATCH 4/5] vmscan: Have kswapd sleep for a short interval and double check it should be asleep Mel Gorman
2009-11-12 19:30   ` Mel Gorman
2009-11-12 19:30   ` Mel Gorman
2009-11-13 10:43   ` KOSAKI Motohiro
2009-11-13 10:43     ` KOSAKI Motohiro
     [not found]     ` <20091113142558.33B6.A69D9226-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2009-11-13 14:13       ` Mel Gorman
2009-11-13 14:13         ` Mel Gorman
2009-11-13 14:13         ` Mel Gorman
2009-11-13 18:00         ` KOSAKI Motohiro
2009-11-13 18:00           ` KOSAKI Motohiro
     [not found]           ` <20091114023901.3DA8.A69D9226-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2009-11-13 18:17             ` Mel Gorman
2009-11-13 18:17               ` Mel Gorman
2009-11-13 18:17               ` Mel Gorman
     [not found]               ` <20091113181740.GN29804-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-14  9:34                 ` KOSAKI Motohiro
2009-11-14  9:34                   ` KOSAKI Motohiro
2009-11-14  9:34                   ` KOSAKI Motohiro
     [not found]                   ` <2f11576a0911140134u21eafa83t9642bb25ccd953de-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-11-14 15:46                     ` Mel Gorman
2009-11-14 15:46                       ` Mel Gorman
2009-11-14 15:46                       ` Mel Gorman
     [not found]                       ` <20091114154636.GR29804-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-17 11:03                         ` KOSAKI Motohiro
2009-11-17 11:03                           ` KOSAKI Motohiro
2009-11-17 11:03                           ` KOSAKI Motohiro
     [not found]                           ` <20091117141638.3DCB.A69D9226-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2009-11-17 11:44                             ` Mel Gorman
2009-11-17 11:44                               ` Mel Gorman
2009-11-17 11:44                               ` Mel Gorman
2009-11-17 12:18                               ` KOSAKI Motohiro
2009-11-17 12:18                                 ` KOSAKI Motohiro
2009-11-17 12:25                                 ` Mel Gorman
2009-11-17 12:25                                   ` Mel Gorman
     [not found]                                   ` <20091117122555.GZ29804-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-18  5:20                                     ` KOSAKI Motohiro
2009-11-18  5:20                                       ` KOSAKI Motohiro
2009-11-18  5:20                                       ` KOSAKI Motohiro
2009-11-17 10:34                     ` [PATCH] vmscan: Have kswapd sleep for a short interval and double check it should be asleep fix 1 Mel Gorman
2009-11-17 10:34                       ` Mel Gorman
2009-11-17 10:34                       ` Mel Gorman
2009-11-18  5:27                       ` KOSAKI Motohiro
2009-11-18  5:27                         ` KOSAKI Motohiro
2009-11-12 19:30 ` [PATCH 5/5] vmscan: Take order into consideration when deciding if kswapd is in trouble Mel Gorman
2009-11-12 19:30   ` Mel Gorman
2009-11-12 19:30   ` Mel Gorman
2009-11-13  9:54   ` KOSAKI Motohiro
2009-11-13  9:54     ` KOSAKI Motohiro
     [not found]     ` <20091113142608.33B9.A69D9226-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2009-11-13 13:54       ` Mel Gorman
2009-11-13 13:54         ` Mel Gorman
2009-11-13 13:54         ` Mel Gorman
     [not found]         ` <20091113135443.GF29804-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-13 14:48           ` Minchan Kim
2009-11-13 14:48             ` Minchan Kim
2009-11-13 14:48             ` Minchan Kim
2009-11-13 18:00         ` KOSAKI Motohiro
2009-11-13 18:00           ` KOSAKI Motohiro
     [not found]           ` <20091114023138.3DA5.A69D9226-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2009-11-13 18:15             ` [PATCH] vmscan: Stop kswapd waiting on congestion when the min watermark is not being met Mel Gorman
2009-11-13 18:15               ` Mel Gorman
2009-11-13 18:15               ` Mel Gorman
2009-11-13 18:26               ` Frans Pop
2009-11-13 18:26                 ` Frans Pop
     [not found]               ` <20091113181557.GM29804-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-13 18:33                 ` KOSAKI Motohiro
2009-11-13 18:33                   ` KOSAKI Motohiro
2009-11-13 18:33                   ` KOSAKI Motohiro
     [not found]                   ` <2f11576a0911131033w4a9e6042k3349f0be290a167e-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-11-13 20:03                     ` [PATCH] vmscan: Stop kswapd waiting on congestion when the min watermark is not being met V2 Mel Gorman
2009-11-13 20:03                       ` Mel Gorman
2009-11-13 20:03                       ` Mel Gorman
     [not found]                       ` <20091113200357.GO29804-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-26 14:45                         ` Tobias Oetiker
2009-11-26 14:45                           ` Tobias Oetiker
2009-11-26 14:45                           ` Tobias Oetiker
     [not found]                           ` <alpine.DEB.2.00.0911261542500.21450-EjsAmf5DE5zIvOfxy3zmAzgUDZmNtoG9@public.gmane.org>
2009-11-29  7:42                             ` still getting allocation failures (was Re: [PATCH] vmscan: Stop kswapd waiting on congestion when the min watermark is not being met V2) Tobi Oetiker
2009-11-29  7:42                               ` Tobi Oetiker
2009-11-29  7:42                               ` Tobi Oetiker
2009-12-02 11:32                               ` Mel Gorman [this message]
2009-12-02 11:32                                 ` Mel Gorman
2009-12-02 21:30                                 ` Tobias Oetiker
2009-12-02 21:30                                   ` Tobias Oetiker
     [not found]                                   ` <alpine.DEB.2.00.0912022210220.30023-EjsAmf5DE5zIvOfxy3zmAzgUDZmNtoG9@public.gmane.org>
2009-12-03 20:26                                     ` Corrado Zoccolo
2009-12-03 20:26                                       ` Corrado Zoccolo
2009-12-03 20:26                                       ` Corrado Zoccolo
     [not found]                                       ` <4e5e476b0912031226i5b0e6cf9hdfd5519182ccdefa-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2009-12-14  5:59                                         ` Tobias Oetiker
2009-12-14  5:59                                           ` Tobias Oetiker
2009-12-14  5:59                                           ` Tobias Oetiker
     [not found]                                           ` <alpine.DEB.2.00.0912140646550.12657-EjsAmf5DE5zIvOfxy3zmAzgUDZmNtoG9@public.gmane.org>
2009-12-14  8:49                                             ` Corrado Zoccolo
2009-12-14  8:49                                               ` Corrado Zoccolo
2009-12-14  8:49                                               ` Corrado Zoccolo
2009-11-13 18:36               ` [PATCH] vmscan: Stop kswapd waiting on congestion when the min watermark is not being met Rik van Riel
2009-11-13 18:36                 ` Rik van Riel
2009-11-13 14:38     ` [PATCH 5/5] vmscan: Take order into consideration when deciding if kswapd is in trouble Minchan Kim
2009-11-13 14:38       ` Minchan Kim
2009-11-13 14:38       ` Minchan Kim
     [not found]   ` <1258054235-3208-6-git-send-email-mel-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-13 12:41     ` Minchan Kim
2009-11-13 12:41       ` Minchan Kim
2009-11-13 12:41       ` Minchan Kim
     [not found] ` <1258054235-3208-1-git-send-email-mel-wPRd99KPJ+uzQB+pC5nmwQ@public.gmane.org>
2009-11-13  9:04   ` [PATCH 0/5] Reduce GFP_ATOMIC allocation failures, candidate fix V3 Frans Pop
2009-11-13  9:04     ` Frans Pop
2009-11-13  9:04     ` Frans Pop
     [not found]     ` <200911131004.25293.elendil-EIBgga6/0yRmR6Xm/wNWPw@public.gmane.org>
2009-11-16 17:57       ` Mel Gorman
2009-11-16 17:57         ` Mel Gorman
2009-11-16 17:57         ` Mel Gorman
2009-11-13 12:47   ` Tobias Oetiker
2009-11-13 12:47     ` Tobias Oetiker
2009-11-13 12:47     ` Tobias Oetiker
     [not found]     ` <alpine.DEB.2.00.0911131346560.22447-ZxOFkyelvri73kmZFr1Urg@public.gmane.org>
2009-11-13 13:37       ` Mel Gorman
2009-11-13 13:37         ` Mel Gorman
2009-11-13 13:37         ` Mel Gorman
2009-11-15 12:07   ` Karol Lewandowski
2009-11-15 12:07     ` Karol Lewandowski
2009-11-15 12:07     ` Karol Lewandowski
     [not found]     ` <20091115120721.GA7557-nLtalAL5mPp2RxbNQum0x1nzlInOXLuq@public.gmane.org>
2009-11-16  9:52       ` Mel Gorman
2009-11-16  9:52         ` Mel Gorman
2009-11-16  9:52         ` Mel Gorman
2009-11-16 12:08         ` Karol Lewandowski
2009-11-16 12:08           ` Karol Lewandowski
     [not found]           ` <20091116120845.GA10115-nLtalAL5mPp2RxbNQum0x1nzlInOXLuq@public.gmane.org>
2009-11-16 14:32             ` Karol Lewandowski
2009-11-16 14:32               ` Karol Lewandowski
2009-11-16 14:32               ` Karol Lewandowski

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20091202113241.GC1457@csn.ul.ie \
    --to=mel@csn.ul.ie \
    --cc=akpm@linux-foundation.org \
    --cc=cl@linux-foundation.org \
    --cc=elendil@planet.nl \
    --cc=jkosina@suse.cz \
    --cc=karol.k.lewandowski@gmail.com \
    --cc=kernel-testers@vger.kernel.org \
    --cc=kosaki.motohiro@jp.fujitsu.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=lists@fuchsschwanzdomain.de \
    --cc=penberg@cs.helsinki.fi \
    --cc=riel@redhat.com \
    --cc=rjw@sisk.pl \
    --cc=skraw@ithnet.com \
    --cc=tobi@oetiker.ch \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.