From: Wu Fengguang <fengguang.wu@intel.com>
To: Minchan Kim <minchan.kim@gmail.com>
Cc: David Howells <dhowells@redhat.com>, Mel Gorman <mel@csn.ul.ie>,
KOSAKI Motohiro <kosaki.motohiro@jp.fujitsu.com>,
Johannes Weiner <hannes@cmpxchg.org>,
"riel@redhat.com" <riel@redhat.com>,
Andrew Morton <akpm@linux-foundation.org>,
LKML <linux-kernel@vger.kernel.org>,
Christoph Lameter <cl@linux-foundation.org>,
"peterz@infradead.org" <peterz@infradead.org>,
"tytso@mit.edu" <tytso@mit.edu>,
"linux-mm@kvack.org" <linux-mm@kvack.org>,
"elladan@eskimo.com" <elladan@eskimo.com>,
"npiggin@suse.de" <npiggin@suse.de>,
"Barnes, Jesse" <jesse.barnes@intel.com>
Subject: Re: Found the commit that causes the OOMs
Date: Mon, 29 Jun 2009 23:14:18 +0800 [thread overview]
Message-ID: <20090629151417.GA29796@localhost> (raw)
In-Reply-To: <28c262360906290800v37f91d7av3642b1ad8b5f0477@mail.gmail.com>
On Mon, Jun 29, 2009 at 11:00:26PM +0800, Minchan Kim wrote:
> On Mon, Jun 29, 2009 at 11:21 PM, David Howells<dhowells@redhat.com> wrote:
> > Wu Fengguang <fengguang.wu@intel.com> wrote:
> >
> >> Sorry! This one compiles OK:
> >
> > Sadly that doesn't seem to work either:
> >
> > msgctl11 invoked oom-killer: gfp_mask=0x200da, order=0, oom_adj=0
> > msgctl11 cpuset=/ mems_allowed=0
> > Pid: 30858, comm: msgctl11 Not tainted 2.6.31-rc1-cachefs #146
> > Call Trace:
> > [<ffffffff8107207e>] ? oom_kill_process.clone.0+0xa9/0x245
> > [<ffffffff81072345>] ? __out_of_memory+0x12b/0x142
> > [<ffffffff810723c6>] ? out_of_memory+0x6a/0x94
> > [<ffffffff81074a90>] ? __alloc_pages_nodemask+0x42e/0x51d
> > [<ffffffff81080843>] ? do_wp_page+0x2c6/0x5f5
> > [<ffffffff810820c1>] ? handle_mm_fault+0x5dd/0x62f
> > [<ffffffff81022c32>] ? do_page_fault+0x1f8/0x20d
> > [<ffffffff812e069f>] ? page_fault+0x1f/0x30
> > Mem-Info:
> > DMA per-cpu:
> > CPU 0: hi: 0, btch: 1 usd: 0
> > CPU 1: hi: 0, btch: 1 usd: 0
> > DMA32 per-cpu:
> > CPU 0: hi: 186, btch: 31 usd: 38
> > CPU 1: hi: 186, btch: 31 usd: 106
> > Active_anon:75040 active_file:0 inactive_anon:2031
> > inactive_file:0 unevictable:0 dirty:0 writeback:0 unstable:0
> > free:1951 slab:41499 mapped:301 pagetables:60674 bounce:0
> > DMA free:3932kB min:60kB low:72kB high:88kB active_anon:2868kB inactive_anon:384kB active_file:0kB inactive_file:0kB unevictable:0kB present:15364kB pages_scanned:0 all_unreclaimable? no
> > lowmem_reserve[]: 0 968 968 968
> > DMA32 free:3872kB min:3948kB low:4932kB high:5920kB active_anon:297292kB inactive_anon:7740kB active_file:0kB inactive_file:0kB unevictable:0kB present:992032kB pages_scanned:0 all_unreclaimable? no
> > lowmem_reserve[]: 0 0 0 0
> > DMA: 7*4kB 0*8kB 0*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 1*2048kB 0*4096kB = 3932kB
> > DMA32: 500*4kB 2*8kB 0*16kB 0*32kB 1*64kB 0*128kB 1*256kB 1*512kB 1*1024kB 0*2048kB 0*4096kB = 3872kB
> > 1928 total pagecache pages
> > 0 pages in swap cache
> > Swap cache stats: add 0, delete 0, find 0/0
> > Free swap = 0kB
> > Total swap = 0kB
> > 255744 pages RAM
> > 5589 pages reserved
> > 238251 pages shared
> > 216210 pages non-shared
> > Out of memory: kill process 25221 (msgctl11) score 130560 or a child
> > Killed process 26379 (msgctl11)
>
> Totally, I can't understand this situation.
> Now, this page allocation is order zero and It is just likely GFP_HIGHUSER.
> So it's unlikely interrupt context.
>
> Buddy already has enough fallback DMA32, I think.
> Why kernel can't allocate page for order 0 ?
> Is it allocator bug ?
Yes this time the OOM order/flags are much different from all previous OOMs.
btw, I found that msgctl11 is pretty good at making a lot of SUnreclaim and PageTables pages:
before during 1 during 2 after
MemTotal: 3931880 kB MemTotal: 3931880 kB MemTotal: 3931880 kB MemTotal: 3931880 kB
MemFree: 985944 kB MemFree: 1489364 kB MemFree: 2069184 kB MemFree: 2853900 kB
Buffers: 41704 kB Buffers: 16080 kB Buffers: 16104 kB Buffers: 16200 kB
Cached: 1899740 kB Cached: 126780 kB Cached: 129092 kB Cached: 130552 kB
SwapCached: 0 kB SwapCached: 0 kB SwapCached: 0 kB SwapCached: 0 kB
Active: 402420 kB Active: 812320 kB Active: 643868 kB Active: 354880 kB
Inactive: 2325644 kB Inactive: 576732 kB Inactive: 578792 kB Inactive: 579640 kB
Active(anon): 333720 kB Active(anon): 781264 kB Active(anon): 612632 kB Active(anon): 323448 kB
Inactive(anon): 470764 kB Inactive(anon): 482792 kB Inactive(anon): 482680 kB Inactive(anon): 482268 kB
Active(file): 68700 kB Active(file): 31056 kB Active(file): 31236 kB Active(file): 31432 kB
Inactive(file): 1854880 kB Inactive(file): 93940 kB Inactive(file): 96112 kB Inactive(file): 97372 kB
Unevictable: 4 kB Unevictable: 4 kB Unevictable: 4 kB Unevictable: 4 kB
Mlocked: 4 kB Mlocked: 4 kB Mlocked: 4 kB Mlocked: 4 kB
SwapTotal: 0 kB SwapTotal: 0 kB SwapTotal: 0 kB SwapTotal: 0 kB
SwapFree: 0 kB SwapFree: 0 kB SwapFree: 0 kB SwapFree: 0 kB
Dirty: 996 kB Dirty: 536 kB Dirty: 1348 kB Dirty: 212 kB
Writeback: 0 kB Writeback: 0 kB Writeback: 0 kB Writeback: 0 kB
AnonPages: 786772 kB AnonPages: 1246280 kB AnonPages: 1077352 kB AnonPages: 787856 kB
Mapped: 53504 kB Mapped: 50420 kB Mapped: 50668 kB Mapped: 50716 kB
Slab: 159340 kB Slab: 339708 kB Slab: 227164 kB Slab: 85272 kB
SReclaimable: 125152 kB SReclaimable: 49188 kB SReclaimable: 48944 kB SReclaimable: 48508 kB
SUnreclaim: 34188 kB SUnreclaim: 290520 kB SUnreclaim: 178220 kB SUnreclaim: 36764 kB
PageTables: 17068 kB PageTables: 363716 kB PageTables: 204336 kB PageTables: 16620 kB
NFS_Unstable: 0 kB NFS_Unstable: 0 kB NFS_Unstable: 0 kB NFS_Unstable: 0 kB
Bounce: 0 kB Bounce: 0 kB Bounce: 0 kB Bounce: 0 kB
WritebackTmp: 0 kB WritebackTmp: 0 kB WritebackTmp: 0 kB WritebackTmp: 0 kB
CommitLimit: 1965940 kB CommitLimit: 1965940 kB CommitLimit: 1965940 kB CommitLimit: 1965940 kB
Committed_AS: 1130516 kB Committed_AS: 79437584 kB Committed_AS: 43472636 kB Committed_AS: 1122240 kB
VmallocTotal: 34359738367 kB VmallocTotal: 34359738367 kB VmallocTotal: 34359738367 kB VmallocTotal: 34359738367 kB
VmallocUsed: 91504 kB VmallocUsed: 91504 kB VmallocUsed: 91504 kB VmallocUsed: 91504 kB
VmallocChunk: 34359582075 kB VmallocChunk: 34359582075 kB VmallocChunk: 34359582075 kB VmallocChunk: 34359582075 kB
HugePages_Total: 0 HugePages_Total: 0 HugePages_Total: 0 HugePages_Total: 0
HugePages_Free: 0 HugePages_Free: 0 HugePages_Free: 0 HugePages_Free: 0
HugePages_Rsvd: 0 HugePages_Rsvd: 0 HugePages_Rsvd: 0 HugePages_Rsvd: 0
HugePages_Surp: 0 HugePages_Surp: 0 HugePages_Surp: 0 HugePages_Surp: 0
Hugepagesize: 2048 kB Hugepagesize: 2048 kB Hugepagesize: 2048 kB Hugepagesize: 2048 kB
DirectMap4k: 6848 kB DirectMap4k: 6848 kB DirectMap4k: 6848 kB DirectMap4k: 6848 kB
DirectMap2M: 4120576 kB DirectMap2M: 4120576 kB DirectMap2M: 4120576 kB DirectMap2M: 4120576 kB
My kernel is 2.6.30.
Thanks,
Fengguang
next prev parent reply other threads:[~2009-06-29 15:14 UTC|newest]
Thread overview: 92+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-05-17 2:23 [PATCH 0/3] make mapped executable pages the first class citizen Wu Fengguang
2009-05-17 2:23 ` [PATCH 1/3] vmscan: report vm_flags in page_referenced() Wu Fengguang
2009-05-17 2:23 ` [PATCH 2/3] vmscan: make mapped executable pages the first class citizen Wu Fengguang
2009-05-19 8:59 ` Wu Fengguang
2009-05-17 2:23 ` [PATCH 3/3] vmscan: merge duplicate code in shrink_active_list() Wu Fengguang
2009-05-18 9:16 ` Wu Fengguang
2009-05-19 2:43 ` Wu Fengguang
2009-05-19 10:18 ` Johannes Weiner
2009-05-19 10:32 ` Wu Fengguang
2009-06-18 14:46 ` [PATCH 0/3] make mapped executable pages the first class citizen David Howells
2009-06-19 5:24 ` Wu Fengguang
2009-06-19 5:58 ` Wu Fengguang
2009-06-19 8:06 ` David Howells
2009-06-18 14:51 ` David Howells
2009-06-18 16:18 ` David Howells
2009-06-18 16:57 ` Andrew Morton
2009-06-20 4:33 ` Wu Fengguang
2009-06-20 8:24 ` David Howells
2009-06-23 14:43 ` David Howells
2009-06-24 1:43 ` KOSAKI Motohiro
2009-06-24 2:32 ` Wu Fengguang
2009-06-24 2:43 ` KOSAKI Motohiro
2009-06-24 2:49 ` Wu Fengguang
2009-06-27 11:53 ` Johannes Weiner
2009-06-27 18:40 ` David Howells
2009-06-24 13:07 ` David Howells
2009-06-27 7:12 ` Found the commit that causes the OOMs David Howells
2009-06-27 12:07 ` Minchan Kim
2009-06-27 12:54 ` Johannes Weiner
2009-06-27 13:50 ` Minchan Kim
2009-06-27 15:36 ` Johannes Weiner
2009-06-28 16:53 ` Minchan Kim
2009-06-27 15:52 ` KOSAKI Motohiro
2009-06-28 11:32 ` Wu Fengguang
2009-06-28 13:30 ` Minchan Kim
2009-06-28 13:36 ` Minchan Kim
2009-06-28 14:22 ` Wu Fengguang
2009-06-28 15:01 ` KOSAKI Motohiro
2009-06-28 15:10 ` Wu Fengguang
2009-06-28 16:50 ` Minchan Kim
2009-06-29 0:17 ` Minchan Kim
2009-06-29 7:34 ` Wu Fengguang
2009-06-29 10:10 ` David Howells
2009-06-29 12:55 ` Wu Fengguang
2009-06-29 14:21 ` David Howells
2009-06-29 15:00 ` Minchan Kim
2009-06-29 15:14 ` Wu Fengguang [this message]
2009-06-29 15:54 ` David Howells
2009-06-29 15:56 ` David Woodhouse
2009-06-30 14:05 ` Wu Fengguang
2009-06-30 15:50 ` Minchan Kim
2009-07-01 2:30 ` Wu Fengguang
2009-07-01 1:18 ` KOSAKI Motohiro
2009-07-01 2:13 ` Rik van Riel
2009-07-01 2:16 ` Wu Fengguang
2009-07-01 2:26 ` Wu Fengguang
2009-07-01 2:51 ` KOSAKI Motohiro
2009-07-01 2:57 ` Rik van Riel
2009-07-01 4:06 ` Wu Fengguang
2009-07-01 4:18 ` KOSAKI Motohiro
2009-07-01 4:25 ` Wu Fengguang
2009-07-01 4:30 ` KOSAKI Motohiro
2009-07-01 11:27 ` Wu Fengguang
2009-07-05 9:55 ` Wu Fengguang
2009-07-05 10:38 ` KOSAKI Motohiro
2009-07-05 10:51 ` Wu Fengguang
2009-07-01 3:54 ` Wu Fengguang
2009-06-29 16:07 ` Mel Gorman
2009-06-30 4:07 ` Minchan Kim
2009-06-30 9:22 ` Mel Gorman
2009-06-30 9:30 ` Minchan Kim
2009-06-30 14:00 ` Minchan Kim
2009-06-30 19:57 ` David Howells
2009-07-02 7:41 ` Minchan Kim
2009-07-02 7:44 ` Minchan Kim
2009-07-02 12:43 ` Wu Fengguang
2009-07-02 14:08 ` Minchan Kim
2009-06-29 15:27 ` David Howells
2009-06-28 14:49 ` KOSAKI Motohiro
2009-06-28 15:04 ` Wu Fengguang
2009-06-28 16:47 ` Minchan Kim
2009-06-29 7:48 ` KOSAKI Motohiro
2009-06-29 9:32 ` Minchan Kim
2009-06-29 12:43 ` David Howells
2009-06-29 12:59 ` Wu Fengguang
2009-06-29 16:57 ` Andrew Morton
2009-06-29 18:54 ` KOSAKI Motohiro
2009-06-29 19:08 ` KOSAKI Motohiro
2009-06-27 18:35 ` David Howells
2009-06-27 18:58 ` David Howells
2009-06-28 7:55 ` David Howells
2009-06-19 5:27 ` [PATCH 0/3] make mapped executable pages the first class citizen Wu Fengguang
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20090629151417.GA29796@localhost \
--to=fengguang.wu@intel.com \
--cc=akpm@linux-foundation.org \
--cc=cl@linux-foundation.org \
--cc=dhowells@redhat.com \
--cc=elladan@eskimo.com \
--cc=hannes@cmpxchg.org \
--cc=jesse.barnes@intel.com \
--cc=kosaki.motohiro@jp.fujitsu.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mel@csn.ul.ie \
--cc=minchan.kim@gmail.com \
--cc=npiggin@suse.de \
--cc=peterz@infradead.org \
--cc=riel@redhat.com \
--cc=tytso@mit.edu \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).