From: starlight@binnacle.cx
To: Mel Gorman <mel@csn.ul.ie>
Cc: Andrew Morton <akpm@linux-foundation.org>,
linux-mm@kvack.org, bugzilla-daemon@bugzilla.kernel.org,
bugme-daemon@bugzilla.kernel.org, Adam Litke <agl@us.ibm.com>,
Eric B Munson <ebmunson@us.ibm.com>
Subject: Re: [Bugme-new] [Bug 13302] New: "bad pmd" on fork() of process with hugepage shared memory segments attached
Date: Thu, 14 May 2009 15:10:36 -0400 [thread overview]
Message-ID: <6.2.5.6.2.20090514151027.0588f5a0@binnacle.cx> (raw)
In-Reply-To: <20090514174947.GA24837@csn.ul.ie>
[-- Attachment #1: Type: text/plain, Size: 1506 bytes --]
At 06:49 PM 5/14/2009 +0100, Mel Gorman wrote:
>Ok, I just tried that there - parent writing 30% of the shared memory
>before forking but still did not reproduce the problem :(
Maybe it makes a difference to have lots of RAM (16GB on this
server), and about 1.5 GB of hugepage shared memory allocated in
the forking process in about four segments. Often have all free
memory consumed by the file cache, but I don't belive this is
necessary to produce the problem as it will happen even right
after a reboot. [RHEL5 meminfo attached]
Other possible factors:
daemon is non-root but has explicit
CAP_IPC_LOCK, CAP_NET_RAW, CAP_SYS_NICE set via
'setcap cap_net_raw,cap_ipc_lock,cap_sys_nice+ep daemon'
ulimit -Hl and -Sl are set to <unlimited>
process group is set in /proc/sys/vm/hugetlb_shm_group
/proc/sys/vm/nr_hugepages is set to 2048
daemon has 200 threads at time of fork()
shared memory segments explictly located [RHEL5 pmap -x attached]
between fork & exec these syscalls are issued
sched_getscheduler/sched_setscheduler
getpriority/setpriority
seteuid(getuid())
setegid(getgid())
with vfork() work-around, no syscalls are made before exec()
Don't think it's something anything specific to the DL160 (Intel E5430)
we have because the DL165 (Opteron 2354) also exhibits the problem.
Will run the test cases provided this weekend for certain and
will let you know if bug is reproduced.
Have to go silent on this till the weekend.
[-- Attachment #2: meminfo.txt --]
[-- Type: text/plain, Size: 777 bytes --]
MemTotal: 16443828 kB
MemFree: 105364 kB
Buffers: 8476 kB
Cached: 11626260 kB
SwapCached: 0 kB
Active: 121876 kB
Inactive: 11570788 kB
HighTotal: 0 kB
HighFree: 0 kB
LowTotal: 16443828 kB
LowFree: 105364 kB
SwapTotal: 2031608 kB
SwapFree: 2031396 kB
Dirty: 417224 kB
Writeback: 0 kB
AnonPages: 62700 kB
Mapped: 10640 kB
Slab: 416872 kB
PageTables: 1904 kB
NFS_Unstable: 0 kB
Bounce: 0 kB
CommitLimit: 8156368 kB
Committed_AS: 71692 kB
VmallocTotal: 34359738367 kB
VmallocUsed: 266280 kB
VmallocChunk: 34359471371 kB
HugePages_Total: 2048
HugePages_Free: 889
HugePages_Rsvd: 0
Hugepagesize: 2048 kB
[-- Attachment #3: pmap.txt --]
[-- Type: text/plain, Size: 20953 bytes --]
Address Kbytes RSS Anon Locked Mode Mapping
0000000000400000 2976 - - - r-x-- daemon
00000000007e8000 8 - - - rw--- daemon
00000000007ea000 192 - - - rw--- [ anon ]
000000001546d000 9228 - - - rw--- [ anon ]
0000000040955000 4 - - - ----- [ anon ]
0000000040956000 128 - - - rw--- [ anon ]
0000000040976000 4 - - - ----- [ anon ]
0000000040977000 128 - - - rw--- [ anon ]
0000000040997000 4 - - - ----- [ anon ]
0000000040998000 128 - - - rw--- [ anon ]
00000000409b8000 4 - - - ----- [ anon ]
00000000409b9000 128 - - - rw--- [ anon ]
000000004193a000 4 - - - ----- [ anon ]
000000004193b000 128 - - - rw--- [ anon ]
000000004195b000 4 - - - ----- [ anon ]
000000004195c000 128 - - - rw--- [ anon ]
000000004197c000 4 - - - ----- [ anon ]
000000004197d000 128 - - - rw--- [ anon ]
000000004199d000 4 - - - ----- [ anon ]
000000004199e000 128 - - - rw--- [ anon ]
00000000419be000 4 - - - ----- [ anon ]
00000000419bf000 128 - - - rw--- [ anon ]
00000000419df000 4 - - - ----- [ anon ]
00000000419e0000 128 - - - rw--- [ anon ]
0000000041a00000 4 - - - ----- [ anon ]
0000000041a01000 128 - - - rw--- [ anon ]
0000000041a21000 4 - - - ----- [ anon ]
0000000041a22000 128 - - - rw--- [ anon ]
0000000041a42000 4 - - - ----- [ anon ]
0000000041a43000 128 - - - rw--- [ anon ]
0000000041a63000 4 - - - ----- [ anon ]
0000000041a64000 128 - - - rw--- [ anon ]
0000000041a84000 4 - - - ----- [ anon ]
0000000041a85000 128 - - - rw--- [ anon ]
0000000041aa5000 4 - - - ----- [ anon ]
0000000041aa6000 128 - - - rw--- [ anon ]
0000000041ac6000 4 - - - ----- [ anon ]
0000000041ac7000 128 - - - rw--- [ anon ]
0000000041ae7000 4 - - - ----- [ anon ]
0000000041ae8000 128 - - - rw--- [ anon ]
0000000041b08000 4 - - - ----- [ anon ]
0000000041b09000 128 - - - rw--- [ anon ]
0000000041b29000 4 - - - ----- [ anon ]
0000000041b2a000 128 - - - rw--- [ anon ]
0000000041b4a000 4 - - - ----- [ anon ]
0000000041b4b000 128 - - - rw--- [ anon ]
0000000041b6b000 4 - - - ----- [ anon ]
0000000041b6c000 128 - - - rw--- [ anon ]
0000000041b8c000 4 - - - ----- [ anon ]
0000000041b8d000 128 - - - rw--- [ anon ]
0000000041bad000 4 - - - ----- [ anon ]
0000000041bae000 128 - - - rw--- [ anon ]
0000000041bce000 4 - - - ----- [ anon ]
0000000041bcf000 128 - - - rw--- [ anon ]
0000000041bef000 4 - - - ----- [ anon ]
0000000041bf0000 128 - - - rw--- [ anon ]
0000000041c10000 4 - - - ----- [ anon ]
0000000041c11000 128 - - - rw--- [ anon ]
0000000041c31000 4 - - - ----- [ anon ]
0000000041c32000 128 - - - rw--- [ anon ]
0000000041c52000 4 - - - ----- [ anon ]
0000000041c53000 128 - - - rw--- [ anon ]
0000000041c73000 4 - - - ----- [ anon ]
0000000041c74000 128 - - - rw--- [ anon ]
0000000041c94000 4 - - - ----- [ anon ]
0000000041c95000 128 - - - rw--- [ anon ]
0000000041cb5000 4 - - - ----- [ anon ]
0000000041cb6000 128 - - - rw--- [ anon ]
0000000041cd6000 4 - - - ----- [ anon ]
0000000041cd7000 128 - - - rw--- [ anon ]
0000000041cf7000 4 - - - ----- [ anon ]
0000000041cf8000 128 - - - rw--- [ anon ]
0000000041d18000 4 - - - ----- [ anon ]
0000000041d19000 128 - - - rw--- [ anon ]
0000000041d39000 4 - - - ----- [ anon ]
0000000041d3a000 128 - - - rw--- [ anon ]
0000000041d5a000 4 - - - ----- [ anon ]
0000000041d5b000 128 - - - rw--- [ anon ]
0000000041d7b000 4 - - - ----- [ anon ]
0000000041d7c000 128 - - - rw--- [ anon ]
0000000041d9c000 4 - - - ----- [ anon ]
0000000041d9d000 128 - - - rw--- [ anon ]
0000000041dbd000 4 - - - ----- [ anon ]
0000000041dbe000 128 - - - rw--- [ anon ]
0000000041dde000 4 - - - ----- [ anon ]
0000000041ddf000 128 - - - rw--- [ anon ]
0000000041dff000 4 - - - ----- [ anon ]
0000000041e00000 128 - - - rw--- [ anon ]
0000000041e20000 4 - - - ----- [ anon ]
0000000041e21000 128 - - - rw--- [ anon ]
0000000041e41000 4 - - - ----- [ anon ]
0000000041e42000 128 - - - rw--- [ anon ]
0000000041e62000 4 - - - ----- [ anon ]
0000000041e63000 128 - - - rw--- [ anon ]
0000000041e83000 4 - - - ----- [ anon ]
0000000041e84000 128 - - - rw--- [ anon ]
0000000041ea4000 4 - - - ----- [ anon ]
0000000041ea5000 128 - - - rw--- [ anon ]
0000000041ec5000 4 - - - ----- [ anon ]
0000000041ec6000 128 - - - rw--- [ anon ]
0000000041ee6000 4 - - - ----- [ anon ]
0000000041ee7000 128 - - - rw--- [ anon ]
0000000041f07000 4 - - - ----- [ anon ]
0000000041f08000 128 - - - rw--- [ anon ]
0000000041f28000 4 - - - ----- [ anon ]
0000000041f29000 128 - - - rw--- [ anon ]
0000000041f49000 4 - - - ----- [ anon ]
0000000041f4a000 128 - - - rw--- [ anon ]
0000000041f6a000 4 - - - ----- [ anon ]
0000000041f6b000 128 - - - rw--- [ anon ]
0000000041f8b000 4 - - - ----- [ anon ]
0000000041f8c000 128 - - - rw--- [ anon ]
0000000041fac000 4 - - - ----- [ anon ]
0000000041fad000 128 - - - rw--- [ anon ]
0000000041fcd000 4 - - - ----- [ anon ]
0000000041fce000 128 - - - rw--- [ anon ]
0000000041fee000 4 - - - ----- [ anon ]
0000000041fef000 128 - - - rw--- [ anon ]
000000004200f000 4 - - - ----- [ anon ]
0000000042010000 128 - - - rw--- [ anon ]
0000000042030000 4 - - - ----- [ anon ]
0000000042031000 128 - - - rw--- [ anon ]
0000000042051000 4 - - - ----- [ anon ]
0000000042052000 128 - - - rw--- [ anon ]
0000000042072000 4 - - - ----- [ anon ]
0000000042073000 128 - - - rw--- [ anon ]
0000000042093000 4 - - - ----- [ anon ]
0000000042094000 128 - - - rw--- [ anon ]
00000000420b4000 4 - - - ----- [ anon ]
00000000420b5000 128 - - - rw--- [ anon ]
00000000420d5000 4 - - - ----- [ anon ]
00000000420d6000 128 - - - rw--- [ anon ]
00000000420f6000 4 - - - ----- [ anon ]
00000000420f7000 128 - - - rw--- [ anon ]
0000000042117000 4 - - - ----- [ anon ]
0000000042118000 128 - - - rw--- [ anon ]
0000000042138000 4 - - - ----- [ anon ]
0000000042139000 128 - - - rw--- [ anon ]
0000000042159000 4 - - - ----- [ anon ]
000000004215a000 128 - - - rw--- [ anon ]
000000004217a000 4 - - - ----- [ anon ]
000000004217b000 128 - - - rw--- [ anon ]
000000004219b000 4 - - - ----- [ anon ]
000000004219c000 128 - - - rw--- [ anon ]
00000000421bc000 4 - - - ----- [ anon ]
00000000421bd000 128 - - - rw--- [ anon ]
00000000421dd000 4 - - - ----- [ anon ]
00000000421de000 128 - - - rw--- [ anon ]
00000000421fe000 4 - - - ----- [ anon ]
00000000421ff000 128 - - - rw--- [ anon ]
000000004221f000 4 - - - ----- [ anon ]
0000000042220000 128 - - - rw--- [ anon ]
0000000042240000 4 - - - ----- [ anon ]
0000000042241000 128 - - - rw--- [ anon ]
0000000042261000 4 - - - ----- [ anon ]
0000000042262000 128 - - - rw--- [ anon ]
0000000042282000 4 - - - ----- [ anon ]
0000000042283000 128 - - - rw--- [ anon ]
00000000422a3000 4 - - - ----- [ anon ]
00000000422a4000 128 - - - rw--- [ anon ]
00000000422c4000 4 - - - ----- [ anon ]
00000000422c5000 128 - - - rw--- [ anon ]
00000000422e5000 4 - - - ----- [ anon ]
00000000422e6000 128 - - - rw--- [ anon ]
0000000042306000 4 - - - ----- [ anon ]
0000000042307000 128 - - - rw--- [ anon ]
0000000042327000 4 - - - ----- [ anon ]
0000000042328000 128 - - - rw--- [ anon ]
0000000042348000 4 - - - ----- [ anon ]
0000000042349000 128 - - - rw--- [ anon ]
0000000042369000 4 - - - ----- [ anon ]
000000004236a000 128 - - - rw--- [ anon ]
000000004238a000 4 - - - ----- [ anon ]
000000004238b000 128 - - - rw--- [ anon ]
00000000423ab000 4 - - - ----- [ anon ]
00000000423ac000 128 - - - rw--- [ anon ]
00000000423cc000 4 - - - ----- [ anon ]
00000000423cd000 128 - - - rw--- [ anon ]
00000000423ed000 4 - - - ----- [ anon ]
00000000423ee000 128 - - - rw--- [ anon ]
000000004240e000 4 - - - ----- [ anon ]
000000004240f000 128 - - - rw--- [ anon ]
000000004242f000 4 - - - ----- [ anon ]
0000000042430000 128 - - - rw--- [ anon ]
0000000042450000 4 - - - ----- [ anon ]
0000000042451000 128 - - - rw--- [ anon ]
0000000042471000 4 - - - ----- [ anon ]
0000000042472000 128 - - - rw--- [ anon ]
0000000042492000 4 - - - ----- [ anon ]
0000000042493000 128 - - - rw--- [ anon ]
00000000424b3000 4 - - - ----- [ anon ]
00000000424b4000 128 - - - rw--- [ anon ]
00000000424d4000 4 - - - ----- [ anon ]
00000000424d5000 128 - - - rw--- [ anon ]
00000000424f5000 4 - - - ----- [ anon ]
00000000424f6000 128 - - - rw--- [ anon ]
0000000042516000 4 - - - ----- [ anon ]
0000000042517000 128 - - - rw--- [ anon ]
0000000042537000 4 - - - ----- [ anon ]
0000000042538000 128 - - - rw--- [ anon ]
0000000042558000 4 - - - ----- [ anon ]
0000000042559000 128 - - - rw--- [ anon ]
0000000042579000 4 - - - ----- [ anon ]
000000004257a000 128 - - - rw--- [ anon ]
000000004259a000 4 - - - ----- [ anon ]
000000004259b000 128 - - - rw--- [ anon ]
00000000425bb000 4 - - - ----- [ anon ]
00000000425bc000 128 - - - rw--- [ anon ]
00000000425dc000 4 - - - ----- [ anon ]
00000000425dd000 128 - - - rw--- [ anon ]
00000000425fd000 4 - - - ----- [ anon ]
00000000425fe000 128 - - - rw--- [ anon ]
000000004261e000 4 - - - ----- [ anon ]
000000004261f000 128 - - - rw--- [ anon ]
000000004263f000 4 - - - ----- [ anon ]
0000000042640000 128 - - - rw--- [ anon ]
0000000042660000 4 - - - ----- [ anon ]
0000000042661000 128 - - - rw--- [ anon ]
0000000042681000 4 - - - ----- [ anon ]
0000000042682000 128 - - - rw--- [ anon ]
00000000426a2000 4 - - - ----- [ anon ]
00000000426a3000 128 - - - rw--- [ anon ]
00000000426c3000 4 - - - ----- [ anon ]
00000000426c4000 128 - - - rw--- [ anon ]
00000000426e4000 4 - - - ----- [ anon ]
00000000426e5000 128 - - - rw--- [ anon ]
0000000042705000 4 - - - ----- [ anon ]
0000000042706000 128 - - - rw--- [ anon ]
0000000042726000 4 - - - ----- [ anon ]
0000000042727000 128 - - - rw--- [ anon ]
0000000042747000 4 - - - ----- [ anon ]
0000000042748000 128 - - - rw--- [ anon ]
0000000042768000 4 - - - ----- [ anon ]
0000000042769000 128 - - - rw--- [ anon ]
0000000042789000 4 - - - ----- [ anon ]
000000004278a000 128 - - - rw--- [ anon ]
00000000427aa000 4 - - - ----- [ anon ]
00000000427ab000 128 - - - rw--- [ anon ]
00000000427cb000 4 - - - ----- [ anon ]
00000000427cc000 128 - - - rw--- [ anon ]
00000000427ec000 4 - - - ----- [ anon ]
00000000427ed000 128 - - - rw--- [ anon ]
000000004280d000 4 - - - ----- [ anon ]
000000004280e000 28 - - - rw--- [ anon ]
0000000042815000 4 - - - ----- [ anon ]
0000000042816000 28 - - - rw--- [ anon ]
000000004281d000 4 - - - ----- [ anon ]
000000004281e000 28 - - - rw--- [ anon ]
0000000042825000 4 - - - ----- [ anon ]
0000000042826000 28 - - - rw--- [ anon ]
000000004282d000 4 - - - ----- [ anon ]
000000004282e000 28 - - - rw--- [ anon ]
0000000042835000 4 - - - ----- [ anon ]
0000000042836000 28 - - - rw--- [ anon ]
000000004283d000 4 - - - ----- [ anon ]
000000004283e000 28 - - - rw--- [ anon ]
0000000042845000 4 - - - ----- [ anon ]
0000000042846000 28 - - - rw--- [ anon ]
000000004284d000 4 - - - ----- [ anon ]
000000004284e000 28 - - - rw--- [ anon ]
0000000300000000 524288 - - - rw-s- 9 (deleted)
0000000330000000 131072 - - - rw-s- 6 (deleted)
00000003c0000000 98304 - - - rw-s- 8 (deleted)
00000003d8000000 169984 - - - rw-s- 5 (deleted)
00000003f0000000 2048 - - - rw-s- 1 (deleted)
00000003f0400000 2048 - - - rw-s- 7 (deleted)
0000000400000000 1048576 - - - rw-s- 3 (deleted)
0000000580000000 262144 - - - rw-s- 4 (deleted)
0000000600000000 131072 - - - rw-s- 2 (deleted)
00000032d5400000 112 - - - r-x-- ld-2.5.so
00000032d561b000 4 - - - r---- ld-2.5.so
00000032d561c000 4 - - - rw--- ld-2.5.so
00000032d5800000 1328 - - - r-x-- libc-2.5.so
00000032d594c000 2048 - - - ----- libc-2.5.so
00000032d5b4c000 16 - - - r---- libc-2.5.so
00000032d5b50000 4 - - - rw--- libc-2.5.so
00000032d5b51000 20 - - - rw--- [ anon ]
00000032d6800000 520 - - - r-x-- libm-2.5.so
00000032d6882000 2044 - - - ----- libm-2.5.so
00000032d6a81000 4 - - - r---- libm-2.5.so
00000032d6a82000 4 - - - rw--- libm-2.5.so
00000032d6c00000 88 - - - r-x-- libpthread-2.5.so
00000032d6c16000 2044 - - - ----- libpthread-2.5.so
00000032d6e15000 4 - - - r---- libpthread-2.5.so
00000032d6e16000 4 - - - rw--- libpthread-2.5.so
00000032d6e17000 16 - - - rw--- [ anon ]
00000032d7000000 28 - - - r-x-- librt-2.5.so
00000032d7007000 2048 - - - ----- librt-2.5.so
00000032d7207000 4 - - - r---- librt-2.5.so
00000032d7208000 4 - - - rw--- librt-2.5.so
00002aaaac000000 132 - - - rw--- [ anon ]
00002aaaac021000 65404 - - - ----- [ anon ]
00002aaab0000000 132 - - - rw--- [ anon ]
00002aaab0021000 65404 - - - ----- [ anon ]
00002aaab4000000 132 - - - rw--- [ anon ]
00002aaab4021000 65404 - - - ----- [ anon ]
00002ad69510e000 4 - - - rw--- [ anon ]
00002ad695115000 4 - - - rw--- [ anon ]
00002ad695116000 944 - - - r-x-- libstdc++.so.6.0.10
00002ad695202000 1024 - - - ----- libstdc++.so.6.0.10
00002ad695302000 8 - - - r---- libstdc++.so.6.0.10
00002ad695304000 28 - - - rw--- libstdc++.so.6.0.10
00002ad69530b000 80 - - - rw--- [ anon ]
00002ad69531f000 88 - - - r-x-- libgcc_s.so.1
00002ad695335000 1020 - - - ----- libgcc_s.so.1
00002ad695434000 4 - - - rw--- libgcc_s.so.1
00002ad695435000 24776 - - - rw--- [ anon ]
00007fff1597d000 124 - - - rw--- [ stack ]
ffffffffff600000 8192 - - - ----- [ anon ]
---------------- ------ ------ ------ ------
total kB 2641188 - - -
next prev parent reply other threads:[~2009-05-14 19:10 UTC|newest]
Thread overview: 25+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <bug-13302-10286@http.bugzilla.kernel.org/>
2009-05-13 20:08 ` [Bugme-new] [Bug 13302] New: "bad pmd" on fork() of process with hugepage shared memory segments attached Andrew Morton
2009-05-14 10:53 ` Mel Gorman
2009-05-14 10:59 ` Mel Gorman
2009-05-14 17:20 ` starlight
2009-05-14 17:49 ` Mel Gorman
2009-05-14 18:42 ` starlight
2009-05-14 19:10 ` starlight [this message]
2009-05-14 17:16 ` starlight
2009-05-15 5:32 starlight
2009-05-15 14:55 ` Mel Gorman
2009-05-15 15:02 ` starlight
-- strict thread matches above, loose matches on Subject: below --
2009-05-15 18:44 starlight
2009-05-18 16:36 ` Mel Gorman
2009-05-15 18:53 starlight
2009-05-20 11:35 ` Mel Gorman
2009-05-20 14:29 ` Mel Gorman
2009-05-20 14:53 ` Lee Schermerhorn
2009-05-20 15:05 ` Lee Schermerhorn
2009-05-20 15:41 ` Mel Gorman
2009-05-21 0:41 ` KOSAKI Motohiro
2009-05-22 16:41 ` Mel Gorman
2009-05-24 13:44 ` KOSAKI Motohiro
2009-05-25 8:51 ` Mel Gorman
2009-05-25 10:10 ` Hugh Dickins
2009-05-25 13:17 ` Mel Gorman
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=6.2.5.6.2.20090514151027.0588f5a0@binnacle.cx \
--to=starlight@binnacle.cx \
--cc=agl@us.ibm.com \
--cc=akpm@linux-foundation.org \
--cc=bugme-daemon@bugzilla.kernel.org \
--cc=bugzilla-daemon@bugzilla.kernel.org \
--cc=ebmunson@us.ibm.com \
--cc=linux-mm@kvack.org \
--cc=mel@csn.ul.ie \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).