From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ray Bryant Date: Sun, 18 Apr 2004 17:36:05 +0000 Subject: Re: [Lse-tech] Re: hugetlb demand paging patch part [2/3] Message-Id: <4082BC85.9010800@sgi.com> List-Id: References: <20040416032725.GG12735@zax> <200404160413.i3G4DcF13729@unix-os.sc.intel.com> <20040416044917.GB26707@zax> <40802E69.7040506@sgi.com> <20040417120540.GC32444@zax> In-Reply-To: <20040417120540.GC32444@zax> MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit To: 'David Gibson' Cc: "Chen, Kenneth W" , linux-kernel@vger.kernel.org, linux-ia64@vger.kernel.org, lse-tech@lists.sourceforge.net, 'Andy Whitcroft' , 'Andrew Morton' 'David Gibson' wrote: > > > My main interest in it is as a prerequisite for various methods of > "automatically" using hugepages for programs where it is difficult to > manually code them to use hugetlbfs. In particular, think HPC > monsters written in FORTRAN. e.g. automatically putting suitable > aligned anonymous mmap()s in hugepages under some circumstances (I > can't say I like that idea much), using an LD_PRELOAD to put > malloc()ated memory into hugepages, or using a hacked ELF loader to > put the BSS section (again, think FORTRAN) into hugepages (actually > easier and less ugly than it sounds). > Well, that certainly is a laudable goal. At the moment, one usually has to resort to such things as POINTER variables and the like to get access to hugetlbpage segments. Unfortunately, some of our experiments with the Intel compiler for ia64 have indicated that the generated code can be significantly slower when arrays are referenced off of POINTER variables than when the same arrays are referenced out of COMMON, thus eliminating the performance gain of HUGETLB pages. My question was really intended to address applying development effort to things that the users of hugetlbpages will likely actually use. For example, it seems pointless to worry too much about demand paging of hugetlbpages out to disk. Anyone who uses hugetlbpages for the performance boost they give will also likely have rightsized their problem or machine configuration to eliminate any swapping. > In any of these cases having the memory have different semantics > (MAP_SHARED) to normal anonymous memory would clearly be a Bad Thing. > > > > -- Best Regards, Ray ----------------------------------------------- Ray Bryant 512-453-9679 (work) 512-507-7807 (cell) raybry@sgi.com raybry@austin.rr.com The box said: "Requires Windows 98 or better", so I installed Linux. -----------------------------------------------