From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1759194AbYDDRRA (ORCPT ); Fri, 4 Apr 2008 13:17:00 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1753143AbYDDRQw (ORCPT ); Fri, 4 Apr 2008 13:16:52 -0400 Received: from hellhawk.shadowen.org ([80.68.90.175]:1721 "EHLO hellhawk.shadowen.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751230AbYDDRQw (ORCPT ); Fri, 4 Apr 2008 13:16:52 -0400 Date: Fri, 4 Apr 2008 18:16:38 +0100 From: Andy Whitcroft To: Nish Aravamudan Cc: Gurudas Pai , Ingo Molnar , linux-kernel@vger.kernel.org Subject: Re: [BUG]:2.6.25-rc7 memory leak with hugepages. Message-ID: <20080404171638.GA17915@shadowen.org> References: <47EB4E2A.1040507@oracle.com> <20080327083849.GF15626@elte.hu> <47EB75C5.20207@oracle.com> <29495f1d0804032040h56f39051lcd5f707660d3c06c@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <29495f1d0804032040h56f39051lcd5f707660d3c06c@mail.gmail.com> User-Agent: Mutt/1.5.13 (2006-08-11) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Apr 03, 2008 at 08:40:41PM -0700, Nish Aravamudan wrote: > Hrm, fio is using SHM_HUGETLB. Does ipcs indicate maybe fio is not > cleaning up the shared memory segment? FWIW, it seems like each run is > using 400 hugepages in the SHM_HUGETLB segment, and then when you try > to force the pool to shrink, it converts those 800 (since you ran fio > twice) hugepages from static pool pages to dynamic (or overcommit) > pages. > > On another note, it is odd that we're using the dynamic pool, when it > is initially disabled...I'll have to think about that. > > I'll try and look at this later this evening or early tomorrow. Yes that is an expected result. We have no way to force the pool to shrink when pages are in-use. When a request is made to redoce the pool below the number of in-use pages, we move the pages to surplus. While this does temporarily violate the overcommit cap, it does provide the most utility as those pages will be returned to the buddy at the earliest oppotunity. I suspect the documenation could do with a little clarification. -apw