linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Dave Hansen <haveblue@us.ibm.com>
To: Adam Litke <agl@us.ibm.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	linux-mm@kvack.org, Ken Chen <kenchen@google.com>,
	Andy Whitcroft <apw@shadowen.org>
Subject: Re: [PATCH 1/3] [FIX] hugetlb: Fix broken fs quota management
Date: Wed, 24 Oct 2007 12:18:38 -0700	[thread overview]
Message-ID: <1193253518.4039.41.camel@localhost> (raw)
In-Reply-To: <1193252583.18417.52.camel@localhost.localdomain>

On Wed, 2007-10-24 at 14:03 -0500, Adam Litke wrote:
> On Wed, 2007-10-24 at 11:43 -0700, Dave Hansen wrote:
> > On Wed, 2007-10-24 at 06:23 -0700, Adam Litke wrote:
> > > --- a/mm/hugetlb.c
> > > +++ b/mm/hugetlb.c
> > > @@ -685,7 +685,17 @@ void __unmap_hugepage_range(struct vm_area_struct *vma, unsigned long start,
> > >  	flush_tlb_range(vma, start, end);
> > >  	list_for_each_entry_safe(page, tmp, &page_list, lru) {
> > >  		list_del(&page->lru);
> > > -		put_page(page);
> > > +		if (put_page_testzero(page)) {
> > > +			/*
> > > +			 * When releasing the last reference to a page we must
> > > +			 * credit the quota.  For MAP_PRIVATE pages this occurs
> > > +			 * when the last PTE is cleared, for MAP_SHARED pages
> > > +			 * this occurs when the file is truncated.
> > > +			 */

Could we change this comment a bit?  It isn't completely clear that
_this_ code is never called for shared pages.  

/*
 * We'll never get here for MAP_SHARED.  We always
 * have another reference out for the address_space,
 * and will never get to page_count()==0 during
 * an unmap.  We put the quota for these in
 * some_function() instead.
 */

> > > +			VM_BUG_ON(PageMapping(page));
> > > +			hugetlb_put_quota(vma->vm_file->f_mapping);
> > > +			free_huge_page(page);
> > > +		}
> > >  	}
> > >  }
> > 
> > That's a pretty good mechanism to use.   
> > 
> > This particular nugget is for MAP_PRIVATE pages only, right?  The shared
> > ones should have another ref out on them for the 'mapping' too, so won't
> > get released at unmap, right?
> 
> Yep that's right.  Shared pages are released by truncate_hugepages()
> when the ref for the mapping is dropped.
> 
> > It isn't obvious from the context here, but how did free_huge_page() get
> > called for these pages before?
> 
> put_page() calls put_compound_page() which looks up the page dtor
> (free_huge_page) and calls it.

Ahhh, and put_page_testzero() doesn't hook into the destructors at all.
I wish it had an __ prefixed. :)

> > Can you use free_pages_check() here to get some more comprehensive page
> > tests?  Just a cursory look at it makes me think that it should work.  
> 
> Yeah, that should work but I am a little hesitant to use
> free_pages_check() because it may happen to "just work."  None of the
> other hugetlb code concerns itself with all of those page flags so it
> seems a little out of place to start caring only here.

I just think it is more comprehensive.  If you're going to check
PageMapping(), should you not also check page->mapping to make sure they
are consistent?  Anyway, bad_page() may also be more appropriate than a
VM_BUG_ON().  It gets you a much prettier message.

Your comment about this happening when the last PTE is shot down would
be reinforced by having the page_mapcount() check in free_pages_check().
But, it would also be worthless since we don't do rmap for huge
pages. ;)

-- Dave

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2007-10-24 19:18 UTC|newest]

Thread overview: 15+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2007-10-24 13:23 [PATCH 0/3] hugetlb: Fix up filesystem quota accounting Adam Litke
2007-10-24 13:23 ` [PATCH 1/3] [FIX] hugetlb: Fix broken fs quota management Adam Litke
2007-10-24 18:43   ` Dave Hansen
2007-10-24 19:03     ` Adam Litke
2007-10-24 19:18       ` Dave Hansen [this message]
2007-10-24 19:21       ` Ken Chen
2007-10-24 20:02         ` Adam Litke
2007-10-24 22:12           ` Dave Hansen
2007-10-25  5:20             ` Ken Chen
2007-10-25 14:54               ` Adam Litke
2007-10-24 13:23 ` [PATCH 2/3] hugetlb: Allow bulk updating in hugetlb_*_quota() Adam Litke
2007-10-24 13:24 ` [PATCH 3/3] [PATCH] hugetlb: Enforce quotas during reservation for shared mappings Adam Litke
2007-10-24 19:07   ` Dave Hansen
2007-10-24 19:52     ` Adam Litke
2007-10-24 20:00       ` Dave Hansen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=1193253518.4039.41.camel@localhost \
    --to=haveblue@us.ibm.com \
    --cc=agl@us.ibm.com \
    --cc=akpm@linux-foundation.org \
    --cc=apw@shadowen.org \
    --cc=kenchen@google.com \
    --cc=linux-mm@kvack.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).