From: Vlastimil Babka <vbabka@suse.cz>
To: Joonsoo Kim <iamjoonsoo.kim@lge.com>,
Andrew Morton <akpm@linux-foundation.org>
Cc: "Kirill A. Shutemov" <kirill.shutemov@linux.intel.com>,
Rik van Riel <riel@redhat.com>,
Peter Zijlstra <peterz@infradead.org>,
Mel Gorman <mgorman@suse.de>,
Johannes Weiner <hannes@cmpxchg.org>,
Minchan Kim <minchan@kernel.org>,
Yasuaki Ishimatsu <isimatu.yasuaki@jp.fujitsu.com>,
Zhang Yanfei <zhangyanfei@cn.fujitsu.com>,
Tang Chen <tangchen@cn.fujitsu.com>,
Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>,
Bartlomiej Zolnierkiewicz <b.zolnierkie@samsung.com>,
Wen Congyang <wency@cn.fujitsu.com>,
Marek Szyprowski <m.szyprowski@samsung.com>,
Michal Nazarewicz <mina86@mina86.com>,
Laura Abbott <lauraa@codeaurora.org>,
Heesub Shin <heesub.shin@samsung.com>,
"Aneesh Kumar K.V" <aneesh.kumar@linux.vnet.ibm.com>,
Ritesh Harjani <ritesh.list@gmail.com>,
t.stanislaws@samsung.com, Gioh Kim <gioh.kim@lge.com>,
linux-mm@kvack.org, linux-kernel@vger.kernel.org,
stable@vger.kernel.org
Subject: Re: [PATCH v5 4/4] mm/page_alloc: restrict max order of merging on isolated pageblock
Date: Fri, 31 Oct 2014 15:39:13 +0100 [thread overview]
Message-ID: <54539F11.7080501@suse.cz> (raw)
In-Reply-To: <1414740330-4086-5-git-send-email-iamjoonsoo.kim@lge.com>
On 10/31/2014 08:25 AM, Joonsoo Kim wrote:
> @@ -571,6 +548,7 @@ static inline void __free_one_page(struct page *page,
> unsigned long combined_idx;
> unsigned long uninitialized_var(buddy_idx);
> struct page *buddy;
> + int max_order = MAX_ORDER;
>
> VM_BUG_ON(!zone_is_initialized(zone));
>
> @@ -579,15 +557,23 @@ static inline void __free_one_page(struct page *page,
> return;
>
> VM_BUG_ON(migratetype == -1);
> - if (!is_migrate_isolate(migratetype))
> + if (is_migrate_isolate(migratetype)) {
> + /*
> + * We restrict max order of merging to prevent merge
> + * between freepages on isolate pageblock and normal
> + * pageblock. Without this, pageblock isolation
> + * could cause incorrect freepage accounting.
> + */
> + max_order = min(MAX_ORDER, pageblock_order + 1);
> + } else
> __mod_zone_freepage_state(zone, 1 << order, migratetype);
Please add { } to the else branch, this looks ugly :)
> - page_idx = pfn & ((1 << MAX_ORDER) - 1);
> + page_idx = pfn & ((1 << max_order) - 1);
>
> VM_BUG_ON_PAGE(page_idx & ((1 << order) - 1), page);
> VM_BUG_ON_PAGE(bad_range(zone, page), page);
>
> - while (order < MAX_ORDER-1) {
> + while (order < max_order - 1) {
> buddy_idx = __find_buddy_index(page_idx, order);
> buddy = page + (buddy_idx - page_idx);
> if (!page_is_buddy(page, buddy, order))
> @@ -1590,7 +1576,7 @@ void split_page(struct page *page, unsigned int order)
> }
> EXPORT_SYMBOL_GPL(split_page);
>
> -static int __isolate_free_page(struct page *page, unsigned int order)
> +int __isolate_free_page(struct page *page, unsigned int order)
> {
> unsigned long watermark;
> struct zone *zone;
> diff --git a/mm/page_isolation.c b/mm/page_isolation.c
> index 1fa4a4d..df61c93 100644
> --- a/mm/page_isolation.c
> +++ b/mm/page_isolation.c
> @@ -76,17 +76,48 @@ void unset_migratetype_isolate(struct page *page, unsigned migratetype)
> {
> struct zone *zone;
> unsigned long flags, nr_pages;
> + struct page *isolated_page = NULL;
> + unsigned int order;
> + unsigned long page_idx, buddy_idx;
> + struct page *buddy;
> + int mt;
>
> zone = page_zone(page);
> spin_lock_irqsave(&zone->lock, flags);
> if (get_pageblock_migratetype(page) != MIGRATE_ISOLATE)
> goto out;
> +
> + /*
> + * Because freepage with more than pageblock_order on isolated
> + * pageblock is restricted to merge due to freepage counting problem,
> + * it is possible that there is free buddy page.
> + * move_freepages_block() doesn't care of merge so we need other
> + * approach in order to merge them. Isolation and free will make
> + * these pages to be merged.
> + */
> + if (PageBuddy(page)) {
> + order = page_order(page);
> + if (order >= pageblock_order) {
> + page_idx = page_to_pfn(page) & ((1 << MAX_ORDER) - 1);
> + buddy_idx = __find_buddy_index(page_idx, order);
> + buddy = page + (buddy_idx - page_idx);
> + mt = get_pageblock_migratetype(buddy);
> +
> + if (!is_migrate_isolate(mt)) {
You could use is_migrate_isolate_page(buddy) and save a variable.
> + __isolate_free_page(page, order);
> + set_page_refcounted(page);
> + isolated_page = page;
> + }
> + }
> + }
> nr_pages = move_freepages_block(zone, page, migratetype);
- this is a costly no-op when the whole pageblock is an isolated page,
right?
> __mod_zone_freepage_state(zone, nr_pages, migratetype);
- with isolated_page set, this means you increase freepage_state here,
and then the second time in __free_pages() below? __isolate_free_page()
won't decrease it as the pageblock is still MIGRATE_ISOLATE, so the net
result is overcounting?
> set_pageblock_migratetype(page, migratetype);
> zone->nr_isolate_pageblock--;
> out:
> spin_unlock_irqrestore(&zone->lock, flags);
> + if (isolated_page)
> + __free_pages(isolated_page, order);
> }
>
> static inline struct page *
>
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
WARNING: multiple messages have this Message-ID (diff)
From: Vlastimil Babka <vbabka@suse.cz>
To: Joonsoo Kim <iamjoonsoo.kim@lge.com>,
Andrew Morton <akpm@linux-foundation.org>
Cc: "Kirill A. Shutemov" <kirill.shutemov@linux.intel.com>,
Rik van Riel <riel@redhat.com>,
Peter Zijlstra <peterz@infradead.org>,
Mel Gorman <mgorman@suse.de>,
Johannes Weiner <hannes@cmpxchg.org>,
Minchan Kim <minchan@kernel.org>,
Yasuaki Ishimatsu <isimatu.yasuaki@jp.fujitsu.com>,
Zhang Yanfei <zhangyanfei@cn.fujitsu.com>,
Tang Chen <tangchen@cn.fujitsu.com>,
Naoya Horiguchi <n-horiguchi@ah.jp.nec.com>,
Bartlomiej Zolnierkiewicz <b.zolnierkie@samsung.com>,
Wen Congyang <wency@cn.fujitsu.com>,
Marek Szyprowski <m.szyprowski@samsung.com>,
Michal Nazarewicz <mina86@mina86.com>,
Laura Abbott <lauraa@codeaurora.org>,
Heesub Shin <heesub.shin@samsung.com>,
"Aneesh Kumar K.V" <aneesh.kumar@linux.vnet.ibm.com>,
Ritesh Harjani <ritesh.list@gmail.com>,
t.stanislaws@samsung.com, Gioh Kim <gioh.kim@lge.com>,
linux-mm@kvack.org, linux-kernel@vger.kernel.org,
stable@vger.kernel.org
Subject: Re: [PATCH v5 4/4] mm/page_alloc: restrict max order of merging on isolated pageblock
Date: Fri, 31 Oct 2014 15:39:13 +0100 [thread overview]
Message-ID: <54539F11.7080501@suse.cz> (raw)
In-Reply-To: <1414740330-4086-5-git-send-email-iamjoonsoo.kim@lge.com>
On 10/31/2014 08:25 AM, Joonsoo Kim wrote:
> @@ -571,6 +548,7 @@ static inline void __free_one_page(struct page *page,
> unsigned long combined_idx;
> unsigned long uninitialized_var(buddy_idx);
> struct page *buddy;
> + int max_order = MAX_ORDER;
>
> VM_BUG_ON(!zone_is_initialized(zone));
>
> @@ -579,15 +557,23 @@ static inline void __free_one_page(struct page *page,
> return;
>
> VM_BUG_ON(migratetype == -1);
> - if (!is_migrate_isolate(migratetype))
> + if (is_migrate_isolate(migratetype)) {
> + /*
> + * We restrict max order of merging to prevent merge
> + * between freepages on isolate pageblock and normal
> + * pageblock. Without this, pageblock isolation
> + * could cause incorrect freepage accounting.
> + */
> + max_order = min(MAX_ORDER, pageblock_order + 1);
> + } else
> __mod_zone_freepage_state(zone, 1 << order, migratetype);
Please add { } to the else branch, this looks ugly :)
> - page_idx = pfn & ((1 << MAX_ORDER) - 1);
> + page_idx = pfn & ((1 << max_order) - 1);
>
> VM_BUG_ON_PAGE(page_idx & ((1 << order) - 1), page);
> VM_BUG_ON_PAGE(bad_range(zone, page), page);
>
> - while (order < MAX_ORDER-1) {
> + while (order < max_order - 1) {
> buddy_idx = __find_buddy_index(page_idx, order);
> buddy = page + (buddy_idx - page_idx);
> if (!page_is_buddy(page, buddy, order))
> @@ -1590,7 +1576,7 @@ void split_page(struct page *page, unsigned int order)
> }
> EXPORT_SYMBOL_GPL(split_page);
>
> -static int __isolate_free_page(struct page *page, unsigned int order)
> +int __isolate_free_page(struct page *page, unsigned int order)
> {
> unsigned long watermark;
> struct zone *zone;
> diff --git a/mm/page_isolation.c b/mm/page_isolation.c
> index 1fa4a4d..df61c93 100644
> --- a/mm/page_isolation.c
> +++ b/mm/page_isolation.c
> @@ -76,17 +76,48 @@ void unset_migratetype_isolate(struct page *page, unsigned migratetype)
> {
> struct zone *zone;
> unsigned long flags, nr_pages;
> + struct page *isolated_page = NULL;
> + unsigned int order;
> + unsigned long page_idx, buddy_idx;
> + struct page *buddy;
> + int mt;
>
> zone = page_zone(page);
> spin_lock_irqsave(&zone->lock, flags);
> if (get_pageblock_migratetype(page) != MIGRATE_ISOLATE)
> goto out;
> +
> + /*
> + * Because freepage with more than pageblock_order on isolated
> + * pageblock is restricted to merge due to freepage counting problem,
> + * it is possible that there is free buddy page.
> + * move_freepages_block() doesn't care of merge so we need other
> + * approach in order to merge them. Isolation and free will make
> + * these pages to be merged.
> + */
> + if (PageBuddy(page)) {
> + order = page_order(page);
> + if (order >= pageblock_order) {
> + page_idx = page_to_pfn(page) & ((1 << MAX_ORDER) - 1);
> + buddy_idx = __find_buddy_index(page_idx, order);
> + buddy = page + (buddy_idx - page_idx);
> + mt = get_pageblock_migratetype(buddy);
> +
> + if (!is_migrate_isolate(mt)) {
You could use is_migrate_isolate_page(buddy) and save a variable.
> + __isolate_free_page(page, order);
> + set_page_refcounted(page);
> + isolated_page = page;
> + }
> + }
> + }
> nr_pages = move_freepages_block(zone, page, migratetype);
- this is a costly no-op when the whole pageblock is an isolated page,
right?
> __mod_zone_freepage_state(zone, nr_pages, migratetype);
- with isolated_page set, this means you increase freepage_state here,
and then the second time in __free_pages() below? __isolate_free_page()
won't decrease it as the pageblock is still MIGRATE_ISOLATE, so the net
result is overcounting?
> set_pageblock_migratetype(page, migratetype);
> zone->nr_isolate_pageblock--;
> out:
> spin_unlock_irqrestore(&zone->lock, flags);
> + if (isolated_page)
> + __free_pages(isolated_page, order);
> }
>
> static inline struct page *
>
next prev parent reply other threads:[~2014-10-31 14:39 UTC|newest]
Thread overview: 30+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-10-31 7:25 [PATCH v5 0/4] fix freepage count problems in memory isolation Joonsoo Kim
2014-10-31 7:25 ` Joonsoo Kim
2014-10-31 7:25 ` [PATCH v5 1/4] mm/page_alloc: fix incorrect isolation behavior by rechecking migratetype Joonsoo Kim
2014-10-31 7:25 ` Joonsoo Kim
2014-11-14 8:27 ` Weijie Yang
2014-11-14 8:27 ` Weijie Yang
2014-11-14 10:33 ` Mel Gorman
2014-11-14 10:33 ` Mel Gorman
2014-11-18 3:11 ` Joonsoo Kim
2014-11-18 3:11 ` Joonsoo Kim
2014-10-31 7:25 ` [PATCH v5 2/4] mm/page_alloc: add freepage on isolate pageblock to correct buddy list Joonsoo Kim
2014-10-31 7:25 ` Joonsoo Kim
2014-11-03 8:22 ` Heesub Shin
2014-11-03 8:22 ` Heesub Shin
2014-11-03 8:34 ` Hui Zhu
2014-11-03 8:34 ` Hui Zhu
2014-11-04 0:44 ` Joonsoo Kim
2014-11-04 0:44 ` Joonsoo Kim
2014-10-31 7:25 ` [PATCH v5 3/4] mm/page_alloc: move freepage counting logic to __free_one_page() Joonsoo Kim
2014-10-31 7:25 ` Joonsoo Kim
2014-10-31 14:02 ` Vlastimil Babka
2014-10-31 14:02 ` Vlastimil Babka
2014-10-31 7:25 ` [PATCH v5 4/4] mm/page_alloc: restrict max order of merging on isolated pageblock Joonsoo Kim
2014-10-31 7:25 ` Joonsoo Kim
2014-10-31 14:39 ` Vlastimil Babka [this message]
2014-10-31 14:39 ` Vlastimil Babka
2014-11-03 8:10 ` Joonsoo Kim
2014-11-03 8:10 ` Joonsoo Kim
2014-11-03 8:29 ` Vlastimil Babka
2014-11-03 8:29 ` Vlastimil Babka
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=54539F11.7080501@suse.cz \
--to=vbabka@suse.cz \
--cc=akpm@linux-foundation.org \
--cc=aneesh.kumar@linux.vnet.ibm.com \
--cc=b.zolnierkie@samsung.com \
--cc=gioh.kim@lge.com \
--cc=hannes@cmpxchg.org \
--cc=heesub.shin@samsung.com \
--cc=iamjoonsoo.kim@lge.com \
--cc=isimatu.yasuaki@jp.fujitsu.com \
--cc=kirill.shutemov@linux.intel.com \
--cc=lauraa@codeaurora.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=m.szyprowski@samsung.com \
--cc=mgorman@suse.de \
--cc=mina86@mina86.com \
--cc=minchan@kernel.org \
--cc=n-horiguchi@ah.jp.nec.com \
--cc=peterz@infradead.org \
--cc=riel@redhat.com \
--cc=ritesh.list@gmail.com \
--cc=stable@vger.kernel.org \
--cc=t.stanislaws@samsung.com \
--cc=tangchen@cn.fujitsu.com \
--cc=wency@cn.fujitsu.com \
--cc=zhangyanfei@cn.fujitsu.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.