All of lore.kernel.org
 help / color / mirror / Atom feed
From: vbabka@suse.cz (Vlastimil Babka)
To: linux-arm-kernel@lists.infradead.org
Subject: Suspicious error for CMA stress test
Date: Fri, 18 Mar 2016 21:58:35 +0100	[thread overview]
Message-ID: <56EC6BFB.2020107@suse.cz> (raw)
In-Reply-To: <1458312126.18134.45.camel@pengutronix.de>

On 03/18/2016 03:42 PM, Lucas Stach wrote:
> Am Freitag, den 18.03.2016, 15:10 +0100 schrieb Vlastimil Babka:
>> On 03/17/2016 04:52 PM, Joonsoo Kim wrote:
>> > 2016-03-18 0:43 GMT+09:00 Vlastimil Babka <vbabka@suse.cz>:
>>
>> OK, here it is. Hanjun can you please retest this, as I'm not sure if you had
>> the same code due to the followup one-liner patches in the thread. Lucas, see if
>> it helps with your issue as well. Laura and Joonsoo, please also test and review
>> and check changelog if my perception of the problem is accurate :)
>>
>
> This doesn't help for my case, as it is still trying to merge pages in
> isolated ranges. It even tries extra hard at doing so.
>
> With concurrent isolation and frees going on this may lead to the start
> page of the range to be isolated merging into an higher order buddy page
> if it isn't already pageblock aligned, leading both test_pages_isolated
> and isolate_freepages to fail on an otherwise perfectly fine range.
>
> What I am arguing is that if a page is freed into an isolated range we
> should not try merge it with it's buddies at all, by setting max_order =
> order. If the range is isolated because want to isolate freepages from
> it, the work to do the merging is wasted, as isolate_freepages will
> split higher order pages into order-0 pages again.
>
> If we already finished isolating freepages and are in the process of
> undoing the isolation, we don't strictly need to do the merging in
> __free_one_page, but can defer it to unset_migratetype_isolate, allowing
> to simplify those code paths by disallowing any merging of isolated
> pages at all.

Oh, I think understand now. Yeah, skipping merging for pages in isolated 
pageblocks might be a rather elegant solution. But still, we would have to check 
buddy's migratetype at order >= pageblock_order like my patch does, which is 
annoying. Because even without isolated merging, the buddy might have already 
had order>=pageblock_order when it was isolated.

So what if isolation also split existing buddies in the pageblock immediately 
when it sets the MIGRATETYPE_ISOLATE on the pageblock? Then we would have it 
guaranteed that there's no isolated buddy - a buddy candidate at order >= 
pageblock_order either has a smaller order (so it's not a buddy) or is not 
MIGRATE_ISOLATE so it's safe to merge with.

Does that make sense?

WARNING: multiple messages have this Message-ID (diff)
From: Vlastimil Babka <vbabka@suse.cz>
To: Lucas Stach <l.stach@pengutronix.de>
Cc: Joonsoo Kim <js1304@gmail.com>, Hanjun Guo <guohanjun@huawei.com>,
	Joonsoo Kim <iamjoonsoo.kim@lge.com>,
	"Leizhen (ThunderTown)" <thunder.leizhen@huawei.com>,
	Laura Abbott <labbott@redhat.com>,
	"linux-arm-kernel@lists.infradead.org"
	<linux-arm-kernel@lists.infradead.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Sasha Levin <sasha.levin@oracle.com>,
	Laura Abbott <lauraa@codeaurora.org>,
	qiuxishi <qiuxishi@huawei.com>,
	Catalin Marinas <Catalin.Marinas@arm.com>,
	Will Deacon <will.deacon@arm.com>, Arnd Bergmann <arnd@arndb.de>,
	dingtinahong <dingtianhong@huawei.com>,
	chenjie6@huawei.com, "linux-mm@kvack.org" <linux-mm@kvack.org>
Subject: Re: Suspicious error for CMA stress test
Date: Fri, 18 Mar 2016 21:58:35 +0100	[thread overview]
Message-ID: <56EC6BFB.2020107@suse.cz> (raw)
In-Reply-To: <1458312126.18134.45.camel@pengutronix.de>

On 03/18/2016 03:42 PM, Lucas Stach wrote:
> Am Freitag, den 18.03.2016, 15:10 +0100 schrieb Vlastimil Babka:
>> On 03/17/2016 04:52 PM, Joonsoo Kim wrote:
>> > 2016-03-18 0:43 GMT+09:00 Vlastimil Babka <vbabka@suse.cz>:
>>
>> OK, here it is. Hanjun can you please retest this, as I'm not sure if you had
>> the same code due to the followup one-liner patches in the thread. Lucas, see if
>> it helps with your issue as well. Laura and Joonsoo, please also test and review
>> and check changelog if my perception of the problem is accurate :)
>>
>
> This doesn't help for my case, as it is still trying to merge pages in
> isolated ranges. It even tries extra hard at doing so.
>
> With concurrent isolation and frees going on this may lead to the start
> page of the range to be isolated merging into an higher order buddy page
> if it isn't already pageblock aligned, leading both test_pages_isolated
> and isolate_freepages to fail on an otherwise perfectly fine range.
>
> What I am arguing is that if a page is freed into an isolated range we
> should not try merge it with it's buddies at all, by setting max_order =
> order. If the range is isolated because want to isolate freepages from
> it, the work to do the merging is wasted, as isolate_freepages will
> split higher order pages into order-0 pages again.
>
> If we already finished isolating freepages and are in the process of
> undoing the isolation, we don't strictly need to do the merging in
> __free_one_page, but can defer it to unset_migratetype_isolate, allowing
> to simplify those code paths by disallowing any merging of isolated
> pages at all.

Oh, I think understand now. Yeah, skipping merging for pages in isolated 
pageblocks might be a rather elegant solution. But still, we would have to check 
buddy's migratetype at order >= pageblock_order like my patch does, which is 
annoying. Because even without isolated merging, the buddy might have already 
had order>=pageblock_order when it was isolated.

So what if isolation also split existing buddies in the pageblock immediately 
when it sets the MIGRATETYPE_ISOLATE on the pageblock? Then we would have it 
guaranteed that there's no isolated buddy - a buddy candidate at order >= 
pageblock_order either has a smaller order (so it's not a buddy) or is not 
MIGRATE_ISOLATE so it's safe to merge with.

Does that make sense?


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Vlastimil Babka <vbabka@suse.cz>
To: Lucas Stach <l.stach@pengutronix.de>
Cc: Joonsoo Kim <js1304@gmail.com>, Hanjun Guo <guohanjun@huawei.com>,
	Joonsoo Kim <iamjoonsoo.kim@lge.com>,
	"Leizhen (ThunderTown)" <thunder.leizhen@huawei.com>,
	Laura Abbott <labbott@redhat.com>,
	"linux-arm-kernel@lists.infradead.org" 
	<linux-arm-kernel@lists.infradead.org>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Sasha Levin <sasha.levin@oracle.com>,
	Laura Abbott <lauraa@codeaurora.org>,
	qiuxishi <qiuxishi@huawei.com>,
	Catalin Marinas <Catalin.Marinas@arm.com>,
	Will Deacon <will.deacon@arm.com>, Arnd Bergmann <arnd@arndb.de>,
	dingtinahong <dingtianhong@huawei.com>,
	chenjie6@huawei.com, "linux-mm@kvack.org" <linux-mm@kvack.org>
Subject: Re: Suspicious error for CMA stress test
Date: Fri, 18 Mar 2016 21:58:35 +0100	[thread overview]
Message-ID: <56EC6BFB.2020107@suse.cz> (raw)
In-Reply-To: <1458312126.18134.45.camel@pengutronix.de>

On 03/18/2016 03:42 PM, Lucas Stach wrote:
> Am Freitag, den 18.03.2016, 15:10 +0100 schrieb Vlastimil Babka:
>> On 03/17/2016 04:52 PM, Joonsoo Kim wrote:
>> > 2016-03-18 0:43 GMT+09:00 Vlastimil Babka <vbabka@suse.cz>:
>>
>> OK, here it is. Hanjun can you please retest this, as I'm not sure if you had
>> the same code due to the followup one-liner patches in the thread. Lucas, see if
>> it helps with your issue as well. Laura and Joonsoo, please also test and review
>> and check changelog if my perception of the problem is accurate :)
>>
>
> This doesn't help for my case, as it is still trying to merge pages in
> isolated ranges. It even tries extra hard at doing so.
>
> With concurrent isolation and frees going on this may lead to the start
> page of the range to be isolated merging into an higher order buddy page
> if it isn't already pageblock aligned, leading both test_pages_isolated
> and isolate_freepages to fail on an otherwise perfectly fine range.
>
> What I am arguing is that if a page is freed into an isolated range we
> should not try merge it with it's buddies at all, by setting max_order =
> order. If the range is isolated because want to isolate freepages from
> it, the work to do the merging is wasted, as isolate_freepages will
> split higher order pages into order-0 pages again.
>
> If we already finished isolating freepages and are in the process of
> undoing the isolation, we don't strictly need to do the merging in
> __free_one_page, but can defer it to unset_migratetype_isolate, allowing
> to simplify those code paths by disallowing any merging of isolated
> pages at all.

Oh, I think understand now. Yeah, skipping merging for pages in isolated 
pageblocks might be a rather elegant solution. But still, we would have to check 
buddy's migratetype at order >= pageblock_order like my patch does, which is 
annoying. Because even without isolated merging, the buddy might have already 
had order>=pageblock_order when it was isolated.

So what if isolation also split existing buddies in the pageblock immediately 
when it sets the MIGRATETYPE_ISOLATE on the pageblock? Then we would have it 
guaranteed that there's no isolated buddy - a buddy candidate at order >= 
pageblock_order either has a smaller order (so it's not a buddy) or is not 
MIGRATE_ISOLATE so it's safe to merge with.

Does that make sense?

  reply	other threads:[~2016-03-18 20:58 UTC|newest]

Thread overview: 176+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2016-03-02 13:52 Suspicious error for CMA stress test Hanjun Guo
2016-03-02 13:52 ` Hanjun Guo
2016-03-03  1:25 ` Laura Abbott
2016-03-03  1:25   ` Laura Abbott
2016-03-03  1:25   ` Laura Abbott
2016-03-03  6:07   ` Hanjun Guo
2016-03-03  6:07     ` Hanjun Guo
2016-03-03  6:07     ` Hanjun Guo
2016-03-03  7:42   ` Joonsoo Kim
2016-03-03  7:42     ` Joonsoo Kim
2016-03-03  7:42     ` Joonsoo Kim
2016-03-03  7:58     ` Hanjun Guo
2016-03-03  7:58       ` Hanjun Guo
2016-03-03  7:58       ` Hanjun Guo
2016-03-03 12:49     ` Hanjun Guo
2016-03-03 12:49       ` Hanjun Guo
2016-03-03 12:49       ` Hanjun Guo
2016-03-03 18:52       ` Laura Abbott
2016-03-03 18:52         ` Laura Abbott
2016-03-03 18:52         ` Laura Abbott
2016-03-04  2:09         ` Joonsoo Kim
2016-03-04  2:09           ` Joonsoo Kim
2016-03-04  2:09           ` Joonsoo Kim
2016-03-04  6:09           ` Hanjun Guo
2016-03-04  6:09             ` Hanjun Guo
2016-03-04  6:09             ` Hanjun Guo
2016-03-04  2:02       ` Joonsoo Kim
2016-03-04  2:02         ` Joonsoo Kim
2016-03-04  2:02         ` Joonsoo Kim
2016-03-04  4:32         ` Joonsoo Kim
2016-03-04  4:32           ` Joonsoo Kim
2016-03-04  4:32           ` Joonsoo Kim
2016-03-04  6:05           ` Hanjun Guo
2016-03-04  6:05             ` Hanjun Guo
2016-03-04  6:05             ` Hanjun Guo
2016-03-04  6:38             ` Joonsoo Kim
2016-03-04  6:38               ` Joonsoo Kim
2016-03-04  6:38               ` Joonsoo Kim
2016-03-04  7:35               ` Hanjun Guo
2016-03-04  7:35                 ` Hanjun Guo
2016-03-04  7:35                 ` Hanjun Guo
2016-03-07  4:34                 ` Joonsoo Kim
2016-03-07  4:34                   ` Joonsoo Kim
2016-03-07  4:34                   ` Joonsoo Kim
2016-03-07  8:16                   ` Leizhen (ThunderTown)
2016-03-07  8:16                     ` Leizhen (ThunderTown)
2016-03-07  8:16                     ` Leizhen (ThunderTown)
2016-03-07 18:42                     ` Laura Abbott
2016-03-07 18:42                       ` Laura Abbott
2016-03-07 18:42                       ` Laura Abbott
2016-03-08  1:54                       ` Leizhen (ThunderTown)
2016-03-08  1:54                         ` Leizhen (ThunderTown)
2016-03-08  1:54                         ` Leizhen (ThunderTown)
2016-03-09  1:23                         ` Leizhen (ThunderTown)
2016-03-09  1:23                           ` Leizhen (ThunderTown)
2016-03-09  1:23                           ` Leizhen (ThunderTown)
2016-03-11 15:00                           ` Joonsoo Kim
2016-03-11 15:00                             ` Joonsoo Kim
2016-03-11 15:00                             ` Joonsoo Kim
2016-03-11 17:07                             ` Vlastimil Babka
2016-03-11 17:07                               ` Vlastimil Babka
2016-03-11 17:07                               ` Vlastimil Babka
2016-03-14  6:49                               ` Joonsoo Kim
2016-03-14  6:49                                 ` Joonsoo Kim
2016-03-14  6:49                                 ` Joonsoo Kim
2016-03-14  7:06                                 ` Vlastimil Babka
2016-03-14  7:06                                   ` Vlastimil Babka
2016-03-14  7:06                                   ` Vlastimil Babka
2016-03-14  7:18                                   ` Joonsoo Kim
2016-03-14  7:18                                     ` Joonsoo Kim
2016-03-14  7:18                                     ` Joonsoo Kim
2016-03-14 12:30                                     ` Vlastimil Babka
2016-03-14 12:30                                       ` Vlastimil Babka
2016-03-14 12:30                                       ` Vlastimil Babka
2016-03-14 14:10                                       ` Joonsoo Kim
2016-03-14 14:10                                         ` Joonsoo Kim
2016-03-14 14:10                                         ` Joonsoo Kim
2016-03-16 12:03                                         ` Vlastimil Babka
2016-03-16 12:03                                           ` Vlastimil Babka
2016-03-16 12:03                                           ` Vlastimil Babka
2016-03-16  9:44                                     ` Hanjun Guo
2016-03-16  9:44                                       ` Hanjun Guo
2016-03-16  9:44                                       ` Hanjun Guo
2016-03-17  6:54                                       ` Joonsoo Kim
2016-03-17  6:54                                         ` Joonsoo Kim
2016-03-17  6:54                                         ` Joonsoo Kim
2016-03-17  9:24                                         ` Hanjun Guo
2016-03-17  9:24                                           ` Hanjun Guo
2016-03-17  9:24                                           ` Hanjun Guo
2016-03-17 15:31                                           ` Joonsoo Kim
2016-03-17 15:31                                             ` Joonsoo Kim
2016-03-17 15:31                                             ` Joonsoo Kim
2016-03-18  2:03                                             ` Hanjun Guo
2016-03-18  2:03                                               ` Hanjun Guo
2016-03-18  2:03                                               ` Hanjun Guo
2016-03-17 15:43                                           ` Vlastimil Babka
2016-03-17 15:43                                             ` Vlastimil Babka
2016-03-17 15:43                                             ` Vlastimil Babka
2016-03-17 15:52                                             ` Joonsoo Kim
2016-03-17 15:52                                               ` Joonsoo Kim
2016-03-17 15:52                                               ` Joonsoo Kim
2016-03-18 13:32                                               ` Lucas Stach
2016-03-18 13:32                                                 ` Lucas Stach
2016-03-18 13:32                                                 ` Lucas Stach
2016-03-21  4:42                                                 ` Joonsoo Kim
2016-03-21  4:42                                                   ` Joonsoo Kim
2016-03-21  4:42                                                   ` Joonsoo Kim
2016-03-22 14:56                                                   ` Lucas Stach
2016-03-22 14:56                                                     ` Lucas Stach
2016-03-22 14:56                                                     ` Lucas Stach
2016-03-23  4:42                                                     ` Joonsoo Kim
2016-03-23  4:42                                                       ` Joonsoo Kim
2016-03-23  4:42                                                       ` Joonsoo Kim
2016-03-18 14:10                                               ` Vlastimil Babka
2016-03-18 14:10                                                 ` Vlastimil Babka
2016-03-18 14:10                                                 ` Vlastimil Babka
2016-03-18 14:42                                                 ` Lucas Stach
2016-03-18 14:42                                                   ` Lucas Stach
2016-03-18 14:42                                                   ` Lucas Stach
2016-03-18 20:58                                                   ` Vlastimil Babka [this message]
2016-03-18 20:58                                                     ` Vlastimil Babka
2016-03-18 20:58                                                     ` Vlastimil Babka
2016-03-22 14:47                                                     ` Lucas Stach
2016-03-22 14:47                                                       ` Lucas Stach
2016-03-22 14:47                                                       ` Lucas Stach
2016-03-19  7:24                                                 ` Hanjun Guo
2016-03-19  7:24                                                   ` Hanjun Guo
2016-03-19  7:24                                                   ` Hanjun Guo
2016-03-19 22:11                                                   ` Vlastimil Babka
2016-03-19 22:11                                                     ` Vlastimil Babka
2016-03-19 22:11                                                     ` Vlastimil Babka
2016-03-23  4:44                                                 ` Joonsoo Kim
2016-03-23  4:44                                                   ` Joonsoo Kim
2016-03-23  4:44                                                   ` Joonsoo Kim
2016-03-23  8:26                                                   ` Vlastimil Babka
2016-03-23  8:26                                                     ` Vlastimil Babka
2016-03-23  8:26                                                     ` Vlastimil Babka
2016-03-23  8:32                                                     ` Joonsoo Kim
2016-03-23  8:32                                                       ` Joonsoo Kim
2016-03-23  8:32                                                       ` Joonsoo Kim
2016-03-18 12:29                                         ` Vlastimil Babka
2016-03-18 12:29                                           ` Vlastimil Babka
2016-03-18 12:29                                           ` Vlastimil Babka
2016-03-08  4:03                     ` Hanjun Guo
2016-03-08  4:03                       ` Hanjun Guo
2016-03-08  4:03                       ` Hanjun Guo
2016-03-07 12:59                   ` Vlastimil Babka
2016-03-07 12:59                     ` Vlastimil Babka
2016-03-07 12:59                     ` Vlastimil Babka
2016-03-08  7:48                     ` Joonsoo Kim
2016-03-08  7:48                       ` Joonsoo Kim
2016-03-08  7:48                       ` Joonsoo Kim
2016-03-08 10:45                       ` Xishi Qiu
2016-03-08 10:45                         ` Xishi Qiu
2016-03-08 10:45                         ` Xishi Qiu
2016-03-08 15:36                         ` Joonsoo Kim
2016-03-08 15:36                           ` Joonsoo Kim
2016-03-08 15:36                           ` Joonsoo Kim
2016-03-09  2:18                           ` Xishi Qiu
2016-03-09  2:18                             ` Xishi Qiu
2016-03-09  2:18                             ` Xishi Qiu
2016-03-04  5:33         ` Hanjun Guo
2016-03-04  5:33           ` Hanjun Guo
2016-03-04  5:33           ` Hanjun Guo
2016-03-08  1:42           ` Xishi Qiu
2016-03-08  1:42             ` Xishi Qiu
2016-03-08  1:42             ` Xishi Qiu
2016-03-08  8:09             ` Joonsoo Kim
2016-03-08  8:09               ` Joonsoo Kim
2016-03-08  8:09               ` Joonsoo Kim
2016-03-04  6:59         ` Hanjun Guo
2016-03-04  6:59           ` Hanjun Guo
2016-03-04  6:59           ` Hanjun Guo
2016-03-07  4:40           ` Joonsoo Kim
2016-03-07  4:40             ` Joonsoo Kim
2016-03-07  4:40             ` Joonsoo Kim

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=56EC6BFB.2020107@suse.cz \
    --to=vbabka@suse.cz \
    --cc=linux-arm-kernel@lists.infradead.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.