From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mike Rapoport Subject: Re: [PATCH v2 00/21] Refine memblock API Date: Wed, 2 Oct 2019 10:36:06 +0300 Message-ID: <20191002073605.GA30433@linux.ibm.com> References: <20190926160433.GD32311@linux.ibm.com> <20190928073331.GA5269@linux.ibm.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Return-path: DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20170209; h=Sender: Content-Transfer-Encoding:Content-Type:Cc:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:Message-Id:In-Reply-To:MIME-Version: References:Subject:To:From:Date:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=casRdqP01x9OmelJGq/wLtHznnEsibtqG1Uc5xBfFpQ=; b=n2vDlT0oxL/ZQq NrYR4y0qAi/SeNKf3AWYJ+3M776mCh0rteKW+S+evSjspy7t45gvr+8EE9lXvKzp4AOpgvDtxkO5t axLINETZw3yAKvdfPUUnhndBLsTXbSvGaVhYIOBPuY0peCiI20ENsFWF/MMHzNqy8D/j/0FwtbIMD D9zYj2vA8iWLGnJ6XIm1hSdE3GTqtvaiVpFgjAHJhcrST7thbdk8HMKETzGPMXd9P2noM2kjEiSwS slDkI0BwpOgC1mHWUQYsfLH8rU/Ebfinjr66stcbXUmGAuNAemEdSGiYWXpNwMIYZG8WOra5aFtnQ G9oxojoVwrrVQokOc3TQ==; Content-Disposition: inline In-Reply-To: List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-snps-arc" Errors-To: linux-snps-arc-bounces+gla-linux-snps-arc=m.gmane.org@lists.infradead.org To: Adam Ford Cc: Rich Felker , linux-ia64@vger.kernel.org, linux-sh@vger.kernel.org, Catalin Marinas , Heiko Carstens , linux-mips@vger.kernel.org, Max Filippov , devicetree , Guo Ren , sparclinux@vger.kernel.org, Fabio Estevam , Christoph Hellwig , linux-s390@vger.kernel.org, linux-c6x-dev@linux-c6x.org, Yoshinori Sato , Richard Weinberger , x86@kernel.org, Russell King , kasan-dev , Geert Uytterhoeven , Mark Salter , Dennis Zhou , Matt Turner , linux-snps-arc@lists.infradead.org, Chris Healy , uclinux-h8-devel@lists.sourceforge.j Hi Adam, On Tue, Oct 01, 2019 at 07:14:13PM -0500, Adam Ford wrote: > On Sun, Sep 29, 2019 at 8:33 AM Adam Ford wrote: > > > > I am attaching two logs. I now the mailing lists will be unhappy, but > > don't want to try and spam a bunch of log through the mailing liast. > > The two logs show the differences between the working and non-working > > imx6q 3D accelerator when trying to run a simple glmark2-es2-drm demo. > > > > The only change between them is the 2 line code change you suggested. > > > > In both cases, I have cma=128M set in my bootargs. Historically this > > has been sufficient, but cma=256M has not made a difference. > > > > Mike any suggestions on how to move forward? > I was hoping to get the fixes tested and pushed before 5.4 is released > if at all possible I have a fix (below) that kinda restores the original behaviour, but I still would like to double check to make sure it's not a band aid and I haven't missed the actual root cause. Can you please send me your device tree definition and the output of cat /sys/kernel/debug/memblock/memory and cat /sys/kernel/debug/memblock/reserved Thanks! >From 06529f861772b7dea2912fc2245debe4690139b8 Mon Sep 17 00:00:00 2001 From: Mike Rapoport Date: Wed, 2 Oct 2019 10:14:17 +0300 Subject: [PATCH] mm: memblock: do not enforce current limit for memblock_phys* family Until commit 92d12f9544b7 ("memblock: refactor internal allocation functions") the maximal address for memblock allocations was forced to memblock.current_limit only for the allocation functions returning virtual address. The changes introduced by that commit moved the limit enforcement into the allocation core and as a result the allocation functions returning physical address also started to limit allocations to memblock.current_limit. This caused breakage of etnaviv GPU driver: [ 3.682347] etnaviv etnaviv: bound 130000.gpu (ops gpu_ops) [ 3.688669] etnaviv etnaviv: bound 134000.gpu (ops gpu_ops) [ 3.695099] etnaviv etnaviv: bound 2204000.gpu (ops gpu_ops) [ 3.700800] etnaviv-gpu 130000.gpu: model: GC2000, revision: 5108 [ 3.723013] etnaviv-gpu 130000.gpu: command buffer outside valid memory window [ 3.731308] etnaviv-gpu 134000.gpu: model: GC320, revision: 5007 [ 3.752437] etnaviv-gpu 134000.gpu: command buffer outside valid memory window [ 3.760583] etnaviv-gpu 2204000.gpu: model: GC355, revision: 1215 [ 3.766766] etnaviv-gpu 2204000.gpu: Ignoring GPU with VG and FE2.0 Restore the behaviour of memblock_phys* family so that these functions will not enforce memblock.current_limit. Fixes: 92d12f9544b7 ("memblock: refactor internal allocation functions") Reported-by: Adam Ford Signed-off-by: Mike Rapoport --- mm/memblock.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/mm/memblock.c b/mm/memblock.c index 7d4f61a..c4b16ca 100644 --- a/mm/memblock.c +++ b/mm/memblock.c @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, align = SMP_CACHE_BYTES; } - if (end > memblock.current_limit) - end = memblock.current_limit; - again: found = memblock_find_in_range_node(size, align, start, end, nid, flags); @@ -1469,6 +1466,9 @@ static void * __init memblock_alloc_internal( if (WARN_ON_ONCE(slab_is_available())) return kzalloc_node(size, GFP_NOWAIT, nid); + if (max_addr > memblock.current_limit) + max_addr = memblock.current_limit; + alloc = memblock_alloc_range_nid(size, align, min_addr, max_addr, nid); /* retry allocation without lower limit */ -- 2.7.4 > > adam > > > > On Sat, Sep 28, 2019 at 2:33 AM Mike Rapoport wrote: > > > > > > On Thu, Sep 26, 2019 at 02:35:53PM -0500, Adam Ford wrote: > > > > On Thu, Sep 26, 2019 at 11:04 AM Mike Rapoport wrote: > > > > > > > > > > Hi, > > > > > > > > > > On Thu, Sep 26, 2019 at 08:09:52AM -0500, Adam Ford wrote: > > > > > > On Wed, Sep 25, 2019 at 10:17 AM Fabio Estevam wrote: > > > > > > > > > > > > > > On Wed, Sep 25, 2019 at 9:17 AM Adam Ford wrote: > > > > > > > > > > > > > > > I tried cma=256M and noticed the cma dump at the beginning didn't > > > > > > > > change. Do we need to setup a reserved-memory node like > > > > > > > > imx6ul-ccimx6ulsom.dtsi did? > > > > > > > > > > > > > > I don't think so. > > > > > > > > > > > > > > Were you able to identify what was the exact commit that caused such regression? > > > > > > > > > > > > I was able to narrow it down the 92d12f9544b7 ("memblock: refactor > > > > > > internal allocation functions") that caused the regression with > > > > > > Etnaviv. > > > > > > > > > > > > > > > Can you please test with this change: > > > > > > > > > > > > > That appears to have fixed my issue. I am not sure what the impact > > > > is, but is this a safe option? > > > > > > It's not really a fix, I just wanted to see how exactly 92d12f9544b7 ("memblock: > > > refactor internal allocation functions") broke your setup. > > > > > > Can you share the dts you are using and the full kernel log? > > > > > > > adam > > > > > > > > > diff --git a/mm/memblock.c b/mm/memblock.c > > > > > index 7d4f61a..1f5a0eb 100644 > > > > > --- a/mm/memblock.c > > > > > +++ b/mm/memblock.c > > > > > @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, > > > > > align = SMP_CACHE_BYTES; > > > > > } > > > > > > > > > > - if (end > memblock.current_limit) > > > > > - end = memblock.current_limit; > > > > > - > > > > > again: > > > > > found = memblock_find_in_range_node(size, align, start, end, nid, > > > > > flags); > > > > > > > > > > > I also noticed that if I create a reserved memory node as was done one > > > > > > imx6ul-ccimx6ulsom.dtsi the 3D seems to work again, but without it, I > > > > > > was getting errors regardless of the 'cma=256M' or not. > > > > > > I don't have a problem using the reserved memory, but I guess I am not > > > > > > sure what the amount should be. I know for the video decoding 1080p, > > > > > > I have historically used cma=128M, but with the 3D also needing some > > > > > > memory allocation, is that enough or should I use 256M? > > > > > > > > > > > > adam > > > > > > > > > > -- > > > > > Sincerely yours, > > > > > Mike. > > > > > > > > > > > -- > > > Sincerely yours, > > > Mike. > > > -- Sincerely yours, Mike. From mboxrd@z Thu Jan 1 00:00:00 1970 From: rppt@linux.ibm.com (Mike Rapoport) Date: Wed, 2 Oct 2019 10:36:06 +0300 Subject: [PATCH v2 00/21] Refine memblock API In-Reply-To: References: <20190926160433.GD32311@linux.ibm.com> <20190928073331.GA5269@linux.ibm.com> List-ID: Message-ID: <20191002073605.GA30433@linux.ibm.com> To: linux-snps-arc@lists.infradead.org Hi Adam, On Tue, Oct 01, 2019@07:14:13PM -0500, Adam Ford wrote: > On Sun, Sep 29, 2019@8:33 AM Adam Ford wrote: > > > > I am attaching two logs. I now the mailing lists will be unhappy, but > > don't want to try and spam a bunch of log through the mailing liast. > > The two logs show the differences between the working and non-working > > imx6q 3D accelerator when trying to run a simple glmark2-es2-drm demo. > > > > The only change between them is the 2 line code change you suggested. > > > > In both cases, I have cma=128M set in my bootargs. Historically this > > has been sufficient, but cma=256M has not made a difference. > > > > Mike any suggestions on how to move forward? > I was hoping to get the fixes tested and pushed before 5.4 is released > if at all possible I have a fix (below) that kinda restores the original behaviour, but I still would like to double check to make sure it's not a band aid and I haven't missed the actual root cause. Can you please send me your device tree definition and the output of cat /sys/kernel/debug/memblock/memory and cat /sys/kernel/debug/memblock/reserved Thanks! >>From 06529f861772b7dea2912fc2245debe4690139b8 Mon Sep 17 00:00:00 2001 From: Mike Rapoport Date: Wed, 2 Oct 2019 10:14:17 +0300 Subject: [PATCH] mm: memblock: do not enforce current limit for memblock_phys* family Until commit 92d12f9544b7 ("memblock: refactor internal allocation functions") the maximal address for memblock allocations was forced to memblock.current_limit only for the allocation functions returning virtual address. The changes introduced by that commit moved the limit enforcement into the allocation core and as a result the allocation functions returning physical address also started to limit allocations to memblock.current_limit. This caused breakage of etnaviv GPU driver: [ 3.682347] etnaviv etnaviv: bound 130000.gpu (ops gpu_ops) [ 3.688669] etnaviv etnaviv: bound 134000.gpu (ops gpu_ops) [ 3.695099] etnaviv etnaviv: bound 2204000.gpu (ops gpu_ops) [ 3.700800] etnaviv-gpu 130000.gpu: model: GC2000, revision: 5108 [ 3.723013] etnaviv-gpu 130000.gpu: command buffer outside valid memory window [ 3.731308] etnaviv-gpu 134000.gpu: model: GC320, revision: 5007 [ 3.752437] etnaviv-gpu 134000.gpu: command buffer outside valid memory window [ 3.760583] etnaviv-gpu 2204000.gpu: model: GC355, revision: 1215 [ 3.766766] etnaviv-gpu 2204000.gpu: Ignoring GPU with VG and FE2.0 Restore the behaviour of memblock_phys* family so that these functions will not enforce memblock.current_limit. Fixes: 92d12f9544b7 ("memblock: refactor internal allocation functions") Reported-by: Adam Ford Signed-off-by: Mike Rapoport --- mm/memblock.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/mm/memblock.c b/mm/memblock.c index 7d4f61a..c4b16ca 100644 --- a/mm/memblock.c +++ b/mm/memblock.c @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, align = SMP_CACHE_BYTES; } - if (end > memblock.current_limit) - end = memblock.current_limit; - again: found = memblock_find_in_range_node(size, align, start, end, nid, flags); @@ -1469,6 +1466,9 @@ static void * __init memblock_alloc_internal( if (WARN_ON_ONCE(slab_is_available())) return kzalloc_node(size, GFP_NOWAIT, nid); + if (max_addr > memblock.current_limit) + max_addr = memblock.current_limit; + alloc = memblock_alloc_range_nid(size, align, min_addr, max_addr, nid); /* retry allocation without lower limit */ -- 2.7.4 > > adam > > > > On Sat, Sep 28, 2019@2:33 AM Mike Rapoport wrote: > > > > > > On Thu, Sep 26, 2019@02:35:53PM -0500, Adam Ford wrote: > > > > On Thu, Sep 26, 2019@11:04 AM Mike Rapoport wrote: > > > > > > > > > > Hi, > > > > > > > > > > On Thu, Sep 26, 2019@08:09:52AM -0500, Adam Ford wrote: > > > > > > On Wed, Sep 25, 2019@10:17 AM Fabio Estevam wrote: > > > > > > > > > > > > > > On Wed, Sep 25, 2019@9:17 AM Adam Ford wrote: > > > > > > > > > > > > > > > I tried cma=256M and noticed the cma dump at the beginning didn't > > > > > > > > change. Do we need to setup a reserved-memory node like > > > > > > > > imx6ul-ccimx6ulsom.dtsi did? > > > > > > > > > > > > > > I don't think so. > > > > > > > > > > > > > > Were you able to identify what was the exact commit that caused such regression? > > > > > > > > > > > > I was able to narrow it down the 92d12f9544b7 ("memblock: refactor > > > > > > internal allocation functions") that caused the regression with > > > > > > Etnaviv. > > > > > > > > > > > > > > > Can you please test with this change: > > > > > > > > > > > > > That appears to have fixed my issue. I am not sure what the impact > > > > is, but is this a safe option? > > > > > > It's not really a fix, I just wanted to see how exactly 92d12f9544b7 ("memblock: > > > refactor internal allocation functions") broke your setup. > > > > > > Can you share the dts you are using and the full kernel log? > > > > > > > adam > > > > > > > > > diff --git a/mm/memblock.c b/mm/memblock.c > > > > > index 7d4f61a..1f5a0eb 100644 > > > > > --- a/mm/memblock.c > > > > > +++ b/mm/memblock.c > > > > > @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, > > > > > align = SMP_CACHE_BYTES; > > > > > } > > > > > > > > > > - if (end > memblock.current_limit) > > > > > - end = memblock.current_limit; > > > > > - > > > > > again: > > > > > found = memblock_find_in_range_node(size, align, start, end, nid, > > > > > flags); > > > > > > > > > > > I also noticed that if I create a reserved memory node as was done one > > > > > > imx6ul-ccimx6ulsom.dtsi the 3D seems to work again, but without it, I > > > > > > was getting errors regardless of the 'cma=256M' or not. > > > > > > I don't have a problem using the reserved memory, but I guess I am not > > > > > > sure what the amount should be. I know for the video decoding 1080p, > > > > > > I have historically used cma=128M, but with the 3D also needing some > > > > > > memory allocation, is that enough or should I use 256M? > > > > > > > > > > > > adam > > > > > > > > > > -- > > > > > Sincerely yours, > > > > > Mike. > > > > > > > > > > > -- > > > Sincerely yours, > > > Mike. > > > -- Sincerely yours, Mike. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Date: Wed, 2 Oct 2019 10:36:06 +0300 From: Mike Rapoport Subject: Re: [PATCH v2 00/21] Refine memblock API References: <20190926160433.GD32311@linux.ibm.com> <20190928073331.GA5269@linux.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: Message-Id: <20191002073605.GA30433@linux.ibm.com> To: Adam Ford Cc: Fabio Estevam , Rich Felker , linux-ia64@vger.kernel.org, Petr Mladek , linux-sh@vger.kernel.org, Catalin Marinas , Heiko Carstens , Linux Kernel Mailing List , Max Filippov , Guo Ren , Michael Ellerman , sparclinux@vger.kernel.org, Christoph Hellwig , linux-s390@vger.kernel.org, linux-c6x-dev@linux-c6x.org, Yoshinori Sato , Richard Weinberger , x86@kernel.org, Russell King , kasan-dev , Geert Uytterhoeven , Mark Salter , Dennis Zhou , Matt Turner , linux-snps-arc@lists.infradead.org, uclinux-h8-devel@lists.sourceforge.jp, devicetree , linux-xtensa@linux-xtensa.org, linux-um@lists.infradead.org, The etnaviv authors , linux-m68k@lists.linux-m68k.org, Rob Herring , Greentime Hu , xen-devel@lists.xenproject.org, Stafford Horne , Guan Xuetao , arm-soc , Michal Simek , Tony Luck , Linux Memory Management List , Greg Kroah-Hartman , USB list , linux-mips@vger.kernel.org, Paul Burton , Vineet Gupta , linux-alpha@vger.kernel.org, Andrew Morton , linuxppc-dev@lists.ozlabs.org, "David S. Miller" , openrisc@lists.librecores.org, Chris Healy List-ID: Hi Adam, On Tue, Oct 01, 2019 at 07:14:13PM -0500, Adam Ford wrote: > On Sun, Sep 29, 2019 at 8:33 AM Adam Ford wrote: > > > > I am attaching two logs. I now the mailing lists will be unhappy, but > > don't want to try and spam a bunch of log through the mailing liast. > > The two logs show the differences between the working and non-working > > imx6q 3D accelerator when trying to run a simple glmark2-es2-drm demo. > > > > The only change between them is the 2 line code change you suggested. > > > > In both cases, I have cma=128M set in my bootargs. Historically this > > has been sufficient, but cma=256M has not made a difference. > > > > Mike any suggestions on how to move forward? > I was hoping to get the fixes tested and pushed before 5.4 is released > if at all possible I have a fix (below) that kinda restores the original behaviour, but I still would like to double check to make sure it's not a band aid and I haven't missed the actual root cause. Can you please send me your device tree definition and the output of cat /sys/kernel/debug/memblock/memory and cat /sys/kernel/debug/memblock/reserved Thanks! >From 06529f861772b7dea2912fc2245debe4690139b8 Mon Sep 17 00:00:00 2001 From: Mike Rapoport Date: Wed, 2 Oct 2019 10:14:17 +0300 Subject: [PATCH] mm: memblock: do not enforce current limit for memblock_phys* family Until commit 92d12f9544b7 ("memblock: refactor internal allocation functions") the maximal address for memblock allocations was forced to memblock.current_limit only for the allocation functions returning virtual address. The changes introduced by that commit moved the limit enforcement into the allocation core and as a result the allocation functions returning physical address also started to limit allocations to memblock.current_limit. This caused breakage of etnaviv GPU driver: [ 3.682347] etnaviv etnaviv: bound 130000.gpu (ops gpu_ops) [ 3.688669] etnaviv etnaviv: bound 134000.gpu (ops gpu_ops) [ 3.695099] etnaviv etnaviv: bound 2204000.gpu (ops gpu_ops) [ 3.700800] etnaviv-gpu 130000.gpu: model: GC2000, revision: 5108 [ 3.723013] etnaviv-gpu 130000.gpu: command buffer outside valid memory window [ 3.731308] etnaviv-gpu 134000.gpu: model: GC320, revision: 5007 [ 3.752437] etnaviv-gpu 134000.gpu: command buffer outside valid memory window [ 3.760583] etnaviv-gpu 2204000.gpu: model: GC355, revision: 1215 [ 3.766766] etnaviv-gpu 2204000.gpu: Ignoring GPU with VG and FE2.0 Restore the behaviour of memblock_phys* family so that these functions will not enforce memblock.current_limit. Fixes: 92d12f9544b7 ("memblock: refactor internal allocation functions") Reported-by: Adam Ford Signed-off-by: Mike Rapoport --- mm/memblock.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/mm/memblock.c b/mm/memblock.c index 7d4f61a..c4b16ca 100644 --- a/mm/memblock.c +++ b/mm/memblock.c @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, align = SMP_CACHE_BYTES; } - if (end > memblock.current_limit) - end = memblock.current_limit; - again: found = memblock_find_in_range_node(size, align, start, end, nid, flags); @@ -1469,6 +1466,9 @@ static void * __init memblock_alloc_internal( if (WARN_ON_ONCE(slab_is_available())) return kzalloc_node(size, GFP_NOWAIT, nid); + if (max_addr > memblock.current_limit) + max_addr = memblock.current_limit; + alloc = memblock_alloc_range_nid(size, align, min_addr, max_addr, nid); /* retry allocation without lower limit */ -- 2.7.4 > > adam > > > > On Sat, Sep 28, 2019 at 2:33 AM Mike Rapoport wrote: > > > > > > On Thu, Sep 26, 2019 at 02:35:53PM -0500, Adam Ford wrote: > > > > On Thu, Sep 26, 2019 at 11:04 AM Mike Rapoport wrote: > > > > > > > > > > Hi, > > > > > > > > > > On Thu, Sep 26, 2019 at 08:09:52AM -0500, Adam Ford wrote: > > > > > > On Wed, Sep 25, 2019 at 10:17 AM Fabio Estevam wrote: > > > > > > > > > > > > > > On Wed, Sep 25, 2019 at 9:17 AM Adam Ford wrote: > > > > > > > > > > > > > > > I tried cma=256M and noticed the cma dump at the beginning didn't > > > > > > > > change. Do we need to setup a reserved-memory node like > > > > > > > > imx6ul-ccimx6ulsom.dtsi did? > > > > > > > > > > > > > > I don't think so. > > > > > > > > > > > > > > Were you able to identify what was the exact commit that caused such regression? > > > > > > > > > > > > I was able to narrow it down the 92d12f9544b7 ("memblock: refactor > > > > > > internal allocation functions") that caused the regression with > > > > > > Etnaviv. > > > > > > > > > > > > > > > Can you please test with this change: > > > > > > > > > > > > > That appears to have fixed my issue. I am not sure what the impact > > > > is, but is this a safe option? > > > > > > It's not really a fix, I just wanted to see how exactly 92d12f9544b7 ("memblock: > > > refactor internal allocation functions") broke your setup. > > > > > > Can you share the dts you are using and the full kernel log? > > > > > > > adam > > > > > > > > > diff --git a/mm/memblock.c b/mm/memblock.c > > > > > index 7d4f61a..1f5a0eb 100644 > > > > > --- a/mm/memblock.c > > > > > +++ b/mm/memblock.c > > > > > @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, > > > > > align = SMP_CACHE_BYTES; > > > > > } > > > > > > > > > > - if (end > memblock.current_limit) > > > > > - end = memblock.current_limit; > > > > > - > > > > > again: > > > > > found = memblock_find_in_range_node(size, align, start, end, nid, > > > > > flags); > > > > > > > > > > > I also noticed that if I create a reserved memory node as was done one > > > > > > imx6ul-ccimx6ulsom.dtsi the 3D seems to work again, but without it, I > > > > > > was getting errors regardless of the 'cma=256M' or not. > > > > > > I don't have a problem using the reserved memory, but I guess I am not > > > > > > sure what the amount should be. I know for the video decoding 1080p, > > > > > > I have historically used cma=128M, but with the 3D also needing some > > > > > > memory allocation, is that enough or should I use 256M? > > > > > > > > > > > > adam > > > > > > > > > > -- > > > > > Sincerely yours, > > > > > Mike. > > > > > > > > > > > -- > > > Sincerely yours, > > > Mike. > > > -- Sincerely yours, Mike. From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mike Rapoport Date: Wed, 2 Oct 2019 10:36:06 +0300 Subject: [OpenRISC] [PATCH v2 00/21] Refine memblock API In-Reply-To: References: <20190926160433.GD32311@linux.ibm.com> <20190928073331.GA5269@linux.ibm.com> Message-ID: <20191002073605.GA30433@linux.ibm.com> List-Id: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit To: openrisc@lists.librecores.org Hi Adam, On Tue, Oct 01, 2019 at 07:14:13PM -0500, Adam Ford wrote: > On Sun, Sep 29, 2019 at 8:33 AM Adam Ford wrote: > > > > I am attaching two logs. I now the mailing lists will be unhappy, but > > don't want to try and spam a bunch of log through the mailing liast. > > The two logs show the differences between the working and non-working > > imx6q 3D accelerator when trying to run a simple glmark2-es2-drm demo. > > > > The only change between them is the 2 line code change you suggested. > > > > In both cases, I have cma=128M set in my bootargs. Historically this > > has been sufficient, but cma=256M has not made a difference. > > > > Mike any suggestions on how to move forward? > I was hoping to get the fixes tested and pushed before 5.4 is released > if at all possible I have a fix (below) that kinda restores the original behaviour, but I still would like to double check to make sure it's not a band aid and I haven't missed the actual root cause. Can you please send me your device tree definition and the output of cat /sys/kernel/debug/memblock/memory and cat /sys/kernel/debug/memblock/reserved Thanks! >From 06529f861772b7dea2912fc2245debe4690139b8 Mon Sep 17 00:00:00 2001 From: Mike Rapoport Date: Wed, 2 Oct 2019 10:14:17 +0300 Subject: [PATCH] mm: memblock: do not enforce current limit for memblock_phys* family Until commit 92d12f9544b7 ("memblock: refactor internal allocation functions") the maximal address for memblock allocations was forced to memblock.current_limit only for the allocation functions returning virtual address. The changes introduced by that commit moved the limit enforcement into the allocation core and as a result the allocation functions returning physical address also started to limit allocations to memblock.current_limit. This caused breakage of etnaviv GPU driver: [ 3.682347] etnaviv etnaviv: bound 130000.gpu (ops gpu_ops) [ 3.688669] etnaviv etnaviv: bound 134000.gpu (ops gpu_ops) [ 3.695099] etnaviv etnaviv: bound 2204000.gpu (ops gpu_ops) [ 3.700800] etnaviv-gpu 130000.gpu: model: GC2000, revision: 5108 [ 3.723013] etnaviv-gpu 130000.gpu: command buffer outside valid memory window [ 3.731308] etnaviv-gpu 134000.gpu: model: GC320, revision: 5007 [ 3.752437] etnaviv-gpu 134000.gpu: command buffer outside valid memory window [ 3.760583] etnaviv-gpu 2204000.gpu: model: GC355, revision: 1215 [ 3.766766] etnaviv-gpu 2204000.gpu: Ignoring GPU with VG and FE2.0 Restore the behaviour of memblock_phys* family so that these functions will not enforce memblock.current_limit. Fixes: 92d12f9544b7 ("memblock: refactor internal allocation functions") Reported-by: Adam Ford Signed-off-by: Mike Rapoport --- mm/memblock.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/mm/memblock.c b/mm/memblock.c index 7d4f61a..c4b16ca 100644 --- a/mm/memblock.c +++ b/mm/memblock.c @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, align = SMP_CACHE_BYTES; } - if (end > memblock.current_limit) - end = memblock.current_limit; - again: found = memblock_find_in_range_node(size, align, start, end, nid, flags); @@ -1469,6 +1466,9 @@ static void * __init memblock_alloc_internal( if (WARN_ON_ONCE(slab_is_available())) return kzalloc_node(size, GFP_NOWAIT, nid); + if (max_addr > memblock.current_limit) + max_addr = memblock.current_limit; + alloc = memblock_alloc_range_nid(size, align, min_addr, max_addr, nid); /* retry allocation without lower limit */ -- 2.7.4 > > adam > > > > On Sat, Sep 28, 2019 at 2:33 AM Mike Rapoport wrote: > > > > > > On Thu, Sep 26, 2019 at 02:35:53PM -0500, Adam Ford wrote: > > > > On Thu, Sep 26, 2019 at 11:04 AM Mike Rapoport wrote: > > > > > > > > > > Hi, > > > > > > > > > > On Thu, Sep 26, 2019 at 08:09:52AM -0500, Adam Ford wrote: > > > > > > On Wed, Sep 25, 2019 at 10:17 AM Fabio Estevam wrote: > > > > > > > > > > > > > > On Wed, Sep 25, 2019 at 9:17 AM Adam Ford wrote: > > > > > > > > > > > > > > > I tried cma=256M and noticed the cma dump at the beginning didn't > > > > > > > > change. Do we need to setup a reserved-memory node like > > > > > > > > imx6ul-ccimx6ulsom.dtsi did? > > > > > > > > > > > > > > I don't think so. > > > > > > > > > > > > > > Were you able to identify what was the exact commit that caused such regression? > > > > > > > > > > > > I was able to narrow it down the 92d12f9544b7 ("memblock: refactor > > > > > > internal allocation functions") that caused the regression with > > > > > > Etnaviv. > > > > > > > > > > > > > > > Can you please test with this change: > > > > > > > > > > > > > That appears to have fixed my issue. I am not sure what the impact > > > > is, but is this a safe option? > > > > > > It's not really a fix, I just wanted to see how exactly 92d12f9544b7 ("memblock: > > > refactor internal allocation functions") broke your setup. > > > > > > Can you share the dts you are using and the full kernel log? > > > > > > > adam > > > > > > > > > diff --git a/mm/memblock.c b/mm/memblock.c > > > > > index 7d4f61a..1f5a0eb 100644 > > > > > --- a/mm/memblock.c > > > > > +++ b/mm/memblock.c > > > > > @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, > > > > > align = SMP_CACHE_BYTES; > > > > > } > > > > > > > > > > - if (end > memblock.current_limit) > > > > > - end = memblock.current_limit; > > > > > - > > > > > again: > > > > > found = memblock_find_in_range_node(size, align, start, end, nid, > > > > > flags); > > > > > > > > > > > I also noticed that if I create a reserved memory node as was done one > > > > > > imx6ul-ccimx6ulsom.dtsi the 3D seems to work again, but without it, I > > > > > > was getting errors regardless of the 'cma=256M' or not. > > > > > > I don't have a problem using the reserved memory, but I guess I am not > > > > > > sure what the amount should be. I know for the video decoding 1080p, > > > > > > I have historically used cma=128M, but with the 3D also needing some > > > > > > memory allocation, is that enough or should I use 256M? > > > > > > > > > > > > adam > > > > > > > > > > -- > > > > > Sincerely yours, > > > > > Mike. > > > > > > > > > > > -- > > > Sincerely yours, > > > Mike. > > > -- Sincerely yours, Mike. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.3 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS, USER_AGENT_SANE_1 autolearn=unavailable autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D8FEDC352AA for ; Wed, 2 Oct 2019 07:38:33 +0000 (UTC) Received: from lists.ozlabs.org (lists.ozlabs.org [203.11.71.2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 54D32215EA for ; Wed, 2 Oct 2019 07:38:33 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 54D32215EA Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.ibm.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=linuxppc-dev-bounces+linuxppc-dev=archiver.kernel.org@lists.ozlabs.org Received: from bilbo.ozlabs.org (lists.ozlabs.org [IPv6:2401:3900:2:1::3]) by lists.ozlabs.org (Postfix) with ESMTP id 46jp0Q6n4bzDqWs for ; Wed, 2 Oct 2019 17:38:30 +1000 (AEST) Authentication-Results: lists.ozlabs.org; spf=pass (mailfrom) smtp.mailfrom=linux.ibm.com (client-ip=148.163.156.1; helo=mx0a-001b2d01.pphosted.com; envelope-from=rppt@linux.ibm.com; receiver=) Authentication-Results: lists.ozlabs.org; dmarc=none (p=none dis=none) header.from=linux.ibm.com Received: from mx0a-001b2d01.pphosted.com (mx0a-001b2d01.pphosted.com [148.163.156.1]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by lists.ozlabs.org (Postfix) with ESMTPS id 46jny90jrczDqWJ for ; Wed, 2 Oct 2019 17:36:31 +1000 (AEST) Received: from pps.filterd (m0098409.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x927aPC6136354 for ; Wed, 2 Oct 2019 03:36:27 -0400 Received: from e06smtp02.uk.ibm.com (e06smtp02.uk.ibm.com [195.75.94.98]) by mx0a-001b2d01.pphosted.com with ESMTP id 2vckrce4a9-1 (version=TLSv1.2 cipher=AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 02 Oct 2019 03:36:27 -0400 Received: from localhost by e06smtp02.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Wed, 2 Oct 2019 08:36:23 +0100 Received: from b06avi18626390.portsmouth.uk.ibm.com (9.149.26.192) by e06smtp02.uk.ibm.com (192.168.101.132) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; (version=TLSv1/SSLv3 cipher=AES256-GCM-SHA384 bits=256/256) Wed, 2 Oct 2019 08:36:12 +0100 Received: from b06wcsmtp001.portsmouth.uk.ibm.com (b06wcsmtp001.portsmouth.uk.ibm.com [9.149.105.160]) by b06avi18626390.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id x927ZgPA34865576 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 2 Oct 2019 07:35:42 GMT Received: from b06wcsmtp001.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 56E0EA4060; Wed, 2 Oct 2019 07:36:11 +0000 (GMT) Received: from b06wcsmtp001.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id CDD2EA4054; Wed, 2 Oct 2019 07:36:07 +0000 (GMT) Received: from linux.ibm.com (unknown [9.148.8.153]) by b06wcsmtp001.portsmouth.uk.ibm.com (Postfix) with ESMTPS; Wed, 2 Oct 2019 07:36:07 +0000 (GMT) Date: Wed, 2 Oct 2019 10:36:06 +0300 From: Mike Rapoport To: Adam Ford Subject: Re: [PATCH v2 00/21] Refine memblock API References: <20190926160433.GD32311@linux.ibm.com> <20190928073331.GA5269@linux.ibm.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-TM-AS-GCONF: 00 x-cbid: 19100207-0008-0000-0000-0000031D3BD8 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 19100207-0009-0000-0000-00004A3C3DD3 Message-Id: <20191002073605.GA30433@linux.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-10-02_04:, , signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1908290000 definitions=main-1910020071 X-BeenThere: linuxppc-dev@lists.ozlabs.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Linux on PowerPC Developers Mail List List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Rich Felker , linux-ia64@vger.kernel.org, linux-sh@vger.kernel.org, Catalin Marinas , Heiko Carstens , linux-mips@vger.kernel.org, Max Filippov , devicetree , Guo Ren , sparclinux@vger.kernel.org, Fabio Estevam , Christoph Hellwig , linux-s390@vger.kernel.org, linux-c6x-dev@linux-c6x.org, Yoshinori Sato , Richard Weinberger , x86@kernel.org, Russell King , kasan-dev , Geert Uytterhoeven , Mark Salter , Dennis Zhou , Matt Turner , linux-snps-arc@lists.infradead.org, Chris Healy , uclinux-h8-devel@lists.sourceforge.jp, Petr Mladek , linux-xtensa@linux-xtensa.org, linux-alpha@vger.kernel.org, linux-um@lists.infradead.org, The etnaviv authors , linux-m68k@lists.linux-m68k.org, Rob Herring , Greentime Hu , xen-devel@lists.xenproject.org, Stafford Horne , Guan Xuetao , arm-soc , Michal Simek , Tony Luck , Linux Memory Management List , Greg Kroah-Hartman , USB list , Linux Kernel Mailing List , Paul Burton , Vineet Gupta , Andrew Morton , linuxppc-dev@lists.ozlabs.org, "David S. Miller" , openrisc@lists.librecores.org Errors-To: linuxppc-dev-bounces+linuxppc-dev=archiver.kernel.org@lists.ozlabs.org Sender: "Linuxppc-dev" Hi Adam, On Tue, Oct 01, 2019 at 07:14:13PM -0500, Adam Ford wrote: > On Sun, Sep 29, 2019 at 8:33 AM Adam Ford wrote: > > > > I am attaching two logs. I now the mailing lists will be unhappy, but > > don't want to try and spam a bunch of log through the mailing liast. > > The two logs show the differences between the working and non-working > > imx6q 3D accelerator when trying to run a simple glmark2-es2-drm demo. > > > > The only change between them is the 2 line code change you suggested. > > > > In both cases, I have cma=128M set in my bootargs. Historically this > > has been sufficient, but cma=256M has not made a difference. > > > > Mike any suggestions on how to move forward? > I was hoping to get the fixes tested and pushed before 5.4 is released > if at all possible I have a fix (below) that kinda restores the original behaviour, but I still would like to double check to make sure it's not a band aid and I haven't missed the actual root cause. Can you please send me your device tree definition and the output of cat /sys/kernel/debug/memblock/memory and cat /sys/kernel/debug/memblock/reserved Thanks! >From 06529f861772b7dea2912fc2245debe4690139b8 Mon Sep 17 00:00:00 2001 From: Mike Rapoport Date: Wed, 2 Oct 2019 10:14:17 +0300 Subject: [PATCH] mm: memblock: do not enforce current limit for memblock_phys* family Until commit 92d12f9544b7 ("memblock: refactor internal allocation functions") the maximal address for memblock allocations was forced to memblock.current_limit only for the allocation functions returning virtual address. The changes introduced by that commit moved the limit enforcement into the allocation core and as a result the allocation functions returning physical address also started to limit allocations to memblock.current_limit. This caused breakage of etnaviv GPU driver: [ 3.682347] etnaviv etnaviv: bound 130000.gpu (ops gpu_ops) [ 3.688669] etnaviv etnaviv: bound 134000.gpu (ops gpu_ops) [ 3.695099] etnaviv etnaviv: bound 2204000.gpu (ops gpu_ops) [ 3.700800] etnaviv-gpu 130000.gpu: model: GC2000, revision: 5108 [ 3.723013] etnaviv-gpu 130000.gpu: command buffer outside valid memory window [ 3.731308] etnaviv-gpu 134000.gpu: model: GC320, revision: 5007 [ 3.752437] etnaviv-gpu 134000.gpu: command buffer outside valid memory window [ 3.760583] etnaviv-gpu 2204000.gpu: model: GC355, revision: 1215 [ 3.766766] etnaviv-gpu 2204000.gpu: Ignoring GPU with VG and FE2.0 Restore the behaviour of memblock_phys* family so that these functions will not enforce memblock.current_limit. Fixes: 92d12f9544b7 ("memblock: refactor internal allocation functions") Reported-by: Adam Ford Signed-off-by: Mike Rapoport --- mm/memblock.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/mm/memblock.c b/mm/memblock.c index 7d4f61a..c4b16ca 100644 --- a/mm/memblock.c +++ b/mm/memblock.c @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, align = SMP_CACHE_BYTES; } - if (end > memblock.current_limit) - end = memblock.current_limit; - again: found = memblock_find_in_range_node(size, align, start, end, nid, flags); @@ -1469,6 +1466,9 @@ static void * __init memblock_alloc_internal( if (WARN_ON_ONCE(slab_is_available())) return kzalloc_node(size, GFP_NOWAIT, nid); + if (max_addr > memblock.current_limit) + max_addr = memblock.current_limit; + alloc = memblock_alloc_range_nid(size, align, min_addr, max_addr, nid); /* retry allocation without lower limit */ -- 2.7.4 > > adam > > > > On Sat, Sep 28, 2019 at 2:33 AM Mike Rapoport wrote: > > > > > > On Thu, Sep 26, 2019 at 02:35:53PM -0500, Adam Ford wrote: > > > > On Thu, Sep 26, 2019 at 11:04 AM Mike Rapoport wrote: > > > > > > > > > > Hi, > > > > > > > > > > On Thu, Sep 26, 2019 at 08:09:52AM -0500, Adam Ford wrote: > > > > > > On Wed, Sep 25, 2019 at 10:17 AM Fabio Estevam wrote: > > > > > > > > > > > > > > On Wed, Sep 25, 2019 at 9:17 AM Adam Ford wrote: > > > > > > > > > > > > > > > I tried cma=256M and noticed the cma dump at the beginning didn't > > > > > > > > change. Do we need to setup a reserved-memory node like > > > > > > > > imx6ul-ccimx6ulsom.dtsi did? > > > > > > > > > > > > > > I don't think so. > > > > > > > > > > > > > > Were you able to identify what was the exact commit that caused such regression? > > > > > > > > > > > > I was able to narrow it down the 92d12f9544b7 ("memblock: refactor > > > > > > internal allocation functions") that caused the regression with > > > > > > Etnaviv. > > > > > > > > > > > > > > > Can you please test with this change: > > > > > > > > > > > > > That appears to have fixed my issue. I am not sure what the impact > > > > is, but is this a safe option? > > > > > > It's not really a fix, I just wanted to see how exactly 92d12f9544b7 ("memblock: > > > refactor internal allocation functions") broke your setup. > > > > > > Can you share the dts you are using and the full kernel log? > > > > > > > adam > > > > > > > > > diff --git a/mm/memblock.c b/mm/memblock.c > > > > > index 7d4f61a..1f5a0eb 100644 > > > > > --- a/mm/memblock.c > > > > > +++ b/mm/memblock.c > > > > > @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, > > > > > align = SMP_CACHE_BYTES; > > > > > } > > > > > > > > > > - if (end > memblock.current_limit) > > > > > - end = memblock.current_limit; > > > > > - > > > > > again: > > > > > found = memblock_find_in_range_node(size, align, start, end, nid, > > > > > flags); > > > > > > > > > > > I also noticed that if I create a reserved memory node as was done one > > > > > > imx6ul-ccimx6ulsom.dtsi the 3D seems to work again, but without it, I > > > > > > was getting errors regardless of the 'cma=256M' or not. > > > > > > I don't have a problem using the reserved memory, but I guess I am not > > > > > > sure what the amount should be. I know for the video decoding 1080p, > > > > > > I have historically used cma=128M, but with the 3D also needing some > > > > > > memory allocation, is that enough or should I use 256M? > > > > > > > > > > > > adam > > > > > > > > > > -- > > > > > Sincerely yours, > > > > > Mike. > > > > > > > > > > > -- > > > Sincerely yours, > > > Mike. > > > -- Sincerely yours, Mike. From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-8.3 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS, USER_AGENT_SANE_1 autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id BB5A3C352AA for ; Wed, 2 Oct 2019 07:36:51 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 8718B215EA for ; Wed, 2 Oct 2019 07:36:51 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 8718B215EA Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=linux.ibm.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iFZBe-0004HH-LM; Wed, 02 Oct 2019 07:36:38 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iFZBc-0004H3-Id for xen-devel@lists.xenproject.org; Wed, 02 Oct 2019 07:36:36 +0000 X-Inumbo-ID: 5cbc39e6-e4e7-11e9-9711-12813bfff9fa Received: from mx0a-001b2d01.pphosted.com (unknown [148.163.158.5]) by localhost (Halon) with ESMTPS id 5cbc39e6-e4e7-11e9-9711-12813bfff9fa; Wed, 02 Oct 2019 07:36:35 +0000 (UTC) Received: from pps.filterd (m0098421.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.16.0.27/8.16.0.27) with SMTP id x927aW4t026604 for ; Wed, 2 Oct 2019 03:36:35 -0400 Received: from e06smtp02.uk.ibm.com (e06smtp02.uk.ibm.com [195.75.94.98]) by mx0a-001b2d01.pphosted.com with ESMTP id 2vcqdurd8v-1 (version=TLSv1.2 cipher=AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 02 Oct 2019 03:36:34 -0400 Received: from localhost by e06smtp02.uk.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Wed, 2 Oct 2019 08:36:23 +0100 Received: from b06avi18626390.portsmouth.uk.ibm.com (9.149.26.192) by e06smtp02.uk.ibm.com (192.168.101.132) with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted; (version=TLSv1/SSLv3 cipher=AES256-GCM-SHA384 bits=256/256) Wed, 2 Oct 2019 08:36:12 +0100 Received: from b06wcsmtp001.portsmouth.uk.ibm.com (b06wcsmtp001.portsmouth.uk.ibm.com [9.149.105.160]) by b06avi18626390.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id x927ZgPA34865576 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Wed, 2 Oct 2019 07:35:42 GMT Received: from b06wcsmtp001.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 56E0EA4060; Wed, 2 Oct 2019 07:36:11 +0000 (GMT) Received: from b06wcsmtp001.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id CDD2EA4054; Wed, 2 Oct 2019 07:36:07 +0000 (GMT) Received: from linux.ibm.com (unknown [9.148.8.153]) by b06wcsmtp001.portsmouth.uk.ibm.com (Postfix) with ESMTPS; Wed, 2 Oct 2019 07:36:07 +0000 (GMT) Date: Wed, 2 Oct 2019 10:36:06 +0300 From: Mike Rapoport To: Adam Ford References: <20190926160433.GD32311@linux.ibm.com> <20190928073331.GA5269@linux.ibm.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.24 (2015-08-30) X-TM-AS-GCONF: 00 x-cbid: 19100207-0008-0000-0000-0000031D3BD8 X-IBM-AV-DETECTION: SAVI=unused REMOTE=unused XFE=unused x-cbparentid: 19100207-0009-0000-0000-00004A3C3DD3 Message-Id: <20191002073605.GA30433@linux.ibm.com> X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:, , definitions=2019-10-02_04:, , signatures=0 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 malwarescore=0 suspectscore=0 phishscore=0 bulkscore=0 spamscore=0 clxscore=1015 lowpriorityscore=0 mlxscore=0 impostorscore=0 mlxlogscore=999 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.0.1-1908290000 definitions=main-1910020071 Subject: Re: [Xen-devel] [PATCH v2 00/21] Refine memblock API X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Rich Felker , linux-ia64@vger.kernel.org, linux-sh@vger.kernel.org, Catalin Marinas , Heiko Carstens , linux-mips@vger.kernel.org, Max Filippov , devicetree , Guo Ren , sparclinux@vger.kernel.org, Fabio Estevam , Christoph Hellwig , linux-s390@vger.kernel.org, linux-c6x-dev@linux-c6x.org, Yoshinori Sato , Richard Weinberger , x86@kernel.org, Russell King , kasan-dev , Geert Uytterhoeven , Mark Salter , Dennis Zhou , Matt Turner , linux-snps-arc@lists.infradead.org, Chris Healy , uclinux-h8-devel@lists.sourceforge.jp, Petr Mladek , linux-xtensa@linux-xtensa.org, linux-alpha@vger.kernel.org, linux-um@lists.infradead.org, The etnaviv authors , linux-m68k@lists.linux-m68k.org, Rob Herring , Greentime Hu , xen-devel@lists.xenproject.org, Stafford Horne , Guan Xuetao , arm-soc , Michal Simek , Tony Luck , Linux Memory Management List , Greg Kroah-Hartman , USB list , Linux Kernel Mailing List , Paul Burton , Vineet Gupta , Michael Ellerman , Andrew Morton , linuxppc-dev@lists.ozlabs.org, "David S. Miller" , openrisc@lists.librecores.org Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" SGkgQWRhbSwKCk9uIFR1ZSwgT2N0IDAxLCAyMDE5IGF0IDA3OjE0OjEzUE0gLTA1MDAsIEFkYW0g Rm9yZCB3cm90ZToKPiBPbiBTdW4sIFNlcCAyOSwgMjAxOSBhdCA4OjMzIEFNIEFkYW0gRm9yZCA8 YWZvcmQxNzNAZ21haWwuY29tPiB3cm90ZToKPiA+Cj4gPiBJIGFtIGF0dGFjaGluZyB0d28gbG9n cy4gIEkgbm93IHRoZSBtYWlsaW5nIGxpc3RzIHdpbGwgYmUgdW5oYXBweSwgYnV0Cj4gPiAgZG9u J3Qgd2FudCB0byB0cnkgYW5kIHNwYW0gYSBidW5jaCBvZiBsb2cgdGhyb3VnaCB0aGUgbWFpbGlu ZyBsaWFzdC4KPiA+IFRoZSB0d28gbG9ncyBzaG93IHRoZSBkaWZmZXJlbmNlcyBiZXR3ZWVuIHRo ZSB3b3JraW5nIGFuZCBub24td29ya2luZwo+ID4gaW14NnEgM0QgYWNjZWxlcmF0b3Igd2hlbiB0 cnlpbmcgdG8gcnVuIGEgc2ltcGxlIGdsbWFyazItZXMyLWRybSBkZW1vLgo+ID4KPiA+IFRoZSBv bmx5IGNoYW5nZSBiZXR3ZWVuIHRoZW0gaXMgdGhlIDIgbGluZSBjb2RlIGNoYW5nZSB5b3Ugc3Vn Z2VzdGVkLgo+ID4KPiA+IEluIGJvdGggY2FzZXMsIEkgaGF2ZSBjbWE9MTI4TSBzZXQgaW4gbXkg Ym9vdGFyZ3MuICBIaXN0b3JpY2FsbHkgdGhpcwo+ID4gaGFzIGJlZW4gc3VmZmljaWVudCwgYnV0 IGNtYT0yNTZNIGhhcyBub3QgbWFkZSBhIGRpZmZlcmVuY2UuCj4gPgo+IAo+IE1pa2UgYW55IHN1 Z2dlc3Rpb25zIG9uIGhvdyB0byBtb3ZlIGZvcndhcmQ/Cj4gSSB3YXMgaG9waW5nIHRvIGdldCB0 aGUgZml4ZXMgdGVzdGVkIGFuZCBwdXNoZWQgYmVmb3JlIDUuNCBpcyByZWxlYXNlZAo+IGlmIGF0 IGFsbCBwb3NzaWJsZQoKSSBoYXZlIGEgZml4IChiZWxvdykgdGhhdCBraW5kYSByZXN0b3JlcyB0 aGUgb3JpZ2luYWwgYmVoYXZpb3VyLCBidXQgSQpzdGlsbCB3b3VsZCBsaWtlIHRvIGRvdWJsZSBj aGVjayB0byBtYWtlIHN1cmUgaXQncyBub3QgYSBiYW5kIGFpZCBhbmQgSQpoYXZlbid0IG1pc3Nl ZCB0aGUgYWN0dWFsIHJvb3QgY2F1c2UuCgpDYW4geW91IHBsZWFzZSBzZW5kIG1lIHlvdXIgZGV2 aWNlIHRyZWUgZGVmaW5pdGlvbiBhbmQgdGhlIG91dHB1dCBvZiAKCmNhdCAvc3lzL2tlcm5lbC9k ZWJ1Zy9tZW1ibG9jay9tZW1vcnkKCmFuZCAKCmNhdCAvc3lzL2tlcm5lbC9kZWJ1Zy9tZW1ibG9j ay9yZXNlcnZlZAoKVGhhbmtzIQoKRnJvbSAwNjUyOWY4NjE3NzJiN2RlYTI5MTJmYzIyNDVkZWJl NDY5MDEzOWI4IE1vbiBTZXAgMTcgMDA6MDA6MDAgMjAwMQpGcm9tOiBNaWtlIFJhcG9wb3J0IDxy cHB0QGxpbnV4LmlibS5jb20+CkRhdGU6IFdlZCwgMiBPY3QgMjAxOSAxMDoxNDoxNyArMDMwMApT dWJqZWN0OiBbUEFUQ0hdIG1tOiBtZW1ibG9jazogZG8gbm90IGVuZm9yY2UgY3VycmVudCBsaW1p dCBmb3IgbWVtYmxvY2tfcGh5cyoKIGZhbWlseQoKVW50aWwgY29tbWl0IDkyZDEyZjk1NDRiNyAo Im1lbWJsb2NrOiByZWZhY3RvciBpbnRlcm5hbCBhbGxvY2F0aW9uCmZ1bmN0aW9ucyIpIHRoZSBt YXhpbWFsIGFkZHJlc3MgZm9yIG1lbWJsb2NrIGFsbG9jYXRpb25zIHdhcyBmb3JjZWQgdG8KbWVt YmxvY2suY3VycmVudF9saW1pdCBvbmx5IGZvciB0aGUgYWxsb2NhdGlvbiBmdW5jdGlvbnMgcmV0 dXJuaW5nIHZpcnR1YWwKYWRkcmVzcy4gVGhlIGNoYW5nZXMgaW50cm9kdWNlZCBieSB0aGF0IGNv bW1pdCBtb3ZlZCB0aGUgbGltaXQgZW5mb3JjZW1lbnQKaW50byB0aGUgYWxsb2NhdGlvbiBjb3Jl IGFuZCBhcyBhIHJlc3VsdCB0aGUgYWxsb2NhdGlvbiBmdW5jdGlvbnMgcmV0dXJuaW5nCnBoeXNp Y2FsIGFkZHJlc3MgYWxzbyBzdGFydGVkIHRvIGxpbWl0IGFsbG9jYXRpb25zIHRvCm1lbWJsb2Nr LmN1cnJlbnRfbGltaXQuCgpUaGlzIGNhdXNlZCBicmVha2FnZSBvZiBldG5hdml2IEdQVSBkcml2 ZXI6CgpbICAgIDMuNjgyMzQ3XSBldG5hdml2IGV0bmF2aXY6IGJvdW5kIDEzMDAwMC5ncHUgKG9w cyBncHVfb3BzKQpbICAgIDMuNjg4NjY5XSBldG5hdml2IGV0bmF2aXY6IGJvdW5kIDEzNDAwMC5n cHUgKG9wcyBncHVfb3BzKQpbICAgIDMuNjk1MDk5XSBldG5hdml2IGV0bmF2aXY6IGJvdW5kIDIy MDQwMDAuZ3B1IChvcHMgZ3B1X29wcykKWyAgICAzLjcwMDgwMF0gZXRuYXZpdi1ncHUgMTMwMDAw LmdwdTogbW9kZWw6IEdDMjAwMCwgcmV2aXNpb246IDUxMDgKWyAgICAzLjcyMzAxM10gZXRuYXZp di1ncHUgMTMwMDAwLmdwdTogY29tbWFuZCBidWZmZXIgb3V0c2lkZSB2YWxpZAptZW1vcnkgd2lu ZG93ClsgICAgMy43MzEzMDhdIGV0bmF2aXYtZ3B1IDEzNDAwMC5ncHU6IG1vZGVsOiBHQzMyMCwg cmV2aXNpb246IDUwMDcKWyAgICAzLjc1MjQzN10gZXRuYXZpdi1ncHUgMTM0MDAwLmdwdTogY29t bWFuZCBidWZmZXIgb3V0c2lkZSB2YWxpZAptZW1vcnkgd2luZG93ClsgICAgMy43NjA1ODNdIGV0 bmF2aXYtZ3B1IDIyMDQwMDAuZ3B1OiBtb2RlbDogR0MzNTUsIHJldmlzaW9uOiAxMjE1ClsgICAg My43NjY3NjZdIGV0bmF2aXYtZ3B1IDIyMDQwMDAuZ3B1OiBJZ25vcmluZyBHUFUgd2l0aCBWRyBh bmQgRkUyLjAKClJlc3RvcmUgdGhlIGJlaGF2aW91ciBvZiBtZW1ibG9ja19waHlzKiBmYW1pbHkg c28gdGhhdCB0aGVzZSBmdW5jdGlvbnMgd2lsbApub3QgZW5mb3JjZSBtZW1ibG9jay5jdXJyZW50 X2xpbWl0LgoKRml4ZXM6IDkyZDEyZjk1NDRiNyAoIm1lbWJsb2NrOiByZWZhY3RvciBpbnRlcm5h bCBhbGxvY2F0aW9uIGZ1bmN0aW9ucyIpClJlcG9ydGVkLWJ5OiBBZGFtIEZvcmQgPGFmb3JkMTcz QGdtYWlsLmNvbT4KU2lnbmVkLW9mZi1ieTogTWlrZSBSYXBvcG9ydCA8cnBwdEBsaW51eC5pYm0u Y29tPgotLS0KIG1tL21lbWJsb2NrLmMgfCA2ICsrKy0tLQogMSBmaWxlIGNoYW5nZWQsIDMgaW5z ZXJ0aW9ucygrKSwgMyBkZWxldGlvbnMoLSkKCmRpZmYgLS1naXQgYS9tbS9tZW1ibG9jay5jIGIv bW0vbWVtYmxvY2suYwppbmRleCA3ZDRmNjFhLi5jNGIxNmNhIDEwMDY0NAotLS0gYS9tbS9tZW1i bG9jay5jCisrKyBiL21tL21lbWJsb2NrLmMKQEAgLTEzNTYsOSArMTM1Niw2IEBAIHN0YXRpYyBw aHlzX2FkZHJfdCBfX2luaXQgbWVtYmxvY2tfYWxsb2NfcmFuZ2VfbmlkKHBoeXNfYWRkcl90IHNp emUsCiAJCWFsaWduID0gU01QX0NBQ0hFX0JZVEVTOwogCX0KIAotCWlmIChlbmQgPiBtZW1ibG9j ay5jdXJyZW50X2xpbWl0KQotCQllbmQgPSBtZW1ibG9jay5jdXJyZW50X2xpbWl0OwotCiBhZ2Fp bjoKIAlmb3VuZCA9IG1lbWJsb2NrX2ZpbmRfaW5fcmFuZ2Vfbm9kZShzaXplLCBhbGlnbiwgc3Rh cnQsIGVuZCwgbmlkLAogCQkJCQkgICAgZmxhZ3MpOwpAQCAtMTQ2OSw2ICsxNDY2LDkgQEAgc3Rh dGljIHZvaWQgKiBfX2luaXQgbWVtYmxvY2tfYWxsb2NfaW50ZXJuYWwoCiAJaWYgKFdBUk5fT05f T05DRShzbGFiX2lzX2F2YWlsYWJsZSgpKSkKIAkJcmV0dXJuIGt6YWxsb2Nfbm9kZShzaXplLCBH RlBfTk9XQUlULCBuaWQpOwogCisJaWYgKG1heF9hZGRyID4gbWVtYmxvY2suY3VycmVudF9saW1p dCkKKwkJbWF4X2FkZHIgPSBtZW1ibG9jay5jdXJyZW50X2xpbWl0OworCiAJYWxsb2MgPSBtZW1i bG9ja19hbGxvY19yYW5nZV9uaWQoc2l6ZSwgYWxpZ24sIG1pbl9hZGRyLCBtYXhfYWRkciwgbmlk KTsKIAogCS8qIHJldHJ5IGFsbG9jYXRpb24gd2l0aG91dCBsb3dlciBsaW1pdCAqLwotLSAKMi43 LjQKCiAKPiA+IGFkYW0KPiA+Cj4gPiBPbiBTYXQsIFNlcCAyOCwgMjAxOSBhdCAyOjMzIEFNIE1p a2UgUmFwb3BvcnQgPHJwcHRAbGludXguaWJtLmNvbT4gd3JvdGU6Cj4gPiA+Cj4gPiA+IE9uIFRo dSwgU2VwIDI2LCAyMDE5IGF0IDAyOjM1OjUzUE0gLTA1MDAsIEFkYW0gRm9yZCB3cm90ZToKPiA+ ID4gPiBPbiBUaHUsIFNlcCAyNiwgMjAxOSBhdCAxMTowNCBBTSBNaWtlIFJhcG9wb3J0IDxycHB0 QGxpbnV4LmlibS5jb20+IHdyb3RlOgo+ID4gPiA+ID4KPiA+ID4gPiA+IEhpLAo+ID4gPiA+ID4K PiA+ID4gPiA+IE9uIFRodSwgU2VwIDI2LCAyMDE5IGF0IDA4OjA5OjUyQU0gLTA1MDAsIEFkYW0g Rm9yZCB3cm90ZToKPiA+ID4gPiA+ID4gT24gV2VkLCBTZXAgMjUsIDIwMTkgYXQgMTA6MTcgQU0g RmFiaW8gRXN0ZXZhbSA8ZmVzdGV2YW1AZ21haWwuY29tPiB3cm90ZToKPiA+ID4gPiA+ID4gPgo+ ID4gPiA+ID4gPiA+IE9uIFdlZCwgU2VwIDI1LCAyMDE5IGF0IDk6MTcgQU0gQWRhbSBGb3JkIDxh Zm9yZDE3M0BnbWFpbC5jb20+IHdyb3RlOgo+ID4gPiA+ID4gPiA+Cj4gPiA+ID4gPiA+ID4gPiBJ IHRyaWVkIGNtYT0yNTZNIGFuZCBub3RpY2VkIHRoZSBjbWEgZHVtcCBhdCB0aGUgYmVnaW5uaW5n IGRpZG4ndAo+ID4gPiA+ID4gPiA+ID4gY2hhbmdlLiAgRG8gd2UgbmVlZCB0byBzZXR1cCBhIHJl c2VydmVkLW1lbW9yeSBub2RlIGxpa2UKPiA+ID4gPiA+ID4gPiA+IGlteDZ1bC1jY2lteDZ1bHNv bS5kdHNpIGRpZD8KPiA+ID4gPiA+ID4gPgo+ID4gPiA+ID4gPiA+IEkgZG9uJ3QgdGhpbmsgc28u Cj4gPiA+ID4gPiA+ID4KPiA+ID4gPiA+ID4gPiBXZXJlIHlvdSBhYmxlIHRvIGlkZW50aWZ5IHdo YXQgd2FzIHRoZSBleGFjdCBjb21taXQgdGhhdCBjYXVzZWQgc3VjaCByZWdyZXNzaW9uPwo+ID4g PiA+ID4gPgo+ID4gPiA+ID4gPiBJIHdhcyBhYmxlIHRvIG5hcnJvdyBpdCBkb3duIHRoZSA5MmQx MmY5NTQ0YjcgKCJtZW1ibG9jazogcmVmYWN0b3IKPiA+ID4gPiA+ID4gaW50ZXJuYWwgYWxsb2Nh dGlvbiBmdW5jdGlvbnMiKSB0aGF0IGNhdXNlZCB0aGUgcmVncmVzc2lvbiB3aXRoCj4gPiA+ID4g PiA+IEV0bmF2aXYuCj4gPiA+ID4gPgo+ID4gPiA+ID4KPiA+ID4gPiA+IENhbiB5b3UgcGxlYXNl IHRlc3Qgd2l0aCB0aGlzIGNoYW5nZToKPiA+ID4gPiA+Cj4gPiA+ID4KPiA+ID4gPiBUaGF0IGFw cGVhcnMgdG8gaGF2ZSBmaXhlZCBteSBpc3N1ZS4gIEkgYW0gbm90IHN1cmUgd2hhdCB0aGUgaW1w YWN0Cj4gPiA+ID4gaXMsIGJ1dCBpcyB0aGlzIGEgc2FmZSBvcHRpb24/Cj4gPiA+Cj4gPiA+IEl0 J3Mgbm90IHJlYWxseSBhIGZpeCwgSSBqdXN0IHdhbnRlZCB0byBzZWUgaG93IGV4YWN0bHkgOTJk MTJmOTU0NGI3ICgibWVtYmxvY2s6Cj4gPiA+IHJlZmFjdG9yIGludGVybmFsIGFsbG9jYXRpb24g ZnVuY3Rpb25zIikgYnJva2UgeW91ciBzZXR1cC4KPiA+ID4KPiA+ID4gQ2FuIHlvdSBzaGFyZSB0 aGUgZHRzIHlvdSBhcmUgdXNpbmcgYW5kIHRoZSBmdWxsIGtlcm5lbCBsb2c/Cj4gPiA+Cj4gPiA+ ID4gYWRhbQo+ID4gPiA+Cj4gPiA+ID4gPiBkaWZmIC0tZ2l0IGEvbW0vbWVtYmxvY2suYyBiL21t L21lbWJsb2NrLmMKPiA+ID4gPiA+IGluZGV4IDdkNGY2MWEuLjFmNWEwZWIgMTAwNjQ0Cj4gPiA+ ID4gPiAtLS0gYS9tbS9tZW1ibG9jay5jCj4gPiA+ID4gPiArKysgYi9tbS9tZW1ibG9jay5jCj4g PiA+ID4gPiBAQCAtMTM1Niw5ICsxMzU2LDYgQEAgc3RhdGljIHBoeXNfYWRkcl90IF9faW5pdCBt ZW1ibG9ja19hbGxvY19yYW5nZV9uaWQocGh5c19hZGRyX3Qgc2l6ZSwKPiA+ID4gPiA+ICAgICAg ICAgICAgICAgICBhbGlnbiA9IFNNUF9DQUNIRV9CWVRFUzsKPiA+ID4gPiA+ICAgICAgICAgfQo+ ID4gPiA+ID4KPiA+ID4gPiA+IC0gICAgICAgaWYgKGVuZCA+IG1lbWJsb2NrLmN1cnJlbnRfbGlt aXQpCj4gPiA+ID4gPiAtICAgICAgICAgICAgICAgZW5kID0gbWVtYmxvY2suY3VycmVudF9saW1p dDsKPiA+ID4gPiA+IC0KPiA+ID4gPiA+ICBhZ2FpbjoKPiA+ID4gPiA+ICAgICAgICAgZm91bmQg PSBtZW1ibG9ja19maW5kX2luX3JhbmdlX25vZGUoc2l6ZSwgYWxpZ24sIHN0YXJ0LCBlbmQsIG5p ZCwKPiA+ID4gPiA+ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ZmxhZ3MpOwo+ID4gPiA+ID4KPiA+ID4gPiA+ID4gSSBhbHNvIG5vdGljZWQgdGhhdCBpZiBJIGNy ZWF0ZSBhIHJlc2VydmVkIG1lbW9yeSBub2RlIGFzIHdhcyBkb25lIG9uZQo+ID4gPiA+ID4gPiBp bXg2dWwtY2NpbXg2dWxzb20uZHRzaSB0aGUgM0Qgc2VlbXMgdG8gd29yayBhZ2FpbiwgYnV0IHdp dGhvdXQgaXQsIEkKPiA+ID4gPiA+ID4gd2FzIGdldHRpbmcgZXJyb3JzIHJlZ2FyZGxlc3Mgb2Yg dGhlICdjbWE9MjU2TScgb3Igbm90Lgo+ID4gPiA+ID4gPiBJIGRvbid0IGhhdmUgYSBwcm9ibGVt IHVzaW5nIHRoZSByZXNlcnZlZCBtZW1vcnksIGJ1dCBJIGd1ZXNzIEkgYW0gbm90Cj4gPiA+ID4g PiA+IHN1cmUgd2hhdCB0aGUgYW1vdW50IHNob3VsZCBiZS4gIEkga25vdyBmb3IgdGhlIHZpZGVv IGRlY29kaW5nIDEwODBwLAo+ID4gPiA+ID4gPiBJIGhhdmUgaGlzdG9yaWNhbGx5IHVzZWQgY21h PTEyOE0sIGJ1dCB3aXRoIHRoZSAzRCBhbHNvIG5lZWRpbmcgc29tZQo+ID4gPiA+ID4gPiBtZW1v cnkgYWxsb2NhdGlvbiwgaXMgdGhhdCBlbm91Z2ggb3Igc2hvdWxkIEkgdXNlIDI1Nk0/Cj4gPiA+ ID4gPiA+Cj4gPiA+ID4gPiA+IGFkYW0KPiA+ID4gPiA+Cj4gPiA+ID4gPiAtLQo+ID4gPiA+ID4g U2luY2VyZWx5IHlvdXJzLAo+ID4gPiA+ID4gTWlrZS4KPiA+ID4gPiA+Cj4gPiA+Cj4gPiA+IC0t Cj4gPiA+IFNpbmNlcmVseSB5b3VycywKPiA+ID4gTWlrZS4KPiA+ID4KCi0tIApTaW5jZXJlbHkg eW91cnMsCk1pa2UuCgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX18KWGVuLWRldmVsIG1haWxpbmcgbGlzdApYZW4tZGV2ZWxAbGlzdHMueGVucHJvamVjdC5v cmcKaHR0cHM6Ly9saXN0cy54ZW5wcm9qZWN0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3hlbi1kZXZl bA== From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mike Rapoport Subject: Re: [PATCH v2 00/21] Refine memblock API Date: Wed, 2 Oct 2019 10:36:06 +0300 Message-ID: <20191002073605.GA30433@linux.ibm.com> References: <20190926160433.GD32311@linux.ibm.com> <20190928073331.GA5269@linux.ibm.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Return-path: Content-Disposition: inline In-Reply-To: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: "linux-snps-arc" Errors-To: linux-snps-arc-bounces+gla-linux-snps-arc=m.gmane.org@lists.infradead.org To: Adam Ford Cc: Rich Felker , linux-ia64@vger.kernel.org, linux-sh@vger.kernel.org, Catalin Marinas , Heiko Carstens , linux-mips@vger.kernel.org, Max Filippov , devicetree , Guo Ren , sparclinux@vger.kernel.org, Fabio Estevam , Christoph Hellwig , linux-s390@vger.kernel.org, linux-c6x-dev@linux-c6x.org, Yoshinori Sato , Richard Weinberger , x86@kernel.org, Russell King , kasan-dev , Geert Uytterhoeven , Mark Salter , Dennis Zhou , Matt Turner , linux-snps-arc@lists.infradead.org, Chris Healy , uclinux-h8-devel@lists.sourceforge.j List-Id: devicetree@vger.kernel.org Hi Adam, On Tue, Oct 01, 2019 at 07:14:13PM -0500, Adam Ford wrote: > On Sun, Sep 29, 2019 at 8:33 AM Adam Ford wrote: > > > > I am attaching two logs. I now the mailing lists will be unhappy, but > > don't want to try and spam a bunch of log through the mailing liast. > > The two logs show the differences between the working and non-working > > imx6q 3D accelerator when trying to run a simple glmark2-es2-drm demo. > > > > The only change between them is the 2 line code change you suggested. > > > > In both cases, I have cma=128M set in my bootargs. Historically this > > has been sufficient, but cma=256M has not made a difference. > > > > Mike any suggestions on how to move forward? > I was hoping to get the fixes tested and pushed before 5.4 is released > if at all possible I have a fix (below) that kinda restores the original behaviour, but I still would like to double check to make sure it's not a band aid and I haven't missed the actual root cause. Can you please send me your device tree definition and the output of cat /sys/kernel/debug/memblock/memory and cat /sys/kernel/debug/memblock/reserved Thanks! >>From 06529f861772b7dea2912fc2245debe4690139b8 Mon Sep 17 00:00:00 2001 From: Mike Rapoport Date: Wed, 2 Oct 2019 10:14:17 +0300 Subject: [PATCH] mm: memblock: do not enforce current limit for memblock_phys* family Until commit 92d12f9544b7 ("memblock: refactor internal allocation functions") the maximal address for memblock allocations was forced to memblock.current_limit only for the allocation functions returning virtual address. The changes introduced by that commit moved the limit enforcement into the allocation core and as a result the allocation functions returning physical address also started to limit allocations to memblock.current_limit. This caused breakage of etnaviv GPU driver: [ 3.682347] etnaviv etnaviv: bound 130000.gpu (ops gpu_ops) [ 3.688669] etnaviv etnaviv: bound 134000.gpu (ops gpu_ops) [ 3.695099] etnaviv etnaviv: bound 2204000.gpu (ops gpu_ops) [ 3.700800] etnaviv-gpu 130000.gpu: model: GC2000, revision: 5108 [ 3.723013] etnaviv-gpu 130000.gpu: command buffer outside valid memory window [ 3.731308] etnaviv-gpu 134000.gpu: model: GC320, revision: 5007 [ 3.752437] etnaviv-gpu 134000.gpu: command buffer outside valid memory window [ 3.760583] etnaviv-gpu 2204000.gpu: model: GC355, revision: 1215 [ 3.766766] etnaviv-gpu 2204000.gpu: Ignoring GPU with VG and FE2.0 Restore the behaviour of memblock_phys* family so that these functions will not enforce memblock.current_limit. Fixes: 92d12f9544b7 ("memblock: refactor internal allocation functions") Reported-by: Adam Ford Signed-off-by: Mike Rapoport --- mm/memblock.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/mm/memblock.c b/mm/memblock.c index 7d4f61a..c4b16ca 100644 --- a/mm/memblock.c +++ b/mm/memblock.c @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, align = SMP_CACHE_BYTES; } - if (end > memblock.current_limit) - end = memblock.current_limit; - again: found = memblock_find_in_range_node(size, align, start, end, nid, flags); @@ -1469,6 +1466,9 @@ static void * __init memblock_alloc_internal( if (WARN_ON_ONCE(slab_is_available())) return kzalloc_node(size, GFP_NOWAIT, nid); + if (max_addr > memblock.current_limit) + max_addr = memblock.current_limit; + alloc = memblock_alloc_range_nid(size, align, min_addr, max_addr, nid); /* retry allocation without lower limit */ -- 2.7.4 > > adam > > > > On Sat, Sep 28, 2019 at 2:33 AM Mike Rapoport wrote: > > > > > > On Thu, Sep 26, 2019 at 02:35:53PM -0500, Adam Ford wrote: > > > > On Thu, Sep 26, 2019 at 11:04 AM Mike Rapoport wrote: > > > > > > > > > > Hi, > > > > > > > > > > On Thu, Sep 26, 2019 at 08:09:52AM -0500, Adam Ford wrote: > > > > > > On Wed, Sep 25, 2019 at 10:17 AM Fabio Estevam wrote: > > > > > > > > > > > > > > On Wed, Sep 25, 2019 at 9:17 AM Adam Ford wrote: > > > > > > > > > > > > > > > I tried cma=256M and noticed the cma dump at the beginning didn't > > > > > > > > change. Do we need to setup a reserved-memory node like > > > > > > > > imx6ul-ccimx6ulsom.dtsi did? > > > > > > > > > > > > > > I don't think so. > > > > > > > > > > > > > > Were you able to identify what was the exact commit that caused such regression? > > > > > > > > > > > > I was able to narrow it down the 92d12f9544b7 ("memblock: refactor > > > > > > internal allocation functions") that caused the regression with > > > > > > Etnaviv. > > > > > > > > > > > > > > > Can you please test with this change: > > > > > > > > > > > > > That appears to have fixed my issue. I am not sure what the impact > > > > is, but is this a safe option? > > > > > > It's not really a fix, I just wanted to see how exactly 92d12f9544b7 ("memblock: > > > refactor internal allocation functions") broke your setup. > > > > > > Can you share the dts you are using and the full kernel log? > > > > > > > adam > > > > > > > > > diff --git a/mm/memblock.c b/mm/memblock.c > > > > > index 7d4f61a..1f5a0eb 100644 > > > > > --- a/mm/memblock.c > > > > > +++ b/mm/memblock.c > > > > > @@ -1356,9 +1356,6 @@ static phys_addr_t __init memblock_alloc_range_nid(phys_addr_t size, > > > > > align = SMP_CACHE_BYTES; > > > > > } > > > > > > > > > > - if (end > memblock.current_limit) > > > > > - end = memblock.current_limit; > > > > > - > > > > > again: > > > > > found = memblock_find_in_range_node(size, align, start, end, nid, > > > > > flags); > > > > > > > > > > > I also noticed that if I create a reserved memory node as was done one > > > > > > imx6ul-ccimx6ulsom.dtsi the 3D seems to work again, but without it, I > > > > > > was getting errors regardless of the 'cma=256M' or not. > > > > > > I don't have a problem using the reserved memory, but I guess I am not > > > > > > sure what the amount should be. I know for the video decoding 1080p, > > > > > > I have historically used cma=128M, but with the 3D also needing some > > > > > > memory allocation, is that enough or should I use 256M? > > > > > > > > > > > > adam > > > > > > > > > > -- > > > > > Sincerely yours, > > > > > Mike. > > > > > > > > > > > -- > > > Sincerely yours, > > > Mike. > > > -- Sincerely yours, Mike.