All of lore.kernel.org
 help / color / mirror / Atom feed
From: Minchan Kim <minchan@kernel.org>
To: Vinayak Menon <vinmenon@codeaurora.org>
Cc: akpm@linux-foundation.org, hannes@cmpxchg.org,
	mgorman@techsingularity.net, vbabka@suse.cz, mhocko@suse.com,
	riel@redhat.com, vdavydov.dev@gmail.com,
	anton.vorontsov@linaro.org, shashim@codeaurora.org,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH 1/2 v2] mm: vmscan: do not pass reclaimed slab to vmpressure
Date: Tue, 31 Jan 2017 08:56:42 +0900	[thread overview]
Message-ID: <20170130235642.GB7942@bbox> (raw)
In-Reply-To: <1485504817-3124-1-git-send-email-vinmenon@codeaurora.org>

On Fri, Jan 27, 2017 at 01:43:36PM +0530, Vinayak Menon wrote:
> It is noticed that during a global reclaim the memory
> reclaimed via shrinking the slabs can sometimes result
> in reclaimed pages being greater than the scanned pages
> in shrink_node. When this is passed to vmpressure, the
> unsigned arithmetic results in the pressure value to be
> huge, thus resulting in a critical event being sent to
> root cgroup. While this can be fixed by underflow checks
> in vmpressure, adding reclaimed slab without a corresponding
> increment of nr_scanned results in incorrect vmpressure
> reporting. So do not consider reclaimed slab pages in
> vmpressure calculation.

I belive we could enhance the description better.

problem

VM include nr_reclaimed of slab but not nr_scanned so pressure
calculation can be underflow.

solution

do not consider reclaimed slab pages for vmpressure

why

Freeing a page by slab shrinking depends on each slab's object
population so the cost model(i.e., scan:free) is not fair with
LRU pages. Also, every shrinker doesn't account reclaimed pages.
Lastly, this regression happens since 6b4f7799c6a5

> 
> Signed-off-by: Vinayak Menon <vinmenon@codeaurora.org>
> ---
>  mm/vmscan.c | 10 +++++-----
>  1 file changed, 5 insertions(+), 5 deletions(-)
> 
> diff --git a/mm/vmscan.c b/mm/vmscan.c
> index 947ab6f..37c4486 100644
> --- a/mm/vmscan.c
> +++ b/mm/vmscan.c
> @@ -2594,16 +2594,16 @@ static bool shrink_node(pg_data_t *pgdat, struct scan_control *sc)
>  				    sc->nr_scanned - nr_scanned,
>  				    node_lru_pages);
>  
> -		if (reclaim_state) {
> -			sc->nr_reclaimed += reclaim_state->reclaimed_slab;
> -			reclaim_state->reclaimed_slab = 0;
> -		}
> -
>  		/* Record the subtree's reclaim efficiency */
>  		vmpressure(sc->gfp_mask, sc->target_mem_cgroup, true,
>  			   sc->nr_scanned - nr_scanned,
>  			   sc->nr_reclaimed - nr_reclaimed);
>  

Please add comment about "vmpressure excludes reclaimed pages via slab
because blah blah blah" so upcoming patches doesn't make mistake again.

Thanks!

> +		if (reclaim_state) {
> +			sc->nr_reclaimed += reclaim_state->reclaimed_slab;
> +			reclaim_state->reclaimed_slab = 0;
> +		}
> +
>  		if (sc->nr_reclaimed - nr_reclaimed)
>  			reclaimable = true;
>  
> -- 
> QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a
> member of the Code Aurora Forum, hosted by The Linux Foundation
> 
> --
> To unsubscribe, send a message with 'unsubscribe linux-mm' in
> the body to majordomo@kvack.org.  For more info on Linux MM,
> see: http://www.linux-mm.org/ .
> Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Minchan Kim <minchan@kernel.org>
To: Vinayak Menon <vinmenon@codeaurora.org>
Cc: akpm@linux-foundation.org, hannes@cmpxchg.org,
	mgorman@techsingularity.net, vbabka@suse.cz, mhocko@suse.com,
	riel@redhat.com, vdavydov.dev@gmail.com,
	anton.vorontsov@linaro.org, shashim@codeaurora.org,
	linux-mm@kvack.org, linux-kernel@vger.kernel.org
Subject: Re: [PATCH 1/2 v2] mm: vmscan: do not pass reclaimed slab to vmpressure
Date: Tue, 31 Jan 2017 08:56:42 +0900	[thread overview]
Message-ID: <20170130235642.GB7942@bbox> (raw)
In-Reply-To: <1485504817-3124-1-git-send-email-vinmenon@codeaurora.org>

On Fri, Jan 27, 2017 at 01:43:36PM +0530, Vinayak Menon wrote:
> It is noticed that during a global reclaim the memory
> reclaimed via shrinking the slabs can sometimes result
> in reclaimed pages being greater than the scanned pages
> in shrink_node. When this is passed to vmpressure, the
> unsigned arithmetic results in the pressure value to be
> huge, thus resulting in a critical event being sent to
> root cgroup. While this can be fixed by underflow checks
> in vmpressure, adding reclaimed slab without a corresponding
> increment of nr_scanned results in incorrect vmpressure
> reporting. So do not consider reclaimed slab pages in
> vmpressure calculation.

I belive we could enhance the description better.

problem

VM include nr_reclaimed of slab but not nr_scanned so pressure
calculation can be underflow.

solution

do not consider reclaimed slab pages for vmpressure

why

Freeing a page by slab shrinking depends on each slab's object
population so the cost model(i.e., scan:free) is not fair with
LRU pages. Also, every shrinker doesn't account reclaimed pages.
Lastly, this regression happens since 6b4f7799c6a5

> 
> Signed-off-by: Vinayak Menon <vinmenon@codeaurora.org>
> ---
>  mm/vmscan.c | 10 +++++-----
>  1 file changed, 5 insertions(+), 5 deletions(-)
> 
> diff --git a/mm/vmscan.c b/mm/vmscan.c
> index 947ab6f..37c4486 100644
> --- a/mm/vmscan.c
> +++ b/mm/vmscan.c
> @@ -2594,16 +2594,16 @@ static bool shrink_node(pg_data_t *pgdat, struct scan_control *sc)
>  				    sc->nr_scanned - nr_scanned,
>  				    node_lru_pages);
>  
> -		if (reclaim_state) {
> -			sc->nr_reclaimed += reclaim_state->reclaimed_slab;
> -			reclaim_state->reclaimed_slab = 0;
> -		}
> -
>  		/* Record the subtree's reclaim efficiency */
>  		vmpressure(sc->gfp_mask, sc->target_mem_cgroup, true,
>  			   sc->nr_scanned - nr_scanned,
>  			   sc->nr_reclaimed - nr_reclaimed);
>  

Please add comment about "vmpressure excludes reclaimed pages via slab
because blah blah blah" so upcoming patches doesn't make mistake again.

Thanks!

> +		if (reclaim_state) {
> +			sc->nr_reclaimed += reclaim_state->reclaimed_slab;
> +			reclaim_state->reclaimed_slab = 0;
> +		}
> +
>  		if (sc->nr_reclaimed - nr_reclaimed)
>  			reclaimable = true;
>  
> -- 
> QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a
> member of the Code Aurora Forum, hosted by The Linux Foundation
> 
> --
> To unsubscribe, send a message with 'unsubscribe linux-mm' in
> the body to majordomo@kvack.org.  For more info on Linux MM,
> see: http://www.linux-mm.org/ .
> Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  parent reply	other threads:[~2017-01-30 23:56 UTC|newest]

Thread overview: 36+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2017-01-27  8:13 [PATCH 1/2 v2] mm: vmscan: do not pass reclaimed slab to vmpressure Vinayak Menon
2017-01-27  8:13 ` Vinayak Menon
2017-01-27  8:13 ` [PATCH 2/2] mm: vmpressure: fix sending wrong events on underflow Vinayak Menon
2017-01-27  8:13   ` Vinayak Menon
2017-01-30 23:58   ` Minchan Kim
2017-01-30 23:58     ` Minchan Kim
2017-01-30 23:56 ` Minchan Kim [this message]
2017-01-30 23:56   ` [PATCH 1/2 v2] mm: vmscan: do not pass reclaimed slab to vmpressure Minchan Kim
2017-01-31  7:48   ` vinayak menon
2017-01-31  7:48     ` vinayak menon
2017-01-31  9:02 ` [PATCH 1/2 v3] " Vinayak Menon
2017-01-31  9:02   ` Vinayak Menon
2017-02-01  6:12   ` Minchan Kim
2017-02-01  6:12     ` Minchan Kim
2017-02-02 10:44   ` Michal Hocko
2017-02-02 10:44     ` Michal Hocko
2017-02-02 10:48     ` Michal Hocko
2017-02-02 10:48       ` Michal Hocko
2017-02-02 11:25       ` vinayak menon
2017-02-02 11:25         ` vinayak menon
2017-02-02 11:52         ` Michal Hocko
2017-02-02 11:52           ` Michal Hocko
2017-02-02 15:30           ` vinayak menon
2017-02-02 15:30             ` vinayak menon
2017-02-02 16:01             ` Michal Hocko
2017-02-02 16:01               ` Michal Hocko
2017-02-03  5:26               ` vinayak menon
2017-02-03  5:26                 ` vinayak menon
2017-02-03 14:59                 ` Michal Hocko
2017-02-03 14:59                   ` Michal Hocko
2017-02-06 11:31                   ` vinayak menon
2017-02-06 11:31                     ` vinayak menon
2017-02-02 11:28     ` vinayak menon
2017-02-02 11:28       ` vinayak menon
2017-02-03  6:17     ` Minchan Kim
2017-02-03  6:17       ` Minchan Kim

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20170130235642.GB7942@bbox \
    --to=minchan@kernel.org \
    --cc=akpm@linux-foundation.org \
    --cc=anton.vorontsov@linaro.org \
    --cc=hannes@cmpxchg.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mgorman@techsingularity.net \
    --cc=mhocko@suse.com \
    --cc=riel@redhat.com \
    --cc=shashim@codeaurora.org \
    --cc=vbabka@suse.cz \
    --cc=vdavydov.dev@gmail.com \
    --cc=vinmenon@codeaurora.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.