linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Simon Jeons <simon.jeons@gmail.com>
To: Joonsoo Kim <iamjoonsoo.kim@lge.com>
Cc: Mel Gorman <mgorman@suse.de>, Linux-MM <linux-mm@kvack.org>,
	Jiri Slaby <jslaby@suse.cz>,
	Valdis Kletnieks <Valdis.Kletnieks@vt.edu>,
	Rik van Riel <riel@redhat.com>,
	Zlatko Calusic <zcalusic@bitsync.net>,
	Johannes Weiner <hannes@cmpxchg.org>,
	dormando <dormando@rydia.net>,
	Satoru Moriya <satoru.moriya@hds.com>,
	Michal Hocko <mhocko@suse.cz>,
	LKML <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH 08/10] mm: vmscan: Have kswapd shrink slab only once per priority
Date: Tue, 09 Apr 2013 16:41:36 +0800	[thread overview]
Message-ID: <5163D440.7080105@gmail.com> (raw)
In-Reply-To: <20130409065325.GA4411@lge.com>

Hi Joonsoo,
On 04/09/2013 02:53 PM, Joonsoo Kim wrote:
> Hello, Mel.
> Sorry for too late question.
>
> On Sun, Mar 17, 2013 at 01:04:14PM +0000, Mel Gorman wrote:
>> If kswaps fails to make progress but continues to shrink slab then it'll
>> either discard all of slab or consume CPU uselessly scanning shrinkers.
>> This patch causes kswapd to only call the shrinkers once per priority.
>>
>> Signed-off-by: Mel Gorman <mgorman@suse.de>
>> ---
>>   mm/vmscan.c | 28 +++++++++++++++++++++-------
>>   1 file changed, 21 insertions(+), 7 deletions(-)
>>
>> diff --git a/mm/vmscan.c b/mm/vmscan.c
>> index 7d5a932..84375b2 100644
>> --- a/mm/vmscan.c
>> +++ b/mm/vmscan.c
>> @@ -2661,9 +2661,10 @@ static bool prepare_kswapd_sleep(pg_data_t *pgdat, int order, long remaining,
>>    */
>>   static bool kswapd_shrink_zone(struct zone *zone,
>>   			       struct scan_control *sc,
>> -			       unsigned long lru_pages)
>> +			       unsigned long lru_pages,
>> +			       bool shrinking_slab)
>>   {
>> -	unsigned long nr_slab;
>> +	unsigned long nr_slab = 0;
>>   	struct reclaim_state *reclaim_state = current->reclaim_state;
>>   	struct shrink_control shrink = {
>>   		.gfp_mask = sc->gfp_mask,
>> @@ -2673,9 +2674,15 @@ static bool kswapd_shrink_zone(struct zone *zone,
>>   	sc->nr_to_reclaim = max(SWAP_CLUSTER_MAX, high_wmark_pages(zone));
>>   	shrink_zone(zone, sc);
>>   
>> -	reclaim_state->reclaimed_slab = 0;
>> -	nr_slab = shrink_slab(&shrink, sc->nr_scanned, lru_pages);
>> -	sc->nr_reclaimed += reclaim_state->reclaimed_slab;
>> +	/*
>> +	 * Slabs are shrunk for each zone once per priority or if the zone
>> +	 * being balanced is otherwise unreclaimable
>> +	 */
>> +	if (shrinking_slab || !zone_reclaimable(zone)) {
>> +		reclaim_state->reclaimed_slab = 0;
>> +		nr_slab = shrink_slab(&shrink, sc->nr_scanned, lru_pages);
>> +		sc->nr_reclaimed += reclaim_state->reclaimed_slab;
>> +	}
>>   
>>   	if (nr_slab == 0 && !zone_reclaimable(zone))
>>   		zone->all_unreclaimable = 1;
> Why shrink_slab() is called here?
> I think that outside of zone loop is better place to run shrink_slab(),
> because shrink_slab() is not directly related to a specific zone.

True.

>
> And this is a question not related to this patch.
> Why nr_slab is used here to decide zone->all_unreclaimable?
> nr_slab is not directly related whether a specific zone is reclaimable
> or not, and, moreover, nr_slab is not directly related to number of
> reclaimed pages. It just say some objects in the system are freed.
>
> This question comes from my ignorance, so please enlighten me.

Good question, I also want to know. ;-)

>
> Thanks.
>
>> @@ -2713,6 +2720,7 @@ static unsigned long balance_pgdat(pg_data_t *pgdat, int order,
>>   	int end_zone = 0;	/* Inclusive.  0 = ZONE_DMA */
>>   	unsigned long nr_soft_reclaimed;
>>   	unsigned long nr_soft_scanned;
>> +	bool shrinking_slab = true;
>>   	struct scan_control sc = {
>>   		.gfp_mask = GFP_KERNEL,
>>   		.priority = DEF_PRIORITY,
>> @@ -2861,7 +2869,8 @@ static unsigned long balance_pgdat(pg_data_t *pgdat, int order,
>>   				 * already being scanned that that high
>>   				 * watermark would be met at 100% efficiency.
>>   				 */
>> -				if (kswapd_shrink_zone(zone, &sc, lru_pages))
>> +				if (kswapd_shrink_zone(zone, &sc,
>> +						lru_pages, shrinking_slab))
>>   					raise_priority = false;
>>   
>>   				nr_to_reclaim += sc.nr_to_reclaim;
>> @@ -2900,6 +2909,9 @@ static unsigned long balance_pgdat(pg_data_t *pgdat, int order,
>>   				pfmemalloc_watermark_ok(pgdat))
>>   			wake_up(&pgdat->pfmemalloc_wait);
>>   
>> +		/* Only shrink slab once per priority */
>> +		shrinking_slab = false;
>> +
>>   		/*
>>   		 * Fragmentation may mean that the system cannot be rebalanced
>>   		 * for high-order allocations in all zones. If twice the
>> @@ -2925,8 +2937,10 @@ static unsigned long balance_pgdat(pg_data_t *pgdat, int order,
>>   		 * Raise priority if scanning rate is too low or there was no
>>   		 * progress in reclaiming pages
>>   		 */
>> -		if (raise_priority || !this_reclaimed)
>> +		if (raise_priority || !this_reclaimed) {
>>   			sc.priority--;
>> +			shrinking_slab = true;
>> +		}
>>   	} while (sc.priority >= 1 &&
>>   		 !pgdat_balanced(pgdat, order, *classzone_idx));
>>   
>> -- 
>> 1.8.1.4
>>
>> --
>> To unsubscribe, send a message with 'unsubscribe linux-mm' in
>> the body to majordomo@kvack.org.  For more info on Linux MM,
>> see: http://www.linux-mm.org/ .
>> Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>
> --
> To unsubscribe, send a message with 'unsubscribe linux-mm' in
> the body to majordomo@kvack.org.  For more info on Linux MM,
> see: http://www.linux-mm.org/ .
> Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  reply	other threads:[~2013-04-09  8:41 UTC|newest]

Thread overview: 135+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-03-17 13:04 [RFC PATCH 0/8] Reduce system disruption due to kswapd Mel Gorman
2013-03-17 13:04 ` [PATCH 01/10] mm: vmscan: Limit the number of pages kswapd reclaims at each priority Mel Gorman
2013-03-18 23:53   ` Simon Jeons
2013-03-19  9:55     ` Mel Gorman
2013-03-19 10:16       ` Simon Jeons
2013-03-19 10:59         ` Mel Gorman
2013-03-20 16:18   ` Michal Hocko
2013-03-21  0:52     ` Rik van Riel
2013-03-22  0:08       ` Will Huck
2013-03-21  9:47     ` Mel Gorman
2013-03-21 12:59       ` Michal Hocko
2013-03-21  0:51   ` Rik van Riel
2013-03-21 15:57   ` Johannes Weiner
2013-03-21 16:47     ` Mel Gorman
2013-03-22  0:05     ` Will Huck
2013-03-22  3:52       ` Rik van Riel
2013-03-22  3:56         ` Will Huck
2013-03-22  4:59           ` Will Huck
2013-03-22 13:01             ` Rik van Riel
2013-04-05  0:05               ` Will Huck
2013-04-07  7:32                 ` Will Huck
2013-04-07  7:35                 ` Will Huck
2013-04-11  5:54         ` Will Huck
2013-04-11  5:58         ` Will Huck
2013-04-12  5:46           ` Ric Mason
2013-04-12  9:34             ` Mel Gorman
2013-04-12 13:40               ` Rik van Riel
2013-03-25  9:07   ` Michal Hocko
2013-03-25  9:13     ` Jiri Slaby
2013-03-28 22:31       ` Jiri Slaby
2013-03-29  8:22         ` Michal Hocko
2013-03-30 22:07           ` Jiri Slaby
2013-04-02 11:15             ` Mel Gorman
2013-03-17 13:04 ` [PATCH 02/10] mm: vmscan: Obey proportional scanning requirements for kswapd Mel Gorman
2013-03-17 14:39   ` Andi Kleen
2013-03-17 15:08     ` Mel Gorman
2013-03-21  1:10   ` Rik van Riel
2013-03-21  9:54     ` Mel Gorman
2013-03-21 14:01   ` Michal Hocko
2013-03-21 14:31     ` Mel Gorman
2013-03-21 15:07       ` Michal Hocko
2013-03-21 15:34         ` Mel Gorman
2013-03-22  7:54           ` Michal Hocko
2013-03-22  8:37             ` Mel Gorman
2013-03-22 10:04               ` Michal Hocko
2013-03-22 10:47                 ` Michal Hocko
2013-03-21 16:25   ` Johannes Weiner
2013-03-21 18:02     ` Mel Gorman
2013-03-22 16:53       ` Johannes Weiner
2013-03-22 18:25         ` Mel Gorman
2013-03-22 19:09           ` Johannes Weiner
2013-03-22 19:46             ` Mel Gorman
2013-03-17 13:04 ` [PATCH 03/10] mm: vmscan: Flatten kswapd priority loop Mel Gorman
2013-03-17 14:36   ` Andi Kleen
2013-03-17 15:09     ` Mel Gorman
2013-03-18  7:02   ` Hillf Danton
2013-03-19 10:01     ` Mel Gorman
2013-03-18 23:58   ` Simon Jeons
2013-03-19 10:12     ` Mel Gorman
2013-03-19  3:08   ` Simon Jeons
2013-03-19  8:23     ` Michal Hocko
2013-03-19 10:14     ` Mel Gorman
2013-03-19 10:26       ` Simon Jeons
2013-03-19 11:01         ` Mel Gorman
2013-03-21 14:54   ` Michal Hocko
2013-03-21 15:26     ` Mel Gorman
2013-03-21 15:38       ` Michal Hocko
2013-03-17 13:04 ` [PATCH 04/10] mm: vmscan: Decide whether to compact the pgdat based on reclaim progress Mel Gorman
2013-03-18 11:11   ` Wanpeng Li
2013-03-19 10:19     ` Mel Gorman
2013-03-18 11:11   ` Wanpeng Li
2013-03-18 11:35   ` Hillf Danton
2013-03-19 10:27     ` Mel Gorman
2013-03-21 15:32   ` Michal Hocko
2013-03-21 15:47     ` Mel Gorman
2013-03-21 15:50       ` Michal Hocko
2013-03-17 13:04 ` [PATCH 05/10] mm: vmscan: Do not allow kswapd to scan at maximum priority Mel Gorman
2013-03-21  1:20   ` Rik van Riel
2013-03-21 10:12     ` Mel Gorman
2013-03-21 12:30       ` Rik van Riel
2013-03-21 15:48   ` Michal Hocko
2013-03-17 13:04 ` [PATCH 06/10] mm: vmscan: Have kswapd writeback pages based on dirty pages encountered, not priority Mel Gorman
2013-03-17 14:42   ` Andi Kleen
2013-03-17 15:11     ` Mel Gorman
2013-03-21 17:53       ` Rik van Riel
2013-03-21 18:15         ` Mel Gorman
2013-03-21 18:21           ` Rik van Riel
2013-03-18 11:08   ` Wanpeng Li
2013-03-18 11:08   ` Wanpeng Li
2013-03-19 10:35     ` Mel Gorman
2013-03-17 13:04 ` [PATCH 07/10] mm: vmscan: Block kswapd if it is encountering pages under writeback Mel Gorman
2013-03-17 14:49   ` Andi Kleen
2013-03-17 15:19     ` Mel Gorman
2013-03-17 15:40       ` Andi Kleen
2013-03-19 11:06         ` Mel Gorman
2013-03-18 11:37   ` Simon Jeons
2013-03-19 10:57     ` Mel Gorman
2013-03-18 11:58   ` Wanpeng Li
2013-03-19 10:58     ` Mel Gorman
2013-03-18 11:58   ` Wanpeng Li
2013-03-21 16:32   ` [PATCH 07/10 -v2r1] " Michal Hocko
2013-03-21 18:42   ` [PATCH 07/10] " Rik van Riel
2013-03-22  8:27     ` Mel Gorman
2013-03-17 13:04 ` [PATCH 08/10] mm: vmscan: Have kswapd shrink slab only once per priority Mel Gorman
2013-03-17 14:53   ` Andi Kleen
2013-03-21 16:47   ` Michal Hocko
2013-03-21 19:47   ` Rik van Riel
2013-04-09  6:53   ` Joonsoo Kim
2013-04-09  8:41     ` Simon Jeons [this message]
2013-04-09 11:13     ` Mel Gorman
2013-04-10  1:07       ` Dave Chinner
2013-04-10  5:23         ` Joonsoo Kim
2013-04-11  9:53         ` Mel Gorman
2013-04-10  5:21       ` Joonsoo Kim
2013-04-11 10:01         ` Mel Gorman
2013-04-11 10:29           ` Ric Mason
2013-03-17 13:04 ` [PATCH 09/10] mm: vmscan: Check if kswapd should writepage " Mel Gorman
2013-03-21 16:58   ` Michal Hocko
2013-03-21 18:07     ` Mel Gorman
2013-03-21 19:52   ` Rik van Riel
2013-03-17 13:04 ` [PATCH 10/10] mm: vmscan: Move logic from balance_pgdat() to kswapd_shrink_zone() Mel Gorman
2013-03-17 14:55   ` Andi Kleen
2013-03-17 15:25     ` Mel Gorman
2013-03-21 17:18   ` Michal Hocko
2013-03-21 18:13     ` Mel Gorman
2013-03-21 10:44 ` [RFC PATCH 0/8] Reduce system disruption due to kswapd Damien Wyart
2013-03-21 10:54   ` Zlatko Calusic
2013-03-21 11:48     ` Mel Gorman
2013-03-21 11:20   ` Mel Gorman
2013-03-22 14:37 ` Mel Gorman
2013-03-24 19:00 ` Jiri Slaby
2013-03-25  8:17   ` Michal Hocko
  -- strict thread matches above, loose matches on Subject: below --
2013-04-09 11:06 [PATCH 0/10] Reduce system disruption due to kswapd V2 Mel Gorman
2013-04-09 11:07 ` [PATCH 08/10] mm: vmscan: Have kswapd shrink slab only once per priority Mel Gorman
2013-04-11 19:57 [PATCH 0/10] Reduce system disruption due to kswapd V3 Mel Gorman
2013-04-11 19:57 ` [PATCH 08/10] mm: vmscan: Have kswapd shrink slab only once per priority Mel Gorman
2013-04-18 16:43   ` Johannes Weiner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=5163D440.7080105@gmail.com \
    --to=simon.jeons@gmail.com \
    --cc=Valdis.Kletnieks@vt.edu \
    --cc=dormando@rydia.net \
    --cc=hannes@cmpxchg.org \
    --cc=iamjoonsoo.kim@lge.com \
    --cc=jslaby@suse.cz \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mgorman@suse.de \
    --cc=mhocko@suse.cz \
    --cc=riel@redhat.com \
    --cc=satoru.moriya@hds.com \
    --cc=zcalusic@bitsync.net \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).