Linux Container Development
 help / color / mirror / Atom feed
From: Ric Mason <ric.masonn-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
To: Glauber Costa <glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
Cc: Theodore Ts'o <tytso-3s7WtUTddSA@public.gmane.org>,
	hughd-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org,
	containers-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org,
	Dave Shrinnker <david-FqsqvQoI3Ljby3iVrkZq2A@public.gmane.org>,
	Michal Hocko <mhocko-AlSwsSmVLrQ@public.gmane.org>,
	linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org,
	Al Viro <viro-RmSDqhL/yNMiFSDQTTA3OLVCufUGDwFn@public.gmane.org>,
	Johannes Weiner <hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org>,
	linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	Andrew Morton
	<akpm-de/tnXTf+JLsfHDXvbKv3WD2FQJk+8+b@public.gmane.org>
Subject: Re: [PATCH v2 02/28] vmscan: take at least one pass with shrinkers
Date: Wed, 10 Apr 2013 13:09:42 +0800	[thread overview]
Message-ID: <5164F416.8040903@gmail.com> (raw)
In-Reply-To: <515940E4.8050704-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>

Hi Glauber,
On 04/01/2013 04:10 PM, Glauber Costa wrote:
> Hi Kame,
>
>> Doesn't this break
>>
>> ==
>>                 /*
>>                  * copy the current shrinker scan count into a local variable
>>                  * and zero it so that other concurrent shrinker invocations
>>                  * don't also do this scanning work.
>>                  */
>>                 nr = atomic_long_xchg(&shrinker->nr_in_batch, 0);
>> ==
>>
>> This xchg magic ?
>>
>> Thnks,
>> -Kame
> This is done before the actual reclaim attempt, and all it does is to
> indicate to other concurrent shrinkers that "I've got it", and others
> should not attempt to shrink.
>
> Even before I touch this, this quantity represents the number of
> entities we will try to shrink. Not necessarily we will succeed. What my
> patch does, is to try at least once if the number is too small.
>
> Before it, we will try to shrink 512 objects and succeed at 0 (because
> batch is 1024). After this, we will try to free 512 objects and succeed
> at an undefined quantity between 0 and 512.

Where you get the magic number 512 and 1024? The value of SHRINK_BATCH
is 128.

>
> In both cases, we will zero out nr_in_batch in the shrinker structure to
> notify other shrinkers that we are the ones shrinking.
>
> --
> To unsubscribe, send a message with 'unsubscribe linux-mm' in
> the body to majordomo-Bw31MaZKKs0EbZ0PF+XxCw@public.gmane.org  For more info on Linux MM,
> see: http://www.linux-mm.org/ .
> Don't email: <a href=mailto:"dont-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org"> email-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org </a>

  parent reply	other threads:[~2013-04-10  5:09 UTC|newest]

Thread overview: 87+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <1364548450-28254-1-git-send-email-glommer@parallels.com>
     [not found] ` <1364548450-28254-1-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-03-29  9:13   ` [PATCH v2 01/28] super: fix calculation of shrinkable objects for small numbers Glauber Costa
     [not found]     ` <1364548450-28254-2-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-01  7:16       ` Kamezawa Hiroyuki
2013-03-29  9:13   ` [PATCH v2 02/28] vmscan: take at least one pass with shrinkers Glauber Costa
     [not found]     ` <1364548450-28254-3-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-01  7:26       ` Kamezawa Hiroyuki
     [not found]     ` <515936B5.8070501@jp.fujitsu.com>
     [not found]       ` <515936B5.8070501-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-04-01  8:10         ` Glauber Costa
     [not found]       ` <515940E4.8050704@parallels.com>
     [not found]         ` <515940E4.8050704-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-10  5:09           ` Ric Mason [this message]
     [not found]             ` <5164F416.8040903-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
2013-04-10  7:32               ` Glauber Costa
2013-04-10  9:19               ` Dave Chinner
     [not found]     ` <20130408084202.GA21654@lge.com>
     [not found]       ` <51628412.6050803@parallels.com>
     [not found]         ` <51628412.6050803-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-08  9:01           ` Joonsoo Kim
     [not found]         ` <20130408090131.GB21654@lge.com>
     [not found]           ` <51628877.5000701@parallels.com>
     [not found]             ` <51628877.5000701-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-09  0:55               ` Joonsoo Kim
     [not found]             ` <20130409005547.GC21654@lge.com>
     [not found]               ` <20130409005547.GC21654-Hm3cg6mZ9cc@public.gmane.org>
2013-04-09  1:29                 ` Dave Chinner
2013-04-09  2:05                   ` Joonsoo Kim
     [not found]                   ` <20130409020505.GA4218@lge.com>
     [not found]                     ` <20130409020505.GA4218-Hm3cg6mZ9cc@public.gmane.org>
2013-04-09  7:43                       ` Glauber Costa
2013-04-09 12:30                       ` Dave Chinner
2013-04-10  2:51                         ` Joonsoo Kim
     [not found]                         ` <20130410025115.GA5872@lge.com>
     [not found]                           ` <20130410025115.GA5872-Hm3cg6mZ9cc@public.gmane.org>
2013-04-10  7:30                             ` Glauber Costa
2013-04-10  8:46                             ` Wanpeng Li
     [not found]                           ` <51651518.4010007@parallels.com>
     [not found]                             ` <51651518.4010007-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-10  8:19                               ` Joonsoo Kim
     [not found]                           ` <20130410084606.GA10235@hacker.(null)>
2013-04-10 10:07                             ` Dave Chinner
2013-04-10 14:03                               ` JoonSoo Kim
     [not found]                               ` <CAAmzW4OMyZ=nVbHK_AiifPK5LVxvhOQUXmsD5NGfo33CBjf=eA@mail.gmail.com>
     [not found]                                 ` <CAAmzW4OMyZ=nVbHK_AiifPK5LVxvhOQUXmsD5NGfo33CBjf=eA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2013-04-11  0:41                                   ` Dave Chinner
2013-04-11  7:27                                     ` Wanpeng Li
     [not found]                                     ` <20130411072729.GA3605@hacker.(null)>
2013-04-11  9:25                                       ` Dave Chinner
     [not found]                     ` <5163C6A5.5050307@parallels.com>
     [not found]                       ` <5163C6A5.5050307-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-09  9:08                         ` Joonsoo Kim
2013-03-29  9:13   ` [PATCH v2 03/28] dcache: convert dentry_stat.nr_unused to per-cpu counters Glauber Costa
2013-03-29  9:13   ` [PATCH v2 04/28] dentry: move to per-sb LRU locks Glauber Costa
2013-03-29  9:13   ` [PATCH v2 05/28] dcache: remove dentries from LRU before putting on dispose list Glauber Costa
2013-03-29  9:13   ` [PATCH v2 06/28] mm: new shrinker API Glauber Costa
2013-03-29  9:13   ` [PATCH v2 07/28] shrinker: convert superblock shrinkers to new API Glauber Costa
2013-03-29  9:13   ` [PATCH v2 08/28] list: add a new LRU list type Glauber Costa
2013-03-29  9:13   ` [PATCH v2 09/28] inode: convert inode lru list to generic lru list code Glauber Costa
2013-03-29  9:13   ` [PATCH v2 10/28] dcache: convert to use new lru list infrastructure Glauber Costa
2013-03-29  9:13   ` [PATCH v2 11/28] list_lru: per-node " Glauber Costa
2013-03-29  9:13   ` [PATCH v2 12/28] shrinker: add node awareness Glauber Costa
2013-03-29  9:13   ` [PATCH v2 13/28] fs: convert inode and dentry shrinking to be node aware Glauber Costa
2013-03-29  9:13   ` [PATCH v2 14/28] xfs: convert buftarg LRU to generic code Glauber Costa
2013-03-29  9:13   ` [PATCH v2 15/28] xfs: convert dquot cache lru to list_lru Glauber Costa
2013-03-29  9:13   ` [PATCH v2 16/28] fs: convert fs shrinkers to new scan/count API Glauber Costa
2013-03-29  9:13   ` [PATCH v2 17/28] drivers: convert shrinkers to new count/scan API Glauber Costa
2013-03-29  9:14   ` [PATCH v2 18/28] shrinker: convert remaining shrinkers to " Glauber Costa
2013-03-29  9:14   ` [PATCH v2 19/28] hugepage: convert huge zero page shrinker to new shrinker API Glauber Costa
2013-03-29  9:14   ` [PATCH v2 20/28] shrinker: Kill old ->shrink API Glauber Costa
2013-03-29  9:14   ` [PATCH v2 21/28] vmscan: also shrink slab in memcg pressure Glauber Costa
2013-03-29  9:14   ` [PATCH v2 22/28] memcg,list_lru: duplicate LRUs upon kmemcg creation Glauber Costa
2013-03-29  9:14   ` [PATCH v2 23/28] lru: add an element to a memcg list Glauber Costa
2013-03-29  9:14   ` [PATCH v2 24/28] list_lru: also include memcg lists in counts and scans Glauber Costa
2013-03-29  9:14   ` [PATCH v2 25/28] list_lru: per-memcg walks Glauber Costa
2013-03-29  9:14   ` [PATCH v2 26/28] memcg: per-memcg kmem shrinking Glauber Costa
2013-03-29  9:14   ` [PATCH v2 27/28] list_lru: reclaim proportionaly between memcgs and nodes Glauber Costa
2013-03-29  9:14   ` [PATCH v2 28/28] super: targeted memcg reclaim Glauber Costa
2013-04-01 12:38   ` [PATCH v2 00/28] memcg-aware slab shrinking Serge Hallyn
     [not found] ` <1364548450-28254-23-git-send-email-glommer@parallels.com>
     [not found]   ` <1364548450-28254-23-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-01  8:05     ` [PATCH v2 22/28] memcg, list_lru: duplicate LRUs upon kmemcg creation Kamezawa Hiroyuki
     [not found]       ` <51593FD0.9080502-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-04-01  8:22         ` Glauber Costa
     [not found] ` <1364548450-28254-24-git-send-email-glommer@parallels.com>
     [not found]   ` <1364548450-28254-24-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-01  8:18     ` [PATCH v2 23/28] lru: add an element to a memcg list Kamezawa Hiroyuki
     [not found]   ` <515942D8.1070301@jp.fujitsu.com>
     [not found]     ` <515942D8.1070301-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-04-01  8:29       ` Glauber Costa
     [not found] ` <1364548450-28254-27-git-send-email-glommer@parallels.com>
     [not found]   ` <1364548450-28254-27-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-01  8:31     ` [PATCH v2 26/28] memcg: per-memcg kmem shrinking Kamezawa Hiroyuki
     [not found]   ` <515945E3.9090809@jp.fujitsu.com>
     [not found]     ` <515945E3.9090809-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-04-01  8:48       ` Glauber Costa
     [not found]     ` <515949EB.7020400@parallels.com>
     [not found]       ` <515949EB.7020400-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-01  9:01         ` Kamezawa Hiroyuki
     [not found]           ` <51594CED.4050401-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-04-01  9:14             ` Glauber Costa
2013-04-01  9:35             ` Kamezawa Hiroyuki
     [not found] ` <20130401123843.GC5217@sergelap>
2013-04-01 12:45   ` [PATCH v2 00/28] memcg-aware slab shrinking Glauber Costa
     [not found]   ` <51598168.4050404@parallels.com>
     [not found]     ` <51598168.4050404-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-01 14:12       ` Serge Hallyn
2013-04-02  4:58   ` Dave Chinner
     [not found]   ` <20130402045842.GO6369@dastard>
2013-04-02  7:55     ` Glauber Costa
     [not found] ` <1364548450-28254-6-git-send-email-glommer@parallels.com>
     [not found]   ` <1364548450-28254-6-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-03  6:51     ` [PATCH v2 05/28] dcache: remove dentries from LRU before putting on dispose list Sha Zhengju
     [not found]       ` <CAFj3OHU_o5o_n_kcci1U_=M0tCpYEwy8abRvHKBdp-GoJ-cs3w-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2013-04-03  8:55         ` Glauber Costa
2013-04-04  6:19         ` Dave Chinner
     [not found]       ` <20130404061938.GD12011@dastard>
2013-04-04  6:56         ` Glauber Costa
     [not found] ` <1364548450-28254-22-git-send-email-glommer@parallels.com>
     [not found]   ` <51593B70.6080003@jp.fujitsu.com>
     [not found]     ` <51593B70.6080003-+CUm20s59erQFUHtdCDX3A@public.gmane.org>
2013-04-01  8:51       ` [PATCH v2 21/28] vmscan: also shrink slab in memcg pressure Glauber Costa
     [not found]   ` <1364548450-28254-22-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-01  7:46     ` Kamezawa Hiroyuki
2013-04-03 10:11     ` Sha Zhengju
     [not found]       ` <CAFj3OHXp5K6TSCJq4gmi7Y_RpkmbLzDU3GP8vRMmChexULZjyQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2013-04-03 10:43         ` Glauber Costa
     [not found]       ` <515C07E9.8080307@parallels.com>
     [not found]         ` <515C07E9.8080307-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-04  9:35           ` Sha Zhengju
     [not found]         ` <CAFj3OHWEirUH-xWX4O1NVDXCc6EYtceYy9suUgphEQ3C-35oxQ@mail.gmail.com>
     [not found]           ` <CAFj3OHWEirUH-xWX4O1NVDXCc6EYtceYy9suUgphEQ3C-35oxQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2013-04-05  8:25             ` Glauber Costa
     [not found] ` <1364548450-28254-9-git-send-email-glommer@parallels.com>
2013-04-04 21:53   ` [PATCH v2 08/28] list: add a new LRU list type Greg Thelen
     [not found]   ` <xr93ehepkcje.fsf@gthelen.mtv.corp.google.com>
     [not found]     ` <xr93ehepkcje.fsf-aSPv4SP+Du0KgorLzL7FmE7CuiCeIGUxQQ4Iyu8u01E@public.gmane.org>
2013-04-05  1:20       ` Dave Chinner
     [not found]     ` <20130405012048.GH12011@dastard>
2013-04-05  8:01       ` Glauber Costa
     [not found] ` <1364548450-28254-4-git-send-email-glommer@parallels.com>
2013-04-05  1:09   ` [PATCH v2 03/28] dcache: convert dentry_stat.nr_unused to per-cpu counters Greg Thelen
     [not found]     ` <xr93r4ipkcl0.fsf-aSPv4SP+Du0KgorLzL7FmE7CuiCeIGUxQQ4Iyu8u01E@public.gmane.org>
2013-04-05  1:15       ` Dave Chinner
2013-04-08  9:14         ` Glauber Costa
     [not found]         ` <51628A88.2090002@parallels.com>
     [not found]           ` <51628A88.2090002-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-08 13:18             ` Glauber Costa
2013-04-08 23:26             ` Dave Chinner
2013-04-09  8:02               ` Glauber Costa
     [not found]                 ` <5163CB0D.1040000-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-09 12:47                   ` Dave Chinner
     [not found] ` <1364548450-28254-7-git-send-email-glommer@parallels.com>
2013-04-05  1:09   ` [PATCH v2 06/28] mm: new shrinker API Greg Thelen
     [not found] ` <1364548450-28254-11-git-send-email-glommer@parallels.com>
     [not found]   ` <1364548450-28254-11-git-send-email-glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-08 13:14     ` [PATCH v2 10/28] dcache: convert to use new lru list infrastructure Glauber Costa
     [not found]   ` <5162C2C4.7010807@parallels.com>
     [not found]     ` <5162C2C4.7010807-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org>
2013-04-08 23:28       ` Dave Chinner

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=5164F416.8040903@gmail.com \
    --to=ric.masonn-re5jqeeqqe8avxtiumwx3w@public.gmane.org \
    --cc=akpm-de/tnXTf+JLsfHDXvbKv3WD2FQJk+8+b@public.gmane.org \
    --cc=containers-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org \
    --cc=david-FqsqvQoI3Ljby3iVrkZq2A@public.gmane.org \
    --cc=glommer-bzQdu9zFT3WakBO8gow8eQ@public.gmane.org \
    --cc=hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org \
    --cc=hughd-hpIqsD4AKlfQT0dZR+AlfA@public.gmane.org \
    --cc=linux-fsdevel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org \
    --cc=mhocko-AlSwsSmVLrQ@public.gmane.org \
    --cc=tytso-3s7WtUTddSA@public.gmane.org \
    --cc=viro-RmSDqhL/yNMiFSDQTTA3OLVCufUGDwFn@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox