All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Bruno Prémont" <bonbons-ud5FBsm0p/xEiooADzr8i9i2O/JbrIOy@public.gmane.org>
To: Michal Hocko <mhocko-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org>
Cc: Chris Down <chris-6Bi1550iOqEnzZ6mRAm98g@public.gmane.org>,
	cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org,
	Johannes Weiner <hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org>,
	Vladimir Davydov
	<vdavydov.dev-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
Subject: Re: Memory CG and 5.1 to 5.6 uprade slows backup
Date: Wed, 15 Apr 2020 13:37:28 +0200	[thread overview]
Message-ID: <20200415133728.3f58d46e@hemera.lan.sysophe.eu> (raw)
In-Reply-To: <20200415102442.GE4629-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>

On Wed, 15 Apr 2020 12:24:42 Michal Hocko <mhocko-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org> wrote:
> On Wed 15-04-20 12:17:53, Bruno Prémont wrote:
> [...]
> > > Anyway the following simply tracing patch should give a better clue.
> > > The output will appear in the trace buffer (mount tracefs and read
> > > trace_pipe file).  
> > 
> > This is the output I get on 5.6.4 with simple tar -zc call (max=high+4096):
> >   tar-16943 [000] ....  1098.796955: mem_cgroup_handle_over_high: memcg_nr_pages_over_high:1 penalty_jiffies:200 current:262122 high:262144
> >   tar-16943 [000] ....  1100.876794: mem_cgroup_handle_over_high: memcg_nr_pages_over_high:1 penalty_jiffies:200 current:262122 high:262144
> >   tar-16943 [000] ....  1102.956636: mem_cgroup_handle_over_high: memcg_nr_pages_over_high:1 penalty_jiffies:200 current:262120 high:262144
> >   tar-16943 [000] ....  1105.037388: mem_cgroup_handle_over_high: memcg_nr_pages_over_high:1 penalty_jiffies:200 current:262121 high:262144
> >   tar-16943 [000] ....  1107.117246: mem_cgroup_handle_over_high: memcg_nr_pages_over_high:1 penalty_jiffies:200 current:262122 high:262144  
> 
> OK, that points to the underflow fix.
> 
> > 
> > With 5.7-rc1 it runs just fine, pressure remains zero and no output in trace_pipe or throttling.
> > 
> > So the fixes that went in there do fix it.
> > Now matter of cherry-picking the right ones... e26733e0d0ec and its fixe's fix,
> > maybe some others (will start with those tagged for stable).  
> 
> I have seen Greg picking up this for stable trees so it should show up
> there soon.

Applying just 9b8b17541f13809d06f6f873325305ddbb760e3e which went to
stable-rc for 5.6.5 gets things running fine where.
(e26733e0d0ec seems to have gone in shortly prior to 5.6 release, need
to improve my git-foo to locate commits between tags!)

So yes it's the fix.

Thanks,
Bruno

> Thanks!

WARNING: multiple messages have this Message-ID (diff)
From: "Bruno Prémont" <bonbons@linux-vserver.org>
To: Michal Hocko <mhocko@kernel.org>
Cc: Chris Down <chris@chrisdown.name>,
	cgroups@vger.kernel.org, linux-mm@kvack.org,
	Johannes Weiner <hannes@cmpxchg.org>,
	Vladimir Davydov <vdavydov.dev@gmail.com>
Subject: Re: Memory CG and 5.1 to 5.6 uprade slows backup
Date: Wed, 15 Apr 2020 13:37:28 +0200	[thread overview]
Message-ID: <20200415133728.3f58d46e@hemera.lan.sysophe.eu> (raw)
In-Reply-To: <20200415102442.GE4629@dhcp22.suse.cz>

On Wed, 15 Apr 2020 12:24:42 Michal Hocko <mhocko@kernel.org> wrote:
> On Wed 15-04-20 12:17:53, Bruno Prémont wrote:
> [...]
> > > Anyway the following simply tracing patch should give a better clue.
> > > The output will appear in the trace buffer (mount tracefs and read
> > > trace_pipe file).  
> > 
> > This is the output I get on 5.6.4 with simple tar -zc call (max=high+4096):
> >   tar-16943 [000] ....  1098.796955: mem_cgroup_handle_over_high: memcg_nr_pages_over_high:1 penalty_jiffies:200 current:262122 high:262144
> >   tar-16943 [000] ....  1100.876794: mem_cgroup_handle_over_high: memcg_nr_pages_over_high:1 penalty_jiffies:200 current:262122 high:262144
> >   tar-16943 [000] ....  1102.956636: mem_cgroup_handle_over_high: memcg_nr_pages_over_high:1 penalty_jiffies:200 current:262120 high:262144
> >   tar-16943 [000] ....  1105.037388: mem_cgroup_handle_over_high: memcg_nr_pages_over_high:1 penalty_jiffies:200 current:262121 high:262144
> >   tar-16943 [000] ....  1107.117246: mem_cgroup_handle_over_high: memcg_nr_pages_over_high:1 penalty_jiffies:200 current:262122 high:262144  
> 
> OK, that points to the underflow fix.
> 
> > 
> > With 5.7-rc1 it runs just fine, pressure remains zero and no output in trace_pipe or throttling.
> > 
> > So the fixes that went in there do fix it.
> > Now matter of cherry-picking the right ones... e26733e0d0ec and its fixe's fix,
> > maybe some others (will start with those tagged for stable).  
> 
> I have seen Greg picking up this for stable trees so it should show up
> there soon.

Applying just 9b8b17541f13809d06f6f873325305ddbb760e3e which went to
stable-rc for 5.6.5 gets things running fine where.
(e26733e0d0ec seems to have gone in shortly prior to 5.6 release, need
to improve my git-foo to locate commits between tags!)

So yes it's the fix.

Thanks,
Bruno

> Thanks!


  parent reply	other threads:[~2020-04-15 11:37 UTC|newest]

Thread overview: 35+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-04-09  9:25 Memory CG and 5.1 to 5.6 uprade slows backup Bruno Prémont
2020-04-09  9:25 ` Bruno Prémont
     [not found] ` <20200409112505.2e1fc150-pDZhbqX7CfkoGc32E1+a2S4z1YicLaQ4@public.gmane.org>
2020-04-09  9:46   ` Michal Hocko
2020-04-09  9:46     ` Michal Hocko
     [not found]     ` <20200409094615.GE18386-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2020-04-09 10:17       ` Bruno Prémont
2020-04-09 10:17         ` Bruno Prémont
     [not found]         ` <20200409121733.1a5ba17c-pDZhbqX7CfkoGc32E1+a2S4z1YicLaQ4@public.gmane.org>
2020-04-09 10:34           ` Michal Hocko
2020-04-09 10:34             ` Michal Hocko
     [not found]             ` <20200409103400.GF18386-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2020-04-09 15:09               ` Bruno Prémont
2020-04-09 15:09                 ` Bruno Prémont
     [not found]                 ` <20200409170926.182354c3-pDZhbqX7CfkoGc32E1+a2S4z1YicLaQ4@public.gmane.org>
2020-04-09 15:24                   ` Chris Down
2020-04-09 15:24                     ` Chris Down
     [not found]                     ` <20200409152417.GB1040020-6Bi1550iOqEnzZ6mRAm98g@public.gmane.org>
2020-04-09 15:40                       ` Bruno Prémont
2020-04-09 15:40                         ` Bruno Prémont
     [not found]                         ` <20200409174042.2a3389ba-pDZhbqX7CfkoGc32E1+a2S4z1YicLaQ4@public.gmane.org>
2020-04-09 17:50                           ` Chris Down
2020-04-09 17:50                             ` Chris Down
     [not found]                             ` <20200409175044.GC1040020-6Bi1550iOqEnzZ6mRAm98g@public.gmane.org>
2020-04-09 17:56                               ` Chris Down
2020-04-09 17:56                                 ` Chris Down
2020-04-09 15:25                   ` Michal Hocko
2020-04-09 15:25                     ` Michal Hocko
2020-04-10  7:15                     ` Bruno Prémont
     [not found]                       ` <20200410091525.287062fa-pDZhbqX7CfkoGc32E1+a2S4z1YicLaQ4@public.gmane.org>
2020-04-10  8:43                         ` Bruno Prémont
2020-04-10  8:43                           ` Bruno Prémont
     [not found]                           ` <20200410115010.1d9f6a3f@hemera.lan.sysophe.eu>
     [not found]                             ` <20200414163134.GQ4629@dhcp22.suse.cz>
     [not found]                               ` <20200414163134.GQ4629-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2020-04-15 10:17                                 ` Bruno Prémont
2020-04-15 10:17                                   ` Bruno Prémont
     [not found]                                   ` <20200415121753.3c8d700b-pDZhbqX7CfkoGc32E1+a2S4z1YicLaQ4@public.gmane.org>
2020-04-15 10:24                                     ` Michal Hocko
2020-04-15 10:24                                       ` Michal Hocko
     [not found]                                       ` <20200415102442.GE4629-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2020-04-15 11:37                                         ` Bruno Prémont [this message]
2020-04-15 11:37                                           ` Bruno Prémont
     [not found]                     ` <20200409152540.GP18386-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2020-04-14 15:09                       ` Bruno Prémont
2020-04-14 15:09                         ` Bruno Prémont
2020-04-09 10:50   ` Chris Down
2020-04-09 10:50     ` Chris Down
     [not found]     ` <20200409105048.GA1040020-6Bi1550iOqEnzZ6mRAm98g@public.gmane.org>
2020-04-09 11:58       ` Bruno Prémont
2020-04-09 11:58         ` Bruno Prémont

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20200415133728.3f58d46e@hemera.lan.sysophe.eu \
    --to=bonbons-ud5fbsm0p/xeiooadzr8i9i2o/jbrioy@public.gmane.org \
    --cc=cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=chris-6Bi1550iOqEnzZ6mRAm98g@public.gmane.org \
    --cc=hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org \
    --cc=linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org \
    --cc=mhocko-DgEjT+Ai2ygdnm+yROfE0A@public.gmane.org \
    --cc=vdavydov.dev-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.