All of lore.kernel.org
 help / color / mirror / Atom feed
From: Michal Hocko <mhocko-IBi9RG/b67k@public.gmane.org>
To: Tim Chen <tim.c.chen-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
Cc: Andrew Morton
	<akpm-de/tnXTf+JLsfHDXvbKv3WD2FQJk+8+b@public.gmane.org>,
	Johannes Weiner <hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org>,
	Vladimir Davydov
	<vdavydov.dev-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>,
	Dave Hansen <dave.hansen-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>,
	Ying Huang <ying.huang-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org>,
	linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org,
	cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
Subject: Re: [PATCH v2 1/3] mm: Fix dropped memcg from mem cgroup soft limit tree
Date: Thu, 18 Feb 2021 20:13:05 +0100	[thread overview]
Message-ID: <YC68QRVsCONXscCl@dhcp22.suse.cz> (raw)
In-Reply-To: <c3ffa2cb-cb2c-20b7-d722-c875934992e9-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>

On Thu 18-02-21 10:30:20, Tim Chen wrote:
> 
> 
> On 2/18/21 12:24 AM, Michal Hocko wrote:
> 
> > 
> > I have already acked this patch in the previous version along with Fixes
> > tag. It seems that my review feedback has been completely ignored also
> > for other patches in this series.
> 
> Michal,
> 
> My apology.  Our mail system screwed up and there are some mail missing
> from our mail system that I completely missed your mail.  
> Only saw them now after I looked into the lore.kernel.org.

I see. My apology for suspecting you from ignoring my review.
 
> Responding to your comment:
> 
> >Have you observed this happening in the real life? I do agree that the
> >threshold based updates of the tree is not ideal but the whole soft
> >reclaim code is far from optimal. So why do we care only now? The
> >feature is essentially dead and fine tuning it sounds like a step back
> >to me.
> 
> Yes, I did see the issue mentioned in patch 2 breaking soft limit
> reclaim for cgroup v1.  There are still some of our customers using
> cgroup v1 so we will like to fix this if possible.

It would be great to see more details.

> For patch 3 regarding the uncharge_batch, it
> is more of an observation that we should uncharge in batch of same node
> and not prompted by actual workload.
> Thinking more about this, the worst that could happen
> is we could have some entries in the soft limit tree that overestimate
> the memory used.  The worst that could happen is a soft page reclaim
> on that cgroup.  The overhead from extra memcg event update could
> be more than a soft page reclaim pass.  So let's drop patch 3
> for now.

I would still prefer to handle that in the soft limit reclaim path and
check each memcg for the soft limit reclaim excess before the reclaim.
 
> Let me know if you will like me to resend patch 1 with the fixes tag
> for commit 4e41695356fb ("memory controller: soft limit reclaim on contention")
> and if there are any changes I should make for patch 2.

I will ack and suggest Fixes.

> 
> Thanks.
> 
> Tim

-- 
Michal Hocko
SUSE Labs

WARNING: multiple messages have this Message-ID (diff)
From: Michal Hocko <mhocko@suse.com>
To: Tim Chen <tim.c.chen@linux.intel.com>
Cc: Andrew Morton <akpm@linux-foundation.org>,
	Johannes Weiner <hannes@cmpxchg.org>,
	Vladimir Davydov <vdavydov.dev@gmail.com>,
	Dave Hansen <dave.hansen@intel.com>,
	Ying Huang <ying.huang@intel.com>,
	linux-mm@kvack.org, cgroups@vger.kernel.org,
	linux-kernel@vger.kernel.org
Subject: Re: [PATCH v2 1/3] mm: Fix dropped memcg from mem cgroup soft limit tree
Date: Thu, 18 Feb 2021 20:13:05 +0100	[thread overview]
Message-ID: <YC68QRVsCONXscCl@dhcp22.suse.cz> (raw)
In-Reply-To: <c3ffa2cb-cb2c-20b7-d722-c875934992e9@linux.intel.com>

On Thu 18-02-21 10:30:20, Tim Chen wrote:
> 
> 
> On 2/18/21 12:24 AM, Michal Hocko wrote:
> 
> > 
> > I have already acked this patch in the previous version along with Fixes
> > tag. It seems that my review feedback has been completely ignored also
> > for other patches in this series.
> 
> Michal,
> 
> My apology.  Our mail system screwed up and there are some mail missing
> from our mail system that I completely missed your mail.  
> Only saw them now after I looked into the lore.kernel.org.

I see. My apology for suspecting you from ignoring my review.
 
> Responding to your comment:
> 
> >Have you observed this happening in the real life? I do agree that the
> >threshold based updates of the tree is not ideal but the whole soft
> >reclaim code is far from optimal. So why do we care only now? The
> >feature is essentially dead and fine tuning it sounds like a step back
> >to me.
> 
> Yes, I did see the issue mentioned in patch 2 breaking soft limit
> reclaim for cgroup v1.  There are still some of our customers using
> cgroup v1 so we will like to fix this if possible.

It would be great to see more details.

> For patch 3 regarding the uncharge_batch, it
> is more of an observation that we should uncharge in batch of same node
> and not prompted by actual workload.
> Thinking more about this, the worst that could happen
> is we could have some entries in the soft limit tree that overestimate
> the memory used.  The worst that could happen is a soft page reclaim
> on that cgroup.  The overhead from extra memcg event update could
> be more than a soft page reclaim pass.  So let's drop patch 3
> for now.

I would still prefer to handle that in the soft limit reclaim path and
check each memcg for the soft limit reclaim excess before the reclaim.
 
> Let me know if you will like me to resend patch 1 with the fixes tag
> for commit 4e41695356fb ("memory controller: soft limit reclaim on contention")
> and if there are any changes I should make for patch 2.

I will ack and suggest Fixes.

> 
> Thanks.
> 
> Tim

-- 
Michal Hocko
SUSE Labs


  parent reply	other threads:[~2021-02-18 19:13 UTC|newest]

Thread overview: 64+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-02-17 20:41 [PATCH v2 0/3] Soft limit memory management bug fixes Tim Chen
2021-02-17 20:41 ` Tim Chen
2021-02-17 20:41 ` [PATCH v2 1/3] mm: Fix dropped memcg from mem cgroup soft limit tree Tim Chen
     [not found]   ` <8d35206601ccf0e1fe021d24405b2a0c2f4e052f.1613584277.git.tim.c.chen-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-02-18  8:24     ` Michal Hocko
2021-02-18  8:24       ` Michal Hocko
     [not found]       ` <YC4kV7dkJpxjW+df-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2021-02-18 18:30         ` Tim Chen
2021-02-18 18:30           ` Tim Chen
     [not found]           ` <c3ffa2cb-cb2c-20b7-d722-c875934992e9-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-02-18 19:13             ` Michal Hocko [this message]
2021-02-18 19:13               ` Michal Hocko
     [not found]               ` <YC68QRVsCONXscCl-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2021-02-18 19:51                 ` Tim Chen
2021-02-18 19:51                   ` Tim Chen
2021-02-18 19:13     ` Michal Hocko
2021-02-18 19:13       ` Michal Hocko
     [not found]       ` <YC68Xo9+R2msn/ul-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2021-03-04 17:35         ` Tim Chen
2021-03-04 17:35           ` Tim Chen
     [not found]           ` <72cb8618-73af-ce08-d5d5-30cab30755a3-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-03-05  9:11             ` Michal Hocko
2021-03-05  9:11               ` Michal Hocko
     [not found]               ` <YEH1xF8xm9MCsQ+q-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2021-03-05 19:07                 ` Tim Chen
2021-03-05 19:07                   ` Tim Chen
2021-03-08  8:34                   ` Michal Hocko
2021-02-17 20:41 ` [PATCH v2 2/3] mm: Force update of mem cgroup soft limit tree on usage excess Tim Chen
     [not found]   ` <06f1f92f1f7d4e57c4e20c97f435252c16c60a27.1613584277.git.tim.c.chen-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-02-19  9:11     ` Michal Hocko
2021-02-19  9:11       ` Michal Hocko
     [not found]       ` <YC+ApsntwnlVfCuK-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2021-02-19 18:59         ` Tim Chen
2021-02-19 18:59           ` Tim Chen
     [not found]           ` <884d7559-e118-3773-351d-84c02642ca96-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-02-20 16:23             ` Tim Chen
2021-02-20 16:23               ` Tim Chen
2021-02-22  8:40             ` Michal Hocko
2021-02-22  8:40               ` Michal Hocko
     [not found]               ` <YDNuAIztiGJpLEtw-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2021-02-22 17:41                 ` Tim Chen
2021-02-22 17:41                   ` Tim Chen
     [not found]                   ` <e132f836-b5d5-3776-22d6-669e713983e4-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-02-22 19:09                     ` Michal Hocko
2021-02-22 19:09                       ` Michal Hocko
     [not found]                       ` <YDQBh5th9txxEFUm-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2021-02-22 19:23                         ` Tim Chen
2021-02-22 19:23                           ` Tim Chen
2021-02-22 19:48                         ` Tim Chen
2021-02-22 19:48                           ` Tim Chen
     [not found]                           ` <cf5ca7a1-7965-f307-22e1-e216316904cf-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-02-24 11:53                             ` Michal Hocko
2021-02-24 11:53                               ` Michal Hocko
     [not found]                               ` <YDY+PydRUGQpHNaJ-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2021-02-25 22:48                                 ` Tim Chen
2021-02-25 22:48                                   ` Tim Chen
2021-02-26  8:52                                   ` Michal Hocko
     [not found]                                     ` <YDi2udQqIML6Vdpo-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2021-02-27  0:56                                       ` Tim Chen
2021-02-27  0:56                                         ` Tim Chen
     [not found]                                         ` <781634ee-ffb9-598d-fdb6-0ae6067448b7-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-03-01  7:39                                           ` Michal Hocko
2021-03-01  7:39                                             ` Michal Hocko
2021-02-25 22:25                     ` Tim Chen
2021-02-25 22:25                       ` Tim Chen
2021-03-02  6:25   ` [mm] 4f09feb8bf: vm-scalability.throughput -4.3% regression kernel test robot
2021-03-02  6:25     ` kernel test robot
     [not found] ` <cover.1613584277.git.tim.c.chen-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-02-17 20:41   ` [PATCH v2 3/3] mm: Fix missing mem cgroup soft limit tree updates Tim Chen
2021-02-17 20:41     ` Tim Chen
     [not found]     ` <e269f5df3af1157232b01a9b0dae3edf4880d786.1613584277.git.tim.c.chen-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-02-18  5:56       ` Johannes Weiner
2021-02-18  5:56         ` Johannes Weiner
     [not found]         ` <YC4BcsNFEmW7XeqB-druUgvl0LCNAfugRpC6u6w@public.gmane.org>
2021-02-22 18:38           ` Tim Chen
2021-02-22 18:38             ` Tim Chen
2021-02-23 15:18             ` Johannes Weiner
2021-02-19  9:16       ` Michal Hocko
2021-02-19  9:16         ` Michal Hocko
2021-02-19 19:28         ` Tim Chen
     [not found]           ` <1ecd277e-c236-08e1-f068-3dd65ee0e640-VuQAYsv1563Yd54FQh9/CA@public.gmane.org>
2021-02-22  8:41             ` Michal Hocko
2021-02-22  8:41               ` Michal Hocko
     [not found]               ` <YDNuRFgJPH4bPEbq-2MMpYkNvuYDjFM9bn6wA6Q@public.gmane.org>
2021-02-22 17:45                 ` Tim Chen
2021-02-22 17:45                   ` Tim Chen

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=YC68QRVsCONXscCl@dhcp22.suse.cz \
    --to=mhocko-ibi9rg/b67k@public.gmane.org \
    --cc=akpm-de/tnXTf+JLsfHDXvbKv3WD2FQJk+8+b@public.gmane.org \
    --cc=cgroups-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=dave.hansen-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org \
    --cc=hannes-druUgvl0LCNAfugRpC6u6w@public.gmane.org \
    --cc=linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org \
    --cc=linux-mm-Bw31MaZKKs3YtjvyW6yDsg@public.gmane.org \
    --cc=tim.c.chen-VuQAYsv1563Yd54FQh9/CA@public.gmane.org \
    --cc=vdavydov.dev-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org \
    --cc=ying.huang-ral2JQCrhuEAvxtiuMwx3w@public.gmane.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.