From: Michal Hocko <mhocko@suse.com>
To: Kent Overstreet <kent.overstreet@linux.dev>,
Andrew Morton <akpm@linux-foundation.org>
Cc: Roman Gushchin <roman.gushchin@linux.dev>,
Qi Zheng <zhengqi.arch@bytedance.com>,
Muchun Song <muchun.song@linux.dev>,
Linux-MM <linux-mm@kvack.org>,
"linux-kernel@vger.kernel.org Dave Chinner" <david@fromorbit.com>
Subject: Re: [PATCH 2/7] mm: shrinker: Add a .to_text() method for shrinkers
Date: Tue, 5 Dec 2023 09:49:15 +0100 [thread overview]
Message-ID: <ZW7kC_un5bfQ9uTI@tiehlicka> (raw)
In-Reply-To: <20231204181553.tyxeq7zy54cuc3o7@moria.home.lan>
On Mon 04-12-23 13:15:53, Kent Overstreet wrote:
> On Mon, Dec 04, 2023 at 11:33:12AM +0100, Michal Hocko wrote:
> > On Fri 01-12-23 16:25:06, Kent Overstreet wrote:
> > > On Fri, Dec 01, 2023 at 11:04:23AM +0100, Michal Hocko wrote:
> > > > On Thu 30-11-23 20:47:45, Kent Overstreet wrote:
> > > > > On Thu, Nov 30, 2023 at 09:14:35AM +0100, Michal Hocko wrote:
> > > > [...]
> > > > > > All that being said, I am with you on the fact that the oom report in
> > > > > > its current form could see improvements.
> > > > >
> > > > > I'm glad we're finally in agreement on something!
> > > > >
> > > > > If you want to share your own ideas on what could be improved and what
> > > > > you find useful, maybe we could find some more common ground.
> > > >
> > > > One thing that I would consider an improvement is to have a way to
> > > > subscribe drivers with excessive memory consumption or those which are
> > > > struggling to dump their state.
> > >
> > > Remember the memory allocation profiling patchset? The one where you
> > > kept complaining about "maintenancy overhead"?
> >
> > Yes, I still maintain my opinion on that approach. I have never
> > questioned usefulness of the information.
> >
> > > We can plug that into the show_mem report too, and list the top 10
> > > allocations by file and line number.
> > >
> > > > Maybe your proposal can be extended that way but the crucial point is to
> > > > not dump all sorts of random shrinkers' state and end up with unwieldy
> > > > reports. If, on the other hand, any particular shrinker struggles to
> > > > reclaim memory and it is sitting on a lot of memory it could be able to
> > > > flag itself to be involved in the dump.
> > >
> > > Great, since as was mentioned in the original commit message it's not
> > > "all sorts of random shrinkers", but top 10 by objects reported, what
> > > I've got here should make you happy.
> >
> > Can we do better and make that a shrinker decision rather than an
> > arbitrary top N selection? The thing is that shrinkers might even not
> > matter in many cases so their output would be just a balast. The number
> > of objects is not universaly great choice. As Dave mentioned metdata
> > might be pinning other objects.
> >
> > That being said, if you want to give more debugability power to
> > shrinkers then it makes more sense to allow them to opt-in for the oom
> > report rather than control which of them to involve from the oom
> > reporting code which doesn't have enough context on its own.
>
> If you've got an idea for a refinement, please submit your own patch and
> I'll look at incorporating it into the series.
OK, noted. Let me just remind you that /me as a reviewer have pointed
out several shortcomings of your proposed solution. From my POV this is
not something we should merge in its current form.
I am not going to comment further in this email thread as it seems you
are not interested in the review feedback and I have better things to do
than talking to /dev/null. This is not the first time you act like that
and I really do recommend you to think about your attitude and
communication style.
Good luck!
--
Michal Hocko
SUSE Labs
next prev parent reply other threads:[~2023-12-05 8:49 UTC|newest]
Thread overview: 47+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-11-22 23:25 [PATCH 0/7] shrinker debugging improvements Kent Overstreet
2023-11-22 23:25 ` [PATCH 1/7] seq_buf: seq_buf_human_readable_u64() Kent Overstreet
2023-11-22 23:25 ` [PATCH 2/7] mm: shrinker: Add a .to_text() method for shrinkers Kent Overstreet
[not found] ` <deed9bb1-02b9-4e89-895b-38a84e5a9408@gmail.com>
2023-11-23 21:24 ` Kent Overstreet
2023-11-24 3:08 ` Qi Zheng
2023-11-25 0:30 ` Kent Overstreet
2023-11-28 3:27 ` Muchun Song
2023-11-28 3:53 ` Kent Overstreet
2023-11-28 6:23 ` Qi Zheng
2023-11-29 0:34 ` Roman Gushchin
2023-11-29 9:14 ` Michal Hocko
2023-11-29 23:11 ` Kent Overstreet
2023-11-30 3:09 ` Qi Zheng
2023-11-30 3:21 ` Kent Overstreet
2023-11-30 3:42 ` Qi Zheng
2023-11-30 4:14 ` Kent Overstreet
2023-11-30 19:01 ` Roman Gushchin
2023-12-01 0:00 ` Kent Overstreet
2023-12-01 1:18 ` Dave Chinner
2023-12-01 20:01 ` Roman Gushchin
2023-12-01 21:51 ` Kent Overstreet
2023-12-06 8:16 ` Dave Chinner
2023-12-06 19:13 ` Kent Overstreet
2023-12-09 1:44 ` Roman Gushchin
2023-12-09 2:04 ` Kent Overstreet
2023-11-30 8:14 ` Michal Hocko
2023-12-01 1:47 ` Kent Overstreet
2023-12-01 10:04 ` Michal Hocko
2023-12-01 21:25 ` Kent Overstreet
2023-12-04 10:33 ` Michal Hocko
2023-12-04 18:15 ` Kent Overstreet
2023-12-05 8:49 ` Michal Hocko [this message]
2023-12-05 23:21 ` Kent Overstreet
2023-11-24 11:46 ` kernel test robot
2023-11-28 10:01 ` Michal Hocko
2023-11-28 17:48 ` Kent Overstreet
2023-11-29 16:02 ` Michal Hocko
2023-11-29 22:36 ` Kent Overstreet
2023-11-22 23:25 ` [PATCH 3/7] mm: shrinker: Add new stats for .to_text() Kent Overstreet
2023-11-22 23:25 ` [PATCH 4/7] mm: Centralize & improve oom reporting in show_mem.c Kent Overstreet
2023-11-28 10:07 ` Michal Hocko
2023-11-28 17:54 ` Kent Overstreet
2023-11-29 8:59 ` Michal Hocko
2023-11-22 23:25 ` [PATCH 5/7] mm: shrinker: Add shrinker_to_text() to debugfs interface Kent Overstreet
2023-11-22 23:25 ` [PATCH 6/7] bcachefs: shrinker.to_text() methods Kent Overstreet
2023-11-22 23:25 ` [PATCH 7/7] bcachefs: add counters for failed shrinker reclaim Kent Overstreet
2023-11-28 9:59 ` [PATCH 0/7] shrinker debugging improvements Michal Hocko
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ZW7kC_un5bfQ9uTI@tiehlicka \
--to=mhocko@suse.com \
--cc=akpm@linux-foundation.org \
--cc=david@fromorbit.com \
--cc=kent.overstreet@linux.dev \
--cc=linux-mm@kvack.org \
--cc=muchun.song@linux.dev \
--cc=roman.gushchin@linux.dev \
--cc=zhengqi.arch@bytedance.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).