From: pintu@codeaurora.org
To: Johannes Weiner <hannes@cmpxchg.org>
Cc: linux-kernel@vger.kernel.org, akpm@linux-foundation.org,
linux-mm@kvack.org, linux-fsdevel@vger.kernel.org,
linux-doc@vger.kernel.org, jaewon31.kim@samsung.com,
yuzhao@google.com, shakeelb@google.com, guro@fb.com,
mchehab+huawei@kernel.org, xi.fengfei@h3c.com,
lokeshgidra@google.com, nigupta@nvidia.com, famzheng@amazon.com,
andrew.a.klychkov@gmail.com, bigeasy@linutronix.de,
ping.ping@gmail.com, vbabka@suse.cz, yzaikin@google.com,
keescook@chromium.org, mcgrof@kernel.org, corbet@lwn.net,
pintu.ping@gmail.com
Subject: Re: [PATCH] mm: introduce clear all vm events counters
Date: Wed, 03 Mar 2021 17:55:38 +0530 [thread overview]
Message-ID: <2f816fe9682d9b066ba630951db75eac@codeaurora.org> (raw)
In-Reply-To: <YD5gFYalXJh0dMLn@cmpxchg.org>
On 2021-03-02 21:26, Johannes Weiner wrote:
> On Tue, Mar 02, 2021 at 04:00:34PM +0530, pintu@codeaurora.org wrote:
>> On 2021-03-01 20:41, Johannes Weiner wrote:
>> > On Mon, Mar 01, 2021 at 04:19:26PM +0530, Pintu Kumar wrote:
>> > > At times there is a need to regularly monitor vm counters while we
>> > > reproduce some issue, or it could be as simple as gathering some
>> > > system
>> > > statistics when we run some scenario and every time we like to start
>> > > from
>> > > beginning.
>> > > The current steps are:
>> > > Dump /proc/vmstat
>> > > Run some scenario
>> > > Dump /proc/vmstat again
>> > > Generate some data or graph
>> > > reboot and repeat again
>> >
>> > You can subtract the first vmstat dump from the second to get the
>> > event delta for the scenario run. That's what I do, and I'd assume
>> > most people are doing. Am I missing something?
>>
>> Thanks so much for your comments.
>> Yes in most cases it works.
>>
>> But I guess there are sometimes where we need to compare with fresh
>> data
>> (just like reboot) at least for some of the counters.
>> Suppose we wanted to monitor pgalloc_normal and pgfree.
>
> Hopefully these would already be balanced out pretty well before you
> run a test, or there is a risk that whatever outstanding allocations
> there are can cause a large number of frees during your test that
> don't match up to your recorded allocation events. Resetting to zero
> doesn't eliminate the risk of such background noise.
>
>> Or, suppose we want to monitor until the field becomes non-zero..
>> Or, how certain values are changing compared to fresh reboot.
>> Or, suppose we want to reset all counters after boot and start
>> capturing
>> fresh stats.
>
> Again, there simply is no mathematical difference between
>
> reset events to 0
> run test
> look at events - 0
>
> and
>
> read events baseline
> run test
> look at events - baseline
>
>> Some of the counters could be growing too large and too fast. Will
>> there be
>> chances of overflow ?
>> Then resetting using this could help without rebooting.
>
> Overflows are just a fact of life on 32 bit systems. However, they can
> also be trivially handled - you can always subtract a ulong start
> state from a ulong end state and get a reliable delta of up to 2^32
> events, whether the end state has overflowed or not.
>
> The bottom line is that the benefit of this patch adds a minor
> convenience for something that can already be done in userspace. But
> the downside is that there would be one more possible source of noise
> for kernel developers to consider when looking at a bug report. Plus
> the extra code and user interface that need to be maintained.
>
> I don't think we should merge this patch.
Okay no problem.Thank you so much for your review and feedback.
Yes I agree the benefits are minor but I thought might be useful for
someone somewhere.
I worked on it and found it easy and convinient and thus proposed it.
If others feel not important I am okay to drop it.
Thanks once again to all who helped to review it.
prev parent reply other threads:[~2021-03-04 0:30 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-03-01 10:49 [PATCH] mm: introduce clear all vm events counters Pintu Kumar
2021-03-01 12:13 ` Matthew Wilcox
2021-03-01 13:55 ` pintu
2021-03-01 15:11 ` Johannes Weiner
2021-03-02 10:30 ` pintu
2021-03-02 15:56 ` Johannes Weiner
2021-03-03 12:25 ` pintu [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=2f816fe9682d9b066ba630951db75eac@codeaurora.org \
--to=pintu@codeaurora.org \
--cc=akpm@linux-foundation.org \
--cc=andrew.a.klychkov@gmail.com \
--cc=bigeasy@linutronix.de \
--cc=corbet@lwn.net \
--cc=famzheng@amazon.com \
--cc=guro@fb.com \
--cc=hannes@cmpxchg.org \
--cc=jaewon31.kim@samsung.com \
--cc=keescook@chromium.org \
--cc=linux-doc@vger.kernel.org \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=lokeshgidra@google.com \
--cc=mcgrof@kernel.org \
--cc=mchehab+huawei@kernel.org \
--cc=nigupta@nvidia.com \
--cc=ping.ping@gmail.com \
--cc=pintu.ping@gmail.com \
--cc=shakeelb@google.com \
--cc=vbabka@suse.cz \
--cc=xi.fengfei@h3c.com \
--cc=yuzhao@google.com \
--cc=yzaikin@google.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.