From: Qu Wenruo <wqu@suse.com>
To: linux-btrfs@vger.kernel.org
Subject: [PATCH RFC 0/3] btrfs: Performance profiler support
Date: Wed, 6 Mar 2019 14:19:04 +0800 [thread overview]
Message-ID: <20190306061907.29685-1-wqu@suse.com> (raw)
This patchset can be fetched from github:
https://github.com/adam900710/linux/tree/perf_tree_lock
Which is based on v5.0-rc7 tag.
Although we have ftrace/perf to do various performance analyse, under most
case the granularity is too small, resulting data flood for users.
This RFC patchset provides a btrfs specific performance profiler.
It calculates certain function duration and account the duration.
The result is provided through RO sysfs interface,
/sys/fs/btrfs/<FSID>/profiler.
The content of that file is genreated when read.
Users can have full control on the sample resolution.
The example content can be found in the last patch.
One example using the interface to profile fsstress can be found here:
https://docs.google.com/spreadsheets/d/1BVng8hqyyxFWPQF_1N0cpwiCA6R3SXtDTHmRqo8qyvo/edit?usp=sharing
The test script can be found here:
https://gist.github.com/adam900710/ca47b9a8d4b8db7168b261b6fba71ff1
The interesting result from the graph is:
- Concurrency on fs tree is only high for the initial 25 seconds
My initial expectation is, the hotness on fs tree should be more or
less stable. Which looks pretty interesting
- Then extent tree get more concurrency after 25 seconds
This again breaks my expectation. As write to extent tree should only
be triggered by delayed ref. So there is something interesting here
too.
- Root tree is pretty cold
Since the test is only happening on fs tree, it's expected to be less
racy.
- There is some minor load on other trees.
My guess is, that's from csum tree.
Although the patchset is relatively small, there are some design points
need extra commends before the patchset get larger and larger.
- How should this profiler get enabled?
Should this feature get enabled by mount option or kernel config?
Or just let it run for all kernel build?
Currently the overhead should be pretty small, but the overhead should
be larger and larger with new telemetry.
- Design of the interface
Is this a valid usage of sysfs or an abuse?
And if the content can be improved for both human or program?
- Idea on new telemetry
My plan is to add transaction wait time.
Qu Wenruo (3):
btrfs: Introduce performance profiler
btrfs: locking: Add hooks for btrfs perf
btrfs: perf: Add RO sysfs interface to collect perf result
fs/btrfs/Makefile | 2 +-
fs/btrfs/ctree.h | 3 ++
fs/btrfs/disk-io.c | 6 +++
fs/btrfs/locking.c | 11 ++++++
fs/btrfs/perf.c | 92 ++++++++++++++++++++++++++++++++++++++++++++++
fs/btrfs/perf.h | 44 ++++++++++++++++++++++
fs/btrfs/sysfs.c | 39 ++++++++++++++++++++
7 files changed, 196 insertions(+), 1 deletion(-)
create mode 100644 fs/btrfs/perf.c
create mode 100644 fs/btrfs/perf.h
--
2.21.0
next reply other threads:[~2019-03-06 6:19 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-03-06 6:19 Qu Wenruo [this message]
2019-03-06 6:19 ` [PATCH RFC 1/3] btrfs: Introduce performance profiler Qu Wenruo
2019-03-06 6:19 ` [PATCH RFC 2/3] btrfs: locking: Add hooks for btrfs perf Qu Wenruo
2019-03-06 6:19 ` [PATCH RFC 3/3] btrfs: perf: Add RO sysfs interface to collect perf result Qu Wenruo
2019-03-07 14:02 ` [PATCH RFC 0/3] btrfs: Performance profiler support David Sterba
2019-03-07 14:18 ` Qu Wenruo
2019-03-07 16:12 ` David Sterba
2019-03-09 6:21 ` Nikolay Borisov
2019-03-09 6:32 ` Qu Wenruo
2019-03-10 3:08 ` Anand Jain
2019-03-10 9:29 ` Nikolay Borisov
2019-03-10 9:34 ` Qu Wenruo
2019-03-10 9:40 ` Nikolay Borisov
2019-03-10 9:56 ` Qu Wenruo
2019-03-10 10:00 ` Nikolay Borisov
2019-03-11 0:44 ` Anand Jain
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20190306061907.29685-1-wqu@suse.com \
--to=wqu@suse.com \
--cc=linux-btrfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).