From: Tejun Heo <tj@kernel.org>
To: dsterba@suse.com, clm@fb.com, josef@toxicpanda.com,
axboe@kernel.dk, jack@suse.cz
Cc: linux-btrfs@vger.kernel.org, linux-kernel@vger.kernel.org,
linux-block@vger.kernel.org, kernel-team@fb.com
Subject: [PATCHSET v2 btrfs/for-next] blkcg, btrfs: fix cgroup writeback support
Date: Sat, 15 Jun 2019 11:24:44 -0700 [thread overview]
Message-ID: <20190615182453.843275-1-tj@kernel.org> (raw)
Hello,
Changes from v1[1]
* 0001-cgroup-blkcg-Prepare-some-symbols-for-module-and-CON.patch
added. It collects and adds symbol exports and dummy function def
to fix module and different config builds.
When writeback is executed asynchronously (e.g. for compression), bios
are bounced to and issued by worker pool shared by all cgroups. This
leads to significant priority inversions when cgroup IO control is in
use - IOs for a low priority cgroup can tie down the workers forcing
higher priority IOs to wait behind them.
This patchset adds an bio punt mechanism to blkcg and updates btrfs to
issue async IOs through it. A bio tagged with REQ_CGROUP_PUNT flag is
bounced to the asynchronous issue context of the associated blkcg on
bio_submit(). As the bios are issued from per-blkcg work items,
there's no concern for priority inversions and it doesn't require
invasive changes to the filesystems. The mechanism should be
generally useful for IO control support across different filesystems.
This patchset contains the following 9 patches. The first three are
my blkcg patches to implement the needed mechanisms. The latter five
are Chris Mason's btrfs cleanup and update patches. Please let me
know how the patches should be routed. Given that there currently
aren't other users, it's likely the easiest to route all through btrfs
tree.
0001-cgroup-blkcg-Prepare-some-symbols-for-module-and-CON.patch
0002-blkcg-writeback-Add-wbc-no_wbc_acct.patch
0003-blkcg-writeback-Implement-wbc_blkcg_css.patch
0004-blkcg-implement-REQ_CGROUP_PUNT.patch
0005-Btrfs-stop-using-btrfs_schedule_bio.patch
0006-Btrfs-delete-the-entire-async-bio-submission-framewo.patch
0007-Btrfs-only-associate-the-locked-page-with-one-async_.patch
0008-Btrfs-use-REQ_CGROUP_PUNT-for-worker-thread-submitte.patch
0009-Btrfs-extent_write_locked_range-should-attach-inode-.patch
0001-0003 implement wbc->no_wbc_acct, wbc_blkcg_css() and
REQ_CGROUP_PUNT.
0004-0007 are prep patches to simplify / improve async bio submission.
0008 makes btrfs use REQ_CGROUP_PUNT for async bios.
0009 fixes wbc writeback accounting for IOs issued through
extent_write_locked_range().
This patchset is also available in the following git branch.
git://git.kernel.org/pub/scm/linux/kernel/git/tj/cgroup.git review-btrfs-cgroup-updates-v2
Thanks, diffstat follows.
block/blk-cgroup.c | 54 +++++++++
block/blk-core.c | 3
fs/btrfs/compression.c | 16 +-
fs/btrfs/compression.h | 3
fs/btrfs/ctree.h | 1
fs/btrfs/disk-io.c | 25 +---
fs/btrfs/extent_io.c | 15 +-
fs/btrfs/inode.c | 61 ++++++++--
fs/btrfs/super.c | 1
fs/btrfs/volumes.c | 264 --------------------------------------------
fs/btrfs/volumes.h | 10 -
fs/fs-writeback.c | 5
include/linux/backing-dev.h | 1
include/linux/blk-cgroup.h | 16 ++
include/linux/blk_types.h | 10 +
include/linux/cgroup.h | 1
include/linux/writeback.h | 24 +++-
17 files changed, 198 insertions(+), 312 deletions(-)
--
tejun
[1] http://lkml.kernel.org/r/20190614003350.1178444-1-tj@kernel.org
next reply other threads:[~2019-06-15 18:25 UTC|newest]
Thread overview: 25+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-06-15 18:24 Tejun Heo [this message]
2019-06-15 18:24 ` [PATCH 1/9] cgroup, blkcg: Prepare some symbols for module and !CONFIG_CGROUP usages Tejun Heo
2019-06-24 16:39 ` Jan Kara
2019-06-15 18:24 ` [PATCH 2/9] blkcg, writeback: Add wbc->no_wbc_acct Tejun Heo
2019-06-20 15:21 ` Jan Kara
2019-06-20 17:02 ` Tejun Heo
2019-06-24 8:21 ` Jan Kara
2019-06-24 12:58 ` Tejun Heo
2019-06-24 16:39 ` Jan Kara
2019-06-24 16:49 ` Jan Kara
2019-06-15 18:24 ` [PATCH 3/9] blkcg, writeback: Implement wbc_blkcg_css() Tejun Heo
2019-06-24 16:50 ` Jan Kara
2019-06-15 18:24 ` [PATCH 4/9] blkcg: implement REQ_CGROUP_PUNT Tejun Heo
2019-06-15 18:29 ` Tejun Heo
2019-06-20 15:37 ` Jan Kara
2019-06-20 16:42 ` Tejun Heo
2019-06-20 17:01 ` Jan Kara
2019-06-24 16:53 ` Jan Kara
2019-06-15 18:24 ` [PATCH 5/9] Btrfs: stop using btrfs_schedule_bio() Tejun Heo
2019-06-15 18:24 ` [PATCH 6/9] Btrfs: delete the entire async bio submission framework Tejun Heo
2019-06-15 18:24 ` [PATCH 7/9] Btrfs: only associate the locked page with one async_cow struct Tejun Heo
2019-06-15 18:24 ` [PATCH 8/9] Btrfs: use REQ_CGROUP_PUNT for worker thread submitted bios Tejun Heo
2019-06-15 18:24 ` [PATCH 9/9] Btrfs: extent_write_locked_range() should attach inode->i_wb Tejun Heo
2019-06-18 12:54 ` [PATCHSET v2 btrfs/for-next] blkcg, btrfs: fix cgroup writeback support David Sterba
2019-06-18 14:45 ` Tejun Heo
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20190615182453.843275-1-tj@kernel.org \
--to=tj@kernel.org \
--cc=axboe@kernel.dk \
--cc=clm@fb.com \
--cc=dsterba@suse.com \
--cc=jack@suse.cz \
--cc=josef@toxicpanda.com \
--cc=kernel-team@fb.com \
--cc=linux-block@vger.kernel.org \
--cc=linux-btrfs@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).