From: Anand Jain <anand.jain@oracle.com>
To: linux-btrfs@vger.kernel.org
Subject: [PATCH RFC 00/10] btrfs: new performance-based chunk allocation using device roles
Date: Tue, 13 May 2025 02:07:06 +0800 [thread overview]
Message-ID: <cover.1747070147.git.anand.jain@oracle.com> (raw)
In host hardware, devices can have different speeds. Generally, faster
devices come with lesser capacity while slower devices come with larger
capacity. A typical configuration would expect that:
- A filesystem's read/write performance is evenly distributed on average
across the entire filesystem. This is not achievable with the current
allocation method because chunks are allocated based only on device free
space.
- Typically, faster devices are assigned to metadata chunk allocations
while slower devices are assigned to data chunk allocations.
Introducing Device Roles:
Here I define 5 device roles in a specific order for metadata and in the
reverse order for data: metadata_only, metadata, none, data, data_only.
One or more devices may have the same role.
The metadata and data roles indicate preference but not exclusivity for
that role, whereas data_only and metadata_only are exclusive roles.
Introducing Role-then-Space allocation method:
Metadata allocation can happen on devices with the roles metadata_only,
metadata, none, and data in that order. If multiple devices share a role,
they are arranged based on device free space.
Similarly, data allocation can happen on devices with the roles data_only,
data, none, and metadata in that order. If multiple devices share a role,
they are arranged based on device free space.
Finding device speed automatically:
Measuring device read/write latency for the allocaiton is not good idea,
as the historical readings and may be misleading, as they could include
iostat data from periods with issues that have since been fixed. Testing
to determine relative latency and arranging in ascending order for metadata
and descending for data is possible, but is better handled by an external
tool that can still set device roles.
On-Disk Format changes:
The following items are defined but are unused on-disk format:
btrfs_dev_item::
__le64 type; // unused
__le64 start_offset; // unused
__le32 dev_group; // unused
__u8 seek_speed; // unused
__u8 bandwidth; // unused
The device roles is using the dev_item::type 8-bit field to store each
device's role.
Anand Jain (10):
btrfs: fix thresh scope in should_alloc_chunk()
btrfs: refactor should_alloc_chunk() arg type
btrfs: introduce btrfs_split_sysfs_arg() for argument parsing
btrfs: introduce device allocation method
btrfs: sysfs: show device allocation method
btrfs: skip device sorting when only one device is present
btrfs: refactor chunk allocation device handling to use list_head
btrfs: introduce explicit device roles for block groups
btrfs: introduce ROLE_THEN_SPACE device allocation method
btrfs: pass device roles through device add ioctl
fs/btrfs/block-group.c | 11 +-
fs/btrfs/ioctl.c | 12 +-
fs/btrfs/sysfs.c | 130 ++++++++++++++++++++--
fs/btrfs/volumes.c | 242 +++++++++++++++++++++++++++++++++--------
fs/btrfs/volumes.h | 35 +++++-
5 files changed, 366 insertions(+), 64 deletions(-)
--
2.49.0
next reply other threads:[~2025-05-12 18:07 UTC|newest]
Thread overview: 44+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-05-12 18:07 Anand Jain [this message]
2025-05-12 18:07 ` [PATCH 01/10] btrfs: fix thresh scope in should_alloc_chunk() Anand Jain
2025-05-12 18:07 ` [PATCH 02/10] btrfs: refactor should_alloc_chunk() arg type Anand Jain
2025-05-12 18:07 ` [PATCH 03/10] btrfs: introduce btrfs_split_sysfs_arg() for argument parsing Anand Jain
2025-05-12 18:07 ` [PATCH 04/10] btrfs: introduce device allocation method Anand Jain
2025-05-12 18:07 ` [PATCH 05/10] btrfs: sysfs: show " Anand Jain
2025-05-12 18:07 ` [PATCH 06/10] btrfs: skip device sorting when only one device is present Anand Jain
2025-05-12 18:07 ` [PATCH 07/10] btrfs: refactor chunk allocation device handling to use list_head Anand Jain
2025-05-12 18:07 ` [PATCH 08/10] btrfs: introduce explicit device roles for block groups Anand Jain
2025-05-12 18:07 ` [PATCH 09/10] btrfs: introduce ROLE_THEN_SPACE device allocation method Anand Jain
2025-05-12 18:07 ` [PATCH 10/10] btrfs: pass device roles through device add ioctl Anand Jain
2025-05-12 18:09 ` [PATCH RFC 00/14] btrfs-progs: add support for device role-based chunk allocation Anand Jain
2025-05-12 18:09 ` [PATCH 01/14] btrfs-progs: minor spelling correction in the list-chunk help text Anand Jain
2025-05-12 18:09 ` [PATCH 02/14] btrfs-progs: refactor devid comparison function Anand Jain
2025-05-12 18:09 ` [PATCH 03/14] btrfs-progs: rename local dev_list to devices in btrfs_alloc_chunk Anand Jain
2025-05-12 18:09 ` [PATCH 04/14] btrfs-progs: mkfs: prepare to merge duplicate if-else blocks Anand Jain
2025-05-12 18:09 ` [PATCH 05/14] btrfs-progs: mkfs: eliminate duplicate code in if-else Anand Jain
2025-05-12 18:09 ` [PATCH 06/14] btrfs-progs: mkfs: refactor test_num_disk_vs_raid - split data and metadata Anand Jain
2025-05-12 18:09 ` [PATCH 07/14] btrfs-progs: mkfs: device argument handling with a list Anand Jain
2025-05-12 18:09 ` [PATCH 08/14] btrfs-progs: import device role handling from the kernel Anand Jain
2025-05-12 18:09 ` [PATCH 09/14] btrfs-progs: mkfs: introduce device roles in device paths Anand Jain
2025-05-12 18:09 ` [PATCH 10/14] btrfs-progs: sort devices by role before using them Anand Jain
2025-05-12 18:09 ` [PATCH 11/14] btrfs-progs: helper for the device role within dev_item::type Anand Jain
2025-05-12 18:09 ` [PATCH 12/14] btrfs-progs: mkfs: persist device roles to dev_item::type Anand Jain
2025-05-12 18:09 ` [PATCH 13/14] btrfs-progs: update device add ioctl with device type Anand Jain
2025-05-12 18:09 ` [PATCH 14/14] btrfs-progs: disable exclusive metadata/data device roles Anand Jain
2025-06-20 16:46 ` [PATCH RFC 00/14] btrfs-progs: add support for device role-based chunk allocation David Sterba
2025-05-12 18:11 ` [PATCH RFC 0/2] fstests: btrfs: add functional verification for device roles Anand Jain
2025-05-12 18:11 ` [PATCH 1/2] fstests: common/btrfs: add _require_btrfs_feature_device_roles Anand Jain
2025-05-12 18:11 ` [PATCH 2/2] fstests: btrfs/366: add test for device role-based chunk allocation Anand Jain
2025-05-20 9:19 ` [PATCH RFC 00/10] btrfs: new performance-based chunk allocation using device roles Forza
2025-05-21 8:37 ` Anand Jain
2025-05-22 4:07 ` Zygo Blaxell
2025-06-02 4:26 ` Anand Jain
2025-06-21 1:11 ` Zygo Blaxell
2025-05-22 18:19 ` waxhead
2025-06-02 4:25 ` Anand Jain
2025-06-06 14:21 ` waxhead
2025-05-22 20:39 ` Ferry Toth
2025-06-02 4:24 ` Anand Jain
2025-06-04 21:29 ` Ferry Toth
2025-06-04 21:48 ` Anand Jain
2025-05-30 0:15 ` Jani Partanen
2025-06-02 4:25 ` Anand Jain
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover.1747070147.git.anand.jain@oracle.com \
--to=anand.jain@oracle.com \
--cc=linux-btrfs@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox