[GIT PULL] Btrfs

Chris Mason
2015-11-06T18:44:56Z

Hi Linus,

Please pull my for-linus-4.4 branch:

git://git.kernel.org/pub/scm/linux/kernel/git/mason/linux-btrfs.git for-linus-4.4

My branch was based on 4.3-rc5, and it ended up with a minor conflict
against the btrfs changes sent in for a later rc. I put a sample merge
resolution up here:

git://git.kernel.org/pub/scm/linux/kernel/git/mason/linux-btrfs.git for-linus-4.4-merged

The only non-obvious part of all this is in fs/btrfs/volumes.h. Both
sides of the merge ended up creating the BTRFS_BALANCE_ARGS_MASK
definition, which was my fault (sorry) for letting a duplicate patch in
the mix. When you merge, please keep the longer of the two definitions,
since we added to it later in the for-linus-4.4 branch.

I'm happy to redo things merged with 4.3-final if you don't want to
bother with this, sorry for the hassle.

On to the fun part, we have a lot of subvolume quota improvements in here,
along with big piles of cleanups from Dave Sterba and Anand Jain and
others.

Josef pitched in a batch of allocator fixes based on production use here
at FB. We found that mount -o ssd_spread greatly improved our
performance on hardware raid5/6, but it exposed some CPU bottlenecks in
the allocator. These patches make a huge difference.

Qu Wenruo (24) commits (+1031/-375):
btrfs: extent-tree: Add new version of btrfs_check_data_free_space and btrfs_free_reserved_data_space. (+79/-9)
btrfs: extent-tree: Switch to new check_data_free_space and free_reserved_data_space (+27/-19)
btrfs: qgroup: Avoid calling btrfs_free_reserved_data_space in clear_bit_hook (+22/-12)
btrfs: delayed_ref: Add new function to record reserved space into delayed ref (+43/-0)
btrfs: extent-tree: Add new version of btrfs_delalloc_reserve/release_space (+61/-0)
btrfs: extent_io: Introduce needed structure for recoding set/clear bits (+12/-0)
btrfs: qgroup: Introduce functions to release/free qgroup reserve data (+62/-0)
btrfs: extent-tree: Switch to new delalloc space reserve and release (+38/-25)
btrfs: delayed_ref: release and free qgroup reserved at proper timing (+34/-4)
btrfs: qgroup: Fix a race in delayed_ref which leads to abort trans (+32/-21)
btrfs: extent_io: Introduce new function clear_record_extent_bits() (+42/-11)
btrfs: qgroup: Fix a rebase bug which will cause qgroup double free (+0/-4)
btrfs: extent_io: Introduce new function set_record_extent_bits (+56/-18)
btrfs: qgroup: Introduce new functions to reserve/free metadata (+48/-0)
btrfs: qgroup: Don't copy extent buffer to do qgroup rescan (+16/-10)
btrfs: qgroup: Add new trace point for qgroup data reserve (+130/-2)
btrfs: qgroup: Introduce btrfs_qgroup_reserve_data function (+52/-0)
btrfs: fallocate: Add support to accurate qgroup reserve (+117/-44)
btrfs: qgroup: Check if qgroup reserved space leaked (+34/-0)
btrfs: qgroup: Cleanup old inaccurate facilities (+60/-156)
btrfs: qgroup: Add handler for NOCOW and inline (+21/-1)
btrfs: qgroup: Use new metadata reservation. (+13/-36)
btrfs: Fix a data space underflow warning (+8/-3)
btrfs: Add handler for invalidate page (+24/-0)

David Sterba (17) commits (+393/-112):
btrfs: introduce ratelimited _in_rcu variants of message printing functions (+38/-0)
btrfs: remove waitqueue_active check from btrfs_rm_dev_replace_unblocked (+1/-2)
btrfs: add balance filters limits, stripes and usage to supported mask (+4/-1)
btrfs: comment the rest of implicit barriers before waitqueue_active (+22/-0)
btrfs: introduce ratelimited variants of message printing functions (+21/-0)
btrfs: switch message printers to ratelimited _in_rcu variants (+16/-16)
btrfs: introduce _in_rcu variants of message printing functions (+29/-0)
btrfs: extend balance filter usage to take minimum and maximum (+60/-4)
btrfs: extend balance filter limit to take minimum and maximum (+67/-3)
btrfs: add barrier for waitqueue_active in clear_btree_io_tree (+6/-0)
btrfs: add comments to barriers before waitqueue_active (+16/-2)
btrfs: switch message printers to ratelimited variants (+31/-33)
btrfs: check unsupported filters in balance arguments (+13/-0)
btrfs: switch message printers to _in_rcu variants (+27/-27)
btrfs: remove extra barrier before waitqueue_active (+6/-2)
btrfs: comment waitqueue_active implied by locks (+11/-1)
btrfs: switch more printks to our helpers (+25/-21)

Anand Jain (14) commits (+205/-184):
Btrfs: __btrfs_std_error() logic should be consistent w/out CONFIG_PRINTK defined (+5/-22)
Btrfs: use BTRFS_ERROR_DEV_MISSING_NOT_FOUND when missing device is not found (+2/-4)
Btrfs: kernel operation should come after user input has been verified (+13/-13)
Btrfs: enhance btrfs_scratch_superblock to scratch all superblocks (+27/-13)
Btrfs: rename btrfs_kobj_add_device to btrfs_sysfs_add_device_link (+5/-5)
Btrfs: rename btrfs_sysfs_remove_one to btrfs_sysfs_remove_mounted (+5/-5)
Btrfs: rename btrfs_kobj_rm_device to btrfs_sysfs_rm_device_link (+8/-8)
Btrfs: add btrfs_read_dev_one_super() to read one specific SB (+35/-20)
Btrfs: SB read failure should return EIO for __bread failure (+19/-7)
Btrfs: rename btrfs_sysfs_add_one to btrfs_sysfs_add_mounted (+3/-3)
Btrfs: consolidate btrfs_error() to btrfs_std_error() (+26/-33)
Btrfs: don't log error from btrfs_get_bdev_and_sb (+0/-1)
Btrfs: add helper for closing one device (+37/-30)
Btrfs: rename super_kobj to fsid_kobj (+20/-20)

Josef Bacik (12) commits (+468/-132):
Btrfs: don't keep trying to build clusters if we are fragmented (+82/-24)
Btrfs: don't continue setting up space cache when enospc (+20/-0)
Btrfs: fix prealloc under heavy fragmentation conditions (+9/-0)
Btrfs: change how we wait for pending ordered extents (+60/-64)
Btrfs: don't do extra bitmap search in one bit case (+15/-13)
Btrfs: keep track of max_extent_size per space_info (+34/-1)
Btrfs: keep track of largest extent in bitmaps (+39/-1)
Btrfs: cut down on loops through the allocator (+36/-3)
Btrfs: add a flags field to btrfs_transaction (+16/-18)
Btrfs: don't loop in allocator for space cache (+1/-1)
Btrfs: add fragment=* debug mount option (+150/-7)
Btrfs: fix qgroup sanity tests (+6/-0)

Alexandru Moise (8) commits (+30/-46):
btrfs: use a single if() statement for one outcome in get_block_rsv() (+3/-7)
btrfs: declare rsv_count as unsigned int instead of int (+1/-1)
btrfs: change num_items type from u64 to unsigned int (+8/-6)
btrfs: cleanup btrfs_balance profile validity checks (+12/-9)
btrfs: trimming some start_transaction() code away (+1/-14)
btrfs: memset cur_trans->delayed_refs to zero (+2/-6)
btrfs: Fixed dsize and last_off declarations (+2/-2)
btrfs: Fixed declaration of old_len (+1/-1)

Filipe Manana (7) commits (+583/-220):
Btrfs: fix file corruption and data loss after cloning inline extents (+152/-43)
Btrfs: send, fix file corruption due to incorrect cloning operations (+173/-27)
Btrfs: fix regression running delayed references when using qgroups (+44/-134)
Btrfs: fix double range unlock of hole region when reading page (+6/-2)
Btrfs: fix hole punching when using the no-holes feature (+13/-0)
Btrfs: fix truncation of compressed and inlined extents (+68/-14)
Btrfs: fix regression when running delayed references (+127/-0)

Byongho Lee (4) commits (+55/-56):
btrfs: compress: put variables defined per compress type in struct to make cache friendly (+48/-46)
btrfs: replace unnecessary list_for_each_entry_safe to list_for_each_entry (+1/-2)
btrfs: cleanup iterating over prop_handlers array (+6/-7)
btrfs: remove unnecessary list_del (+0/-1)

Zhao Lei (3) commits (+125/-98):
btrfs: use btrfs_raid_array for btrfs_get_num_tolerated_disk_barrier_failures() (+30/-13)
btrfs: use btrfs_raid_array in btrfs_reduce_alloc_profile (+22/-26)
btrfs: Move btrfs_raid_array to public (+73/-59)

Luis de Bethencourt (2) commits (+7/-5):
btrfs: check-integrity: Fix returned errno codes (+2/-2)
btrfs: reada: Fix returned errno code (+5/-3)

chandan (1) commits (+6/-1):
Btrfs: find_free_extent: Do not erroneously skip LOOP_CACHING_WAIT state

Liu Bo (1) commits (+4/-4):
Btrfs: move kobj stuff out of dev_replace lock range

Shan Hai (1) commits (+0/-3):
btrfs/file.c: remove an unsed varialbe first_index

Chris Mason (1) commits (+3/-5):
btrfs: fix use after free iterating extrefs

Robin Ruede (1) commits (+8/-2):
btrfs: fix resending received snapshot with parent

Geliang Tang (1) commits (+1/-1):
btrfs: fix a comment typo

Jiri Kosina (1) commits (+1/-0):
btrfs: clear PF_NOFREEZE in cleaner_kthread()

Gabríel Arthúr Pétursson (1) commits (+37/-2):
btrfs: add balance filter for stripes

Chandan Rajendra (1) commits (+2/-2):
Btrfs: btrfs_submit_bio_hook: Use btrfs_wq_endio_type values instead of integer constants

Total: (100) commits (+2959/-1248)

fs/btrfs/backref.c | 14 +-
fs/btrfs/check-integrity.c | 8 +-
fs/btrfs/compression.c | 97 ++++---
fs/btrfs/ctree.c | 10 +-
fs/btrfs/ctree.h | 180 ++++++++++--
fs/btrfs/delayed-inode.c | 4 +
fs/btrfs/delayed-ref.c | 190 +++++++++++--
fs/btrfs/delayed-ref.h | 23 +-
fs/btrfs/dev-replace.c | 55 ++--
fs/btrfs/disk-io.c | 166 ++++++-----
fs/btrfs/disk-io.h | 2 +
fs/btrfs/extent-tree.c | 572 ++++++++++++++++++++++++++++----------
fs/btrfs/extent_io.c | 155 ++++++++---
fs/btrfs/extent_io.h | 19 ++
fs/btrfs/file.c | 228 ++++++++++-----
fs/btrfs/free-space-cache.c | 79 ++++--
fs/btrfs/free-space-cache.h | 1 +
fs/btrfs/inode-item.c | 2 +-
fs/btrfs/inode-map.c | 6 +-
fs/btrfs/inode.c | 194 ++++++++++---
fs/btrfs/ioctl.c | 285 +++++++++++--------
fs/btrfs/locking.c | 12 +
fs/btrfs/ordered-data.c | 70 ++++-
fs/btrfs/ordered-data.h | 2 +
fs/btrfs/props.c | 13 +-
fs/btrfs/qgroup.c | 229 +++++++++++++--
fs/btrfs/qgroup.h | 31 ++-
fs/btrfs/raid56.c | 6 +-
fs/btrfs/reada.c | 8 +-
fs/btrfs/relocation.c | 26 +-
fs/btrfs/root-tree.c | 11 +-
fs/btrfs/scrub.c | 42 +--
fs/btrfs/send.c | 212 ++++++++++++--
fs/btrfs/super.c | 57 ++--
fs/btrfs/sysfs.c | 52 ++--
fs/btrfs/sysfs.h | 4 +-
fs/btrfs/tests/free-space-tests.c | 22 +-
fs/btrfs/transaction.c | 129 +++------
fs/btrfs/transaction.h | 20 +-
fs/btrfs/tree-log.c | 24 +-
fs/btrfs/volumes.c | 427 ++++++++++++++++++----------
fs/btrfs/volumes.h | 24 +-
include/trace/events/btrfs.h | 113 ++++++++
include/uapi/linux/btrfs.h | 31 ++-
44 files changed, 2783 insertions(+), 1072 deletions(-)