Linux Btrfs filesystem development
 help / color / mirror / Atom feed
From: Qu Wenruo <quwenruo.btrfs@gmx.com>
To: Josef Bacik <josef@toxicpanda.com>,
	linux-btrfs@vger.kernel.org, kernel-team@fb.com
Subject: Re: [PATCH v3 06/54] btrfs: do not cleanup upper nodes in btrfs_backref_cleanup_node
Date: Thu, 3 Dec 2020 10:08:18 +0800	[thread overview]
Message-ID: <8960c0d8-7cef-bc55-97db-be48bc916a9b@gmx.com> (raw)
In-Reply-To: <5baef1129ee209bc9d31fc46972bb8df3f7dd4f2.1606938211.git.josef@toxicpanda.com>


[-- Attachment #1.1: Type: text/plain, Size: 4307 bytes --]



On 2020/12/3 上午3:50, Josef Bacik wrote:
> Zygo reported the following panic when testing my error handling patches
> for relocation
> 
> ------------[ cut here ]------------
> kernel BUG at fs/btrfs/backref.c:2545!
> invalid opcode: 0000 [#1] SMP KASAN PTI CPU: 3 PID: 8472 Comm: btrfs Tainted: G        W 14
> Hardware name: QEMU Standard PC (i440FX + PIIX,
> 
> Call Trace:
>  btrfs_backref_error_cleanup+0x4df/0x530
>  build_backref_tree+0x1a5/0x700
>  ? _raw_spin_unlock+0x22/0x30
>  ? release_extent_buffer+0x225/0x280
>  ? free_extent_buffer.part.52+0xd7/0x140
>  relocate_tree_blocks+0x2a6/0xb60
>  ? kasan_unpoison_shadow+0x35/0x50
>  ? do_relocation+0xc10/0xc10
>  ? kasan_kmalloc+0x9/0x10
>  ? kmem_cache_alloc_trace+0x6a3/0xcb0
>  ? free_extent_buffer.part.52+0xd7/0x140
>  ? rb_insert_color+0x342/0x360
>  ? add_tree_block.isra.36+0x236/0x2b0
>  relocate_block_group+0x2eb/0x780
>  ? merge_reloc_roots+0x470/0x470
>  btrfs_relocate_block_group+0x26e/0x4c0
>  btrfs_relocate_chunk+0x52/0x120
>  btrfs_balance+0xe2e/0x18f0
>  ? pvclock_clocksource_read+0xeb/0x190
>  ? btrfs_relocate_chunk+0x120/0x120
>  ? lock_contended+0x620/0x6e0
>  ? do_raw_spin_lock+0x1e0/0x1e0
>  ? do_raw_spin_unlock+0xa8/0x140
>  btrfs_ioctl_balance+0x1f9/0x460
>  btrfs_ioctl+0x24c8/0x4380
>  ? __kasan_check_read+0x11/0x20
>  ? check_chain_key+0x1f4/0x2f0
>  ? __asan_loadN+0xf/0x20
>  ? btrfs_ioctl_get_supported_features+0x30/0x30
>  ? kvm_sched_clock_read+0x18/0x30
>  ? check_chain_key+0x1f4/0x2f0
>  ? lock_downgrade+0x3f0/0x3f0
>  ? handle_mm_fault+0xad6/0x2150
>  ? do_vfs_ioctl+0xfc/0x9d0
>  ? ioctl_file_clone+0xe0/0xe0
>  ? check_flags.part.50+0x6c/0x1e0
>  ? check_flags.part.50+0x6c/0x1e0
>  ? check_flags+0x26/0x30
>  ? lock_is_held_type+0xc3/0xf0
>  ? syscall_enter_from_user_mode+0x1b/0x60
>  ? do_syscall_64+0x13/0x80
>  ? rcu_read_lock_sched_held+0xa1/0xd0
>  ? __kasan_check_read+0x11/0x20
>  ? __fget_light+0xae/0x110
>  __x64_sys_ioctl+0xc3/0x100
>  do_syscall_64+0x37/0x80
>  entry_SYSCALL_64_after_hwframe+0x44/0xa9
> 
> This occurs because of this check
> 
> if (RB_EMPTY_NODE(&upper->rb_node))
> 	BUG_ON(!list_empty(&node->upper));
> 
> As we are dropping the backref node, if we discover that our upper node
> in the edge we just cleaned up isn't linked into the cache that we are
> now done with this node, thus the BUG_ON().
> 
> However this is an erroneous assumption, as we will look up all the
> references for a node first, and then process the pending edges.  All of
> the 'upper' nodes in our pending edges won't be in the cache's rb_tree
> yet, because they haven't been processed.  We could very well have many
> edges still left to cleanup on this node.
> 
> The fact is we simply do not need this check, we can just process all of
> the edges only for this node, because below this check we do the
> following
> 
> if (list_empty(&upper->lower)) {
> 	list_add_tail(&upper->lower, &cache->leaves);
> 	upper->lowest = 1;
> }
> 
> If the upper node truly isn't used yet, then we add it to the
> cache->leaves list to be cleaned up later.  If it is still used then the
> last child node that has it linked into its node will add it to the
> leaves list and then it will be cleaned up.

That's tree.

> 
> Fix this problem by dropping this logic altogether.  With this fix I no
> longer see the panic when testing with error injection in the backref
> code.
> 
> Signed-off-by: Josef Bacik <josef@toxicpanda.com>

Reviewed-by: Qu Wenruo <wqu@suse.com>

Thanks,
Qu

> ---
>  fs/btrfs/backref.c | 7 -------
>  1 file changed, 7 deletions(-)
> 
> diff --git a/fs/btrfs/backref.c b/fs/btrfs/backref.c
> index 02d7d7b2563b..56f7c840031e 100644
> --- a/fs/btrfs/backref.c
> +++ b/fs/btrfs/backref.c
> @@ -2541,13 +2541,6 @@ void btrfs_backref_cleanup_node(struct btrfs_backref_cache *cache,
>  		list_del(&edge->list[UPPER]);
>  		btrfs_backref_free_edge(cache, edge);
>  
> -		if (RB_EMPTY_NODE(&upper->rb_node)) {
> -			BUG_ON(!list_empty(&node->upper));
> -			btrfs_backref_drop_node(cache, node);
> -			node = upper;
> -			node->lowest = 1;
> -			continue;
> -		}
>  		/*
>  		 * Add the node to leaf node list if no other child block
>  		 * cached.
> 


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 488 bytes --]

  reply	other threads:[~2020-12-03  2:10 UTC|newest]

Thread overview: 114+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2020-12-02 19:50 [PATCH v3 00/54] Cleanup error handling in relocation Josef Bacik
2020-12-02 19:50 ` [PATCH v3 01/54] btrfs: fix error handling in commit_fs_roots Josef Bacik
2020-12-03  1:45   ` Qu Wenruo
2020-12-03  8:09   ` Johannes Thumshirn
2020-12-02 19:50 ` [PATCH v3 02/54] btrfs: allow error injection for btrfs_search_slot and btrfs_cow_block Josef Bacik
2020-12-03  1:48   ` Qu Wenruo
2020-12-03  8:21   ` Johannes Thumshirn
2020-12-02 19:50 ` [PATCH v3 03/54] btrfs: fix lockdep splat in btrfs_recover_relocation Josef Bacik
2020-12-03  1:49   ` Qu Wenruo
2020-12-03  8:44   ` Johannes Thumshirn
2020-12-02 19:50 ` [PATCH v3 04/54] btrfs: keep track of the root owner for relocation reads Josef Bacik
2020-12-03  2:04   ` Qu Wenruo
2020-12-03 15:55     ` Josef Bacik
2020-12-02 19:50 ` [PATCH v3 05/54] btrfs: noinline btrfs_should_cancel_balance Josef Bacik
2020-12-03  2:06   ` Qu Wenruo
2020-12-03  8:44   ` Johannes Thumshirn
2020-12-03  9:00   ` Nikolay Borisov
2020-12-03 17:04     ` Josef Bacik
2020-12-02 19:50 ` [PATCH v3 06/54] btrfs: do not cleanup upper nodes in btrfs_backref_cleanup_node Josef Bacik
2020-12-03  2:08   ` Qu Wenruo [this message]
2020-12-02 19:50 ` [PATCH v3 07/54] btrfs: pass down the tree block level through ref-verify Josef Bacik
2020-12-02 19:50 ` [PATCH v3 08/54] btrfs: make sure owner is set in ref-verify Josef Bacik
2020-12-02 19:50 ` [PATCH v3 09/54] btrfs: don't clear ret in btrfs_start_dirty_block_groups Josef Bacik
2020-12-03  2:13   ` Qu Wenruo
2020-12-03  8:58   ` Johannes Thumshirn
2020-12-02 19:50 ` [PATCH v3 10/54] btrfs: convert some BUG_ON()'s to ASSERT()'s in do_relocation Josef Bacik
2020-12-03  2:14   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 11/54] btrfs: convert BUG_ON()'s in relocate_tree_block Josef Bacik
2020-12-03  2:15   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 12/54] btrfs: return an error from btrfs_record_root_in_trans Josef Bacik
2020-12-03  2:20   ` Qu Wenruo
2020-12-03 13:50   ` Johannes Thumshirn
2020-12-02 19:50 ` [PATCH v3 13/54] btrfs: handle errors from select_reloc_root() Josef Bacik
2020-12-03  2:23   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 14/54] btrfs: convert BUG_ON()'s in select_reloc_root() to proper errors Josef Bacik
2020-12-03  2:29   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 15/54] btrfs: check record_root_in_trans related failures in select_reloc_root Josef Bacik
2020-12-03  2:33   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 16/54] btrfs: do proper error handling in record_reloc_root_in_trans Josef Bacik
2020-12-03  2:39   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 17/54] btrfs: handle btrfs_record_root_in_trans failure in btrfs_rename_exchange Josef Bacik
2020-12-03  2:40   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 18/54] btrfs: handle btrfs_record_root_in_trans failure in btrfs_rename Josef Bacik
2020-12-02 19:50 ` [PATCH v3 19/54] btrfs: handle btrfs_record_root_in_trans failure in btrfs_delete_subvolume Josef Bacik
2020-12-03  2:41   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 20/54] btrfs: handle btrfs_record_root_in_trans failure in btrfs_recover_log_trees Josef Bacik
2020-12-03  2:42   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 21/54] btrfs: handle btrfs_record_root_in_trans failure in create_subvol Josef Bacik
2020-12-03  2:43   ` Qu Wenruo
2020-12-03 16:06     ` Josef Bacik
2020-12-02 19:50 ` [PATCH v3 22/54] btrfs: btrfs: handle btrfs_record_root_in_trans failure in relocate_tree_block Josef Bacik
2020-12-03  2:44   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 23/54] btrfs: handle btrfs_record_root_in_trans failure in start_transaction Josef Bacik
2020-12-03  2:47   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 24/54] btrfs: handle record_root_in_trans failure in qgroup_account_snapshot Josef Bacik
2020-12-03  2:48   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 25/54] btrfs: handle record_root_in_trans failure in btrfs_record_root_in_trans Josef Bacik
2020-12-02 19:50 ` [PATCH v3 26/54] btrfs: handle record_root_in_trans failure in create_pending_snapshot Josef Bacik
2020-12-03  2:56   ` Qu Wenruo
2020-12-03 16:14     ` Josef Bacik
2020-12-02 19:50 ` [PATCH v3 27/54] btrfs: do not panic in __add_reloc_root Josef Bacik
2020-12-03  3:00   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 28/54] btrfs: have proper error handling in btrfs_init_reloc_root Josef Bacik
2020-12-02 19:50 ` [PATCH v3 29/54] btrfs: do proper error handling in create_reloc_root Josef Bacik
2020-12-03  3:29   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 30/54] btrfs: validate ->reloc_root after recording root in trans Josef Bacik
2020-12-03  4:49   ` Qu Wenruo
2020-12-03 16:18     ` Josef Bacik
2020-12-02 19:50 ` [PATCH v3 31/54] btrfs: handle btrfs_update_reloc_root failure in commit_fs_roots Josef Bacik
2020-12-03  4:51   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 32/54] btrfs: change insert_dirty_subvol to return errors Josef Bacik
2020-12-02 19:50 ` [PATCH v3 33/54] btrfs: handle btrfs_update_reloc_root failure in insert_dirty_subvol Josef Bacik
2020-12-02 19:50 ` [PATCH v3 34/54] btrfs: handle btrfs_update_reloc_root failure in prepare_to_merge Josef Bacik
2020-12-02 19:50 ` [PATCH v3 35/54] btrfs: do proper error handling in btrfs_update_reloc_root Josef Bacik
2020-12-03  4:54   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 36/54] btrfs: convert logic BUG_ON()'s in replace_path to ASSERT()'s Josef Bacik
2020-12-03  4:55   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 37/54] btrfs: handle initial btrfs_cow_block error in replace_path Josef Bacik
2020-12-03  5:05   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 38/54] btrfs: handle the loop " Josef Bacik
2020-12-03  5:11   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 39/54] btrfs: handle btrfs_search_slot failure " Josef Bacik
2020-12-03  5:13   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 40/54] btrfs: handle errors in reference count manipulation " Josef Bacik
2020-12-03  5:14   ` Qu Wenruo
2020-12-02 19:50 ` [PATCH v3 41/54] btrfs: handle extent reference errors in do_relocation Josef Bacik
2020-12-03  5:15   ` Qu Wenruo
2020-12-03 16:26     ` Josef Bacik
2020-12-02 19:51 ` [PATCH v3 42/54] btrfs: check for BTRFS_BLOCK_FLAG_FULL_BACKREF being set improperly Josef Bacik
2020-12-03  5:19   ` Qu Wenruo
2020-12-02 19:51 ` [PATCH v3 43/54] btrfs: remove the extent item sanity checks in relocate_block_group Josef Bacik
2020-12-03  5:20   ` Qu Wenruo
2020-12-02 19:51 ` [PATCH v3 44/54] btrfs: do proper error handling in create_reloc_inode Josef Bacik
2020-12-03  5:25   ` Qu Wenruo
2020-12-03 16:34     ` Josef Bacik
2020-12-02 19:51 ` [PATCH v3 45/54] btrfs: handle __add_reloc_root failure in btrfs_recover_relocation Josef Bacik
2020-12-03  5:32   ` Qu Wenruo
2020-12-02 19:51 ` [PATCH v3 46/54] btrfs: handle __add_reloc_root failure in btrfs_reloc_post_snapshot Josef Bacik
2020-12-03  5:34   ` Qu Wenruo
2020-12-02 19:51 ` [PATCH v3 47/54] btrfs: cleanup error handling in prepare_to_merge Josef Bacik
2020-12-03  5:39   ` Qu Wenruo
2020-12-03 16:53     ` Josef Bacik
2020-12-02 19:51 ` [PATCH v3 48/54] btrfs: handle extent corruption with select_one_root properly Josef Bacik
2020-12-03  5:40   ` Qu Wenruo
2020-12-02 19:51 ` [PATCH v3 49/54] btrfs: do proper error handling in merge_reloc_roots Josef Bacik
2020-12-03  5:42   ` Qu Wenruo
2020-12-02 19:51 ` [PATCH v3 50/54] btrfs: check return value of btrfs_commit_transaction in relocation Josef Bacik
2020-12-03  5:42   ` Qu Wenruo
2020-12-02 19:51 ` [PATCH v3 51/54] btrfs: do not WARN_ON() if we can't find the reloc root Josef Bacik
2020-12-02 19:51 ` [PATCH v3 52/54] btrfs: print the actual offset in btrfs_root_name Josef Bacik
2020-12-03  5:44   ` Qu Wenruo
2020-12-02 19:51 ` [PATCH v3 53/54] btrfs: fix reloc root leak with 0 ref reloc roots on recovery Josef Bacik
2020-12-02 19:51 ` [PATCH v3 54/54] btrfs: splice remaining dirty_bg's onto the transaction dirty bg list Josef Bacik
2020-12-03  5:47   ` Qu Wenruo

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=8960c0d8-7cef-bc55-97db-be48bc916a9b@gmx.com \
    --to=quwenruo.btrfs@gmx.com \
    --cc=josef@toxicpanda.com \
    --cc=kernel-team@fb.com \
    --cc=linux-btrfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox