public inbox for linux-btrfs@vger.kernel.org
 help / color / mirror / Atom feed
From: Josef Bacik <josef@toxicpanda.com>
To: Qu Wenruo <wqu@suse.com>, dsterba@suse.com
Cc: linux-btrfs@vger.kernel.org
Subject: Re: [PATCH v3 20/26] btrfs: make extent_write_locked_range() to be subpage compatible
Date: Wed, 13 Oct 2021 10:50:38 -0400	[thread overview]
Message-ID: <YWbyPmlCPtvOvMOZ@localhost.localdomain> (raw)
In-Reply-To: <20210927072208.21634-21-wqu@suse.com>

On Mon, Sep 27, 2021 at 03:22:02PM +0800, Qu Wenruo wrote:
> There are two sites are not subpage compatible yet for
> extent_write_locked_range():
> 
> - How @nr_pages are calculated
>   For subpage we can have the following range with 64K page size:
> 
>   0   32K  64K   96K 128K
>   |   |////|/////|   |
> 
>   In that case, although 96K - 32K == 64K, thus it looks like one page
>   is enough, but the range spans across two pages, not one.
> 
>   Fix it by doing proper round_up() and round_down() to calculate
>   @nr_pages.
> 
>   Also add some extra ASSERT()s to ensure the range passed in is already
>   aligned.
> 
> - How the page end is calculated
>   Currently we just use cur + PAGE_SIZE - 1 to calculate the page end.
> 
>   Which can't handle above range layout, and will trigger ASSERT() in
>   btrfs_writepage_endio_finish_ordered(), as the range is no longer
>   covered by the page range.
> 
>   Fix it by take page end into consideration.
> 
> Signed-off-by: Qu Wenruo <wqu@suse.com>
> ---
>  fs/btrfs/extent_io.c | 17 +++++++++++++----
>  1 file changed, 13 insertions(+), 4 deletions(-)
> 
> diff --git a/fs/btrfs/extent_io.c b/fs/btrfs/extent_io.c
> index 825917f1b623..f05d8896d1ad 100644
> --- a/fs/btrfs/extent_io.c
> +++ b/fs/btrfs/extent_io.c
> @@ -5087,15 +5087,14 @@ int extent_write_locked_range(struct inode *inode, u64 start, u64 end)
>  	struct address_space *mapping = inode->i_mapping;
>  	struct page *page;
>  	u64 cur = start;
> -	unsigned long nr_pages = (end - start + PAGE_SIZE) >>
> -		PAGE_SHIFT;
> +	unsigned long nr_pages;
> +	const u32 sectorsize = btrfs_sb(inode->i_sb)->sectorsize;
>  	struct extent_page_data epd = {
>  		.bio_ctrl = { 0 },
>  		.extent_locked = 1,
>  		.sync_io = 1,
>  	};
>  	struct writeback_control wbc_writepages = {
> -		.nr_to_write	= nr_pages * 2,
>  		.sync_mode	= WB_SYNC_ALL,
>  		.range_start	= start,
>  		.range_end	= end + 1,
> @@ -5104,14 +5103,24 @@ int extent_write_locked_range(struct inode *inode, u64 start, u64 end)
>  		.no_cgroup_owner = 1,
>  	};
>  
> +	ASSERT(IS_ALIGNED(start, sectorsize) &&
> +	       IS_ALIGNED(end + 1, sectorsize));
> +	nr_pages = (round_up(end, PAGE_SIZE) - round_down(start, PAGE_SIZE)) >>
> +		   PAGE_SHIFT;
> +	wbc_writepages.nr_to_write = nr_pages * 2;
> +
>  	wbc_attach_fdatawrite_inode(&wbc_writepages, inode);
>  	while (cur <= end) {
> +		u64 cur_end = min(round_down(cur, PAGE_SIZE) + PAGE_SIZE - 1,
> +				  end);
> +
>  		page = find_get_page(mapping, cur >> PAGE_SHIFT);
>  		/*
>  		 * All pages in the range are locked since
>  		 * btrfs_run_delalloc_range(), thus there is no way to clear
>  		 * the page dirty flag.
>  		 */
> +		ASSERT(PageLocked(page));

We're tripping this ASSERT() with compression turned on, sorry I didn't notice
this but we've been panicing consistently since this was merged, so I've lost a
weeks worth of xfstests runs.  You can easily reproduce running

./check generic/029

with

MOUNT_OPTIONS="-o compress"

Thanks,

Josef

  reply	other threads:[~2021-10-13 14:50 UTC|newest]

Thread overview: 37+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-09-27  7:21 [PATCH v3 00/26] Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 01/26] btrfs: remove unused parameter @nr_pages in add_ra_bio_pages() Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 02/26] btrfs: remove unnecessary parameter @delalloc_start for writepage_delalloc() Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 03/26] btrfs: use async_chunk::async_cow to replace the confusing pending pointer Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 04/26] btrfs: don't pass compressed pages to btrfs_writepage_endio_finish_ordered() Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 05/26] btrfs: make add_ra_bio_pages() to be subpage compatible Qu Wenruo
2021-10-04 17:45   ` David Sterba
2021-10-04 22:39     ` Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 06/26] btrfs: introduce compressed_bio::pending_sectors to trace compressed bio more elegantly Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 07/26] btrfs: add subpage checked bitmap to make PageChecked flag to be subpage compatible Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 08/26] btrfs: handle errors properly inside btrfs_submit_compressed_read() Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 09/26] btrfs: handle errors properly inside btrfs_submit_compressed_write() Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 10/26] btrfs: introduce submit_compressed_bio() for compression Qu Wenruo
2021-10-04 19:42   ` David Sterba
2021-10-04 22:41     ` Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 11/26] btrfs: introduce alloc_compressed_bio() " Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 12/26] btrfs: make btrfs_submit_compressed_read() to determine stripe boundary at bio allocation time Qu Wenruo
2021-10-04 20:10   ` David Sterba
2021-10-05  6:24     ` Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 13/26] btrfs: make btrfs_submit_compressed_write() " Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 14/26] btrfs: remove unused function btrfs_bio_fits_in_stripe() Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 15/26] btrfs: refactor submit_compressed_extents() Qu Wenruo
2021-10-05 16:33   ` David Sterba
2021-09-27  7:21 ` [PATCH v3 16/26] btrfs: cleanup for extent_write_locked_range() Qu Wenruo
2021-09-27  7:21 ` [PATCH v3 17/26] btrfs: make compress_file_range() to be subpage compatible Qu Wenruo
2021-09-27  7:22 ` [PATCH v3 18/26] btrfs: make btrfs_submit_compressed_write() " Qu Wenruo
2021-09-27  7:22 ` [PATCH v3 19/26] btrfs: make end_compressed_bio_writeback() to be subpage compatble Qu Wenruo
2021-09-27  7:22 ` [PATCH v3 20/26] btrfs: make extent_write_locked_range() to be subpage compatible Qu Wenruo
2021-10-13 14:50   ` Josef Bacik [this message]
2021-10-14  0:08     ` Qu Wenruo
2021-09-27  7:22 ` [PATCH v3 21/26] btrfs: extract uncompressed async extent submission code into a new helper Qu Wenruo
2021-09-27  7:22 ` [PATCH v3 22/26] btrfs: rework lzo_compress_pages() to make it subpage compatible Qu Wenruo
2021-09-27  7:22 ` [PATCH v3 23/26] btrfs: teach __extent_writepage() to handle locked page differently Qu Wenruo
2021-09-27  7:22 ` [PATCH v3 24/26] btrfs: allow page to be unlocked by btrfs_page_end_writer_lock() even if it's locked by plain page_lock() Qu Wenruo
2021-09-27  7:22 ` [PATCH v3 25/26] btrfs: don't run delalloc range which is beyond the locked_page to prevent deadlock for subpage compression Qu Wenruo
2021-09-27  7:22 ` [PATCH v3 26/26] btrfs: only allow subpage compression if the range is fully page aligned Qu Wenruo
2021-10-05 17:21 ` [PATCH v3 00/26] David Sterba

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=YWbyPmlCPtvOvMOZ@localhost.localdomain \
    --to=josef@toxicpanda.com \
    --cc=dsterba@suse.com \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=wqu@suse.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox