From: Josef Bacik <josef@toxicpanda.com>
To: Qu Wenruo <wqu@suse.com>, dsterba@suse.com
Cc: linux-btrfs@vger.kernel.org
Subject: Re: [PATCH v3 20/26] btrfs: make extent_write_locked_range() to be subpage compatible
Date: Wed, 13 Oct 2021 10:50:38 -0400 [thread overview]
Message-ID: <YWbyPmlCPtvOvMOZ@localhost.localdomain> (raw)
In-Reply-To: <20210927072208.21634-21-wqu@suse.com>
On Mon, Sep 27, 2021 at 03:22:02PM +0800, Qu Wenruo wrote:
> There are two sites are not subpage compatible yet for
> extent_write_locked_range():
>
> - How @nr_pages are calculated
> For subpage we can have the following range with 64K page size:
>
> 0 32K 64K 96K 128K
> | |////|/////| |
>
> In that case, although 96K - 32K == 64K, thus it looks like one page
> is enough, but the range spans across two pages, not one.
>
> Fix it by doing proper round_up() and round_down() to calculate
> @nr_pages.
>
> Also add some extra ASSERT()s to ensure the range passed in is already
> aligned.
>
> - How the page end is calculated
> Currently we just use cur + PAGE_SIZE - 1 to calculate the page end.
>
> Which can't handle above range layout, and will trigger ASSERT() in
> btrfs_writepage_endio_finish_ordered(), as the range is no longer
> covered by the page range.
>
> Fix it by take page end into consideration.
>
> Signed-off-by: Qu Wenruo <wqu@suse.com>
> ---
> fs/btrfs/extent_io.c | 17 +++++++++++++----
> 1 file changed, 13 insertions(+), 4 deletions(-)
>
> diff --git a/fs/btrfs/extent_io.c b/fs/btrfs/extent_io.c
> index 825917f1b623..f05d8896d1ad 100644
> --- a/fs/btrfs/extent_io.c
> +++ b/fs/btrfs/extent_io.c
> @@ -5087,15 +5087,14 @@ int extent_write_locked_range(struct inode *inode, u64 start, u64 end)
> struct address_space *mapping = inode->i_mapping;
> struct page *page;
> u64 cur = start;
> - unsigned long nr_pages = (end - start + PAGE_SIZE) >>
> - PAGE_SHIFT;
> + unsigned long nr_pages;
> + const u32 sectorsize = btrfs_sb(inode->i_sb)->sectorsize;
> struct extent_page_data epd = {
> .bio_ctrl = { 0 },
> .extent_locked = 1,
> .sync_io = 1,
> };
> struct writeback_control wbc_writepages = {
> - .nr_to_write = nr_pages * 2,
> .sync_mode = WB_SYNC_ALL,
> .range_start = start,
> .range_end = end + 1,
> @@ -5104,14 +5103,24 @@ int extent_write_locked_range(struct inode *inode, u64 start, u64 end)
> .no_cgroup_owner = 1,
> };
>
> + ASSERT(IS_ALIGNED(start, sectorsize) &&
> + IS_ALIGNED(end + 1, sectorsize));
> + nr_pages = (round_up(end, PAGE_SIZE) - round_down(start, PAGE_SIZE)) >>
> + PAGE_SHIFT;
> + wbc_writepages.nr_to_write = nr_pages * 2;
> +
> wbc_attach_fdatawrite_inode(&wbc_writepages, inode);
> while (cur <= end) {
> + u64 cur_end = min(round_down(cur, PAGE_SIZE) + PAGE_SIZE - 1,
> + end);
> +
> page = find_get_page(mapping, cur >> PAGE_SHIFT);
> /*
> * All pages in the range are locked since
> * btrfs_run_delalloc_range(), thus there is no way to clear
> * the page dirty flag.
> */
> + ASSERT(PageLocked(page));
We're tripping this ASSERT() with compression turned on, sorry I didn't notice
this but we've been panicing consistently since this was merged, so I've lost a
weeks worth of xfstests runs. You can easily reproduce running
./check generic/029
with
MOUNT_OPTIONS="-o compress"
Thanks,
Josef
next prev parent reply other threads:[~2021-10-13 14:50 UTC|newest]
Thread overview: 37+ messages / expand[flat|nested] mbox.gz Atom feed top
2021-09-27 7:21 [PATCH v3 00/26] Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 01/26] btrfs: remove unused parameter @nr_pages in add_ra_bio_pages() Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 02/26] btrfs: remove unnecessary parameter @delalloc_start for writepage_delalloc() Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 03/26] btrfs: use async_chunk::async_cow to replace the confusing pending pointer Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 04/26] btrfs: don't pass compressed pages to btrfs_writepage_endio_finish_ordered() Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 05/26] btrfs: make add_ra_bio_pages() to be subpage compatible Qu Wenruo
2021-10-04 17:45 ` David Sterba
2021-10-04 22:39 ` Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 06/26] btrfs: introduce compressed_bio::pending_sectors to trace compressed bio more elegantly Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 07/26] btrfs: add subpage checked bitmap to make PageChecked flag to be subpage compatible Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 08/26] btrfs: handle errors properly inside btrfs_submit_compressed_read() Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 09/26] btrfs: handle errors properly inside btrfs_submit_compressed_write() Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 10/26] btrfs: introduce submit_compressed_bio() for compression Qu Wenruo
2021-10-04 19:42 ` David Sterba
2021-10-04 22:41 ` Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 11/26] btrfs: introduce alloc_compressed_bio() " Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 12/26] btrfs: make btrfs_submit_compressed_read() to determine stripe boundary at bio allocation time Qu Wenruo
2021-10-04 20:10 ` David Sterba
2021-10-05 6:24 ` Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 13/26] btrfs: make btrfs_submit_compressed_write() " Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 14/26] btrfs: remove unused function btrfs_bio_fits_in_stripe() Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 15/26] btrfs: refactor submit_compressed_extents() Qu Wenruo
2021-10-05 16:33 ` David Sterba
2021-09-27 7:21 ` [PATCH v3 16/26] btrfs: cleanup for extent_write_locked_range() Qu Wenruo
2021-09-27 7:21 ` [PATCH v3 17/26] btrfs: make compress_file_range() to be subpage compatible Qu Wenruo
2021-09-27 7:22 ` [PATCH v3 18/26] btrfs: make btrfs_submit_compressed_write() " Qu Wenruo
2021-09-27 7:22 ` [PATCH v3 19/26] btrfs: make end_compressed_bio_writeback() to be subpage compatble Qu Wenruo
2021-09-27 7:22 ` [PATCH v3 20/26] btrfs: make extent_write_locked_range() to be subpage compatible Qu Wenruo
2021-10-13 14:50 ` Josef Bacik [this message]
2021-10-14 0:08 ` Qu Wenruo
2021-09-27 7:22 ` [PATCH v3 21/26] btrfs: extract uncompressed async extent submission code into a new helper Qu Wenruo
2021-09-27 7:22 ` [PATCH v3 22/26] btrfs: rework lzo_compress_pages() to make it subpage compatible Qu Wenruo
2021-09-27 7:22 ` [PATCH v3 23/26] btrfs: teach __extent_writepage() to handle locked page differently Qu Wenruo
2021-09-27 7:22 ` [PATCH v3 24/26] btrfs: allow page to be unlocked by btrfs_page_end_writer_lock() even if it's locked by plain page_lock() Qu Wenruo
2021-09-27 7:22 ` [PATCH v3 25/26] btrfs: don't run delalloc range which is beyond the locked_page to prevent deadlock for subpage compression Qu Wenruo
2021-09-27 7:22 ` [PATCH v3 26/26] btrfs: only allow subpage compression if the range is fully page aligned Qu Wenruo
2021-10-05 17:21 ` [PATCH v3 00/26] David Sterba
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=YWbyPmlCPtvOvMOZ@localhost.localdomain \
--to=josef@toxicpanda.com \
--cc=dsterba@suse.com \
--cc=linux-btrfs@vger.kernel.org \
--cc=wqu@suse.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox