From: Long Li <leo.lilong@huawei.com>
To: "Darrick J. Wong" <djwong@kernel.org>
Cc: <brauner@kernel.org>, <cem@kernel.org>,
<linux-xfs@vger.kernel.org>, <linux-fsdevel@vger.kernel.org>,
<yi.zhang@huawei.com>, <houtao1@huawei.com>,
<yangerkun@huawei.com>
Subject: Re: [PATCH v5 1/2] iomap: fix zero padding data issue in concurrent append writes
Date: Thu, 28 Nov 2024 14:38:50 +0800 [thread overview]
Message-ID: <Z0gP-peky2Se-YIy@localhost.localdomain> (raw)
In-Reply-To: <20241127162829.GY1926309@frogsfrogsfrogs>
On Wed, Nov 27, 2024 at 08:28:29AM -0800, Darrick J. Wong wrote:
> > @@ -1789,7 +1790,16 @@ static int iomap_add_to_ioend(struct iomap_writepage_ctx *wpc,
> >
> > if (ifs)
> > atomic_add(len, &ifs->write_bytes_pending);
> > +
> > + /*
> > + * If the ioend spans i_size, trim io_size to the former to provide
> > + * the fs with more accurate size information. This is useful for
> > + * completion time on-disk size updates.
>
> I think it's useful to preserve the diagram showing exactly what problem
> you're solving:
>
> /*
> * Clamp io_offset and io_size to the incore EOF so that ondisk
> * file size updates in the ioend completion are byte-accurate.
> * This avoids recovering files with zeroed tail regions when
> * writeback races with appending writes:
> *
> * Thread 1: Thread 2:
> * ------------ -----------
> * write [A, A+B]
> * update inode size to A+B
> * submit I/O [A, A+BS]
> * write [A+B, A+B+C]
> * update inode size to A+B+C
> * <I/O completes, updates disk size to min(A+B+C, A+BS)>
> * <power failure>
> *
> * After reboot:
> * 1) with A+B+C < A+BS, the file has zero padding in range
> * [A+B, A+B+C]
> *
> * |< Block Size (BS) >|
> * |DDDDDDDDDDDD00000000000000|
> * ^ ^ ^
> * A A+B A+B+C
> * (EOF)
> *
> * 2) with A+B+C > A+BS, the file has zero padding in range
> * [A+B, A+BS]
> *
> * |< Block Size (BS) >|< Block Size (BS) >|
> * |DDDDDDDDDDDD00000000000000|000000000000000000000000000|
> * ^ ^ ^ ^
> * A A+B A+BS A+B+C
> * (EOF)
> *
> * D = Valid Data
> * 0 = Zero Padding
> *
> * Note that this defeats the ability to chain the ioends of
> * appending writes.
> */
>
> (I reduced the blocksize a bit for wrapping purposes)
Ok, I will update it.
>
> The logic looks ok, but I'm curious about how you landed at 2.6.12-rc
> for the fixes tag.
>
> --D
I see that io_size was introduced in version 2.6. It's quite difficult
to determine the exact version where the issue was introduced, but I can
confirm it was before version 4.19, as I can reproduce the issue in 4.19.
It should before introduce iomap infrastructure, how about using the
following fix tag?
Fixes: ae259a9c8593 ("fs: introduce iomap infrastructure") # goes further back than this
Thanks,
Long Li
next prev parent reply other threads:[~2024-11-28 6:41 UTC|newest]
Thread overview: 18+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-11-27 6:35 [PATCH v5 1/2] iomap: fix zero padding data issue in concurrent append writes Long Li
2024-11-27 6:35 ` [PATCH v5 2/2] xfs: clean up xfs_end_ioend() to reuse local variables Long Li
2024-11-27 16:07 ` Darrick J. Wong
2024-11-27 16:28 ` [PATCH v5 1/2] iomap: fix zero padding data issue in concurrent append writes Darrick J. Wong
2024-11-28 6:38 ` Long Li [this message]
2024-11-28 3:33 ` Christoph Hellwig
2024-11-30 13:39 ` Long Li
2024-12-02 15:26 ` Brian Foster
2024-12-03 2:08 ` Dave Chinner
2024-12-03 14:54 ` Brian Foster
2024-12-03 21:12 ` Dave Chinner
2024-12-04 12:05 ` Brian Foster
2024-12-04 9:06 ` Long Li
2024-12-04 12:05 ` Brian Foster
2024-12-06 3:36 ` Long Li
2024-12-04 9:00 ` Long Li
2024-12-04 12:17 ` Brian Foster
2024-12-05 12:47 ` Long Li
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=Z0gP-peky2Se-YIy@localhost.localdomain \
--to=leo.lilong@huawei.com \
--cc=brauner@kernel.org \
--cc=cem@kernel.org \
--cc=djwong@kernel.org \
--cc=houtao1@huawei.com \
--cc=linux-fsdevel@vger.kernel.org \
--cc=linux-xfs@vger.kernel.org \
--cc=yangerkun@huawei.com \
--cc=yi.zhang@huawei.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox