public inbox for linux-btrfs@vger.kernel.org
 help / color / mirror / Atom feed
From: "Darrick J. Wong" <djwong@kernel.org>
To: Andrey Albershteyn <aalbersh@redhat.com>
Cc: Andrey Albershteyn <aalbersh@kernel.org>,
	linux-xfs@vger.kernel.org, fsverity@lists.linux.dev,
	linux-fsdevel@vger.kernel.org, ebiggers@kernel.org, hch@lst.de,
	linux-ext4@vger.kernel.org,
	linux-f2fs-devel@lists.sourceforge.net,
	linux-btrfs@vger.kernel.org
Subject: Re: [PATCH v4 19/25] xfs: remove unwritten extents after preallocations in fsverity metadata
Date: Fri, 13 Mar 2026 07:55:51 -0700	[thread overview]
Message-ID: <20260313145551.GN1770774@frogsfrogsfrogs> (raw)
In-Reply-To: <dz3va7indkh4to2pingopyndck737qvyxvlfomkqqothzj4pdk@wu26ba5stnf6>

On Fri, Mar 13, 2026 at 12:17:15PM +0100, Andrey Albershteyn wrote:
> On 2026-03-12 07:52:50, Darrick J. Wong wrote:
> > On Thu, Mar 12, 2026 at 02:50:57PM +0100, Andrey Albershteyn wrote:
> > > On 2026-03-09 18:29:14, Darrick J. Wong wrote:
> > > > > XFS preallocates spaces during writes. In normal I/O this space, if
> > > > > unused, is removed by truncate. For files with fsverity, XFS does not
> > > > > use truncate as fsverity metadata is stored past EOF.
> > > > > 
> > > > > After we're done with writing fsverity metadata iterate over extents in
> > > > > that region and remove any unwritten ones. These would be preallocation
> > > > > leftovers in the merkle tree holes and past fsverity descriptor.
> > > > > 
> > > > > Signed-off-by: Andrey Albershteyn <aalbersh@kernel.org>
> > > > > ---
> > > 
> > > > There's an upper limit on the number of blocks you can unmap/free in a
> > > > single transaction.  Maybe move the xfs_trans_{alloc,commit} into the
> > > > loop body?
> > > > 
> > > > Oh wait, you skip the written extents.  Ok, so maybe just roll it after
> > > > you've done a bunmapi.
> > > 
> > > I see, I will add a rolling transaction. Btw, why skipping the
> > > written extents let's us use rolling here?
> > 
> > Hrmm.  At first I thought: why can't xfs_fsverity_cancel_unwritten
> > allocate (and commit) the transaction inside the loop body?  Then I
> > thought "well, it's only conditionally unmapping things, and it's sort
> > of a pain to allocate a transaction only then to find out if you
> > actually want to run one".
> > 
> > OTOH there could be billions of extents in the data fork, so holding the
> > ILOCK for that many transactions isn't a good thing because tr_write
> > only preallocates space for a certain number of transaction rolls.
> > fsverity already holds IOLOCK_EXCL so there can't be any other programs
> > using the file.
> > 
> > So now I arrive back at "The transaction allocation and commit/cancel
> > should be inside the loop body, since crashing midway through wouldn't
> > result in user-visible changes to the file data".
> > 
> > > > Do you need to purge the cow fork too?
> > > 
> > > hmm, what case are you thinking about here? The fsverity is written
> > > in past EOF region, I don't see how COW extent could be left there.
> > > Can they somehow be left mapped for blocks past i_size?
> > 
> > I was talking about speculative cow fork preallocations below i_size.
> > They'll eventually get purged by blockgc, but you could give the space
> > back once you've committed enabling the fsverity file flag.
> 
> hmm, if they're purged by blockgc, then why to do it here? I'm

Since you've made the file read-only by turning on fsverity, I think
it's appropriate to return the COW fork preallocations to the free space
pool.  Granted, you're correct that blockgc will eventually call
xfs_reflink_cancel_cow_range for you either due to timeout or because
something hit ENOSPC and kicked blockgc.  So I guess its not a
requirement to land this series; I was just surprised not to see
xfs_reflink_cancel_cow_range done explicitly here.

> iterating and removing unwritten extents here only because
> xfs_inode_free_eofblocks() will skip fsverity inodes, the check in
> xfs_can_free_eofblocks():
> 
> 	if (IS_VERITY(VFS_I(ip)))
> 		return false;
> 
> The skipping is done to not remove all the fsverity metadata
> extents. With preallocations enabled there could be unwritten
> extents left in the metadata.

<nod> Cleaning out the unwritten extents from the data fork when
enabling fsverity makes sense to me and is totally fine.

> Am I missing something?

Nah, but we might be talking past each other a bit at this point. :/

--D

  reply	other threads:[~2026-03-13 14:55 UTC|newest]

Thread overview: 53+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-03-09 19:23 [PATCH v4 00/25] fs-verity support for XFS with post EOF merkle tree Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 01/25] fsverity: report validation errors through fserror to fsnotify Andrey Albershteyn
2026-03-10  0:46   ` Darrick J. Wong
2026-03-11 11:47     ` Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 02/25] fsverity: expose ensure_fsverity_info() Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 03/25] fsverity: generate and store zero-block hash Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 04/25] fsverity: introduce fsverity_folio_zero_hash() Andrey Albershteyn
2026-03-10  0:47   ` Darrick J. Wong
2026-03-09 19:23 ` [PATCH v4 05/25] fsverity: pass digest size and hash of the empty block to ->write Andrey Albershteyn
2026-03-10  0:49   ` Darrick J. Wong
2026-03-09 19:23 ` [PATCH v4 06/25] fsverity: hoist pagecache_read from f2fs/ext4 to fsverity Andrey Albershteyn
2026-03-10  0:49   ` Darrick J. Wong
2026-03-09 19:23 ` [PATCH v4 07/25] iomap: introduce IOMAP_F_FSVERITY and teach writeback to handle fsverity Andrey Albershteyn
2026-03-10  0:54   ` Darrick J. Wong
2026-03-10  8:44   ` Christoph Hellwig
2026-03-09 19:23 ` [PATCH v4 08/25] iomap: obtain fsverity info for read path Andrey Albershteyn
2026-03-10  0:57   ` Darrick J. Wong
2026-03-10  8:44   ` Christoph Hellwig
2026-03-09 19:23 ` [PATCH v4 09/25] iomap: issue readahead for fsverity merkle tree Andrey Albershteyn
2026-03-10  0:57   ` Darrick J. Wong
2026-03-10  8:45   ` Christoph Hellwig
2026-03-09 19:23 ` [PATCH v4 10/25] iomap: teach iomap to handle fsverity holes and verify data holes Andrey Albershteyn
2026-03-10  1:05   ` Darrick J. Wong
2026-03-10 14:42     ` Andrey Albershteyn
2026-03-10  9:14   ` Christoph Hellwig
2026-03-09 19:23 ` [PATCH v4 11/25] iomap: introduce iomap_fsverity_write() for writing fsverity metadata Andrey Albershteyn
2026-03-10  1:02   ` Darrick J. Wong
2026-03-09 19:23 ` [PATCH v4 12/25] xfs: introduce fsverity on-disk changes Andrey Albershteyn
2026-03-10  1:05   ` Darrick J. Wong
2026-03-09 19:23 ` [PATCH v4 13/25] xfs: initialize fs-verity on file open Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 14/25] xfs: don't allow to enable DAX on fs-verity sealed inode Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 15/25] xfs: disable direct read path for fs-verity files Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 16/25] xfs: handle fsverity I/O in write/read path Andrey Albershteyn
2026-03-10  1:17   ` Darrick J. Wong
2026-03-09 19:23 ` [PATCH v4 17/25] xfs: use read ioend for fsverity data verification Andrey Albershteyn
2026-03-10  1:21   ` Darrick J. Wong
2026-03-11 11:40     ` Andrey Albershteyn
2026-03-10  9:11   ` Christoph Hellwig
2026-03-09 19:23 ` [PATCH v4 18/25] xfs: add fs-verity support Andrey Albershteyn
2026-03-10  1:26   ` Darrick J. Wong
2026-03-10 15:26     ` Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 19/25] xfs: remove unwritten extents after preallocations in fsverity metadata Andrey Albershteyn
2026-03-10  1:29   ` Darrick J. Wong
2026-03-12 13:50     ` Andrey Albershteyn
2026-03-12 14:52       ` Darrick J. Wong
2026-03-13 11:17         ` Andrey Albershteyn
2026-03-13 14:55           ` Darrick J. Wong [this message]
2026-03-09 19:23 ` [PATCH v4 20/25] xfs: add fs-verity ioctls Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 21/25] xfs: advertise fs-verity being available on filesystem Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 22/25] xfs: check and repair the verity inode flag state Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 23/25] xfs: introduce health state for corrupted fsverity metadata Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 24/25] xfs: add fsverity traces Andrey Albershteyn
2026-03-09 19:23 ` [PATCH v4 25/25] xfs: enable ro-compat fs-verity flag Andrey Albershteyn

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20260313145551.GN1770774@frogsfrogsfrogs \
    --to=djwong@kernel.org \
    --cc=aalbersh@kernel.org \
    --cc=aalbersh@redhat.com \
    --cc=ebiggers@kernel.org \
    --cc=fsverity@lists.linux.dev \
    --cc=hch@lst.de \
    --cc=linux-btrfs@vger.kernel.org \
    --cc=linux-ext4@vger.kernel.org \
    --cc=linux-f2fs-devel@lists.sourceforge.net \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-xfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox