[ANNOUNCE] xfs-linux: for-next updated to 22c2699cb068

[ANNOUNCE] xfs-linux: for-next updated to 22c2699cb068

[Chandan Babu R]

Hi folks,

The for-next branch of the xfs-linux repository at:

	https://git.kernel.org/pub/scm/fs/xfs/xfs-linux.git

has just been updated.

Patches often get missed, so please check if your outstanding patches
were in this update. If they have not been in this update, please
resubmit them to linux-xfs@vger.kernel.org so they can be picked up in
the next update.

The new head of the for-next branch is commit:

22c2699cb068 mm, pmem, xfs: Introduce MF_MEM_PRE_REMOVE for unbind

47 new commits:

Catherine Hoang (1):
      [14a537983b22] xfs: allow read IO and FICLONE to run concurrently

Chandan Babu R (6):
      [d0e85e79d680] Merge tag 'realtime-fixes-6.7_2023-10-19' of https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfs-linux into xfs-6.7-mergeA
      [3ef52c010973] Merge tag 'clean-up-realtime-units-6.7_2023-10-19' of https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfs-linux into xfs-6.7-mergeA
      [9d4ca5afa604] Merge tag 'refactor-rt-unit-conversions-6.7_2023-10-19' of https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfs-linux into xfs-6.7-mergeA
      [035e32f7524d] Merge tag 'refactor-rtbitmap-macros-6.7_2023-10-19' of https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfs-linux into xfs-6.7-mergeA
      [830b4abfe2de] Merge tag 'refactor-rtbitmap-accessors-6.7_2023-10-19' of https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfs-linux into xfs-6.7-mergeA
      [9fa8753aa1f1] Merge tag 'rtalloc-speedups-6.7_2023-10-19' of https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfs-linux into xfs-6.7-mergeA

Cheng Lin (1):
      [2b99e410b28f] xfs: introduce protection for drop nlink

Christoph Hellwig (1):
      [35dc55b9e80c] xfs: handle nimaps=0 from xfs_bmapi_write in xfs_alloc_file_space

Darrick J. Wong (30):
      [948806280594] xfs: bump max fsgeom struct version
      [6c664484337b] xfs: hoist freeing of rt data fork extent mappings
      [b73494fa9a30] xfs: prevent rt growfs when quota is enabled
      [c2988eb5cff7] xfs: rt stubs should return negative errnos when rt disabled
      [ddd98076d5c0] xfs: fix units conversion error in xfs_bmap_del_extent_delay
      [f6a2dae2a1f5] xfs: make sure maxlen is still congruent with prod when rounding down
      [13928113fc5b] xfs: move the xfs_rtbitmap.c declarations to xfs_rtbitmap.h
      [a684c538bc14] xfs: convert xfs_extlen_t to xfs_rtxlen_t in the rt allocator
      [fa5a38723086] xfs: create a helper to convert rtextents to rtblocks
      [03f4de332e2e] xfs: convert rt bitmap/summary block numbers to xfs_fileoff_t
      [68db60bf01c1] xfs: create a helper to compute leftovers of realtime extents
      [f29c3e745dc2] xfs: convert rt bitmap extent lengths to xfs_rtbxlen_t
      [2c2b981b737a] xfs: create a helper to convert extlen to rtextlen
      [3d2b6d034f0f] xfs: rename xfs_verify_rtext to xfs_verify_rtbext
      [5dc3a80d46a4] xfs: create helpers to convert rt block numbers to rt extent numbers
      [2d5f216b77e3] xfs: convert rt extent numbers to xfs_rtxnum_t
      [055641248f64] xfs: convert do_div calls to xfs_rtb_to_rtx helper calls
      [5f57f7309d9a] xfs: create rt extent rounding helpers for realtime extent blocks
      [90d98a6ada1d] xfs: convert the rtbitmap block and bit macros to static inline functions
      [ef5a83b7e597] xfs: use shifting and masking when converting rt extents, if possible
      [add3cddaea50] xfs: remove XFS_BLOCKWSIZE and XFS_BLOCKWMASK macros
      [a9948626849c] xfs: convert open-coded xfs_rtword_t pointer accesses to helper
      [097b4b7b64ef] xfs: convert rt summary macros to helpers
      [312d61021b89] xfs: create a helper to handle logging parts of rt bitmap/summary blocks
      [d0448fe76ac1] xfs: create helpers for rtbitmap block/wordcount computations
      [97e993830a1c] xfs: use accessor functions for bitmap words
      [bd85af280de6] xfs: create helpers for rtsummary block/wordcount computations
      [663b8db7b025] xfs: use accessor functions for summary info words
      [5b1d0ae9753f] xfs: simplify xfs_rtbuf_get calling conventions
      [e2cf427c9149] xfs: simplify rt bitmap/summary block accessor functions

Dave Chinner (1):
      [41f33d82cfd3] xfs: consolidate realtime allocation arguments

Omar Sandoval (6):
      [e94b53ff699c] xfs: cache last bitmap block in realtime allocator
      [e23aaf450de7] xfs: invert the realtime summary cache
      [1b5d63963f98] xfs: return maximum free size from xfs_rtany_summary()
      [ec5857bf0763] xfs: limit maxlen based on available space in xfs_rtallocate_extent_near()
      [85fa2c774397] xfs: don't try redundant allocations in xfs_rtallocate_extent_near()
      [e0f7422f54b0] xfs: don't look for end of extent further than necessary in xfs_rtallocate_extent_near()

Shiyang Ruan (1):
      [22c2699cb068] mm, pmem, xfs: Introduce MF_MEM_PRE_REMOVE for unbind

Code Diffstat:

 drivers/dax/super.c            |   3 +-
 fs/xfs/libxfs/xfs_bmap.c       |  45 +++----
 fs/xfs/libxfs/xfs_format.h     |  34 ++---
 fs/xfs/libxfs/xfs_rtbitmap.c   | 803 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++-----------------------------------------------------
 fs/xfs/libxfs/xfs_rtbitmap.h   | 383 ++++++++++++++++++++++++++++++++++++++++++++++++++++++++
 fs/xfs/libxfs/xfs_sb.c         |   2 +
 fs/xfs/libxfs/xfs_sb.h         |   2 +-
 fs/xfs/libxfs/xfs_trans_resv.c |  10 +-
 fs/xfs/libxfs/xfs_types.c      |   4 +-
 fs/xfs/libxfs/xfs_types.h      |  10 +-
 fs/xfs/scrub/bmap.c            |   2 +-
 fs/xfs/scrub/fscounters.c      |   2 +-
 fs/xfs/scrub/inode.c           |   3 +-
 fs/xfs/scrub/rtbitmap.c        |  28 ++---
 fs/xfs/scrub/rtsummary.c       |  72 ++++++-----
 fs/xfs/scrub/trace.c           |   1 +
 fs/xfs/scrub/trace.h           |  15 +--
 fs/xfs/xfs_bmap_util.c         |  74 +++++------
 fs/xfs/xfs_file.c              |  63 ++++++++--
 fs/xfs/xfs_fsmap.c             |  15 +--
 fs/xfs/xfs_inode.c             |  24 ++++
 fs/xfs/xfs_inode.h             |   9 ++
 fs/xfs/xfs_inode_item.c        |   3 +-
 fs/xfs/xfs_ioctl.c             |   5 +-
 fs/xfs/xfs_linux.h             |  12 ++
 fs/xfs/xfs_mount.h             |   8 +-
 fs/xfs/xfs_notify_failure.c    | 108 +++++++++++++++-
 fs/xfs/xfs_ondisk.h            |   4 +
 fs/xfs/xfs_reflink.c           |   4 +
 fs/xfs/xfs_rtalloc.c           | 626 +++++++++++++++++++++++++++++++++++++++++++++----------------------------------------------
 fs/xfs/xfs_rtalloc.h           |  94 ++------------
 fs/xfs/xfs_super.c             |   3 +-
 fs/xfs/xfs_trans.c             |   7 +-
 include/linux/mm.h             |   1 +
 mm/memory-failure.c            |  21 +++-
 35 files changed, 1547 insertions(+), 953 deletions(-)
 create mode 100644 fs/xfs/libxfs/xfs_rtbitmap.h

Re: [ANNOUNCE] xfs-linux: for-next updated to 22c2699cb068

[Christoph Hellwig]

Can you also pick up:

"xfs: only remap the written blocks in xfs_reflink_end_cow_extent"

?

Also this seems to a bit of a mix of fixes for 6.7 and big stuff that
is too late for the merge window.

Re: [ANNOUNCE] xfs-linux: for-next updated to 22c2699cb068

[Chandan Babu R]

On Tue, Oct 31, 2023 at 10:02:42 AM +0100, Christoph Hellwig wrote:
> Can you also pick up:
>
> "xfs: only remap the written blocks in xfs_reflink_end_cow_extent"
>
> ?

Sorry, I missed the above patch. I will add it as part of fixes for 6.7-rc1.

>
> Also this seems to a bit of a mix of fixes for 6.7 and big stuff that
> is too late for the merge window.

I ended up doing two rounds of testing since I had to execute the tests the
second time after dropping the "xfs: up(ic_sema) if flushing data device
fails" patch. I hope to send the pull request by end of Wednesday.

-- 
Chandan

Re: [ANNOUNCE] xfs-linux: for-next updated to 22c2699cb068

[Darrick J. Wong]

On Tue, Oct 31, 2023 at 10:02:42AM +0100, Christoph Hellwig wrote:
> Can you also pick up:
> 
> "xfs: only remap the written blocks in xfs_reflink_end_cow_extent"
> 
> ?
> 
> Also this seems to a bit of a mix of fixes for 6.7 and big stuff that
> is too late for the merge window.

If by 'big stuff' you mean the MF_MEM_PRE_REMOVE patch, then yes, I
agree that it's too late to be changing code outside xfs.  Bumping that
to 6.8 will disappoint Shiyang, regrettably.

The patchsets for realtime units refactoring and typechecked rt-helpers
(except for the xfs_rtalloc_args thing) I'd prefer to land in 6.7 for a
few reasons.  First, the blast radii are contained to the rtalloc
subsystem of xfs.  Second, I've been testing them for nearly a year now,
I think they're ready from a QA perspective.

The third selfish reason for wanting to get the xfs realtime stuff off
my plate is that my goal for 6.8 is to try to eliminate the indirect
->iomap_begin/end calls from iomap.  It'll be helpful for me to be able
to focus exclusively on that since I'd really like your help making sure
I do the transition correctly. :)

--D

Re: [ANNOUNCE] xfs-linux: for-next updated to 22c2699cb068

[Chandan Babu R]

On Tue, Oct 31, 2023 at 09:43:59 AM -0700, Darrick J. Wong wrote:
> On Tue, Oct 31, 2023 at 10:02:42AM +0100, Christoph Hellwig wrote:
>> Can you also pick up:
>> 
>> "xfs: only remap the written blocks in xfs_reflink_end_cow_extent"
>> 
>> ?
>> 
>> Also this seems to a bit of a mix of fixes for 6.7 and big stuff that
>> is too late for the merge window.
>
> If by 'big stuff' you mean the MF_MEM_PRE_REMOVE patch, then yes, I
> agree that it's too late to be changing code outside xfs.  Bumping that
> to 6.8 will disappoint Shiyang, regrettably.
>

I am sorry Shiyang, I will have to postpone your "mm, pmem, xfs: Introduce
MF_MEM_PRE_REMOVE for unbind" patch for v6.8. The delay was my
mistake. Apologies once again.

I have updated xfs-linux's for-next branch and I will be sending an
announcement shortly.

-- 
Chandan

Re: [ANNOUNCE] xfs-linux: for-next updated to 22c2699cb068

[Christoph Hellwig]

On Tue, Oct 31, 2023 at 09:43:59AM -0700, Darrick J. Wong wrote:
> If by 'big stuff' you mean the MF_MEM_PRE_REMOVE patch, then yes, I
> agree that it's too late to be changing code outside xfs.  Bumping that
> to 6.8 will disappoint Shiyang, regrettably.
> 
> The patchsets for realtime units refactoring and typechecked rt-helpers
> (except for the xfs_rtalloc_args thing) I'd prefer to land in 6.7 for a
> few reasons.  First, the blast radii are contained to the rtalloc
> subsystem of xfs.  Second, I've been testing them for nearly a year now,
> I think they're ready from a QA perspective.

I mean both of them.  And yes, I was hoping to see the RT work in 6.7
as well, but for that it needs to be in linux-next before the release
of 6.6.

Re: [ANNOUNCE] xfs-linux: for-next updated to 22c2699cb068

[Shiyang Ruan]

在 2023/11/1 1:02, Chandan Babu R 写道:
> On Tue, Oct 31, 2023 at 09:43:59 AM -0700, Darrick J. Wong wrote:
>> On Tue, Oct 31, 2023 at 10:02:42AM +0100, Christoph Hellwig wrote:
>>> Can you also pick up:
>>>
>>> "xfs: only remap the written blocks in xfs_reflink_end_cow_extent"
>>>
>>> ?
>>>
>>> Also this seems to a bit of a mix of fixes for 6.7 and big stuff that
>>> is too late for the merge window.
>>
>> If by 'big stuff' you mean the MF_MEM_PRE_REMOVE patch, then yes, I
>> agree that it's too late to be changing code outside xfs.  Bumping that
>> to 6.8 will disappoint Shiyang, regrettably.
>>
> 
> I am sorry Shiyang, I will have to postpone your "mm, pmem, xfs: Introduce
> MF_MEM_PRE_REMOVE for unbind" patch for v6.8. The delay was my
> mistake. Apologies once again.

Never mind~  Then we'll have more time to test it, make sure the 
functionality is good.


--
Thanks,
Ruan.

> 
> I have updated xfs-linux's for-next branch and I will be sending an
> announcement shortly.
>