[GIT PULLBOMB v3] xfsprogs: everything I have for 6.12

[GIT PULLBOMB v3] xfsprogs: everything I have for 6.12

[Darrick J. Wong]

Hi Andrey,

Please pull these patchsets for xfsprogs 6.12.

--D

[GIT PULL 1/7] libxfs: new code for 6.12

[Darrick J. Wong]

Hi Andrey,

Please pull this branch with changes for xfsprogs for 6.11-rc1.

As usual, I did a test-merge with the main upstream branch as of a few
minutes ago, and didn't see any conflicts.  Please let me know if you
encounter any problems.

The following changes since commit 42523142959ddebd127a87e98879f9110da0cc7d:

xfsprogs: update gitignore (2024-10-08 14:31:31 +0200)

are available in the Git repository at:

https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/libxfs-sync-6.12_2024-10-31

for you to fetch changes up to 6611215e3d441a5e6d9d6a2f85c5ea1bf573a8d0:

xfs: update the pag for the last AG at recovery time (2024-10-31 15:45:04 -0700)

----------------------------------------------------------------
libxfs: new code for 6.12 [1/7]

New code for 6.12.

Signed-off-by: Darrick J. Wong <djwong@kernel.org>

----------------------------------------------------------------
Andrey Albershteyn (1):
xfsprogs: Release v6.11.0

Christoph Hellwig (30):
libfrog: add xarray emulation
xfs: remove xfs_validate_rtextents
xfs: factor out a xfs_validate_rt_geometry helper
xfs: remove the limit argument to xfs_rtfind_back
xfs: assert a valid limit in xfs_rtfind_forw
xfs: add bounds checking to xfs_rt{bitmap,summary}_read_buf
xfs: factor out rtbitmap/summary initialization helpers
xfs: push transaction join out of xfs_rtbitmap_lock and xfs_rtgroup_lock
xfs: ensure rtx mask/shift are correct after growfs
xfs: remove xfs_rtb_to_rtxrem
xfs: simplify xfs_rtalloc_query_range
xfs: clean up the ISVALID macro in xfs_bmap_adjacent
xfs: remove xfs_{rtbitmap,rtsummary}_wordcount
xfs: replace m_rsumsize with m_rsumblocks
xfs: use kfree_rcu_mightsleep to free the perag structures
xfs: move the tagged perag lookup helpers to xfs_icache.c
xfs: convert perag lookup to xarray
xfs: ensure st_blocks never goes to zero during COW writes
xfs: merge xfs_attr_leaf_try_add into xfs_attr_leaf_addname
xfs: return bool from xfs_attr3_leaf_add
xfs: distinguish extra split from real ENOSPC from xfs_attr3_leaf_split
xfs: distinguish extra split from real ENOSPC from xfs_attr_node_try_addname
xfs: fold xfs_bmap_alloc_userdata into xfs_bmapi_allocate
xfs: don't ifdef around the exact minlen allocations
xfs: call xfs_bmap_exact_minlen_extent_alloc from xfs_bmap_btalloc
xfs: support lowmode allocations in xfs_bmap_exact_minlen_extent_alloc
xfs: pass the exact range to initialize to xfs_initialize_perag
xfs: merge the perag freeing helpers
xfs: don't use __GFP_RETRY_MAYFAIL in xfs_initialize_perag
xfs: update the pag for the last AG at recovery time

Dan Carpenter (1):
xfs: remove unnecessary check

Darrick J. Wong (8):
libxfs: require -std=gnu11 for compilation by default
libxfs: test compiling public headers with a C++ compiler
libxfs: port IS_ENABLED from the kernel
xfs: introduce new file range commit ioctls
xfs: pass the icreate args object to xfs_dialloc
xfs: fix a sloppy memory handling bug in xfs_iroot_realloc
xfs: replace shouty XFS_BM{BT,DR} macros
xfs: standardize the btree maxrecs function parameters

Dave Chinner (1):
xfs: use kvmalloc for xattr buffers

Pankaj Raghav (1):
xfs: enable block size larger than page size support

VERSION                     |   4 +-
configure.ac                |  15 ++-
db/bmap.c                   |  10 +-
db/bmap_inflate.c           |   2 +-
db/bmroot.c                 |   8 +-
db/btheight.c               |  18 +--
db/check.c                  |  11 +-
db/frag.c                   |   8 +-
db/iunlink.c                |   2 +-
db/metadump.c               |  16 +--
debian/changelog            |   6 +
doc/CHANGES                 |   5 +
include/builddefs.in        |   8 ++
include/kmem.h              |  11 ++
include/libxfs.h            |   6 +-
include/platform_defs.h     |  63 ++++++++++
include/xfs_mount.h         |   4 +-
libfrog/radix-tree.h        |  35 ++++++
libxfs/Makefile             |  31 ++++-
libxfs/defer_item.c         |  14 +++
libxfs/init.c               |  17 +--
libxfs/ioctl_c_dummy.c      |  11 ++
libxfs/ioctl_cxx_dummy.cpp  |  13 +++
libxfs/libxfs_api_defs.h    |   2 +-
libxfs/libxfs_priv.h        |   6 +-
libxfs/xfs_ag.c             | 165 ++++++--------------------
libxfs/xfs_ag.h             |  25 +---
libxfs/xfs_alloc.c          |   7 +-
libxfs/xfs_alloc.h          |   4 +-
libxfs/xfs_alloc_btree.c    |   6 +-
libxfs/xfs_alloc_btree.h    |   3 +-
libxfs/xfs_attr.c           | 190 +++++++++++++-----------------
libxfs/xfs_attr_leaf.c      |  63 +++++-----
libxfs/xfs_attr_leaf.h      |   2 +-
libxfs/xfs_bmap.c           | 243 ++++++++++++++++-----------------------
libxfs/xfs_bmap_btree.c     |  24 ++--
libxfs/xfs_bmap_btree.h     | 207 ++++++++++++++++++++++-----------
libxfs/xfs_da_btree.c       |   5 +-
libxfs/xfs_fs.h             |  26 +++++
libxfs/xfs_ialloc.c         |  14 ++-
libxfs/xfs_ialloc.h         |   4 +-
libxfs/xfs_ialloc_btree.c   |   6 +-
libxfs/xfs_ialloc_btree.h   |   3 +-
libxfs/xfs_inode_fork.c     |  40 +++----
libxfs/xfs_inode_util.c     |   2 +-
libxfs/xfs_refcount_btree.c |   5 +-
libxfs/xfs_refcount_btree.h |   3 +-
libxfs/xfs_rmap_btree.c     |   7 +-
libxfs/xfs_rmap_btree.h     |   3 +-
libxfs/xfs_rtbitmap.c       | 274 +++++++++++++++++++++++++++++++-------------
libxfs/xfs_rtbitmap.h       |  61 ++--------
libxfs/xfs_sb.c             |  92 ++++++++-------
libxfs/xfs_sb.h             |   3 +
libxfs/xfs_shared.h         |   3 +
libxfs/xfs_trans_resv.c     |   4 +-
libxfs/xfs_types.h          |  12 --
m4/package_utilies.m4       |   5 +
mkfs/proto.c                |  17 ++-
repair/bmap_repair.c        |   2 +-
repair/dinode.c             |  17 +--
repair/phase5.c             |  16 +--
repair/phase6.c             |  18 ++-
repair/prefetch.c           |   8 +-
repair/rt.c                 |   7 +-
repair/scan.c               |   6 +-
65 files changed, 1076 insertions(+), 852 deletions(-)
create mode 100644 libxfs/ioctl_c_dummy.c
create mode 100644 libxfs/ioctl_cxx_dummy.cpp

[GIT PULL 2/7] xfsprogs: atomic file content commits

[Darrick J. Wong]

Hi Andrey,

Please pull this branch with changes for xfsprogs for 6.11-rc1.

As usual, I did a test-merge with the main upstream branch as of a few
minutes ago, and didn't see any conflicts.  Please let me know if you
encounter any problems.

The following changes since commit 6611215e3d441a5e6d9d6a2f85c5ea1bf573a8d0:

xfs: update the pag for the last AG at recovery time (2024-10-31 15:45:04 -0700)

are available in the Git repository at:

https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/atomic-file-commits-6.12_2024-10-31

for you to fetch changes up to 1cf7afbc0c8bcb450ebc3acab7616c9da49087de:

xfs_io: add atomic file update commands to exercise file commit range (2024-10-31 15:45:04 -0700)

----------------------------------------------------------------
xfsprogs: atomic file content commits [v31.3 2/7]

This series creates XFS_IOC_START_COMMIT and XFS_IOC_COMMIT_RANGE ioctls
to perform the exchange only if the target file has not been changed
since a given sampling point.

This new functionality uses the mechanism underlying EXCHANGE_RANGE to
stage and commit file updates such that reader programs will see either
the old contents or the new contents in their entirety, with no chance
of torn writes.  A successful call completion guarantees that the new
contents will be seen even if the system fails.  The pair of ioctls
allows userspace to perform what amounts to a compare and exchange
operation on entire file contents.

Note that there are ongoing arguments in the community about how best to
implement some sort of file data write counter that nfsd could also use
to signal invalidations to clients.  Until such a thing is implemented,
this patch will rely on ctime/mtime updates.

Signed-off-by: Darrick J. Wong <djwong@kernel.org>

----------------------------------------------------------------
Darrick J. Wong (7):
man: document file range commit ioctls
libfrog: add support for commit range ioctl family
libxfs: remove unused xfs_inode fields
libxfs: validate inumber in xfs_iget
xfs_fsr: port to new file exchange library function
xfs_io: add a commitrange option to the exchangerange command
xfs_io: add atomic file update commands to exercise file commit range

fsr/xfs_fsr.c                     |  74 ++++----
include/xfs_inode.h               |   4 -
io/exchrange.c                    | 390 +++++++++++++++++++++++++++++++++++++-
io/io.h                           |   4 +
io/open.c                         |  27 ++-
libfrog/file_exchange.c           | 194 +++++++++++++++++++
libfrog/file_exchange.h           |  10 +
libxfs/inode.c                    |   2 +-
man/man2/ioctl_xfs_commit_range.2 | 296 +++++++++++++++++++++++++++++
man/man2/ioctl_xfs_fsgeometry.2   |   2 +-
man/man2/ioctl_xfs_start_commit.2 |   1 +
man/man8/xfs_io.8                 |  35 +++-
12 files changed, 983 insertions(+), 56 deletions(-)
create mode 100644 man/man2/ioctl_xfs_commit_range.2
create mode 100644 man/man2/ioctl_xfs_start_commit.2

[GIT PULL 3/7] xfs_db: debug realtime geometry

[Darrick J. Wong]

Hi Andrey,

Please pull this branch with changes for xfsprogs for 6.11-rc1.

As usual, I did a test-merge with the main upstream branch as of a few
minutes ago, and didn't see any conflicts.  Please let me know if you
encounter any problems.

The following changes since commit 1cf7afbc0c8bcb450ebc3acab7616c9da49087de:

xfs_io: add atomic file update commands to exercise file commit range (2024-10-31 15:45:04 -0700)

are available in the Git repository at:

https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/debug-realtime-geometry-6.12_2024-10-31

for you to fetch changes up to 5f10590bae67d7698191a1392b6b1d3ce4d11a0c:

xfs_db: convert rtsummary geometry (2024-10-31 15:45:05 -0700)

----------------------------------------------------------------
xfs_db: debug realtime geometry [v5.3 3/7]

Before we start modernizing the realtime device, let's first make a few
improvements to the XFS debugger to make our lives easier.  First up is
making it so that users can point the debugger at the block device
containing the realtime section, and augmenting the io cursor code to be
able to read blocks from the rt device.  Next, we add a new geometry
conversion command (rtconvert) to make it easier to go back and forth
between rt blocks, rt extents, and the corresponding locations within
the rt bitmap and summary files.

Signed-off-by: Darrick J. Wong <djwong@kernel.org>

----------------------------------------------------------------
Darrick J. Wong (8):
xfs_db: support passing the realtime device to the debugger
xfs_db: report the realtime device when associated with each io cursor
xfs_db: make the daddr command target the realtime device
xfs_db: access realtime file blocks
xfs_db: access arbitrary realtime blocks and extents
xfs_db: enable conversion of rt space units
xfs_db: convert rtbitmap geometry
xfs_db: convert rtsummary geometry

db/block.c        | 171 ++++++++++++++++++++-
db/block.h        |  20 +++
db/convert.c      | 438 +++++++++++++++++++++++++++++++++++++++++++++++++++---
db/faddr.c        |   5 +-
db/init.c         |   7 +-
db/io.c           |  39 ++++-
db/io.h           |   3 +
db/xfs_admin.sh   |   4 +-
man/man8/xfs_db.8 | 131 +++++++++++++++-
9 files changed, 778 insertions(+), 40 deletions(-)

[GIT PULL 4/7] xfs_metadump: support external devices

[Darrick J. Wong]

Hi Andrey,

Please pull this branch with changes for xfsprogs for 6.11-rc1.

As usual, I did a test-merge with the main upstream branch as of a few
minutes ago, and didn't see any conflicts.  Please let me know if you
encounter any problems.

The following changes since commit 5f10590bae67d7698191a1392b6b1d3ce4d11a0c:

xfs_db: convert rtsummary geometry (2024-10-31 15:45:05 -0700)

are available in the Git repository at:

https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/metadump-external-devices-6.12_2024-10-31

for you to fetch changes up to 5e8139658b798d931079404660273840432bcd9f:

xfs_db: allow setting current address to log blocks (2024-10-31 15:45:05 -0700)

----------------------------------------------------------------
xfs_metadump: support external devices [v5.3 4/7]

This series augments the xfs_metadump and xfs_mdrestore utilities to
capture the contents of an external log in a metadump, and restore it on
the other end.  This will enable better debugging analysis of broken
filesystems, since it will now be possible to capture external log data.
This is a prequisite for the rt groups feature, since we'll also need to
capture the rt superblocks written to the rt device.

This also means we can capture the contents of external logs for better
analysis by support staff.

Signed-off-by: Darrick J. Wong <djwong@kernel.org>

----------------------------------------------------------------
Darrick J. Wong (1):
xfs_db: allow setting current address to log blocks

db/block.c        | 103 +++++++++++++++++++++++++++++++++++++++++++++++++++++-
man/man8/xfs_db.8 |  17 +++++++++
2 files changed, 119 insertions(+), 1 deletion(-)

[GIT PULL 5/7] mkfs/repair: use new rtbitmap helpers

[Darrick J. Wong]

Hi Andrey,

Please pull this branch with changes for xfsprogs for 6.11-rc1.

As usual, I did a test-merge with the main upstream branch as of a few
minutes ago, and didn't see any conflicts.  Please let me know if you
encounter any problems.

The following changes since commit 5e8139658b798d931079404660273840432bcd9f:

xfs_db: allow setting current address to log blocks (2024-10-31 15:45:05 -0700)

are available in the Git repository at:

https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/misc-use-rtbitmap-helpers-6.12_2024-10-31

for you to fetch changes up to 07c09d46665cfac48256f6faf829897554ec74bf:

xfs_repair: stop preallocating blocks in mk_rbmino and mk_rsumino (2024-10-31 15:45:05 -0700)

----------------------------------------------------------------
mkfs/repair: use new rtbitmap helpers [v5.3 5/7]

Use the new rtfile helpers to create the rt bitmap and summary files instead of
duplicating the logic that the in-kernel growfs already had.

Signed-off-by: Darrick J. Wong <djwong@kernel.org>

----------------------------------------------------------------
Christoph Hellwig (5):
xfs_repair: use xfs_validate_rt_geometry
mkfs: remove a pointless rtfreesp_init forward declaration
mkfs: use xfs_rtfile_initialize_blocks
xfs_repair: use libxfs_rtfile_initialize_blocks
xfs_repair: stop preallocating blocks in mk_rbmino and mk_rsumino

Darrick J. Wong (1):
xfs_repair: checking rt free space metadata must happen during phase 4

libxfs/libxfs_api_defs.h |   2 +
mkfs/proto.c             | 107 +++---------------
repair/phase4.c          |   7 ++
repair/phase5.c          |   6 -
repair/phase6.c          | 284 ++++++++---------------------------------------
repair/sb.c              |  40 +------
repair/xfs_repair.c      |   3 -
7 files changed, 73 insertions(+), 376 deletions(-)

[GIT PULL 6/7] xfs_scrub_all: bug fix for 6.12

[Darrick J. Wong]

Hi Andrey,

Please pull this branch with changes for xfsprogs for 6.11-rc1.

As usual, I did a test-merge with the main upstream branch as of a few
minutes ago, and didn't see any conflicts.  Please let me know if you
encounter any problems.

The following changes since commit 07c09d46665cfac48256f6faf829897554ec74bf:

xfs_repair: stop preallocating blocks in mk_rbmino and mk_rsumino (2024-10-31 15:45:05 -0700)

are available in the Git repository at:

https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/scrub-fixes-6.12_2024-10-31

for you to fetch changes up to 024f91c02f22a6f1f1256a5b09323bc3b104f839:

xfs_scrub_all: wait for services to start activating (2024-10-31 15:45:05 -0700)

----------------------------------------------------------------
xfs_scrub_all: bug fix for 6.12 [v31.3 6/7]

Fix a problem with xfs_scrub_all mistakenly thinking that a service finished
before it really did.

Signed-off-by: Darrick J. Wong <djwong@kernel.org>

----------------------------------------------------------------
Darrick J. Wong (1):
xfs_scrub_all: wait for services to start activating

scrub/xfs_scrub_all.in | 52 ++++++++++++++++++++++++++++++++++++++++++++++++++
1 file changed, 52 insertions(+)

[GIT PULL 7/7] mkfs: new config file for 6.12 LTS

[Darrick J. Wong]

Hi Andrey,

Please pull this branch with changes for xfsprogs for 6.11-rc1.

As usual, I did a test-merge with the main upstream branch as of a few
minutes ago, and didn't see any conflicts.  Please let me know if you
encounter any problems.

The following changes since commit 024f91c02f22a6f1f1256a5b09323bc3b104f839:

xfs_scrub_all: wait for services to start activating (2024-10-31 15:45:05 -0700)

are available in the Git repository at:

https://git.kernel.org/pub/scm/linux/kernel/git/djwong/xfsprogs-dev.git tags/mkfs-configs-6.12_2024-10-31

for you to fetch changes up to d19c5581b03e236de3737a35e53c99529ac8e912:

mkfs: add a config file for 6.12 LTS kernels (2024-10-31 15:45:05 -0700)

----------------------------------------------------------------
mkfs: new config file for 6.12 LTS [7/7]

New mkfs config file for 6.12 LTS.

Signed-off-by: Darrick J. Wong <djwong@kernel.org>

----------------------------------------------------------------
Darrick J. Wong (1):
mkfs: add a config file for 6.12 LTS kernels

mkfs/Makefile      |  3 ++-
mkfs/lts_6.12.conf | 19 +++++++++++++++++++
2 files changed, 21 insertions(+), 1 deletion(-)
create mode 100644 mkfs/lts_6.12.conf