* [PATCH v4 2/6] common/config: export F2FS_INJECT_PROG
2025-03-12 7:23 [PATCH v4 1/6] common/config: remove redundant export variables Chao Yu
@ 2025-03-12 7:23 ` Chao Yu
2025-03-12 7:23 ` [PATCH v4 3/6] common/config: export F2FS_FSCK_PROG Chao Yu
` (3 subsequent siblings)
4 siblings, 0 replies; 10+ messages in thread
From: Chao Yu @ 2025-03-12 7:23 UTC (permalink / raw)
To: Zorro Lang, fstests
Cc: jaegeuk, linux-f2fs-devel, Chao Yu, David Disseldorp, Zorro Lang
export F2FS_INJECT_PROG w/ inject.f2fs, it can be used for fault injection.
Cc: Jaegeuk Kim <jaegeuk@kernel.org>
Reviewed-by: David Disseldorp <ddiss@suse.de>
Reviewed-by: Zorro Lang <zlang@redhat.com>
Signed-off-by: Chao Yu <chao@kernel.org>
---
v4:
- no changes
common/config | 1 +
1 file changed, 1 insertion(+)
diff --git a/common/config b/common/config
index aa525825..7d017a05 100644
--- a/common/config
+++ b/common/config
@@ -316,6 +316,7 @@ export MKFS_BTRFS_PROG=$(set_mkfs_prog_path_with_opts btrfs)
export MKFS_F2FS_PROG=$(set_mkfs_prog_path_with_opts f2fs)
export DUMP_F2FS_PROG=$(type -P dump.f2fs)
export F2FS_IO_PROG=$(type -P f2fs_io)
+export F2FS_INJECT_PROG=$(type -P inject.f2fs)
export BTRFS_UTIL_PROG=$(type -P btrfs)
export BTRFS_SHOW_SUPER_PROG=$(type -P btrfs-show-super)
export BTRFS_CONVERT_PROG=$(type -P btrfs-convert)
--
2.48.1
^ permalink raw reply related [flat|nested] 10+ messages in thread* [PATCH v4 3/6] common/config: export F2FS_FSCK_PROG
2025-03-12 7:23 [PATCH v4 1/6] common/config: remove redundant export variables Chao Yu
2025-03-12 7:23 ` [PATCH v4 2/6] common/config: export F2FS_INJECT_PROG Chao Yu
@ 2025-03-12 7:23 ` Chao Yu
2025-03-12 7:23 ` [PATCH v4 4/6] common/rc: use -f for mkfs.f2fs by default Chao Yu
` (2 subsequent siblings)
4 siblings, 0 replies; 10+ messages in thread
From: Chao Yu @ 2025-03-12 7:23 UTC (permalink / raw)
To: Zorro Lang, fstests; +Cc: jaegeuk, linux-f2fs-devel, Chao Yu, Zorro Lang
Let's export F2FS_FSCK_PROG, then we can use it in
_check_f2fs_filesystem() later.
Cc: Jaegeuk Kim <jaegeuk@kernel.org>
Reviewed-by: Zorro Lang <zlang@redhat.com>
Signed-off-by: Chao Yu <chao@kernel.org>
---
v4:
- no changes
common/config | 1 +
1 file changed, 1 insertion(+)
diff --git a/common/config b/common/config
index 7d017a05..79bec87f 100644
--- a/common/config
+++ b/common/config
@@ -317,6 +317,7 @@ export MKFS_F2FS_PROG=$(set_mkfs_prog_path_with_opts f2fs)
export DUMP_F2FS_PROG=$(type -P dump.f2fs)
export F2FS_IO_PROG=$(type -P f2fs_io)
export F2FS_INJECT_PROG=$(type -P inject.f2fs)
+export F2FS_FSCK_PROG=$(type -P fsck.f2fs)
export BTRFS_UTIL_PROG=$(type -P btrfs)
export BTRFS_SHOW_SUPER_PROG=$(type -P btrfs-show-super)
export BTRFS_CONVERT_PROG=$(type -P btrfs-convert)
--
2.48.1
^ permalink raw reply related [flat|nested] 10+ messages in thread* [PATCH v4 4/6] common/rc: use -f for mkfs.f2fs by default
2025-03-12 7:23 [PATCH v4 1/6] common/config: remove redundant export variables Chao Yu
2025-03-12 7:23 ` [PATCH v4 2/6] common/config: export F2FS_INJECT_PROG Chao Yu
2025-03-12 7:23 ` [PATCH v4 3/6] common/config: export F2FS_FSCK_PROG Chao Yu
@ 2025-03-12 7:23 ` Chao Yu
2025-03-12 7:23 ` [PATCH v4 5/6] common/rc: introduce _check_f2fs_filesystem() Chao Yu
2025-03-12 7:23 ` [PATCH v4 6/6] f2fs/009: detect and repair nlink corruption Chao Yu
4 siblings, 0 replies; 10+ messages in thread
From: Chao Yu @ 2025-03-12 7:23 UTC (permalink / raw)
To: Zorro Lang, fstests; +Cc: jaegeuk, linux-f2fs-devel, Chao Yu, Zorro Lang
Otherwise, mkfs will fail due to there is an existing filesystem
in the image.
Cc: Jaegeuk Kim <jaegeuk@kernel.org>
Reviewed-by: Zorro Lang <zlang@redhat.com>
Signed-off-by: Chao Yu <chao@kernel.org>
---
v4:
- no changes
common/rc | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git a/common/rc b/common/rc
index ca755055..23b642f4 100644
--- a/common/rc
+++ b/common/rc
@@ -993,7 +993,7 @@ _scratch_mkfs()
mkfs_filter="grep -v -e ^Warning: -e \"^mke2fs \""
;;
f2fs)
- mkfs_cmd="$MKFS_F2FS_PROG"
+ mkfs_cmd="$MKFS_F2FS_PROG -f"
mkfs_filter="cat"
;;
ocfs2)
@@ -1336,7 +1336,7 @@ _try_scratch_mkfs_sized()
f2fs)
# mkfs.f2fs requires # of sectors as an input for the size
local sector_size=`blockdev --getss $SCRATCH_DEV`
- $MKFS_F2FS_PROG $MKFS_OPTIONS "$@" $SCRATCH_DEV `expr $fssize / $sector_size`
+ $MKFS_F2FS_PROG -f $MKFS_OPTIONS "$@" $SCRATCH_DEV `expr $fssize / $sector_size`
;;
tmpfs)
local free_mem=`_free_memory_bytes`
--
2.48.1
^ permalink raw reply related [flat|nested] 10+ messages in thread
* [PATCH v4 5/6] common/rc: introduce _check_f2fs_filesystem()
2025-03-12 7:23 [PATCH v4 1/6] common/config: remove redundant export variables Chao Yu
` (2 preceding siblings ...)
2025-03-12 7:23 ` [PATCH v4 4/6] common/rc: use -f for mkfs.f2fs by default Chao Yu
@ 2025-03-12 7:23 ` Chao Yu
2025-03-12 7:23 ` [PATCH v4 6/6] f2fs/009: detect and repair nlink corruption Chao Yu
4 siblings, 0 replies; 10+ messages in thread
From: Chao Yu @ 2025-03-12 7:23 UTC (permalink / raw)
To: Zorro Lang, fstests; +Cc: jaegeuk, linux-f2fs-devel, Chao Yu
_check_generic_filesystem() will fail the test once it detects
corruption, let's introduce _check_f2fs_filesystem() to just check
filesystem w/ --dry-run option, and return the error number, then
let caller to decide whether the corruption is as expected or not.
Cc: Jaegeuk Kim <jaegeuk@kernel.org>
Signed-off-by: Chao Yu <chao@kernel.org>
---
v4:
- clean up $FSTYP and $FSCK_OPTIONS
- dump formated logs to seqres.full once fsck detects the corruption.
common/rc | 50 ++++++++++++++++++++++++++++++++++++++++++++++++++
1 file changed, 50 insertions(+)
diff --git a/common/rc b/common/rc
index 23b642f4..43d3fe42 100644
--- a/common/rc
+++ b/common/rc
@@ -3519,6 +3519,50 @@ _check_generic_filesystem()
return 0
}
+_check_f2fs_filesystem()
+{
+ local device=$1
+
+ # If type is set, we're mounted
+ local type=`_fs_type $device`
+ local ok=1
+
+ if [ "$type" = "f2fs" ]
+ then
+ # mounted ...
+ local mountpoint=`_umount_or_remount_ro $device`
+ fi
+
+ $F2FS_FSCK_PROG --dry-run $device >$tmp.fsck.f2fs 2>&1
+ if [ $? -ne 0 ];then
+ _log_err "_check_f2fs_filesystem: filesystem on $device is inconsistent"
+ echo "*** fsck.f2fs output ***" >>$seqres.full
+ cat $tmp.fsck.f2fs >>$seqres.full
+ echo "*** end fsck.f2fs output" >>$seqres.full
+
+ ok=0
+ fi
+ rm -f $tmp.fsck.f2fs
+
+ if [ $ok -eq 0 ]
+ then
+ echo "*** mount output ***" >>$seqres.full
+ _mount >>$seqres.full
+ echo "*** end mount output" >>$seqres.full
+ elif [ "$type" = "f2fs" ]
+ then
+ # was mounted ...
+ _mount_or_remount_rw "$MOUNT_OPTIONS" $device $mountpoint
+ ok=$?
+ fi
+
+ if [ $ok -eq 0 ]; then
+ return 1
+ fi
+
+ return 0
+}
+
# Filter the knowen errors the UDF Verifier reports.
_udf_test_known_error_filter()
{
@@ -3623,6 +3667,9 @@ _check_test_fs()
ubifs)
# there is no fsck program for ubifs yet
;;
+ f2fs)
+ _check_f2fs_filesystem $TEST_DEV
+ ;;
*)
_check_generic_filesystem $TEST_DEV
;;
@@ -3679,6 +3726,9 @@ _check_scratch_fs()
ubifs)
# there is no fsck program for ubifs yet
;;
+ f2fs)
+ _check_f2fs_filesystem $device
+ ;;
*)
_check_generic_filesystem $device
;;
--
2.48.1
^ permalink raw reply related [flat|nested] 10+ messages in thread* [PATCH v4 6/6] f2fs/009: detect and repair nlink corruption
2025-03-12 7:23 [PATCH v4 1/6] common/config: remove redundant export variables Chao Yu
` (3 preceding siblings ...)
2025-03-12 7:23 ` [PATCH v4 5/6] common/rc: introduce _check_f2fs_filesystem() Chao Yu
@ 2025-03-12 7:23 ` Chao Yu
2025-03-25 1:07 ` Zorro Lang
2025-03-25 9:15 ` Dave Chinner
4 siblings, 2 replies; 10+ messages in thread
From: Chao Yu @ 2025-03-12 7:23 UTC (permalink / raw)
To: Zorro Lang, fstests; +Cc: jaegeuk, linux-f2fs-devel, Chao Yu
This is a regression test to check whether fsck can handle corrupted
nlinks correctly, it uses inject.f2fs to inject nlinks w/ wrong value,
and expects fsck.f2fs can detect such corruption and do the repair.
Cc: Jaegeuk Kim <jaegeuk@kernel.org>
Signed-off-by: Chao Yu <chao@kernel.org>
---
v4:
- remove unnecessary "_require_command fsck.f2fs"
- clean up _fixed_by_git_commit line
- fix to clean all tmp files in _cleanup
tests/f2fs/009 | 147 +++++++++++++++++++++++++++++++++++++++++++++
tests/f2fs/009.out | 2 +
2 files changed, 149 insertions(+)
create mode 100755 tests/f2fs/009
create mode 100644 tests/f2fs/009.out
diff --git a/tests/f2fs/009 b/tests/f2fs/009
new file mode 100755
index 00000000..9120d8a5
--- /dev/null
+++ b/tests/f2fs/009
@@ -0,0 +1,147 @@
+#! /bin/bash
+# SPDX-License-Identifier: GPL-2.0
+# Copyright (c) 2025 Chao Yu. All Rights Reserved.
+#
+# FS QA Test No. f2fs/009
+#
+# This is a regression test to check whether fsck can handle corrupted
+# nlinks correctly, it uses inject.f2fs to inject nlinks w/ wrong value,
+# and expects fsck.f2fs can detect such corruption and do the repair.
+#
+. ./common/preamble
+_begin_fstest auto quick
+
+if [ ! -x "$(type -P socket)" ]; then
+ _notrun "Couldn't find socket"
+fi
+
+_require_scratch
+_require_command "$F2FS_INJECT_PROG" inject.f2fs
+
+_fixed_by_git_commit f2fs-tools 958cd6e \
+ "fsck.f2fs: support to repair corrupted i_links"
+
+filename=$SCRATCH_MNT/foo
+hardlink=$SCRATCH_MNT/bar
+
+_cleanup()
+{
+ if [ -n "$pid" ]; then
+ kill $pid &> /dev/null
+ wait
+ fi
+ cd /
+ rm -r -f $tmp.*
+}
+
+for ((i=0;i<14;i++)) do
+ echo "round: " $i >> $seqres.full
+
+ _scratch_mkfs >> $seqres.full
+ _scratch_mount
+
+ if [ $i == 0 ]; then
+ touch $filename
+ ino=`stat -c '%i' $filename`
+ nlink=0
+ elif [ $i == 1 ]; then
+ mkdir $filename
+ ino=`stat -c '%i' $filename`
+ nlink=1
+ elif [ $i == 2 ]; then
+ mknod $filename c 9 0
+ ino=`stat -c '%i' $filename`
+ nlink=0
+ elif [ $i == 3 ]; then
+ mknod $filename b 8 0
+ ino=`stat -c '%i' $filename`
+ nlink=0
+ elif [ $i == 4 ]; then
+ mkfifo $filename
+ ino=`stat -c '%i' $filename`
+ nlink=0
+ elif [ $i == 5 ]; then
+ socket -s $filename >> $seqres.full 2>&1 &
+ pid=$!
+ sleep 2
+ ino=`stat -c '%i' $filename`
+ kill $pid >> $seqres.full 2>&1
+ nlink=0
+ elif [ $i == 6 ]; then
+ ln -s $SCRATCH_MNT/empty $filename
+ ino=`stat -c '%i' $filename`
+ nlink=0
+ elif [ $i == 7 ]; then
+ # orphan inode
+ touch $filename
+ ino=`stat -c '%i' $filename`
+ $F2FS_IO_PROG write 1 0 1 zero atomic_commit $filename 5000 >> $seqres.full 2>&1 &
+ stat $filename >> $seqres.full
+ rm $filename
+ $F2FS_IO_PROG shutdown 1 $SCRATCH_MNT/ >> $seqres.full
+ sleep 6
+ nlink=1
+ elif [ $i == 8 ]; then
+ # hardlink on file
+ touch $filename
+ ino=`stat -c '%i' $filename`
+ ln $filename $hardlink
+ nlink=0
+ elif [ $i == 9 ]; then
+ # hardlink on charactor
+ mknod $filename c 9 0
+ ino=`stat -c '%i' $filename`
+ ln $filename $hardlink
+ nlink=0
+ elif [ $i == 10 ]; then
+ # hardlink on blockdev
+ mknod $filename b 8 0
+ ino=`stat -c '%i' $filename`
+ ln $filename $hardlink
+ nlink=0
+ elif [ $i == 11 ]; then
+ # hardlink on pipe
+ mkfifo $filename
+ ino=`stat -c '%i' $filename`
+ ln $filename $hardlink
+ nlink=0
+ elif [ $i == 12 ]; then
+ # hardlink on socket
+ socket -s $filename >> $seqres.full 2>&1 &
+ pid=$!
+ sleep 2
+ ino=`stat -c '%i' $filename`
+ kill $pid >> $seqres.full 2>&1
+ ln $filename $hardlink
+ nlink=0
+ elif [ $i == 13 ]; then
+ # hardlink on symlink
+ ln -s $SCRATCH_MNT/empty $filename
+ ino=`stat -c '%i' $filename`
+ ln $filename $hardlink
+ nlink=0
+ fi
+
+ if [ $i != 7 ]; then
+ stat $SCRATCH_MNT/* >> $seqres.full
+ fi
+ echo "ino:"$ino >> $seqres.full
+ echo "nlink:"$nlink >> $seqres.full
+
+ _scratch_unmount
+
+ $F2FS_INJECT_PROG --node --mb i_links --nid $ino --val $nlink $SCRATCH_DEV \
+ >> $seqres.full || _fail "fail to inject"
+
+ _check_scratch_fs >> $seqres.full 2>&1 && _fail "can't find corruption"
+ _repair_scratch_fs >> $seqres.full
+ _check_scratch_fs >> $seqres.full 2>&1 || _fail "fsck can't fix corruption"
+
+ _scratch_mount
+ _scratch_unmount
+done
+
+echo "Silence is golden"
+
+status=0
+exit
diff --git a/tests/f2fs/009.out b/tests/f2fs/009.out
new file mode 100644
index 00000000..7e977155
--- /dev/null
+++ b/tests/f2fs/009.out
@@ -0,0 +1,2 @@
+QA output created by 009
+Silence is golden
--
2.48.1
^ permalink raw reply related [flat|nested] 10+ messages in thread* Re: [PATCH v4 6/6] f2fs/009: detect and repair nlink corruption
2025-03-12 7:23 ` [PATCH v4 6/6] f2fs/009: detect and repair nlink corruption Chao Yu
@ 2025-03-25 1:07 ` Zorro Lang
2025-03-25 6:54 ` Chao Yu
2025-03-25 9:15 ` Dave Chinner
1 sibling, 1 reply; 10+ messages in thread
From: Zorro Lang @ 2025-03-25 1:07 UTC (permalink / raw)
To: Chao Yu; +Cc: Zorro Lang, fstests, jaegeuk, linux-f2fs-devel
On Wed, Mar 12, 2025 at 03:23:09PM +0800, Chao Yu wrote:
> This is a regression test to check whether fsck can handle corrupted
> nlinks correctly, it uses inject.f2fs to inject nlinks w/ wrong value,
> and expects fsck.f2fs can detect such corruption and do the repair.
>
> Cc: Jaegeuk Kim <jaegeuk@kernel.org>
> Signed-off-by: Chao Yu <chao@kernel.org>
> ---
> v4:
> - remove unnecessary "_require_command fsck.f2fs"
> - clean up _fixed_by_git_commit line
> - fix to clean all tmp files in _cleanup
> tests/f2fs/009 | 147 +++++++++++++++++++++++++++++++++++++++++++++
> tests/f2fs/009.out | 2 +
> 2 files changed, 149 insertions(+)
> create mode 100755 tests/f2fs/009
> create mode 100644 tests/f2fs/009.out
>
> diff --git a/tests/f2fs/009 b/tests/f2fs/009
> new file mode 100755
> index 00000000..9120d8a5
> --- /dev/null
> +++ b/tests/f2fs/009
> @@ -0,0 +1,147 @@
> +#! /bin/bash
> +# SPDX-License-Identifier: GPL-2.0
> +# Copyright (c) 2025 Chao Yu. All Rights Reserved.
> +#
> +# FS QA Test No. f2fs/009
> +#
> +# This is a regression test to check whether fsck can handle corrupted
> +# nlinks correctly, it uses inject.f2fs to inject nlinks w/ wrong value,
> +# and expects fsck.f2fs can detect such corruption and do the repair.
> +#
> +. ./common/preamble
> +_begin_fstest auto quick
> +
> +if [ ! -x "$(type -P socket)" ]; then
Hi Chao,
Which package provides this "socket" command? I tried to search it in Fedora, but
got nothing:
# yum search */socket
Updating and loading repositories:
Fedora - Rawhide - Developmental packages for the next Fedora release 100% | 19.1 KiB/s | 23.6 KiB | 00m01s
Fedora - Rawhide - Developmental packages for the next Fedora release 100% | 694.7 KiB/s | 6.9 MiB | 00m10s
Repositories loaded.
No matches found.
If it's a program by yourself, we might can put it in xfstests/src/socket.c?
Thanks,
Zorro
> + _notrun "Couldn't find socket"
> +fi
> +
> +_require_scratch
> +_require_command "$F2FS_INJECT_PROG" inject.f2fs
> +
> +_fixed_by_git_commit f2fs-tools 958cd6e \
> + "fsck.f2fs: support to repair corrupted i_links"
> +
> +filename=$SCRATCH_MNT/foo
> +hardlink=$SCRATCH_MNT/bar
> +
> +_cleanup()
> +{
> + if [ -n "$pid" ]; then
> + kill $pid &> /dev/null
> + wait
> + fi
> + cd /
> + rm -r -f $tmp.*
> +}
> +
> +for ((i=0;i<14;i++)) do
> + echo "round: " $i >> $seqres.full
> +
> + _scratch_mkfs >> $seqres.full
> + _scratch_mount
> +
> + if [ $i == 0 ]; then
> + touch $filename
> + ino=`stat -c '%i' $filename`
> + nlink=0
> + elif [ $i == 1 ]; then
> + mkdir $filename
> + ino=`stat -c '%i' $filename`
> + nlink=1
> + elif [ $i == 2 ]; then
> + mknod $filename c 9 0
> + ino=`stat -c '%i' $filename`
> + nlink=0
> + elif [ $i == 3 ]; then
> + mknod $filename b 8 0
> + ino=`stat -c '%i' $filename`
> + nlink=0
> + elif [ $i == 4 ]; then
> + mkfifo $filename
> + ino=`stat -c '%i' $filename`
> + nlink=0
> + elif [ $i == 5 ]; then
> + socket -s $filename >> $seqres.full 2>&1 &
> + pid=$!
> + sleep 2
> + ino=`stat -c '%i' $filename`
> + kill $pid >> $seqres.full 2>&1
> + nlink=0
> + elif [ $i == 6 ]; then
> + ln -s $SCRATCH_MNT/empty $filename
> + ino=`stat -c '%i' $filename`
> + nlink=0
> + elif [ $i == 7 ]; then
> + # orphan inode
> + touch $filename
> + ino=`stat -c '%i' $filename`
> + $F2FS_IO_PROG write 1 0 1 zero atomic_commit $filename 5000 >> $seqres.full 2>&1 &
> + stat $filename >> $seqres.full
> + rm $filename
> + $F2FS_IO_PROG shutdown 1 $SCRATCH_MNT/ >> $seqres.full
> + sleep 6
> + nlink=1
> + elif [ $i == 8 ]; then
> + # hardlink on file
> + touch $filename
> + ino=`stat -c '%i' $filename`
> + ln $filename $hardlink
> + nlink=0
> + elif [ $i == 9 ]; then
> + # hardlink on charactor
> + mknod $filename c 9 0
> + ino=`stat -c '%i' $filename`
> + ln $filename $hardlink
> + nlink=0
> + elif [ $i == 10 ]; then
> + # hardlink on blockdev
> + mknod $filename b 8 0
> + ino=`stat -c '%i' $filename`
> + ln $filename $hardlink
> + nlink=0
> + elif [ $i == 11 ]; then
> + # hardlink on pipe
> + mkfifo $filename
> + ino=`stat -c '%i' $filename`
> + ln $filename $hardlink
> + nlink=0
> + elif [ $i == 12 ]; then
> + # hardlink on socket
> + socket -s $filename >> $seqres.full 2>&1 &
> + pid=$!
> + sleep 2
> + ino=`stat -c '%i' $filename`
> + kill $pid >> $seqres.full 2>&1
> + ln $filename $hardlink
> + nlink=0
> + elif [ $i == 13 ]; then
> + # hardlink on symlink
> + ln -s $SCRATCH_MNT/empty $filename
> + ino=`stat -c '%i' $filename`
> + ln $filename $hardlink
> + nlink=0
> + fi
> +
> + if [ $i != 7 ]; then
> + stat $SCRATCH_MNT/* >> $seqres.full
> + fi
> + echo "ino:"$ino >> $seqres.full
> + echo "nlink:"$nlink >> $seqres.full
> +
> + _scratch_unmount
> +
> + $F2FS_INJECT_PROG --node --mb i_links --nid $ino --val $nlink $SCRATCH_DEV \
> + >> $seqres.full || _fail "fail to inject"
> +
> + _check_scratch_fs >> $seqres.full 2>&1 && _fail "can't find corruption"
> + _repair_scratch_fs >> $seqres.full
> + _check_scratch_fs >> $seqres.full 2>&1 || _fail "fsck can't fix corruption"
> +
> + _scratch_mount
> + _scratch_unmount
> +done
> +
> +echo "Silence is golden"
> +
> +status=0
> +exit
> diff --git a/tests/f2fs/009.out b/tests/f2fs/009.out
> new file mode 100644
> index 00000000..7e977155
> --- /dev/null
> +++ b/tests/f2fs/009.out
> @@ -0,0 +1,2 @@
> +QA output created by 009
> +Silence is golden
> --
> 2.48.1
>
^ permalink raw reply [flat|nested] 10+ messages in thread* Re: [PATCH v4 6/6] f2fs/009: detect and repair nlink corruption
2025-03-25 1:07 ` Zorro Lang
@ 2025-03-25 6:54 ` Chao Yu
0 siblings, 0 replies; 10+ messages in thread
From: Chao Yu @ 2025-03-25 6:54 UTC (permalink / raw)
To: Zorro Lang; +Cc: chao, Zorro Lang, fstests, jaegeuk, linux-f2fs-devel
On 3/25/25 09:07, Zorro Lang wrote:
> On Wed, Mar 12, 2025 at 03:23:09PM +0800, Chao Yu wrote:
>> This is a regression test to check whether fsck can handle corrupted
>> nlinks correctly, it uses inject.f2fs to inject nlinks w/ wrong value,
>> and expects fsck.f2fs can detect such corruption and do the repair.
>>
>> Cc: Jaegeuk Kim <jaegeuk@kernel.org>
>> Signed-off-by: Chao Yu <chao@kernel.org>
>> ---
>> v4:
>> - remove unnecessary "_require_command fsck.f2fs"
>> - clean up _fixed_by_git_commit line
>> - fix to clean all tmp files in _cleanup
>> tests/f2fs/009 | 147 +++++++++++++++++++++++++++++++++++++++++++++
>> tests/f2fs/009.out | 2 +
>> 2 files changed, 149 insertions(+)
>> create mode 100755 tests/f2fs/009
>> create mode 100644 tests/f2fs/009.out
>>
>> diff --git a/tests/f2fs/009 b/tests/f2fs/009
>> new file mode 100755
>> index 00000000..9120d8a5
>> --- /dev/null
>> +++ b/tests/f2fs/009
>> @@ -0,0 +1,147 @@
>> +#! /bin/bash
>> +# SPDX-License-Identifier: GPL-2.0
>> +# Copyright (c) 2025 Chao Yu. All Rights Reserved.
>> +#
>> +# FS QA Test No. f2fs/009
>> +#
>> +# This is a regression test to check whether fsck can handle corrupted
>> +# nlinks correctly, it uses inject.f2fs to inject nlinks w/ wrong value,
>> +# and expects fsck.f2fs can detect such corruption and do the repair.
>> +#
>> +. ./common/preamble
>> +_begin_fstest auto quick
>> +
>> +if [ ! -x "$(type -P socket)" ]; then
>
> Hi Chao,
>
> Which package provides this "socket" command? I tried to search it in Fedora, but
> got nothing:
>
> # yum search */socket
> Updating and loading repositories:
> Fedora - Rawhide - Developmental packages for the next Fedora release 100% | 19.1 KiB/s | 23.6 KiB | 00m01s
> Fedora - Rawhide - Developmental packages for the next Fedora release 100% | 694.7 KiB/s | 6.9 MiB | 00m10s
> Repositories loaded.
> No matches found.
>
> If it's a program by yourself, we might can put it in xfstests/src/socket.c?
Hi Zorro,
It's not a program from me, I just installed it w/ "sudo apt install socket", can
you try that?
Thanks,
>
> Thanks,
> Zorro
>
>> + _notrun "Couldn't find socket"
>> +fi
>> +
>> +_require_scratch
>> +_require_command "$F2FS_INJECT_PROG" inject.f2fs
>> +
>> +_fixed_by_git_commit f2fs-tools 958cd6e \
>> + "fsck.f2fs: support to repair corrupted i_links"
>> +
>> +filename=$SCRATCH_MNT/foo
>> +hardlink=$SCRATCH_MNT/bar
>> +
>> +_cleanup()
>> +{
>> + if [ -n "$pid" ]; then
>> + kill $pid &> /dev/null
>> + wait
>> + fi
>> + cd /
>> + rm -r -f $tmp.*
>> +}
>> +
>> +for ((i=0;i<14;i++)) do
>> + echo "round: " $i >> $seqres.full
>> +
>> + _scratch_mkfs >> $seqres.full
>> + _scratch_mount
>> +
>> + if [ $i == 0 ]; then
>> + touch $filename
>> + ino=`stat -c '%i' $filename`
>> + nlink=0
>> + elif [ $i == 1 ]; then
>> + mkdir $filename
>> + ino=`stat -c '%i' $filename`
>> + nlink=1
>> + elif [ $i == 2 ]; then
>> + mknod $filename c 9 0
>> + ino=`stat -c '%i' $filename`
>> + nlink=0
>> + elif [ $i == 3 ]; then
>> + mknod $filename b 8 0
>> + ino=`stat -c '%i' $filename`
>> + nlink=0
>> + elif [ $i == 4 ]; then
>> + mkfifo $filename
>> + ino=`stat -c '%i' $filename`
>> + nlink=0
>> + elif [ $i == 5 ]; then
>> + socket -s $filename >> $seqres.full 2>&1 &
>> + pid=$!
>> + sleep 2
>> + ino=`stat -c '%i' $filename`
>> + kill $pid >> $seqres.full 2>&1
>> + nlink=0
>> + elif [ $i == 6 ]; then
>> + ln -s $SCRATCH_MNT/empty $filename
>> + ino=`stat -c '%i' $filename`
>> + nlink=0
>> + elif [ $i == 7 ]; then
>> + # orphan inode
>> + touch $filename
>> + ino=`stat -c '%i' $filename`
>> + $F2FS_IO_PROG write 1 0 1 zero atomic_commit $filename 5000 >> $seqres.full 2>&1 &
>> + stat $filename >> $seqres.full
>> + rm $filename
>> + $F2FS_IO_PROG shutdown 1 $SCRATCH_MNT/ >> $seqres.full
>> + sleep 6
>> + nlink=1
>> + elif [ $i == 8 ]; then
>> + # hardlink on file
>> + touch $filename
>> + ino=`stat -c '%i' $filename`
>> + ln $filename $hardlink
>> + nlink=0
>> + elif [ $i == 9 ]; then
>> + # hardlink on charactor
>> + mknod $filename c 9 0
>> + ino=`stat -c '%i' $filename`
>> + ln $filename $hardlink
>> + nlink=0
>> + elif [ $i == 10 ]; then
>> + # hardlink on blockdev
>> + mknod $filename b 8 0
>> + ino=`stat -c '%i' $filename`
>> + ln $filename $hardlink
>> + nlink=0
>> + elif [ $i == 11 ]; then
>> + # hardlink on pipe
>> + mkfifo $filename
>> + ino=`stat -c '%i' $filename`
>> + ln $filename $hardlink
>> + nlink=0
>> + elif [ $i == 12 ]; then
>> + # hardlink on socket
>> + socket -s $filename >> $seqres.full 2>&1 &
>> + pid=$!
>> + sleep 2
>> + ino=`stat -c '%i' $filename`
>> + kill $pid >> $seqres.full 2>&1
>> + ln $filename $hardlink
>> + nlink=0
>> + elif [ $i == 13 ]; then
>> + # hardlink on symlink
>> + ln -s $SCRATCH_MNT/empty $filename
>> + ino=`stat -c '%i' $filename`
>> + ln $filename $hardlink
>> + nlink=0
>> + fi
>> +
>> + if [ $i != 7 ]; then
>> + stat $SCRATCH_MNT/* >> $seqres.full
>> + fi
>> + echo "ino:"$ino >> $seqres.full
>> + echo "nlink:"$nlink >> $seqres.full
>> +
>> + _scratch_unmount
>> +
>> + $F2FS_INJECT_PROG --node --mb i_links --nid $ino --val $nlink $SCRATCH_DEV \
>> + >> $seqres.full || _fail "fail to inject"
>> +
>> + _check_scratch_fs >> $seqres.full 2>&1 && _fail "can't find corruption"
>> + _repair_scratch_fs >> $seqres.full
>> + _check_scratch_fs >> $seqres.full 2>&1 || _fail "fsck can't fix corruption"
>> +
>> + _scratch_mount
>> + _scratch_unmount
>> +done
>> +
>> +echo "Silence is golden"
>> +
>> +status=0
>> +exit
>> diff --git a/tests/f2fs/009.out b/tests/f2fs/009.out
>> new file mode 100644
>> index 00000000..7e977155
>> --- /dev/null
>> +++ b/tests/f2fs/009.out
>> @@ -0,0 +1,2 @@
>> +QA output created by 009
>> +Silence is golden
>> --
>> 2.48.1
>>
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [PATCH v4 6/6] f2fs/009: detect and repair nlink corruption
2025-03-12 7:23 ` [PATCH v4 6/6] f2fs/009: detect and repair nlink corruption Chao Yu
2025-03-25 1:07 ` Zorro Lang
@ 2025-03-25 9:15 ` Dave Chinner
2025-03-25 12:55 ` Chao Yu
1 sibling, 1 reply; 10+ messages in thread
From: Dave Chinner @ 2025-03-25 9:15 UTC (permalink / raw)
To: Chao Yu; +Cc: Zorro Lang, fstests, jaegeuk, linux-f2fs-devel
On Wed, Mar 12, 2025 at 03:23:09PM +0800, Chao Yu wrote:
> This is a regression test to check whether fsck can handle corrupted
> nlinks correctly, it uses inject.f2fs to inject nlinks w/ wrong value,
> and expects fsck.f2fs can detect such corruption and do the repair.
>
> Cc: Jaegeuk Kim <jaegeuk@kernel.org>
> Signed-off-by: Chao Yu <chao@kernel.org>
> ---
> v4:
> - remove unnecessary "_require_command fsck.f2fs"
> - clean up _fixed_by_git_commit line
> - fix to clean all tmp files in _cleanup
> tests/f2fs/009 | 147 +++++++++++++++++++++++++++++++++++++++++++++
> tests/f2fs/009.out | 2 +
> 2 files changed, 149 insertions(+)
> create mode 100755 tests/f2fs/009
> create mode 100644 tests/f2fs/009.out
>
> diff --git a/tests/f2fs/009 b/tests/f2fs/009
> new file mode 100755
> index 00000000..9120d8a5
> --- /dev/null
> +++ b/tests/f2fs/009
> @@ -0,0 +1,147 @@
> +#! /bin/bash
> +# SPDX-License-Identifier: GPL-2.0
> +# Copyright (c) 2025 Chao Yu. All Rights Reserved.
> +#
> +# FS QA Test No. f2fs/009
> +#
> +# This is a regression test to check whether fsck can handle corrupted
> +# nlinks correctly, it uses inject.f2fs to inject nlinks w/ wrong value,
> +# and expects fsck.f2fs can detect such corruption and do the repair.
> +#
> +. ./common/preamble
> +_begin_fstest auto quick
> +
> +if [ ! -x "$(type -P socket)" ]; then
> + _notrun "Couldn't find socket"
> +fi
> +
> +_require_scratch
> +_require_command "$F2FS_INJECT_PROG" inject.f2fs
> +
> +_fixed_by_git_commit f2fs-tools 958cd6e \
> + "fsck.f2fs: support to repair corrupted i_links"
> +
> +filename=$SCRATCH_MNT/foo
> +hardlink=$SCRATCH_MNT/bar
> +
> +_cleanup()
> +{
> + if [ -n "$pid" ]; then
> + kill $pid &> /dev/null
> + wait
> + fi
> + cd /
> + rm -r -f $tmp.*
> +}
> +
> +for ((i=0;i<14;i++)) do
> + echo "round: " $i >> $seqres.full
> +
> + _scratch_mkfs >> $seqres.full
> + _scratch_mount
> +
> + if [ $i == 0 ]; then
> + touch $filename
> + ino=`stat -c '%i' $filename`
> + nlink=0
> + elif [ $i == 1 ]; then
.....
Ok, it works, but it's a bit nasty. You want to run the same
injection and checking on all types of inodes, so factor that out
like so:
inject_and_check()
{
local nlink=$1
local ino=`stat -c '%i' $filename`
echo "ino:"$ino >> $seqres.full
echo "nlink:"$nlink >> $seqres.full
_scratch_unmount
$F2FS_INJECT_PROG --node --mb i_links --nid $ino --val $nlink $SCRATCH_DEV \
>> $seqres.full || _fail "fail to inject"
_check_scratch_fs >> $seqres.full 2>&1 && _fail "can't find corruption"
_repair_scratch_fs >> $seqres.full
_check_scratch_fs >> $seqres.full 2>&1 || _fail "fsck can't fix corruption"
_scratch_mount
_scratch_unmount
_scratch_mkfs >> $seqres.full
_scratch_mount
}
And now most of the test cases become this:
_scratch_mkfs >> $seqres.full
_scratch_mount
touch $filename
inject_and_check 0
mkdir $filename
inject_and_check 1
mknod $filename c 9 0
inject_and_check 0
mknod $filename b 8 0
inject_and_check 0
.....
The whacky cases with socket and orphan inodes can be handled
by factoring inject_and_check so there's a second function that
takes both ino and nlink as parameters.
This gets rid of all the unnecessary if/elif logic and looping,
leaving only the test code that does the work behind.
-Dave.
--
Dave Chinner
david@fromorbit.com
^ permalink raw reply [flat|nested] 10+ messages in thread* Re: [PATCH v4 6/6] f2fs/009: detect and repair nlink corruption
2025-03-25 9:15 ` Dave Chinner
@ 2025-03-25 12:55 ` Chao Yu
0 siblings, 0 replies; 10+ messages in thread
From: Chao Yu @ 2025-03-25 12:55 UTC (permalink / raw)
To: Dave Chinner; +Cc: chao, Zorro Lang, fstests, jaegeuk, linux-f2fs-devel
On 3/25/25 17:15, Dave Chinner wrote:
> On Wed, Mar 12, 2025 at 03:23:09PM +0800, Chao Yu wrote:
>> This is a regression test to check whether fsck can handle corrupted
>> nlinks correctly, it uses inject.f2fs to inject nlinks w/ wrong value,
>> and expects fsck.f2fs can detect such corruption and do the repair.
>>
>> Cc: Jaegeuk Kim <jaegeuk@kernel.org>
>> Signed-off-by: Chao Yu <chao@kernel.org>
>> ---
>> v4:
>> - remove unnecessary "_require_command fsck.f2fs"
>> - clean up _fixed_by_git_commit line
>> - fix to clean all tmp files in _cleanup
>> tests/f2fs/009 | 147 +++++++++++++++++++++++++++++++++++++++++++++
>> tests/f2fs/009.out | 2 +
>> 2 files changed, 149 insertions(+)
>> create mode 100755 tests/f2fs/009
>> create mode 100644 tests/f2fs/009.out
>>
>> diff --git a/tests/f2fs/009 b/tests/f2fs/009
>> new file mode 100755
>> index 00000000..9120d8a5
>> --- /dev/null
>> +++ b/tests/f2fs/009
>> @@ -0,0 +1,147 @@
>> +#! /bin/bash
>> +# SPDX-License-Identifier: GPL-2.0
>> +# Copyright (c) 2025 Chao Yu. All Rights Reserved.
>> +#
>> +# FS QA Test No. f2fs/009
>> +#
>> +# This is a regression test to check whether fsck can handle corrupted
>> +# nlinks correctly, it uses inject.f2fs to inject nlinks w/ wrong value,
>> +# and expects fsck.f2fs can detect such corruption and do the repair.
>> +#
>> +. ./common/preamble
>> +_begin_fstest auto quick
>> +
>> +if [ ! -x "$(type -P socket)" ]; then
>> + _notrun "Couldn't find socket"
>> +fi
>> +
>> +_require_scratch
>> +_require_command "$F2FS_INJECT_PROG" inject.f2fs
>> +
>> +_fixed_by_git_commit f2fs-tools 958cd6e \
>> + "fsck.f2fs: support to repair corrupted i_links"
>> +
>> +filename=$SCRATCH_MNT/foo
>> +hardlink=$SCRATCH_MNT/bar
>> +
>> +_cleanup()
>> +{
>> + if [ -n "$pid" ]; then
>> + kill $pid &> /dev/null
>> + wait
>> + fi
>> + cd /
>> + rm -r -f $tmp.*
>> +}
>> +
>> +for ((i=0;i<14;i++)) do
>> + echo "round: " $i >> $seqres.full
>> +
>> + _scratch_mkfs >> $seqres.full
>> + _scratch_mount
>> +
>> + if [ $i == 0 ]; then
>> + touch $filename
>> + ino=`stat -c '%i' $filename`
>> + nlink=0
>> + elif [ $i == 1 ]; then
> .....
>
> Ok, it works, but it's a bit nasty. You want to run the same
> injection and checking on all types of inodes, so factor that out
> like so:
>
> inject_and_check()
> {
> local nlink=$1
> local ino=`stat -c '%i' $filename`
>
> echo "ino:"$ino >> $seqres.full
> echo "nlink:"$nlink >> $seqres.full
>
> _scratch_unmount
>
> $F2FS_INJECT_PROG --node --mb i_links --nid $ino --val $nlink $SCRATCH_DEV \
> >> $seqres.full || _fail "fail to inject"
>
> _check_scratch_fs >> $seqres.full 2>&1 && _fail "can't find corruption"
> _repair_scratch_fs >> $seqres.full
> _check_scratch_fs >> $seqres.full 2>&1 || _fail "fsck can't fix corruption"
>
> _scratch_mount
> _scratch_unmount
>
> _scratch_mkfs >> $seqres.full
> _scratch_mount
> }
>
> And now most of the test cases become this:
>
> _scratch_mkfs >> $seqres.full
> _scratch_mount
>
> touch $filename
> inject_and_check 0
>
> mkdir $filename
> inject_and_check 1
>
> mknod $filename c 9 0
> inject_and_check 0
>
> mknod $filename b 8 0
> inject_and_check 0
>
> .....
>
> The whacky cases with socket and orphan inodes can be handled
> by factoring inject_and_check so there's a second function that
> takes both ino and nlink as parameters.
>
> This gets rid of all the unnecessary if/elif logic and looping,
> leaving only the test code that does the work behind.
Thanks a lot for the suggestion, it will be more clean w/ above
implementation, will update v5.
Thanks,
>
> -Dave.
^ permalink raw reply [flat|nested] 10+ messages in thread