* [PATCH] generic/473: fix expectation properly in out file @ 2021-02-23 13:40 Chengguang Xu 2021-02-24 7:52 ` Su Yue 2021-02-24 16:50 ` Darrick J. Wong 0 siblings, 2 replies; 12+ messages in thread From: Chengguang Xu @ 2021-02-23 13:40 UTC (permalink / raw) To: guaneryu; +Cc: fstests, Chengguang Xu It seems the expected result of testcase of "Hole + Data" in generic/473 is not correct, so just fix it properly. Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> --- tests/generic/473.out | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/tests/generic/473.out b/tests/generic/473.out index 75816388..f1ee5805 100644 --- a/tests/generic/473.out +++ b/tests/generic/473.out @@ -6,7 +6,7 @@ Data + Hole 1: [256..287]: hole Hole + Data 0: [0..127]: hole -1: [128..255]: data +1: [128..135]: data Hole + Data + Hole 0: [0..127]: hole 1: [128..255]: data -- 2.27.0 ^ permalink raw reply related [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-23 13:40 [PATCH] generic/473: fix expectation properly in out file Chengguang Xu @ 2021-02-24 7:52 ` Su Yue 2021-02-24 8:10 ` Su Yue 2021-02-24 8:51 ` Chengguang Xu 2021-02-24 16:50 ` Darrick J. Wong 1 sibling, 2 replies; 12+ messages in thread From: Su Yue @ 2021-02-24 7:52 UTC (permalink / raw) To: Chengguang Xu; +Cc: guaneryu, fstests, nborisov, linux-xfs Cc to the author and linux-xfs, since it's xfsprogs related. On Tue 23 Feb 2021 at 21:40, Chengguang Xu <cgxu519@mykernel.net> wrote: > It seems the expected result of testcase of "Hole + Data" > in generic/473 is not correct, so just fix it properly. > But it's not proper... > Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> > --- > tests/generic/473.out | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > diff --git a/tests/generic/473.out b/tests/generic/473.out > index 75816388..f1ee5805 100644 > --- a/tests/generic/473.out > +++ b/tests/generic/473.out > @@ -6,7 +6,7 @@ Data + Hole > 1: [256..287]: hole > Hole + Data > 0: [0..127]: hole > -1: [128..255]: data > +1: [128..135]: data > The line is produced by `$XFS_IO_PROG -c "fiemap -v 0 65k" $file | _filter_fiemap`. 0-64k is a hole and 64k-128k is a data extent. fiemap ioctl always returns *complete* ranges of extents. You may ask why the ending hole range is not aligned to 128 in 473.out. Because fiemap ioctl returns nothing of querying holes. xfs_io does the extra print work for holes. xfsprogs-dev/io/fiemap.c: for holes: 153 if (lstart > llast) { 154 print_hole(0, 0, 0, cur_extent, lflag, true, llast, lstart); 155 cur_extent++; 156 num_printed++; 157 } for the ending hole: 381 if (cur_extent && last_logical < range_end) 382 print_hole(foff_w, boff_w, tot_w, cur_extent, lflag, !vflag, 383 BTOBBT(last_logical), BTOBBT(range_end)); > Hole + Data + Hole > 0: [0..127]: hole > 1: [128..255]: data ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-24 7:52 ` Su Yue @ 2021-02-24 8:10 ` Su Yue 2021-02-24 8:55 ` Chengguang Xu 2021-02-24 8:51 ` Chengguang Xu 1 sibling, 1 reply; 12+ messages in thread From: Su Yue @ 2021-02-24 8:10 UTC (permalink / raw) To: Chengguang Xu; +Cc: guaneryu, fstests, nborisov, linux-xfs On Wed 24 Feb 2021 at 15:52, Su Yue <l@damenly.su> wrote: > Cc to the author and linux-xfs, since it's xfsprogs related. > > On Tue 23 Feb 2021 at 21:40, Chengguang Xu > <cgxu519@mykernel.net> wrote: > >> It seems the expected result of testcase of "Hole + Data" >> in generic/473 is not correct, so just fix it properly. >> > > But it's not proper... > >> Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> >> --- >> tests/generic/473.out | 2 +- >> 1 file changed, 1 insertion(+), 1 deletion(-) >> >> diff --git a/tests/generic/473.out b/tests/generic/473.out >> index 75816388..f1ee5805 100644 >> --- a/tests/generic/473.out >> +++ b/tests/generic/473.out >> @@ -6,7 +6,7 @@ Data + Hole >> 1: [256..287]: hole >> Hole + Data >> 0: [0..127]: hole >> -1: [128..255]: data >> +1: [128..135]: data >> > The line is produced by `$XFS_IO_PROG -c "fiemap -v 0 65k" $file > | > _filter_fiemap`. > 0-64k is a hole and 64k-128k is a data extent. > fiemap ioctl always returns *complete* ranges of extents. > And what you want to change is only the filted output. Without _filter_fiemap: /mnt/test/fiemap.473: | EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS | 0: [0..127]: hole 128 | 1: [128..255]: 26792..26919 128 0x0 [128..255] corresponds to the BLOCK-RANGE of the extent 26792..26919. > You may ask why the ending hole range is not aligned to 128 in > 473.out. Because > fiemap ioctl returns nothing of querying holes. xfs_io does the > extra > print work for holes. > > xfsprogs-dev/io/fiemap.c: > for holes: > 153 if (lstart > llast) { > 154 print_hole(0, 0, 0, cur_extent, lflag, true, llast, > lstart); > 155 cur_extent++; > 156 num_printed++; > 157 } > > for the ending hole: > 381 if (cur_extent && last_logical < range_end) > 382 print_hole(foff_w, boff_w, tot_w, cur_extent, > lflag, !vflag, > 383 BTOBBT(last_logical), BTOBBT(range_end)); > >> Hole + Data + Hole >> 0: [0..127]: hole >> 1: [128..255]: data ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-24 8:10 ` Su Yue @ 2021-02-24 8:55 ` Chengguang Xu 0 siblings, 0 replies; 12+ messages in thread From: Chengguang Xu @ 2021-02-24 8:55 UTC (permalink / raw) To: Su Yue; +Cc: guaneryu, fstests, nborisov, linux-xfs ---- 在 星期三, 2021-02-24 16:10:39 Su Yue <l@damenly.su> 撰写 ---- > > On Wed 24 Feb 2021 at 15:52, Su Yue <l@damenly.su> wrote: > > > Cc to the author and linux-xfs, since it's xfsprogs related. > > > > On Tue 23 Feb 2021 at 21:40, Chengguang Xu > > <cgxu519@mykernel.net> wrote: > > > >> It seems the expected result of testcase of "Hole + Data" > >> in generic/473 is not correct, so just fix it properly. > >> > > > > But it's not proper... > > > >> Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> > >> --- > >> tests/generic/473.out | 2 +- > >> 1 file changed, 1 insertion(+), 1 deletion(-) > >> > >> diff --git a/tests/generic/473.out b/tests/generic/473.out > >> index 75816388..f1ee5805 100644 > >> --- a/tests/generic/473.out > >> +++ b/tests/generic/473.out > >> @@ -6,7 +6,7 @@ Data + Hole > >> 1: [256..287]: hole > >> Hole + Data > >> 0: [0..127]: hole > >> -1: [128..255]: data > >> +1: [128..135]: data > >> > > The line is produced by `$XFS_IO_PROG -c "fiemap -v 0 65k" $file > > | > > _filter_fiemap`. > > 0-64k is a hole and 64k-128k is a data extent. > > fiemap ioctl always returns *complete* ranges of extents. > > > And what you want to change is only the filted output. > Without _filter_fiemap: Without _filter_fiemap: [root@centos xfstests-dev]# git diff diff --git a/tests/generic/473 b/tests/generic/473 index 5c19703e..35f28677 100755 --- a/tests/generic/473 +++ b/tests/generic/473 @@ -60,7 +60,8 @@ echo "Data + Hole" $XFS_IO_PROG -c "fiemap -v 64k 80k" $file | _filter_fiemap echo "Hole + Data" -$XFS_IO_PROG -c "fiemap -v 0 65k" $file | _filter_fiemap +#$XFS_IO_PROG -c "fiemap -v 0 65k" $file | _filter_fiemap +$XFS_IO_PROG -c "fiemap -v 0 65k" $file echo "Hole + Data + Hole" $XFS_IO_PROG -c "fiemap -v 0k 130k" $file | _filter_fiemap [root@centos xfstests-dev]# ./check generic/473 FSTYP -- ext4 PLATFORM -- Linux/x86_64 centos 5.11.0+ #5 SMP Tue Feb 23 21:02:27 CST 2021 MKFS_OPTIONS -- /dev/mapper/workvg-test2 MOUNT_OPTIONS -- -o acl,user_xattr /dev/mapper/workvg-test2 /mnt/scratch generic/473 1s ... - output mismatch (see /git/xfstests-dev/results//generic/473.out.bad) --- tests/generic/473.out 2021-02-24 16:51:23.254845067 +0800 +++ /git/xfstests-dev/results//generic/473.out.bad 2021-02-24 16:52:04.440737816 +0800 @@ -5,8 +5,10 @@ 0: [128..255]: data 1: [256..287]: hole Hole + Data -0: [0..127]: hole -1: [128..255]: data +/mnt/test/fiemap.473: + EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS ... (Run 'diff -u /git/xfstests-dev/tests/generic/473.out /git/xfstests-dev/results//generic/473.out.bad' to see the entire diff) Ran: generic/473 Failures: generic/473 Failed 1 of 1 tests [root@centos xfstests-dev]# diff -u /git/xfstests-dev/tests/generic/473.out /git/xfstests-dev/results//generic/473.out.bad --- /git/xfstests-dev/tests/generic/473.out 2021-02-24 16:51:23.254845067 +0800 +++ /git/xfstests-dev/results//generic/473.out.bad 2021-02-24 16:52:04.440737816 +0800 @@ -5,8 +5,10 @@ 0: [128..255]: data 1: [256..287]: hole Hole + Data -0: [0..127]: hole -1: [128..255]: data +/mnt/test/fiemap.473: + EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS + 0: [0..127]: hole 128 + 1: [128..135]: 274560..274567 8 0x1 Hole + Data + Hole 0: [0..127]: hole 1: [128..255]: data > > /mnt/test/fiemap.473: > | > EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS > | > 0: [0..127]: hole 128 > | > 1: [128..255]: 26792..26919 128 0x0 > > [128..255] corresponds to the BLOCK-RANGE of the extent > 26792..26919. > > > You may ask why the ending hole range is not aligned to 128 in > > 473.out. Because > > fiemap ioctl returns nothing of querying holes. xfs_io does the > > extra > > print work for holes. > > > > xfsprogs-dev/io/fiemap.c: > > for holes: > > 153 if (lstart > llast) { > > 154 print_hole(0, 0, 0, cur_extent, lflag, true, llast, > > lstart); > > 155 cur_extent++; > > 156 num_printed++; > > 157 } > > > > for the ending hole: > > 381 if (cur_extent && last_logical < range_end) > > 382 print_hole(foff_w, boff_w, tot_w, cur_extent, > > lflag, !vflag, > > 383 BTOBBT(last_logical), BTOBBT(range_end)); > > > >> Hole + Data + Hole > >> 0: [0..127]: hole > >> 1: [128..255]: data > > ^ permalink raw reply related [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-24 7:52 ` Su Yue 2021-02-24 8:10 ` Su Yue @ 2021-02-24 8:51 ` Chengguang Xu 2021-02-24 9:16 ` Chengguang Xu 2021-02-24 9:22 ` Su Yue 1 sibling, 2 replies; 12+ messages in thread From: Chengguang Xu @ 2021-02-24 8:51 UTC (permalink / raw) To: Su Yue; +Cc: guaneryu, fstests ---- 在 星期三, 2021-02-24 15:52:17 Su Yue <l@damenly.su> 撰写 ---- > > Cc to the author and linux-xfs, since it's xfsprogs related. > > On Tue 23 Feb 2021 at 21:40, Chengguang Xu <cgxu519@mykernel.net> > wrote: > > > It seems the expected result of testcase of "Hole + Data" > > in generic/473 is not correct, so just fix it properly. > > > > But it's not proper... > > > Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> > > --- > > tests/generic/473.out | 2 +- > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > diff --git a/tests/generic/473.out b/tests/generic/473.out > > index 75816388..f1ee5805 100644 > > --- a/tests/generic/473.out > > +++ b/tests/generic/473.out > > @@ -6,7 +6,7 @@ Data + Hole > > 1: [256..287]: hole > > Hole + Data > > 0: [0..127]: hole > > -1: [128..255]: data > > +1: [128..135]: data > > > The line is produced by `$XFS_IO_PROG -c "fiemap -v 0 65k" $file | > _filter_fiemap`. > 0-64k is a hole and 64k-128k is a data extent. > fiemap ioctl always returns *complete* ranges of extents. Manual testing result in latest kernel like below. [root@centos test]# uname -a Linux centos 5.11.0+ #5 SMP Tue Feb 23 21:02:27 CST 2021 x86_64 x86_64 x86_64 GNU/Linux [root@centos test]# xfs_io -V xfs_io version 5.0.0 [root@centos test]# stat a File: a Size: 4194304 Blocks: 0 IO Block: 4096 regular file Device: fc01h/64513d Inode: 140 Links: 1 Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) Access: 2021-02-24 16:33:20.235654140 +0800 Modify: 2021-02-24 16:33:25.070641521 +0800 Change: 2021-02-24 16:33:25.070641521 +0800 Birth: - [root@centos test]# xfs_io -c "pwrite 64k 64k" a wrote 65536/65536 bytes at offset 65536 64 KiB, 16 ops; 0.0000 sec (992.063 MiB/sec and 253968.2540 ops/sec) [root@VM-8-4-centos test]# xfs_io -c "fiemap -v 0 65k" a a: EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS 0: [0..127]: hole 128 1: [128..135]: 360..367 8 0x1 [root@centos test]# xfs_io -c "fiemap -v 0 128k" a a: EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS 0: [0..127]: hole 128 1: [128..255]: 360..487 128 0x1 > > You may ask why the ending hole range is not aligned to 128 in > 473.out. Because > fiemap ioctl returns nothing of querying holes. xfs_io does the > extra > print work for holes. > > xfsprogs-dev/io/fiemap.c: > for holes: > 153 if (lstart > llast) { > 154 print_hole(0, 0, 0, cur_extent, lflag, true, llast, > lstart); > 155 cur_extent++; > 156 num_printed++; > 157 } > > for the ending hole: > 381 if (cur_extent && last_logical < range_end) > 382 print_hole(foff_w, boff_w, tot_w, cur_extent, lflag, > !vflag, > 383 BTOBBT(last_logical), BTOBBT(range_end)); > > > Hole + Data + Hole > > 0: [0..127]: hole > > 1: [128..255]: data > ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-24 8:51 ` Chengguang Xu @ 2021-02-24 9:16 ` Chengguang Xu 2021-02-24 9:22 ` Su Yue 1 sibling, 0 replies; 12+ messages in thread From: Chengguang Xu @ 2021-02-24 9:16 UTC (permalink / raw) To: Su Yue; +Cc: guaneryu, fstests, linux-fsdevel, linux-ext4, linux-xfs, linux-btrfs ---- 在 星期三, 2021-02-24 16:51:03 Chengguang Xu <cgxu519@mykernel.net> 撰写 ---- > ---- 在 星期三, 2021-02-24 15:52:17 Su Yue <l@damenly.su> 撰写 ---- > > > > Cc to the author and linux-xfs, since it's xfsprogs related. > > > > On Tue 23 Feb 2021 at 21:40, Chengguang Xu <cgxu519@mykernel.net> > > wrote: > > > > > It seems the expected result of testcase of "Hole + Data" > > > in generic/473 is not correct, so just fix it properly. > > > > > > > But it's not proper... > > > > > Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> > > > --- > > > tests/generic/473.out | 2 +- > > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > > > diff --git a/tests/generic/473.out b/tests/generic/473.out > > > index 75816388..f1ee5805 100644 > > > --- a/tests/generic/473.out > > > +++ b/tests/generic/473.out > > > @@ -6,7 +6,7 @@ Data + Hole > > > 1: [256..287]: hole > > > Hole + Data > > > 0: [0..127]: hole > > > -1: [128..255]: data > > > +1: [128..135]: data > > > > > The line is produced by `$XFS_IO_PROG -c "fiemap -v 0 65k" $file | > > _filter_fiemap`. > > 0-64k is a hole and 64k-128k is a data extent. > > fiemap ioctl always returns *complete* ranges of extents. Finally, I found btrfs returns *complete* rangne of extents but xfs/ext4 does not. :-/ [root@VM-89-226-centos /test]# xfs_io -c "fiemap 0 65k" a a: 0: [0..127]: hole 1: [128..255]: 24576..24703 [root@VM-89-226-centos /test]# xfs_io -c "fiemap 0 128k" a a: 0: [0..127]: hole 1: [128..255]: 24576..24703 > > Manual testing result in latest kernel like below. > > [root@centos test]# uname -a > Linux centos 5.11.0+ #5 SMP Tue Feb 23 21:02:27 CST 2021 x86_64 x86_64 x86_64 GNU/Linux > > [root@centos test]# xfs_io -V > xfs_io version 5.0.0 > > [root@centos test]# stat a > File: a > Size: 4194304 Blocks: 0 IO Block: 4096 regular file > Device: fc01h/64513d Inode: 140 Links: 1 > Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ root) > Access: 2021-02-24 16:33:20.235654140 +0800 > Modify: 2021-02-24 16:33:25.070641521 +0800 > Change: 2021-02-24 16:33:25.070641521 +0800 > Birth: - > > [root@centos test]# xfs_io -c "pwrite 64k 64k" a > wrote 65536/65536 bytes at offset 65536 > 64 KiB, 16 ops; 0.0000 sec (992.063 MiB/sec and 253968.2540 ops/sec) > > [root@VM-8-4-centos test]# xfs_io -c "fiemap -v 0 65k" a > a: > EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS > 0: [0..127]: hole 128 > 1: [128..135]: 360..367 8 0x1 > > [root@centos test]# xfs_io -c "fiemap -v 0 128k" a > a: > EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS > 0: [0..127]: hole 128 > 1: [128..255]: 360..487 128 0x1 > > > > > > You may ask why the ending hole range is not aligned to 128 in > > 473.out. Because > > fiemap ioctl returns nothing of querying holes. xfs_io does the > > extra > > print work for holes. > > > > xfsprogs-dev/io/fiemap.c: > > for holes: > > 153 if (lstart > llast) { > > 154 print_hole(0, 0, 0, cur_extent, lflag, true, llast, > > lstart); > > 155 cur_extent++; > > 156 num_printed++; > > 157 } > > > > for the ending hole: > > 381 if (cur_extent && last_logical < range_end) > > 382 print_hole(foff_w, boff_w, tot_w, cur_extent, lflag, > > !vflag, > > 383 BTOBBT(last_logical), BTOBBT(range_end)); > > > > > Hole + Data + Hole > > > 0: [0..127]: hole > > > 1: [128..255]: data > > > ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-24 8:51 ` Chengguang Xu 2021-02-24 9:16 ` Chengguang Xu @ 2021-02-24 9:22 ` Su Yue 2021-02-24 9:37 ` Chengguang Xu 1 sibling, 1 reply; 12+ messages in thread From: Su Yue @ 2021-02-24 9:22 UTC (permalink / raw) To: cgxu519; +Cc: guaneryu, fstests On Wed 24 Feb 2021 at 16:51, Chengguang Xu <cgxu519@mykernel.net> wrote: > ---- 在 星期三, 2021-02-24 15:52:17 Su Yue <l@damenly.su> 撰写 > ---- > > > > Cc to the author and linux-xfs, since it's xfsprogs related. > > > > On Tue 23 Feb 2021 at 21:40, Chengguang Xu > > <cgxu519@mykernel.net> > > wrote: > > > > > It seems the expected result of testcase of "Hole + Data" > > > in generic/473 is not correct, so just fix it properly. > > > > > > > But it's not proper... > > > > > Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> > > > --- > > > tests/generic/473.out | 2 +- > > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > > > diff --git a/tests/generic/473.out b/tests/generic/473.out > > > index 75816388..f1ee5805 100644 > > > --- a/tests/generic/473.out > > > +++ b/tests/generic/473.out > > > @@ -6,7 +6,7 @@ Data + Hole > > > 1: [256..287]: hole > > > Hole + Data > > > 0: [0..127]: hole > > > -1: [128..255]: data > > > +1: [128..135]: data > > > > > The line is produced by `$XFS_IO_PROG -c "fiemap -v 0 65k" > > $file | > > _filter_fiemap`. > > 0-64k is a hole and 64k-128k is a data extent. > > fiemap ioctl always returns *complete* ranges of extents. > > Manual testing result in latest kernel like below. > > [root@centos test]# uname -a > Linux centos 5.11.0+ #5 SMP Tue Feb 23 21:02:27 CST 2021 x86_64 > x86_64 x86_64 GNU/Linux > > [root@centos test]# xfs_io -V > xfs_io version 5.0.0 > > [root@centos test]# stat a > File: a > Size: 4194304 Blocks: 0 IO Block: 4096 > regular file > Device: fc01h/64513d Inode: 140 Links: 1 > Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ > root) > Access: 2021-02-24 16:33:20.235654140 +0800 > Modify: 2021-02-24 16:33:25.070641521 +0800 > Change: 2021-02-24 16:33:25.070641521 +0800 > Birth: - > > [root@centos test]# xfs_io -c "pwrite 64k 64k" a > wrote 65536/65536 bytes at offset 65536 > 64 KiB, 16 ops; 0.0000 sec (992.063 MiB/sec and 253968.2540 > ops/sec) > > [root@VM-8-4-centos test]# xfs_io -c "fiemap -v 0 65k" a > a: > EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS > 0: [0..127]: hole 128 > 1: [128..135]: 360..367 8 0x1 > Sorry, my carelessness. I only checked btrfs implementation but xfs and ext4 do return the change you made. > [root@centos test]# xfs_io -c "fiemap -v 0 128k" a > a: > EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS > 0: [0..127]: hole 128 > 1: [128..255]: 360..487 128 0x1 > > > > > > You may ask why the ending hole range is not aligned to 128 > > in > > 473.out. Because > > fiemap ioctl returns nothing of querying holes. xfs_io does > > the > > extra > > print work for holes. > > > > xfsprogs-dev/io/fiemap.c: > > for holes: > > 153 if (lstart > llast) { > > 154 print_hole(0, 0, 0, cur_extent, lflag, true, > > llast, > > lstart); > > 155 cur_extent++; > > 156 num_printed++; > > 157 } > > > > for the ending hole: > > 381 if (cur_extent && last_logical < range_end) > > 382 print_hole(foff_w, boff_w, tot_w, cur_extent, > > lflag, > > !vflag, > > 383 BTOBBT(last_logical), > > BTOBBT(range_end)); > > > > > Hole + Data + Hole > > > 0: [0..127]: hole > > > 1: [128..255]: data > > ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-24 9:22 ` Su Yue @ 2021-02-24 9:37 ` Chengguang Xu 2021-02-24 13:31 ` Eryu Guan 0 siblings, 1 reply; 12+ messages in thread From: Chengguang Xu @ 2021-02-24 9:37 UTC (permalink / raw) To: Su Yue; +Cc: guaneryu, fstests, linux-btrfs, linux-fsdevel, linux-ext4, linux-xfs ---- 在 星期三, 2021-02-24 17:22:35 Su Yue <l@damenly.su> 撰写 ---- > > On Wed 24 Feb 2021 at 16:51, Chengguang Xu <cgxu519@mykernel.net> > wrote: > > > ---- 在 星期三, 2021-02-24 15:52:17 Su Yue <l@damenly.su> 撰写 > > ---- > > > > > > Cc to the author and linux-xfs, since it's xfsprogs related. > > > > > > On Tue 23 Feb 2021 at 21:40, Chengguang Xu > > > <cgxu519@mykernel.net> > > > wrote: > > > > > > > It seems the expected result of testcase of "Hole + Data" > > > > in generic/473 is not correct, so just fix it properly. > > > > > > > > > > But it's not proper... > > > > > > > Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> > > > > --- > > > > tests/generic/473.out | 2 +- > > > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > > > > > diff --git a/tests/generic/473.out b/tests/generic/473.out > > > > index 75816388..f1ee5805 100644 > > > > --- a/tests/generic/473.out > > > > +++ b/tests/generic/473.out > > > > @@ -6,7 +6,7 @@ Data + Hole > > > > 1: [256..287]: hole > > > > Hole + Data > > > > 0: [0..127]: hole > > > > -1: [128..255]: data > > > > +1: [128..135]: data > > > > > > > The line is produced by `$XFS_IO_PROG -c "fiemap -v 0 65k" > > > $file | > > > _filter_fiemap`. > > > 0-64k is a hole and 64k-128k is a data extent. > > > fiemap ioctl always returns *complete* ranges of extents. > > > > Manual testing result in latest kernel like below. > > > > [root@centos test]# uname -a > > Linux centos 5.11.0+ #5 SMP Tue Feb 23 21:02:27 CST 2021 x86_64 > > x86_64 x86_64 GNU/Linux > > > > [root@centos test]# xfs_io -V > > xfs_io version 5.0.0 > > > > [root@centos test]# stat a > > File: a > > Size: 4194304 Blocks: 0 IO Block: 4096 > > regular file > > Device: fc01h/64513d Inode: 140 Links: 1 > > Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ > > root) > > Access: 2021-02-24 16:33:20.235654140 +0800 > > Modify: 2021-02-24 16:33:25.070641521 +0800 > > Change: 2021-02-24 16:33:25.070641521 +0800 > > Birth: - > > > > [root@centos test]# xfs_io -c "pwrite 64k 64k" a > > wrote 65536/65536 bytes at offset 65536 > > 64 KiB, 16 ops; 0.0000 sec (992.063 MiB/sec and 253968.2540 > > ops/sec) > > > > [root@VM-8-4-centos test]# xfs_io -c "fiemap -v 0 65k" a > > a: > > EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS > > 0: [0..127]: hole 128 > > 1: [128..135]: 360..367 8 0x1 > > > > Sorry, my carelessness. I only checked btrfs implementation but > xfs > and ext4 do return the change you made. > Yeah, it seems there is no bad side effect to show only specified range of extents and keep all the same behavior is also good for testing. I can post a fix patch for this but before that let us to wait some feedback from maintainers and experts. Thanks, Chengguang > > > [root@centos test]# xfs_io -c "fiemap -v 0 128k" a > > a: > > EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS > > 0: [0..127]: hole 128 > > 1: [128..255]: 360..487 128 0x1 > > > > > > > > > > You may ask why the ending hole range is not aligned to 128 > > > in > > > 473.out. Because > > > fiemap ioctl returns nothing of querying holes. xfs_io does > > > the > > > extra > > > print work for holes. > > > > > > xfsprogs-dev/io/fiemap.c: > > > for holes: > > > 153 if (lstart > llast) { > > > 154 print_hole(0, 0, 0, cur_extent, lflag, true, > > > llast, > > > lstart); > > > 155 cur_extent++; > > > 156 num_printed++; > > > 157 } > > > > > > for the ending hole: > > > 381 if (cur_extent && last_logical < range_end) > > > 382 print_hole(foff_w, boff_w, tot_w, cur_extent, > > > lflag, > > > !vflag, > > > 383 BTOBBT(last_logical), > > > BTOBBT(range_end)); > > > > > > > Hole + Data + Hole > > > > 0: [0..127]: hole > > > > 1: [128..255]: data > > > > > ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-24 9:37 ` Chengguang Xu @ 2021-02-24 13:31 ` Eryu Guan 2021-02-24 13:48 ` Chengguang Xu 0 siblings, 1 reply; 12+ messages in thread From: Eryu Guan @ 2021-02-24 13:31 UTC (permalink / raw) To: Chengguang Xu Cc: Su Yue, guaneryu, fstests, linux-btrfs, linux-fsdevel, linux-ext4, linux-xfs On Wed, Feb 24, 2021 at 05:37:20PM +0800, Chengguang Xu wrote: > ---- 在 星期三, 2021-02-24 17:22:35 Su Yue <l@damenly.su> 撰写 ---- > > > > On Wed 24 Feb 2021 at 16:51, Chengguang Xu <cgxu519@mykernel.net> > > wrote: > > > > > ---- 在 星期三, 2021-02-24 15:52:17 Su Yue <l@damenly.su> 撰写 > > > ---- > > > > > > > > Cc to the author and linux-xfs, since it's xfsprogs related. > > > > > > > > On Tue 23 Feb 2021 at 21:40, Chengguang Xu > > > > <cgxu519@mykernel.net> > > > > wrote: > > > > > > > > > It seems the expected result of testcase of "Hole + Data" > > > > > in generic/473 is not correct, so just fix it properly. > > > > > > > > > > > > > But it's not proper... > > > > > > > > > Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> > > > > > --- > > > > > tests/generic/473.out | 2 +- > > > > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > > > > > > > diff --git a/tests/generic/473.out b/tests/generic/473.out > > > > > index 75816388..f1ee5805 100644 > > > > > --- a/tests/generic/473.out > > > > > +++ b/tests/generic/473.out > > > > > @@ -6,7 +6,7 @@ Data + Hole > > > > > 1: [256..287]: hole > > > > > Hole + Data > > > > > 0: [0..127]: hole > > > > > -1: [128..255]: data > > > > > +1: [128..135]: data > > > > > > > > > The line is produced by `$XFS_IO_PROG -c "fiemap -v 0 65k" > > > > $file | > > > > _filter_fiemap`. > > > > 0-64k is a hole and 64k-128k is a data extent. > > > > fiemap ioctl always returns *complete* ranges of extents. > > > > > > Manual testing result in latest kernel like below. > > > > > > [root@centos test]# uname -a > > > Linux centos 5.11.0+ #5 SMP Tue Feb 23 21:02:27 CST 2021 x86_64 > > > x86_64 x86_64 GNU/Linux > > > > > > [root@centos test]# xfs_io -V > > > xfs_io version 5.0.0 > > > > > > [root@centos test]# stat a > > > File: a > > > Size: 4194304 Blocks: 0 IO Block: 4096 > > > regular file > > > Device: fc01h/64513d Inode: 140 Links: 1 > > > Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ > > > root) > > > Access: 2021-02-24 16:33:20.235654140 +0800 > > > Modify: 2021-02-24 16:33:25.070641521 +0800 > > > Change: 2021-02-24 16:33:25.070641521 +0800 > > > Birth: - > > > > > > [root@centos test]# xfs_io -c "pwrite 64k 64k" a > > > wrote 65536/65536 bytes at offset 65536 > > > 64 KiB, 16 ops; 0.0000 sec (992.063 MiB/sec and 253968.2540 > > > ops/sec) > > > > > > [root@VM-8-4-centos test]# xfs_io -c "fiemap -v 0 65k" a > > > a: > > > EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS > > > 0: [0..127]: hole 128 > > > 1: [128..135]: 360..367 8 0x1 > > > > > > > Sorry, my carelessness. I only checked btrfs implementation but > > xfs > > and ext4 do return the change you made. > > > > Yeah, it seems there is no bad side effect to show only specified range of extents > and keep all the same behavior is also good for testing. I can post a fix patch for > this but before that let us to wait some feedback from maintainers and experts. generic/473 is marked as broken by commit 715eac1a9e66 ("generic/47[23]: remove from auto/quick groups"). Thanks, Eryu ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-24 13:31 ` Eryu Guan @ 2021-02-24 13:48 ` Chengguang Xu 0 siblings, 0 replies; 12+ messages in thread From: Chengguang Xu @ 2021-02-24 13:48 UTC (permalink / raw) To: Eryu Guan Cc: Su Yue, guaneryu, fstests, linux-btrfs, linux-fsdevel, linux-ext4, linux-xfs ---- 在 星期三, 2021-02-24 21:31:46 Eryu Guan <eguan@linux.alibaba.com> 撰写 ---- > On Wed, Feb 24, 2021 at 05:37:20PM +0800, Chengguang Xu wrote: > > ---- 在 星期三, 2021-02-24 17:22:35 Su Yue <l@damenly.su> 撰写 ---- > > > > > > On Wed 24 Feb 2021 at 16:51, Chengguang Xu <cgxu519@mykernel.net> > > > wrote: > > > > > > > ---- 在 星期三, 2021-02-24 15:52:17 Su Yue <l@damenly.su> 撰写 > > > > ---- > > > > > > > > > > Cc to the author and linux-xfs, since it's xfsprogs related. > > > > > > > > > > On Tue 23 Feb 2021 at 21:40, Chengguang Xu > > > > > <cgxu519@mykernel.net> > > > > > wrote: > > > > > > > > > > > It seems the expected result of testcase of "Hole + Data" > > > > > > in generic/473 is not correct, so just fix it properly. > > > > > > > > > > > > > > > > But it's not proper... > > > > > > > > > > > Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> > > > > > > --- > > > > > > tests/generic/473.out | 2 +- > > > > > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > > > > > > > > > diff --git a/tests/generic/473.out b/tests/generic/473.out > > > > > > index 75816388..f1ee5805 100644 > > > > > > --- a/tests/generic/473.out > > > > > > +++ b/tests/generic/473.out > > > > > > @@ -6,7 +6,7 @@ Data + Hole > > > > > > 1: [256..287]: hole > > > > > > Hole + Data > > > > > > 0: [0..127]: hole > > > > > > -1: [128..255]: data > > > > > > +1: [128..135]: data > > > > > > > > > > > The line is produced by `$XFS_IO_PROG -c "fiemap -v 0 65k" > > > > > $file | > > > > > _filter_fiemap`. > > > > > 0-64k is a hole and 64k-128k is a data extent. > > > > > fiemap ioctl always returns *complete* ranges of extents. > > > > > > > > Manual testing result in latest kernel like below. > > > > > > > > [root@centos test]# uname -a > > > > Linux centos 5.11.0+ #5 SMP Tue Feb 23 21:02:27 CST 2021 x86_64 > > > > x86_64 x86_64 GNU/Linux > > > > > > > > [root@centos test]# xfs_io -V > > > > xfs_io version 5.0.0 > > > > > > > > [root@centos test]# stat a > > > > File: a > > > > Size: 4194304 Blocks: 0 IO Block: 4096 > > > > regular file > > > > Device: fc01h/64513d Inode: 140 Links: 1 > > > > Access: (0644/-rw-r--r--) Uid: ( 0/ root) Gid: ( 0/ > > > > root) > > > > Access: 2021-02-24 16:33:20.235654140 +0800 > > > > Modify: 2021-02-24 16:33:25.070641521 +0800 > > > > Change: 2021-02-24 16:33:25.070641521 +0800 > > > > Birth: - > > > > > > > > [root@centos test]# xfs_io -c "pwrite 64k 64k" a > > > > wrote 65536/65536 bytes at offset 65536 > > > > 64 KiB, 16 ops; 0.0000 sec (992.063 MiB/sec and 253968.2540 > > > > ops/sec) > > > > > > > > [root@VM-8-4-centos test]# xfs_io -c "fiemap -v 0 65k" a > > > > a: > > > > EXT: FILE-OFFSET BLOCK-RANGE TOTAL FLAGS > > > > 0: [0..127]: hole 128 > > > > 1: [128..135]: 360..367 8 0x1 > > > > > > > > > > Sorry, my carelessness. I only checked btrfs implementation but > > > xfs > > > and ext4 do return the change you made. > > > > > > > Yeah, it seems there is no bad side effect to show only specified range of extents > > and keep all the same behavior is also good for testing. I can post a fix patch for > > this but before that let us to wait some feedback from maintainers and experts. > > generic/473 is marked as broken by commit 715eac1a9e66 ("generic/47[23]: > remove from auto/quick groups"). > I got it, thanks Eryu! ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-23 13:40 [PATCH] generic/473: fix expectation properly in out file Chengguang Xu 2021-02-24 7:52 ` Su Yue @ 2021-02-24 16:50 ` Darrick J. Wong 2021-02-25 2:16 ` Chengguang Xu 1 sibling, 1 reply; 12+ messages in thread From: Darrick J. Wong @ 2021-02-24 16:50 UTC (permalink / raw) To: Chengguang Xu; +Cc: guaneryu, fstests On Tue, Feb 23, 2021 at 09:40:42PM +0800, Chengguang Xu wrote: > It seems the expected result of testcase of "Hole + Data" > in generic/473 is not correct, so just fix it properly. > > Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> > --- > tests/generic/473.out | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > diff --git a/tests/generic/473.out b/tests/generic/473.out > index 75816388..f1ee5805 100644 > --- a/tests/generic/473.out > +++ b/tests/generic/473.out > @@ -6,7 +6,7 @@ Data + Hole > 1: [256..287]: hole > Hole + Data > 0: [0..127]: hole > -1: [128..255]: data > +1: [128..135]: data This again. While the FIEMAP documentation allows the call to return file mapping data outside the requested range, it doesn't require it, and neither XFS nor ext4 have ever done so. This test *enforces* that the FIEMAP implementation provide data outside the requested range, which means it has never passed on xfs/ext4. This is no surprise, since it's enforcing one behavior where the spec allows for two behaviors. The only fs I know of where it passes is btrfs. Delete this test or move it to tests/btrfs/, because it should not have been added in the first place. --D > Hole + Data + Hole > 0: [0..127]: hole > 1: [128..255]: data > -- > 2.27.0 > > ^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [PATCH] generic/473: fix expectation properly in out file 2021-02-24 16:50 ` Darrick J. Wong @ 2021-02-25 2:16 ` Chengguang Xu 0 siblings, 0 replies; 12+ messages in thread From: Chengguang Xu @ 2021-02-25 2:16 UTC (permalink / raw) To: Darrick J. Wong; +Cc: guaneryu, fstests ---- 在 星期四, 2021-02-25 00:50:57 Darrick J. Wong <djwong@kernel.org> 撰写 ---- > On Tue, Feb 23, 2021 at 09:40:42PM +0800, Chengguang Xu wrote: > > It seems the expected result of testcase of "Hole + Data" > > in generic/473 is not correct, so just fix it properly. > > > > Signed-off-by: Chengguang Xu <cgxu519@mykernel.net> > > --- > > tests/generic/473.out | 2 +- > > 1 file changed, 1 insertion(+), 1 deletion(-) > > > > diff --git a/tests/generic/473.out b/tests/generic/473.out > > index 75816388..f1ee5805 100644 > > --- a/tests/generic/473.out > > +++ b/tests/generic/473.out > > @@ -6,7 +6,7 @@ Data + Hole > > 1: [256..287]: hole > > Hole + Data > > 0: [0..127]: hole > > -1: [128..255]: data > > +1: [128..135]: data > > This again. While the FIEMAP documentation allows the call to return > file mapping data outside the requested range, it doesn't require it, > and neither XFS nor ext4 have ever done so. I did more tests on ext4 and found in old 4.14 kernel ext4 returned whole extent range. > > This test *enforces* that the FIEMAP implementation provide data outside > the requested range, which means it has never passed on xfs/ext4. This > is no surprise, since it's enforcing one behavior where the spec allows > for two behaviors. The only fs I know of where it passes is btrfs. plus f2fs. Thanks, Chengguang > > Delete this test or move it to tests/btrfs/, because it should not have > been added in the first place. > > --D > > > Hole + Data + Hole > > 0: [0..127]: hole > > 1: [128..255]: data > > -- > > 2.27.0 > > > > > ^ permalink raw reply [flat|nested] 12+ messages in thread
end of thread, other threads:[~2021-02-25 2:18 UTC | newest] Thread overview: 12+ messages (download: mbox.gz follow: Atom feed -- links below jump to the message on this page -- 2021-02-23 13:40 [PATCH] generic/473: fix expectation properly in out file Chengguang Xu 2021-02-24 7:52 ` Su Yue 2021-02-24 8:10 ` Su Yue 2021-02-24 8:55 ` Chengguang Xu 2021-02-24 8:51 ` Chengguang Xu 2021-02-24 9:16 ` Chengguang Xu 2021-02-24 9:22 ` Su Yue 2021-02-24 9:37 ` Chengguang Xu 2021-02-24 13:31 ` Eryu Guan 2021-02-24 13:48 ` Chengguang Xu 2021-02-24 16:50 ` Darrick J. Wong 2021-02-25 2:16 ` Chengguang Xu
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.