* [PATCH] generic/042: add sleep before shutdown
@ 2019-07-03 1:31 Yang Xu
2019-07-03 3:34 ` Theodore Ts'o
0 siblings, 1 reply; 4+ messages in thread
From: Yang Xu @ 2019-07-03 1:31 UTC (permalink / raw)
To: tytso; +Cc: fstests, Yang Xu
On some server machines, the memory was so big that we
don't have enough time to submit file. After umoumt,
hexdump will report no such file or directory on ext4.
memory：128G
swap:8G
fail as below:
-------------------------------------------
falloc -k
wrote 65536/65536 bytes at offset 0
-XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec)
+64 KiB, 16 ops; 0.0002 sec (282.805 MiB/sec and 72398.1900 ops/sec)
+hexdump: /mnt/xfstests/scratch/042.mnt/file: No such file or directory
+hexdump: all input file arguments failed
-------------------------------------------
I think we should reserve a short time, so umount will not lose file.
Signed-off-by: Yang Xu <xuyang2018.jy@cn.fujitsu.com>
---
tests/generic/042 | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/tests/generic/042 b/tests/generic/042
index 6c62eb63..e1453114 100755
--- a/tests/generic/042
+++ b/tests/generic/042
@@ -56,6 +56,10 @@ _crashtest()
# write, run the test command and shutdown the fs
$XFS_IO_PROG -f -c "pwrite -S 1 0 64k" -c "$cmd 60k 4k" $file | \
_filter_xfs_io
+
+ # keep file not lose when umount even on server machine
+ sleep 10
+
./src/godown -f $mnt
$UMOUNT_PROG $mnt
--
2.18.1
^ permalink raw reply related [flat|nested] 4+ messages in thread
* Re: [PATCH] generic/042: add sleep before shutdown
2019-07-03 1:31 [PATCH] generic/042: add sleep before shutdown Yang Xu
@ 2019-07-03 3:34 ` Theodore Ts'o
2019-07-03 8:15 ` Yang Xu
0 siblings, 1 reply; 4+ messages in thread
From: Theodore Ts'o @ 2019-07-03 3:34 UTC (permalink / raw)
To: Yang Xu; +Cc: fstests
On Wed, Jul 03, 2019 at 09:31:11AM +0800, Yang Xu wrote:
> On some server machines, the memory was so big that we
> don't have enough time to submit file. After umoumt,
> hexdump will report no such file or directory on ext4.
Um, so this is passing for me using ext4. The file system is getting
shutdown via "./src/godown -f $mnt". The -f causes the shutdown file
system to be called with the LOGFLUSH flag set. This causes a forced
journal commit before the file system is shut down, so how much memory
the system might have should be irrelvant.
The only thing I can think of is if the journal was not enabled, but
generic/042 calls _require_metadata_journalling, and so the test will
be skipped if the file system was created without a journal or if the
noload mount option is passed as part of the test config.
Can you say a little bit more about your test configuration and test
environment? This test really shouldn't be needing your patch;
sleeping for ten seconds should *not* be making a difference as to
whether or not the file exists for hexdump to test. And to the extent
that the test is trying to find race conditions, adding a sleep 10
defeats the purpose of the test.
- Ted
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [PATCH] generic/042: add sleep before shutdown
2019-07-03 3:34 ` Theodore Ts'o
@ 2019-07-03 8:15 ` Yang Xu
0 siblings, 0 replies; 4+ messages in thread
From: Yang Xu @ 2019-07-03 8:15 UTC (permalink / raw)
To: Theodore Ts'o; +Cc: fstests
on 2019/07/03 11:34, Theodore Ts'o wrote:
> On Wed, Jul 03, 2019 at 09:31:11AM +0800, Yang Xu wrote:
>> On some server machines, the memory was so big that we
>> don't have enough time to submit file. After umoumt,
>> hexdump will report no such file or directory on ext4.
> Um, so this is passing for me using ext4. The file system is getting
> shutdown via "./src/godown -f $mnt". The -f causes the shutdown file
> system to be called with the LOGFLUSH flag set. This causes a forced
> journal commit before the file system is shut down, so how much memory
> the system might have should be irrelvant.
>
> The only thing I can think of is if the journal was not enabled, but
> generic/042 calls _require_metadata_journalling, and so the test will
> be skipped if the file system was created without a journal or if the
> noload mount option is passed as part of the test config.
Hi Theodore
Thanks for your quick reply.
I am trying it about how much memory leads to case fails(I decrease memory to 8G,swap 2G, processor 2,
and off numa in grub2, this cases also fails.). It look likes not memeory affect this.
As you said, generic/042 has enabled journal. But filesystem errors occur(please see the
last dmesg). I doubt whether the file metadata journal trancation has been aborted or
clear, and data has been written into disk. So the error occur?
my local.config as below(sda6 sda7 size is 20G):
TEST_DIR=/mnt/xfstests/test
TEST_DEV=/dev/sda6
SCRATCH_MNT=/mnt/xfstests/scratch
SCRATCH_DEV=/dev/sda7
export XFS_MKFS_OPTIONS="-m reflink=1"
> Can you say a little bit more about your test configuration and test
> environment? This test really shouldn't be needing your patch;
> sleeping for ten seconds should *not* be making a difference as to
> whether or not the file exists for hexdump to test. And to the extent
> that the test is trying to find race conditions, adding a sleep 10
> defeats the purpose of the test.
Ok. I see. Add ten sleep will defeat the purpose the test like fsync.
my test environment as below(hardware supports numa):
package:e2fsprogs-1.44.6-3.el8.x86_6
kernel:4.18.0-100.el8.x86_64
Intel(R) Xeon(R) Platinum 8180 CPU @ 2.50GHz
memory:128G, swap:9G, processors:112
Disk identifier: ADA6C75F-FB05-412B-981B-510BEB2346B3
dmesg(From dmesg, filesystem error occurs):
[165576.774479] run fstests generic/042 at 2019-07-04 11:39:47
[165577.900431] EXT4-fs (sda7): mounted filesystem with ordered data mode. Opts: acl,user_xattr
[165577.901681] EXT4-fs (sda7): shut down requested (1)
[165577.902069] Aborting journal on device sda7-8.
[165578.995533] EXT4-fs (sda7): mounted filesystem with ordered data mode. Opts: acl,user_xattr
[165579.263674] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null)
[165579.267658] EXT4-fs (loop0): shut down requested (1)
[165579.268159] Aborting journal on device loop0-8.
[165579.297715] JBD2: Detected IO errors while flushing file data on loop0-8
[165579.360537] EXT4-fs warning (device loop0): ext4_clear_journal_err:4992: Filesystem error recorded from previous mount: IO failure
[165579.360540] EXT4-fs warning (device loop0): ext4_clear_journal_err:4993: Marking fs in need of filesystem check.
[165579.395128] EXT4-fs (loop0): warning: mounting fs with errors, running e2fsck is recommended
[165579.412176] EXT4-fs (loop0): recovery complete
[165579.429230] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null)
[165579.777900] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null)
[165579.781827] EXT4-fs (loop0): shut down requested (1)
[165579.782353] Aborting journal on device loop0-8.
[165579.817722] JBD2: Detected IO errors while flushing file data on loop0-8
[165579.897782] EXT4-fs warning (device loop0): ext4_clear_journal_err:4992: Filesystem error recorded from previous mount: IO failure
[165579.897785] EXT4-fs warning (device loop0): ext4_clear_journal_err:4993: Marking fs in need of filesystem check.
[165579.926637] EXT4-fs (loop0): warning: mounting fs with errors, running e2fsck is recommended
[165579.943837] EXT4-fs (loop0): recovery complete
[165579.960779] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null)
[165580.309274] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null)
[165580.313196] EXT4-fs (loop0): shut down requested (1)
[165580.313733] Aborting journal on device loop0-8.
[165580.326363] JBD2: Detected IO errors while flushing file data on loop0-8
[165580.412144] EXT4-fs warning (device loop0): ext4_clear_journal_err:4992: Filesystem error recorded from previous mount: IO failure
[165580.412145] EXT4-fs warning (device loop0): ext4_clear_journal_err:4993: Marking fs in need of filesystem check.
[165580.446685] EXT4-fs (loop0): warning: mounting fs with errors, running e2fsck is recommended
[165580.463867] EXT4-fs (loop0): recovery complete
[165580.480805] EXT4-fs (loop0): mounted filesystem with ordered data mode. Opts: (null)
[165580.723550] EXT4-fs (sda7): mounted filesystem with ordered data mode. Opts: acl,user_xa
> - Ted
>
>
>
^ permalink raw reply [flat|nested] 4+ messages in thread
* [PATCH] generic/042: add sleep before shutdown
@ 2019-06-26 23:51 Yang Xu
0 siblings, 0 replies; 4+ messages in thread
From: Yang Xu @ 2019-06-26 23:51 UTC (permalink / raw)
To: fstests; +Cc: Yang Xu
On some server machines, the memory was so big that we
don't have enough time to submit file. After umoumt,
hexdump will report no such file or directory on ext4.
memory：128G
swap:8G
fail as below:
-------------------------------------------
falloc -k
wrote 65536/65536 bytes at offset 0
-XXX Bytes, X ops; XX:XX:XX.X (XXX YYY/sec and XXX ops/sec)
+64 KiB, 16 ops; 0.0002 sec (282.805 MiB/sec and 72398.1900 ops/sec)
+hexdump: /mnt/xfstests/scratch/042.mnt/file: No such file or directory
+hexdump: all input file arguments failed
-------------------------------------------
I think we should reserve a short time, so umount will not lose file.
Signed-off-by: Yang Xu <xuyang2018.jy@cn.fujitsu.com>
---
tests/generic/042 | 4 ++++
1 file changed, 4 insertions(+)
diff --git a/tests/generic/042 b/tests/generic/042
index 6c62eb63..e1453114 100755
--- a/tests/generic/042
+++ b/tests/generic/042
@@ -56,6 +56,10 @@ _crashtest()
# write, run the test command and shutdown the fs
$XFS_IO_PROG -f -c "pwrite -S 1 0 64k" -c "$cmd 60k 4k" $file | \
_filter_xfs_io
+
+ # keep file not lose when umount even on server machine
+ sleep 10
+
./src/godown -f $mnt
$UMOUNT_PROG $mnt
--
2.18.1
^ permalink raw reply related [flat|nested] 4+ messages in thread
end of thread, other threads:[~2019-07-03 8:15 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2019-07-03 1:31 [PATCH] generic/042: add sleep before shutdown Yang Xu
2019-07-03 3:34 ` Theodore Ts'o
2019-07-03 8:15 ` Yang Xu
-- strict thread matches above, loose matches on Subject: below --
2019-06-26 23:51 Yang Xu
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox