From: Vincent Fu <vincentfu@gmail.com>
To: "Yan, Jane" <Jane.J.Yan@dell.com>,
"fio@vger.kernel.org" <fio@vger.kernel.org>
Subject: Re: FIO for random seed usage -How to verify the data validation
Date: Wed, 23 Jul 2025 13:22:53 -0400 [thread overview]
Message-ID: <d3dbac97-318e-4df6-b6df-0c14184bb8c9@gmail.com> (raw)
In-Reply-To: <SN4PR19MB547194A3A4A1560CB9A2D2F6A851A@SN4PR19MB5471.namprd19.prod.outlook.com>
On 7/17/25 10:39 AM, Yan, Jane wrote:
>
>
> HI, FIO experts, how are you !
>
> Currently I am using the FIO tool for some testing ,I got a problem which may need your help , Thanks a lot.
> Seems if we used the randseed ,we could not do data validation correctly.
>
>
> I want to use the randseed to generate totally same data pattern to do deduplication seems we cannot do data verification if we used the seed ?
> Can you please give me an example how to validate the data with randseed. Thanks .
> My step steps:
>
> 1. Write configure file:
>
> [write_test]
> filename=/home/cyc/tmp/seed/testa.txt
> size=8k
> rw=write
> bs=8k
> numjobs=1
> iodepth=1
> direct=1
> sync=1
> randseed=383733983
> buffer_compress_percentage=50
> randrepeat=1
>
> 2. Validation conf file:
>
> [write_test]
> filename=/home/cyc/tmp/seed/testa.txt
> size=8k
> rw=read
> bs=8k
> numjobs=1
> iodepth=1
> direct=1
> sync=1
> randseed=383733983
> buffer_compress_percentage=50
> randrepeat=1
> do_verify=1
>
> 3. Modify the file testa.txt and then do reun the verify file , which did not report errors this is not expected as I change the testa.txt file ,thanks
>
> Thanks a lot.
>
>
>
> Internal Use - Confidential
>
You need to tell fio what type of checksum to use for validation. To
both of your jobs add an option such as
verify=crc32c
Then fio will calculate a crc32c checksum and place it in the verify
header associated with each IO. When fio reads the data back it will
compare the checksum calculated from the data with the checksum in the
header. If there is a mismatch fio will report an error.
See also this overview of fio's verify feature:
https://github.com/vincentkfu/fio-blog/wiki/Verify-overview
Vincent
prev parent reply other threads:[~2025-07-23 17:22 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <SN4PR19MB547124FE361F26649D8C7517A851A@SN4PR19MB5471.namprd19.prod.outlook.com>
[not found] ` <SN4PR19MB54710097436252E45CEAE9E1A851A@SN4PR19MB5471.namprd19.prod.outlook.com>
2025-07-17 14:39 ` FIO for random seed usage -How to verify the data validation Yan, Jane
2025-07-23 17:22 ` Vincent Fu [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=d3dbac97-318e-4df6-b6df-0c14184bb8c9@gmail.com \
--to=vincentfu@gmail.com \
--cc=Jane.J.Yan@dell.com \
--cc=fio@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox