[Bug-Report] fio cannot handle some situation

[Bug-Report] fio cannot handle some situation

[Chao Guo]

1) A description of what you think the bug is:

  when using readwrite=randread and do_verify=1, fio always fails with
'Invalid or incomplete multibyte or wide character'


2) Environment (Linux distro version, kernel version). This is mostly
   needed if it's a build bug.

   CentOS 7(fio 3.1-2)

   CentOS 7(build from github.com/axboe/fio, master)

   Ubuntu 18.04(fio 3.1-1)

3) The output from fio --version.

   See above

4) How to reproduce. Please include a full list of the parameters
   passed to fio and the job file used (if any).

[global]
ioengine=libaio
direct=1
group_reporting
iodepth=128
bs=1M
readwrite=randread
size=500MB
do_verify=1
verify=crc32c-intel

[test]
filename=test

Re: [Bug-Report] fio cannot handle some situation

[Jens Axboe]

On 8/21/18 4:21 AM, Chao Guo wrote:
> 1) A description of what you think the bug is:
> 
>   when using readwrite=randread and do_verify=1, fio always fails with
> 'Invalid or incomplete multibyte or wide character'
> 
> 
> 2) Environment (Linux distro version, kernel version). This is mostly
>    needed if it's a build bug.
> 
>    CentOS 7(fio 3.1-2)
> 
>    CentOS 7(build from github.com/axboe/fio, master)
> 
>    Ubuntu 18.04(fio 3.1-1)
> 
> 3) The output from fio --version.
> 
>    See above
> 
> 4) How to reproduce. Please include a full list of the parameters
>    passed to fio and the job file used (if any).
> 
> [global]
> ioengine=libaio
> direct=1
> group_reporting
> iodepth=128
> bs=1M
> readwrite=randread
> size=500MB
> do_verify=1
> verify=crc32c-intel
> 
> [test]
> filename=test

You're asking fio to verify a file, which assumes that the file
has already been written with verify data. That's not the case
(unless you ran another job to do that first), so the verify will
naturally fail.

Change your readwrite=randread to readwrite=randwrite, and fio
will randomly write it first, them randomly read and verify.

-- 
Jens Axboe

Re: [Bug-Report] fio cannot handle some situation

[Chao Guo]

ok. that makes sense.

i thought that the file fio created was already written with verify data.

thanks a lot

On Tue, Aug 21, 2018 at 11:19 PM, Jens Axboe <axboe@kernel.dk> wrote:
> On 8/21/18 4:21 AM, Chao Guo wrote:
>> 1) A description of what you think the bug is:
>>
>>   when using readwrite=randread and do_verify=1, fio always fails with
>> 'Invalid or incomplete multibyte or wide character'
>>
>>
>> 2) Environment (Linux distro version, kernel version). This is mostly
>>    needed if it's a build bug.
>>
>>    CentOS 7(fio 3.1-2)
>>
>>    CentOS 7(build from github.com/axboe/fio, master)
>>
>>    Ubuntu 18.04(fio 3.1-1)
>>
>> 3) The output from fio --version.
>>
>>    See above
>>
>> 4) How to reproduce. Please include a full list of the parameters
>>    passed to fio and the job file used (if any).
>>
>> [global]
>> ioengine=libaio
>> direct=1
>> group_reporting
>> iodepth=128
>> bs=1M
>> readwrite=randread
>> size=500MB
>> do_verify=1
>> verify=crc32c-intel
>>
>> [test]
>> filename=test
>
> You're asking fio to verify a file, which assumes that the file
> has already been written with verify data. That's not the case
> (unless you ran another job to do that first), so the verify will
> naturally fail.
>
> Change your readwrite=randread to readwrite=randwrite, and fio
> will randomly write it first, them randomly read and verify.
>
> --
> Jens Axboe
>



-- 
关注官微，获实时帮助

 郭超 Guo Chao

上海亦存网络科技有限公司 Yicun Network Tech Co., Ltd.
邮箱 Email: guochao@nutstore.net
手机 Mobile: 18729085840

Re: [Bug-Report] fio cannot handle some situation

[Jens Axboe]

On 8/22/18 4:40 AM, Chao Guo wrote:
> ok. that makes sense.
> 
> i thought that the file fio created was already written with verify data.

Only if you ask it to, as it stands, your job file asked fio to verify
already written data.

-- 
Jens Axboe

Re: [Bug-Report] fio cannot handle some situation

[Chao Guo]

[-- Attachment #1: Type: text/plain, Size: 624 bytes --]

Ok, thanks. I get it.

And fio is really remarkable. thanks for your job.

On Wed, Aug 22, 2018 at 11:09 PM Jens Axboe <axboe@kernel.dk> wrote:

> On 8/22/18 4:40 AM, Chao Guo wrote:
> > ok. that makes sense.
> >
> > i thought that the file fio created was already written with verify data.
>
> Only if you ask it to, as it stands, your job file asked fio to verify
> already written data.
>
> --
> Jens Axboe
>
>

-- 
关注官微，获实时帮助

 郭超 Guo Chao

上海亦存网络科技有限公司 Yicun Network Tech Co., Ltd.
邮箱 Email: guochao@nutstore.net
手机 Mobile: 18729085840

[-- Attachment #2: Type: text/html, Size: 2000 bytes --]

Re: [Bug-Report] fio cannot handle some situation

[Chao Guo]

[-- Attachment #1: Type: text/plain, Size: 423 bytes --]

Ok, thanks. I get it.

And fio is really remarkable. thanks for your job.

On Wed, Aug 22, 2018 at 11:09 PM Jens Axboe <axboe@kernel.dk> wrote:

> On 8/22/18 4:40 AM, Chao Guo wrote:
> > ok. that makes sense.
> >
> > i thought that the file fio created was already written with verify data.
>
> Only if you ask it to, as it stands, your job file asked fio to verify
> already written data.
>
> --
> Jens Axboe
>
>
Chao Guo

[-- Attachment #2: Type: text/html, Size: 871 bytes --]

Re: [Bug-Report] fio cannot handle some situation

[Chao Guo]

[-- Attachment #1: Type: text/plain, Size: 627 bytes --]

Ok, thanks. I get it.

And fio is really remarkable. thanks for your job.


On Wed, Aug 22, 2018 at 11:09 PM Jens Axboe <axboe@kernel.dk> wrote:
>
> On 8/22/18 4:40 AM, Chao Guo wrote:
> > ok. that makes sense.
> >
> > i thought that the file fio created was already written with verify
data.
>
> Only if you ask it to, as it stands, your job file asked fio to verify
> already written data.
>
> --
> Jens Axboe
>


-- 
关注官微，获实时帮助

 郭超 Guo Chao

上海亦存网络科技有限公司 Yicun Network Tech Co., Ltd.
邮箱 Email: guochao@nutstore.net
手机 Mobile: 18729085840

[-- Attachment #2: Type: text/html, Size: 876 bytes --]

Re: [Bug-Report] fio cannot handle some situation

[Chao Guo]

[-- Attachment #1: Type: text/plain, Size: 74 bytes --]

Ok, thanks. I get it.

And fio is really remarkable. thanks for your job.

[-- Attachment #2: Type: text/html, Size: 225 bytes --]

Re: [Bug-Report] fio cannot handle some situation

[Chao Guo]

[-- Attachment #1: Type: text/plain, Size: 79 bytes --]

Ok, thanks. I get it.

And fio is really fancy. thanks for your job.

Chao Guo

[-- Attachment #2: Type: text/html, Size: 257 bytes --]