From: "Huang\, Ying" <ying.huang@intel.com>
To: Jan Kara <jack@suse.cz>
Cc: Avi Kivity <avi@scylladb.com>,
LKML <linux-kernel@vger.kernel.org>,
0day robot <fengguang.wu@intel.com>, <lkp@01.org>,
Steven Whitehouse <swhiteho@redhat.com>
Subject: Re: [LKP] [lkp] [direct] e594571852: xfstests.generic.299.fail
Date: Tue, 24 Nov 2015 12:45:54 +0800 [thread overview]
Message-ID: <87r3jguhrx.fsf@yhuang-dev.intel.com> (raw)
In-Reply-To: <20151123112026.GE23418@quack.suse.cz> (Jan Kara's message of "Mon, 23 Nov 2015 12:20:26 +0100")
[-- Attachment #1: Type: text/plain, Size: 697 bytes --]
Jan Kara <jack@suse.cz> writes:
> Hello,
>
> On Mon 23-11-15 16:29:25, kernel test robot wrote:
>> FYI, we noticed the below changes on
>>
>> git://internal_merge_and_test_tree
>> revert-e594571852b03a5503ba48edd718462e99bf238e-e594571852b03a5503ba48edd718462e99bf238e
>> commit e594571852b03a5503ba48edd718462e99bf238e ("direct-io: Fix negative return from dio read beyond eof")
>
> Do you have the file:
>
> /lkp/benchmarks/xfstests/results//generic/299.full
>
> produced by the failed test? Thanks!
I found we have this feature in our test scripts already, just need to
fix a bug in script, but that is just done yesterday! Please check the
299.full attached.
Best Regards,
Huang, Ying
[-- Attachment #2: 299.full --]
[-- Type: application/octet-stream, Size: 9494 bytes --]
fio --ioengine=libaio --bs=128k --directory=/fs/scratch --filesize=96636764160 --size=999G --iodepth=128*1 --continue_on_error=write --ignore_error=,ENOSPC --error_dump=0 --create_on_open=1 --fallocate=none --exitall=1 --name=direct_aio --direct=1 --buffered=0 --numjobs=4 --rw=randwrite --runtime=100*1 --time_based --name=aio-dio-verifier --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=4 --verifysort=1 --direct=1 --bs=4k --rw=randrw --filename=aio-dio-verifier --name=buffered-aio-verifier --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=4 --verifysort=1 --direct=0 --buffered=1 --bs=4k --rw=randrw --filename=buffered-aio-verifier
###########
# 299 test fio activity
# Filenames derived from jobsname and jobid like follows:
# ..
[global]
ioengine=libaio
bs=128k
directory=/fs/scratch
filesize=96636764160
size=999G
iodepth=128*1
continue_on_error=write
ignore_error=,ENOSPC
error_dump=0
create_on_open=1
fallocate=none
exitall=1
## Perform direct aio, to files which may be truncated
## by external task
[direct_aio]
direct=1
buffered=0
numjobs=4
rw=randwrite
runtime=100*1
time_based
# Perform direct aio and verify data
# This test case should check use-after-free issues
[aio-dio-verifier]
numjobs=1
verify=crc32c-intel
verify_fatal=1
verify_dump=1
verify_backlog=1024
verify_async=4
verifysort=1
direct=1
bs=4k
rw=randrw
filename=aio-dio-verifier
# Perform buffered aio and verify data
# This test case should check use-after-free issues
[buffered-aio-verifier]
numjobs=1
verify=crc32c-intel
verify_fatal=1
verify_dump=1
verify_backlog=1024
verify_async=4
verifysort=1
direct=0
buffered=1
bs=4k
rw=randrw
filename=buffered-aio-verifier
# /usr/bin/fio /tmp/32763.fio
fallocate: No space left on device
direct_aio: (g=0): rw=randwrite, bs=128K-128K/128K-128K/128K-128K, ioengine=libaio, iodepth=128
...
aio-dio-verifier: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=128
buffered-aio-verifier: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=128
fio-2.1.11
Starting 6 processes
fallocate: No space left on device
fallocate: No space left on device
fallocate: No space left on device
fallocate: No space left on device
fio: io_u.c:1315: __get_io_u: Assertion `io_u->flags & IO_U_F_FREE' failed.
fio: pid=607, got signal=6
fio: io_u error on file /fs/scratch/aio-dio-verifier: Cannot allocate memory
read offset=8446353408, buflen=4096
fio: io_u error on file /fs/scratch/aio-dio-verifier: Cannot allocate memory
read offset=71839776768, buflen=4096
fallocate: No space left on device
direct_aio: (groupid=0, jobs=1): err= 0: pid=601: Tue Nov 24 11:18:39 2015
write: io=3328.0KB, bw=1357.9KB/s, iops=10, runt= 2451msec
slat (usec): min=52, max=1995.3K, avg=94225.62, stdev=395390.10
clat (usec): min=9, max=2432.5K, avg=1308562.46, stdev=1037197.96
lat (msec): min=397, max=2449, avg=1402.79, stdev=1024.77
clat percentiles (usec):
| 1.00th=[ 9], 5.00th=[399360], 10.00th=[399360], 20.00th=[399360],
| 30.00th=[399360], 40.00th=[399360], 50.00th=[399360], 60.00th=[2408448],
| 70.00th=[2408448], 80.00th=[2408448], 90.00th=[2408448], 95.00th=[2408448],
| 99.00th=[2441216], 99.50th=[2441216], 99.90th=[2441216], 99.95th=[2441216],
| 99.99th=[2441216]
bw (KB /s): min= 52, max= 52, per=0.06%, avg=52.00, stdev= 0.00
lat (usec) : 10=3.85%
lat (msec) : 500=50.00%, >=2000=46.15%
cpu : usr=0.00%, sys=0.04%, ctx=12, majf=0, minf=9
IO depths : 1=3.8%, 2=7.7%, 4=15.4%, 8=30.8%, 16=42.3%, 32=0.0%, >=64=0.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
issued : total=r=0/w=26/d=0, short=r=0/w=0/d=0
errors : total=0, first_error=0/<Success>
latency : target=0, window=0, percentile=100.00%, depth=128
direct_aio: (groupid=0, jobs=1): err= 0: pid=602: Tue Nov 24 11:18:39 2015
write: io=10112KB, bw=4125.7KB/s, iops=32, runt= 2451msec
slat (usec): min=50, max=1907.2K, avg=31008.52, stdev=218628.65
clat (usec): min=12, max=2432.3K, avg=739870.43, stdev=755535.67
lat (msec): min=396, max=2449, avg=770.88, stdev=774.81
clat percentiles (usec):
| 1.00th=[ 12], 5.00th=[395264], 10.00th=[395264], 20.00th=[395264],
| 30.00th=[399360], 40.00th=[399360], 50.00th=[399360], 60.00th=[399360],
| 70.00th=[399360], 80.00th=[399360], 90.00th=[2310144], 95.00th=[2408448],
| 99.00th=[2441216], 99.50th=[2441216], 99.90th=[2441216], 99.95th=[2441216],
| 99.99th=[2441216]
bw (KB /s): min= 52, max= 52, per=0.06%, avg=52.00, stdev= 0.00
lat (usec) : 20=1.27%
lat (msec) : 500=81.01%, >=2000=17.72%
cpu : usr=0.00%, sys=0.16%, ctx=12, majf=0, minf=10
IO depths : 1=1.3%, 2=2.5%, 4=5.1%, 8=10.1%, 16=20.3%, 32=40.5%, >=64=20.3%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0%
issued : total=r=0/w=79/d=0, short=r=0/w=0/d=0
errors : total=0, first_error=0/<Success>
latency : target=0, window=0, percentile=100.00%, depth=128
direct_aio: (groupid=0, jobs=1): err= 0: pid=603: Tue Nov 24 11:18:39 2015
write: io=200192KB, bw=79473KB/s, iops=620, runt= 2519msec
slat (usec): min=38, max=155172, avg=276.60, stdev=5060.46
clat (msec): min=8, max=597, avg=197.86, stdev=121.42
lat (msec): min=10, max=597, avg=198.14, stdev=121.23
clat percentiles (msec):
| 1.00th=[ 51], 5.00th=[ 127], 10.00th=[ 133], 20.00th=[ 161],
| 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 163], 60.00th=[ 163],
| 70.00th=[ 165], 80.00th=[ 172], 90.00th=[ 281], 95.00th=[ 594],
| 99.00th=[ 594], 99.50th=[ 594], 99.90th=[ 594], 99.95th=[ 594],
| 99.99th=[ 594]
bw (KB /s): min=77306, max=101173, per=99.41%, avg=89459.25, stdev=12548.25
lat (msec) : 10=0.06%, 20=0.77%, 100=2.81%, 250=84.72%, 500=3.77%
lat (msec) : 750=7.86%
cpu : usr=0.64%, sys=4.41%, ctx=432, majf=0, minf=5
IO depths : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.0%, 32=2.0%, >=64=96.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
issued : total=r=0/w=1564/d=0, short=r=0/w=0/d=0
errors : total=0, first_error=0/<Success>
latency : target=0, window=0, percentile=100.00%, depth=128
direct_aio: (groupid=0, jobs=1): err= 0: pid=604: Tue Nov 24 11:18:39 2015
write: io=13056KB, bw=5201.7KB/s, iops=40, runt= 2510msec
slat (usec): min=53, max=1905.1K, avg=24599.30, stdev=193704.93
clat (usec): min=10, max=2494.2K, avg=1134770.84, stdev=931324.08
lat (msec): min=456, max=2509, avg=1159.37, stdev=934.19
clat percentiles (msec):
| 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 457],
| 30.00th=[ 457], 40.00th=[ 457], 50.00th=[ 461], 60.00th=[ 461],
| 70.00th=[ 2376], 80.00th=[ 2376], 90.00th=[ 2376], 95.00th=[ 2474],
| 99.00th=[ 2474], 99.50th=[ 2507], 99.90th=[ 2507], 99.95th=[ 2507],
| 99.99th=[ 2507]
bw (KB /s): min= 51, max= 51, per=0.06%, avg=51.00, stdev= 0.00
lat (usec) : 20=0.98%
lat (msec) : 500=63.73%, >=2000=35.29%
cpu : usr=0.00%, sys=0.28%, ctx=10, majf=0, minf=7
IO depths : 1=1.0%, 2=2.0%, 4=3.9%, 8=7.8%, 16=15.7%, 32=31.4%, >=64=38.2%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0%
issued : total=r=0/w=102/d=0, short=r=0/w=0/d=0
errors : total=0, first_error=0/<Success>
latency : target=0, window=0, percentile=100.00%, depth=128
aio-dio-verifier: (groupid=0, jobs=1): err=12 (file:io_u.c:1548, func=io_u error, error=Cannot allocate memory): pid=605: Tue Nov 24 11:18:39 2015
cpu : usr=0.00%, sys=0.10%, ctx=42, majf=0, minf=14
IO depths : 1=0.8%, 2=1.6%, 4=3.1%, 8=6.2%, 16=12.5%, 32=25.0%, >=64=50.8%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=64/w=64/d=0, short=r=0/w=0/d=0
errors : total=0, first_error=0/<Success>
latency : target=0, window=0, percentile=100.00%, depth=128
buffered-aio-verifier: (groupid=0, jobs=1): err= 0: pid=607: Tue Nov 24 11:18:39 2015
lat (usec) : 500=0.84%, 750=1.37%, 1000=29.04%
lat (msec) : 2=64.00%, 4=2.05%, 2000=0.64%
cpu : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
issued : total=r=3657/w=2548/d=0, short=r=0/w=0/d=0
errors : total=0, first_error=0/<Success>
latency : target=0, window=0, percentile=100.00%, depth=128
Run status group 0 (all jobs):
WRITE: io=226688KB, aggrb=89991KB/s, minb=1357KB/s, maxb=79472KB/s, mint=2451msec, maxt=2519msec
fio: file hash not empty on exit
fallocate: No space left on device
failed: '/usr/bin/fio /tmp/32763.fio'
fallocate: No space left on device
next prev parent reply other threads:[~2015-11-24 4:45 UTC|newest]
Thread overview: 5+ messages / expand[flat|nested] mbox.gz Atom feed top
2015-11-23 8:29 [lkp] [direct] e594571852: xfstests.generic.299.fail kernel test robot
2015-11-23 11:20 ` Jan Kara
2015-11-24 1:51 ` [LKP] " Huang, Ying
2015-11-24 4:45 ` Huang, Ying [this message]
2015-11-24 10:03 ` Jan Kara
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87r3jguhrx.fsf@yhuang-dev.intel.com \
--to=ying.huang@intel.com \
--cc=avi@scylladb.com \
--cc=fengguang.wu@intel.com \
--cc=jack@suse.cz \
--cc=linux-kernel@vger.kernel.org \
--cc=lkp@01.org \
--cc=swhiteho@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox