public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: "Huang\, Ying" <ying.huang@intel.com>
To: Jan Kara <jack@suse.cz>
Cc: Avi Kivity <avi@scylladb.com>,
	LKML <linux-kernel@vger.kernel.org>,
	0day robot <fengguang.wu@intel.com>, <lkp@01.org>,
	Steven Whitehouse <swhiteho@redhat.com>
Subject: Re: [LKP] [lkp] [direct] e594571852: xfstests.generic.299.fail
Date: Tue, 24 Nov 2015 12:45:54 +0800	[thread overview]
Message-ID: <87r3jguhrx.fsf@yhuang-dev.intel.com> (raw)
In-Reply-To: <20151123112026.GE23418@quack.suse.cz> (Jan Kara's message of "Mon, 23 Nov 2015 12:20:26 +0100")

[-- Attachment #1: Type: text/plain, Size: 697 bytes --]

Jan Kara <jack@suse.cz> writes:

>   Hello,
>
> On Mon 23-11-15 16:29:25, kernel test robot wrote:
>> FYI, we noticed the below changes on
>> 
>> git://internal_merge_and_test_tree
>> revert-e594571852b03a5503ba48edd718462e99bf238e-e594571852b03a5503ba48edd718462e99bf238e
>> commit e594571852b03a5503ba48edd718462e99bf238e ("direct-io: Fix negative return from dio read beyond eof")
>
> Do you have the file:
>
> /lkp/benchmarks/xfstests/results//generic/299.full
>
> produced by the failed test? Thanks!

I found we have this feature in our test scripts already, just need to
fix a bug in script, but that is just done yesterday!  Please check the
299.full attached.

Best Regards,
Huang, Ying


[-- Attachment #2: 299.full --]
[-- Type: application/octet-stream, Size: 9494 bytes --]

fio --ioengine=libaio --bs=128k --directory=/fs/scratch --filesize=96636764160 --size=999G --iodepth=128*1 --continue_on_error=write --ignore_error=,ENOSPC --error_dump=0 --create_on_open=1 --fallocate=none --exitall=1 --name=direct_aio --direct=1 --buffered=0 --numjobs=4 --rw=randwrite --runtime=100*1 --time_based --name=aio-dio-verifier --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=4 --verifysort=1 --direct=1 --bs=4k --rw=randrw --filename=aio-dio-verifier --name=buffered-aio-verifier --numjobs=1 --verify=crc32c-intel --verify_fatal=1 --verify_dump=1 --verify_backlog=1024 --verify_async=4 --verifysort=1 --direct=0 --buffered=1 --bs=4k --rw=randrw --filename=buffered-aio-verifier 
###########
# 299 test fio activity
# Filenames derived from jobsname and jobid like follows:
# ..
[global]
ioengine=libaio
bs=128k
directory=/fs/scratch
filesize=96636764160
size=999G
iodepth=128*1
continue_on_error=write
ignore_error=,ENOSPC
error_dump=0
create_on_open=1
fallocate=none
exitall=1

## Perform direct aio, to files which may be truncated
## by external task
[direct_aio]
direct=1
buffered=0
numjobs=4
rw=randwrite
runtime=100*1
time_based

# Perform direct aio and verify data
# This test case should check use-after-free issues
[aio-dio-verifier]
numjobs=1
verify=crc32c-intel
verify_fatal=1
verify_dump=1
verify_backlog=1024
verify_async=4
verifysort=1
direct=1
bs=4k
rw=randrw
filename=aio-dio-verifier

# Perform buffered aio and verify data
# This test case should check use-after-free issues
[buffered-aio-verifier]
numjobs=1
verify=crc32c-intel
verify_fatal=1
verify_dump=1
verify_backlog=1024
verify_async=4
verifysort=1
direct=0
buffered=1
bs=4k
rw=randrw
filename=buffered-aio-verifier
# /usr/bin/fio /tmp/32763.fio
fallocate: No space left on device
direct_aio: (g=0): rw=randwrite, bs=128K-128K/128K-128K/128K-128K, ioengine=libaio, iodepth=128
...
aio-dio-verifier: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=128
buffered-aio-verifier: (g=0): rw=randrw, bs=4K-4K/4K-4K/4K-4K, ioengine=libaio, iodepth=128
fio-2.1.11
Starting 6 processes
fallocate: No space left on device
fallocate: No space left on device
fallocate: No space left on device
fallocate: No space left on device
fio: io_u.c:1315: __get_io_u: Assertion `io_u->flags & IO_U_F_FREE' failed.
fio: pid=607, got signal=6
fio: io_u error on file /fs/scratch/aio-dio-verifier: Cannot allocate memory
     read offset=8446353408, buflen=4096
fio: io_u error on file /fs/scratch/aio-dio-verifier: Cannot allocate memory
     read offset=71839776768, buflen=4096
fallocate: No space left on device

direct_aio: (groupid=0, jobs=1): err= 0: pid=601: Tue Nov 24 11:18:39 2015
  write: io=3328.0KB, bw=1357.9KB/s, iops=10, runt=  2451msec
    slat (usec): min=52, max=1995.3K, avg=94225.62, stdev=395390.10
    clat (usec): min=9, max=2432.5K, avg=1308562.46, stdev=1037197.96
     lat (msec): min=397, max=2449, avg=1402.79, stdev=1024.77
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[399360], 10.00th=[399360], 20.00th=[399360],
     | 30.00th=[399360], 40.00th=[399360], 50.00th=[399360], 60.00th=[2408448],
     | 70.00th=[2408448], 80.00th=[2408448], 90.00th=[2408448], 95.00th=[2408448],
     | 99.00th=[2441216], 99.50th=[2441216], 99.90th=[2441216], 99.95th=[2441216],
     | 99.99th=[2441216]
    bw (KB  /s): min=   52, max=   52, per=0.06%, avg=52.00, stdev= 0.00
    lat (usec) : 10=3.85%
    lat (msec) : 500=50.00%, >=2000=46.15%
  cpu          : usr=0.00%, sys=0.04%, ctx=12, majf=0, minf=9
  IO depths    : 1=3.8%, 2=7.7%, 4=15.4%, 8=30.8%, 16=42.3%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=100.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=0/w=26/d=0, short=r=0/w=0/d=0
     errors    : total=0, first_error=0/<Success>
     latency   : target=0, window=0, percentile=100.00%, depth=128
direct_aio: (groupid=0, jobs=1): err= 0: pid=602: Tue Nov 24 11:18:39 2015
  write: io=10112KB, bw=4125.7KB/s, iops=32, runt=  2451msec
    slat (usec): min=50, max=1907.2K, avg=31008.52, stdev=218628.65
    clat (usec): min=12, max=2432.3K, avg=739870.43, stdev=755535.67
     lat (msec): min=396, max=2449, avg=770.88, stdev=774.81
    clat percentiles (usec):
     |  1.00th=[   12],  5.00th=[395264], 10.00th=[395264], 20.00th=[395264],
     | 30.00th=[399360], 40.00th=[399360], 50.00th=[399360], 60.00th=[399360],
     | 70.00th=[399360], 80.00th=[399360], 90.00th=[2310144], 95.00th=[2408448],
     | 99.00th=[2441216], 99.50th=[2441216], 99.90th=[2441216], 99.95th=[2441216],
     | 99.99th=[2441216]
    bw (KB  /s): min=   52, max=   52, per=0.06%, avg=52.00, stdev= 0.00
    lat (usec) : 20=1.27%
    lat (msec) : 500=81.01%, >=2000=17.72%
  cpu          : usr=0.00%, sys=0.16%, ctx=12, majf=0, minf=10
  IO depths    : 1=1.3%, 2=2.5%, 4=5.1%, 8=10.1%, 16=20.3%, 32=40.5%, >=64=20.3%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0%
     issued    : total=r=0/w=79/d=0, short=r=0/w=0/d=0
     errors    : total=0, first_error=0/<Success>
     latency   : target=0, window=0, percentile=100.00%, depth=128
direct_aio: (groupid=0, jobs=1): err= 0: pid=603: Tue Nov 24 11:18:39 2015
  write: io=200192KB, bw=79473KB/s, iops=620, runt=  2519msec
    slat (usec): min=38, max=155172, avg=276.60, stdev=5060.46
    clat (msec): min=8, max=597, avg=197.86, stdev=121.42
     lat (msec): min=10, max=597, avg=198.14, stdev=121.23
    clat percentiles (msec):
     |  1.00th=[   51],  5.00th=[  127], 10.00th=[  133], 20.00th=[  161],
     | 30.00th=[  161], 40.00th=[  161], 50.00th=[  163], 60.00th=[  163],
     | 70.00th=[  165], 80.00th=[  172], 90.00th=[  281], 95.00th=[  594],
     | 99.00th=[  594], 99.50th=[  594], 99.90th=[  594], 99.95th=[  594],
     | 99.99th=[  594]
    bw (KB  /s): min=77306, max=101173, per=99.41%, avg=89459.25, stdev=12548.25
    lat (msec) : 10=0.06%, 20=0.77%, 100=2.81%, 250=84.72%, 500=3.77%
    lat (msec) : 750=7.86%
  cpu          : usr=0.64%, sys=4.41%, ctx=432, majf=0, minf=5
  IO depths    : 1=0.1%, 2=0.1%, 4=0.3%, 8=0.5%, 16=1.0%, 32=2.0%, >=64=96.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=99.9%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
     issued    : total=r=0/w=1564/d=0, short=r=0/w=0/d=0
     errors    : total=0, first_error=0/<Success>
     latency   : target=0, window=0, percentile=100.00%, depth=128
direct_aio: (groupid=0, jobs=1): err= 0: pid=604: Tue Nov 24 11:18:39 2015
  write: io=13056KB, bw=5201.7KB/s, iops=40, runt=  2510msec
    slat (usec): min=53, max=1905.1K, avg=24599.30, stdev=193704.93
    clat (usec): min=10, max=2494.2K, avg=1134770.84, stdev=931324.08
     lat (msec): min=456, max=2509, avg=1159.37, stdev=934.19
    clat percentiles (msec):
     |  1.00th=[  457],  5.00th=[  457], 10.00th=[  457], 20.00th=[  457],
     | 30.00th=[  457], 40.00th=[  457], 50.00th=[  461], 60.00th=[  461],
     | 70.00th=[ 2376], 80.00th=[ 2376], 90.00th=[ 2376], 95.00th=[ 2474],
     | 99.00th=[ 2474], 99.50th=[ 2507], 99.90th=[ 2507], 99.95th=[ 2507],
     | 99.99th=[ 2507]
    bw (KB  /s): min=   51, max=   51, per=0.06%, avg=51.00, stdev= 0.00
    lat (usec) : 20=0.98%
    lat (msec) : 500=63.73%, >=2000=35.29%
  cpu          : usr=0.00%, sys=0.28%, ctx=10, majf=0, minf=7
  IO depths    : 1=1.0%, 2=2.0%, 4=3.9%, 8=7.8%, 16=15.7%, 32=31.4%, >=64=38.2%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=100.0%
     issued    : total=r=0/w=102/d=0, short=r=0/w=0/d=0
     errors    : total=0, first_error=0/<Success>
     latency   : target=0, window=0, percentile=100.00%, depth=128
aio-dio-verifier: (groupid=0, jobs=1): err=12 (file:io_u.c:1548, func=io_u error, error=Cannot allocate memory): pid=605: Tue Nov 24 11:18:39 2015
  cpu          : usr=0.00%, sys=0.10%, ctx=42, majf=0, minf=14
  IO depths    : 1=0.8%, 2=1.6%, 4=3.1%, 8=6.2%, 16=12.5%, 32=25.0%, >=64=50.8%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=64/w=64/d=0, short=r=0/w=0/d=0
     errors    : total=0, first_error=0/<Success>
     latency   : target=0, window=0, percentile=100.00%, depth=128
buffered-aio-verifier: (groupid=0, jobs=1): err= 0: pid=607: Tue Nov 24 11:18:39 2015
    lat (usec) : 500=0.84%, 750=1.37%, 1000=29.04%
    lat (msec) : 2=64.00%, 4=2.05%, 2000=0.64%
  cpu          : usr=0.00%, sys=0.00%, ctx=0, majf=0, minf=0
  IO depths    : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued    : total=r=3657/w=2548/d=0, short=r=0/w=0/d=0
     errors    : total=0, first_error=0/<Success>
     latency   : target=0, window=0, percentile=100.00%, depth=128

Run status group 0 (all jobs):
  WRITE: io=226688KB, aggrb=89991KB/s, minb=1357KB/s, maxb=79472KB/s, mint=2451msec, maxt=2519msec
fio: file hash not empty on exit
fallocate: No space left on device
failed: '/usr/bin/fio /tmp/32763.fio'
fallocate: No space left on device

  parent reply	other threads:[~2015-11-24  4:45 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-11-23  8:29 [lkp] [direct] e594571852: xfstests.generic.299.fail kernel test robot
2015-11-23 11:20 ` Jan Kara
2015-11-24  1:51   ` [LKP] " Huang, Ying
2015-11-24  4:45   ` Huang, Ying [this message]
2015-11-24 10:03     ` Jan Kara

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=87r3jguhrx.fsf@yhuang-dev.intel.com \
    --to=ying.huang@intel.com \
    --cc=avi@scylladb.com \
    --cc=fengguang.wu@intel.com \
    --cc=jack@suse.cz \
    --cc=linux-kernel@vger.kernel.org \
    --cc=lkp@01.org \
    --cc=swhiteho@redhat.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox