Flexible I/O Tester development
 help / color / mirror / Atom feed
From: Alan Hagge <Alan.Hagge@warnerbros.com>
To: fio@vger.kernel.org
Subject: How to re-use default sequential filenames?
Date: Thu, 04 Apr 2013 09:28:35 -0700	[thread overview]
Message-ID: <515DAA33.4000009@warnerbros.com> (raw)

I'm trying to put together a test of the write and read speed to some 
new SAN storage.  Our workflow involves writing large numbers of 12 MiB 
files (on the order of 20,000 or so) at a time.  I'd like to set up a 
config file section that will write all 20,000 files then read all 
20,000 files and report on the write performance and the read 
performance (separately).

I've tried something like this:

[global]
blocksize=4m
filesize=12m
nrfiles=20000
openfiles=1
file_service_type=sequential
create_on_open=1
ioengine=posixaio

[write]
rw=write

[read]
stonewall
rw=read

But the issue is that the files get created with default filenames 
(write.1.1, write.1.2, etc.), so that when the read job is run, it can't 
find any files (since it expects the files to be named read.1.1, 
read.1.2, etc.).  If I try to specify the "filename=" option in either 
section, fio no longer appends the ".<thread>.<sequence>" to the 
filename, but rather tries to do all I/O to a single file.

Is there a syntax for the "filename=" option that will allow me to 
specify a different root filename, but still use the 
".<thread>.<sequence>" naming convention?  Failing that, is there any 
other way to accomplish my goal?

Thanks for any tips, pointers, etc.


             reply	other threads:[~2013-04-04 16:38 UTC|newest]

Thread overview: 14+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-04-04 16:28 Alan Hagge [this message]
2013-04-04 18:19 ` How to re-use default sequential filenames? Jens Axboe
2013-04-04 18:41   ` Jens Axboe
2013-04-04 23:59     ` Michal Šmucr
2013-04-05  8:40       ` Jens Axboe
2013-04-05 19:24         ` Michal Šmucr
2013-04-05 19:31           ` Jens Axboe
2013-04-05  8:39     ` Jens Axboe
2013-04-07 23:28       ` Michal Šmucr
2013-04-08 11:17         ` Jens Axboe
2013-04-10 17:46           ` Alan Hagge
2013-04-11 11:18             ` Jens Axboe
2013-04-04 18:33 ` Matt Hayward
2013-04-04 19:02   ` Carl Zwanzig

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=515DAA33.4000009@warnerbros.com \
    --to=alan.hagge@warnerbros.com \
    --cc=fio@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox