Flexible I/O Tester development
 help / color / mirror / Atom feed
From: Jens Axboe <jens.axboe@oracle.com>
To: Troels Arvin <troels@arvin.dk>
Cc: fio@vger.kernel.org
Subject: Re: Does fio write only 0x00s?
Date: Mon, 15 Mar 2010 22:22:19 +0100	[thread overview]
Message-ID: <20100315212219.GQ5768@kernel.dk> (raw)
In-Reply-To: <4B9E9D92.80701@arvin.dk>

On Mon, Mar 15 2010, Troels Arvin wrote:
> Hello,
>
> I'm benchmarking a new FC-attached storage system which we are bringing  
> into production, in order to see if it yields acceptable performance -  
> and to have a baseline for potential performance trouble in the future.
>
> One of the tools I'm using is fio, which is certainly great. Especially  
> the fact that it includes data regarding latencies, and that it makes it  
> easy to have a mix of reads and writes.
>
> Now, compared to an another FC-attached storage system, and compared to  
> a local RAID10, the new system yields fio numbers which are extremely  
> much better.
> This made me have a quick and superficial look into the files which fio  
> works with. I seems that the files contain only 0-bytes.
>
> Does fio only write bytes with a single value?
> If so: I would be afraid that some kind of  
> compression/de-duplication/thin provisioning feature in the storage  
> system invalidates the fio results I'm seeing. Is this a valid fear?

By default, fio will at init time randomly fill the buffer of the
allocated IO units. If you are using the sync io engine, then only one
buffer will be allocated and that will be repeatedly written. So yes,
that'll compress very nicely. You can enable refill_buffers=1 and
that'll cause fio to randomly fill it everytime it's submitted instead.
That should effectively disable compression at the storage end.

But you should not be seeing zeroes only. Are you perhaps sparsely
filling a file with random writes, and you are observing the holes?

-- 
Jens Axboe


  reply	other threads:[~2010-03-15 21:22 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-03-15 20:50 Does fio write only 0x00s? Troels Arvin
2010-03-15 21:22 ` Jens Axboe [this message]
2010-03-15 23:19   ` Troels Arvin
2010-03-16  8:05     ` Jens Axboe
2010-03-16 11:27       ` Troels Arvin

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20100315212219.GQ5768@kernel.dk \
    --to=jens.axboe@oracle.com \
    --cc=fio@vger.kernel.org \
    --cc=troels@arvin.dk \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox