All of lore.kernel.org
 help / color / mirror / Atom feed
From: Jens Axboe <axboe@kernel.dk>
To: Andrey Kuzmin <andrey.v.kuzmin@gmail.com>
Cc: Stephen Nichols <Stephen.Nichols@wdc.com>,
	"fio@vger.kernel.org" <fio@vger.kernel.org>
Subject: Re: Sequential Commands are essentially random when in mixed sequential/random workloads
Date: Sun, 14 Dec 2014 19:39:28 -0700	[thread overview]
Message-ID: <548E49E0.10503@kernel.dk> (raw)
In-Reply-To: <CANvN+enb9j_964d9=R-iOq79VCu7ZzjqSw7K6Oz-XNAx-n3aGg@mail.gmail.com>

On 12/14/2014 08:20 AM, Andrey Kuzmin wrote:
> On Sun, Dec 14, 2014 at 1:53 AM, Jens Axboe <axboe@kernel.dk> wrote:
>> On 12/12/2014 05:23 PM, Stephen Nichols wrote:
>>> Hi all,
>>>
>>> When using fio configuration below..
>>>
>>> [global]
>>> ioengine=libaio
>>> direct=1
>>> runtime=600
>>> bs=32k
>>> iodepth=8
>>> rw=randrw
>>> rwmixread=80
>>> percentage_random=100,0
>>>
>>> [drive1]
>>> filename=/dev/sda
>>>
>>>
>>> I am expecting to see 80% reads, 20% writes where all reads are random and all writes are sequential. I captured a bus trace of traffic to the disk and the bus trace reflected as much with one issue. The write commands are essentially random. Each write begins at a new random LBA. If 2 or more writes occur in a row, the LBA's are sequential based on the block size BUT I feel the heart of this feature would be to emulate a large file write during random access. With that in mind would it be possible for sequential reads or writes within mixed sequential/random workload to remember the last LBA accessed? In this scenario the writes would still only take up 20% of the workload but when a write did occur it should be the next sequential step from the last write.
>>>
>>>
>>> Snippet from the bus trace for reference
>>>
>>> Command                                           LBA
>>> Read FPDMA Queued:                  19F3F818
>>> Read FPDMA Queued:                  1CBE2740
>>> Write FPDMA Queued:                 24E35198
>>> Write FPDMA Queued:                 24E351A0
>>> Read FPDMA Queued:                  115A9E10
>>> Write FPDMA Queued:                 A3C1968
>>> Read FPDMA Queued:                  20B89488
>>> Write FPDMA Queued:                 336EE0D0
>>> Write FPDMA Queued:                 336EE0D8
>>>
>>>
>>>
>>> Let me know what you think, this feature may be working as intended but it seemed off to me.
>>
>> Would be easy enough to fix, we just need to track last offset per data
>> direction. Does the attached work for you? Totally untested, will test
>> on Monday.
>
> Looks like fixed.

Thanks for verifying, Andrey. After taking a second look, looks sane to 
me after all. Lucky punch!

Stephen, the fix has been committed, so if you just update to the latest 
git, it should hopefully work for you as well. Please report back when 
you have tested it.

-- 
Jens Axboe



  reply	other threads:[~2014-12-15  2:39 UTC|newest]

Thread overview: 8+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-12-13  0:23 Sequential Commands are essentially random when in mixed sequential/random workloads Stephen Nichols
2014-12-13 20:31 ` Andrey Kuzmin
2014-12-13 22:54   ` Jens Axboe
2014-12-13 22:53 ` Jens Axboe
2014-12-14 15:20   ` Andrey Kuzmin
2014-12-15  2:39     ` Jens Axboe [this message]
2014-12-15 16:33       ` Stephen Nichols
2014-12-16 22:54       ` Stephen Nichols

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=548E49E0.10503@kernel.dk \
    --to=axboe@kernel.dk \
    --cc=Stephen.Nichols@wdc.com \
    --cc=andrey.v.kuzmin@gmail.com \
    --cc=fio@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.