Flexible I/O Tester development
 help / color / mirror / Atom feed
From: Mark Kirkwood <mark.kirkwood@catalyst.net.nz>
To: Ketor D <d.ketor@gmail.com>
Cc: Jens Axboe <axboe@kernel.dk>,
	Mark Nelson <mark.nelson@inktank.com>,
	Mark Nelson <mark.a.nelson@gmail.com>,
	"fio@vger.kernel.org" <fio@vger.kernel.org>,
	"xan.peng" <xanpeng@gmail.com>,
	"ceph-devel@vger.kernel.org" <ceph-devel@vger.kernel.org>
Subject: Re: fio rbd completions (Was: fio rbd hang for block sizes > 1M)
Date: Fri, 31 Oct 2014 21:54:32 +1300	[thread overview]
Message-ID: <54534E48.8080505@catalyst.net.nz> (raw)
In-Reply-To: <CAM9_UU_NV+Ra+A0K5mES_A08HiaOEtMjuj2hxtGd4eW8cNoxWg@mail.gmail.com>

On 30/10/14 21:04, Ketor D wrote:
> Hi Mark,
>        Could you do a fio test in your env with the busy_poll=1 ?
> I am very interested in the busy_poll result. Thanks!
>

Sure:

blocksize k | head iops     |  head iops (busy_pool=1)
------------+---------------+--------------------------
4           |  11114        |  12608
128         |   4551        |   6422
1024        |   1195        |   1175
4096        |    320        |    316

So looks like the busy_pool=1 improves performance for small and mid 
range blocksizes but is a little slower at the larger end.

However there are a lot of variables here - I'm using iodepth=32 for 
instance, and altering that may change the pattern I'm seeing, also a 
system with more osd's may bring out different behaviours as it runs the 
fio client out of available cpu power in the smaller block sizes.

Regards

Mark




  reply	other threads:[~2014-10-31  8:54 UTC|newest]

Thread overview: 52+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2014-10-24  2:38 fio rbd hang for block sizes > 1M Mark Kirkwood
2014-10-24  5:35 ` Jens Axboe
2014-10-24  6:17   ` Mark Kirkwood
2014-10-24 13:19     ` Mark Nelson
2014-10-24 14:09       ` Mark Nelson
2014-10-24 14:30         ` Jens Axboe
2014-10-24 22:45         ` Mark Kirkwood
2014-10-25  0:12           ` Mark Nelson
2014-10-25  0:37             ` Mark Kirkwood
2014-10-25  2:35               ` Mark Kirkwood
2014-10-25  3:47                 ` Jens Axboe
2014-10-25  4:50                   ` fio rbd completions (Was: fio rbd hang for block sizes > 1M) Mark Kirkwood
2014-10-25 19:20                     ` Jens Axboe
2014-10-25 22:25                       ` Mark Kirkwood
2014-10-27  9:27                         ` Ketor D
2014-10-27 10:25                           ` Ketor D
2014-10-27 14:19                             ` Jens Axboe
2014-10-27 14:15                           ` Jens Axboe
2014-10-27 14:19                         ` Jens Axboe
2014-10-27 15:12                           ` Ketor D
2014-10-27 15:22                             ` Jens Axboe
2014-10-27 15:25                               ` Jens Axboe
2014-10-27 15:29                                 ` Ketor D
2014-10-27 15:36                                   ` Jens Axboe
2014-10-27 15:45                                     ` Ketor D
2014-10-27 15:53                                       ` Jens Axboe
2014-10-27 16:20                                         ` Ketor D
2014-10-27 16:55                                           ` Jens Axboe
2014-10-27 21:59                                           ` Mark Kirkwood
2014-10-27 22:32                                             ` Jens Axboe
2014-10-27 23:21                                               ` Mark Kirkwood
2014-10-28  3:23                                                 ` Ketor D
2014-10-28  4:01                                                   ` Mark Kirkwood
2014-10-28  4:05                                                   ` Jens Axboe
2014-10-28  4:49                                                     ` Ketor D
2014-10-28 15:14                                                       ` Jens Axboe
2014-10-28 15:49                                                         ` Ketor D
2014-10-28 15:53                                                           ` Jens Axboe
2014-10-28 17:09                                                           ` Jens Axboe
2014-10-28 18:43                                                             ` Ketor D
2014-10-29  7:15                                                               ` Ketor D
2014-10-29 14:31                                                                 ` Jens Axboe
2014-10-30  2:50                                                                   ` Ketor D
2014-10-30  2:55                                                                     ` Jens Axboe
2014-10-30  5:29                                                                       ` Ketor D
2014-10-30  7:44                                                                   ` Mark Kirkwood
2014-10-30  8:04                                                                     ` Ketor D
2014-10-31  8:54                                                                       ` Mark Kirkwood [this message]
2014-10-24 22:30       ` fio rbd hang for block sizes > 1M Mark Kirkwood
2014-10-24 22:38         ` Mark Nelson
2014-10-24 14:11   ` Danny Al-Gaaf
2014-10-24 14:31     ` Jens Axboe

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=54534E48.8080505@catalyst.net.nz \
    --to=mark.kirkwood@catalyst.net.nz \
    --cc=axboe@kernel.dk \
    --cc=ceph-devel@vger.kernel.org \
    --cc=d.ketor@gmail.com \
    --cc=fio@vger.kernel.org \
    --cc=mark.a.nelson@gmail.com \
    --cc=mark.nelson@inktank.com \
    --cc=xanpeng@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox