public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Sagi Grimberg <sagig@dev.mellanox.co.il>
To: Or Gerlitz <gerlitz.or@gmail.com>
Cc: Christoph Hellwig <hch@lst.de>,
	"linux-rdma@vger.kernel.org" <linux-rdma@vger.kernel.org>,
	Bart Van Assche <bart.vanassche@sandisk.com>,
	axboe@fb.com,
	"linux-scsi@vger.kernel.org" <linux-scsi@vger.kernel.org>,
	Linux Kernel <linux-kernel@vger.kernel.org>,
	Oren Duer <oren@mellanox.com>
Subject: Re: [PATCH 1/9] move blk_iopoll to limit and make it generally available
Date: Sun, 15 Nov 2015 15:16:46 +0200	[thread overview]
Message-ID: <564885BE.1080707@dev.mellanox.co.il> (raw)
In-Reply-To: <CAJ3xEMgvttM1D3bePz0CWhZAZ3gCSQsf_qgmq9Ny4gzK5d0bXw@mail.gmail.com>



On 15/11/2015 11:04, Or Gerlitz wrote:
> On Sun, Nov 15, 2015 at 10:48 AM, Sagi Grimberg
> <sagig@dev.mellanox.co.il> wrote:
>> Or is correct,
>>
>> I have attempted to convert iser to use blk_iopoll in the past, however
>> I've seen inconsistent performance and latency skews (comparing to
>> tasklets iser is using today). This was manifested in IOPs test cases
>> where I ran multiple threads with higher queue-depth and not in
>> sanitized pure latency (QD=1) test cases. Unfortunately I didn't have
>> the time to pick it up since.
>>
>> I do have every intention of testing it again with this. If it still
>> exist we will need to find the root-cause of it before converting
>> drivers to use it.
>
> Good, this way (inconsistent performance and latency skews) or another
> (all shines up) -- please
> let us know your findings, best through commenting within V > 0 the
> cover letter posts of this series
>

Hi Or & Co,

I ran some tests on the iser code with this patchset applied.
I can confirm that I did not see any performance degradations.
summary (on my test servers):
1  LUN:   ~530K  (IOPs)
2  LUNs:  ~1080K (IOPs)
4  LUNs:  ~1350K (IOPs)
8  LUNs:  ~1930K (IOPs)
16 LUns:  ~2250K (IOPs)

These results are true both for tasklet and iopoll.

So, I don't have anything smart to say here, the IO
stack (block, scsi) has gone through major changes since
the last time I looked into this, so it'll be pretty hard to figure
out what was the root cause back then...

Sagi.

  reply	other threads:[~2015-11-15 13:16 UTC|newest]

Thread overview: 86+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-11-13 13:46 add a proper completion queue abstraction Christoph Hellwig
2015-11-13 13:46 ` [PATCH 1/9] move blk_iopoll to limit and make it generally available Christoph Hellwig
2015-11-13 15:23   ` Or Gerlitz
2015-11-14  7:02     ` Christoph Hellwig
2015-11-15  8:48       ` Sagi Grimberg
2015-11-15  9:04         ` Or Gerlitz
2015-11-15 13:16           ` Sagi Grimberg [this message]
2015-11-15 12:51         ` Christoph Hellwig
2015-11-13 19:19   ` Bart Van Assche
2015-11-14  7:02     ` Christoph Hellwig
2015-11-17 17:16       ` Bart Van Assche
2015-11-17 17:27         ` Bart Van Assche
2015-11-18 13:58         ` Christoph Hellwig
2015-11-13 13:46 ` [PATCH 2/9] IB: add a proper completion queue abstraction Christoph Hellwig
2015-11-13 18:25   ` Jason Gunthorpe
2015-11-13 19:57     ` Bart Van Assche
2015-11-13 22:06       ` Jason Gunthorpe
2015-11-14  7:13         ` Christoph Hellwig
2015-11-23 20:37           ` Jason Gunthorpe
2015-11-23 21:04             ` Bart Van Assche
2015-11-23 21:28               ` Jason Gunthorpe
2015-11-23 21:54                 ` Bart Van Assche
2015-11-23 22:18                   ` Jason Gunthorpe
2015-11-23 22:33                     ` Bart Van Assche
2015-11-23 23:06                       ` Jason Gunthorpe
     [not found]                         ` <B24F4DDE-709A-4D2D-8B26-4E83325DBB1A@asomi.com>
2015-11-24  0:00                           ` Jason Gunthorpe
2015-11-24  0:34                             ` Tom Talpey
2015-11-24  0:40                               ` Jason Gunthorpe
2015-11-24  2:35                             ` Caitlin Bestler
2015-11-24  7:03                               ` Jason Gunthorpe
2015-11-24 12:52                                 ` Tom Talpey
2015-11-14  7:08     ` Christoph Hellwig
2015-11-23 20:01       ` Jason Gunthorpe
2015-11-23 20:57         ` Christoph Hellwig
2015-11-15  9:40   ` Sagi Grimberg
2015-11-15 12:55     ` Christoph Hellwig
2015-11-15 13:21       ` Sagi Grimberg
2015-11-17 17:52   ` Bart Van Assche
2015-11-18  7:55     ` Sagi Grimberg
2015-11-18 18:20       ` Bart Van Assche
2015-11-20 10:16         ` Christoph Hellwig
2015-11-20 16:50           ` Bart Van Assche
2015-11-22  9:51             ` Sagi Grimberg
2015-11-22 10:13               ` Christoph Hellwig
2015-11-22 10:36                 ` Sagi Grimberg
2015-11-22 13:23                   ` Christoph Hellwig
2015-11-22 14:57                     ` Sagi Grimberg
2015-11-22 16:55                       ` Bart Van Assche
2015-11-18 14:00     ` Christoph Hellwig
2015-11-13 13:46 ` [PATCH 3/9] IB: add a helper to safely drain a QP Christoph Hellwig
2015-11-13 16:16   ` Steve Wise
2015-11-14  7:05     ` Christoph Hellwig
2015-11-15  9:34   ` Sagi Grimberg
2015-11-16 16:38     ` Steve Wise
2015-11-16 18:30       ` Steve Wise
2015-11-16 18:37         ` Sagi Grimberg
2015-11-16 19:03           ` Steve Wise
2015-11-17  8:54             ` Sagi Grimberg
2015-11-23 10:28             ` Sagi Grimberg
2015-11-23 10:35               ` Sagi Grimberg
2015-11-23 14:33                 ` 'Christoph Hellwig'
2015-11-23 14:48                 ` Steve Wise
2015-11-23 14:44               ` Steve Wise
2015-11-17 17:06     ` Bart Van Assche
2015-11-18  7:59       ` Sagi Grimberg
2015-11-18 11:32   ` Sagi Grimberg
2015-11-18 14:06     ` Christoph Hellwig
2015-11-18 15:21       ` Steve Wise
2015-11-13 13:46 ` [PATCH 4/9] srpt: chain RDMA READ/WRITE requests Christoph Hellwig
2015-11-18  1:17   ` Bart Van Assche
2015-11-18  9:15     ` Sagi Grimberg
2015-11-18 16:32       ` Bart Van Assche
2015-11-20 10:20         ` Christoph Hellwig
2015-11-18 14:06     ` Christoph Hellwig
2015-11-13 13:46 ` [PATCH 5/9] srpt: use the new CQ API Christoph Hellwig
2015-11-17 18:22   ` Bart Van Assche
2015-11-17 19:38   ` Bart Van Assche
2015-11-18 14:03     ` Christoph Hellwig
2015-11-13 13:46 ` [PATCH 6/9] srp: " Christoph Hellwig
2015-11-17 19:56   ` Bart Van Assche
2015-11-18 14:03     ` Christoph Hellwig
2015-11-13 13:46 ` [PATCH 7/9] IB/iser: Use a dedicated descriptor for login Christoph Hellwig
2015-11-15  9:14   ` Or Gerlitz
2015-11-13 13:46 ` [PATCH 8/9] IB/iser: Use helper for container_of Christoph Hellwig
2015-11-13 13:46 ` [PATCH 9/9] IB/iser: Convert to CQ abstraction Christoph Hellwig
2015-11-15  9:21   ` Or Gerlitz

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=564885BE.1080707@dev.mellanox.co.il \
    --to=sagig@dev.mellanox.co.il \
    --cc=axboe@fb.com \
    --cc=bart.vanassche@sandisk.com \
    --cc=gerlitz.or@gmail.com \
    --cc=hch@lst.de \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-rdma@vger.kernel.org \
    --cc=linux-scsi@vger.kernel.org \
    --cc=oren@mellanox.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox