From: Ming Lei <ming.lei@redhat.com>
To: Ben Hutchings <ben@decadent.org.uk>
Cc: Ricardo Ribalda Delgado <ricardo.ribalda@gmail.com>,
Ming Lei <tom.leiming@gmail.com>,
linux-block@vger.kernel.org
Subject: Re: blk-mq 5-8 times slower for bmap-tools
Date: Thu, 23 Aug 2018 06:02:25 +0800 [thread overview]
Message-ID: <20180822220220.GA8846@ming.t460p> (raw)
In-Reply-To: <526e40ca8f426252377be21f935ddcdec93cb197.camel@decadent.org.uk>
On Wed, Aug 22, 2018 at 08:22:00PM +0100, Ben Hutchings wrote:
> On Mon, 2018-08-20 at 11:04 +0200, Ricardo Ribalda Delgado wrote:
> > Hello Ming
> > On Mon, Aug 20, 2018 at 10:30 AM Ming Lei <ming.lei@redhat.com> wrote:
> [...]
> > > One problem found from your iostat log is that looks there is ~30sec
> > > idle period between IO activities when blk-mq is enabled.
> >
> > During all the test the LED on the device was blinking.
> >
> > But a closer look to dmesg reveals a lot of this messages:
> >
> > [ 196.929811] sd 6:0:0:0: [sdb] tag#3 data cmplt err -71 uas-tag 1
> > inflight: CMD
> > [ 196.929822] sd 6:0:0:0: [sdb] tag#3 CDB: Write(10) 2a 00 00 04 00
> > 68 00 04 00 00
> > [ 227.764379] sd 6:0:0:0: [sdb] tag#4 uas_eh_abort_handler 0 uas-tag
> > 2 inflight: CMD OUT
> > [ 227.764389] sd 6:0:0:0: [sdb] tag#4 CDB: Write(10) 2a 00 00 04 04
> > 68 00 04 00 00
> > [ 227.766555] sd 6:0:0:0: [sdb] tag#3 uas_eh_abort_handler 0 uas-tag
> > 1 inflight: CMD
> > [ 227.766562] sd 6:0:0:0: [sdb] tag#3 CDB: Write(10) 2a 00 00 04 00
> > 68 00 04 00 00
> > [ 227.784312] scsi host6: uas_eh_device_reset_handler start
> > [ 227.913672] usb 2-2: reset SuperSpeed USB device number 3 using xhci_hcd
> > [ 227.944842] scsi host6: uas_eh_device_reset_handler success
> > [ 231.416133] sd 6:0:0:0: [sdb] tag#1 data cmplt err -71 uas-tag 10
> > inflight: CMD
> > [ 231.416147] sd 6:0:0:0: [sdb] tag#1 CDB: Write(10) 2a 00 00 06 d5
> > e8 00 04 00 00
> >
> > And they take around 30 secons (227-196)
> >
> >
> > Maybe this is a hw issue? I will bring the reader home tonight and see
> > if I can replicate the bug with my notebook
> >
> > >
> > > Maybe it is related with timeout, given we had big change in v4.17 timeout code,
> > > and we also fixed one scsi_mq timeout related issue recently, and the patch[1] has
> > > been merged to v4.18 release already.
> >
> > I tried with v4.18-rc4 (latest one packaged in debian experimental)
> > and after 3 runs, 2 were fine (27 sec), but the last one was over a
> > minute.
>
> Is it possible that this is fixed by "block: really disable runtime-pm
> for blk-mq"?
>
As I mentioned, the similar issue can be triggered in both blk-mq and
non-blk-mq, so it shouldn't be related with runtime PM.
We need our UAS guys to take a look at this issue.
Thanks,
Ming
next prev parent reply other threads:[~2018-08-23 1:29 UTC|newest]
Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-08-17 17:31 blk-mq 5-8 times slower for bmap-tools Ricardo Ribalda Delgado
2018-08-17 17:35 ` Paolo Valente
2018-08-17 17:39 ` Ricardo Ribalda Delgado
2018-08-17 17:41 ` Jens Axboe
2018-08-17 17:49 ` Ricardo Ribalda Delgado
2018-08-17 21:23 ` Jens Axboe
2018-08-17 17:42 ` Paolo Valente
2018-08-17 17:52 ` Ricardo Ribalda Delgado
2018-08-17 23:43 ` Ming Lei
[not found] ` <CAPybu_2ke4usj9Qwr9iSKTymAk1510pzZnZAgLemRB+cK4Se1A@mail.gmail.com>
2018-08-20 8:30 ` Ming Lei
2018-08-20 9:04 ` Ricardo Ribalda Delgado
2018-08-20 9:55 ` Ming Lei
2018-08-20 9:56 ` Ricardo Ribalda Delgado
2018-08-20 10:15 ` Ming Lei
2018-08-20 11:42 ` Ming Lei
2018-08-20 11:45 ` Ming Lei
2018-08-22 19:22 ` Ben Hutchings
2018-08-22 22:02 ` Ming Lei [this message]
2018-08-23 0:51 ` Ben Hutchings
2018-08-23 2:17 ` Ming Lei
2018-08-23 6:29 ` Ricardo Ribalda Delgado
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20180822220220.GA8846@ming.t460p \
--to=ming.lei@redhat.com \
--cc=ben@decadent.org.uk \
--cc=linux-block@vger.kernel.org \
--cc=ricardo.ribalda@gmail.com \
--cc=tom.leiming@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox