From: Ming Lei <ming.lei@redhat.com>
To: Guenter Roeck <linux@roeck-us.net>
Cc: linux-scsi@vger.kernel.org, Jens Axboe <axboe@fb.com>,
linux-block@vger.kernel.org, Omar Sandoval <osandov@fb.com>,
"Martin K. Petersen" <martin.petersen@oracle.com>,
James Bottomley <james.bottomley@hansenpartnership.com>,
Christoph Hellwig <hch@lst.de>,
Don Brace <don.brace@microsemi.com>,
Kashyap Desai <kashyap.desai@broadcom.com>,
Mike Snitzer <snitzer@redhat.com>, Hannes Reinecke <hare@suse.de>,
Laurence Oberman <loberman@redhat.com>,
Bart Van Assche <bart.vanassche@wdc.com>
Subject: Re: [V2, 2/2] scsi: avoid to hold host-wide counter of host_busy for scsi_mq
Date: Sat, 30 Jun 2018 09:30:30 +0800 [thread overview]
Message-ID: <20180630013028.GB12152@ming.t460p> (raw)
In-Reply-To: <20180629162054.GA19036@roeck-us.net>
On Fri, Jun 29, 2018 at 09:20:54AM -0700, Guenter Roeck wrote:
> Hi,
>
> On Sun, Jun 24, 2018 at 10:03:27PM +0800, Ming Lei wrote:
> > It isn't necessary to check the host depth in scsi_queue_rq() any more
> > since it has been respected by blk-mq before calling scsi_queue_rq() via
> > getting driver tag.
> >
> > Lots of LUNs may attach to same host, and per-host IOPS may reach millions
> > level, so we should avoid to this expensive atomic operations on the
> > hostwide counter in IO path.
> >
> > This patch implemens scsi_host_busy() via blk_mq_tagset_busy_iter() for
> > reading the count of busy IOs for scsi_mq.
> >
> > It is observed that IOPS is increased by 15% in IO test on scsi_debug
> > (32 LUNs, 32 submit queues, 1024 can_queue, libaio/dio) in one
> > dual-socket system.
> >
>
> This patch breaks two of my qemu test builds in -next: parisc:defconfig
> and arm:versatilepb-scsi:versatile_defconfig (which is versatilepb booting
> from scsi disk). The symptom is the same for both: Boot stalls after scsi
> bus initialization.
>
> arm:
>
> sym53c8xx 0000:00:0c.0: enabling device (0100 -> 0103)
> sym0: <895a> rev 0x0 at pci 0000:00:0c.0 irq 66
> sym0: No NVRAM, ID 7, Fast-40, LVD, parity checking
> sym0: SCSI BUS has been reset.
> scsi host0: sym-2.2.3
> random: fast init done
> [stalls]
>
> parisc:
>
> sym53c8xx 0000:00:00.0: enabling SERR and PARITY (0107 -> 0147)
> sym0: <895a> rev 0x0 at pci 0000:00:00.0 irq 17
> sym0: PA-RISC Firmware, ID 7, Fast-40, LVD, parity checking
> sym0: SCSI BUS has been reset.
> scsi host0: sym-2.2.3
> random: fast init done
> [stalls]
>
> Reverting the patch fixes the problem. Bisect log is attached.
Please test the patch of 'scsi: fix scsi_host_queue_ready', which has
been posted on linux-scsi list and CCed to you.
Thanks,
Ming
next prev parent reply other threads:[~2018-06-30 1:30 UTC|newest]
Thread overview: 10+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-06-24 14:03 [PATCH V2 0/2] scsi: scsi-mq: don't hold host_busy in IO path Ming Lei
2018-06-24 14:03 ` [PATCH V2 1/2] scsi: read host_busy via scsi_host_busy() Ming Lei
2018-06-25 15:37 ` Bart Van Assche
2018-06-24 14:03 ` [PATCH V2 2/2] scsi: avoid to hold host-wide counter of host_busy for scsi_mq Ming Lei
2018-06-25 15:38 ` Bart Van Assche
2018-06-29 16:20 ` [V2, " Guenter Roeck
2018-06-30 1:12 ` Ming Lei
2018-06-30 1:30 ` Ming Lei [this message]
2018-06-30 1:41 ` Guenter Roeck
2018-06-26 16:53 ` [PATCH V2 0/2] scsi: scsi-mq: don't hold host_busy in IO path Martin K. Petersen
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20180630013028.GB12152@ming.t460p \
--to=ming.lei@redhat.com \
--cc=axboe@fb.com \
--cc=bart.vanassche@wdc.com \
--cc=don.brace@microsemi.com \
--cc=hare@suse.de \
--cc=hch@lst.de \
--cc=james.bottomley@hansenpartnership.com \
--cc=kashyap.desai@broadcom.com \
--cc=linux-block@vger.kernel.org \
--cc=linux-scsi@vger.kernel.org \
--cc=linux@roeck-us.net \
--cc=loberman@redhat.com \
--cc=martin.petersen@oracle.com \
--cc=osandov@fb.com \
--cc=snitzer@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox