From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mx0a-001b2d01.pphosted.com ([148.163.156.1]:48902 "EHLO mx0a-001b2d01.pphosted.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752169AbdGDUzb (ORCPT ); Tue, 4 Jul 2017 16:55:31 -0400 Received: from pps.filterd (m0098410.ppops.net [127.0.0.1]) by mx0a-001b2d01.pphosted.com (8.16.0.20/8.16.0.20) with SMTP id v64KrkaP039340 for ; Tue, 4 Jul 2017 16:55:31 -0400 Received: from e14.ny.us.ibm.com (e14.ny.us.ibm.com [129.33.205.204]) by mx0a-001b2d01.pphosted.com with ESMTP id 2bg9h6kme5-1 (version=TLSv1.2 cipher=AES256-SHA bits=256 verify=NOT) for ; Tue, 04 Jul 2017 16:55:30 -0400 Received: from localhost by e14.ny.us.ibm.com with IBM ESMTP SMTP Gateway: Authorized Use Only! Violators will be prosecuted for from ; Tue, 4 Jul 2017 16:55:29 -0400 Subject: Re: [dm-devel] [PATCH 1/1] block: Convert hd_struct in_flight from atomic to percpu To: Jens Axboe , Ming Lei Cc: linux-block , "open list:DEVICE-MAPPER (LVM)" , Mike Snitzer , Alasdair Kergon References: <20170628211010.4C8C9124035@b01ledav002.gho.pok.ibm.com> <7f0a852e-5f90-4c63-9a43-a4180557530c@kernel.dk> <07ba10a8-6369-c1bc-dc9a-b550d9394c22@kernel.dk> <8f4ff428-e158-0df5-cf54-ae3cdea7ad1f@kernel.dk> <3729482c-fcca-2af5-4d05-7e44bcd71159@linux.vnet.ibm.com> <0759ff58-caa0-9e55-b5ac-6324d9ba521b@kernel.dk> <0aedc83b-17a0-14bd-bacd-e11e1b7c263c@kernel.dk> <5cfc618b-eb03-fe1b-6429-189c0b3d3fc1@kernel.dk> From: Brian King Date: Tue, 4 Jul 2017 15:55:24 -0500 MIME-Version: 1.0 In-Reply-To: <5cfc618b-eb03-fe1b-6429-189c0b3d3fc1@kernel.dk> Content-Type: text/plain; charset=utf-8 Message-Id: <1c4c3849-ab98-9d5b-a31d-8ff35416ac23@linux.vnet.ibm.com> Sender: linux-block-owner@vger.kernel.org List-Id: linux-block@vger.kernel.org On 07/01/2017 11:43 AM, Jens Axboe wrote: > Now: > > http://git.kernel.dk/cgit/linux-block/commit/?h=mq-inflight&id=87f73ef2b9edb6834001df8f7cb48c7a116e8cd3 > >> And updated the branch here: >> >> http://git.kernel.dk/cgit/linux-block/log/?h=mq-inflight >> >> to include that, and be based on top of for-4.13/block. If you prefer just >> pulling a branch, pull: >> >> git://git.kernel.dk/linux-block mq-inflight > > I've tested it, and made a few adjustments and fixes. The branches are > the same, just rebased. Works fine for me, even with partitions now. > > Let me know how it works for you. This is looking very nice. This is what I'm seeing now: 1 null_blk device / 80 submit_queues / fio numjobs=80 9.4M IOPs 80 null_blk devices / 1 submit_queue per null_blk / fio numjobs=1 (1 per null_blk) 9.3M IOPs 1 null_blk device / 160 submit_queues / fio numjobs=160 9.8M IOPs 160 null_blk devices / 1 submit_queue per null_blk / fio numjobs=1 (1 per null_blk) 8.9M IOPs What is queued in mq-inflight looks to resolve the issue I've been seeing. Thanks!!! Brian -- Brian King Power Linux I/O IBM Linux Technology Center