From: Chaitanya Kulkarni <chaitanyak@nvidia.com>
To: Jens Axboe <axboe@kernel.dk>,
Gulam Mohamed <gulam.mohamed@oracle.com>,
"linux-block@vger.kernel.org" <linux-block@vger.kernel.org>
Cc: "philipp.reisner@linbit.com" <philipp.reisner@linbit.com>,
"lars.ellenberg@linbit.com" <lars.ellenberg@linbit.com>,
"christoph.boehmwalder@linbit.com"
<christoph.boehmwalder@linbit.com>,
"minchan@kernel.org" <minchan@kernel.org>,
"ngupta@vflare.org" <ngupta@vflare.org>,
"senozhatsky@chromium.org" <senozhatsky@chromium.org>,
"colyli@suse.de" <colyli@suse.de>,
"kent.overstreet@gmail.com" <kent.overstreet@gmail.com>,
"agk@redhat.com" <agk@redhat.com>,
"snitzer@kernel.org" <snitzer@kernel.org>,
"dm-devel@redhat.com" <dm-devel@redhat.com>,
"song@kernel.org" <song@kernel.org>,
"dan.j.williams@intel.com" <dan.j.williams@intel.com>,
"vishal.l.verma@intel.com" <vishal.l.verma@intel.com>,
"dave.jiang@intel.com" <dave.jiang@intel.com>,
"ira.weiny@intel.com" <ira.weiny@intel.com>,
"junxiao.bi@oracle.com" <junxiao.bi@oracle.com>,
"martin.petersen@oracle.com" <martin.petersen@oracle.com>,
Chaitanya Kulkarni <chaitanyak@nvidia.com>,
"drbd-dev@lists.linbit.com" <drbd-dev@lists.linbit.com>,
"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
"linux-bcache@vger.kernel.org" <linux-bcache@vger.kernel.org>,
"linux-raid@vger.kernel.org" <linux-raid@vger.kernel.org>,
"nvdimm@lists.linux.dev" <nvdimm@lists.linux.dev>,
"konrad.wilk@oracle.com" <konrad.wilk@oracle.com>,
"joe.jin@oracle.com" <joe.jin@oracle.com>
Subject: Re: [RFC for-6.2/block V2] block: Change the granularity of io ticks from ms to ns
Date: Wed, 7 Dec 2022 23:17:12 +0000 [thread overview]
Message-ID: <09be5cbe-9251-d28c-e91a-3f2e5e9e99f2@nvidia.com> (raw)
In-Reply-To: <abaa2003-4ddf-5ef9-d62c-1708a214609d@kernel.dk>
On 12/7/22 15:08, Jens Axboe wrote:
> On 12/7/22 3:32?PM, Gulam Mohamed wrote:
>> As per the review comment from Jens Axboe, I am re-sending this patch
>> against "for-6.2/block".
>>
>>
>> Use ktime to change the granularity of IO accounting in block layer from
>> milli-seconds to nano-seconds to get the proper latency values for the
>> devices whose latency is in micro-seconds. After changing the granularity
>> to nano-seconds the iostat command, which was showing incorrect values for
>> %util, is now showing correct values.
>>
>> We did not work on the patch to drop the logic for
>> STAT_PRECISE_TIMESTAMPS yet. Will do it if this patch is ok.
>>
>> The iostat command was run after starting the fio with following command
>> on an NVME disk. For the same fio command, the iostat %util was showing
>> ~100% for the disks whose latencies are in the range of microseconds.
>> With the kernel changes (granularity to nano-seconds), the %util was
>> showing correct values. Following are the details of the test and their
>> output:
>
> My default peak testing runs at 122M IOPS. That's also the peak IOPS of
> the devices combined, and with iostats disabled. If I enabled iostats,
> then the performance drops to 112M IOPS. It's no longer device limited,
> that's a drop of about 8.2%.
>
Wow, clearly not acceptable that's exactly I asked for perf
numbers :).
-ck
next prev parent reply other threads:[~2022-12-07 23:17 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-12-07 22:32 [RFC for-6.2/block V2] block: Change the granularity of io ticks from ms to ns Gulam Mohamed
2022-12-07 23:02 ` Chaitanya Kulkarni
2022-12-07 23:08 ` Jens Axboe
2022-12-07 23:17 ` Chaitanya Kulkarni [this message]
2022-12-08 0:35 ` Keith Busch
2022-12-08 2:55 ` Jens Axboe
2022-12-08 0:36 ` Ming Lei
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=09be5cbe-9251-d28c-e91a-3f2e5e9e99f2@nvidia.com \
--to=chaitanyak@nvidia.com \
--cc=agk@redhat.com \
--cc=axboe@kernel.dk \
--cc=christoph.boehmwalder@linbit.com \
--cc=colyli@suse.de \
--cc=dan.j.williams@intel.com \
--cc=dave.jiang@intel.com \
--cc=dm-devel@redhat.com \
--cc=drbd-dev@lists.linbit.com \
--cc=gulam.mohamed@oracle.com \
--cc=ira.weiny@intel.com \
--cc=joe.jin@oracle.com \
--cc=junxiao.bi@oracle.com \
--cc=kent.overstreet@gmail.com \
--cc=konrad.wilk@oracle.com \
--cc=lars.ellenberg@linbit.com \
--cc=linux-bcache@vger.kernel.org \
--cc=linux-block@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-raid@vger.kernel.org \
--cc=martin.petersen@oracle.com \
--cc=minchan@kernel.org \
--cc=ngupta@vflare.org \
--cc=nvdimm@lists.linux.dev \
--cc=philipp.reisner@linbit.com \
--cc=senozhatsky@chromium.org \
--cc=snitzer@kernel.org \
--cc=song@kernel.org \
--cc=vishal.l.verma@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox