From: Wen Xiong <wenxiong@linux.ibm.com>
To: yukuai@fygo.io
Cc: Jens Axboe <axboe@kernel.dk>,
linux-block@vger.kernel.org, tom.leiming@gmail.com,
jmoyer@redhat.com, Gjoyce <gjoyce@linux.ibm.com>,
wenxiong@us.ibm.com
Subject: Re: Observing higher CPU utilization during random IO fio testing
Date: Tue, 26 May 2026 10:28:13 -0500 [thread overview]
Message-ID: <4ce7323fc4b02cdabc96c8443d373091@linux.ibm.com> (raw)
In-Reply-To: <043e357f-5b37-4e05-9433-271504fc1d30@fygo.io>
On 2026-05-25 00:28, Yu Kuai wrote:
> Hi,
>
> 在 2026/5/22 5:52, Jens Axboe 写道:
>>> - More IO scheduler interaction, forces requests through scheduler
>>> instead of direct dispatch(direct dispatch to hardware queue)
> I don't understand this point. Can you explain more? I think plug
> should not matter if request go through scheduler or not.
My understanding is:
Random IO tests are more CPU intensive.
Plug delays the dispatch IOs to hardware queue(quick way) directly.
Plug submits multiple IO requests in a batch to defer submitting IO
until calling blk_flush_plug(dispatch to hardware queue) or task gets
scheduling.
>
> And I assume you're testing raw disk, because filesystems should
> always enable plug.
>
Yes. FIO random IO tests over raw disks.
> Yes, perf data will be helpful. And please show your test in details
> and I'll
> check if I can reproduce it.
System config:
47 dedicate cores
120 GB memory
PCIe4 2-Port 64Gb FC Adapter
64Gb FC switch
FlashSystem: FS9500, 12 LUNs/FC port
Below is fio config for rwmixread=100:
[global]
randrepeat=0
buffered=0
direct=1
norandommap=1
group_reporting=1
size=80g
ioengine=libaio
rw=randrw
bs=4k
iodepth=1
rwmixread=100
runtime=600
ramp_time=5
time_based=1
numjobs=20
[job1]
filename=/dev/dm-2
[job2]
filename=/dev/dm-3
...
24 jobs in total.
We collected some perf data. What kind of perf data you want? Let me
know.
Thanks,
Wendy
next prev parent reply other threads:[~2026-05-26 15:28 UTC|newest]
Thread overview: 8+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-05-21 19:44 Observing higher CPU utilization during random IO fio testing Wen Xiong
2026-05-21 21:52 ` Jens Axboe
2026-05-25 5:28 ` Yu Kuai
2026-05-26 15:28 ` Wen Xiong [this message]
2026-05-29 17:13 ` Wen Xiong
2026-05-31 11:45 ` Yu Kuai
2026-05-30 1:10 ` Ming Lei
2026-05-31 11:56 ` Yu Kuai
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=4ce7323fc4b02cdabc96c8443d373091@linux.ibm.com \
--to=wenxiong@linux.ibm.com \
--cc=axboe@kernel.dk \
--cc=gjoyce@linux.ibm.com \
--cc=jmoyer@redhat.com \
--cc=linux-block@vger.kernel.org \
--cc=tom.leiming@gmail.com \
--cc=wenxiong@us.ibm.com \
--cc=yukuai@fygo.io \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.