From: "Alan D. Brunelle" <Alan.Brunelle@hp.com>
To: Vivek Goyal <vgoyal@redhat.com>
Cc: Corrado Zoccolo <czoccolo@gmail.com>,
linux-kernel@vger.kernel.org, jens.axboe@oracle.com,
nauman@google.com, dpshah@google.com, lizf@cn.fujitsu.com,
ryov@valinux.co.jp, fernando@oss.ntt.co.jp,
s-uchida@ap.jp.nec.com, taka@valinux.co.jp,
guijianfeng@cn.fujitsu.com, jmoyer@redhat.com,
righi.andrea@gmail.com, m-ikeda@ds.jp.nec.com
Subject: Re: Block IO Controller V4
Date: Tue, 08 Dec 2009 10:17:48 -0500 [thread overview]
Message-ID: <1260285468.6686.12.camel@cail> (raw)
In-Reply-To: <20091130225640.GO11670@redhat.com>
Hi Vivek -
Sorry, I've been off doing other work and haven't had time to follow up
on this (until recently). I have runs based upon Jens' for-2.6.33 tree
as of commit 0d99519efef15fd0cf84a849492c7b1deee1e4b7 and your V4 patch
sequence (the refresh patch you sent me on 3 December 2009). I _think_
things look pretty darn good. There are three modes compared:
(1) base - just Jens' for-2.6.33 tree, not patched.
(2) i1,s8 - Your patches added and slice_idle set to 8 (default)
(3) i1,s0 - Your patched added and slice_idle set to 0
I did both synchronous and asynchronous runs, direct I/Os in both case,
random and sequential, with reads, writes and 80%/20% read/write cases.
The results are in throughput (as reported by fio). The first table
shows overall test results, the other tables show breakdowns per cgroup
(disk).
Regards,
Alan
---- ---- - --------- --------- --------- --------- --------- ---------
Mode RdWr N as,base as,i1,s8 as,i1,s0 sy,base sy,i1,s8 sy,i1,s0
---- ---- - --------- --------- --------- --------- --------- ---------
rnd rd 2 39.7 39.1 43.7 20.5 20.5 20.4
rnd rd 4 33.9 33.3 41.2 28.5 28.5 28.5
rnd rd 8 23.7 25.0 36.7 34.4 34.5 34.6
rnd wr 2 66.1 67.8 68.9 71.8 71.8 71.9
rnd wr 4 57.8 62.9 66.1 64.1 64.2 64.3
rnd wr 8 39.5 47.4 60.6 54.7 54.6 54.9
rnd rdwr 2 50.2 49.1 54.5 31.1 31.1 31.1
rnd rdwr 4 41.4 41.3 50.9 38.9 39.1 39.6
rnd rdwr 8 28.1 30.5 46.3 42.5 42.6 43.8
seq rd 2 612.3 605.7 611.2 509.6 528.3 608.6
seq rd 4 614.1 606.9 606.2 493.0 490.6 615.4
seq rd 8 613.6 603.8 605.9 453.0 461.8 617.6
seq wr 2 694.6 726.1 701.2 685.8 661.8 314.2
seq wr 4 687.6 715.3 628.3 702.9 702.3 317.8
seq wr 8 695.0 710.0 629.8 704.0 708.3 339.4
seq rdwr 2 692.3 664.9 693.8 508.4 504.0 642.8
seq rdwr 4 664.5 657.1 639.3 484.5 481.0 694.3
seq rdwr 8 659.0 648.0 634.4 458.1 460.4 709.6
===============================================================
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
Test Mode RdWr N test0 test1 test2 test3 test4 test5 test6 test7
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
as,base rnd rd 2 20.0 19.7
as,base rnd rd 4 8.8 8.5 8.3 8.3
as,base rnd rd 8 3.3 3.1 3.3 3.2 2.7 2.7 2.8 2.6
as,base rnd wr 2 33.2 32.9
as,base rnd wr 4 15.9 15.2 14.5 12.3
as,base rnd wr 8 5.8 3.4 7.8 8.7 3.5 3.4 3.8 3.1
as,base rnd rdwr 2 25.0 25.2
as,base rnd rdwr 4 10.6 10.4 10.2 10.2
as,base rnd rdwr 8 3.7 3.6 4.0 4.1 3.2 3.4 3.3 2.9
as,base seq rd 2 305.9 306.4
as,base seq rd 4 159.4 160.5 147.3 146.9
as,base seq rd 8 79.7 80.0 77.3 78.4 73.0 70.0 77.5 77.7
as,base seq wr 2 348.6 346.0
as,base seq wr 4 189.9 187.6 154.7 155.3
as,base seq wr 8 87.9 88.3 84.7 85.3 84.5 85.1 90.4 88.8
as,base seq rdwr 2 347.2 345.1
as,base seq rdwr 4 181.6 181.8 150.8 150.2
as,base seq rdwr 8 83.6 82.1 82.1 82.7 80.6 82.7 82.2 82.9
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
Test Mode RdWr N test0 test1 test2 test3 test4 test5 test6 test7
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
as,i1,s8 rnd rd 2 12.7 26.3
as,i1,s8 rnd rd 4 1.2 3.7 12.2 16.3
as,i1,s8 rnd rd 8 0.5 0.8 1.2 1.7 2.1 3.5 6.7 8.4
as,i1,s8 rnd wr 2 18.5 49.3
as,i1,s8 rnd wr 4 1.0 1.6 20.7 39.6
as,i1,s8 rnd wr 8 0.5 0.7 0.9 1.2 1.7 2.5 15.5 24.5
as,i1,s8 rnd rdwr 2 16.2 32.9
as,i1,s8 rnd rdwr 4 1.2 4.7 15.6 19.9
as,i1,s8 rnd rdwr 8 0.6 0.8 1.1 1.7 2.1 3.4 9.4 11.5
as,i1,s8 seq rd 2 202.7 403.0
as,i1,s8 seq rd 4 92.1 114.7 182.4 217.6
as,i1,s8 seq rd 8 38.7 76.2 74.0 73.9 74.5 74.7 84.7 107.0
as,i1,s8 seq wr 2 243.8 482.3
as,i1,s8 seq wr 4 107.7 155.5 200.4 251.7
as,i1,s8 seq wr 8 52.1 77.2 81.9 80.8 89.6 99.9 109.8 118.7
as,i1,s8 seq rdwr 2 225.8 439.1
as,i1,s8 seq rdwr 4 103.2 140.2 186.5 227.2
as,i1,s8 seq rdwr 8 50.3 77.4 77.5 78.9 80.5 83.9 94.3 105.2
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
Test Mode RdWr N test0 test1 test2 test3 test4 test5 test6 test7
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
as,i1,s0 rnd rd 2 21.9 21.8
as,i1,s0 rnd rd 4 11.4 12.0 9.1 8.7
as,i1,s0 rnd rd 8 3.2 3.2 6.7 6.7 4.7 4.0 4.7 3.5
as,i1,s0 rnd wr 2 34.5 34.4
as,i1,s0 rnd wr 4 21.6 20.5 12.6 11.4
as,i1,s0 rnd wr 8 5.1 4.8 18.2 16.9 4.1 4.0 4.0 3.3
as,i1,s0 rnd rdwr 2 27.5 27.0
as,i1,s0 rnd rdwr 4 16.1 15.4 10.2 9.2
as,i1,s0 rnd rdwr 8 5.3 4.6 9.9 9.7 4.6 4.0 4.4 3.8
as,i1,s0 seq rd 2 305.5 305.6
as,i1,s0 seq rd 4 159.5 157.3 144.1 145.3
as,i1,s0 seq rd 8 74.1 74.6 76.7 76.4 74.6 76.7 75.5 77.4
as,i1,s0 seq wr 2 350.3 350.9
as,i1,s0 seq wr 4 160.3 161.7 153.1 153.2
as,i1,s0 seq wr 8 79.5 80.9 78.2 78.7 79.7 78.3 77.8 76.7
as,i1,s0 seq rdwr 2 346.8 347.0
as,i1,s0 seq rdwr 4 163.3 163.5 156.7 155.8
as,i1,s0 seq rdwr 8 79.1 79.4 80.1 80.3 79.1 78.9 79.6 77.8
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
Test Mode RdWr N test0 test1 test2 test3 test4 test5 test6 test7
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
sy,base rnd rd 2 10.2 10.2
sy,base rnd rd 4 7.2 7.2 7.1 7.0
sy,base rnd rd 8 4.1 4.1 4.5 4.5 4.3 4.3 4.4 4.1
sy,base rnd wr 2 36.1 35.7
sy,base rnd wr 4 16.7 16.5 15.6 15.3
sy,base rnd wr 8 5.7 5.4 9.0 8.6 6.6 6.5 6.8 6.0
sy,base rnd rdwr 2 15.5 15.5
sy,base rnd rdwr 4 9.9 9.8 9.7 9.6
sy,base rnd rdwr 8 4.8 4.9 5.8 5.8 5.4 5.4 5.4 4.9
sy,base seq rd 2 254.7 254.8
sy,base seq rd 4 124.2 123.6 121.8 123.4
sy,base seq rd 8 56.9 56.5 56.1 56.8 56.6 56.7 56.5 56.9
sy,base seq wr 2 343.1 342.8
sy,base seq wr 4 177.4 177.9 173.1 174.7
sy,base seq wr 8 86.2 87.5 87.6 89.5 86.8 89.6 88.0 88.7
sy,base seq rdwr 2 254.0 254.4
sy,base seq rdwr 4 124.2 124.5 118.0 117.8
sy,base seq rdwr 8 57.2 56.8 57.0 58.8 56.8 56.3 57.5 57.8
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
Test Mode RdWr N test0 test1 test2 test3 test4 test5 test6 test7
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
sy,i1,s8 rnd rd 2 10.2 10.2
sy,i1,s8 rnd rd 4 7.2 7.2 7.1 7.1
sy,i1,s8 rnd rd 8 4.1 4.1 4.5 4.5 4.4 4.4 4.4 4.2
sy,i1,s8 rnd wr 2 36.2 35.5
sy,i1,s8 rnd wr 4 16.9 17.0 15.3 15.0
sy,i1,s8 rnd wr 8 5.7 5.6 8.5 8.7 6.7 6.5 6.6 6.3
sy,i1,s8 rnd rdwr 2 15.5 15.5
sy,i1,s8 rnd rdwr 4 9.8 9.8 9.7 9.6
sy,i1,s8 rnd rdwr 8 4.9 4.9 5.9 5.8 5.4 5.4 5.4 5.0
sy,i1,s8 seq rd 2 165.9 362.3
sy,i1,s8 seq rd 4 54.0 97.2 145.5 193.9
sy,i1,s8 seq rd 8 14.9 31.4 41.8 52.8 62.8 73.2 85.9 98.8
sy,i1,s8 seq wr 2 220.7 441.1
sy,i1,s8 seq wr 4 77.6 141.9 208.6 274.3
sy,i1,s8 seq wr 8 24.9 47.3 63.8 79.1 97.8 114.8 132.1 148.6
sy,i1,s8 seq rdwr 2 167.7 336.4
sy,i1,s8 seq rdwr 4 54.5 98.2 141.1 187.2
sy,i1,s8 seq rdwr 8 16.7 31.8 41.4 52.3 63.1 73.9 84.6 96.7
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
Test Mode RdWr N test0 test1 test2 test3 test4 test5 test6 test7
----------- ---- ---- - ----- ----- ----- ----- ----- ----- ----- -----
sy,i1,s0 rnd rd 2 10.2 10.2
sy,i1,s0 rnd rd 4 7.2 7.2 7.1 7.1
sy,i1,s0 rnd rd 8 4.1 4.1 4.6 4.6 4.4 4.4 4.4 4.2
sy,i1,s0 rnd wr 2 36.3 35.6
sy,i1,s0 rnd wr 4 16.9 17.0 15.3 15.2
sy,i1,s0 rnd wr 8 6.0 6.0 8.9 8.8 6.5 6.2 6.5 5.9
sy,i1,s0 rnd rdwr 2 15.6 15.6
sy,i1,s0 rnd rdwr 4 10.0 10.0 9.8 9.8
sy,i1,s0 rnd rdwr 8 5.0 5.0 6.0 6.0 5.5 5.5 5.6 5.1
sy,i1,s0 seq rd 2 304.2 304.3
sy,i1,s0 seq rd 4 154.2 154.2 153.4 153.7
sy,i1,s0 seq rd 8 76.9 76.8 77.3 76.9 77.1 77.2 77.4 78.0
sy,i1,s0 seq wr 2 156.8 157.4
sy,i1,s0 seq wr 4 80.7 79.6 78.5 79.0
sy,i1,s0 seq wr 8 43.2 41.7 41.7 42.6 42.1 42.6 42.8 42.7
sy,i1,s0 seq rdwr 2 321.1 321.7
sy,i1,s0 seq rdwr 4 174.2 174.0 172.6 173.6
sy,i1,s0 seq rdwr 8 86.6 86.3 88.6 88.9 90.2 89.8 90.1 89.0
next prev parent reply other threads:[~2009-12-08 15:17 UTC|newest]
Thread overview: 54+ messages / expand[flat|nested] mbox.gz Atom feed top
2009-11-30 2:59 Block IO Controller V4 Vivek Goyal
2009-11-30 2:59 ` [PATCH 01/21] blkio: Set must_dispatch only if we decided to not dispatch the request Vivek Goyal
2009-12-02 14:06 ` Jeff Moyer
2009-11-30 2:59 ` [PATCH 02/21] blkio: Introduce the notion of cfq groups Vivek Goyal
2009-11-30 2:59 ` [PATCH 03/21] blkio: Implement macro to traverse each idle tree in group Vivek Goyal
2009-11-30 20:13 ` Divyesh Shah
2009-11-30 22:24 ` Vivek Goyal
2009-11-30 2:59 ` [PATCH 04/21] blkio: Keep queue on service tree until we expire it Vivek Goyal
2009-11-30 2:59 ` [PATCH 05/21] blkio: Introduce the root service tree for cfq groups Vivek Goyal
2009-11-30 23:55 ` Divyesh Shah
2009-12-02 15:42 ` Vivek Goyal
2009-12-02 15:49 ` Vivek Goyal
2009-11-30 2:59 ` [PATCH 06/21] blkio: Introduce blkio controller cgroup interface Vivek Goyal
2009-12-01 0:04 ` Divyesh Shah
2009-12-02 15:27 ` Vivek Goyal
2009-11-30 2:59 ` [PATCH 07/21] blkio: Introduce per cfq group weights and vdisktime calculations Vivek Goyal
2009-12-02 15:50 ` Vivek Goyal
2009-11-30 2:59 ` [PATCH 08/21] blkio: Implement per cfq group latency target and busy queue avg Vivek Goyal
2009-11-30 2:59 ` [PATCH 09/21] blkio: Group time used accounting and workload context save restore Vivek Goyal
2009-11-30 2:59 ` [PATCH 10/21] blkio: Dynamic cfq group creation based on cgroup tasks belongs to Vivek Goyal
2009-11-30 2:59 ` [PATCH 11/21] blkio: Take care of cgroup deletion and cfq group reference counting Vivek Goyal
2009-11-30 2:59 ` [PATCH 12/21] blkio: Some debugging aids for CFQ Vivek Goyal
2009-11-30 2:59 ` [PATCH 13/21] blkio: Export disk time and sectors used by a group to user space Vivek Goyal
2009-11-30 2:59 ` [PATCH 14/21] blkio: Provide some isolation between groups Vivek Goyal
2009-11-30 2:59 ` [PATCH 15/21] blkio: Drop the reference to queue once the task changes cgroup Vivek Goyal
2009-11-30 2:59 ` [PATCH 16/21] blkio: Propagate cgroup weight updation to cfq groups Vivek Goyal
2009-11-30 2:59 ` [PATCH 17/21] blkio: Wait for cfq queue to get backlogged if group is empty Vivek Goyal
2009-11-30 2:59 ` [PATCH 18/21] blkio: Determine async workload length based on total number of queues Vivek Goyal
2009-11-30 2:59 ` [PATCH 19/21] blkio: Implement group_isolation tunable Vivek Goyal
2009-11-30 2:59 ` [PATCH 20/21] blkio: Wait on sync-noidle queue even if rq_noidle = 1 Vivek Goyal
2009-11-30 2:59 ` [PATCH 21/21] blkio: Documentation Vivek Goyal
2009-11-30 15:34 ` Block IO Controller V4 Corrado Zoccolo
2009-11-30 16:00 ` Vivek Goyal
2009-11-30 21:34 ` Corrado Zoccolo
2009-11-30 21:58 ` Vivek Goyal
2009-11-30 22:00 ` Alan D. Brunelle
2009-11-30 22:56 ` Vivek Goyal
2009-11-30 23:50 ` Alan D. Brunelle
2009-12-02 19:12 ` Vivek Goyal
2009-12-08 15:17 ` Alan D. Brunelle [this message]
2009-12-08 16:32 ` Vivek Goyal
2009-12-08 18:05 ` Alan D. Brunelle
2009-12-10 3:44 ` Vivek Goyal
2009-12-01 22:27 ` Vivek Goyal
2009-12-02 1:51 ` Gui Jianfeng
2009-12-02 14:25 ` Vivek Goyal
2009-12-03 8:41 ` Gui Jianfeng
2009-12-03 14:36 ` Vivek Goyal
2009-12-03 18:10 ` Vivek Goyal
2009-12-03 23:51 ` Vivek Goyal
2009-12-07 8:45 ` Gui Jianfeng
2009-12-07 15:25 ` Vivek Goyal
2009-12-07 1:35 ` Gui Jianfeng
2009-12-07 8:41 ` Gui Jianfeng
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1260285468.6686.12.camel@cail \
--to=alan.brunelle@hp.com \
--cc=czoccolo@gmail.com \
--cc=dpshah@google.com \
--cc=fernando@oss.ntt.co.jp \
--cc=guijianfeng@cn.fujitsu.com \
--cc=jens.axboe@oracle.com \
--cc=jmoyer@redhat.com \
--cc=linux-kernel@vger.kernel.org \
--cc=lizf@cn.fujitsu.com \
--cc=m-ikeda@ds.jp.nec.com \
--cc=nauman@google.com \
--cc=righi.andrea@gmail.com \
--cc=ryov@valinux.co.jp \
--cc=s-uchida@ap.jp.nec.com \
--cc=taka@valinux.co.jp \
--cc=vgoyal@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox