All of lore.kernel.org
 help / color / mirror / Atom feed
From: rwhron@earthlink.net
To: linux-kernel@vger.kernel.org
Cc: akpm@osdl.org
Subject: Re: [BENCHMARK] I/O regression after 2.6.0-test5
Date: Sun, 26 Oct 2003 05:38:29 -0500	[thread overview]
Message-ID: <20031026103829.GA6549@rushmore> (raw)

2.6.0-test8-mm1 doesn't have the AIM7 database regression
that 2.6.0-test8 has.  The AIM7 fileserver and shared 
workloads regression between test5-mm2 and test8-mm1 is
about 18%.  Mainline regression was about 38% between test5
and test8 on AIM7 fileserver and shared workloads.

AIM7 dbase workload
kernel                   Tasks   Jobs/Min        Real    CPU
2.6.0-test5-mm2          32	609.3		311.9	139.5
2.6.0-test8-mm1          32	608.2		312.6	133.5
2.6.0-test5              32	590.2		322.0	131.9
2.6.0-test8              32	299.8		634.0	128.6

2.6.0-test5-mm2          64	786.2		483.5	253.2
2.6.0-test8-mm1          64	784.3		484.7	256.6
2.6.0-test5              64	774.3		490.9	256.6
2.6.0-test8              64	450.5		843.9	246.5

2.6.0-test8-mm1          96	876.2		650.8	384.0
2.6.0-test5-mm2          96	869.2		656.0	382.2
2.6.0-test5              96	859.0		663.9	389.5
2.6.0-test8              96	549.7		1037.4	366.0

2.6.0-test5-mm2          128	929.4		818.0	526.1
2.6.0-test8-mm1          128	924.7		822.2	523.3
2.6.0-test5              128	910.3		835.2	528.6
2.6.0-test8              128	558.7		1360.8	497.6

2.6.0-test5-mm2          160	962.5		987.4	674.6
2.6.0-test8-mm1          160	959.8		990.2	664.5
2.6.0-test5              160	741.5		1281.7	644.8
2.6.0-test8              160	522.1		1820.2	612.2

2.6.0-test5-mm2          192	993.9		1147.5	810.0
2.6.0-test8-mm1          192	983.7		1159.3	806.0
2.6.0-test5              192	840.0		1357.8	776.0
2.6.0-test8              192	515.5		2212.4	742.7

2.6.0-test5-mm2          224	1011.2		1315.8	943.5
2.6.0-test8-mm1          224	1011.1		1315.9	918.0
2.6.0-test5              224	986.9		1348.2	911.8
2.6.0-test8              224	529.9		2510.8	859.5

2.6.0-test5-mm2          256	1030.9		1475.1	1076.5
2.6.0-test8-mm1          256	1023.2		1486.2	1078.5
2.6.0-test5              256	999.5		1521.3	1029.3
2.6.0-test8              256	552.4		2753.0	980.4


-mm regressed about 20% going from test5 to test8 in AIM7
fileserver workload.  Linus tree regressed about 38%.

AIM7 fserver workload
kernel                   Tasks   Jobs/Min        Real    CPU
2.6.0-test5              4	79.7		304.0	38.3
2.6.0-test5-mm2          4	77.4		313.4	38.3
2.6.0-test8-mm1          4	66.5		364.5	34.1
2.6.0-test8              4	42.3		573.6	40.9

2.6.0-test5              8	129.8		373.5	66.3
2.6.0-test5-mm2          8	103.1		470.4	62.0
2.6.0-test8-mm1          8	85.1		569.6	63.9
2.6.0-test8              8	63.3		765.7	71.6

2.6.0-test5              12	164.1		443.0	93.1
2.6.0-test5-mm2          12	112.4		646.8	98.4
2.6.0-test8-mm1          12	92.3		788.0	101.8
2.6.0-test8              12	83.2		874.2	95.0

2.6.0-test5              16	173.4		559.0	116.5
2.6.0-test5-mm2          16	128.8		752.9	119.9
2.6.0-test8-mm1          16	104.4		928.5	124.1
2.6.0-test8              16	87.5		1108.4	102.5

2.6.0-test5              20	180.5		671.5	143.0
2.6.0-test5-mm2          20	141.7		855.3	144.1
2.6.0-test8-mm1          20	116.6		1039.9	143.9
2.6.0-test8              20	105.0		1154.6	136.7

2.6.0-test5              24	189.1		769.0	176.0
2.6.0-test5-mm2          24	156.2		930.9	180.2
2.6.0-test8-mm1          24	127.1		1144.1	174.4
2.6.0-test8              24	111.2		1308.1	162.2

2.6.0-test5              28	204.6		829.2	197.5
2.6.0-test5-mm2          28	158.7		1069.2	209.8
2.6.0-test8-mm1          28	127.8		1327.5	203.8
2.6.0-test8              28	130.7		1297.9	185.8

2.6.0-test5              32	213.7		907.4	228.9
2.6.0-test5-mm2          32	151.9		1276.7	239.7
2.6.0-test8-mm1          32	123.2		1573.5	243.7
2.6.0-test8              32	134.2		1444.5	212.9

On the shared workload, Linus tree regressed about 38% between
test5 and test8.  The -mm tree only regressed about 16%.

AIM7 shared workload
kernel                   Tasks   Jobs/Min        Real    CPU
2.6.0-test5              64	1888.8		197.2	168.3
2.6.0-test5-mm2          64	1517.6		245.4	177.0
2.6.0-test8-mm1          64	1265.2		294.4	174.8
2.6.0-test8              64	829.1		449.3	167.8

2.6.0-test5              128	2094.9		355.6	338.1
2.6.0-test5-mm2          128	1837.4		405.4	352.4
2.6.0-test8-mm1          128	1558.3		478.1	348.9
2.6.0-test8              128	1105.2		674.1	330.5

2.6.0-test5              192	2256.0		495.3	507.8
2.6.0-test5-mm2          192	2074.9		538.5	530.9
2.6.0-test8-mm1          192	1755.2		636.6	526.9
2.6.0-test8              192	1320.0		846.6	504.7

2.6.0-test5              256	2389.0		623.7	683.8
2.6.0-test5-mm2          256	2207.2		675.0	720.6
2.6.0-test8-mm1          256	1855.2		803.1	708.4
2.6.0-test8              256	1462.1		1019.0	672.7

2.6.0-test5              320	2457.9		757.7	856.6
2.6.0-test5-mm2          320	2327.9		800.0	919.4
2.6.0-test8-mm1          320	1958.4		951.0	894.6
2.6.0-test8              320	1573.0		1184.0	845.2

2.6.0-test5              384	2480.4		901.0	1036.5
2.6.0-test5-mm2          384	2440.2		915.9	1111.6
2.6.0-test8-mm1          384	1997.9		1118.6	1087.2
2.6.0-test8              384	1601.1		1395.9	1028.7

2.6.0-test5              448	2529.8		1030.7	1209.2
2.6.0-test5-mm2          448	2510.0		1038.8	1306.1
2.6.0-test8-mm1          448	2030.0		1284.4	1279.6
2.6.0-test8              448	1659.7		1571.0	1205.2

2.6.0-test5              512	2566.2		1161.2	1386.2
2.6.0-test5-mm2          512	2579.1		1155.4	1504.0
2.6.0-test8-mm1          512	2046.4		1456.1	1481.3
2.6.0-test8              512	1614.4		1845.8	1381.5


The big increase in max latency on tiobench sequential reads at
256 threads affects both test8 and test8-mm1.

tiobench-0.3.3
File size = 8192 megabytes
Blk Size  = 4096 bytes

Sequential Reads ext2
                    Num                    Avg       Maximum     Lat%
Kernel              Thr   Rate  (CPU%)   Latency     Latency      >2s
------------------  ---  --------------------------------------------
2.6.0-test5           1   28.55 13.89%     0.408      754.59  0.00000
2.6.0-test5-mm2       1   28.66 13.98%     0.406      742.76  0.00000
2.6.0-test8           1   28.66 13.57%     0.406     1010.39  0.00000
2.6.0-test8-mm1       1   28.53 13.79%     0.408      977.75  0.00000

2.6.0-test5           8   34.01 17.09%     2.620      834.85  0.00000
2.6.0-test5-mm2       8   32.44 16.44%     2.765      844.99  0.00000
2.6.0-test8           8   20.83  9.82%     4.437     1626.42  0.00000
2.6.0-test8-mm1       8   21.31 10.27%     4.334     1669.82  0.00000

2.6.0-test5          16   30.13 15.04%     5.980     1337.69  0.00000
2.6.0-test5-mm2      16   29.71 14.97%     6.024     1115.95  0.00000
2.6.0-test8          16   15.88  7.53%    11.604     2888.67  0.00000
2.6.0-test8-mm1      16   16.40  7.93%    11.203     2954.75  0.00000

2.6.0-test5          32   29.46 14.62%    11.954     1560.02  0.00000
2.6.0-test5-mm2      32   28.01 14.26%    12.808     1627.00  0.00000
2.6.0-test8          32   16.17  7.55%    22.170     5119.98  0.00000
2.6.0-test8-mm1      32   15.78  7.74%    23.080     4826.59  0.00000

2.6.0-test5          64   25.24 13.57%    26.901     1743.05  0.00000
2.6.0-test5-mm2      64   24.01 13.27%    27.922     1849.82  0.00000
2.6.0-test8          64    8.71  4.78%    82.514    11744.03  3.04523
2.6.0-test8-mm1      64    9.06  5.13%    79.839     9458.66  2.92964

2.6.0-test5         128   10.41  9.76%   129.662     1820.78  0.00000
2.6.0-test5-mm2     128   11.00 10.44%   120.118     1742.44  0.00000
2.6.0-test8         128    3.04  2.64%   466.928    26583.72  8.12159
2.6.0-test8-mm1     128    3.00  2.78%   476.711    22323.98  8.28352

2.6.0-test5         256    9.13 13.30%   305.097     1446.43  0.00000
2.6.0-test5-mm2     256    9.09 13.60%   304.019     1648.80  0.00000
2.6.0-test8         256    2.66  2.41%   960.563   679406.45  9.02886
2.6.0-test8-mm1     256    2.80  2.61%   916.388   678138.20  8.60138


test8 and test8-mm1 have an increase in requests taking more than 2 
seconds on tiobench random reads at 256 threads.  -mm1 regressed less
than mainline between test5 and test8.

Random Reads ext2
                    Num                    Avg       Maximum     Lat%
Kernel              Thr   Rate  (CPU%)   Latency     Latency      >2s
------------------  ---  --------------------------------------------
2.6.0-test5           1    0.95  0.94%    12.373      114.89  0.00000
2.6.0-test5-mm2       1    0.90  0.88%    13.061      113.19  0.00000
2.6.0-test8           1    0.95  0.85%    12.360      113.96  0.00000
2.6.0-test8-mm1       1    0.89  0.88%    13.222      107.35  0.00000

2.6.0-test5           8    4.11  4.58%    19.433      137.74  0.00000
2.6.0-test5-mm2       8    3.94  4.03%    20.931      144.16  0.00000
2.6.0-test8           8    3.52  3.59%    25.298      477.80  0.00000
2.6.0-test8-mm1       8    4.51  4.80%    19.777      299.43  0.00000

2.6.0-test5          16    4.05  3.90%    42.424      236.49  0.00000
2.6.0-test5-mm2      16    4.09  4.31%    41.651      255.17  0.00000
2.6.0-test8          16    3.92  3.56%    45.278      843.31  0.00000
2.6.0-test8-mm1      16    4.11  3.46%    42.043      608.63  0.00000

2.6.0-test5          32    4.41  3.58%    70.910      516.28  0.00000
2.6.0-test5-mm2      32    4.23  4.17%    78.492      372.63  0.00000
2.6.0-test8          32    4.25  3.45%    77.345     1324.85  0.00000
2.6.0-test8-mm1      32    3.70  3.69%    91.986     1270.38  0.00000

2.6.0-test5          64    4.47  4.00%   137.277     1077.53  0.00000
2.6.0-test5-mm2      64    4.79  4.53%   124.035     1144.38  0.00000
2.6.0-test8          64    3.57  3.32%   181.257     3029.47  0.00000
2.6.0-test8-mm1      64    3.66  3.24%   175.724     2493.85  0.00000

2.6.0-test5         128    4.86  4.83%   243.704     2287.09  0.00000
2.6.0-test5-mm2     128    5.08  4.85%   228.102     2391.21  0.00000
2.6.0-test8         128    3.28  3.08%   379.081     5007.00  0.00000
2.6.0-test8-mm1     128    3.40  3.52%   372.210     4671.71  0.00000

2.6.0-test5         256    5.51  7.00%   427.503     2511.79  0.00000
2.6.0-test5-mm2     256    5.23  7.39%   449.007     3169.28  0.00000
2.6.0-test8         256    2.07  2.40%  1162.555    13971.08 16.95313
2.6.0-test8-mm1     256    2.36  2.99%  1019.360    10935.31 10.65104

-- 
Randy Hron
http://home.earthlink.net/~rwhron/kernel/bigbox.html


             reply	other threads:[~2003-10-26 10:35 UTC|newest]

Thread overview: 25+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2003-10-26 10:38 rwhron [this message]
2003-10-27 23:49 ` [BENCHMARK] I/O regression after 2.6.0-test5 Dave Olien
  -- strict thread matches above, loose matches on Subject: below --
2003-10-29  0:38 rwhron
2003-10-27 23:33 John Hawkes
2003-10-24 23:43 rwhron
2003-10-24 12:46 rwhron
2003-10-24  0:10 rwhron
2003-10-21 13:05 rwhron
2003-10-21 15:57 ` Nick Piggin
2003-10-21 21:07 ` venom
2003-10-22  9:54 ` Nick Piggin
2003-10-22 18:30   ` Dave Olien
2003-10-22 19:08     ` Dave Olien
2003-10-23  2:24     ` Nick Piggin
2003-10-23  3:48       ` Nick Piggin
2003-10-23 20:35       ` Dave Olien
2003-10-23 23:07         ` Nick Piggin
2003-10-20  0:37 rwhron
2003-10-20  1:35 ` Nick Piggin
2003-10-20  4:52   ` Andrew Morton
2003-10-20  8:12     ` Nick Piggin
2003-10-20  4:51 ` Dave Olien
2003-10-20  7:55   ` venom
2003-10-21  4:49     ` Nick Piggin
2003-10-24 13:52 ` Magnus Andersson

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20031026103829.GA6549@rushmore \
    --to=rwhron@earthlink.net \
    --cc=akpm@osdl.org \
    --cc=linux-kernel@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.