public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Hanna Linder <hannal@us.ibm.com>
To: "Martin J. Bligh" <Martin.Bligh@us.ibm.com>, akpm@zip.com.au
Cc: Keith Mannthey <mannthey@us.ibm.com>,
	hannal@us.ibm.com, haveblue@us.ibm.com,
	lse-tech@lists.sourceforge.net, linux-kernel@vger.kernel.org
Subject: Re: scalable kmap (was Re: vm lock contention reduction) (fwd)
Date: Wed, 10 Jul 2002 15:18:08 -0700	[thread overview]
Message-ID: <40740000.1026339488@w-hlinder> (raw)
In-Reply-To: <237170000.1026317715@flay>

[-- Attachment #1: Type: text/plain, Size: 1486 bytes --]

--On Wednesday, July 10, 2002 09:15:15 -0700 "Martin J. Bligh" <Martin.Bligh@us.ibm.com> wrote:

> 
> Updated patch below ...
> 
> 
>  arch/i386/kernel/i386_ksyms.c   |    5 ++
>  arch/i386/lib/usercopy.c        |   10 +++++
>  arch/i386/mm/fault.c            |   71 +++++++++++++++++++++++++++++++++++
>  fs/exec.c                       |   60 +++++++++++++++++++++---------
>  include/asm-i386/highmem.h      |    5 ++
>  include/asm-i386/kmap_types.h   |    3 +
>  include/asm-i386/processor.h    |    2 +
>  include/asm-ppc/kmap_types.h    |    1 
>  include/asm-sparc/kmap_types.h  |    1 
>  include/asm-x86_64/kmap_types.h |    1 
>  include/linux/highmem.h         |   80 ++++++++++++++++++++++++++++++++++++++++
>  include/linux/sched.h           |    5 ++
>  mm/filemap.c                    |   11 +++--
>  13 files changed, 232 insertions(+), 23 deletions(-)


Andrew and Martin,

	I ran this updated patch on 2.5.25 with dbench on
the 8-way with 4 Gb of memory compared to clean 2.5.25. 
I saw a significant improvement in throughput about 15%
(averaged over 5 runs each). 
	Included is the pretty picture (akpm-2525.png) the 
data that picture came from (akpm-2525.data) and the raw 
results of the runs with min/max and timing results 
(2525akpmkmaphi and 2525clnhi).
	I believe the drop at around 64 clients is caused by
memory swapping leading to increased disk accesses since the 
time increased by 200% in direct correlation with the decreased 
throughput.

Hanna





[-- Attachment #2: akpm-2525.png --]
[-- Type: image/png, Size: 3587 bytes --]

[-- Attachment #3: 2525akpmkmaphi --]
[-- Type: application/octet-stream, Size: 4599 bytes --]

[root@elm3b96 dbench]# ./test_dbench-avg.sh 1 36 5 hikmap
Running 1 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 3 lo is 2
thru hi is 81.5701 lo is 76.9333
        avg run time 3
        avg throughput 79.6601666666667
Running 5 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 4 lo is 3
thru hi is 277.74 lo is 243.343
        avg run time 3.33333333333333
        avg throughput 264.646333333333
Running 9 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 6 lo is 5
thru hi is 295.914 lo is 288.236
        avg run time 5
        avg throughput 283.635333333333
Running 13 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 8 lo is 7
thru hi is 291.79 lo is 246.807
        avg run time 7
        avg throughput 284.074666666667
Running 17 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 9 lo is 9
thru hi is 288.754 lo is 279.672
        avg run time 9
        avg throughput 282.871666666667
Running 21 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 11 lo is 10
thru hi is 282.556 lo is 279.696
        avg run time 11
        avg throughput 280.028666666667
Running 25 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 13 lo is 13
thru hi is 283.141 lo is 270.631
        avg run time 13
        avg throughput 279.706666666667
Running 21 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 11 lo is 10
thru hi is 282.556 lo is 279.696
        avg run time 11
        avg throughput 280.028666666667
Running 25 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 13 lo is 13
thru hi is 283.141 lo is 270.631
        avg run time 13
        avg throughput 279.706666666667
Running 29 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 16 lo is 14
thru hi is 287.336 lo is 282.406
        avg run time 14.6666666666667
        avg throughput 274.366
Running 33 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 17 lo is 16
thru hi is 280.63 lo is 274.984
        avg run time 16.6666666666667
        avg throughput 277.988

[root@elm3b96 dbench]# ./test_dbench-avg.sh 36 64 5 akpmhi2     
Running 36 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 19 lo is 18
thru hi is 284.684 lo is 272.75
        avg run time 18
        avg throughput 274.103
Running 40 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 22 lo is 20
thru hi is 279.052 lo is 274.726
        avg run time 20
        avg throughput 270.671666666667
Running 44 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 23 lo is 22
thru hi is 275.928 lo is 261.419
        avg run time 22.6666666666667
        avg throughput 270.660333333333
Running 48 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 25 lo is 24
thru hi is 276.622 lo is 271.115
        avg run time 24
        avg throughput 274.449333333333
Running 52 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 28 lo is 25
thru hi is 279.96 lo is 256.425
        avg run time 26
        avg throughput 273.272333333333
Running 56 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 30 lo is 28
thru hi is 270.907 lo is 268.947
        avg run time 28.3333333333333
        avg throughput 267.339666666667
Running 60 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 31 lo is 30
thru hi is 273.963 lo is 266.724
        avg run time 30
        avg throughput 272.487333333333
Running 64 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 883 lo is 33
thru hi is 262.225 lo is 9.57893
        avg run time 147.333333333333
        avg throughput 117.4783


[-- Attachment #4: 2525clnhi --]
[-- Type: application/octet-stream, Size: 4189 bytes --]


[root@elm3b96 dbench]# ./test_dbench-avg.sh 1 36 5 2525hi
Running 1 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 3 lo is 2
thru hi is 82.3442 lo is 77.5547
        avg run time 2.66666666666667
        avg throughput 81.7611333333333
Running 5 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 4 lo is 3
thru hi is 260.515 lo is 229.134
        avg run time 3.66666666666667
        avg throughput 242.980333333333
Running 9 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 6 lo is 5
thru hi is 256.654 lo is 253.473
        avg run time 6
        avg throughput 250.254666666667
Running 13 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 9 lo is 7
thru hi is 258.22 lo is 207.652
        avg run time 8.33333333333333
        avg throughput 246.309666666667
Running 17 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 11 lo is 10
thru hi is 252.47 lo is 228.667
        avg run time 10
        avg throughput 250.657666666667
Running 21 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 13 lo is 12
thru hi is 250.391 lo is 242.239
        avg run time 12
        avg throughput 244.346333333333
Running 25 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 15 lo is 15
thru hi is 249.358 lo is 226.142
        avg run time 15
        avg throughput 238.363333333333
Running 29 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 18 lo is 16
thru hi is 256.472 lo is 228.52
        avg run time 16.6666666666667
        avg throughput 242.994666666667
Running 33 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 20 lo is 18
thru hi is 254.148 lo is 234.099
        avg run time 19
        avg throughput 241.595333333333
[root@elm3b96 dbench]# ./test_dbench-avg.sh 36 64 5 2525hi
Running 36 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 21 lo is 20
thru hi is 250.669 lo is 240.105
        avg run time 20.3333333333333
        avg throughput 247.037333333333
Running 40 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 23 lo is 22
thru hi is 247.32 lo is 241.098
        avg run time 22.6666666666667
        avg throughput 243.157333333333
Running 44 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 26 lo is 25
thru hi is 245.733 lo is 237.135
        avg run time 25
        avg throughput 241.037333333333
unning 48 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 28 lo is 27
thru hi is 244.339 lo is 237.92
        avg run time 27
        avg throughput 242.203
unning 52 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 30 lo is 29
thru hi is 245.097 lo is 242.522
        avg run time 29.3333333333333
        avg throughput 240.211
Running 56 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 32 lo is 31
thru hi is 245.913 lo is 236.625
        avg run time 31.6666666666667
        avg throughput 241.393666666667
Running 60 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 35 lo is 34
thru hi is 243.014 lo is 231.635
        avg run time 34.6666666666667
        avg throughput 235.398333333333
Running 64 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 710 lo is 309
thru hi is 237.763 lo is 11.9168
        avg run time 131
        avg throughput 83.1543666666667


[-- Attachment #5: akpm-2525.data --]
[-- Type: application/octet-stream, Size: 305 bytes --]

#clnts	#kmap	#cln

1	79.66	81.76
5	264.65	242.98
9	283.07	250.25
13	284.07	246.31
17	282.87	250.66
21	280.03	244.35
25	279.70	238.36
29	274.37	242.99
33	277.99	241.60
36	274.10	247.04
40	270.67	243.16
44	270.66	241.04	
48	274.45	242.20
52	273.27	240.21
56	267.34	241.39
60	272.49	235.40
64	117.48	83.15



       reply	other threads:[~2002-07-10 22:11 UTC|newest]

Thread overview: 3+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <237170000.1026317715@flay>
2002-07-10 22:18 ` Hanna Linder [this message]
2002-07-11  3:06   ` scalable kmap (was Re: vm lock contention reduction) (fwd) Andrew Morton
2002-07-11  5:19     ` Andrew Morton

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=40740000.1026339488@w-hlinder \
    --to=hannal@us.ibm.com \
    --cc=Martin.Bligh@us.ibm.com \
    --cc=akpm@zip.com.au \
    --cc=haveblue@us.ibm.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=lse-tech@lists.sourceforge.net \
    --cc=mannthey@us.ibm.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox