All of lore.kernel.org
 help / color / mirror / Atom feed
From: Hanna Linder <hannal@us.ibm.com>
To: "Martin J. Bligh" <Martin.Bligh@us.ibm.com>, akpm@zip.com.au
Cc: Keith Mannthey <mannthey@us.ibm.com>,
	hannal@us.ibm.com, haveblue@us.ibm.com,
	lse-tech@lists.sourceforge.net, linux-kernel@vger.kernel.org
Subject: Re: scalable kmap (was Re: vm lock contention reduction) (fwd)
Date: Wed, 10 Jul 2002 15:18:08 -0700	[thread overview]
Message-ID: <40740000.1026339488@w-hlinder> (raw)
In-Reply-To: <237170000.1026317715@flay>

[-- Attachment #1: Type: text/plain, Size: 1486 bytes --]

--On Wednesday, July 10, 2002 09:15:15 -0700 "Martin J. Bligh" <Martin.Bligh@us.ibm.com> wrote:

> 
> Updated patch below ...
> 
> 
>  arch/i386/kernel/i386_ksyms.c   |    5 ++
>  arch/i386/lib/usercopy.c        |   10 +++++
>  arch/i386/mm/fault.c            |   71 +++++++++++++++++++++++++++++++++++
>  fs/exec.c                       |   60 +++++++++++++++++++++---------
>  include/asm-i386/highmem.h      |    5 ++
>  include/asm-i386/kmap_types.h   |    3 +
>  include/asm-i386/processor.h    |    2 +
>  include/asm-ppc/kmap_types.h    |    1 
>  include/asm-sparc/kmap_types.h  |    1 
>  include/asm-x86_64/kmap_types.h |    1 
>  include/linux/highmem.h         |   80 ++++++++++++++++++++++++++++++++++++++++
>  include/linux/sched.h           |    5 ++
>  mm/filemap.c                    |   11 +++--
>  13 files changed, 232 insertions(+), 23 deletions(-)


Andrew and Martin,

	I ran this updated patch on 2.5.25 with dbench on
the 8-way with 4 Gb of memory compared to clean 2.5.25. 
I saw a significant improvement in throughput about 15%
(averaged over 5 runs each). 
	Included is the pretty picture (akpm-2525.png) the 
data that picture came from (akpm-2525.data) and the raw 
results of the runs with min/max and timing results 
(2525akpmkmaphi and 2525clnhi).
	I believe the drop at around 64 clients is caused by
memory swapping leading to increased disk accesses since the 
time increased by 200% in direct correlation with the decreased 
throughput.

Hanna





[-- Attachment #2: akpm-2525.png --]
[-- Type: image/png, Size: 3587 bytes --]

[-- Attachment #3: 2525akpmkmaphi --]
[-- Type: application/octet-stream, Size: 4599 bytes --]

[root@elm3b96 dbench]# ./test_dbench-avg.sh 1 36 5 hikmap
Running 1 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 3 lo is 2
thru hi is 81.5701 lo is 76.9333
        avg run time 3
        avg throughput 79.6601666666667
Running 5 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 4 lo is 3
thru hi is 277.74 lo is 243.343
        avg run time 3.33333333333333
        avg throughput 264.646333333333
Running 9 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 6 lo is 5
thru hi is 295.914 lo is 288.236
        avg run time 5
        avg throughput 283.635333333333
Running 13 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 8 lo is 7
thru hi is 291.79 lo is 246.807
        avg run time 7
        avg throughput 284.074666666667
Running 17 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 9 lo is 9
thru hi is 288.754 lo is 279.672
        avg run time 9
        avg throughput 282.871666666667
Running 21 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 11 lo is 10
thru hi is 282.556 lo is 279.696
        avg run time 11
        avg throughput 280.028666666667
Running 25 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 13 lo is 13
thru hi is 283.141 lo is 270.631
        avg run time 13
        avg throughput 279.706666666667
Running 21 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 11 lo is 10
thru hi is 282.556 lo is 279.696
        avg run time 11
        avg throughput 280.028666666667
Running 25 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 13 lo is 13
thru hi is 283.141 lo is 270.631
        avg run time 13
        avg throughput 279.706666666667
Running 29 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 16 lo is 14
thru hi is 287.336 lo is 282.406
        avg run time 14.6666666666667
        avg throughput 274.366
Running 33 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 17 lo is 16
thru hi is 280.63 lo is 274.984
        avg run time 16.6666666666667
        avg throughput 277.988

[root@elm3b96 dbench]# ./test_dbench-avg.sh 36 64 5 akpmhi2     
Running 36 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 19 lo is 18
thru hi is 284.684 lo is 272.75
        avg run time 18
        avg throughput 274.103
Running 40 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 22 lo is 20
thru hi is 279.052 lo is 274.726
        avg run time 20
        avg throughput 270.671666666667
Running 44 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 23 lo is 22
thru hi is 275.928 lo is 261.419
        avg run time 22.6666666666667
        avg throughput 270.660333333333
Running 48 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 25 lo is 24
thru hi is 276.622 lo is 271.115
        avg run time 24
        avg throughput 274.449333333333
Running 52 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 28 lo is 25
thru hi is 279.96 lo is 256.425
        avg run time 26
        avg throughput 273.272333333333
Running 56 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 30 lo is 28
thru hi is 270.907 lo is 268.947
        avg run time 28.3333333333333
        avg throughput 267.339666666667
Running 60 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 31 lo is 30
thru hi is 273.963 lo is 266.724
        avg run time 30
        avg throughput 272.487333333333
Running 64 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 883 lo is 33
thru hi is 262.225 lo is 9.57893
        avg run time 147.333333333333
        avg throughput 117.4783


[-- Attachment #4: 2525clnhi --]
[-- Type: application/octet-stream, Size: 4189 bytes --]


[root@elm3b96 dbench]# ./test_dbench-avg.sh 1 36 5 2525hi
Running 1 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 3 lo is 2
thru hi is 82.3442 lo is 77.5547
        avg run time 2.66666666666667
        avg throughput 81.7611333333333
Running 5 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 4 lo is 3
thru hi is 260.515 lo is 229.134
        avg run time 3.66666666666667
        avg throughput 242.980333333333
Running 9 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 6 lo is 5
thru hi is 256.654 lo is 253.473
        avg run time 6
        avg throughput 250.254666666667
Running 13 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 9 lo is 7
thru hi is 258.22 lo is 207.652
        avg run time 8.33333333333333
        avg throughput 246.309666666667
Running 17 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 11 lo is 10
thru hi is 252.47 lo is 228.667
        avg run time 10
        avg throughput 250.657666666667
Running 21 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 13 lo is 12
thru hi is 250.391 lo is 242.239
        avg run time 12
        avg throughput 244.346333333333
Running 25 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 15 lo is 15
thru hi is 249.358 lo is 226.142
        avg run time 15
        avg throughput 238.363333333333
Running 29 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 18 lo is 16
thru hi is 256.472 lo is 228.52
        avg run time 16.6666666666667
        avg throughput 242.994666666667
Running 33 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 20 lo is 18
thru hi is 254.148 lo is 234.099
        avg run time 19
        avg throughput 241.595333333333
[root@elm3b96 dbench]# ./test_dbench-avg.sh 36 64 5 2525hi
Running 36 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 21 lo is 20
thru hi is 250.669 lo is 240.105
        avg run time 20.3333333333333
        avg throughput 247.037333333333
Running 40 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 23 lo is 22
thru hi is 247.32 lo is 241.098
        avg run time 22.6666666666667
        avg throughput 243.157333333333
Running 44 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 26 lo is 25
thru hi is 245.733 lo is 237.135
        avg run time 25
        avg throughput 241.037333333333
unning 48 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 28 lo is 27
thru hi is 244.339 lo is 237.92
        avg run time 27
        avg throughput 242.203
unning 52 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 30 lo is 29
thru hi is 245.097 lo is 242.522
        avg run time 29.3333333333333
        avg throughput 240.211
Running 56 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 32 lo is 31
thru hi is 245.913 lo is 236.625
        avg run time 31.6666666666667
        avg throughput 241.393666666667
Running 60 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 35 lo is 34
thru hi is 243.014 lo is 231.635
        avg run time 34.6666666666667
        avg throughput 235.398333333333
Running 64 clients
        test no. 0
        test no. 1
        test no. 2
        test no. 3
        test no. 4
time hi is 710 lo is 309
thru hi is 237.763 lo is 11.9168
        avg run time 131
        avg throughput 83.1543666666667


[-- Attachment #5: akpm-2525.data --]
[-- Type: application/octet-stream, Size: 305 bytes --]

#clnts	#kmap	#cln

1	79.66	81.76
5	264.65	242.98
9	283.07	250.25
13	284.07	246.31
17	282.87	250.66
21	280.03	244.35
25	279.70	238.36
29	274.37	242.99
33	277.99	241.60
36	274.10	247.04
40	270.67	243.16
44	270.66	241.04	
48	274.45	242.20
52	273.27	240.21
56	267.34	241.39
60	272.49	235.40
64	117.48	83.15



       reply	other threads:[~2002-07-10 22:11 UTC|newest]

Thread overview: 3+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <237170000.1026317715@flay>
2002-07-10 22:18 ` Hanna Linder [this message]
2002-07-11  3:06   ` scalable kmap (was Re: vm lock contention reduction) (fwd) Andrew Morton
2002-07-11  5:19     ` Andrew Morton

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=40740000.1026339488@w-hlinder \
    --to=hannal@us.ibm.com \
    --cc=Martin.Bligh@us.ibm.com \
    --cc=akpm@zip.com.au \
    --cc=haveblue@us.ibm.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=lse-tech@lists.sourceforge.net \
    --cc=mannthey@us.ibm.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.