From: Srikar Dronamraju <srikar@linux.vnet.ibm.com>
To: Andrea Arcangeli <aarcange@redhat.com>
Cc: linux-kernel@vger.kernel.org, linux-mm@kvack.org,
torvalds@linux-foundation.org, akpm@linux-foundation.org,
pzijlstr@redhat.com, mingo@elte.hu, mel@csn.ul.ie,
hughd@google.com, riel@redhat.com, hannes@cmpxchg.org,
dhillf@gmail.com, drjones@redhat.com, tglx@linutronix.de,
pjt@google.com, cl@linux.com, suresh.b.siddha@intel.com,
efault@gmx.de, paulmck@linux.vnet.ibm.com, alex.shi@intel.com,
konrad.wilk@oracle.com, benh@kernel.crashing.org
Subject: Re: [PATCH 00/33] AutoNUMA27
Date: Tue, 23 Oct 2012 22:02:45 +0530 [thread overview]
Message-ID: <20121023163245.GR11096@linux.vnet.ibm.com> (raw)
In-Reply-To: <20121014045716.GE11663@redhat.com>
* Andrea Arcangeli <aarcange@redhat.com> [2012-10-14 06:57:16]:
> I'll release an autonuma29 behaving like 28fast if there are no
> surprises. The new algorithm change in 28fast will also save memory
> once I rewrite it properly.
>
Here are my results of specjbb2005 on a 2 node box (Still on autonuma27, but
plan to run on a newer release soon).
---------------------------------------------------------------------------------------------------
| kernel| vm| nofit| fit|
- - -------------------------------------------------------------------------
| | | noksm| ksm| noksm| ksm|
- - -------------------------------------------------------------------------
| | | nothp| thp| nothp| thp| nothp| thp| nothp| thp|
---------------------------------------------------------------------------------------------------
| mainline_v36| vm_1| 136085| 188500| 133871| 163638| 133540| 178159| 132460| 164763|
| | vm_2| 61549| 80496| 61420| 74864| 63777| 80573| 60479| 73416|
| | vm_3| 60688| 79349| 62244| 73289| 64394| 80803| 61040| 74258|
---------------------------------------------------------------------------------------------------
| autonuma27_| vm_1| 143261| 186080| 127420| 178505| 141080| 201436| 143216| 183710|
| | vm_2| 72224| 94368| 71309| 89576| 59098| 83750| 63813| 90862|
| | vm_3| 61215| 94213| 71539| 89594| 76269| 99637| 72412| 91191|
---------------------------------------------------------------------------------------------------
| improvement | vm_1| 5.27%| -1.28%| -4.82%| 9.09%| 5.65%| 13.07%| 8.12%| 11.50%|
| from | vm_2| 17.34%| 17.23%| 16.10%| 19.65%| -7.34%| 3.94%| 5.51%| 23.76%|
| mainline | vm_3| 0.87%| 18.73%| 14.93%| 22.25%| 18.44%| 23.31%| 18.63%| 22.80%|
---------------------------------------------------------------------------------------------------
(Results with suggested tweaks from Andrea)
echo 0 > /sys/kernel/mm/autonuma/knuma_scand/pmd
echo 15000 > /sys/kernel/mm/autonuma/knuma_scand/scan_sleep_pass_millisecs
----------------------------------------------------------------------------------------------------
| kernel| vm| nofit| fit|
- - --------------------------------------------------------------------------
| | | noksm| ksm| noksm| ksm|
- - --------------------------------------------------------------------------
| | | nothp| thp| nothp| thp| nothp| thp| nothp| thp|
----------------------------------------------------------------------------------------------------
| mainline_v36| vm_1| 136142| 178362| 132493| 166169| 131774| 179340| 133058| 164637|
| | vm_2| 61143| 81943| 60998| 74195| 63725| 79530| 61916| 73183|
| | vm_3| 61599| 79058| 61448| 73248| 62563| 80815| 61381| 74669|
----------------------------------------------------------------------------------------------------
| autonuma27_| vm_1| 142023| na| 142808| 177880| na| 197244| 145165| 174175|
| | vm_2| 61071| na| 61008| 91184| na| 78893| 71675| 80471|
| | vm_3| 72646| na| 72855| 92167| na| 99080| 64758| 91831|
----------------------------------------------------------------------------------------------------
| improvement | vm_1| 4.32%| na| 7.79%| 7.05%| na| 9.98%| 9.10%| 5.79%|
| from | vm_2| -0.12%| na| 0.02%| 22.90%| na| -0.80%| 15.76%| 9.96%|
| mainline | vm_3| 17.93%| na| 18.56%| 25.83%| na| 22.60%| 5.50%| 22.98%|
----------------------------------------------------------------------------------------------------
Host:
Enterprise Linux Distro
2 NUMA nodes. 6 cores + 6 hyperthreads/node, 12 GB RAM/node.
(total of 24 logical CPUs and 24 GB RAM)
VMs:
Enterprise Linux Distro
Distro Kernel
Main VM (VM1) -- relevant benchmark score.
12 vCPUs
Either 12 GB (for '< 1 Node' configuration, i.e fit case)
or 14 GB (for '> 1 Node', i.e no fit case)
Noise VMs (VM2 and VM3)
each noise VM has half of the remaining resources.
6 vCPUs
Either 4 GB (for '< 1 Node' configuration) or 3 GB ('> 1 Node ')
(to sum 20 GB w/ Main VM + 4 GB for host = total 24 GB)
Settings:
Swapping disabled on host and VMs.
Memory Overcommit enabled on host and VMs.
THP on host is a variable. THP disabled on VMs.
KSM on host is a variable. KSM disabled on VMs.
na: refers to I results where I wasnt able to collect the results.
--
Thanks and Regards
Srikar
next prev parent reply other threads:[~2012-10-23 16:31 UTC|newest]
Thread overview: 34+ messages / expand[flat|nested] mbox.gz Atom feed top
[not found] <1349308275-2174-1-git-send-email-aarcange@redhat.com>
[not found] ` <20121004113943.be7f92a0.akpm@linux-foundation.org>
2012-10-05 23:14 ` [PATCH 00/33] AutoNUMA27 Andi Kleen
2012-10-05 23:57 ` Tim Chen
2012-10-06 0:11 ` Andi Kleen
2012-10-08 13:44 ` Don Morris
2012-10-08 20:34 ` Rik van Riel
[not found] ` <20121011101930.GM3317@csn.ul.ie>
2012-10-11 14:56 ` Andrea Arcangeli
2012-10-11 15:35 ` Mel Gorman
2012-10-12 0:41 ` Andrea Arcangeli
2012-10-12 14:54 ` Mel Gorman
[not found] ` <1349308275-2174-2-git-send-email-aarcange@redhat.com>
[not found] ` <20121011105036.GN3317@csn.ul.ie>
2012-10-11 16:07 ` [PATCH 01/33] autonuma: add Documentation/vm/autonuma.txt Andrea Arcangeli
2012-10-11 19:37 ` Mel Gorman
[not found] ` <1349308275-2174-5-git-send-email-aarcange@redhat.com>
[not found] ` <20121011110137.GQ3317@csn.ul.ie>
2012-10-11 16:43 ` [PATCH 04/33] autonuma: define _PAGE_NUMA Andrea Arcangeli
2012-10-11 19:48 ` Mel Gorman
[not found] ` <1349308275-2174-6-git-send-email-aarcange@redhat.com>
[not found] ` <20121011111545.GR3317@csn.ul.ie>
2012-10-11 16:58 ` [PATCH 05/33] autonuma: pte_numa() and pmd_numa() Andrea Arcangeli
2012-10-11 19:54 ` Mel Gorman
[not found] ` <1349308275-2174-7-git-send-email-aarcange@redhat.com>
[not found] ` <20121011122255.GS3317@csn.ul.ie>
2012-10-11 17:05 ` [PATCH 06/33] autonuma: teach gup_fast about pmd_numa Andrea Arcangeli
2012-10-11 20:01 ` Mel Gorman
[not found] ` <1349308275-2174-8-git-send-email-aarcange@redhat.com>
[not found] ` <20121011122827.GT3317@csn.ul.ie>
2012-10-11 17:15 ` [PATCH 07/33] autonuma: mm_autonuma and task_autonuma data structures Andrea Arcangeli
2012-10-11 20:06 ` Mel Gorman
[not found] ` <5076E4B2.2040301@redhat.com>
[not found] ` <0000013a525a8739-2b4049fa-1cb3-4b8f-b3a7-1fa77b181590-000000@email.amazonses.com>
2012-10-12 0:52 ` Andrea Arcangeli
[not found] ` <1349308275-2174-9-git-send-email-aarcange@redhat.com>
[not found] ` <20121011134643.GU3317@csn.ul.ie>
2012-10-11 17:34 ` [PATCH 08/33] autonuma: define the autonuma flags Andrea Arcangeli
2012-10-11 20:17 ` Mel Gorman
[not found] ` <1349308275-2174-11-git-send-email-aarcange@redhat.com>
[not found] ` <20121011145805.GW3317@csn.ul.ie>
2012-10-12 0:25 ` [PATCH 10/33] autonuma: CPU follows memory algorithm Andrea Arcangeli
2012-10-12 8:29 ` Mel Gorman
[not found] ` <20121011213432.GQ3317@csn.ul.ie>
2012-10-12 1:45 ` [PATCH 00/33] AutoNUMA27 Andrea Arcangeli
2012-10-12 8:46 ` Mel Gorman
[not found] ` <1349308275-2174-16-git-send-email-aarcange@redhat.com>
[not found] ` <20121011155302.GA3317@csn.ul.ie>
[not found] ` <50770314.7060800@redhat.com>
[not found] ` <20121011175953.GT1818@redhat.com>
2012-10-12 14:03 ` [PATCH 15/33] autonuma: alloc/free/init task_autonuma Rik van Riel
2012-10-13 18:40 ` [PATCH 00/33] AutoNUMA27 Srikar Dronamraju
2012-10-14 4:57 ` Andrea Arcangeli
2012-10-15 8:16 ` Srikar Dronamraju
2012-10-23 16:32 ` Srikar Dronamraju [this message]
[not found] ` <1349308275-2174-20-git-send-email-aarcange@redhat.com>
[not found] ` <20121013180618.GC31442@linux.vnet.ibm.com>
2012-10-15 8:24 ` [PATCH 19/33] autonuma: memory follows CPU algorithm and task/mm_autonuma stats collection Srikar Dronamraju
2012-10-15 9:20 ` Mel Gorman
2012-10-15 10:00 ` Srikar Dronamraju
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20121023163245.GR11096@linux.vnet.ibm.com \
--to=srikar@linux.vnet.ibm.com \
--cc=aarcange@redhat.com \
--cc=akpm@linux-foundation.org \
--cc=alex.shi@intel.com \
--cc=benh@kernel.crashing.org \
--cc=cl@linux.com \
--cc=dhillf@gmail.com \
--cc=drjones@redhat.com \
--cc=efault@gmx.de \
--cc=hannes@cmpxchg.org \
--cc=hughd@google.com \
--cc=konrad.wilk@oracle.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-mm@kvack.org \
--cc=mel@csn.ul.ie \
--cc=mingo@elte.hu \
--cc=paulmck@linux.vnet.ibm.com \
--cc=pjt@google.com \
--cc=pzijlstr@redhat.com \
--cc=riel@redhat.com \
--cc=suresh.b.siddha@intel.com \
--cc=tglx@linutronix.de \
--cc=torvalds@linux-foundation.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox