linux-mm.kvack.org archive mirror
 help / color / mirror / Atom feed
From: Mel Gorman <mgorman@suse.de>
To: Peter Zijlstra <a.p.zijlstra@chello.nl>,
	Andrea Arcangeli <aarcange@redhat.com>,
	Ingo Molnar <mingo@kernel.org>
Cc: Rik van Riel <riel@redhat.com>,
	Johannes Weiner <hannes@cmpxchg.org>,
	Hugh Dickins <hughd@google.com>,
	Thomas Gleixner <tglx@linutronix.de>,
	Linus Torvalds <torvalds@linux-foundation.org>,
	Andrew Morton <akpm@linux-foundation.org>,
	Linux-MM <linux-mm@kvack.org>,
	LKML <linux-kernel@vger.kernel.org>
Subject: Re: [RFC PATCH 00/43] Automatic NUMA Balancing V3
Date: Fri, 16 Nov 2012 14:56:28 +0000	[thread overview]
Message-ID: <20121116145628.GB8218@suse.de> (raw)
In-Reply-To: <1353064973-26082-1-git-send-email-mgorman@suse.de>

On Fri, Nov 16, 2012 at 11:22:10AM +0000, Mel Gorman wrote:
> tldr: Benchmarkers, only test patches 1-35.
> 

A very basic sniff test of other benchmarks completed so I thought I'd
report them too. aim9, hackbench both pipes and sockets were inconclusive.
STREAM showed no difference but it was not really configured for running
on NUMA machines.

KERNBENCH
                               3.7.0                 3.7.0                 3.7.0                 3.7.0                 3.7.0                 3.7.0                 3.7.0                 3.7.0
                     rc4-stats-v2r34    rc4-schednuma-v2r3  rc4-autonuma-v28fast       rc4-moron-v3r27    rc4-twostage-v3r27   rc4-lessflush-v3r27      rc4-cpuone-v3r27   rc4-adaptscan-v3r27
User    min        1295.88 (  0.00%)     1402.92 ( -8.26%)     1290.31 (  0.43%)     1298.47 ( -0.20%)     1297.88 ( -0.15%)     1299.04 ( -0.24%)     1296.06 ( -0.01%)     1300.04 ( -0.32%)
User    mean       1298.20 (  0.00%)     1842.51 (-41.93%)     1294.05 (  0.32%)     1301.40 ( -0.25%)     1300.28 ( -0.16%)     1301.86 ( -0.28%)     1300.27 ( -0.16%)     1302.41 ( -0.32%)
User    stddev        1.53 (  0.00%)      223.82 (-14561.84%)        3.29 (-115.30%)        1.96 (-28.37%)        1.82 (-19.21%)        1.62 ( -5.92%)        2.84 (-85.83%)        2.19 (-43.19%)
User    max        1300.23 (  0.00%)     1999.76 (-53.80%)     1298.14 (  0.16%)     1303.91 ( -0.28%)     1302.36 ( -0.16%)     1303.48 ( -0.25%)     1303.67 ( -0.26%)     1306.42 ( -0.48%)
System  min         118.62 (  0.00%)      176.64 (-48.91%)      122.14 ( -2.97%)      122.22 ( -3.03%)      122.11 ( -2.94%)      122.23 ( -3.04%)      120.96 ( -1.97%)      122.88 ( -3.59%)
System  mean        118.96 (  0.00%)      261.27 (-119.63%)      123.23 ( -3.59%)      123.22 ( -3.58%)      122.52 ( -3.00%)      122.68 ( -3.13%)      121.48 ( -2.12%)      123.58 ( -3.88%)
System  stddev        0.20 (  0.00%)       42.66 (-21088.95%)        0.57 (-183.80%)        1.09 (-439.58%)        0.31 (-51.61%)        0.40 (-96.69%)        0.34 (-70.93%)        0.60 (-199.57%)
System  max         119.21 (  0.00%)      291.11 (-144.20%)      123.73 ( -3.79%)      125.24 ( -5.06%)      122.97 ( -3.15%)      123.20 ( -3.35%)      121.92 ( -2.27%)      124.62 ( -4.54%)
Elapsed min          40.26 (  0.00%)       50.31 (-24.96%)       40.63 ( -0.92%)       39.89 (  0.92%)       40.45 ( -0.47%)       40.92 ( -1.64%)       41.33 ( -2.66%)       40.60 ( -0.84%)
Elapsed mean         41.65 (  0.00%)       64.74 (-55.43%)       42.04 ( -0.94%)       41.57 (  0.18%)       41.72 ( -0.18%)       41.96 ( -0.75%)       42.13 ( -1.16%)       41.93 ( -0.67%)
Elapsed stddev        0.89 (  0.00%)        7.44 (-737.89%)        1.25 (-40.28%)        0.94 ( -5.80%)        0.90 ( -1.42%)        0.77 ( 13.48%)        0.57 ( 36.26%)        0.72 ( 19.00%)
Elapsed max          42.96 (  0.00%)       70.82 (-64.85%)       44.00 ( -2.42%)       42.63 (  0.77%)       42.89 (  0.16%)       42.78 (  0.42%)       42.81 (  0.35%)       42.78 (  0.42%)
CPU     min        3303.00 (  0.00%)     3139.00 (  4.97%)     3221.00 (  2.48%)     3332.00 ( -0.88%)     3310.00 ( -0.21%)     3322.00 ( -0.58%)     3310.00 ( -0.21%)     3331.00 ( -0.85%)
CPU     mean       3403.00 (  0.00%)     3243.60 (  4.68%)     3373.40 (  0.87%)     3428.00 ( -0.73%)     3411.00 ( -0.24%)     3395.00 (  0.24%)     3374.40 (  0.84%)     3401.40 (  0.05%)
CPU     stddev       70.24 (  0.00%)       60.02 ( 14.56%)      103.48 (-47.33%)       85.77 (-22.12%)       78.33 (-11.52%)       64.52 (  8.15%)       50.06 ( 28.73%)       64.99 (  7.47%)
CPU     max        3518.00 (  0.00%)     3310.00 (  5.91%)     3496.00 (  0.63%)     3582.00 ( -1.82%)     3522.00 ( -0.11%)     3482.00 (  1.02%)     3447.00 (  2.02%)     3524.00 ( -0.17%)
MMTests Statistics: duration
               3.7.0       3.7.0       3.7.0       3.7.0       3.7.0       3.7.0       3.7.0       3.7.0
        rc4-stats-v2r34rc4-schednuma-v2r3rc4-autonuma-v28fastrc4-moron-v3r27rc4-twostage-v3r27rc4-lessflush-v3r27rc4-cpuone-v3r27rc4-adaptscan-v3r27
User         7821.95    11152.89     7792.64     7841.33     7835.71     7840.44     7829.82     7852.37
System        734.94     1599.73      757.50      760.34      756.44      756.76      749.66      762.89
Elapsed       297.60      438.56      299.92      296.24      298.16      298.33      299.63      300.04

This is a plain kernel build benchmark. 5 builds averaged.

schednuma regressed elapsed time by 55.43% with major deviations and high
system CPU overhead. Breakage in the logic that starts scanning maybe?
Problem could be in the tip/sched/core patches for all I know. I didn't
investigate. It's something to keep an eye on if it's rebased.

autonuma and balancenuma are ok. No major impact but none is expected.

PAGE FAULT TEST

This is a microbench for page fault tests. The ordering of the threads
is screwed up obviously. I'll fix that some other time. It just makes it
a bit trickier to read.

                              3.7.0                 3.7.0                 3.7.0                 3.7.0                 3.7.0                 3.7.0                 3.7.0                 3.7.0
                    rc4-stats-v2r34    rc4-schednuma-v2r3  rc4-autonuma-v28fast       rc4-moron-v3r27    rc4-twostage-v3r27   rc4-lessflush-v3r27      rc4-cpuone-v3r27   rc4-adaptscan-v3r27
User       1       0.6940 (  0.00%)      0.7065 ( -1.80%)      0.6535 (  5.84%)      0.6930 (  0.14%)      0.6985 ( -0.65%)      0.6950 ( -0.14%)      0.6930 (  0.14%)      0.6785 (  2.23%)
User       10      0.8245 (  0.00%)      0.8020 (  2.73%)      0.8650 ( -4.91%)      0.8305 ( -0.73%)      0.8335 ( -1.09%)      0.8110 (  1.64%)      0.8440 ( -2.37%)      0.8320 ( -0.91%)
User       11      0.8410 (  0.00%)      0.8105 (  3.63%)      0.8765 ( -4.22%)      0.8150 (  3.09%)      0.8350 (  0.71%)      0.8335 (  0.89%)      0.8300 (  1.31%)      0.8470 ( -0.71%)
User       12      0.8260 (  0.00%)      0.7370 ( 10.77%)      0.8975 ( -8.66%)      0.8120 (  1.69%)      0.7865 (  4.78%)      0.7880 (  4.60%)      0.7755 (  6.11%)      0.8065 (  2.36%)
User       13      0.8490 (  0.00%)      0.8445 (  0.53%)      0.9275 ( -9.25%)      0.8775 ( -3.36%)      0.8310 (  2.12%)      0.8620 ( -1.53%)      0.8380 (  1.30%)      0.8290 (  2.36%)
User       14      0.8515 (  0.00%)      0.8305 (  2.47%)      0.9170 ( -7.69%)      0.8460 (  0.65%)      0.8295 (  2.58%)      0.8525 ( -0.12%)      0.8550 ( -0.41%)      0.8615 ( -1.17%)
User       15      0.7785 (  0.00%)      0.7745 (  0.51%)      0.9530 (-22.41%)      0.7665 (  1.54%)      0.8185 ( -5.14%)      0.8250 ( -5.97%)      0.8445 ( -8.48%)      0.8035 ( -3.21%)
User       16      0.8750 (  0.00%)      0.8395 (  4.06%)      0.9345 ( -6.80%)      0.8705 (  0.51%)      0.8790 ( -0.46%)      0.8485 (  3.03%)      0.8720 (  0.34%)      0.7620 ( 12.91%)
User       17      0.8865 (  0.00%)      0.9235 ( -4.17%)      0.9585 ( -8.12%)      0.9105 ( -2.71%)      0.8995 ( -1.47%)      0.8800 (  0.73%)      0.8600 (  2.99%)      0.8755 (  1.24%)
User       18      0.9240 (  0.00%)      0.9020 (  2.38%)      0.9615 ( -4.06%)      0.9945 ( -7.63%)      0.9380 ( -1.52%)      1.0210 (-10.50%)      0.8790 (  4.87%)      0.8400 (  9.09%)
User       19      0.8335 (  0.00%)      0.9030 ( -8.34%)      0.9890 (-18.66%)      0.9480 (-13.74%)      0.9160 ( -9.90%)      0.9315 (-11.76%)      0.9575 (-14.88%)      0.8390 ( -0.66%)
User       2       0.6915 (  0.00%)      0.7105 ( -2.75%)      0.6890 (  0.36%)      0.6990 ( -1.08%)      0.7020 ( -1.52%)      0.7000 ( -1.23%)      0.6980 ( -0.94%)      0.7170 ( -3.69%)
User       20      0.8055 (  0.00%)      0.7515 (  6.70%)      0.9285 (-15.27%)      0.8135 ( -0.99%)      0.8900 (-10.49%)      0.7495 (  6.95%)      0.8910 (-10.61%)      0.7920 (  1.68%)
User       21      0.9490 (  0.00%)      0.9575 ( -0.90%)      0.9895 ( -4.27%)      0.9060 (  4.53%)      0.9640 ( -1.58%)      0.9990 ( -5.27%)      1.0165 ( -7.11%)      0.8760 (  7.69%)
User       22      0.9325 (  0.00%)      0.9545 ( -2.36%)      0.9820 ( -5.31%)      0.9205 (  1.29%)      0.9215 (  1.18%)      0.9285 (  0.43%)      0.9625 ( -3.22%)      0.8985 (  3.65%)
User       23      0.8595 (  0.00%)      0.8640 ( -0.52%)      0.9835 (-14.43%)      0.8820 ( -2.62%)      0.8450 (  1.69%)      0.8240 (  4.13%)      0.8750 ( -1.80%)      0.8765 ( -1.98%)
User       24      0.8060 (  0.00%)      0.8255 ( -2.42%)      0.9790 (-21.46%)      0.7695 (  4.53%)      0.8260 ( -2.48%)      0.8165 ( -1.30%)      0.8275 ( -2.67%)      0.8055 (  0.06%)
User       25      0.9570 (  0.00%)      1.1360 (-18.70%)      0.9685 ( -1.20%)      0.9785 ( -2.25%)      0.9655 ( -0.89%)      0.9510 (  0.63%)      0.9815 ( -2.56%)      0.9225 (  3.61%)
User       26      0.9535 (  0.00%)      1.0865 (-13.95%)      1.0100 ( -5.93%)      0.9640 ( -1.10%)      0.9405 (  1.36%)      0.9995 ( -4.82%)      0.9415 (  1.26%)      0.8970 (  5.93%)
User       27      0.8870 (  0.00%)      1.0045 (-13.25%)      0.9885 (-11.44%)      0.9405 ( -6.03%)      0.9375 ( -5.69%)      0.8770 (  1.13%)      0.8865 (  0.06%)      0.8580 (  3.27%)
User       28      0.8935 (  0.00%)      0.8965 ( -0.34%)      1.0015 (-12.09%)      0.8760 (  1.96%)      0.8595 (  3.81%)      0.8435 (  5.60%)      0.8715 (  2.46%)      0.8880 (  0.62%)
User       29      0.9450 (  0.00%)      0.9595 ( -1.53%)      1.0110 ( -6.98%)      0.9620 ( -1.80%)      0.8990 (  4.87%)      1.0160 ( -7.51%)      0.9530 ( -0.85%)      0.9230 (  2.33%)
User       3       0.7355 (  0.00%)      0.7275 (  1.09%)      0.7465 ( -1.50%)      0.7220 (  1.84%)      0.7180 (  2.38%)      0.7180 (  2.38%)      0.7300 (  0.75%)      0.7195 (  2.18%)
User       30      0.9245 (  0.00%)      0.9810 ( -6.11%)      1.0525 (-13.85%)      0.9480 ( -2.54%)      0.9805 ( -6.06%)      0.9885 ( -6.92%)      0.9405 ( -1.73%)      0.8875 (  4.00%)
User       31      0.9120 (  0.00%)      0.9950 ( -9.10%)      1.0360 (-13.60%)      0.9680 ( -6.14%)      0.9820 ( -7.68%)      0.9715 ( -6.52%)      0.9070 (  0.55%)      0.9345 ( -2.47%)
User       32      0.9220 (  0.00%)      0.8985 (  2.55%)      1.0345 (-12.20%)      0.8940 (  3.04%)      0.9725 ( -5.48%)      0.9200 (  0.22%)      1.0100 ( -9.54%)      0.9805 ( -6.34%)
User       33      1.0340 (  0.00%)      1.0530 ( -1.84%)      1.0750 ( -3.97%)      0.9800 (  5.22%)      0.9850 (  4.74%)      1.0520 ( -1.74%)      1.0115 (  2.18%)      0.9250 ( 10.54%)
User       34      1.0150 (  0.00%)      1.0495 ( -3.40%)      1.0415 ( -2.61%)      1.0615 ( -4.58%)      1.0060 (  0.89%)      1.0145 (  0.05%)      1.0180 ( -0.30%)      0.9760 (  3.84%)
User       35      1.0010 (  0.00%)      1.0865 ( -8.54%)      1.0520 ( -5.09%)      1.0420 ( -4.10%)      1.0105 ( -0.95%)      1.0410 ( -4.00%)      1.0015 ( -0.05%)      1.0430 ( -4.20%)
User       36      1.0250 (  0.00%)      1.0835 ( -5.71%)      1.0755 ( -4.93%)      1.0670 ( -4.10%)      1.0410 ( -1.56%)      1.0390 ( -1.37%)      1.0695 ( -4.34%)      1.0590 ( -3.32%)
User       37      1.0520 (  0.00%)      1.1555 ( -9.84%)      1.0565 ( -0.43%)      1.0800 ( -2.66%)      1.0640 ( -1.14%)      1.0600 ( -0.76%)      1.0800 ( -2.66%)      1.0825 ( -2.90%)
User       38      1.0760 (  0.00%)      1.1405 ( -5.99%)      1.0725 (  0.33%)      1.0910 ( -1.39%)      1.0815 ( -0.51%)      1.0935 ( -1.63%)      1.0625 (  1.25%)      1.0430 (  3.07%)
User       39      1.0805 (  0.00%)      1.1335 ( -4.91%)      1.0815 ( -0.09%)      1.1335 ( -4.91%)      1.1095 ( -2.68%)      1.1150 ( -3.19%)      1.0830 ( -0.23%)      1.0540 (  2.45%)
User       4       0.7455 (  0.00%)      0.7555 ( -1.34%)      0.7725 ( -3.62%)      0.7275 (  2.41%)      0.7490 ( -0.47%)      0.7460 ( -0.07%)      0.7330 (  1.68%)      0.7535 ( -1.07%)
User       40      1.0880 (  0.00%)      1.1400 ( -4.78%)      1.0795 (  0.78%)      1.0875 (  0.05%)      1.1345 ( -4.27%)      1.1115 ( -2.16%)      1.1405 ( -4.83%)      1.1125 ( -2.25%)
User       41      1.0750 (  0.00%)      1.1730 ( -9.12%)      1.1250 ( -4.65%)      1.1595 ( -7.86%)      1.1045 ( -2.74%)      1.1930 (-10.98%)      1.1220 ( -4.37%)      1.1385 ( -5.91%)
User       42      1.1400 (  0.00%)      1.2005 ( -5.31%)      1.1060 (  2.98%)      1.1405 ( -0.04%)      1.1720 ( -2.81%)      1.1455 ( -0.48%)      1.1685 ( -2.50%)      1.1305 (  0.83%)
User       43      1.1345 (  0.00%)      1.2520 (-10.36%)      1.0965 (  3.35%)      1.1170 (  1.54%)      1.1875 ( -4.67%)      1.1815 ( -4.14%)      1.1630 ( -2.51%)      1.1165 (  1.59%)
User       44      1.0975 (  0.00%)      1.1655 ( -6.20%)      1.1005 ( -0.27%)      1.1045 ( -0.64%)      1.1765 ( -7.20%)      1.1630 ( -5.97%)      1.1730 ( -6.88%)      1.1285 ( -2.82%)
User       45      1.1195 (  0.00%)      1.1700 ( -4.51%)      1.1365 ( -1.52%)      1.1225 ( -0.27%)      1.1685 ( -4.38%)      1.1325 ( -1.16%)      1.1245 ( -0.45%)      1.1185 (  0.09%)
User       46      1.1265 (  0.00%)      1.1740 ( -4.22%)      1.1390 ( -1.11%)      1.0720 (  4.84%)      1.1665 ( -3.55%)      1.1800 ( -4.75%)      1.1235 (  0.27%)      1.1595 ( -2.93%)
User       47      1.0555 (  0.00%)      1.1835 (-12.13%)      1.2075 (-14.40%)      1.1155 ( -5.68%)      1.0930 ( -3.55%)      1.0810 ( -2.42%)      1.0600 ( -0.43%)      1.0525 (  0.28%)
User       48      1.0190 (  0.00%)      1.1240 (-10.30%)      1.1795 (-15.75%)      1.0510 ( -3.14%)      1.0845 ( -6.43%)      1.0635 ( -4.37%)      1.0770 ( -5.69%)      1.0390 ( -1.96%)
User       5       0.7695 (  0.00%)      0.7935 ( -3.12%)      0.7620 (  0.97%)      0.7735 ( -0.52%)      0.7820 ( -1.62%)      0.7785 ( -1.17%)      0.7710 ( -0.19%)      0.7815 ( -1.56%)
User       6       0.8050 (  0.00%)      0.7950 (  1.24%)      0.8205 ( -1.93%)      0.8020 (  0.37%)      0.7980 (  0.87%)      0.8100 ( -0.62%)      0.7795 (  3.17%)      0.7850 (  2.48%)
User       7       0.8035 (  0.00%)      0.8025 (  0.12%)      0.8470 ( -5.41%)      0.8020 (  0.19%)      0.8325 ( -3.61%)      0.8155 ( -1.49%)      0.7985 (  0.62%)      0.8010 (  0.31%)
User       8       0.7800 (  0.00%)      0.7720 (  1.03%)      0.8165 ( -4.68%)      0.7750 (  0.64%)      0.7675 (  1.60%)      0.7635 (  2.12%)      0.7705 (  1.22%)      0.7590 (  2.69%)
User       9       0.8265 (  0.00%)      0.8205 (  0.73%)      0.8675 ( -4.96%)      0.8180 (  1.03%)      0.8410 ( -1.75%)      0.8325 ( -0.73%)      0.8440 ( -2.12%)      0.8380 ( -1.39%)

okayish

System     1       8.0225 (  0.00%)      8.3030 ( -3.50%)      7.7995 (  2.78%)      8.1195 ( -1.21%)      8.8805 (-10.69%)      8.8315 (-10.08%)      8.9385 (-11.42%)      8.9270 (-11.27%)
System     10      9.3950 (  0.00%)      9.3540 (  0.44%)     12.4220 (-32.22%)      9.4675 ( -0.77%)      9.4720 ( -0.82%)      9.3825 (  0.13%)      9.4545 ( -0.63%)      9.4245 ( -0.31%)
System     11      9.6080 (  0.00%)      9.5930 (  0.16%)     12.8430 (-33.67%)      9.5195 (  0.92%)      9.6365 ( -0.30%)      9.5765 (  0.33%)      9.5655 (  0.44%)      9.6655 ( -0.60%)
System     12      9.6835 (  0.00%)      9.4295 (  2.62%)     13.8420 (-42.94%)      9.6550 (  0.29%)      9.5810 (  1.06%)      9.5840 (  1.03%)      9.5485 (  1.39%)      9.7285 ( -0.46%)
System     13     10.2280 (  0.00%)     10.2590 ( -0.30%)     14.6750 (-43.48%)     10.3410 ( -1.10%)     10.1735 (  0.53%)     10.1995 (  0.28%)     10.1645 (  0.62%)     10.1835 (  0.44%)
System     14     10.5900 (  0.00%)     10.5680 (  0.21%)     14.0160 (-32.35%)     10.5915 ( -0.01%)     10.4970 (  0.88%)     10.5605 (  0.28%)     10.5495 (  0.38%)     10.5625 (  0.26%)
System     15     10.6810 (  0.00%)     10.7840 ( -0.96%)     15.3735 (-43.93%)     10.6965 ( -0.15%)     10.7710 ( -0.84%)     10.7660 ( -0.80%)     10.9565 ( -2.58%)     10.7735 ( -0.87%)
System     16     11.2160 (  0.00%)     11.1445 (  0.64%)     15.7790 (-40.68%)     11.2480 ( -0.29%)     11.2270 ( -0.10%)     11.1350 (  0.72%)     11.1960 (  0.18%)     10.9570 (  2.31%)
System     17     11.8005 (  0.00%)     11.8740 ( -0.62%)     16.0135 (-35.70%)     11.8500 ( -0.42%)     11.8655 ( -0.55%)     11.8020 ( -0.01%)     11.8435 ( -0.36%)     11.7465 (  0.46%)
System     18     12.3135 (  0.00%)     12.3210 ( -0.06%)     17.7965 (-44.53%)     12.4070 ( -0.76%)     12.3475 ( -0.28%)     12.4035 ( -0.73%)     12.3925 ( -0.64%)     12.4900 ( -1.43%)
System     19     12.9255 (  0.00%)     12.8265 (  0.77%)     17.0350 (-31.79%)     12.9055 (  0.15%)     12.7370 (  1.46%)     12.9020 (  0.18%)     12.8535 (  0.56%)     12.7640 (  1.25%)
System     2       7.9740 (  0.00%)      8.1645 ( -2.39%)      8.0575 ( -1.05%)      8.0620 ( -1.10%)      8.3845 ( -5.15%)      8.4270 ( -5.68%)      8.3680 ( -4.94%)      8.4245 ( -5.65%)
System     20     13.1690 (  0.00%)     13.2255 ( -0.43%)     22.2560 (-69.00%)     13.1780 ( -0.07%)     13.4530 ( -2.16%)     13.1810 ( -0.09%)     13.4035 ( -1.78%)     13.1695 ( -0.00%)
System     21     13.9900 (  0.00%)     14.1500 ( -1.14%)     19.5060 (-39.43%)     14.0500 ( -0.43%)     13.8970 (  0.66%)     13.8255 (  1.18%)     13.8665 (  0.88%)     13.9995 ( -0.07%)
System     22     14.4825 (  0.00%)     14.6855 ( -1.40%)     17.4625 (-20.58%)     14.4845 ( -0.01%)     14.5035 ( -0.15%)     14.7185 ( -1.63%)     14.4410 (  0.29%)     14.3950 (  0.60%)
System     23     15.0315 (  0.00%)     15.1310 ( -0.66%)     19.5000 (-29.73%)     15.0550 ( -0.16%)     15.0435 ( -0.08%)     15.0830 ( -0.34%)     15.1505 ( -0.79%)     15.0270 (  0.03%)
System     24     15.5875 (  0.00%)     15.6670 ( -0.51%)     19.4715 (-24.92%)     15.5890 ( -0.01%)     15.5645 (  0.15%)     15.5870 (  0.00%)     15.5850 (  0.02%)     15.5945 ( -0.04%)
System     25     16.1680 (  0.00%)     16.2540 ( -0.53%)     19.1600 (-18.51%)     16.1870 ( -0.12%)     16.2020 ( -0.21%)     16.1655 (  0.02%)     16.1390 (  0.18%)     16.1530 (  0.09%)
System     26     16.7865 (  0.00%)     16.8390 ( -0.31%)     19.1500 (-14.08%)     17.0290 ( -1.44%)     17.0090 ( -1.33%)     16.6930 (  0.56%)     16.9675 ( -1.08%)     16.7230 (  0.38%)
System     27     17.3615 (  0.00%)     17.3930 ( -0.18%)     21.9550 (-26.46%)     17.2930 (  0.39%)     17.4680 ( -0.61%)     17.3075 (  0.31%)     17.3500 (  0.07%)     17.2985 (  0.36%)
System     28     17.8905 (  0.00%)     17.9420 ( -0.29%)     21.7615 (-21.64%)     17.8855 (  0.03%)     17.8505 (  0.22%)     17.8400 (  0.28%)     17.8895 (  0.01%)     17.8940 ( -0.02%)
System     29     18.4965 (  0.00%)     18.6105 ( -0.62%)     20.9715 (-13.38%)     18.5045 ( -0.04%)     18.6050 ( -0.59%)     18.7750 ( -1.51%)     18.4845 (  0.06%)     18.4235 (  0.39%)
System     3       8.0840 (  0.00%)      8.1965 ( -1.39%)      8.4280 ( -4.26%)      8.1570 ( -0.90%)      8.2880 ( -2.52%)      8.3125 ( -2.83%)      8.2720 ( -2.33%)      8.2870 ( -2.51%)
System     30     19.1560 (  0.00%)     19.2185 ( -0.33%)     20.8670 ( -8.93%)     19.1430 (  0.07%)     19.0980 (  0.30%)     19.3585 ( -1.06%)     19.1110 (  0.23%)     19.1110 (  0.23%)
System     31     19.7080 (  0.00%)     19.7565 ( -0.25%)     21.6420 ( -9.81%)     19.7960 ( -0.45%)     19.7590 ( -0.26%)     19.6950 (  0.07%)     19.6655 (  0.22%)     19.6855 (  0.11%)
System     32     20.3105 (  0.00%)     20.2960 (  0.07%)     22.1755 ( -9.18%)     20.2305 (  0.39%)     20.2545 (  0.28%)     20.6380 ( -1.61%)     20.3245 ( -0.07%)     20.6485 ( -1.66%)
System     33     20.9800 (  0.00%)     21.3255 ( -1.65%)     24.1000 (-14.87%)     21.2675 ( -1.37%)     21.0655 ( -0.41%)     20.8960 (  0.40%)     21.0060 ( -0.12%)     20.9885 ( -0.04%)
System     34     21.6850 (  0.00%)     21.6340 (  0.24%)     23.1505 ( -6.76%)     21.7575 ( -0.33%)     21.6265 (  0.27%)     21.6225 (  0.29%)     21.5930 (  0.42%)     21.8515 ( -0.77%)
System     35     22.3675 (  0.00%)     22.3655 (  0.01%)     24.6240 (-10.09%)     22.3405 (  0.12%)     22.3260 (  0.19%)     22.4570 ( -0.40%)     22.2735 (  0.42%)     22.3960 ( -0.13%)
System     36     22.9230 (  0.00%)     22.9350 ( -0.05%)     24.4070 ( -6.47%)     23.1835 ( -1.14%)     23.3975 ( -2.07%)     22.9810 ( -0.25%)     23.1720 ( -1.09%)     22.9655 ( -0.19%)
System     37     23.8260 (  0.00%)     23.6405 (  0.78%)     26.7380 (-12.22%)     23.6795 (  0.61%)     23.7115 (  0.48%)     23.7050 (  0.51%)     23.7755 (  0.21%)     23.7005 (  0.53%)
System     38     24.5010 (  0.00%)     24.4410 (  0.24%)     26.4575 ( -7.99%)     24.4370 (  0.26%)     24.5340 ( -0.13%)     24.4795 (  0.09%)     24.4630 (  0.16%)     24.3760 (  0.51%)
System     39     25.1385 (  0.00%)     25.0860 (  0.21%)     25.9555 ( -3.25%)     25.2515 ( -0.45%)     25.2305 ( -0.37%)     25.2435 ( -0.42%)     25.0690 (  0.28%)     25.0730 (  0.26%)
System     4       8.1825 (  0.00%)      8.2740 ( -1.12%)      9.0735 (-10.89%)      8.2220 ( -0.48%)      8.3215 ( -1.70%)      8.3500 ( -2.05%)      8.2945 ( -1.37%)      8.2665 ( -1.03%)
System     40     25.9080 (  0.00%)     25.8030 (  0.41%)     25.9760 ( -0.26%)     25.6900 (  0.84%)     25.6950 (  0.82%)     25.7610 (  0.57%)     25.9280 ( -0.08%)     25.7840 (  0.48%)
System     41     26.6045 (  0.00%)     26.6025 (  0.01%)     26.7530 ( -0.56%)     26.6155 ( -0.04%)     26.6660 ( -0.23%)     26.6985 ( -0.35%)     26.5565 (  0.18%)     26.6280 ( -0.09%)
System     42     27.3815 (  0.00%)     27.3430 (  0.14%)     27.1135 (  0.98%)     27.3435 (  0.14%)     27.3335 (  0.18%)     27.3950 ( -0.05%)     27.5040 ( -0.45%)     27.3690 (  0.05%)
System     43     28.1110 (  0.00%)     28.2565 ( -0.52%)     28.7255 ( -2.19%)     28.0770 (  0.12%)     28.1630 ( -0.18%)     28.0530 (  0.21%)     27.9880 (  0.44%)     28.0160 (  0.34%)
System     44     28.7445 (  0.00%)     28.9265 ( -0.63%)     27.9265 (  2.85%)     28.7380 (  0.02%)     28.7090 (  0.12%)     28.7205 (  0.08%)     28.7120 (  0.11%)     28.7355 (  0.03%)
System     45     29.4660 (  0.00%)     29.6940 ( -0.77%)     28.7570 (  2.41%)     29.4360 (  0.10%)     29.5085 ( -0.14%)     29.5505 ( -0.29%)     29.5690 ( -0.35%)     29.5495 ( -0.28%)
System     46     30.3190 (  0.00%)     30.4165 ( -0.32%)     29.2040 (  3.68%)     30.2740 (  0.15%)     30.2490 (  0.23%)     30.2530 (  0.22%)     30.2540 (  0.21%)     30.1500 (  0.56%)
System     47     30.9935 (  0.00%)     31.2000 ( -0.67%)     29.5720 (  4.59%)     30.9790 (  0.05%)     30.9705 (  0.07%)     30.9835 (  0.03%)     30.9770 (  0.05%)     30.9540 (  0.13%)
System     48     31.7365 (  0.00%)     31.9850 ( -0.78%)     29.8695 (  5.88%)     31.7240 (  0.04%)     31.6080 (  0.40%)     31.4910 (  0.77%)     31.7400 ( -0.01%)     31.6185 (  0.37%)
System     5       8.4450 (  0.00%)      8.6465 ( -2.39%)      9.7375 (-15.30%)      8.5655 ( -1.43%)      8.6400 ( -2.31%)      8.5890 ( -1.71%)      8.6010 ( -1.85%)      8.6535 ( -2.47%)
System     6       8.7270 (  0.00%)      8.7060 (  0.24%)     10.1565 (-16.38%)      8.7445 ( -0.20%)      8.8040 ( -0.88%)      8.8985 ( -1.97%)      8.7645 ( -0.43%)      8.7625 ( -0.41%)
System     7       8.7955 (  0.00%)      8.8210 ( -0.29%)      9.8575 (-12.07%)      8.8850 ( -1.02%)      8.9770 ( -2.06%)      8.9645 ( -1.92%)      8.9130 ( -1.34%)      8.9485 ( -1.74%)
System     8       8.7685 (  0.00%)      8.8625 ( -1.07%)     11.7395 (-33.88%)      8.8640 ( -1.09%)      8.8125 ( -0.50%)      8.7915 ( -0.26%)      8.8170 ( -0.55%)      8.8815 ( -1.29%)
System     9       9.2585 (  0.00%)      9.2545 (  0.04%)     11.5375 (-24.62%)      9.2480 (  0.11%)      9.3775 ( -1.29%)      9.2645 ( -0.06%)      9.3285 ( -0.76%)      9.2975 ( -0.42%)

autonuma severely regresses here.

Elapsed    1       8.7345 (  0.00%)      9.0280 ( -3.36%)      8.4700 (  3.03%)      8.8290 ( -1.08%)      9.5940 ( -9.84%)      9.5440 ( -9.27%)      9.6495 (-10.48%)      9.6235 (-10.18%)
Elapsed    10      1.0810 (  0.00%)      1.0745 (  0.60%)      1.4245 (-31.78%)      1.0935 ( -1.16%)      1.0895 ( -0.79%)      1.0795 (  0.14%)      1.0990 ( -1.67%)      1.0875 ( -0.60%)
Elapsed    11      1.0140 (  0.00%)      1.0040 (  0.99%)      1.3640 (-34.52%)      1.0065 (  0.74%)      1.0135 (  0.05%)      1.0075 (  0.64%)      0.9965 (  1.73%)      1.0175 ( -0.35%)
Elapsed    12      0.9345 (  0.00%)      0.8745 (  6.42%)      1.4000 (-49.81%)      0.9300 (  0.48%)      0.9160 (  1.98%)      0.9155 (  2.03%)      0.8980 (  3.91%)      0.9375 ( -0.32%)
Elapsed    13      0.9370 (  0.00%)      0.9335 (  0.37%)      1.4165 (-51.17%)      0.9435 ( -0.69%)      0.9270 (  1.07%)      0.9360 (  0.11%)      0.9195 (  1.87%)      0.9195 (  1.87%)
Elapsed    14      0.8840 (  0.00%)      0.8800 (  0.45%)      1.2840 (-45.25%)      0.8870 ( -0.34%)      0.8785 (  0.62%)      0.8835 (  0.06%)      0.8865 ( -0.28%)      0.8770 (  0.79%)
Elapsed    15      0.8165 (  0.00%)      0.8195 ( -0.37%)      1.4100 (-72.69%)      0.8150 (  0.18%)      0.8395 ( -2.82%)      0.8375 ( -2.57%)      0.8420 ( -3.12%)      0.8220 ( -0.67%)
Elapsed    16      0.8090 (  0.00%)      0.7835 (  3.15%)      1.3955 (-72.50%)      0.7980 (  1.36%)      0.8120 ( -0.37%)      0.7780 (  3.83%)      0.8070 (  0.25%)      0.7520 (  7.05%)
Elapsed    17      0.8365 (  0.00%)      0.8340 (  0.30%)      1.3865 (-65.75%)      0.8280 (  1.02%)      0.8370 ( -0.06%)      0.8310 (  0.66%)      0.8280 (  1.02%)      0.8195 (  2.03%)
Elapsed    18      0.8070 (  0.00%)      0.7990 (  0.99%)      1.4900 (-84.63%)      0.8040 (  0.37%)      0.7985 (  1.05%)      0.8025 (  0.56%)      0.8065 (  0.06%)      0.8035 (  0.43%)
Elapsed    19      0.7760 (  0.00%)      0.7620 (  1.80%)      1.3920 (-79.38%)      0.7715 (  0.58%)      0.7665 (  1.22%)      0.7665 (  1.22%)      0.7765 ( -0.06%)      0.7755 (  0.06%)
Elapsed    2       4.3875 (  0.00%)      4.5205 ( -3.03%)      4.4680 ( -1.83%)      4.4385 ( -1.16%)      4.5830 ( -4.46%)      4.6285 ( -5.49%)      4.5885 ( -4.58%)      4.6315 ( -5.56%)
Elapsed    20      0.7320 (  0.00%)      0.7205 (  1.57%)      1.8875 (-157.86%)      0.7360 ( -0.55%)      0.7660 ( -4.64%)      0.7275 (  0.61%)      0.7700 ( -5.19%)      0.7250 (  0.96%)
Elapsed    21      0.8115 (  0.00%)      0.8150 ( -0.43%)      1.5500 (-91.00%)      0.8060 (  0.68%)      0.8000 (  1.42%)      0.7925 (  2.34%)      0.7885 (  2.83%)      0.8050 (  0.80%)
Elapsed    22      0.7865 (  0.00%)      0.7880 ( -0.19%)      1.2990 (-65.16%)      0.7820 (  0.57%)      0.7795 (  0.89%)      0.7995 ( -1.65%)      0.7740 (  1.59%)      0.7615 (  3.18%)
Elapsed    23      0.7550 (  0.00%)      0.7505 (  0.60%)      1.4240 (-88.61%)      0.7585 ( -0.46%)      0.7530 (  0.26%)      0.7620 ( -0.93%)      0.7760 ( -2.78%)      0.7535 (  0.20%)
Elapsed    24      0.7405 (  0.00%)      0.7315 (  1.22%)      1.4250 (-92.44%)      0.7485 ( -1.08%)      0.7420 ( -0.20%)      0.7705 ( -4.05%)      0.7495 ( -1.22%)      0.7475 ( -0.95%)
Elapsed    25      0.8405 (  0.00%)      0.8675 ( -3.21%)      1.3745 (-63.53%)      0.8430 ( -0.30%)      0.8460 ( -0.65%)      0.8380 (  0.30%)      0.8250 (  1.84%)      0.8280 (  1.49%)
Elapsed    26      0.8240 (  0.00%)      0.8400 ( -1.94%)      1.2865 (-56.13%)      0.8420 ( -2.18%)      0.8390 ( -1.82%)      0.8200 (  0.49%)      0.8235 (  0.06%)      0.8030 (  2.55%)
Elapsed    27      0.8095 (  0.00%)      0.8065 (  0.37%)      1.5595 (-92.65%)      0.8080 (  0.19%)      0.8280 ( -2.29%)      0.8070 (  0.31%)      0.8070 (  0.31%)      0.7985 (  1.36%)
Elapsed    28      0.7945 (  0.00%)      0.7805 (  1.76%)      1.5045 (-89.36%)      0.7935 (  0.13%)      0.7955 ( -0.13%)      0.7895 (  0.63%)      0.7955 ( -0.13%)      0.7870 (  0.94%)
Elapsed    29      0.8105 (  0.00%)      0.8015 (  1.11%)      1.2645 (-56.01%)      0.8055 (  0.62%)      0.8205 ( -1.23%)      0.8155 ( -0.62%)      0.8025 (  0.99%)      0.7915 (  2.34%)
Elapsed    3       2.9775 (  0.00%)      3.0160 ( -1.29%)      3.1050 ( -4.28%)      2.9970 ( -0.65%)      3.0270 ( -1.66%)      3.0450 ( -2.27%)      3.0395 ( -2.08%)      3.0295 ( -1.75%)
Elapsed    30      0.7980 (  0.00%)      0.7960 (  0.25%)      1.2380 (-55.14%)      0.8015 ( -0.44%)      0.8045 ( -0.81%)      0.8080 ( -1.25%)      0.8000 ( -0.25%)      0.7930 (  0.63%)
Elapsed    31      0.7895 (  0.00%)      0.7790 (  1.33%)      1.2440 (-57.57%)      0.8020 ( -1.58%)      0.7900 ( -0.06%)      0.7975 ( -1.01%)      0.7800 (  1.20%)      0.7965 ( -0.89%)
Elapsed    32      0.7875 (  0.00%)      0.7565 (  3.94%)      1.2395 (-57.40%)      0.7800 (  0.95%)      0.7850 (  0.32%)      0.7885 ( -0.13%)      0.7935 ( -0.76%)      0.7965 ( -1.14%)
Elapsed    33      0.7910 (  0.00%)      0.7885 (  0.32%)      1.3885 (-75.54%)      0.7965 ( -0.70%)      0.8030 ( -1.52%)      0.7840 (  0.88%)      0.7925 ( -0.19%)      0.7850 (  0.76%)
Elapsed    34      0.7965 (  0.00%)      0.7760 (  2.57%)      1.2035 (-51.10%)      0.8030 ( -0.82%)      0.7750 (  2.70%)      0.7950 (  0.19%)      0.7845 (  1.51%)      0.8015 ( -0.63%)
Elapsed    35      0.7960 (  0.00%)      0.7820 (  1.76%)      1.4090 (-77.01%)      0.7965 ( -0.06%)      0.7800 (  2.01%)      0.7900 (  0.75%)      0.7805 (  1.95%)      0.7975 ( -0.19%)
Elapsed    36      0.7690 (  0.00%)      0.7620 (  0.91%)      1.1845 (-54.03%)      0.8080 ( -5.07%)      0.8230 ( -7.02%)      0.7780 ( -1.17%)      0.7815 ( -1.63%)      0.7800 ( -1.43%)
Elapsed    37      0.8040 (  0.00%)      0.7740 (  3.73%)      1.5740 (-95.77%)      0.7815 (  2.80%)      0.7860 (  2.24%)      0.7890 (  1.87%)      0.7955 (  1.06%)      0.7760 (  3.48%)
Elapsed    38      0.7975 (  0.00%)      0.7755 (  2.76%)      1.3840 (-73.54%)      0.7885 (  1.13%)      0.7845 (  1.63%)      0.7790 (  2.32%)      0.7860 (  1.44%)      0.7620 (  4.45%)
Elapsed    39      0.7840 (  0.00%)      0.7650 (  2.42%)      1.2020 (-53.32%)      0.7850 ( -0.13%)      0.7875 ( -0.45%)      0.7855 ( -0.19%)      0.7755 (  1.08%)      0.7675 (  2.10%)
Elapsed    4       2.2725 (  0.00%)      2.2930 ( -0.90%)      2.5105 (-10.47%)      2.2700 (  0.11%)      2.3045 ( -1.41%)      2.3150 ( -1.87%)      2.2990 ( -1.17%)      2.2895 ( -0.75%)
Elapsed    40      0.7865 (  0.00%)      0.7585 (  3.56%)      1.1700 (-48.76%)      0.7675 (  2.42%)      0.7620 (  3.12%)      0.7720 (  1.84%)      0.7830 (  0.45%)      0.7750 (  1.46%)
Elapsed    41      0.7710 (  0.00%)      0.7730 ( -0.26%)      1.0885 (-41.18%)      0.7700 (  0.13%)      0.7850 ( -1.82%)      0.7895 ( -2.40%)      0.7660 (  0.65%)      0.7825 ( -1.49%)
Elapsed    42      0.7710 (  0.00%)      0.7620 (  1.17%)      1.1805 (-53.11%)      0.7760 ( -0.65%)      0.7835 ( -1.62%)      0.7965 ( -3.31%)      0.7895 ( -2.40%)      0.7750 ( -0.52%)
Elapsed    43      0.7760 (  0.00%)      0.7890 ( -1.68%)      1.4025 (-80.73%)      0.7660 (  1.29%)      0.7815 ( -0.71%)      0.7855 ( -1.22%)      0.7715 (  0.58%)      0.7800 ( -0.52%)
Elapsed    44      0.7620 (  0.00%)      0.7560 (  0.79%)      1.0490 (-37.66%)      0.7650 ( -0.39%)      0.7580 (  0.52%)      0.7635 ( -0.20%)      0.7630 ( -0.13%)      0.7575 (  0.59%)
Elapsed    45      0.7685 (  0.00%)      0.7555 (  1.69%)      1.0340 (-34.55%)      0.7520 (  2.15%)      0.7745 ( -0.78%)      0.7725 ( -0.52%)      0.7685 ( -0.00%)      0.7715 ( -0.39%)
Elapsed    46      0.7675 (  0.00%)      0.7670 (  0.07%)      1.0510 (-36.94%)      0.7530 (  1.89%)      0.7755 ( -1.04%)      0.7790 ( -1.50%)      0.7565 (  1.43%)      0.7690 ( -0.20%)
Elapsed    47      0.7655 (  0.00%)      0.7615 (  0.52%)      0.9980 (-30.37%)      0.7595 (  0.78%)      0.7555 (  1.31%)      0.7580 (  0.98%)      0.7485 (  2.22%)      0.7515 (  1.83%)
Elapsed    48      0.7565 (  0.00%)      0.7665 ( -1.32%)      1.0145 (-34.10%)      0.7550 (  0.20%)      0.7585 ( -0.26%)      0.7675 ( -1.45%)      0.7555 (  0.13%)      0.7630 ( -0.86%)
Elapsed    5       1.8960 (  0.00%)      1.9495 ( -2.82%)      2.1470 (-13.24%)      1.9300 ( -1.79%)      1.9435 ( -2.51%)      1.9385 ( -2.24%)      1.9345 ( -2.03%)      1.9715 ( -3.98%)
Elapsed    6       1.6435 (  0.00%)      1.6235 (  1.22%)      1.8870 (-14.82%)      1.6450 ( -0.09%)      1.6465 ( -0.18%)      1.6780 ( -2.10%)      1.6330 (  0.64%)      1.6335 (  0.61%)
Elapsed    7       1.4235 (  0.00%)      1.4280 ( -0.32%)      1.5900 (-11.70%)      1.4330 ( -0.67%)      1.4540 ( -2.14%)      1.4400 ( -1.16%)      1.4385 ( -1.05%)      1.4440 ( -1.44%)
Elapsed    8       1.2430 (  0.00%)      1.2560 ( -1.05%)      1.6855 (-35.60%)      1.2615 ( -1.49%)      1.2450 ( -0.16%)      1.2345 (  0.68%)      1.2455 ( -0.20%)      1.2505 ( -0.60%)
Elapsed    9       1.1960 (  0.00%)      1.1740 (  1.84%)      1.4805 (-23.79%)      1.1890 (  0.59%)      1.2175 ( -1.80%)      1.1960 (  0.00%)      1.2135 ( -1.46%)      1.1960 (  0.00%)

autonuma severely regresses again.

Faults/cpu 1  379172.8815 (  0.00%) 366916.6749 ( -3.23%) 390865.4622 (  3.08%) 375062.6065 ( -1.08%) 344398.2334 ( -9.17%) 346316.7026 ( -8.67%) 342593.7671 ( -9.65%) 343478.2077 ( -9.41%)
Faults/cpu 10 323604.1493 (  0.00%) 325718.3813 (  0.65%) 258196.7306 (-20.21%) 321198.7019 ( -0.74%) 320441.2754 ( -0.98%) 324020.5574 (  0.13%) 320504.8353 ( -0.96%) 321797.4986 ( -0.56%)
Faults/cpu 11 316519.9065 (  0.00%) 317833.8690 (  0.42%) 243939.0320 (-22.93%) 320036.2189 (  1.11%) 315177.2430 ( -0.42%) 317178.5745 (  0.21%) 317748.8098 (  0.39%) 313869.3320 ( -0.84%)
Faults/cpu 12 314628.1208 (  0.00%) 325383.9891 (  3.42%) 230412.8991 (-26.77%) 315907.2186 (  0.41%) 318360.5441 (  1.19%) 318227.8914 (  1.14%) 320184.1807 (  1.77%) 313449.8158 ( -0.37%)
Faults/cpu 13 298592.4770 (  0.00%) 297979.0298 ( -0.21%) 220614.4681 (-26.12%) 294750.6269 ( -1.29%) 299824.4052 (  0.41%) 298329.0947 ( -0.09%) 300100.8660 (  0.51%) 299793.3858 (  0.40%)
Faults/cpu 14 288928.7491 (  0.00%) 290144.9339 (  0.42%) 223268.2541 (-22.73%) 289070.0442 (  0.05%) 291401.9587 (  0.86%) 289055.8228 (  0.04%) 289312.9895 (  0.13%) 288960.1284 (  0.01%)
Faults/cpu 15 288473.0724 (  0.00%) 285993.7526 ( -0.86%) 207111.4074 (-28.20%) 288432.1628 ( -0.01%) 284684.3744 ( -1.31%) 284659.4118 ( -1.32%) 279829.5199 ( -3.00%) 285039.1880 ( -1.19%)
Faults/cpu 16 273522.3548 (  0.00%) 276017.7447 (  0.91%) 203116.4171 (-25.74%) 273046.0156 ( -0.17%) 272635.1353 ( -0.32%) 275644.9327 (  0.78%) 273495.7977 ( -0.01%) 281660.0911 (  2.98%)
Faults/cpu 17 260585.8755 (  0.00%) 258319.0870 ( -0.87%) 197740.2319 (-24.12%) 259092.8477 ( -0.57%) 258662.7866 ( -0.74%) 260215.8817 ( -0.14%) 260070.3928 ( -0.20%) 261341.7127 (  0.29%)
Faults/cpu 18 249689.2296 (  0.00%) 249968.8075 (  0.11%) 182930.9296 (-26.74%) 246603.2969 ( -1.24%) 248314.5609 ( -0.55%) 245716.2923 ( -1.59%) 248976.3339 ( -0.29%) 248073.9163 ( -0.65%)
Faults/cpu 19 240750.3659 (  0.00%) 240789.6353 (  0.02%) 188771.5218 (-21.59%) 238684.0390 ( -0.86%) 241604.9375 (  0.35%) 238763.3031 ( -0.83%) 238906.5567 ( -0.77%) 242483.4568 (  0.72%)
Faults/cpu 2  381421.0777 (  0.00%) 372376.1903 ( -2.37%) 377934.7123 ( -0.91%) 377273.1157 ( -1.09%) 363045.3746 ( -4.82%) 361409.2242 ( -5.25%) 363834.2320 ( -4.61%) 360820.2154 ( -5.40%)
Faults/cpu 20 236477.3449 (  0.00%) 236457.1431 ( -0.01%) 157382.2381 (-33.45%) 236200.5157 ( -0.12%) 230414.6321 ( -2.56%) 236756.7760 (  0.12%) 231175.6010 ( -2.24%) 236282.0209 ( -0.08%)
Faults/cpu 21 221441.8099 (  0.00%) 219259.4023 ( -0.99%) 170488.7764 (-23.01%) 221341.7555 ( -0.05%) 221960.5560 (  0.23%) 222477.2287 (  0.47%) 221624.7875 (  0.08%) 222009.8368 (  0.26%)
Faults/cpu 22 214404.4785 (  0.00%) 211526.3457 ( -1.34%) 180914.1781 (-15.62%) 214533.1781 (  0.06%) 213834.6982 ( -0.27%) 211470.0826 ( -1.37%) 214114.3111 ( -0.14%) 215667.1744 (  0.59%)
Faults/cpu 23 207965.3607 (  0.00%) 206622.5181 ( -0.65%) 164690.9435 (-20.81%) 207352.5344 ( -0.29%) 207596.1677 ( -0.18%) 207356.1440 ( -0.29%) 205885.1082 ( -1.00%) 207364.0749 ( -0.29%)
Faults/cpu 24 201603.7131 (  0.00%) 200366.9546 ( -0.61%) 164329.3135 (-18.49%) 201995.6658 (  0.19%) 201208.3329 ( -0.20%) 201058.1035 ( -0.27%) 200970.7206 ( -0.31%) 201088.4438 ( -0.26%)
Faults/cpu 25 192982.6559 (  0.00%) 190032.9728 ( -1.53%) 165277.5793 (-14.36%) 192529.6572 ( -0.23%) 192126.4710 ( -0.44%) 192693.8739 ( -0.15%) 192660.3384 ( -0.17%) 193155.8498 (  0.09%)
Faults/cpu 26 186311.3491 (  0.00%) 184369.8079 ( -1.04%) 164639.6026 (-11.63%) 184378.1722 ( -1.04%) 184081.5062 ( -1.20%) 186415.4759 (  0.06%) 184932.4077 ( -0.74%) 187163.1699 (  0.46%)
Faults/cpu 27 181102.8388 (  0.00%) 179639.8924 ( -0.81%) 148296.2637 (-18.11%) 181244.6370 (  0.08%) 179313.3665 ( -0.99%) 181360.8913 (  0.14%) 180856.6142 ( -0.14%) 181653.5192 (  0.30%)
Faults/cpu 28 175945.1131 (  0.00%) 175424.0244 ( -0.30%) 150059.6742 (-14.71%) 176154.8663 (  0.12%) 176295.5024 (  0.20%) 176521.8006 (  0.33%) 175800.4190 ( -0.08%) 175615.2235 ( -0.19%)
Faults/cpu 29 169967.6343 (  0.00%) 168866.6936 ( -0.65%) 151317.4262 (-10.97%) 169771.0342 ( -0.12%) 169147.7679 ( -0.48%) 167103.7776 ( -1.68%) 169676.5522 ( -0.17%) 170481.0704 (  0.30%)
Faults/cpu 3  374694.3435 (  0.00%) 370320.2762 ( -1.17%) 360488.0454 ( -3.79%) 372186.8749 ( -0.67%) 366227.3210 ( -2.26%) 365202.5855 ( -2.53%) 366384.7088 ( -2.22%) 366173.4018 ( -2.27%)
Faults/cpu 30 164584.3989 (  0.00%) 163602.5225 ( -0.60%) 150945.3476 ( -8.29%) 164561.4904 ( -0.01%) 164276.7060 ( -0.19%) 162630.9288 ( -1.19%) 164498.4388 ( -0.05%) 164931.7620 (  0.21%)
Faults/cpu 31 160285.7571 (  0.00%) 159258.2232 ( -0.64%) 146029.2600 ( -8.89%) 159189.9619 ( -0.68%) 159106.5543 ( -0.74%) 159592.9926 ( -0.43%) 160311.9449 (  0.02%) 159957.6423 ( -0.20%)
Faults/cpu 32 155660.9421 (  0.00%) 155903.5774 (  0.16%) 142990.8439 ( -8.14%) 156425.1204 (  0.49%) 155383.8761 ( -0.18%) 153457.0020 ( -1.42%) 154651.0878 ( -0.65%) 153053.4511 ( -1.68%)
Faults/cpu 33 150131.4250 (  0.00%) 148205.0207 ( -1.28%) 133302.3457 (-11.21%) 148901.5659 ( -0.82%) 149606.0924 ( -0.35%) 150268.8294 (  0.09%) 149823.9355 ( -0.20%) 150523.0778 (  0.26%)
Faults/cpu 34 145610.6963 (  0.00%) 145687.3000 (  0.05%) 136800.0015 ( -6.05%) 144857.3713 ( -0.52%) 145742.6888 (  0.09%) 145700.6362 (  0.06%) 145889.6267 (  0.19%) 144569.4039 ( -0.72%)
Faults/cpu 35 141430.9804 (  0.00%) 140922.1273 ( -0.36%) 130391.6158 ( -7.81%) 141342.0054 ( -0.06%) 141339.5519 ( -0.06%) 140456.5555 ( -0.69%) 141719.6577 (  0.20%) 140756.6821 ( -0.48%)
Faults/cpu 36 138008.0201 (  0.00%) 137585.8607 ( -0.31%) 129745.2949 ( -5.99%) 136505.1727 ( -1.09%) 135117.1746 ( -2.09%) 137327.9664 ( -0.49%) 136222.3458 ( -1.29%) 137303.4438 ( -0.51%)
Faults/cpu 37 132858.3984 (  0.00%) 133274.9207 (  0.31%) 120230.8912 ( -9.50%) 133480.7639 (  0.47%) 133137.9432 (  0.21%) 133190.1657 (  0.25%) 132715.4547 ( -0.11%) 133098.7368 (  0.18%)
Faults/cpu 38 129215.3699 (  0.00%) 129181.6598 ( -0.03%) 121015.4440 ( -6.35%) 129457.7455 (  0.19%) 128772.2298 ( -0.34%) 129008.2496 ( -0.16%) 129241.0413 (  0.02%) 129763.2194 (  0.42%)
Faults/cpu 39 126052.2877 (  0.00%) 126028.8097 ( -0.02%) 122698.7134 ( -2.66%) 125348.3350 ( -0.56%) 125239.3263 ( -0.64%) 125155.4174 ( -0.71%) 126122.8165 (  0.06%) 126236.0479 (  0.15%)
Faults/cpu 4  370240.6003 (  0.00%) 366062.3825 ( -1.13%) 338351.9994 ( -8.61%) 369361.7956 ( -0.24%) 363663.5136 ( -1.78%) 362702.0305 ( -2.04%) 365453.3980 ( -1.29%) 365703.0736 ( -1.23%)
Faults/cpu 40 122435.0743 (  0.00%) 122651.8912 (  0.18%) 122193.1722 ( -0.20%) 123412.4231 (  0.80%) 122927.1480 (  0.40%) 122733.6456 (  0.24%) 121857.1499 ( -0.47%) 122625.6619 (  0.16%)
Faults/cpu 41 119399.1440 (  0.00%) 118978.1414 ( -0.35%) 118572.7506 ( -0.69%) 119004.8027 ( -0.33%) 118774.6690 ( -0.52%) 118295.3548 ( -0.92%) 119164.5404 ( -0.20%) 118799.4351 ( -0.50%)
Faults/cpu 42 115875.2469 (  0.00%) 115784.7633 ( -0.08%) 117239.6976 (  1.18%) 116017.0993 (  0.12%) 115713.0031 ( -0.14%) 115567.8722 ( -0.27%) 115062.3753 ( -0.70%) 115763.2412 ( -0.10%)
Faults/cpu 43 112999.9277 (  0.00%) 111988.1086 ( -0.90%) 111327.6586 ( -1.48%) 113200.3248 (  0.18%) 112383.9303 ( -0.55%) 112818.6976 ( -0.16%) 113141.1904 (  0.13%) 113210.6053 (  0.19%)
Faults/cpu 44 110740.1358 (  0.00%) 109819.0161 ( -0.83%) 113847.0028 (  2.81%) 110740.2330 (  0.00%) 110362.8114 ( -0.34%) 110357.7976 ( -0.35%) 110360.7290 ( -0.34%) 110439.5280 ( -0.27%)
Faults/cpu 45 108055.0128 (  0.00%) 107074.4961 ( -0.91%) 110522.1286 (  2.28%) 108136.1353 (  0.08%) 107516.7357 ( -0.50%) 107489.4668 ( -0.52%) 107458.7411 ( -0.55%) 107539.5220 ( -0.48%)
Faults/cpu 46 105092.0969 (  0.00%) 104611.8746 ( -0.46%) 108951.8847 (  3.67%) 105424.3434 (  0.32%) 104985.6988 ( -0.10%) 104923.7530 ( -0.16%) 105117.4772 (  0.02%) 105350.0949 (  0.25%)
Faults/cpu 47 103113.8932 (  0.00%) 102053.7667 ( -1.03%) 107375.4080 (  4.13%) 102964.4128 ( -0.14%) 102863.3429 ( -0.24%) 102859.6629 ( -0.25%) 102949.6548 ( -0.16%) 103048.4885 ( -0.06%)
Faults/cpu 48 100888.0329 (  0.00%)  99814.7029 ( -1.06%) 106438.5374 (  5.50%) 100824.3418 ( -0.06%) 100889.5606 (  0.00%) 101325.3091 (  0.43%) 100501.1339 ( -0.38%) 100997.9388 (  0.11%)
Faults/cpu 5  358736.2684 (  0.00%) 350166.8442 ( -2.39%) 321329.4860 (-10.43%) 353953.4999 ( -1.33%) 350121.1564 ( -2.40%) 352131.6663 ( -1.84%) 352003.8687 ( -1.88%) 349701.4718 ( -2.52%)
Faults/cpu 6  346831.9903 (  0.00%) 347879.3546 (  0.30%) 309546.5744 (-10.75%) 346268.1822 ( -0.16%) 343589.6859 ( -0.93%) 339778.4001 ( -2.03%) 345688.1163 ( -0.33%) 345496.5812 ( -0.39%)
Faults/cpu 7  344501.0568 (  0.00%) 343488.4476 ( -0.29%) 309529.8566 (-10.15%) 341283.5598 ( -0.93%) 336374.8748 ( -2.36%) 337359.2856 ( -2.07%) 339749.2184 ( -1.38%) 338309.3052 ( -1.80%)
Faults/cpu 8  346174.6199 (  0.00%) 343129.3801 ( -0.88%) 278357.0642 (-19.59%) 342992.8225 ( -0.92%) 344325.4495 ( -0.53%) 345312.7516 ( -0.25%) 344172.0340 ( -0.58%) 342254.9877 ( -1.13%)
Faults/cpu 9  328009.1948 (  0.00%) 328338.6341 (  0.10%) 271264.4886 (-17.30%) 328555.3156 (  0.17%) 323107.2113 ( -1.49%) 327109.9752 ( -0.27%) 324555.4670 ( -1.05%) 325690.7369 ( -0.71%)

Same.

Faults/sec 1  378449.1966 (  0.00%) 366185.0651 ( -3.24%) 390125.0553 (  3.09%) 374336.9521 ( -1.09%) 343747.2006 ( -9.17%) 345658.1953 ( -8.66%) 341940.4609 ( -9.65%) 342823.8216 ( -9.41%)
Faults/sec 103057941.3484 (  0.00%)3086181.0691 (  0.92%)2409975.1283 (-21.19%)3028074.8136 ( -0.98%)3029815.4380 ( -0.92%)3064096.7082 (  0.20%)3003064.6477 ( -1.79%)3033433.7765 ( -0.80%)
Faults/sec 113261713.5772 (  0.00%)3294466.8662 (  1.00%)2469654.8367 (-24.28%)3294208.5261 (  1.00%)3257973.1112 ( -0.11%)3278781.5108 (  0.52%)3312117.8594 (  1.55%)3246393.6600 ( -0.47%)
Faults/sec 123536124.1581 (  0.00%)3797714.3716 (  7.40%)2476800.0595 (-29.96%)3556102.7891 (  0.56%)3608809.1736 (  2.06%)3611977.9089 (  2.15%)3683380.5918 (  4.16%)3523474.7009 ( -0.36%)
Faults/sec 133522134.0988 (  0.00%)3548599.2386 (  0.75%)2446087.8125 (-30.55%)3501014.1288 ( -0.60%)3557311.6279 (  1.00%)3522629.3381 (  0.01%)3593101.6671 (  2.01%)3585947.0037 (  1.81%)
Faults/sec 143741399.7322 (  0.00%)3756052.7614 (  0.39%)2619922.1868 (-29.97%)3727293.7004 ( -0.38%)3756884.1995 (  0.41%)3733097.2019 ( -0.22%)3719147.6690 ( -0.59%)3760976.2567 (  0.52%)
Faults/sec 154049357.6044 (  0.00%)4033305.0846 ( -0.40%)2457803.8113 (-39.30%)4059688.2409 (  0.26%)3935065.7173 ( -2.82%)3940383.4551 ( -2.69%)3928630.3240 ( -2.98%)4021120.7646 ( -0.70%)
Faults/sec 164097157.8975 (  0.00%)4217099.0091 (  2.93%)2455395.0021 (-40.07%)4148897.7305 (  1.26%)4079041.4563 ( -0.44%)4254698.5340 (  3.85%)4101174.5232 (  0.10%)4392298.9242 (  7.20%)
Faults/sec 173950363.6366 (  0.00%)3965738.5936 (  0.39%)2464431.7234 (-37.62%)4000612.2796 (  1.27%)3939263.8259 ( -0.28%)3971590.5182 (  0.54%)3992282.1709 (  1.06%)4021605.0297 (  1.80%)
Faults/sec 184103861.4744 (  0.00%)4134124.3588 (  0.74%)2344019.0093 (-42.88%)4110297.5479 (  0.16%)4128836.6183 (  0.61%)4111127.7293 (  0.18%)4103327.8307 ( -0.01%)4116154.7820 (  0.30%)
Faults/sec 194276053.9277 (  0.00%)4332901.1932 (  1.33%)2497192.6587 (-41.60%)4294323.6430 (  0.43%)4307490.7887 (  0.74%)4301598.1106 (  0.60%)4260088.0090 ( -0.37%)4263646.0497 ( -0.29%)
Faults/sec 2  753370.4894 (  0.00%) 731232.6896 ( -2.94%) 739970.8294 ( -1.78%) 744801.6031 ( -1.14%) 719833.6148 ( -4.45%) 712972.4722 ( -5.36%) 719078.6344 ( -4.55%) 712311.6191 ( -5.45%)
Faults/sec 204516401.2478 (  0.00%)4579569.6777 (  1.40%)2031136.9372 (-55.03%)4494195.4045 ( -0.49%)4346639.2787 ( -3.76%)4534616.2385 (  0.40%)4317538.8462 ( -4.40%)4547820.8464 (  0.70%)
Faults/sec 214087026.2936 (  0.00%)4068731.0651 ( -0.45%)2377079.8174 (-41.84%)4123663.5132 (  0.90%)4127628.7535 (  0.99%)4169241.3553 (  2.01%)4188156.6912 (  2.47%)4118111.1871 (  0.76%)
Faults/sec 224211993.0582 (  0.00%)4204705.8000 ( -0.17%)2591796.8264 (-38.47%)4227135.0022 (  0.36%)4232124.1497 (  0.48%)4164897.9655 ( -1.12%)4266884.4798 (  1.30%)4334746.2025 (  2.91%)
Faults/sec 234387001.3207 (  0.00%)4401482.1147 (  0.33%)2405782.9280 (-45.16%)4367309.2063 ( -0.45%)4385823.7866 ( -0.03%)4337430.0302 ( -1.13%)4262380.6674 ( -2.84%)4377168.7657 ( -0.22%)
Faults/sec 244470740.3575 (  0.00%)4515720.6916 (  1.01%)2418614.6959 (-45.90%)4423814.9355 ( -1.05%)4450908.8746 ( -0.44%)4295205.4302 ( -3.93%)4412036.4296 ( -1.31%)4421135.3125 ( -1.11%)
Faults/sec 253937957.1532 (  0.00%)3809703.8550 ( -3.26%)2439820.5747 (-38.04%)3925622.9027 ( -0.31%)3904169.7898 ( -0.86%)3942084.3654 (  0.10%)4004341.9529 (  1.69%)3988732.9759 (  1.29%)
Faults/sec 264016798.7416 (  0.00%)3934975.7249 ( -2.04%)2606188.8779 (-35.12%)3950491.6949 ( -1.65%)3939682.4112 ( -1.92%)4029254.7256 (  0.31%)4024343.2095 (  0.19%)4109742.7410 (  2.31%)
Faults/sec 274086906.0951 (  0.00%)4097020.1548 (  0.25%)2304217.5641 (-43.62%)4089202.5746 (  0.06%)3992381.3302 ( -2.31%)4094242.0021 (  0.18%)4088343.4903 (  0.04%)4133544.6102 (  1.14%)
Faults/sec 284167197.2625 (  0.00%)4244831.3753 (  1.86%)2437237.9013 (-41.51%)4174417.1522 (  0.17%)4149484.5269 ( -0.43%)4175318.3689 (  0.19%)4150715.1941 ( -0.40%)4195704.1843 (  0.68%)
Faults/sec 294084242.8855 (  0.00%)4133645.1554 (  1.21%)2648559.3047 (-35.15%)4101901.9212 (  0.43%)4034820.5255 ( -1.21%)4052956.8133 ( -0.77%)4113191.3654 (  0.71%)4177020.1760 (  2.27%)
Faults/sec 3 1109918.7564 (  0.00%)1096015.2945 ( -1.25%)1065097.6375 ( -4.04%)1102922.5624 ( -0.63%)1089698.3673 ( -1.82%)1084060.8798 ( -2.33%)1085531.7843 ( -2.20%)1088643.6050 ( -1.92%)
Faults/sec 304151304.2546 (  0.00%)4158133.0937 (  0.16%)2683984.9308 (-35.35%)4137216.5074 ( -0.34%)4114545.5170 ( -0.89%)4103882.9041 ( -1.14%)4127238.4153 ( -0.58%)4162033.7762 (  0.26%)
Faults/sec 314191217.6158 (  0.00%)4243033.9025 (  1.24%)2676235.5259 (-36.15%)4137476.7286 ( -1.28%)4186115.3991 ( -0.12%)4140639.1014 ( -1.21%)4233785.2070 (  1.02%)4151948.3967 ( -0.94%)
Faults/sec 324217316.7870 (  0.00%)4365955.9624 (  3.52%)2759893.2658 (-34.56%)4243468.3822 (  0.62%)4209952.8113 ( -0.17%)4202827.3816 ( -0.34%)4173003.7934 ( -1.05%)4153518.1495 ( -1.51%)
Faults/sec 334194428.3071 (  0.00%)4211766.2074 (  0.41%)2605358.9387 (-37.89%)4167864.3697 ( -0.63%)4126534.7061 ( -1.62%)4219846.7104 (  0.61%)4173198.7504 ( -0.51%)4222243.7872 (  0.66%)
Faults/sec 344162964.6453 (  0.00%)4271808.7841 (  2.61%)2812057.1083 (-32.45%)4130364.6776 ( -0.78%)4265449.5564 (  2.46%)4160577.0467 ( -0.06%)4219222.5480 (  1.35%)4130231.2312 ( -0.79%)
Faults/sec 354161390.4401 (  0.00%)4234213.1345 (  1.75%)2607427.3999 (-37.34%)4161469.3984 (  0.00%)4238638.5058 (  1.86%)4185086.8231 (  0.57%)4233991.6586 (  1.74%)4156311.6986 ( -0.12%)
Faults/sec 364309141.4009 (  0.00%)4344553.7007 (  0.82%)2823543.9475 (-34.48%)4122760.9818 ( -4.33%)4035348.2080 ( -6.35%)4254890.0613 ( -1.26%)4241646.1233 ( -1.57%)4236136.0794 ( -1.69%)
Faults/sec 374122489.8845 (  0.00%)4278165.5642 (  3.78%)2421649.8216 (-41.26%)4239905.9435 (  2.85%)4213085.0811 (  2.20%)4198176.2146 (  1.84%)4160112.1225 (  0.91%)4256401.1564 (  3.25%)
Faults/sec 384163428.6206 (  0.00%)4265362.0071 (  2.45%)2665193.5296 (-35.99%)4194590.2131 (  0.75%)4219610.6125 (  1.35%)4242228.8659 (  1.89%)4214551.3392 (  1.23%)4340591.0193 (  4.26%)
Faults/sec 394226045.5491 (  0.00%)4321204.5745 (  2.25%)2936765.1552 (-30.51%)4222799.9685 ( -0.08%)4203297.8809 ( -0.54%)4208847.4974 ( -0.41%)4269451.3378 (  1.03%)4299557.6689 (  1.74%)
Faults/sec 4 1455428.2533 (  0.00%)1441908.4873 ( -0.93%)1325768.8684 ( -8.91%)1455562.4808 (  0.01%)1432189.8288 ( -1.60%)1425444.8766 ( -2.06%)1436425.1946 ( -1.31%)1441507.8962 ( -0.96%)
Faults/sec 404214077.2062 (  0.00%)4360652.1975 (  3.48%)2888662.5408 (-31.45%)4319445.3297 (  2.50%)4337024.7790 (  2.92%)4272911.1494 (  1.40%)4222006.9619 (  0.19%)4261499.5141 (  1.13%)
Faults/sec 414291578.8817 (  0.00%)4288112.8915 ( -0.08%)3058310.1247 (-28.74%)4302334.8101 (  0.25%)4204185.8980 ( -2.04%)4196357.7441 ( -2.22%)4312545.3593 (  0.49%)4237388.6213 ( -1.26%)
Faults/sec 424293722.5431 (  0.00%)4346426.1052 (  1.23%)2952124.2363 (-31.25%)4264837.4512 ( -0.67%)4219652.2680 ( -1.73%)4157078.8993 ( -3.18%)4185778.6339 ( -2.51%)4267668.8611 ( -0.61%)
Faults/sec 434260488.0795 (  0.00%)4190510.2320 ( -1.64%)2805833.3144 (-34.14%)4319181.6684 (  1.38%)4224080.6393 ( -0.85%)4209214.3757 ( -1.20%)4281123.5734 (  0.48%)4234533.2835 ( -0.61%)
Faults/sec 444341635.8888 (  0.00%)4371324.7434 (  0.68%)3197034.6773 (-26.36%)4325882.5323 ( -0.36%)4358300.5382 (  0.38%)4322866.2609 ( -0.43%)4334350.3160 ( -0.17%)4355499.3787 (  0.32%)
Faults/sec 454306175.0810 (  0.00%)4366968.0190 (  1.41%)3207825.3608 (-25.51%)4395367.0756 (  2.07%)4267770.3357 ( -0.89%)4280666.3010 ( -0.59%)4294599.8207 ( -0.27%)4281532.0883 ( -0.57%)
Faults/sec 464307792.6910 (  0.00%)4315328.0769 (  0.17%)3205375.1650 (-25.59%)4385402.7649 (  1.80%)4251443.9562 ( -1.31%)4241371.4893 ( -1.54%)4366618.7751 (  1.37%)4295960.6074 ( -0.27%)
Faults/sec 474321312.4226 (  0.00%)4341256.5948 (  0.46%)3319058.0014 (-23.19%)4358965.6574 (  0.87%)4365015.3672 (  1.01%)4357240.4439 (  0.83%)4405570.9439 (  1.95%)4386073.9254 (  1.50%)
Faults/sec 484366778.2107 (  0.00%)4322882.0123 ( -1.01%)3273802.9460 (-25.03%)4373380.1336 (  0.15%)4343783.8913 ( -0.53%)4297699.9587 ( -1.58%)4365676.1788 ( -0.03%)4328938.3135 ( -0.87%)
Faults/sec 5 1743122.2118 (  0.00%)1695802.2374 ( -2.71%)1567664.0733 (-10.07%)1713142.7753 ( -1.72%)1697865.9386 ( -2.60%)1701956.0663 ( -2.36%)1706302.3236 ( -2.11%)1675439.2691 ( -3.88%)
Faults/sec 6 2011718.4281 (  0.00%)2035980.9355 (  1.21%)1794156.8192 (-10.81%)2008929.2145 ( -0.14%)2003938.3687 ( -0.39%)1967048.8061 ( -2.22%)2018971.6464 (  0.36%)2018509.6143 (  0.34%)
Faults/sec 7 2324635.7987 (  0.00%)2315685.9962 ( -0.38%)2085519.9592 (-10.29%)2308763.4444 ( -0.68%)2271854.7036 ( -2.27%)2294688.0258 ( -1.29%)2295619.0940 ( -1.25%)2286072.4376 ( -1.66%)
Faults/sec 8 2662426.3046 (  0.00%)2634764.5080 ( -1.04%)2116672.9963 (-20.50%)2620493.5231 ( -1.57%)2651049.1842 ( -0.43%)2673473.8717 (  0.41%)2652192.7971 ( -0.38%)2638043.5422 ( -0.92%)
Faults/sec 9 2769511.8307 (  0.00%)2820315.9462 (  1.83%)2290888.7061 (-17.28%)2781974.0535 (  0.45%)2716619.0152 ( -1.91%)2759963.7524 ( -0.34%)2720367.4176 ( -1.77%)2763007.0284 ( -0.23%)

Same.

I don't know why autonuma has such a major impact here.

MMTests Statistics: duration
               3.7.0       3.7.0       3.7.0       3.7.0       3.7.0       3.7.0       3.7.0       3.7.0
        rc4-stats-v2r34rc4-schednuma-v2r3rc4-autonuma-v28fastrc4-moron-v3r27rc4-twostage-v3r27rc4-lessflush-v3r27rc4-cpuone-v3r27rc4-adaptscan-v3r27
User         1067.83      986.85     1256.40     1077.54     1088.63     1092.13     1082.83     1064.14
System      18678.00    18730.98    22240.00    18708.24    18741.07    18742.99    18797.77    18776.84
Elapsed      1348.03     1355.33     1857.83     1352.56     1376.40     1375.49     1380.79     1375.69

autonuma has high system cpu usage and the elapsed time is high. based
on earlier results this is not a surprise.

Like the other tests this was all driven from mmtests using
configs/config-global-dhp__pagealloc-performance with the pagealloc
test removed.  pagealloc is a page allocator microbenchmark that depends
on systemtap which is broken for 3.7 kernels.

-- 
Mel Gorman
SUSE Labs

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

      parent reply	other threads:[~2012-11-16 14:56 UTC|newest]

Thread overview: 62+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2012-11-16 11:22 [RFC PATCH 00/43] Automatic NUMA Balancing V3 Mel Gorman
2012-11-16 11:22 ` [PATCH 01/43] mm: compaction: Move migration fail/success stats to migrate.c Mel Gorman
2012-11-16 11:22 ` [PATCH 02/43] mm: migrate: Add a tracepoint for migrate_pages Mel Gorman
2012-11-16 11:22 ` [PATCH 03/43] mm: compaction: Add scanned and isolated counters for compaction Mel Gorman
2012-11-16 11:22 ` [PATCH 04/43] mm: numa: define _PAGE_NUMA Mel Gorman
2012-11-16 11:22 ` [PATCH 05/43] mm: numa: pte_numa() and pmd_numa() Mel Gorman
2012-11-16 11:22 ` [PATCH 06/43] mm: numa: Make pte_numa() and pmd_numa() a generic implementation Mel Gorman
2012-11-16 14:09   ` Rik van Riel
2012-11-16 14:41     ` Mel Gorman
2012-11-16 15:32       ` Linus Torvalds
2012-11-16 16:08         ` Ingo Molnar
2012-11-16 16:56           ` Mel Gorman
2012-11-16 17:12             ` Ingo Molnar
2012-11-16 17:48               ` Mel Gorman
2012-11-16 18:04                 ` Ingo Molnar
2012-11-16 18:55                   ` Mel Gorman
2012-11-16 17:26             ` Rik van Riel
2012-11-16 17:37             ` Ingo Molnar
2012-11-16 18:44               ` Mel Gorman
2012-11-16 16:19         ` Mel Gorman
2012-11-16 11:22 ` [PATCH 07/43] mm: numa: Support NUMA hinting page faults from gup/gup_fast Mel Gorman
2012-11-16 14:09   ` Rik van Riel
2012-11-16 11:22 ` [PATCH 08/43] mm: numa: split_huge_page: transfer the NUMA type from the pmd to the pte Mel Gorman
2012-11-16 11:22 ` [PATCH 09/43] mm: numa: Create basic numa page hinting infrastructure Mel Gorman
2012-11-16 11:22 ` [PATCH 10/43] mm: mempolicy: Make MPOL_LOCAL a real policy Mel Gorman
2012-11-16 11:22 ` [PATCH 11/43] mm: mempolicy: Add MPOL_MF_NOOP Mel Gorman
2012-11-16 11:22 ` [PATCH 12/43] mm: mempolicy: Check for misplaced page Mel Gorman
2012-11-16 11:22 ` [PATCH 13/43] mm: migrate: Introduce migrate_misplaced_page() Mel Gorman
2012-11-19 19:44   ` [tip:numa/core] mm/migration: Improve migrate_misplaced_page() tip-bot for Mel Gorman
2012-11-16 11:22 ` [PATCH 14/43] mm: mempolicy: Use _PAGE_NUMA to migrate pages Mel Gorman
2012-11-16 16:08   ` Rik van Riel
2012-11-16 11:22 ` [PATCH 15/43] mm: mempolicy: Add MPOL_MF_LAZY Mel Gorman
2012-11-16 11:22 ` [PATCH 16/43] mm: mempolicy: Hide MPOL_NOOP and MPOL_MF_LAZY from userspace for now Mel Gorman
2012-11-16 16:22   ` Rik van Riel
2012-11-16 11:22 ` [PATCH 17/43] sched, mm, x86: Add the ARCH_SUPPORTS_NUMA_BALANCING flag Mel Gorman
2012-11-16 11:22 ` [PATCH 18/43] mm: numa: Add fault driven placement and migration Mel Gorman
2012-11-16 11:22 ` [PATCH 19/43] mm: numa: Avoid double faulting after migrating misplaced page Mel Gorman
2012-11-16 11:22 ` [PATCH 20/43] mm: sched: numa: Implement constant, per task Working Set Sampling (WSS) rate Mel Gorman
2012-11-16 11:22 ` [PATCH 21/43] sched, numa, mm: Count WS scanning against present PTEs, not virtual memory ranges Mel Gorman
2012-11-16 11:22 ` [PATCH 22/43] mm: sched: numa: Implement slow start for working set sampling Mel Gorman
2012-11-16 11:22 ` [PATCH 23/43] mm: numa: Add pte updates, hinting and migration stats Mel Gorman
2012-11-16 11:22 ` [PATCH 24/43] mm: numa: Migrate on reference policy Mel Gorman
2012-11-16 11:22 ` [PATCH 25/43] mm: numa: Migrate pages handled during a pmd_numa hinting fault Mel Gorman
2012-11-16 11:22 ` [PATCH 26/43] mm: numa: Only mark a PMD pmd_numa if the pages are all on the same node Mel Gorman
2012-11-16 11:22 ` [PATCH 27/43] mm: numa: Structures for Migrate On Fault per NUMA migration rate limiting Mel Gorman
2012-11-16 11:22 ` [PATCH 28/43] mm: numa: Rate limit the amount of memory that is migrated between nodes Mel Gorman
2012-11-16 11:22 ` [PATCH 29/43] mm: numa: Rate limit setting of pte_numa if node is saturated Mel Gorman
2012-11-16 11:22 ` [PATCH 30/43] sched: numa: Slowly increase the scanning period as NUMA faults are handled Mel Gorman
2012-11-16 11:22 ` [PATCH 31/43] mm: numa: Introduce last_nid to the page frame Mel Gorman
2012-11-16 11:22 ` [PATCH 32/43] mm: numa: Use a two-stage filter to restrict pages being migrated for unlikely task<->node relationships Mel Gorman
2012-11-16 11:22 ` [PATCH 33/43] x86: mm: only do a local tlb flush in ptep_set_access_flags() Mel Gorman
2012-11-16 11:22 ` [PATCH 34/43] x86: mm: drop TLB flush from ptep_set_access_flags Mel Gorman
2012-11-16 11:22 ` [PATCH 35/43] mm,generic: only flush the local TLB in ptep_set_access_flags Mel Gorman
2012-11-16 11:22 ` [PATCH 36/43] sched: numa: Introduce tsk_home_node() Mel Gorman
2012-11-16 11:22 ` [PATCH 37/43] sched: numa: Make find_busiest_queue() a method Mel Gorman
2012-11-16 11:22 ` [PATCH 38/43] sched: numa: Implement home-node awareness Mel Gorman
2012-11-16 11:22 ` [PATCH 39/43] sched: numa: Introduce per-mm and per-task structures Mel Gorman
2012-11-16 11:22 ` [PATCH 40/43] sched: numa: CPU follows memory Mel Gorman
2012-11-16 11:22 ` [PATCH 41/43] sched: numa: Rename mempolicy to HOME Mel Gorman
2012-11-16 11:22 ` [PATCH 42/43] sched: numa: Consider only one CPU per node for CPU-follows-memory Mel Gorman
2012-11-16 11:22 ` [PATCH 43/43] sched: numa: Increase and decrease a tasks scanning period based on task fault statistics Mel Gorman
2012-11-16 14:56 ` Mel Gorman [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20121116145628.GB8218@suse.de \
    --to=mgorman@suse.de \
    --cc=a.p.zijlstra@chello.nl \
    --cc=aarcange@redhat.com \
    --cc=akpm@linux-foundation.org \
    --cc=hannes@cmpxchg.org \
    --cc=hughd@google.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mingo@kernel.org \
    --cc=riel@redhat.com \
    --cc=tglx@linutronix.de \
    --cc=torvalds@linux-foundation.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).