From: "Paul E. McKenney" <paulmck@linux.vnet.ibm.com>
To: Mike Galbraith <umgwanakikbuti@gmail.com>
Cc: Paul Gortmaker <paul.gortmaker@windriver.com>,
linux-kernel@vger.kernel.org, linux-rt-users@vger.kernel.org,
Ingo Molnar <mingo@redhat.com>,
Peter Zijlstra <peterz@infradead.org>,
Steven Rostedt <rostedt@goodmis.org>,
Thomas Gleixner <tglx@linutronix.de>
Subject: Re: [PATCH] sched/rt: don't try to balance rt_runtime when it is futile
Date: Sat, 17 May 2014 22:20:39 -0700 [thread overview]
Message-ID: <20140518052039.GF4570@linux.vnet.ibm.com> (raw)
In-Reply-To: <1400386954.5140.36.camel@marge.simpson.net>
On Sun, May 18, 2014 at 06:22:34AM +0200, Mike Galbraith wrote:
> On Thu, 2014-05-15 at 05:18 +0200, Mike Galbraith wrote:
> > On Wed, 2014-05-14 at 08:44 -0700, Paul E. McKenney wrote:
> >
> > > In practice, not sure how much testing CONFIG_NO_HZ_FULL=y has received
> > > for -rt kernels in production environments.
> >
> > I took 3.14-rt out for a quick spin on my 64 core box, it didn't work at
> > all with 60 cores isolated. I didn't have time to rummage, but it looks
> > like there are still bugs to squash.
>
> I tested a bit more yesterday. With only NO_HZ_FULL (no all), it did go
> tickless. A 10 second sample of perturbation numbers below. Pretty
> noisy, but it does work in rt.
>
> Below that, some jitter numbers, using a simplified and imperfect model
> of a high end rt video game (game over, insert 1 gold bar to continue
> variety of high end) executive synchronizing a simple load on 60 cores.
> Bottom line there was if user thinks booting nohz_full=set to get any
> core quiescence provided by that should improve jitter for a threaded
> load despite not being able to shut tick down, he's wrong.
If you are saying that turning on nohz_full doesn't help unless you
also ensure that there is only one runnable task per CPU, I completely
agree. If you are saying something else, you lost me. ;-)
Thanx, Paul
> -Mike
>
> vogelweide:/abuild/mike/:[0]# head -180 xx|tail -60
> pert/s: 500 >14.10us: 2 min: 1.90 max: 96.86 avg: 5.17 sum/s: 2586us overhead: 0.26%
> pert/s: 1 >18.63us: 0 min: 3.38 max: 8.37 avg: 4.71 sum/s: 5us overhead: 0.00%
> pert/s: 1 >18.54us: 0 min: 3.41 max: 8.51 avg: 4.61 sum/s: 5us overhead: 0.00%
> pert/s: 1 >18.78us: 0 min: 3.45 max: 8.67 avg: 4.41 sum/s: 4us overhead: 0.00%
> pert/s: 1 >19.60us: 0 min: 2.68 max: 7.47 avg: 4.30 sum/s: 4us overhead: 0.00%
> pert/s: 1 >20.61us: 0 min: 2.60 max: 7.54 avg: 3.94 sum/s: 4us overhead: 0.00%
> pert/s: 1 >21.03us: 0 min: 2.70 max: 7.81 avg: 3.91 sum/s: 4us overhead: 0.00%
> pert/s: 1 >19.89us: 0 min: 2.65 max: 7.83 avg: 3.98 sum/s: 4us overhead: 0.00%
> pert/s: 1 >29.36us: 0 min: 3.78 max: 9.82 avg: 6.10 sum/s: 6us overhead: 0.00%
> pert/s: 1 >28.86us: 0 min: 4.56 max: 10.12 avg: 6.36 sum/s: 6us overhead: 0.00%
> pert/s: 1 >21.34us: 0 min: 2.54 max: 7.79 avg: 3.38 sum/s: 3us overhead: 0.00%
> pert/s: 1 >30.12us: 0 min: 3.51 max: 8.41 avg: 4.47 sum/s: 4us overhead: 0.00%
> pert/s: 1 >21.01us: 0 min: 2.44 max: 7.36 avg: 3.33 sum/s: 3us overhead: 0.00%
> pert/s: 1 >22.41us: 0 min: 2.42 max: 7.71 avg: 3.60 sum/s: 4us overhead: 0.00%
> pert/s: 1 >30.37us: 0 min: 3.46 max: 8.62 avg: 4.49 sum/s: 4us overhead: 0.00%
> pert/s: 1 >29.50us: 0 min: 3.43 max: 9.23 avg: 4.13 sum/s: 4us overhead: 0.00%
> pert/s: 1 >20.66us: 0 min: 2.49 max: 7.73 avg: 4.24 sum/s: 4us overhead: 0.00%
> pert/s: 1 >33.87us: 0 min: 4.45 max: 9.59 avg: 5.63 sum/s: 6us overhead: 0.00%
> pert/s: 1 >34.70us: 0 min: 4.47 max: 10.15 avg: 6.41 sum/s: 6us overhead: 0.00%
> pert/s: 1 >29.62us: 0 min: 4.49 max: 9.87 avg: 5.69 sum/s: 6us overhead: 0.00%
> pert/s: 1 >36.92us: 0 min: 3.53 max: 9.41 avg: 4.48 sum/s: 4us overhead: 0.00%
> pert/s: 1 >35.31us: 0 min: 3.69 max: 9.00 avg: 5.30 sum/s: 5us overhead: 0.00%
> pert/s: 1 >36.29us: 0 min: 3.34 max: 8.48 avg: 4.48 sum/s: 4us overhead: 0.00%
> pert/s: 1 >34.90us: 0 min: 3.39 max: 9.21 avg: 4.45 sum/s: 4us overhead: 0.00%
> pert/s: 1 >34.23us: 0 min: 3.37 max: 8.44 avg: 4.54 sum/s: 5us overhead: 0.00%
> pert/s: 1 >34.45us: 0 min: 0.05 max: 9.41 avg: 4.40 sum/s: 5us overhead: 0.00%
> pert/s: 1 >35.31us: 0 min: 3.89 max: 9.18 avg: 4.30 sum/s: 5us overhead: 0.00%
> pert/s: 1 >35.98us: 0 min: 2.80 max: 9.28 avg: 4.74 sum/s: 5us overhead: 0.00%
> pert/s: 1 >33.89us: 0 min: 3.15 max: 9.67 avg: 5.07 sum/s: 5us overhead: 0.00%
> pert/s: 1 >35.16us: 0 min: 2.56 max: 9.40 avg: 4.84 sum/s: 5us overhead: 0.00%
> pert/s: 1 >36.37us: 0 min: 4.49 max: 9.48 avg: 6.12 sum/s: 6us overhead: 0.00%
> pert/s: 1 >38.10us: 0 min: 0.04 max: 34.86 avg: 6.62 sum/s: 13us overhead: 0.00%
> pert/s: 1 >35.11us: 0 min: 5.05 max: 11.56 avg: 5.88 sum/s: 6us overhead: 0.00%
> pert/s: 1 >36.88us: 0 min: 3.77 max: 12.37 avg: 6.13 sum/s: 6us overhead: 0.00%
> pert/s: 1 >34.37us: 1 min: 2.08 max:199.64 avg: 20.67 sum/s: 25us overhead: 0.00%
> pert/s: 1 >35.57us: 1 min: 2.11 max:198.61 avg: 19.17 sum/s: 25us overhead: 0.00%
> pert/s: 1 >33.89us: 1 min: 2.46 max:199.49 avg: 19.85 sum/s: 26us overhead: 0.00%
> pert/s: 1 >37.58us: 1 min: 2.34 max:199.79 avg: 19.59 sum/s: 25us overhead: 0.00%
> pert/s: 1 >34.57us: 0 min: 3.43 max: 13.37 avg: 5.86 sum/s: 6us overhead: 0.00%
> pert/s: 1 >21.10us: 1 min: 2.42 max:199.97 avg: 20.08 sum/s: 26us overhead: 0.00%
> pert/s: 1 >20.86us: 1 min: 2.23 max:194.83 avg: 19.69 sum/s: 26us overhead: 0.00%
> pert/s: 1 >22.47us: 1 min: 2.15 max:197.13 avg: 19.61 sum/s: 25us overhead: 0.00%
> pert/s: 1 >21.42us: 1 min: 2.24 max:198.75 avg: 19.70 sum/s: 26us overhead: 0.00%
> pert/s: 1 >34.85us: 0 min: 0.05 max: 10.83 avg: 3.80 sum/s: 5us overhead: 0.00%
> pert/s: 1 >33.72us: 0 min: 4.34 max: 11.78 avg: 6.04 sum/s: 6us overhead: 0.00%
> pert/s: 1 >21.49us: 2 min: 2.13 max:200.35 avg: 20.22 sum/s: 26us overhead: 0.00%
> pert/s: 1 >22.52us: 2 min: 2.32 max:197.07 avg: 21.02 sum/s: 27us overhead: 0.00%
> pert/s: 1 >22.35us: 2 min: 2.16 max:197.04 avg: 20.59 sum/s: 27us overhead: 0.00%
> pert/s: 1 >35.38us: 0 min: 3.20 max: 10.42 avg: 4.56 sum/s: 5us overhead: 0.00%
> pert/s: 306 >17.41us: 1 min: 1.31 max: 51.95 avg: 6.83 sum/s: 2091us overhead: 0.21%
> pert/s: 1 >99.81us: 1 min: 2.11 max:196.91 avg: 20.61 sum/s: 27us overhead: 0.00%
> pert/s: 1 >21.45us: 2 min: 2.31 max:196.62 avg: 20.49 sum/s: 27us overhead: 0.00%
> pert/s: 1 >97.14us: 1 min: 2.22 max:195.97 avg: 21.29 sum/s: 28us overhead: 0.00%
> pert/s: 1 >21.94us: 2 min: 2.25 max:199.98 avg: 20.14 sum/s: 26us overhead: 0.00%
> pert/s: 206 >75.07us: 1 min: 1.60 max:116.17 avg: 5.83 sum/s: 1202us overhead: 0.12%
> pert/s: 1 >96.39us: 1 min: 2.26 max:194.60 avg: 21.29 sum/s: 28us overhead: 0.00%
> pert/s: 1 >94.72us: 1 min: 2.20 max:193.63 avg: 21.32 sum/s: 28us overhead: 0.00%
> pert/s: 1 >97.23us: 1 min: 2.08 max:198.18 avg: 21.27 sum/s: 28us overhead: 0.00%
> pert/s: 1 >88.44us: 0 min: 2.28 max: 11.33 avg: 7.05 sum/s: 8us overhead: 0.00%
> pert/s: 1 >89.22us: 0 min: 3.59 max: 15.86 avg: 7.81 sum/s: 8us overhead: 0.00%
>
> model is not picky, calls frame jitter >30us a 'Flier', counts them, tags a few.
>
> 3.14.4-rt5 virgin source nohz_full=4-63
>
> FREQ=960 FRAMES=1728000 LOOP=50000 using CPUs 4 - 23
> FREQ=1000 FRAMES=1800000 LOOP=48000 using CPUs 24 - 43
> FREQ=300 FRAMES=540000 LOOP=160000 using CPUs 44 - 63
> on your marks... get set... POW!
> Cpu Frames Min Max(Frame) Avg Sigma LastTrans Fliers(Frames)
> 4 1727998 0.0159 184.04 (1170916)0.7079 0.7321 0 (0) 16 (955515,955516,986596,986597,1017316,..1561069)
> 5 1727998 0.0159 186.94 (1171397)0.4114 0.6508 0 (0) 16 (956356,956357,987076,987077,1017796,..1171397)
> 6 1727999 0.0159 36.73 (595340) 0.8620 0.8818 0 (0) 11 (86411,86412,91211,91212,96011,..1209942)
> 7 1727999 0.0159 189.53 (1141636)0.4791 0.6720 0 (0) 17 (895876,926596,926597,957316,957317,..1141637)
> 8 1728000 0.0159 184.07 (988517) 0.3885 0.6788 0 (0) 16 (773476,773477,804196,804197,834916,..988517)
> 9 1728000 0.0159 180.74 (1050437)0.3514 0.6649 0 (0) 16 (835396,835397,866116,866117,896836,..1050437)
> 10 1728000 0.0159 188.84 (1020197)0.4211 0.6945 0 (0) 16 (805156,805157,835876,835877,866596,..1020197)
> 11 1728000 0.0159 180.98 (959237) 0.3867 0.6802 0 (0) 16 (744196,744197,774916,774917,805636,..959237)
> 12 1728000 0.0159 176.41 (898276) 0.6384 0.6972 0 (0) 16 (683236,683237,713956,713957,744676,..898277)
> 13 1728000 0.0159 188.84 (837317) 0.7538 0.8263 0 (0) 16 (622276,622277,652996,652997,683716,..837317)
> 14 1728000 0.0159 178.83 (1022117)0.5803 0.6995 0 (0) 16 (807076,807077,837796,837797,868516,..1022117)
> 15 1728000 0.0159 187.17 (838277) 0.7163 0.8367 0 (0) 16 (623236,623237,653956,653957,684676,..838277)
> 16 1728000 0.0159 184.31 (992357) 0.6860 0.9137 0 (0) 16 (777316,777317,808036,808037,838756,..992357)
> 17 1728000 0.0159 190.75 (962117) 0.6607 0.9281 0 (0) 17 (716356,747076,747077,777796,777797,..962117)
> 18 1728000 0.0159 186.46 (870437) 0.6505 0.9303 0 (0) 16 (655396,655397,686116,686117,716836,..870437)
> 19 1728000 0.0159 187.62 (901636) 0.8962 0.9769 0 (0) 16 (686596,686597,717316,717317,748036,..901637)
> 20 1728000 0.0159 187.89 (748517) 1.0297 1.0907 0 (0) 16 (533476,533477,564196,564197,594916,..748517)
> 21 1728000 0.0159 177.84 (779716) 0.9255 1.0430 0 (0) 16 (564676,564677,595396,595397,626116,..779717)
> 22 1728000 0.0159 192.42 (780197) 0.6549 0.9060 0 (0) 18 (534436,534437,565156,565157,595876,..780197)
> 23 1728000 0.0159 179.99 (719236) 0.8476 1.0329 0 (0) 16 (504196,504197,534916,534917,565636,..719237)
> 24 1800000 0.0725 8.75 (1545420) 0.8685 0.6879 0 (0)
> 25 1800000 0.0725 20.19 (1550204) 0.8268 0.7200 0 (0)
> 26 1800000 0.0725 34.02 (14704) 0.6771 0.7340 0 (0) 104 (14704,14705,46704,46705,78704,..1774705)
> 27 1800000 0.0725 48.47 (1519205) 0.6290 0.6766 0 (0) 112 (15204,15205,47204,47205,79204,..1775205)
> 28 1800000 0.0725 65.64 (1711705) 0.6870 0.7524 0 (0) 112 (15704,15705,47704,47705,79704,..1775705)
> 29 1800000 0.0725 108.41 (1616204)0.4684 0.9344 0 (0) 112 (16204,16205,48204,48205,80204,..1776205)
> 30 1800000 0.0725 108.17 (1680704)0.8166 1.0311 0 (0) 112 (16704,16705,48704,48705,80704,..1776705)
> 31 1800000 0.0725 123.81 (49205) 0.6050 1.1110 0 (0) 112 (17204,17205,49204,49205,81204,..1777205)
> 32 1800000 0.0725 113.42 (17704) 0.6158 0.9614 0 (0) 112 (17704,17705,49704,49705,81704,..1777705)
> 33 1800000 0.0725 184.94 (1458204)1.0111 1.7618 0 (0) 112 (18204,18205,50204,50205,82204,..1778205)
> 34 1800000 0.0725 194.72 (1490704)1.1291 1.7317 0 (0) 98 (18704,18705,50704,50705,82704,..1778705)
> 35 1800000 0.0725 185.56 (339205) 0.5819 1.5599 0 (0) 112 (19204,19205,51204,51205,83204,..1779205)
> 36 1800000 0.0725 30.45 (227051) 0.9345 1.0711 0 (0) 1 (227051)
> 37 1800000 0.0725 184.61 (1780205)0.7439 1.5621 0 (0) 112 (20204,20205,52204,52205,84204,..1780205)
> 38 1800000 0.0725 28.30 (329851) 0.9923 0.8368 0 (0)
> 39 1800000 0.0725 26.15 (183951) 0.9777 0.8443 0 (0)
> 40 1800000 0.0725 6.75 (1136462) 0.9447 0.7415 0 (0)
> 41 1800000 0.0725 6.03 (1128961) 0.8416 0.6431 0 (0)
> 42 1800000 0.0725 6.51 (1557012) 0.8961 0.6698 0 (0)
> 43 1800000 0.0725 7.08 (1294060) 0.7015 0.6162 0 (0)
> 44 540000 0.0032 9.30 (470245) 0.7457 0.5968 0 (0)
> 45 540000 0.0032 17.88 (55184) 0.6024 0.9190 0 (0)
> 46 540000 0.0032 104.43 (535411) 1.0158 1.0948 0 (0) 50 (305010,305011,314610,314611,324210,..535411)
> 47 540000 0.0032 17.16 (261898) 0.8780 1.0232 0 (0)
> 48 540000 0.0032 17.65 (132511) 0.5251 0.4697 0 (0)
> 49 540000 0.0032 166.41 (535860) 0.4444 1.4015 0 (0) 84 (142260,142261,151860,151861,161460,..535861)
> 50 540000 0.0032 86.30 (132810) 0.6620 0.6966 0 (0) 14 (46410,46411,56010,56011,84810,..132811)
> 51 540000 0.0032 193.36 (372961) 0.7880 1.6782 0 (0) 62 (8160,8161,17760,17761,27360,..372961)
> 52 540000 0.0032 113.96 (133110) 0.5096 0.7058 0 (0) 14 (46710,46711,56310,56311,85110,..133111)
> 53 540000 0.0032 191.69 (325261) 0.9986 1.6550 0 (0) 54 (8460,8461,18060,18061,27660,..325261)
> 54 540000 0.0032 123.74 (133411) 0.5987 0.7777 0 (0) 14 (47010,47011,56610,56611,85410,..133411)
> 55 540000 0.0032 193.60 (287161) 0.6729 1.5368 0 (0) 46 (8760,8761,18360,18361,27960,..287161)
> 56 540000 0.0032 194.79 (133711) 0.8196 1.3677 0 (0) 12 (47310,47311,56910,56911,85710,..133711)
> 57 540000 0.0032 19.08 (410169) 0.7227 1.1486 0 (0)
> 58 540000 0.0032 192.16 (38010) 0.7522 1.3604 0 (0) 8 (9210,9211,18810,18811,28410,..38011)
> 59 540000 0.0032 18.12 (360437) 0.8875 1.1737 0 (0)
> 60 540000 0.0032 23.84 (316830) 1.0781 1.2241 0 (0)
> 61 540000 0.0032 27.90 (316815) 1.1200 1.2471 0 (0)
> 62 540000 0.0032 22.18 (316830) 0.9777 1.0933 0 (0)
> 63 540000 0.0032 26.94 (317310) 1.1227 1.2478 0 (0)
>
> Reference: 3.12.18-rt25-0.gf8a6df6-rt, nohz_idle, cpuset switches tick ON for rt set
>
> FREQ=960 FRAMES=1728000 LOOP=50000 using CPUs 4 - 23
> FREQ=1000 FRAMES=1800000 LOOP=48000 using CPUs 24 - 43
> FREQ=300 FRAMES=540000 LOOP=160000 using CPUs 44 - 63
> on your marks... get set... POW!
> Cpu Frames Min Max(Frame) Avg Sigma LastTrans Fliers(Frames)
> 4 1727993 0.0159 4.07 (2599) 0.1072 0.1890 0 (0)
> 5 1727993 0.0159 4.55 (807476) 0.0954 0.1669 0 (0)
> 6 1727993 0.0159 3.80 (38023) 0.1321 0.2110 0 (0)
> 7 1727994 0.0159 3.35 (1724219) 0.0898 0.1628 0 (0)
> 8 1727994 0.0159 3.80 (109400) 0.0957 0.1852 0 (0)
> 9 1727994 0.0159 3.83 (710923) 0.1001 0.1779 0 (0)
> 10 1727994 0.0159 3.35 (529312) 0.1009 0.1741 0 (0)
> 11 1727995 0.0159 3.83 (1372590) 0.0935 0.1740 0 (0)
> 12 1727995 0.0159 3.83 (51129) 0.0857 0.1724 0 (0)
> 13 1727995 0.0159 3.83 (1273109) 0.1028 0.1852 0 (0)
> 14 1727996 0.0159 3.59 (486904) 0.1005 0.1811 0 (0)
> 15 1727996 0.0159 3.35 (691340) 0.1589 0.1899 0 (0)
> 16 1727996 0.0159 4.07 (1638706) 0.1340 0.2526 0 (0)
> 17 1727997 0.0159 4.55 (913535) 0.1110 0.2050 0 (0)
> 18 1727997 0.0159 4.31 (1704012) 0.1193 0.2129 0 (0)
> 19 1727997 0.0159 5.23 (1273925) 0.1434 0.2372 0 (0)
> 20 1727997 0.0159 5.26 (16547) 0.1119 0.2259 0 (0)
> 21 1727998 0.0159 5.71 (341896) 0.1893 0.2458 0 (0)
> 22 1727998 0.0159 4.55 (1276554) 0.1005 0.1961 0 (0)
> 23 1727998 0.0159 5.71 (1029507) 0.2141 0.2460 0 (0)
> 24 1799998 0.0725 3.98 (1551231) 0.1059 0.0518 0 (0)
> 25 1799998 0.0725 2.79 (272233) 0.1192 0.0866 0 (0)
> 26 1799998 0.0725 3.03 (272233) 0.1817 0.1317 0 (0)
> 27 1799999 0.0725 3.03 (272233) 0.1426 0.1009 0 (0)
> 28 1799999 0.0725 2.79 (402235) 0.2632 0.2574 0 (0)
> 29 1799999 0.0725 2.46 (387055) 0.1109 0.0709 0 (0)
> 30 1799999 0.0725 3.03 (387054) 0.1301 0.0860 0 (0)
> 31 1800000 0.0725 4.60 (1329743) 0.3274 0.2551 0 (0)
> 32 1800000 0.0725 2.93 (867055) 0.1076 0.0535 0 (0)
> 33 1800000 0.0725 2.93 (867055) 0.1049 0.0524 0 (0)
> 34 1800000 0.0725 3.50 (1347054) 0.1132 0.0740 0 (0)
> 35 1800000 0.0725 3.27 (867054) 0.1076 0.0857 0 (0)
> 36 1800000 0.0725 3.27 (867054) 0.2015 0.1381 0 (0)
> 37 1800000 0.0725 3.74 (1347054) 0.1020 0.0461 0 (0)
> 38 1800000 0.0725 3.17 (867055) 0.1118 0.0752 0 (0)
> 39 1800000 0.0725 2.93 (1347055) 0.1092 0.0624 0 (0)
> 40 1800000 0.0725 2.55 (867054) 0.1126 0.0703 0 (0)
> 41 1800000 0.0725 2.93 (867055) 0.1092 0.0560 0 (0)
> 42 1800000 0.0725 3.65 (387055) 0.2079 0.1424 0 (0)
> 43 1800000 0.0725 6.51 (905345) 0.3940 0.3751 0 (0)
> 44 539999 0.0032 3.10 (260115) 0.3366 0.2650 0 (0)
> 45 539999 0.0032 2.62 (116115) 0.3365 0.2648 0 (0)
> 46 539999 0.0032 4.53 (17248) 0.0854 0.2177 0 (0)
> 47 539999 0.0032 4.06 (142) 0.0767 0.1120 0 (0)
> 48 539999 0.0032 3.10 (260116) 0.0604 0.1029 0 (0)
> 49 539999 0.0032 3.10 (404115) 0.0901 0.1160 0 (0)
> 50 539999 0.0032 3.10 (404116) 0.1026 0.1449 0 (0)
> 51 539999 0.0032 2.86 (260116) 0.1019 0.1571 0 (0)
> 52 539999 0.0032 3.10 (116115) 0.0776 0.1190 0 (0)
> 53 539999 0.0032 3.10 (260115) 0.0719 0.1121 0 (0)
> 54 539999 0.0032 3.10 (260115) 0.3323 0.2669 0 (0)
> 55 539999 0.0032 3.10 (260115) 0.3534 0.2873 0 (0)
> 56 539999 0.0032 4.53 (422169) 0.1143 0.2653 0 (0)
> 57 539999 0.0032 3.10 (260116) 0.1021 0.2007 0 (0)
> 58 539999 0.0032 3.10 (116116) 0.0996 0.2120 0 (0)
> 59 539999 0.0032 2.86 (116116) 0.0989 0.2017 0 (0)
> 60 539999 0.0032 2.86 (116115) 0.3619 0.2676 0 (0)
> 61 539999 0.0032 2.86 (116115) 0.3453 0.2593 0 (0)
> 62 539999 0.0032 2.86 (116116) 0.1029 0.2016 0 (0)
> 63 539999 0.0032 3.10 (116116) 0.0858 0.1893 0 (0)
>
> 3.14.4-rt5 + patches (hacks from reference) nohz_cpus=4-63
>
> FREQ=960 FRAMES=1728000 LOOP=50000 using CPUs 4 - 23
> FREQ=1000 FRAMES=1800000 LOOP=48000 using CPUs 24 - 43
> FREQ=300 FRAMES=540000 LOOP=160000 using CPUs 44 - 63
> on your marks... get set... POW!
> Cpu Frames Min Max(Frame) Avg Sigma LastTrans Fliers(Frames)
> 4 1728000 0.0159 10.98 (1625029) 0.4708 0.6897 0 (0)
> 5 1728000 0.0159 11.94 (1612693) 0.6770 0.8055 0 (0)
> 6 1728000 0.0159 11.90 (1544891) 0.6773 0.6996 0 (0)
> 7 1728000 0.0159 13.10 (1357976) 0.5167 0.6947 0 (0)
> 8 1728000 0.0159 21.71 (1331577) 0.5297 0.8358 0 (0)
> 9 1728000 0.0159 21.68 (1331576) 0.6269 0.7978 0 (0)
> 10 1728000 0.0159 19.53 (889433) 0.8569 0.8690 0 (0)
> 11 1728000 0.0159 29.82 (1508316) 0.5446 0.7971 0 (0)
> 12 1728000 0.0159 24.81 (1502988) 0.5601 0.8393 0 (0)
> 13 1728000 0.0159 21.71 (1476396) 0.7357 0.8276 0 (0)
> 14 1728000 0.0159 12.86 (1178839) 0.5667 0.8542 0 (0)
> 15 1728000 0.0159 11.90 (1671304) 0.6289 0.6630 0 (0)
> 16 1728000 0.0159 23.35 (1493387) 0.7169 1.1261 0 (0)
> 17 1728000 0.0159 17.87 (1463627) 0.9685 1.3873 0 (0)
> 18 1728000 0.0159 16.91 (826801) 0.7671 1.0588 0 (0)
> 19 1728000 0.0159 19.06 (1238264) 0.6330 0.9972 0 (0)
> 20 1728000 0.0159 37.18 (270001) 1.3230 1.9480 0 (0) 15 (266593,266594,268369,268370,270001,..876386)
> 21 1728000 0.0159 40.52 (270769) 1.3299 1.6877 0 (0) 14 (266593,266594,268369,268370,270001,..876386)
> 22 1728000 0.0159 28.86 (273746) 1.3284 2.2402 0 (0)
> 23 1728000 0.0159 39.35 (270770) 1.2386 1.6255 0 (0) 13 (266593,266594,268369,268370,270001,..273746)
> 24 1800000 0.0725 36.41 (282051) 1.3319 1.7074 0 (0) 9 (279551,279552,281251,281252,282051,..285152)
> 25 1800000 0.0725 40.60 (281252) 1.5767 1.8895 0 (0) 14 (277701,277702,279551,279552,281251,..285152)
> 26 1800000 0.0725 44.42 (281252) 1.4205 1.7594 0 (0) 16 (277701,277702,279551,279552,281251,..926361)
> 27 1800000 0.0725 42.27 (281252) 1.3342 1.7801 0 (0) 14 (277701,277702,279551,279552,281251,..285152)
> 28 1800000 0.0725 43.08 (281251) 0.8064 1.2355 0 (0) 16 (277701,277702,279551,279552,281251,..290202)
> 29 1800000 0.0725 44.18 (281252) 0.9319 1.0451 0 (0) 14 (277701,277702,279551,279552,281251,..285152)
> 30 1800000 0.0725 41.56 (279552) 1.5054 1.7734 0 (0) 19 (277701,277702,279551,279552,281251,..1379844)
> 31 1800000 0.0725 43.23 (285152) 0.8076 0.9825 0 (0) 14 (277701,277702,279551,279552,281251,..285152)
> 32 1800000 0.0725 64.21 (281252) 0.8604 1.6229 0 (0) 56 (277701,277702,279551,279552,281251,..420022)
> 33 1800000 0.0725 70.88 (281252) 0.8443 1.7623 0 (0) 843 (252701,264451,264452,269802,276752,..426672)
> 34 1800000 0.0725 74.46 (281252) 0.8727 1.8996 0 (0) 1741 (281251,281252,282051,282052,283601,..445622)
> 35 1800000 0.0725 50.14 (412212) 0.8905 2.0577 0 (0) 2716 (368532,369931,369932,372562,372581,..457072)
> 36 1800000 0.0725 31.16 (466021) 0.8785 0.8549 0 (0) 2 (466021,466022)
> 37 1800000 0.0725 44.75 (415861) 0.7989 1.3541 0 (0) 323 (408731,408732,411281,413861,413862,..490232)
> 38 1800000 0.0725 47.37 (411811) 0.9474 2.0748 0 (0) 2936 (400292,400371,400372,400771,400772,..495282)
> 39 1800000 0.0725 27.97 (466872) 0.8778 0.7751 0 (0)
> 40 1800000 0.0725 7.56 (152518) 0.6923 0.6879 0 (0)
> 41 1800000 0.0725 7.32 (146921) 0.6207 0.6168 0 (0)
> 42 1800000 0.0725 6.99 (1756819) 0.6773 0.6053 0 (0)
> 43 1800000 0.0725 6.27 (1275231) 0.8971 0.7166 0 (0)
> 44 540000 0.0032 22.18 (416117) 1.2127 1.3930 0 (0)
> 45 540000 0.0032 34.34 (124668) 1.3483 2.0767 0 (0) 5 (83864,84374,85574,124667,124668)
> 46 540000 0.0032 32.43 (123279) 1.2910 2.1807 0 (0) 7 (123278,123279,123353,123354,124928,..124953)
> 47 540000 0.0032 30.04 (83864) 1.2735 1.9704 0 (0) 1 (83864)
> 48 540000 0.0032 7.63 (233683) 0.8320 0.7331 0 (0)
> 49 540000 0.0032 5.73 (204097) 0.6421 0.5255 0 (0)
> 50 540000 0.0032 6.44 (72596) 0.5834 0.5951 0 (0)
> 51 540000 0.0032 6.67 (468680) 0.5008 0.5379 0 (0)
> 52 540000 0.0032 7.63 (394623) 0.6245 0.5303 0 (0)
> 53 540000 0.0032 5.96 (456858) 0.4830 0.4921 0 (0)
> 54 540000 0.0032 5.73 (361510) 0.7487 0.5892 0 (0)
> 55 540000 0.0032 5.96 (108106) 0.5493 0.5178 0 (0)
> 56 540000 0.0032 20.98 (539973) 1.1312 0.9690 0 (0)
> 57 540000 0.0032 7.15 (537416) 0.4435 0.4855 0 (0)
> 58 540000 0.0032 11.45 (537372) 0.5048 0.5684 0 (0)
> 59 540000 0.0032 15.02 (537417) 0.6277 0.8161 0 (0)
> 60 540000 0.0032 20.02 (511100) 0.7036 1.2132 0 (0)
> 61 540000 0.0032 28.14 (471348) 0.9544 1.3316 0 (0)
> 62 540000 0.0032 25.04 (461373) 0.7629 1.2334 0 (0)
> 63 540000 0.0032 17.88 (532206) 0.6224 1.2652 0 (0)
>
> 3.14.4-rt5 + patches, nohz_cps=4-63, but with rt cpuset ticked
>
> FREQ=960 FRAMES=1728000 LOOP=50000 using CPUs 4 - 23
> FREQ=1000 FRAMES=1800000 LOOP=48000 using CPUs 24 - 43
> FREQ=300 FRAMES=540000 LOOP=160000 using CPUs 44 - 63
> on your marks... get set... POW!
> Cpu Frames Min Max(Frame) Avg Sigma LastTrans Fliers(Frames)
> 4 1727990 0.0159 15.75 (1110991) 0.2705 0.6782 0 (0)
> 5 1727991 0.0159 18.10 (1152942) 0.2295 0.5379 0 (0)
> 6 1727991 0.0159 12.14 (740256) 0.1871 0.4767 0 (0)
> 7 1727991 0.0159 13.61 (1398636) 0.1943 0.4162 0 (0)
> 8 1727991 0.0159 21.68 (1128942) 0.2343 0.4782 0 (0)
> 9 1727991 0.0159 17.66 (1373532) 0.2449 0.6676 0 (0)
> 10 1727991 0.0159 21.68 (1370843) 0.3469 0.7723 0 (0)
> 11 1727993 0.0159 14.56 (1654553) 0.3085 0.5460 0 (0)
> 12 1727994 0.0159 16.91 (1640920) 0.6324 0.6797 0 (0)
> 13 1727994 0.0159 14.05 (1646008) 0.4396 0.5460 0 (0)
> 14 1727994 0.0159 17.90 (1385628) 0.1940 0.5126 0 (0)
> 15 1727994 0.0159 14.53 (1324235) 0.5829 0.6251 0 (0)
> 16 1727994 0.0159 18.61 (1170511) 0.2769 0.7185 0 (0)
> 17 1727995 0.0159 15.96 (147911) 0.6323 1.1918 0 (0)
> 18 1727995 0.0159 17.63 (1147518) 0.3379 0.8251 0 (0)
> 19 1727997 0.0159 16.67 (1110990) 0.3504 0.8739 0 (0)
> 20 1727997 0.0159 25.02 (1371899) 0.4171 0.9395 0 (0)
> 21 1727997 0.0159 18.10 (1604824) 0.5120 0.9121 0 (0)
> 22 1727997 0.0159 16.67 (1292219) 0.3707 1.0057 0 (0)
> 23 1727997 0.0159 21.92 (1311275) 0.7368 0.9864 0 (0)
> 24 1799997 0.0725 11.13 (513155) 0.2668 0.4618 0 (0)
> 25 1799997 0.0725 14.47 (57648) 1.3242 1.3780 0 (0)
> 26 1799997 0.0725 16.14 (790209) 0.3020 0.6119 0 (0)
> 27 1799999 0.0725 18.52 (406878) 0.9193 1.2727 0 (0)
> 28 1799999 0.0725 16.38 (1333567) 0.9898 1.0894 0 (0)
> 29 1799999 0.0725 17.57 (1388068) 1.5751 1.4865 0 (0)
> 30 1800000 0.0725 15.90 (944311) 0.8447 1.0841 0 (0)
> 31 1800000 0.0725 19.00 (1118689) 1.2406 1.2589 0 (0)
> 32 1800000 0.0725 33.21 (623752) 0.2034 0.5721 0 (0) 2 (623751,623752)
> 33 1800000 0.0725 43.80 (623751) 0.1869 0.5132 0 (0) 40 (555521,555522,558341,558342,561411,..634502)
> 34 1800000 0.0725 54.91 (623752) 0.2003 0.6696 0 (0) 256 (621921,621922,622231,622232,622251,..634652)
> 35 1800000 0.0725 11.61 (1689123) 0.2855 0.3485 0 (0)
> 36 1800000 0.0725 19.95 (662351) 0.1990 0.4114 0 (0)
> 37 1800000 0.0725 7.32 (775961) 0.1888 0.3463 0 (0)
> 38 1800000 0.0725 45.23 (623751) 0.1812 0.5458 0 (0) 72 (555521,555522,558341,558342,561411,..633852)
> 39 1800000 0.0725 6.13 (2023) 0.1899 0.3141 0 (0)
> 40 1800000 0.0725 3.03 (76948) 0.1348 0.1367 0 (0)
> 41 1800000 0.0725 3.27 (278393) 0.1473 0.1599 0 (0)
> 42 1800000 0.0725 3.74 (149791) 0.1490 0.1477 0 (0)
> 43 1800000 0.0725 3.74 (76948) 0.3163 0.2310 0 (0)
> 44 540000 0.0032 32.18 (187964) 0.2410 0.9227 0 (0) 19 (166655,166656,186674,186675,187289,..188639)
> 45 540000 0.0032 13.35 (118119) 0.9129 0.6304 0 (0)
> 46 540000 0.0032 38.87 (187290) 0.3234 1.1625 0 (0) 227 (167501,167502,168422,168423,168575,..190395)
> 47 540000 0.0032 10.97 (70989) 0.7904 0.5492 0 (0)
> 48 540000 0.0032 16.22 (526242) 0.1975 0.3578 0 (0)
> 49 540000 0.0032 4.06 (113415) 0.1632 0.2182 0 (0)
> 50 540000 0.0032 36.00 (348112) 1.0410 1.1357 0 (0) 4 (348112,348113,505655,505656)
> 51 540000 0.0032 7.63 (410141) 0.1802 0.3413 0 (0)
> 52 540000 0.0032 7.63 (388792) 0.1467 0.2892 0 (0)
> 53 540000 0.0032 22.41 (526242) 0.8564 1.0304 0 (0)
> 54 540000 0.0032 16.22 (526242) 0.3234 0.5915 0 (0)
> 55 540000 0.0032 20.51 (523077) 0.8910 1.0718 0 (0)
> 56 540000 0.0032 20.51 (433008) 0.4362 1.3129 0 (0)
> 57 540000 0.0032 23.84 (429227) 0.4652 1.3327 0 (0)
> 58 540000 0.0032 23.60 (409787) 0.3603 1.1818 0 (0)
> 59 540000 0.0032 21.69 (379973) 0.5904 1.3033 0 (0)
> 60 540000 0.0032 24.80 (365811) 0.6453 1.4206 0 (0)
> 61 540000 0.0032 26.23 (351861) 0.8988 1.2698 0 (0)
> 62 540000 0.0032 24.32 (354042) 0.9292 1.2590 0 (0)
> 63 540000 0.0032 24.80 (354441) 0.6686 1.3598 0 (0)
>
> 3.14.4-rt5 + patches. no nohz_full mask supplied, rt cpuset ticked
>
> FREQ=960 FRAMES=1728000 LOOP=50000 using CPUs 4 - 23
> FREQ=1000 FRAMES=1800000 LOOP=48000 using CPUs 24 - 43
> FREQ=300 FRAMES=540000 LOOP=160000 using CPUs 44 - 63
> on your marks... get set... POW!
> Cpu Frames Min Max(Frame) Avg Sigma LastTrans Fliers(Frames)
> 4 1727999 0.0159 19.77 (255927) 0.6208 0.8240 0 (0)
> 5 1727999 0.0159 5.02 (647067) 0.0868 0.1769 0 (0)
> 6 1727999 0.0159 5.23 (643274) 0.0783 0.1614 0 (0)
> 7 1728000 0.0159 5.26 (645483) 0.0940 0.1667 0 (0)
> 8 1728000 0.0159 5.23 (1308493) 0.0928 0.2128 0 (0)
> 9 1728000 0.0159 4.31 (7073) 0.0866 0.1984 0 (0)
> 10 1728000 0.0159 4.78 (1409) 0.0857 0.2031 0 (0)
> 11 1728000 0.0159 6.18 (1177115) 0.0946 0.2038 0 (0)
> 12 1728000 0.0159 5.02 (1607995) 0.0921 0.2065 0 (0)
> 13 1728000 0.0159 5.98 (1164828) 0.1021 0.2268 0 (0)
> 14 1728000 0.0159 7.61 (1143227) 0.1055 0.2670 0 (0)
> 15 1728000 0.0159 5.94 (1122923) 0.1346 0.2006 0 (0)
> 16 1728000 0.0159 5.98 (285214) 0.1058 0.2706 0 (0)
> 17 1728000 0.0159 9.04 (1143131) 0.1198 0.3034 0 (0)
> 18 1728000 0.0159 5.98 (962842) 0.0934 0.2315 0 (0)
> 19 1728000 0.0159 5.74 (1747) 0.1115 0.2409 0 (0)
> 20 1728000 0.0159 5.94 (264838) 0.0931 0.2247 0 (0)
> 21 1728000 0.0159 7.88 (389138) 0.1144 0.2702 0 (0)
> 22 1728000 0.0159 7.85 (588413) 0.1962 0.2656 0 (0)
> 23 1728000 0.0159 5.98 (1110060) 0.1984 0.3365 0 (0)
> 24 1800000 0.0725 2.79 (796117) 0.1595 0.1585 0 (0)
> 25 1800000 0.0725 2.31 (316117) 0.1086 0.0560 0 (0)
> 26 1800000 0.0725 2.46 (796118) 0.1074 0.0544 0 (0)
> 27 1800000 0.0725 3.98 (613155) 0.1087 0.0699 0 (0)
> 28 1800000 0.0725 3.17 (613156) 0.1085 0.0585 0 (0)
> 29 1800000 0.0725 8.18 (613156) 0.2171 0.2721 0 (0)
> 30 1800000 0.0725 7.94 (612931) 0.2242 0.2651 0 (0)
> 31 1800000 0.0725 7.94 (612931) 0.2499 0.3039 0 (0)
> 32 1800000 0.0725 3.03 (1756117) 0.1260 0.0819 0 (0)
> 33 1800000 0.0725 3.27 (1085885) 0.5809 0.4470 0 (0)
> 34 1800000 0.0725 2.55 (316117) 0.1056 0.0504 0 (0)
> 35 1800000 0.0725 3.27 (1965) 0.2121 0.4379 0 (0)
> 36 1800000 0.0725 4.13 (1) 0.1324 0.0874 0 (0)
> 37 1800000 0.0725 4.13 (1) 0.1808 0.1423 0 (0)
> 38 1800000 0.0725 4.13 (1) 0.2027 0.1488 0 (0)
> 39 1800000 0.0725 4.13 (1) 0.2094 0.1533 0 (0)
> 40 1800000 0.0725 2.93 (316118) 0.1093 0.0742 0 (0)
> 41 1800000 0.0725 3.03 (1756116) 0.1971 0.1469 0 (0)
> 42 1800000 0.0725 3.27 (1210118) 0.6525 0.5411 0 (0)
> 43 1800000 0.0725 3.03 (316117) 0.1048 0.0498 0 (0)
> 44 539999 0.0032 2.86 (94835) 0.0828 0.1364 0 (0)
> 45 539999 0.0032 2.62 (94834) 0.1914 0.1657 0 (0)
> 46 540000 0.0032 3.10 (94834) 0.2435 0.1900 0 (0)
> 47 540000 0.0032 2.38 (94834) 0.2505 0.1965 0 (0)
> 48 540000 0.0032 3.82 (524593) 0.1307 0.2533 0 (0)
> 49 540000 0.0032 2.86 (447946) 0.0904 0.2040 0 (0)
> 50 540000 0.0032 3.34 (434056) 0.2087 0.2865 0 (0)
> 51 540000 0.0032 3.10 (94835) 0.0921 0.2016 0 (0)
> 52 540000 0.0032 7.39 (522302) 0.3460 0.3597 0 (0)
> 53 540000 0.0032 7.39 (522302) 0.3449 0.3567 0 (0)
> 54 540000 0.0032 7.15 (522302) 0.3259 0.3550 0 (0)
> 55 540000 0.0032 7.39 (522302) 0.3274 0.3578 0 (0)
> 56 540000 0.0032 6.20 (387845) 0.1547 0.3660 0 (0)
> 57 540000 0.0032 7.87 (367398) 0.1425 0.3847 0 (0)
> 58 540000 0.0032 7.63 (347661) 0.1272 0.3915 0 (0)
> 59 540000 0.0032 9.30 (347660) 0.1239 0.3552 0 (0)
> 60 540000 0.0032 12.16 (152143) 0.3169 0.3407 0 (0)
> 61 540000 0.0032 10.02 (152143) 0.3359 0.3369 0 (0)
> 62 540000 0.0032 12.16 (152143) 0.3347 0.3341 0 (0)
> 63 540000 0.0032 12.40 (152143) 0.2970 0.3460 0 (0)
>
>
next prev parent reply other threads:[~2014-05-18 5:20 UTC|newest]
Thread overview: 31+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-05-14 15:08 [PATCH] sched/rt: don't try to balance rt_runtime when it is futile Paul Gortmaker
2014-05-14 15:44 ` Paul E. McKenney
2014-05-14 19:11 ` Paul Gortmaker
2014-05-14 19:27 ` Paul E. McKenney
2014-05-15 2:49 ` Mike Galbraith
2014-05-15 14:09 ` Paul Gortmaker
2014-11-27 9:17 ` Wanpeng Li
2014-11-27 15:31 ` Mike Galbraith
2014-11-27 11:36 ` Wanpeng Li
2014-05-15 3:18 ` Mike Galbraith
2014-05-15 14:45 ` Paul E. McKenney
2014-05-15 17:27 ` Mike Galbraith
2014-05-18 4:22 ` Mike Galbraith
2014-05-18 5:20 ` Paul E. McKenney [this message]
2014-05-18 8:36 ` Mike Galbraith
2014-05-18 15:58 ` Paul E. McKenney
2014-05-19 2:44 ` Mike Galbraith
2014-05-19 5:34 ` Paul E. McKenney
2014-05-20 14:53 ` Frederic Weisbecker
2014-05-20 15:53 ` Paul E. McKenney
2014-05-20 16:24 ` Frederic Weisbecker
2014-05-20 16:36 ` Peter Zijlstra
2014-05-20 17:20 ` Paul E. McKenney
2014-05-21 4:29 ` Mike Galbraith
2014-05-21 4:18 ` Mike Galbraith
2014-05-21 12:03 ` Paul E. McKenney
2014-05-21 3:52 ` Mike Galbraith
2014-05-19 10:54 ` Peter Zijlstra
2014-05-19 12:40 ` Peter Zijlstra
2014-05-22 19:40 ` Paul Gortmaker
2014-11-27 11:21 ` Wanpeng Li
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20140518052039.GF4570@linux.vnet.ibm.com \
--to=paulmck@linux.vnet.ibm.com \
--cc=linux-kernel@vger.kernel.org \
--cc=linux-rt-users@vger.kernel.org \
--cc=mingo@redhat.com \
--cc=paul.gortmaker@windriver.com \
--cc=peterz@infradead.org \
--cc=rostedt@goodmis.org \
--cc=tglx@linutronix.de \
--cc=umgwanakikbuti@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.