* Re: Tasks schedule/migration issue with CPU hotplug? [not found] <CAOwKts_WTDBLkz9=0MBhs6wzc67XD_bYgGMiZ-JUM+8O7gP_fw@mail.gmail.com> @ 2011-09-08 6:47 ` TAO HU 2011-09-08 7:28 ` Yong Zhang 2011-09-08 12:55 ` Peter Zijlstra 0 siblings, 2 replies; 5+ messages in thread From: TAO HU @ 2011-09-08 6:47 UTC (permalink / raw) To: Ingo Molnar, peterz, linux-kernel; +Cc: linux-arm-kernel, linux-omap Resend with linux-kernel mail list included. On Wed, Sep 7, 2011 at 10:22 PM, TAO HU <tghk48@motorola.com> wrote: > Hi, All > > We seems got a schedule/migration issue in a OMAP4430 dual-core system. > The kernel base is 2.6.35.7 and we're using CFS. > > In a stress testing, we created a huge amount of processes/threads and > forced the 2nd CPU plug/unplug back and forth. > Looks like a few tasks such as below ones didn't get scheduled in 8 seconds! > omap2_mcspi (pid 21, exec-runtime 2223062.886210) > hackbench (pid 3445, exec-runtime 2223114.709956) > > We believe the two tasks were migrated to the primary CPU. > Somehow, they were no selected to run any more. > > The two tasks have a high exec_runtime value. > Can it be a scheduler's bug for tasks migration? > Do we need kind of normalization for vruntime when migrating tasks > from one CPU to another one? > > Here is the part of ftrace logs: > <0>[ 6953.595642] hackbenc-3425 1...2. 2630440327us : 3425:120:S > ==> [001] 3445:120:R <...> > <0>[ 6953.595672] <...>-3445 1d..5. 2630440358us : 3445:120:R > + [001] 3426:120:R hackbench > <0>[ 6953.595703] <...>-3445 1...2. 2630440388us : 3445:120:R > ==> [001] 3426:120:R hackbench > <0>[ 6953.595733] hackbenc-3426 1...2. 2630440388us : 3426:120:S > ==> [001] 3445:120:R <...> > <0>[ 6953.595764] <...>-3445 1d..5. 2630440419us : 3445:120:R > + [001] 3427:120:R hackbench > <0>[ 6953.595825] <...>-3445 1...2. 2630440449us : 3445:120:R > ==> [001] 3427:120:R hackbench > .... ... > <0>[ 6955.049468] <...>-3396 1d..5. 2630462666us : 3396:120:R > + [001] 3376:120:R hackbench > <0>[ 6955.049499] <...>-3396 1...2. 2630462697us : 3396:120:R > ==> [001] 2683: 0:R <...> > <0>[ 6955.049560] <...>-2683 1...2. 2630463093us : 2683: 0:S > ==> [001] 0: 0:R <idle> > <0>[ 6955.049591] <idle>-0 1d..5. 2630463154us : 0: 0:R > + [000] 1642:120:D <...> (the 2nd CPU down here) > ... ... > ... .... > <0>[ 6958.913970] hackbenc-3226 0...2. 2638767048us : 3226:120:R > ==> [000] 3223:120:R hackbench > <0>[ 6958.914001] hackbenc-3223 0d.s7. 2638767110us : 3223:120:S > + [000] 2345:120:R crashspi > <0>[ 6958.914031] hackbenc-3223 0...2. 2638767110us : 3223:120:S > ==> [000] 3226:120:R hackbench > <0>[ 6958.914062] hackbenc-3226 0...2. 2638767140us : 3226:120:R > ==> [000] 2345:120:R crashspi > <0>[ 6958.914093] --------------------------------- > > > Here is the threads/process info dump: > > <4>[ 6950.135192] now at 6950549.376887 msecs > <4>[ 6950.135223] .jiffies : 850755 > <4>[ 6950.135223] .sysctl_sched_latency : 10.000000 > <4>[ 6950.135253] .sysctl_sched_min_granularity : 4.000000 > <4>[ 6950.135253] .sysctl_sched_wakeup_granularity : 2.000000 > <4>[ 6950.135284] .sysctl_sched_child_runs_first : 0.000000 > <4>[ 6950.135284] .sysctl_sched_features : 15471 > <4>[ 6950.135284] .sysctl_sched_tunable_scaling : 1 (logaritmic) > <4>[ 6950.135314] > <4>[ 6950.135314] cpu#0 > <4>[ 6950.135314] .nr_running : 212 > <4>[ 6950.135345] .load : 217650 > <4>[ 6950.135345] .nr_switches : 144304735 > <4>[ 6950.135375] .nr_load_updates : 847105 > <4>[ 6950.135375] .nr_uninterruptible : 108 > <4>[ 6950.135375] .next_balance : 0.849692 > <4>[ 6950.135406] .curr->pid : 2345 > <4>[ 6950.135406] .clock : 6946109.313964 > <4>[ 6950.135437] .cpu_load[0] : 216626 > <4>[ 6950.135437] .cpu_load[1] : 216865 > <4>[ 6950.135437] .cpu_load[2] : 217114 > <4>[ 6950.135467] .cpu_load[3] : 217240 > <4>[ 6950.135467] .cpu_load[4] : 217318 > <4>[ 6950.135467] .yld_count : 46326 > <4>[ 6950.135498] .sched_switch : 0 > <4>[ 6950.135498] .sched_count : 144442385 > <4>[ 6950.135528] .sched_goidle : 2021081 > <4>[ 6950.135528] .avg_idle : 51188 > <4>[ 6950.135528] .ttwu_count : 93102282 > <4>[ 6950.135559] .ttwu_local : 87445098 > <4>[ 6950.135559] .bkl_count : 32006801 > <4>[ 6950.135589] > <4>[ 6950.135589] cfs_rq[0]:/bg_non_interactive > <4>[ 6950.135589] .exec_clock : 7934.204110 > <4>[ 6950.135620] .MIN_vruntime : 0.000001 > <4>[ 6950.135620] .min_vruntime : 79877.877411 > <4>[ 6950.135650] .max_vruntime : 0.000001 > <4>[ 6950.135650] .spread : 0.000000 > <4>[ 6950.135650] .spread0 : -2143179.551111 > <4>[ 6950.135681] .nr_running : 0 > <4>[ 6950.135681] .load : 0 > <4>[ 6950.135711] .nr_spread_over : 390 > <4>[ 6950.135711] .shares : 0 > <4>[ 6950.135711] .se->exec_start : 6945754.943847 > <4>[ 6950.135742] .se->vruntime : 2223057.623199 > <4>[ 6950.135742] .se->sum_exec_runtime : 7934.417734 > <4>[ 6950.135772] .se->statistics.wait_start : 0.000000 > <4>[ 6950.135772] .se->statistics.sleep_start : 0.000000 > <4>[ 6950.135803] .se->statistics.block_start : 0.000000 > <4>[ 6950.135803] .se->statistics.sleep_max : 0.000000 > <4>[ 6950.135803] .se->statistics.block_max : 0.000000 > <4>[ 6950.135833] .se->statistics.exec_max : 7.843018 > <4>[ 6950.135833] .se->statistics.slice_max : 12.329101 > <4>[ 6950.135864] .se->statistics.wait_max : 45493.103028 > <4>[ 6950.135864] .se->statistics.wait_sum : 722360.626242 > <4>[ 6950.135894] .se->statistics.wait_count : 37054 > <4>[ 6950.135894] .se->load.weight : 26 > <4>[ 6950.135894] > <4>[ 6950.135925] cfs_rq[0]:/fg_boost > <4>[ 6950.135925] .exec_clock : 0.000000 > <4>[ 6950.135925] .MIN_vruntime : 0.000001 > <4>[ 6950.135955] .min_vruntime : -1.048576 > <4>[ 6950.135955] .max_vruntime : 0.000001 > <4>[ 6950.135986] .spread : 0.000000 > <4>[ 6950.135986] .spread0 : -2223058.477098 > <4>[ 6950.135986] .nr_running : 0 > <4>[ 6950.136016] .load : 0 > <4>[ 6950.136016] .nr_spread_over : 0 > <4>[ 6950.136047] .shares : 0 > <4>[ 6950.136047] .se->exec_start : 0.000000 > <4>[ 6950.136047] .se->vruntime : 0.000000 > <4>[ 6950.136077] .se->sum_exec_runtime : 0.000000 > <4>[ 6950.136077] .se->statistics.wait_start : 0.000000 > <4>[ 6950.136108] .se->statistics.sleep_start : 0.000000 > <4>[ 6950.136108] .se->statistics.block_start : 0.000000 > <4>[ 6950.136108] .se->statistics.sleep_max : 0.000000 > <4>[ 6950.136138] .se->statistics.block_max : 0.000000 > <4>[ 6950.136138] .se->statistics.exec_max : 0.000000 > <4>[ 6950.136169] .se->statistics.slice_max : 0.000000 > <4>[ 6950.136169] .se->statistics.wait_max : 0.000000 > <4>[ 6950.136199] .se->statistics.wait_sum : 0.000000 > <4>[ 6950.136199] .se->statistics.wait_count : 0 > <4>[ 6950.136199] .se->load.weight : 512 > <4>[ 6950.136230] > <4>[ 6950.136230] cfs_rq[0]:/ > <4>[ 6950.136230] .exec_clock : 6520265.283900 > <4>[ 6950.136260] .MIN_vruntime : 2223057.428522 > <4>[ 6950.136260] .min_vruntime : 2223057.428522 > <4>[ 6950.136291] .max_vruntime : 2223114.709956 > <4>[ 6950.136291] .spread : 57.281434 > <4>[ 6950.136291] .spread0 : 0.000000 > <4>[ 6950.136322] .nr_running : 212 > <4>[ 6950.136322] .load : 217650 > <4>[ 6950.136352] .nr_spread_over : 125034 > <4>[ 6950.136352] .shares : 0 > <4>[ 6950.136352] > <4>[ 6950.136383] rt_rq[0]:/bg_non_interactive > <4>[ 6950.136383] .rt_nr_running : 0 > <4>[ 6950.136383] .rt_throttled : 0 > <4>[ 6950.136413] .rt_time : 0.000000 > <4>[ 6950.136413] .rt_runtime : 0.000000 > <4>[ 6950.136413] > <4>[ 6950.136444] rt_rq[0]:/fg_boost > <4>[ 6950.136444] .rt_nr_running : 0 > <4>[ 6950.136444] .rt_throttled : 0 > <4>[ 6950.136474] .rt_time : 0.000000 > <4>[ 6950.136474] .rt_runtime : 0.000000 > <4>[ 6950.136505] > <4>[ 6950.136505] rt_rq[0]:/ > <4>[ 6950.136505] .rt_nr_running : 0 > <4>[ 6950.136505] .rt_throttled : 0 > <4>[ 6950.136535] .rt_time : 0.000000 > <4>[ 6950.136535] .rt_runtime : 950.000000 > <4>[ 6950.136566] > <4>[ 6950.136566] runnable tasks: > <4>[ 6950.136566] task PID tree-key switches > prio exec-runtime sum-exec sum-sleep > <4>[ 6950.136596] > ---------------------------------------------------------------------------------------------------------- > <4>[ 6950.136627] omap2_mcspi 21 2223062.886210 29451523 > 120 2223062.886210 1177589.035038 1648080.867813 / > <4>[ 6950.136718] salt_lj_2 1683 2223061.583766 2671 > 120 2223061.583766 6119.567813 6395425.231938 / > <4>[ 6950.136779] test-fb-refresh 1644 2223069.415582 672416 > 120 2223069.415582 2846654.876990 711754.241756 / > <4>[ 6950.136810] ActivityManager 4634 2223058.516356 13709 > 118 2223058.516356 38864.105043 4091806.121829 / > <4>[ 6950.137115] R crashspi 2345 2223052.428522 17082 > 120 2223052.428522 433.624298 237326.354921 / > <4>[ 6950.137145] dd 3030 2223058.989726 638 > 120 2223058.989726 2179.229733 16940.704346 / > <4>[ 6950.137207] hackbench 3066 2223057.672624 9610 > 120 2223057.672624 393.890422 197.662353 / > <4>[ 6950.137237] hackbench 3067 2223058.832266 9197 > 120 2223058.832266 395.019547 193.176269 / > <4>[ 6950.137268] hackbench 3068 2223057.764114 9466 > 120 2223057.764114 393.951394 197.631836 / > <4>[ 6950.137298] hackbench 3069 2223057.916691 9308 > 120 2223057.916691 394.103971 193.145752 / > <4>[ 6950.137329] hackbench 3070 2223057.733619 9395 > 120 2223057.733619 393.920900 193.115234 / > <4>[ 6950.137359] hackbench 3071 2223059.290012 9357 > 120 2223059.290012 395.507810 197.540284 / > <4>[ 6950.137420] hackbench 3072 2223058.313450 9501 > 120 2223058.313450 394.500730 193.054199 / > <4>[ 6950.137451] hackbench 3073 2223057.977845 9588 > 120 2223057.977845 394.165126 197.509766 / > <4>[ 6950.137481] hackbench 3074 2223058.649040 9272 > 120 2223058.649040 394.836321 197.479248 / > <4>[ 6950.137512] hackbench 3075 2223058.221896 9536 > 120 2223058.221896 394.439694 197.357178 / > <4>[ 6950.137542] hackbench 3076 2223058.160997 9151 > 120 2223058.160997 394.348277 197.418213 / > <4>[ 6950.137573] hackbench 3077 2223057.733577 9574 > 120 2223057.733577 393.951375 192.993164 / > <4>[ 6950.137603] hackbench 3078 2223058.710150 9455 > 120 2223058.710150 394.897431 197.296142 / > <4>[ 6950.137664] hackbench 3079 2223057.947243 8920 > 120 2223057.947243 394.134524 192.962646 / > <4>[ 6950.137695] hackbench 3080 2223057.733599 9466 > 120 2223057.733599 393.920880 197.326660 / > <4>[ 6950.137725] hackbench 3081 2223058.984851 9557 > 120 2223058.984851 395.172132 192.901611 / > <4>[ 6950.137756] hackbench 3082 2223058.435540 8960 > 120 2223058.435540 394.653338 192.840576 / > <4>[ 6950.137786] hackbench 3083 2223057.794693 9513 > 120 2223057.794693 393.981973 197.235108 / > <4>[ 6950.137817] hackbench 3084 2223058.862755 9145 > 120 2223058.862755 395.050035 192.810059 / > <4>[ 6950.137847] hackbench 3085 2223057.855681 9013 > 120 2223057.855681 394.042962 192.749023 / > <4>[ 6950.137908] hackbench 3106 2223057.916697 7399 > 120 2223057.916697 394.134495 164.001465 / > <4>[ 6950.137939] hackbench 3107 2223058.221850 7661 > 120 2223058.221850 394.439648 163.940430 / > <4>[ 6950.137969] hackbench 3108 2223058.099761 7428 > 120 2223058.099761 394.287041 163.879395 / > <4>[ 6950.138000] hackbench 3109 2223058.343988 7831 > 120 2223058.343988 394.561785 162.231446 / > <4>[ 6950.138031] hackbench 3110 2223057.550561 7632 > 120 2223057.550561 393.737842 163.848877 / > <4>[ 6950.138061] hackbench 3111 2223058.038736 6971 > 120 2223058.038736 394.256534 163.787842 / > <4>[ 6950.138122] hackbench 3112 2223059.045885 7666 > 120 2223059.045885 395.233166 162.200928 / > <4>[ 6950.138153] hackbench 3113 2223059.106955 7683 > 120 2223059.106955 395.294236 163.726806 / > <4>[ 6950.138183] hackbench 3114 2223057.581077 7724 > 120 2223057.581077 393.768358 162.170410 / > <4>[ 6950.138214] hackbench 3115 2223057.886195 7580 > 120 2223057.886195 394.073475 163.696289 / > <4>[ 6950.138244] hackbench 3116 2223058.832318 3037 > 120 2223058.832318 314.117462 471.862792 / > <4>[ 6950.138275] hackbench 3117 2223058.404983 7230 > 120 2223058.404983 394.592264 163.665771 / > <4>[ 6950.138305] hackbench 3118 2223059.168044 7859 > 120 2223059.168044 395.355324 516.845703 / > <4>[ 6950.138366] hackbench 3119 2223058.343964 7533 > 120 2223058.343964 394.561762 163.604736 / > <4>[ 6950.138397] hackbench 3120 2223058.649172 7738 > 120 2223058.649172 394.836453 163.543701 / > <4>[ 6950.138427] hackbench 3121 2223057.947257 3433 > 120 2223057.947257 313.201884 471.740722 / > <4>[ 6950.138458] hackbench 3122 2223059.015328 7743 > 120 2223059.015328 395.233126 516.693117 / > <4>[ 6950.138488] hackbench 3123 2223058.282921 7757 > 120 2223058.282921 394.470201 163.513184 / > <4>[ 6950.138519] hackbench 3124 2223057.550511 7373 > 120 2223057.550511 393.737792 516.693116 / > <4>[ 6950.138549] hackbench 3125 2223057.550537 7566 > 120 2223057.550537 393.737818 163.482666 / > <4>[ 6950.138610] hackbench 3146 2223058.221875 9126 > 120 2223058.221875 394.409155 147.613526 / > <4>[ 6950.138641] hackbench 3147 2223073.145025 9818 > 120 2223073.145025 409.332306 157.928467 / > <4>[ 6950.138671] hackbench 3148 2223057.977772 9457 > 120 2223057.977772 394.165053 147.552490 / > <4>[ 6950.138702] hackbench 3149 2223058.984894 9508 > 120 2223058.984894 395.202692 147.491455 / > <4>[ 6950.138732] hackbench 3150 2223102.045087 10882 > 120 2223102.045087 438.232368 157.745361 / > <4>[ 6950.138763] hackbench 3151 2223059.442607 9630 > 120 2223059.442607 395.629888 147.460937 / > <4>[ 6950.138824] hackbench 3152 2223058.405016 9648 > 120 2223058.405016 394.592296 157.836914 / > <4>[ 6950.138854] hackbench 3153 2223058.527088 9373 > 120 2223058.527088 394.714368 157.714844 / > <4>[ 6950.138885] hackbench 3154 2223058.282932 9576 > 120 2223058.282932 394.470213 157.470703 / > <4>[ 6950.138916] hackbench 3155 2223058.893246 8810 > 120 2223058.893246 395.080526 147.399903 / > <4>[ 6950.138946] hackbench 3156 2223058.130297 9568 > 120 2223058.130297 394.317578 157.562256 / > <4>[ 6950.138977] hackbench 3157 2223059.412138 9432 > 120 2223059.412138 395.599418 157.501221 / > <4>[ 6950.139007] hackbench 3158 2223058.740634 9527 > 120 2223058.740634 394.927915 147.369385 / > <4>[ 6950.139068] hackbench 3159 2223058.221865 9193 > 120 2223058.221865 394.409146 157.653809 / > <4>[ 6950.139099] hackbench 3160 2223058.282916 9580 > 120 2223058.282916 394.500714 147.308350 / > <4>[ 6950.139129] hackbench 3161 2223058.832267 8928 > 120 2223058.832267 395.019548 445.556640 / > <4>[ 6950.139160] hackbench 3162 2223058.069307 9401 > 120 2223058.069307 394.287105 157.592774 / > <4>[ 6950.139190] hackbench 3163 2223059.076440 9460 > 120 2223059.076440 395.263720 147.216797 / > <4>[ 6950.139221] hackbench 3164 2223058.069300 9206 > 120 2223058.069300 394.256581 157.379150 / > <4>[ 6950.139251] hackbench 3165 2223059.412122 8881 > 120 2223059.412122 395.629920 157.409668 / > <4>[ 6950.139312] hackbench 3186 2223057.764144 5252 > 120 2223057.764144 393.981942 128.143310 / > <4>[ 6950.139343] hackbench 3187 2223059.320515 5568 > 120 2223059.320515 395.507795 128.082276 / > <4>[ 6950.139373] hackbench 3188 2223057.550470 5303 > 120 2223057.550470 393.737751 128.051758 / > <4>[ 6950.139404] hackbench 3189 2223058.496557 5096 > 120 2223058.496557 394.714355 127.990723 / > <4>[ 6950.139434] hackbench 3190 2223058.893313 5242 > 120 2223058.893313 395.080594 127.960205 / > <4>[ 6950.139465] hackbench 3191 2223057.733573 5030 > 120 2223057.733573 393.920853 127.899170 / > <4>[ 6950.139526] hackbench 3192 2223058.343903 5208 > 120 2223058.343903 394.561701 127.838135 / > <4>[ 6950.139556] hackbench 3193 2223058.557565 5208 > 120 2223058.557565 394.744846 127.807617 / > <4>[ 6950.139587] hackbench 3194 2223057.489480 5099 > 120 2223057.489480 393.676761 127.746582 / > <4>[ 6950.139617] hackbench 3195 2223058.557600 5235 > 120 2223058.557600 394.744880 233.428958 / > <4>[ 6950.139648] hackbench 3196 2223058.557583 5422 > 120 2223058.557583 394.775381 127.685547 / > <4>[ 6950.139678] hackbench 3197 2223057.733636 4665 > 120 2223057.733636 312.988263 232.971190 / > <4>[ 6950.139709] hackbench 3198 2223058.069299 4848 > 120 2223058.069299 394.256580 233.245849 / > <4>[ 6950.139739] hackbench 3199 2223097.711703 6751 > 120 2223097.711703 433.898983 179.016113 / > <4>[ 6950.139801] hackbench 3200 2223058.771274 4300 > 120 2223058.771274 314.056418 127.349854 / > <4>[ 6950.139831] hackbench 3201 2223058.466064 5259 > 120 2223058.466064 394.683862 213.226320 / > <4>[ 6950.139862] hackbench 3202 2223058.618645 4705 > 120 2223058.618645 313.873272 127.319336 / > <4>[ 6950.139892] hackbench 3203 2223059.015430 4845 > 120 2223059.015430 314.270057 127.410889 / > <4>[ 6950.139923] hackbench 3204 2223058.801745 5110 > 120 2223058.801745 395.019543 136.474609 / > <4>[ 6950.139953] hackbench 3205 2223058.649169 4757 > 120 2223058.649169 313.903795 127.258301 / > <4>[ 6950.140014] hackbench 3226 2223058.679731 6443 > 120 2223058.679731 313.964875 152.099610 / > <4>[ 6950.140045] hackbench 3227 2223098.962891 7276 > 120 2223098.962891 354.217518 152.130127 / > <4>[ 6950.140075] hackbench 3228 2223059.076460 5924 > 120 2223059.076460 314.331087 152.069092 / > <4>[ 6950.140106] hackbench 3229 2223058.679697 3712 > 120 2223058.679697 394.897496 122.253417 / > <4>[ 6950.140136] hackbench 3230 2223058.984841 3425 > 120 2223058.984841 395.172121 122.222900 / > <4>[ 6950.140167] hackbench 3231 2223057.520020 6199 > 120 2223057.520020 312.805164 152.099609 / > <4>[ 6950.140228] hackbench 3232 2223057.886169 3575 > 120 2223057.886169 394.103967 122.161865 / > <4>[ 6950.140258] hackbench 3233 2223058.740636 6318 > 120 2223058.740636 313.995262 126.495362 / > <4>[ 6950.140289] hackbench 3234 2223058.832260 3353 > 120 2223058.832260 395.019541 122.131347 / > <4>[ 6950.140319] hackbench 3235 2223058.984873 3566 > 120 2223058.984873 395.172153 122.070313 / > <4>[ 6950.140350] hackbench 3236 2223058.923805 6362 > 120 2223058.923805 314.178432 126.434326 / > <4>[ 6950.140380] hackbench 3237 2223058.954306 5879 > 120 2223058.954306 314.208932 126.403809 / > <4>[ 6950.140411] hackbench 3238 2223058.862741 6144 > 120 2223058.862741 314.147886 126.342773 / > <4>[ 6950.140472] hackbench 3239 2223059.381590 6495 > 120 2223059.381590 314.666734 110.717774 / > <4>[ 6950.140502] hackbench 3240 2223058.588091 3647 > 120 2223058.588091 394.775371 89.355469 / > <4>[ 6950.140533] hackbench 3241 2223057.764225 6466 > 120 2223057.764225 313.049370 110.656738 / > <4>[ 6950.140563] hackbench 3242 2223058.221896 3157 > 120 2223058.221896 394.409177 89.294434 / > <4>[ 6950.140594] hackbench 3243 2223058.588163 6417 > 120 2223058.588163 313.842789 110.595703 / > <4>[ 6950.140625] hackbench 3244 2223059.442554 3648 > 120 2223059.442554 395.660352 88.806153 / > <4>[ 6950.140655] hackbench 3245 2223057.855737 5957 > 120 2223057.855737 313.140881 100.616455 / > <4>[ 6950.140716] hackbench 3266 2223057.947276 7480 > 120 2223057.947276 313.201903 77.270508 / > <4>[ 6950.140747] hackbench 3267 2223058.191358 7487 > 120 2223058.191358 313.476502 77.209473 / > <4>[ 6950.140777] hackbench 3268 2223059.106873 7480 > 120 2223059.106873 314.361500 77.178955 / > <4>[ 6950.140808] hackbench 3269 2223059.290019 7645 > 120 2223059.290019 314.544645 77.148438 / > <4>[ 6950.140838] hackbench 3270 2223057.428522 7512 > 120 2223057.428522 312.713666 77.056885 / > <4>[ 6950.140869] hackbench 3271 2223058.679698 7515 > 120 2223058.679698 313.934325 131.988525 / > <4>[ 6950.140930] hackbench 3272 2223059.412048 7623 > 120 2223059.412048 314.666675 132.019042 / > <4>[ 6950.140960] hackbench 3273 2223057.947316 7492 > 120 2223057.947316 313.201943 76.995849 / > <4>[ 6950.140991] hackbench 3274 2223058.771171 7539 > 120 2223058.771171 314.025798 77.026367 / > <4>[ 6950.141021] hackbench 3275 2223059.106900 7496 > 120 2223059.106900 314.361527 76.843262 / > <4>[ 6950.141052] hackbench 3276 2223057.794724 7502 > 120 2223057.794724 313.079868 131.988525 / > <4>[ 6950.141082] hackbench 3277 2223058.740749 7628 > 120 2223058.740749 313.995375 131.958008 / > <4>[ 6950.141113] hackbench 3278 2223058.710230 7585 > 120 2223058.710230 314.025891 76.873780 / > <4>[ 6950.141174] hackbench 3279 2223057.611597 7460 > 120 2223057.611597 312.866224 87.249756 / > <4>[ 6950.141204] hackbench 3280 2223057.489500 7366 > 120 2223057.489500 312.774644 76.751709 / > <4>[ 6950.141235] hackbench 3281 2223058.221939 7505 > 120 2223058.221939 313.507083 87.188721 / > <4>[ 6950.141265] hackbench 3282 2223058.222022 7461 > 120 2223058.222022 313.476649 76.660156 / > <4>[ 6950.141296] hackbench 3283 2223058.527082 7568 > 120 2223058.527082 313.781709 76.812744 / > <4>[ 6950.141326] hackbench 3284 2223058.649179 7527 > 120 2223058.649179 313.903806 87.127685 / > <4>[ 6950.141357] hackbench 3285 2223058.954322 7549 > 120 2223058.954322 314.239466 76.599121 / > <4>[ 6950.141418] hackbench 3306 2223058.588151 7570 > 120 2223058.588151 313.873295 123.596191 / > <4>[ 6950.141448] hackbench 3307 2223059.320521 7491 > 120 2223059.320521 314.605665 74.645996 / > <4>[ 6950.141479] hackbench 3308 2223058.435490 7445 > 120 2223058.435490 313.690117 123.596191 / > <4>[ 6950.141510] hackbench 3309 2223058.405116 7464 > 120 2223058.405116 313.659743 74.615478 / > <4>[ 6950.141540] hackbench 3310 2223058.984904 7489 > 120 2223058.984904 314.270048 123.565674 / > <4>[ 6950.141571] hackbench 3311 2223059.290113 7560 > 120 2223059.290113 314.544740 123.565674 / > <4>[ 6950.141632] hackbench 3312 2223058.740716 7601 > 120 2223058.740716 313.995342 74.554444 / > <4>[ 6950.141662] hackbench 3313 2223058.313453 7525 > 120 2223058.313453 313.598597 74.493409 / > <4>[ 6950.141693] hackbench 3314 2223058.343951 7484 > 120 2223058.343951 313.598578 74.462891 / > <4>[ 6950.141723] hackbench 3315 2223058.862795 7314 > 120 2223058.862795 314.117421 75.927735 / > <4>[ 6950.141754] hackbench 3316 2223057.733614 7530 > 120 2223057.733614 313.049277 55.023193 / > <4>[ 6950.141784] hackbench 3317 2223057.611637 7407 > 120 2223057.611637 312.896782 70.098877 / > <4>[ 6950.141815] hackbench 3318 2223058.069358 7538 > 120 2223058.069358 313.385019 54.901123 / > <4>[ 6950.141845] hackbench 3319 2223057.489559 7450 > 120 2223057.489559 312.744185 70.037842 / > <4>[ 6950.141906] hackbench 3320 2223058.771222 7525 > 120 2223058.771222 314.025849 54.870605 / > <4>[ 6950.141937] hackbench 3321 2223058.771264 7560 > 120 2223058.771264 314.056408 69.976807 / > <4>[ 6950.141967] hackbench 3322 2223058.801787 7552 > 120 2223058.801787 314.086931 54.809570 / > <4>[ 6950.141998] hackbench 3323 2223063.501453 7662 > 120 2223063.501453 318.756080 69.946289 / > <4>[ 6950.142028] hackbench 3324 2223058.557622 7429 > 120 2223058.557622 313.812249 54.748535 / > <4>[ 6950.142059] hackbench 3325 2223059.045915 7546 > 120 2223059.045915 314.331059 69.854736 / > <4>[ 6950.142120] hackbench 3346 2223058.618603 5936 > 120 2223058.618603 313.873230 138.793945 / > <4>[ 6950.142150] hackbench 3347 2223058.008418 5961 > 120 2223058.008418 313.293562 138.793945 / > <4>[ 6950.142181] hackbench 3348 2223058.282914 6214 > 120 2223058.282914 313.568058 138.732911 / > <4>[ 6950.142211] hackbench 3349 2223058.099899 6215 > 120 2223058.099899 313.385043 138.763429 / > <4>[ 6950.142242] hackbench 3350 2223058.771209 6163 > 120 2223058.771209 314.056353 32.104493 / > <4>[ 6950.142272] hackbench 3351 2223058.710174 6207 > 120 2223058.710174 313.995318 32.043458 / > <4>[ 6950.142333] hackbench 3352 2223057.550538 6070 > 120 2223057.550538 312.835682 31.890869 / > <4>[ 6950.142364] hackbench 3353 2223058.069267 3653 > 120 2223058.069267 394.256548 35.186767 / > <4>[ 6950.142395] hackbench 3354 2223058.679696 6022 > 120 2223058.679696 313.964841 31.951904 / > <4>[ 6950.142425] hackbench 3355 2223058.343969 3779 > 120 2223058.343969 394.531250 35.095214 / > <4>[ 6950.142456] hackbench 3356 2223059.442623 6049 > 120 2223059.442623 314.697250 31.768798 / > <4>[ 6950.142486] hackbench 3357 2223059.412094 3800 > 120 2223059.412094 395.629892 64.361572 / > <4>[ 6950.142517] hackbench 3358 2223058.527132 6159 > 120 2223058.527132 313.812276 139.129638 / > <4>[ 6950.142547] hackbench 3359 2223057.855719 3752 > 120 2223057.855719 394.043000 142.486572 / > <4>[ 6950.142608] hackbench 3360 2223059.320504 3754 > 120 2223059.320504 395.538302 34.942627 / > <4>[ 6950.142639] hackbench 3361 2223059.442588 6178 > 120 2223059.442588 314.697215 31.646728 / > <4>[ 6950.142669] hackbench 3362 2223059.289979 3781 > 120 2223059.289979 395.477260 34.820556 / > <4>[ 6950.142700] hackbench 3363 2223058.862838 6280 > 120 2223058.862838 314.117464 31.494141 / > <4>[ 6950.142730] hackbench 3364 2223058.374486 3574 > 120 2223058.374486 394.561766 35.064697 / > <4>[ 6950.142761] hackbench 3365 2223058.923857 6232 > 120 2223058.923857 314.239518 81.695556 / > <4>[ 6950.142822] hackbench 3386 2223057.855737 6944 > 120 2223057.855737 313.110363 697.662355 / > <4>[ 6950.142852] hackbench 3387 2223057.732209 3013 > 120 2223057.732209 393.646224 56.457520 / > <4>[ 6950.142883] hackbench 3388 2223059.045915 7227 > 120 2223059.045915 314.300542 30.944824 / > <4>[ 6950.142913] hackbench 3389 2223058.493195 7140 > 120 2223058.493195 313.781777 30.914307 / > <4>[ 6950.142944] hackbench 3391 2223057.943836 7163 > 120 2223057.943836 313.293453 20.538330 / > <4>[ 6950.142974] hackbench 3392 2223057.913266 7054 > 120 2223057.913266 313.201849 20.507812 / > <4>[ 6950.143005] hackbench 3393 2223058.859329 6962 > 120 2223058.859329 314.147912 20.477294 / > <4>[ 6950.143066] hackbench 3394 2223058.584693 7180 > 120 2223058.584693 313.873275 20.416260 / > <4>[ 6950.143096] hackbench 3395 2223059.042494 7120 > 120 2223059.042494 314.361594 20.355225 / > <4>[ 6950.143127] hackbench 3396 2223058.187924 7083 > 120 2223058.187924 313.476507 20.324707 / > <4>[ 6950.143157] hackbench 3397 2223058.310064 7203 > 120 2223058.310064 313.598646 20.263672 / > <4>[ 6950.143188] hackbench 3398 2223057.608173 6928 > 120 2223057.608173 312.896756 20.233154 / > <4>[ 6950.143218] hackbench 3399 2223059.225628 7253 > 120 2223059.225628 314.544728 20.172119 / > <4>[ 6950.143249] hackbench 3400 2223058.035102 3044 > 120 2223058.035102 391.326887 2.166748 / > <4>[ 6950.143310] hackbench 3401 2223059.439242 6937 > 120 2223059.439242 314.727825 20.141601 / > <4>[ 6950.143341] hackbench 3402 2223057.481471 6749 > 120 2223057.481471 309.753424 2.075196 / > <4>[ 6950.143371] hackbench 3403 2223059.439238 6983 > 120 2223059.439238 314.727820 20.080567 / > <4>[ 6950.143402] hackbench 3404 2223057.791245 7107 > 120 2223057.791245 313.079828 20.050049 / > <4>[ 6950.143432] hackbench 3405 2223057.908789 6948 > 120 2223057.908789 310.180704 1.953125 / > <4>[ 6950.143463] hackbench 3406 2223058.523635 7068 > 120 2223058.523635 313.812217 20.019532 / > <4>[ 6950.143524] hackbench 3428 2223058.313422 5337 > 120 2223058.313422 265.045082 9233.978271 / > <4>[ 6950.143554] hackbench 3429 2223059.168004 5277 > 120 2223059.168004 282.775870 8696.319582 / > <4>[ 6950.143585] hackbench 3430 2223057.728820 6040 > 120 2223057.728820 301.605244 3877.227783 / > <4>[ 6950.143615] hackbench 3431 2223059.233894 2218 > 120 2223059.233894 382.110606 3795.104981 / > <4>[ 6950.143646] hackbench 3432 2223057.667812 5830 > 120 2223057.667812 285.736138 6528.869629 / > <4>[ 6950.143676] hackbench 3433 2223058.522277 5567 > 120 2223058.522277 299.621600 5717.285156 / > <4>[ 6950.143707] hackbench 3434 2223058.980062 6110 > 120 2223058.980062 293.426557 5739.990234 / > <4>[ 6950.143768] hackbench 3435 2223058.191454 5514 > 120 2223058.191454 277.832045 8030.822755 / > <4>[ 6950.143798] hackbench 3436 2223059.106975 5677 > 120 2223059.106975 278.320255 6854.644777 / > <4>[ 6950.143829] hackbench 3437 2223059.473183 6101 > 120 2223059.473183 290.588355 5625.305176 / > <4>[ 6950.143859] hackbench 3438 2223057.647029 5570 > 120 2223057.647029 275.299082 8041.503907 / > <4>[ 6950.143890] hackbench 3439 2223059.106971 5878 > 120 2223059.106971 286.071772 6566.406251 / > <4>[ 6950.143920] hackbench 3440 2223057.489483 6113 > 120 2223057.489483 308.166449 2902.313233 / > <4>[ 6950.143951] hackbench 3441 2223058.466070 6376 > 120 2223058.466070 302.093487 3230.041504 / > <4>[ 6950.144012] hackbench 3442 2223058.623568 5077 > 120 2223058.623568 261.810318 11294.525148 / > <4>[ 6950.144042] hackbench 3443 2223058.379449 5345 > 120 2223058.379449 276.397734 8350.708009 / > <4>[ 6950.144073] hackbench 3444 2223058.654045 4896 > 120 2223058.654045 277.343722 9959.838869 / > <4>[ 6950.144104] hackbench 3445 2223114.709956 7669 > 120 2223114.709956 342.468227 5719.573975 / > <4>[ 6950.144134] hackbench 3446 2223057.585953 5494 > 120 2223057.585953 277.252185 8900.085448 / > <4>[ 6950.144165] hackbench 3447 2223059.259559 6293 > 120 2223059.259559 302.734394 3191.955566 / > <4>[ 6950.144195] churn_data 3575 2223057.707968 87 > 120 2223057.707968 187.683096 11222.930908 / > <4>[ 6950.144287] ps 3752 2223059.719359 65 > 120 2223059.719359 179.565417 0.000000 / > <4>[ 6950.144317] kkkkkkkkkkkkkkk 3787 2223058.346130 58 > 120 2223058.346130 71.044920 4.821777 / > <4>[ 6950.144348] pipeio 3788 2223059.320594 182 > 120 2223059.320594 56.304934 0.000000 / > <4>[ 6950.144378] fork11 3818 2223058.262515 0 > 120 2223058.262515 0.000000 0.000000 / > <4>[ 6950.144409] kthreadd 3819 2223060.868907 0 > 120 2223060.868907 0.000000 0.000000 / > <4>[ 6950.144439] > > > -- > Best Regards > Hu Tao > -- Best Regards Hu Tao ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Tasks schedule/migration issue with CPU hotplug? 2011-09-08 6:47 ` Tasks schedule/migration issue with CPU hotplug? TAO HU @ 2011-09-08 7:28 ` Yong Zhang 2011-09-08 7:39 ` Yong Zhang 2011-09-08 12:55 ` Peter Zijlstra 1 sibling, 1 reply; 5+ messages in thread From: Yong Zhang @ 2011-09-08 7:28 UTC (permalink / raw) To: TAO HU; +Cc: Ingo Molnar, peterz, linux-kernel, linux-arm-kernel, linux-omap On Thu, Sep 08, 2011 at 02:47:08PM +0800, TAO HU wrote: > Resend with linux-kernel mail list included. Hmm, could you give a try with commit da7a735e? Thanks, Yong --- commit da7a735e51f9622eb3e1672594d4a41da01d7e4f Author: Peter Zijlstra <a.p.zijlstra@chello.nl> Date: Mon Jan 17 17:03:27 2011 +0100 sched: Fix switch_from_fair() When a task is taken out of the fair class we must ensure the vruntime is properly normalized because when we put it back in it will assume to be normalized. The case that goes wrong is when changing away from the fair class while sleeping. Sleeping tasks have non-normalized vruntime in order to make sleeper-fairness work. So treat the switch away from fair as a wakeup and preserve the relative vruntime. Also update sysrq-n to call the ->switch_{to,from} methods. Reported-by: Onkalo Samu <samu.p.onkalo@nokia.com> Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl> LKML-Reference: <new-submission> Signed-off-by: Ingo Molnar <mingo@elte.hu> > > On Wed, Sep 7, 2011 at 10:22 PM, TAO HU <tghk48@motorola.com> wrote: > > Hi, All > > > > We seems got a schedule/migration issue in a OMAP4430 dual-core system. > > The kernel base is 2.6.35.7 and we're using CFS. > > > > In a stress testing, we created a huge amount of processes/threads and > > forced the 2nd CPU plug/unplug back and forth. > > Looks like a few tasks such as below ones didn't get scheduled in 8 seconds! > > omap2_mcspi ?(pid 21, exec-runtime 2223062.886210) > > hackbench (pid 3445, exec-runtime 2223114.709956) > > > > We believe the two tasks were migrated to the primary CPU. > > Somehow, they were no selected to run any more. > > > > The two tasks have a high exec_runtime value. > > Can it be a scheduler's bug for tasks migration? > > Do we need kind of normalization for vruntime when migrating tasks > > from one CPU to another one? > > > > Here is the part of ftrace logs: > > <0>[ 6953.595642] hackbenc-3425 ? ?1...2. 2630440327us : ? 3425:120:S > > ==> [001] ?3445:120:R <...> > > <0>[ 6953.595672] ? ?<...>-3445 ? ?1d..5. 2630440358us : ? 3445:120:R > > ?+ [001] ?3426:120:R hackbench > > <0>[ 6953.595703] ? ?<...>-3445 ? ?1...2. 2630440388us : ? 3445:120:R > > ==> [001] ?3426:120:R hackbench > > <0>[ 6953.595733] hackbenc-3426 ? ?1...2. 2630440388us : ? 3426:120:S > > ==> [001] ?3445:120:R <...> > > <0>[ 6953.595764] ? ?<...>-3445 ? ?1d..5. 2630440419us : ? 3445:120:R > > ?+ [001] ?3427:120:R hackbench > > <0>[ 6953.595825] ? ?<...>-3445 ? ?1...2. 2630440449us : ? 3445:120:R > > ==> [001] ?3427:120:R hackbench > > .... ... > > <0>[ 6955.049468] ? ?<...>-3396 ? ?1d..5. 2630462666us : ? 3396:120:R > > ?+ [001] ?3376:120:R hackbench > > <0>[ 6955.049499] ? ?<...>-3396 ? ?1...2. 2630462697us : ? 3396:120:R > > ==> [001] ?2683: ?0:R <...> > > <0>[ 6955.049560] ? ?<...>-2683 ? ?1...2. 2630463093us : ? 2683: ?0:S > > ==> [001] ? ? 0: ?0:R <idle> > > <0>[ 6955.049591] ? <idle>-0 ? ? ? 1d..5. 2630463154us : ? ? ?0: ?0:R > > ?+ [000] ?1642:120:D <...> ? (the 2nd CPU down here) > > ... ... > > ... .... > > <0>[ 6958.913970] hackbenc-3226 ? ?0...2. 2638767048us : ? 3226:120:R > > ==> [000] ?3223:120:R hackbench > > <0>[ 6958.914001] hackbenc-3223 ? ?0d.s7. 2638767110us : ? 3223:120:S > > ?+ [000] ?2345:120:R crashspi > > <0>[ 6958.914031] hackbenc-3223 ? ?0...2. 2638767110us : ? 3223:120:S > > ==> [000] ?3226:120:R hackbench > > <0>[ 6958.914062] hackbenc-3226 ? ?0...2. 2638767140us : ? 3226:120:R > > ==> [000] ?2345:120:R crashspi > > <0>[ 6958.914093] --------------------------------- > > > > > > Here is the threads/process info dump: > > > > <4>[ 6950.135192] now at 6950549.376887 msecs > > <4>[ 6950.135223] ? .jiffies ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? ? : 850755 > > <4>[ 6950.135223] ? .sysctl_sched_latency ? ? ? ? ? ? ? ? ? ?: 10.000000 > > <4>[ 6950.135253] ? .sysctl_sched_min_granularity ? ? ? ? ? ?: 4.000000 > > <4>[ 6950.135253] ? .sysctl_sched_wakeup_granularity ? ? ? ? : 2.000000 > > <4>[ 6950.135284] ? .sysctl_sched_child_runs_first ? ? ? ? ? : 0.000000 > > <4>[ 6950.135284] ? .sysctl_sched_features ? ? ? ? ? ? ? ? ? : 15471 > > <4>[ 6950.135284] ? .sysctl_sched_tunable_scaling ? ? ? ? ? ?: 1 (logaritmic) > > <4>[ 6950.135314] > > <4>[ 6950.135314] cpu#0 > > <4>[ 6950.135314] ? .nr_running ? ? ? ? ? ? ? ? ? ?: 212 > > <4>[ 6950.135345] ? .load ? ? ? ? ? ? ? ? ? ? ? ? ?: 217650 > > <4>[ 6950.135345] ? .nr_switches ? ? ? ? ? ? ? ? ? : 144304735 > > <4>[ 6950.135375] ? .nr_load_updates ? ? ? ? ? ? ? : 847105 > > <4>[ 6950.135375] ? .nr_uninterruptible ? ? ? ? ? ?: 108 > > <4>[ 6950.135375] ? .next_balance ? ? ? ? ? ? ? ? ?: 0.849692 > > <4>[ 6950.135406] ? .curr->pid ? ? ? ? ? ? ? ? ? ? : 2345 > > <4>[ 6950.135406] ? .clock ? ? ? ? ? ? ? ? ? ? ? ? : 6946109.313964 > > <4>[ 6950.135437] ? .cpu_load[0] ? ? ? ? ? ? ? ? ? : 216626 > > <4>[ 6950.135437] ? .cpu_load[1] ? ? ? ? ? ? ? ? ? : 216865 > > <4>[ 6950.135437] ? .cpu_load[2] ? ? ? ? ? ? ? ? ? : 217114 > > <4>[ 6950.135467] ? .cpu_load[3] ? ? ? ? ? ? ? ? ? : 217240 > > <4>[ 6950.135467] ? .cpu_load[4] ? ? ? ? ? ? ? ? ? : 217318 > > <4>[ 6950.135467] ? .yld_count ? ? ? ? ? ? ? ? ? ? : 46326 > > <4>[ 6950.135498] ? .sched_switch ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.135498] ? .sched_count ? ? ? ? ? ? ? ? ? : 144442385 > > <4>[ 6950.135528] ? .sched_goidle ? ? ? ? ? ? ? ? ?: 2021081 > > <4>[ 6950.135528] ? .avg_idle ? ? ? ? ? ? ? ? ? ? ?: 51188 > > <4>[ 6950.135528] ? .ttwu_count ? ? ? ? ? ? ? ? ? ?: 93102282 > > <4>[ 6950.135559] ? .ttwu_local ? ? ? ? ? ? ? ? ? ?: 87445098 > > <4>[ 6950.135559] ? .bkl_count ? ? ? ? ? ? ? ? ? ? : 32006801 > > <4>[ 6950.135589] > > <4>[ 6950.135589] cfs_rq[0]:/bg_non_interactive > > <4>[ 6950.135589] ? .exec_clock ? ? ? ? ? ? ? ? ? ?: 7934.204110 > > <4>[ 6950.135620] ? .MIN_vruntime ? ? ? ? ? ? ? ? ?: 0.000001 > > <4>[ 6950.135620] ? .min_vruntime ? ? ? ? ? ? ? ? ?: 79877.877411 > > <4>[ 6950.135650] ? .max_vruntime ? ? ? ? ? ? ? ? ?: 0.000001 > > <4>[ 6950.135650] ? .spread ? ? ? ? ? ? ? ? ? ? ? ?: 0.000000 > > <4>[ 6950.135650] ? .spread0 ? ? ? ? ? ? ? ? ? ? ? : -2143179.551111 > > <4>[ 6950.135681] ? .nr_running ? ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.135681] ? .load ? ? ? ? ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.135711] ? .nr_spread_over ? ? ? ? ? ? ? ?: 390 > > <4>[ 6950.135711] ? .shares ? ? ? ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.135711] ? .se->exec_start ? ? ? ? ? ? ? ?: 6945754.943847 > > <4>[ 6950.135742] ? .se->vruntime ? ? ? ? ? ? ? ? ?: 2223057.623199 > > <4>[ 6950.135742] ? .se->sum_exec_runtime ? ? ? ? ?: 7934.417734 > > <4>[ 6950.135772] ? .se->statistics.wait_start ? ? : 0.000000 > > <4>[ 6950.135772] ? .se->statistics.sleep_start ? ?: 0.000000 > > <4>[ 6950.135803] ? .se->statistics.block_start ? ?: 0.000000 > > <4>[ 6950.135803] ? .se->statistics.sleep_max ? ? ?: 0.000000 > > <4>[ 6950.135803] ? .se->statistics.block_max ? ? ?: 0.000000 > > <4>[ 6950.135833] ? .se->statistics.exec_max ? ? ? : 7.843018 > > <4>[ 6950.135833] ? .se->statistics.slice_max ? ? ?: 12.329101 > > <4>[ 6950.135864] ? .se->statistics.wait_max ? ? ? : 45493.103028 > > <4>[ 6950.135864] ? .se->statistics.wait_sum ? ? ? : 722360.626242 > > <4>[ 6950.135894] ? .se->statistics.wait_count ? ? : 37054 > > <4>[ 6950.135894] ? .se->load.weight ? ? ? ? ? ? ? : 26 > > <4>[ 6950.135894] > > <4>[ 6950.135925] cfs_rq[0]:/fg_boost > > <4>[ 6950.135925] ? .exec_clock ? ? ? ? ? ? ? ? ? ?: 0.000000 > > <4>[ 6950.135925] ? .MIN_vruntime ? ? ? ? ? ? ? ? ?: 0.000001 > > <4>[ 6950.135955] ? .min_vruntime ? ? ? ? ? ? ? ? ?: -1.048576 > > <4>[ 6950.135955] ? .max_vruntime ? ? ? ? ? ? ? ? ?: 0.000001 > > <4>[ 6950.135986] ? .spread ? ? ? ? ? ? ? ? ? ? ? ?: 0.000000 > > <4>[ 6950.135986] ? .spread0 ? ? ? ? ? ? ? ? ? ? ? : -2223058.477098 > > <4>[ 6950.135986] ? .nr_running ? ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.136016] ? .load ? ? ? ? ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.136016] ? .nr_spread_over ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.136047] ? .shares ? ? ? ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.136047] ? .se->exec_start ? ? ? ? ? ? ? ?: 0.000000 > > <4>[ 6950.136047] ? .se->vruntime ? ? ? ? ? ? ? ? ?: 0.000000 > > <4>[ 6950.136077] ? .se->sum_exec_runtime ? ? ? ? ?: 0.000000 > > <4>[ 6950.136077] ? .se->statistics.wait_start ? ? : 0.000000 > > <4>[ 6950.136108] ? .se->statistics.sleep_start ? ?: 0.000000 > > <4>[ 6950.136108] ? .se->statistics.block_start ? ?: 0.000000 > > <4>[ 6950.136108] ? .se->statistics.sleep_max ? ? ?: 0.000000 > > <4>[ 6950.136138] ? .se->statistics.block_max ? ? ?: 0.000000 > > <4>[ 6950.136138] ? .se->statistics.exec_max ? ? ? : 0.000000 > > <4>[ 6950.136169] ? .se->statistics.slice_max ? ? ?: 0.000000 > > <4>[ 6950.136169] ? .se->statistics.wait_max ? ? ? : 0.000000 > > <4>[ 6950.136199] ? .se->statistics.wait_sum ? ? ? : 0.000000 > > <4>[ 6950.136199] ? .se->statistics.wait_count ? ? : 0 > > <4>[ 6950.136199] ? .se->load.weight ? ? ? ? ? ? ? : 512 > > <4>[ 6950.136230] > > <4>[ 6950.136230] cfs_rq[0]:/ > > <4>[ 6950.136230] ? .exec_clock ? ? ? ? ? ? ? ? ? ?: 6520265.283900 > > <4>[ 6950.136260] ? .MIN_vruntime ? ? ? ? ? ? ? ? ?: 2223057.428522 > > <4>[ 6950.136260] ? .min_vruntime ? ? ? ? ? ? ? ? ?: 2223057.428522 > > <4>[ 6950.136291] ? .max_vruntime ? ? ? ? ? ? ? ? ?: 2223114.709956 > > <4>[ 6950.136291] ? .spread ? ? ? ? ? ? ? ? ? ? ? ?: 57.281434 > > <4>[ 6950.136291] ? .spread0 ? ? ? ? ? ? ? ? ? ? ? : 0.000000 > > <4>[ 6950.136322] ? .nr_running ? ? ? ? ? ? ? ? ? ?: 212 > > <4>[ 6950.136322] ? .load ? ? ? ? ? ? ? ? ? ? ? ? ?: 217650 > > <4>[ 6950.136352] ? .nr_spread_over ? ? ? ? ? ? ? ?: 125034 > > <4>[ 6950.136352] ? .shares ? ? ? ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.136352] > > <4>[ 6950.136383] rt_rq[0]:/bg_non_interactive > > <4>[ 6950.136383] ? .rt_nr_running ? ? ? ? ? ? ? ? : 0 > > <4>[ 6950.136383] ? .rt_throttled ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.136413] ? .rt_time ? ? ? ? ? ? ? ? ? ? ? : 0.000000 > > <4>[ 6950.136413] ? .rt_runtime ? ? ? ? ? ? ? ? ? ?: 0.000000 > > <4>[ 6950.136413] > > <4>[ 6950.136444] rt_rq[0]:/fg_boost > > <4>[ 6950.136444] ? .rt_nr_running ? ? ? ? ? ? ? ? : 0 > > <4>[ 6950.136444] ? .rt_throttled ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.136474] ? .rt_time ? ? ? ? ? ? ? ? ? ? ? : 0.000000 > > <4>[ 6950.136474] ? .rt_runtime ? ? ? ? ? ? ? ? ? ?: 0.000000 > > <4>[ 6950.136505] > > <4>[ 6950.136505] rt_rq[0]:/ > > <4>[ 6950.136505] ? .rt_nr_running ? ? ? ? ? ? ? ? : 0 > > <4>[ 6950.136505] ? .rt_throttled ? ? ? ? ? ? ? ? ?: 0 > > <4>[ 6950.136535] ? .rt_time ? ? ? ? ? ? ? ? ? ? ? : 0.000000 > > <4>[ 6950.136535] ? .rt_runtime ? ? ? ? ? ? ? ? ? ?: 950.000000 > > <4>[ 6950.136566] > > <4>[ 6950.136566] runnable tasks: > > <4>[ 6950.136566] ? ? ? ? ? ? task ? PID ? ? ? ? tree-key ?switches > > prio ? ? exec-runtime ? ? ? ? sum-exec ? ? ? ?sum-sleep > > <4>[ 6950.136596] > > ---------------------------------------------------------------------------------------------------------- > > <4>[ 6950.136627] ? ? ?omap2_mcspi ? ?21 ? 2223062.886210 ?29451523 > > 120 ? 2223062.886210 ? 1177589.035038 ? 1648080.867813 / > > <4>[ 6950.136718] ? ? ? ?salt_lj_2 ?1683 ? 2223061.583766 ? ? ?2671 > > 120 ? 2223061.583766 ? ? ?6119.567813 ? 6395425.231938 / > > <4>[ 6950.136779] ?test-fb-refresh ?1644 ? 2223069.415582 ? ?672416 > > 120 ? 2223069.415582 ? 2846654.876990 ? ?711754.241756 / > > <4>[ 6950.136810] ?ActivityManager ?4634 ? 2223058.516356 ? ? 13709 > > 118 ? 2223058.516356 ? ? 38864.105043 ? 4091806.121829 / > > <4>[ 6950.137115] R ? ? ? crashspi ?2345 ? 2223052.428522 ? ? 17082 > > 120 ? 2223052.428522 ? ? ? 433.624298 ? ?237326.354921 / > > <4>[ 6950.137145] ? ? ? ? ? ? ? dd ?3030 ? 2223058.989726 ? ? ? 638 > > 120 ? 2223058.989726 ? ? ?2179.229733 ? ? 16940.704346 / > > <4>[ 6950.137207] ? ? ? ?hackbench ?3066 ? 2223057.672624 ? ? ?9610 > > 120 ? 2223057.672624 ? ? ? 393.890422 ? ? ? 197.662353 / > > <4>[ 6950.137237] ? ? ? ?hackbench ?3067 ? 2223058.832266 ? ? ?9197 > > 120 ? 2223058.832266 ? ? ? 395.019547 ? ? ? 193.176269 / > > <4>[ 6950.137268] ? ? ? ?hackbench ?3068 ? 2223057.764114 ? ? ?9466 > > 120 ? 2223057.764114 ? ? ? 393.951394 ? ? ? 197.631836 / > > <4>[ 6950.137298] ? ? ? ?hackbench ?3069 ? 2223057.916691 ? ? ?9308 > > 120 ? 2223057.916691 ? ? ? 394.103971 ? ? ? 193.145752 / > > <4>[ 6950.137329] ? ? ? ?hackbench ?3070 ? 2223057.733619 ? ? ?9395 > > 120 ? 2223057.733619 ? ? ? 393.920900 ? ? ? 193.115234 / > > <4>[ 6950.137359] ? ? ? ?hackbench ?3071 ? 2223059.290012 ? ? ?9357 > > 120 ? 2223059.290012 ? ? ? 395.507810 ? ? ? 197.540284 / > > <4>[ 6950.137420] ? ? ? ?hackbench ?3072 ? 2223058.313450 ? ? ?9501 > > 120 ? 2223058.313450 ? ? ? 394.500730 ? ? ? 193.054199 / > > <4>[ 6950.137451] ? ? ? ?hackbench ?3073 ? 2223057.977845 ? ? ?9588 > > 120 ? 2223057.977845 ? ? ? 394.165126 ? ? ? 197.509766 / > > <4>[ 6950.137481] ? ? ? ?hackbench ?3074 ? 2223058.649040 ? ? ?9272 > > 120 ? 2223058.649040 ? ? ? 394.836321 ? ? ? 197.479248 / > > <4>[ 6950.137512] ? ? ? ?hackbench ?3075 ? 2223058.221896 ? ? ?9536 > > 120 ? 2223058.221896 ? ? ? 394.439694 ? ? ? 197.357178 / > > <4>[ 6950.137542] ? ? ? ?hackbench ?3076 ? 2223058.160997 ? ? ?9151 > > 120 ? 2223058.160997 ? ? ? 394.348277 ? ? ? 197.418213 / > > <4>[ 6950.137573] ? ? ? ?hackbench ?3077 ? 2223057.733577 ? ? ?9574 > > 120 ? 2223057.733577 ? ? ? 393.951375 ? ? ? 192.993164 / > > <4>[ 6950.137603] ? ? ? ?hackbench ?3078 ? 2223058.710150 ? ? ?9455 > > 120 ? 2223058.710150 ? ? ? 394.897431 ? ? ? 197.296142 / > > <4>[ 6950.137664] ? ? ? ?hackbench ?3079 ? 2223057.947243 ? ? ?8920 > > 120 ? 2223057.947243 ? ? ? 394.134524 ? ? ? 192.962646 / > > <4>[ 6950.137695] ? ? ? ?hackbench ?3080 ? 2223057.733599 ? ? ?9466 > > 120 ? 2223057.733599 ? ? ? 393.920880 ? ? ? 197.326660 / > > <4>[ 6950.137725] ? ? ? ?hackbench ?3081 ? 2223058.984851 ? ? ?9557 > > 120 ? 2223058.984851 ? ? ? 395.172132 ? ? ? 192.901611 / > > <4>[ 6950.137756] ? ? ? ?hackbench ?3082 ? 2223058.435540 ? ? ?8960 > > 120 ? 2223058.435540 ? ? ? 394.653338 ? ? ? 192.840576 / > > <4>[ 6950.137786] ? ? ? ?hackbench ?3083 ? 2223057.794693 ? ? ?9513 > > 120 ? 2223057.794693 ? ? ? 393.981973 ? ? ? 197.235108 / > > <4>[ 6950.137817] ? ? ? ?hackbench ?3084 ? 2223058.862755 ? ? ?9145 > > 120 ? 2223058.862755 ? ? ? 395.050035 ? ? ? 192.810059 / > > <4>[ 6950.137847] ? ? ? ?hackbench ?3085 ? 2223057.855681 ? ? ?9013 > > 120 ? 2223057.855681 ? ? ? 394.042962 ? ? ? 192.749023 / > > <4>[ 6950.137908] ? ? ? ?hackbench ?3106 ? 2223057.916697 ? ? ?7399 > > 120 ? 2223057.916697 ? ? ? 394.134495 ? ? ? 164.001465 / > > <4>[ 6950.137939] ? ? ? ?hackbench ?3107 ? 2223058.221850 ? ? ?7661 > > 120 ? 2223058.221850 ? ? ? 394.439648 ? ? ? 163.940430 / > > <4>[ 6950.137969] ? ? ? ?hackbench ?3108 ? 2223058.099761 ? ? ?7428 > > 120 ? 2223058.099761 ? ? ? 394.287041 ? ? ? 163.879395 / > > <4>[ 6950.138000] ? ? ? ?hackbench ?3109 ? 2223058.343988 ? ? ?7831 > > 120 ? 2223058.343988 ? ? ? 394.561785 ? ? ? 162.231446 / > > <4>[ 6950.138031] ? ? ? ?hackbench ?3110 ? 2223057.550561 ? ? ?7632 > > 120 ? 2223057.550561 ? ? ? 393.737842 ? ? ? 163.848877 / > > <4>[ 6950.138061] ? ? ? ?hackbench ?3111 ? 2223058.038736 ? ? ?6971 > > 120 ? 2223058.038736 ? ? ? 394.256534 ? ? ? 163.787842 / > > <4>[ 6950.138122] ? ? ? ?hackbench ?3112 ? 2223059.045885 ? ? ?7666 > > 120 ? 2223059.045885 ? ? ? 395.233166 ? ? ? 162.200928 / > > <4>[ 6950.138153] ? ? ? ?hackbench ?3113 ? 2223059.106955 ? ? ?7683 > > 120 ? 2223059.106955 ? ? ? 395.294236 ? ? ? 163.726806 / > > <4>[ 6950.138183] ? ? ? ?hackbench ?3114 ? 2223057.581077 ? ? ?7724 > > 120 ? 2223057.581077 ? ? ? 393.768358 ? ? ? 162.170410 / > > <4>[ 6950.138214] ? ? ? ?hackbench ?3115 ? 2223057.886195 ? ? ?7580 > > 120 ? 2223057.886195 ? ? ? 394.073475 ? ? ? 163.696289 / > > <4>[ 6950.138244] ? ? ? ?hackbench ?3116 ? 2223058.832318 ? ? ?3037 > > 120 ? 2223058.832318 ? ? ? 314.117462 ? ? ? 471.862792 / > > <4>[ 6950.138275] ? ? ? ?hackbench ?3117 ? 2223058.404983 ? ? ?7230 > > 120 ? 2223058.404983 ? ? ? 394.592264 ? ? ? 163.665771 / > > <4>[ 6950.138305] ? ? ? ?hackbench ?3118 ? 2223059.168044 ? ? ?7859 > > 120 ? 2223059.168044 ? ? ? 395.355324 ? ? ? 516.845703 / > > <4>[ 6950.138366] ? ? ? ?hackbench ?3119 ? 2223058.343964 ? ? ?7533 > > 120 ? 2223058.343964 ? ? ? 394.561762 ? ? ? 163.604736 / > > <4>[ 6950.138397] ? ? ? ?hackbench ?3120 ? 2223058.649172 ? ? ?7738 > > 120 ? 2223058.649172 ? ? ? 394.836453 ? ? ? 163.543701 / > > <4>[ 6950.138427] ? ? ? ?hackbench ?3121 ? 2223057.947257 ? ? ?3433 > > 120 ? 2223057.947257 ? ? ? 313.201884 ? ? ? 471.740722 / > > <4>[ 6950.138458] ? ? ? ?hackbench ?3122 ? 2223059.015328 ? ? ?7743 > > 120 ? 2223059.015328 ? ? ? 395.233126 ? ? ? 516.693117 / > > <4>[ 6950.138488] ? ? ? ?hackbench ?3123 ? 2223058.282921 ? ? ?7757 > > 120 ? 2223058.282921 ? ? ? 394.470201 ? ? ? 163.513184 / > > <4>[ 6950.138519] ? ? ? ?hackbench ?3124 ? 2223057.550511 ? ? ?7373 > > 120 ? 2223057.550511 ? ? ? 393.737792 ? ? ? 516.693116 / > > <4>[ 6950.138549] ? ? ? ?hackbench ?3125 ? 2223057.550537 ? ? ?7566 > > 120 ? 2223057.550537 ? ? ? 393.737818 ? ? ? 163.482666 / > > <4>[ 6950.138610] ? ? ? ?hackbench ?3146 ? 2223058.221875 ? ? ?9126 > > 120 ? 2223058.221875 ? ? ? 394.409155 ? ? ? 147.613526 / > > <4>[ 6950.138641] ? ? ? ?hackbench ?3147 ? 2223073.145025 ? ? ?9818 > > 120 ? 2223073.145025 ? ? ? 409.332306 ? ? ? 157.928467 / > > <4>[ 6950.138671] ? ? ? ?hackbench ?3148 ? 2223057.977772 ? ? ?9457 > > 120 ? 2223057.977772 ? ? ? 394.165053 ? ? ? 147.552490 / > > <4>[ 6950.138702] ? ? ? ?hackbench ?3149 ? 2223058.984894 ? ? ?9508 > > 120 ? 2223058.984894 ? ? ? 395.202692 ? ? ? 147.491455 / > > <4>[ 6950.138732] ? ? ? ?hackbench ?3150 ? 2223102.045087 ? ? 10882 > > 120 ? 2223102.045087 ? ? ? 438.232368 ? ? ? 157.745361 / > > <4>[ 6950.138763] ? ? ? ?hackbench ?3151 ? 2223059.442607 ? ? ?9630 > > 120 ? 2223059.442607 ? ? ? 395.629888 ? ? ? 147.460937 / > > <4>[ 6950.138824] ? ? ? ?hackbench ?3152 ? 2223058.405016 ? ? ?9648 > > 120 ? 2223058.405016 ? ? ? 394.592296 ? ? ? 157.836914 / > > <4>[ 6950.138854] ? ? ? ?hackbench ?3153 ? 2223058.527088 ? ? ?9373 > > 120 ? 2223058.527088 ? ? ? 394.714368 ? ? ? 157.714844 / > > <4>[ 6950.138885] ? ? ? ?hackbench ?3154 ? 2223058.282932 ? ? ?9576 > > 120 ? 2223058.282932 ? ? ? 394.470213 ? ? ? 157.470703 / > > <4>[ 6950.138916] ? ? ? ?hackbench ?3155 ? 2223058.893246 ? ? ?8810 > > 120 ? 2223058.893246 ? ? ? 395.080526 ? ? ? 147.399903 / > > <4>[ 6950.138946] ? ? ? ?hackbench ?3156 ? 2223058.130297 ? ? ?9568 > > 120 ? 2223058.130297 ? ? ? 394.317578 ? ? ? 157.562256 / > > <4>[ 6950.138977] ? ? ? ?hackbench ?3157 ? 2223059.412138 ? ? ?9432 > > 120 ? 2223059.412138 ? ? ? 395.599418 ? ? ? 157.501221 / > > <4>[ 6950.139007] ? ? ? ?hackbench ?3158 ? 2223058.740634 ? ? ?9527 > > 120 ? 2223058.740634 ? ? ? 394.927915 ? ? ? 147.369385 / > > <4>[ 6950.139068] ? ? ? ?hackbench ?3159 ? 2223058.221865 ? ? ?9193 > > 120 ? 2223058.221865 ? ? ? 394.409146 ? ? ? 157.653809 / > > <4>[ 6950.139099] ? ? ? ?hackbench ?3160 ? 2223058.282916 ? ? ?9580 > > 120 ? 2223058.282916 ? ? ? 394.500714 ? ? ? 147.308350 / > > <4>[ 6950.139129] ? ? ? ?hackbench ?3161 ? 2223058.832267 ? ? ?8928 > > 120 ? 2223058.832267 ? ? ? 395.019548 ? ? ? 445.556640 / > > <4>[ 6950.139160] ? ? ? ?hackbench ?3162 ? 2223058.069307 ? ? ?9401 > > 120 ? 2223058.069307 ? ? ? 394.287105 ? ? ? 157.592774 / > > <4>[ 6950.139190] ? ? ? ?hackbench ?3163 ? 2223059.076440 ? ? ?9460 > > 120 ? 2223059.076440 ? ? ? 395.263720 ? ? ? 147.216797 / > > <4>[ 6950.139221] ? ? ? ?hackbench ?3164 ? 2223058.069300 ? ? ?9206 > > 120 ? 2223058.069300 ? ? ? 394.256581 ? ? ? 157.379150 / > > <4>[ 6950.139251] ? ? ? ?hackbench ?3165 ? 2223059.412122 ? ? ?8881 > > 120 ? 2223059.412122 ? ? ? 395.629920 ? ? ? 157.409668 / > > <4>[ 6950.139312] ? ? ? ?hackbench ?3186 ? 2223057.764144 ? ? ?5252 > > 120 ? 2223057.764144 ? ? ? 393.981942 ? ? ? 128.143310 / > > <4>[ 6950.139343] ? ? ? ?hackbench ?3187 ? 2223059.320515 ? ? ?5568 > > 120 ? 2223059.320515 ? ? ? 395.507795 ? ? ? 128.082276 / > > <4>[ 6950.139373] ? ? ? ?hackbench ?3188 ? 2223057.550470 ? ? ?5303 > > 120 ? 2223057.550470 ? ? ? 393.737751 ? ? ? 128.051758 / > > <4>[ 6950.139404] ? ? ? ?hackbench ?3189 ? 2223058.496557 ? ? ?5096 > > 120 ? 2223058.496557 ? ? ? 394.714355 ? ? ? 127.990723 / > > <4>[ 6950.139434] ? ? ? ?hackbench ?3190 ? 2223058.893313 ? ? ?5242 > > 120 ? 2223058.893313 ? ? ? 395.080594 ? ? ? 127.960205 / > > <4>[ 6950.139465] ? ? ? ?hackbench ?3191 ? 2223057.733573 ? ? ?5030 > > 120 ? 2223057.733573 ? ? ? 393.920853 ? ? ? 127.899170 / > > <4>[ 6950.139526] ? ? ? ?hackbench ?3192 ? 2223058.343903 ? ? ?5208 > > 120 ? 2223058.343903 ? ? ? 394.561701 ? ? ? 127.838135 / > > <4>[ 6950.139556] ? ? ? ?hackbench ?3193 ? 2223058.557565 ? ? ?5208 > > 120 ? 2223058.557565 ? ? ? 394.744846 ? ? ? 127.807617 / > > <4>[ 6950.139587] ? ? ? ?hackbench ?3194 ? 2223057.489480 ? ? ?5099 > > 120 ? 2223057.489480 ? ? ? 393.676761 ? ? ? 127.746582 / > > <4>[ 6950.139617] ? ? ? ?hackbench ?3195 ? 2223058.557600 ? ? ?5235 > > 120 ? 2223058.557600 ? ? ? 394.744880 ? ? ? 233.428958 / > > <4>[ 6950.139648] ? ? ? ?hackbench ?3196 ? 2223058.557583 ? ? ?5422 > > 120 ? 2223058.557583 ? ? ? 394.775381 ? ? ? 127.685547 / > > <4>[ 6950.139678] ? ? ? ?hackbench ?3197 ? 2223057.733636 ? ? ?4665 > > 120 ? 2223057.733636 ? ? ? 312.988263 ? ? ? 232.971190 / > > <4>[ 6950.139709] ? ? ? ?hackbench ?3198 ? 2223058.069299 ? ? ?4848 > > 120 ? 2223058.069299 ? ? ? 394.256580 ? ? ? 233.245849 / > > <4>[ 6950.139739] ? ? ? ?hackbench ?3199 ? 2223097.711703 ? ? ?6751 > > 120 ? 2223097.711703 ? ? ? 433.898983 ? ? ? 179.016113 / > > <4>[ 6950.139801] ? ? ? ?hackbench ?3200 ? 2223058.771274 ? ? ?4300 > > 120 ? 2223058.771274 ? ? ? 314.056418 ? ? ? 127.349854 / > > <4>[ 6950.139831] ? ? ? ?hackbench ?3201 ? 2223058.466064 ? ? ?5259 > > 120 ? 2223058.466064 ? ? ? 394.683862 ? ? ? 213.226320 / > > <4>[ 6950.139862] ? ? ? ?hackbench ?3202 ? 2223058.618645 ? ? ?4705 > > 120 ? 2223058.618645 ? ? ? 313.873272 ? ? ? 127.319336 / > > <4>[ 6950.139892] ? ? ? ?hackbench ?3203 ? 2223059.015430 ? ? ?4845 > > 120 ? 2223059.015430 ? ? ? 314.270057 ? ? ? 127.410889 / > > <4>[ 6950.139923] ? ? ? ?hackbench ?3204 ? 2223058.801745 ? ? ?5110 > > 120 ? 2223058.801745 ? ? ? 395.019543 ? ? ? 136.474609 / > > <4>[ 6950.139953] ? ? ? ?hackbench ?3205 ? 2223058.649169 ? ? ?4757 > > 120 ? 2223058.649169 ? ? ? 313.903795 ? ? ? 127.258301 / > > <4>[ 6950.140014] ? ? ? ?hackbench ?3226 ? 2223058.679731 ? ? ?6443 > > 120 ? 2223058.679731 ? ? ? 313.964875 ? ? ? 152.099610 / > > <4>[ 6950.140045] ? ? ? ?hackbench ?3227 ? 2223098.962891 ? ? ?7276 > > 120 ? 2223098.962891 ? ? ? 354.217518 ? ? ? 152.130127 / > > <4>[ 6950.140075] ? ? ? ?hackbench ?3228 ? 2223059.076460 ? ? ?5924 > > 120 ? 2223059.076460 ? ? ? 314.331087 ? ? ? 152.069092 / > > <4>[ 6950.140106] ? ? ? ?hackbench ?3229 ? 2223058.679697 ? ? ?3712 > > 120 ? 2223058.679697 ? ? ? 394.897496 ? ? ? 122.253417 / > > <4>[ 6950.140136] ? ? ? ?hackbench ?3230 ? 2223058.984841 ? ? ?3425 > > 120 ? 2223058.984841 ? ? ? 395.172121 ? ? ? 122.222900 / > > <4>[ 6950.140167] ? ? ? ?hackbench ?3231 ? 2223057.520020 ? ? ?6199 > > 120 ? 2223057.520020 ? ? ? 312.805164 ? ? ? 152.099609 / > > <4>[ 6950.140228] ? ? ? ?hackbench ?3232 ? 2223057.886169 ? ? ?3575 > > 120 ? 2223057.886169 ? ? ? 394.103967 ? ? ? 122.161865 / > > <4>[ 6950.140258] ? ? ? ?hackbench ?3233 ? 2223058.740636 ? ? ?6318 > > 120 ? 2223058.740636 ? ? ? 313.995262 ? ? ? 126.495362 / > > <4>[ 6950.140289] ? ? ? ?hackbench ?3234 ? 2223058.832260 ? ? ?3353 > > 120 ? 2223058.832260 ? ? ? 395.019541 ? ? ? 122.131347 / > > <4>[ 6950.140319] ? ? ? ?hackbench ?3235 ? 2223058.984873 ? ? ?3566 > > 120 ? 2223058.984873 ? ? ? 395.172153 ? ? ? 122.070313 / > > <4>[ 6950.140350] ? ? ? ?hackbench ?3236 ? 2223058.923805 ? ? ?6362 > > 120 ? 2223058.923805 ? ? ? 314.178432 ? ? ? 126.434326 / > > <4>[ 6950.140380] ? ? ? ?hackbench ?3237 ? 2223058.954306 ? ? ?5879 > > 120 ? 2223058.954306 ? ? ? 314.208932 ? ? ? 126.403809 / > > <4>[ 6950.140411] ? ? ? ?hackbench ?3238 ? 2223058.862741 ? ? ?6144 > > 120 ? 2223058.862741 ? ? ? 314.147886 ? ? ? 126.342773 / > > <4>[ 6950.140472] ? ? ? ?hackbench ?3239 ? 2223059.381590 ? ? ?6495 > > 120 ? 2223059.381590 ? ? ? 314.666734 ? ? ? 110.717774 / > > <4>[ 6950.140502] ? ? ? ?hackbench ?3240 ? 2223058.588091 ? ? ?3647 > > 120 ? 2223058.588091 ? ? ? 394.775371 ? ? ? ?89.355469 / > > <4>[ 6950.140533] ? ? ? ?hackbench ?3241 ? 2223057.764225 ? ? ?6466 > > 120 ? 2223057.764225 ? ? ? 313.049370 ? ? ? 110.656738 / > > <4>[ 6950.140563] ? ? ? ?hackbench ?3242 ? 2223058.221896 ? ? ?3157 > > 120 ? 2223058.221896 ? ? ? 394.409177 ? ? ? ?89.294434 / > > <4>[ 6950.140594] ? ? ? ?hackbench ?3243 ? 2223058.588163 ? ? ?6417 > > 120 ? 2223058.588163 ? ? ? 313.842789 ? ? ? 110.595703 / > > <4>[ 6950.140625] ? ? ? ?hackbench ?3244 ? 2223059.442554 ? ? ?3648 > > 120 ? 2223059.442554 ? ? ? 395.660352 ? ? ? ?88.806153 / > > <4>[ 6950.140655] ? ? ? ?hackbench ?3245 ? 2223057.855737 ? ? ?5957 > > 120 ? 2223057.855737 ? ? ? 313.140881 ? ? ? 100.616455 / > > <4>[ 6950.140716] ? ? ? ?hackbench ?3266 ? 2223057.947276 ? ? ?7480 > > 120 ? 2223057.947276 ? ? ? 313.201903 ? ? ? ?77.270508 / > > <4>[ 6950.140747] ? ? ? ?hackbench ?3267 ? 2223058.191358 ? ? ?7487 > > 120 ? 2223058.191358 ? ? ? 313.476502 ? ? ? ?77.209473 / > > <4>[ 6950.140777] ? ? ? ?hackbench ?3268 ? 2223059.106873 ? ? ?7480 > > 120 ? 2223059.106873 ? ? ? 314.361500 ? ? ? ?77.178955 / > > <4>[ 6950.140808] ? ? ? ?hackbench ?3269 ? 2223059.290019 ? ? ?7645 > > 120 ? 2223059.290019 ? ? ? 314.544645 ? ? ? ?77.148438 / > > <4>[ 6950.140838] ? ? ? ?hackbench ?3270 ? 2223057.428522 ? ? ?7512 > > 120 ? 2223057.428522 ? ? ? 312.713666 ? ? ? ?77.056885 / > > <4>[ 6950.140869] ? ? ? ?hackbench ?3271 ? 2223058.679698 ? ? ?7515 > > 120 ? 2223058.679698 ? ? ? 313.934325 ? ? ? 131.988525 / > > <4>[ 6950.140930] ? ? ? ?hackbench ?3272 ? 2223059.412048 ? ? ?7623 > > 120 ? 2223059.412048 ? ? ? 314.666675 ? ? ? 132.019042 / > > <4>[ 6950.140960] ? ? ? ?hackbench ?3273 ? 2223057.947316 ? ? ?7492 > > 120 ? 2223057.947316 ? ? ? 313.201943 ? ? ? ?76.995849 / > > <4>[ 6950.140991] ? ? ? ?hackbench ?3274 ? 2223058.771171 ? ? ?7539 > > 120 ? 2223058.771171 ? ? ? 314.025798 ? ? ? ?77.026367 / > > <4>[ 6950.141021] ? ? ? ?hackbench ?3275 ? 2223059.106900 ? ? ?7496 > > 120 ? 2223059.106900 ? ? ? 314.361527 ? ? ? ?76.843262 / > > <4>[ 6950.141052] ? ? ? ?hackbench ?3276 ? 2223057.794724 ? ? ?7502 > > 120 ? 2223057.794724 ? ? ? 313.079868 ? ? ? 131.988525 / > > <4>[ 6950.141082] ? ? ? ?hackbench ?3277 ? 2223058.740749 ? ? ?7628 > > 120 ? 2223058.740749 ? ? ? 313.995375 ? ? ? 131.958008 / > > <4>[ 6950.141113] ? ? ? ?hackbench ?3278 ? 2223058.710230 ? ? ?7585 > > 120 ? 2223058.710230 ? ? ? 314.025891 ? ? ? ?76.873780 / > > <4>[ 6950.141174] ? ? ? ?hackbench ?3279 ? 2223057.611597 ? ? ?7460 > > 120 ? 2223057.611597 ? ? ? 312.866224 ? ? ? ?87.249756 / > > <4>[ 6950.141204] ? ? ? ?hackbench ?3280 ? 2223057.489500 ? ? ?7366 > > 120 ? 2223057.489500 ? ? ? 312.774644 ? ? ? ?76.751709 / > > <4>[ 6950.141235] ? ? ? ?hackbench ?3281 ? 2223058.221939 ? ? ?7505 > > 120 ? 2223058.221939 ? ? ? 313.507083 ? ? ? ?87.188721 / > > <4>[ 6950.141265] ? ? ? ?hackbench ?3282 ? 2223058.222022 ? ? ?7461 > > 120 ? 2223058.222022 ? ? ? 313.476649 ? ? ? ?76.660156 / > > <4>[ 6950.141296] ? ? ? ?hackbench ?3283 ? 2223058.527082 ? ? ?7568 > > 120 ? 2223058.527082 ? ? ? 313.781709 ? ? ? ?76.812744 / > > <4>[ 6950.141326] ? ? ? ?hackbench ?3284 ? 2223058.649179 ? ? ?7527 > > 120 ? 2223058.649179 ? ? ? 313.903806 ? ? ? ?87.127685 / > > <4>[ 6950.141357] ? ? ? ?hackbench ?3285 ? 2223058.954322 ? ? ?7549 > > 120 ? 2223058.954322 ? ? ? 314.239466 ? ? ? ?76.599121 / > > <4>[ 6950.141418] ? ? ? ?hackbench ?3306 ? 2223058.588151 ? ? ?7570 > > 120 ? 2223058.588151 ? ? ? 313.873295 ? ? ? 123.596191 / > > <4>[ 6950.141448] ? ? ? ?hackbench ?3307 ? 2223059.320521 ? ? ?7491 > > 120 ? 2223059.320521 ? ? ? 314.605665 ? ? ? ?74.645996 / > > <4>[ 6950.141479] ? ? ? ?hackbench ?3308 ? 2223058.435490 ? ? ?7445 > > 120 ? 2223058.435490 ? ? ? 313.690117 ? ? ? 123.596191 / > > <4>[ 6950.141510] ? ? ? ?hackbench ?3309 ? 2223058.405116 ? ? ?7464 > > 120 ? 2223058.405116 ? ? ? 313.659743 ? ? ? ?74.615478 / > > <4>[ 6950.141540] ? ? ? ?hackbench ?3310 ? 2223058.984904 ? ? ?7489 > > 120 ? 2223058.984904 ? ? ? 314.270048 ? ? ? 123.565674 / > > <4>[ 6950.141571] ? ? ? ?hackbench ?3311 ? 2223059.290113 ? ? ?7560 > > 120 ? 2223059.290113 ? ? ? 314.544740 ? ? ? 123.565674 / > > <4>[ 6950.141632] ? ? ? ?hackbench ?3312 ? 2223058.740716 ? ? ?7601 > > 120 ? 2223058.740716 ? ? ? 313.995342 ? ? ? ?74.554444 / > > <4>[ 6950.141662] ? ? ? ?hackbench ?3313 ? 2223058.313453 ? ? ?7525 > > 120 ? 2223058.313453 ? ? ? 313.598597 ? ? ? ?74.493409 / > > <4>[ 6950.141693] ? ? ? ?hackbench ?3314 ? 2223058.343951 ? ? ?7484 > > 120 ? 2223058.343951 ? ? ? 313.598578 ? ? ? ?74.462891 / > > <4>[ 6950.141723] ? ? ? ?hackbench ?3315 ? 2223058.862795 ? ? ?7314 > > 120 ? 2223058.862795 ? ? ? 314.117421 ? ? ? ?75.927735 / > > <4>[ 6950.141754] ? ? ? ?hackbench ?3316 ? 2223057.733614 ? ? ?7530 > > 120 ? 2223057.733614 ? ? ? 313.049277 ? ? ? ?55.023193 / > > <4>[ 6950.141784] ? ? ? ?hackbench ?3317 ? 2223057.611637 ? ? ?7407 > > 120 ? 2223057.611637 ? ? ? 312.896782 ? ? ? ?70.098877 / > > <4>[ 6950.141815] ? ? ? ?hackbench ?3318 ? 2223058.069358 ? ? ?7538 > > 120 ? 2223058.069358 ? ? ? 313.385019 ? ? ? ?54.901123 / > > <4>[ 6950.141845] ? ? ? ?hackbench ?3319 ? 2223057.489559 ? ? ?7450 > > 120 ? 2223057.489559 ? ? ? 312.744185 ? ? ? ?70.037842 / > > <4>[ 6950.141906] ? ? ? ?hackbench ?3320 ? 2223058.771222 ? ? ?7525 > > 120 ? 2223058.771222 ? ? ? 314.025849 ? ? ? ?54.870605 / > > <4>[ 6950.141937] ? ? ? ?hackbench ?3321 ? 2223058.771264 ? ? ?7560 > > 120 ? 2223058.771264 ? ? ? 314.056408 ? ? ? ?69.976807 / > > <4>[ 6950.141967] ? ? ? ?hackbench ?3322 ? 2223058.801787 ? ? ?7552 > > 120 ? 2223058.801787 ? ? ? 314.086931 ? ? ? ?54.809570 / > > <4>[ 6950.141998] ? ? ? ?hackbench ?3323 ? 2223063.501453 ? ? ?7662 > > 120 ? 2223063.501453 ? ? ? 318.756080 ? ? ? ?69.946289 / > > <4>[ 6950.142028] ? ? ? ?hackbench ?3324 ? 2223058.557622 ? ? ?7429 > > 120 ? 2223058.557622 ? ? ? 313.812249 ? ? ? ?54.748535 / > > <4>[ 6950.142059] ? ? ? ?hackbench ?3325 ? 2223059.045915 ? ? ?7546 > > 120 ? 2223059.045915 ? ? ? 314.331059 ? ? ? ?69.854736 / > > <4>[ 6950.142120] ? ? ? ?hackbench ?3346 ? 2223058.618603 ? ? ?5936 > > 120 ? 2223058.618603 ? ? ? 313.873230 ? ? ? 138.793945 / > > <4>[ 6950.142150] ? ? ? ?hackbench ?3347 ? 2223058.008418 ? ? ?5961 > > 120 ? 2223058.008418 ? ? ? 313.293562 ? ? ? 138.793945 / > > <4>[ 6950.142181] ? ? ? ?hackbench ?3348 ? 2223058.282914 ? ? ?6214 > > 120 ? 2223058.282914 ? ? ? 313.568058 ? ? ? 138.732911 / > > <4>[ 6950.142211] ? ? ? ?hackbench ?3349 ? 2223058.099899 ? ? ?6215 > > 120 ? 2223058.099899 ? ? ? 313.385043 ? ? ? 138.763429 / > > <4>[ 6950.142242] ? ? ? ?hackbench ?3350 ? 2223058.771209 ? ? ?6163 > > 120 ? 2223058.771209 ? ? ? 314.056353 ? ? ? ?32.104493 / > > <4>[ 6950.142272] ? ? ? ?hackbench ?3351 ? 2223058.710174 ? ? ?6207 > > 120 ? 2223058.710174 ? ? ? 313.995318 ? ? ? ?32.043458 / > > <4>[ 6950.142333] ? ? ? ?hackbench ?3352 ? 2223057.550538 ? ? ?6070 > > 120 ? 2223057.550538 ? ? ? 312.835682 ? ? ? ?31.890869 / > > <4>[ 6950.142364] ? ? ? ?hackbench ?3353 ? 2223058.069267 ? ? ?3653 > > 120 ? 2223058.069267 ? ? ? 394.256548 ? ? ? ?35.186767 / > > <4>[ 6950.142395] ? ? ? ?hackbench ?3354 ? 2223058.679696 ? ? ?6022 > > 120 ? 2223058.679696 ? ? ? 313.964841 ? ? ? ?31.951904 / > > <4>[ 6950.142425] ? ? ? ?hackbench ?3355 ? 2223058.343969 ? ? ?3779 > > 120 ? 2223058.343969 ? ? ? 394.531250 ? ? ? ?35.095214 / > > <4>[ 6950.142456] ? ? ? ?hackbench ?3356 ? 2223059.442623 ? ? ?6049 > > 120 ? 2223059.442623 ? ? ? 314.697250 ? ? ? ?31.768798 / > > <4>[ 6950.142486] ? ? ? ?hackbench ?3357 ? 2223059.412094 ? ? ?3800 > > 120 ? 2223059.412094 ? ? ? 395.629892 ? ? ? ?64.361572 / > > <4>[ 6950.142517] ? ? ? ?hackbench ?3358 ? 2223058.527132 ? ? ?6159 > > 120 ? 2223058.527132 ? ? ? 313.812276 ? ? ? 139.129638 / > > <4>[ 6950.142547] ? ? ? ?hackbench ?3359 ? 2223057.855719 ? ? ?3752 > > 120 ? 2223057.855719 ? ? ? 394.043000 ? ? ? 142.486572 / > > <4>[ 6950.142608] ? ? ? ?hackbench ?3360 ? 2223059.320504 ? ? ?3754 > > 120 ? 2223059.320504 ? ? ? 395.538302 ? ? ? ?34.942627 / > > <4>[ 6950.142639] ? ? ? ?hackbench ?3361 ? 2223059.442588 ? ? ?6178 > > 120 ? 2223059.442588 ? ? ? 314.697215 ? ? ? ?31.646728 / > > <4>[ 6950.142669] ? ? ? ?hackbench ?3362 ? 2223059.289979 ? ? ?3781 > > 120 ? 2223059.289979 ? ? ? 395.477260 ? ? ? ?34.820556 / > > <4>[ 6950.142700] ? ? ? ?hackbench ?3363 ? 2223058.862838 ? ? ?6280 > > 120 ? 2223058.862838 ? ? ? 314.117464 ? ? ? ?31.494141 / > > <4>[ 6950.142730] ? ? ? ?hackbench ?3364 ? 2223058.374486 ? ? ?3574 > > 120 ? 2223058.374486 ? ? ? 394.561766 ? ? ? ?35.064697 / > > <4>[ 6950.142761] ? ? ? ?hackbench ?3365 ? 2223058.923857 ? ? ?6232 > > 120 ? 2223058.923857 ? ? ? 314.239518 ? ? ? ?81.695556 / > > <4>[ 6950.142822] ? ? ? ?hackbench ?3386 ? 2223057.855737 ? ? ?6944 > > 120 ? 2223057.855737 ? ? ? 313.110363 ? ? ? 697.662355 / > > <4>[ 6950.142852] ? ? ? ?hackbench ?3387 ? 2223057.732209 ? ? ?3013 > > 120 ? 2223057.732209 ? ? ? 393.646224 ? ? ? ?56.457520 / > > <4>[ 6950.142883] ? ? ? ?hackbench ?3388 ? 2223059.045915 ? ? ?7227 > > 120 ? 2223059.045915 ? ? ? 314.300542 ? ? ? ?30.944824 / > > <4>[ 6950.142913] ? ? ? ?hackbench ?3389 ? 2223058.493195 ? ? ?7140 > > 120 ? 2223058.493195 ? ? ? 313.781777 ? ? ? ?30.914307 / > > <4>[ 6950.142944] ? ? ? ?hackbench ?3391 ? 2223057.943836 ? ? ?7163 > > 120 ? 2223057.943836 ? ? ? 313.293453 ? ? ? ?20.538330 / > > <4>[ 6950.142974] ? ? ? ?hackbench ?3392 ? 2223057.913266 ? ? ?7054 > > 120 ? 2223057.913266 ? ? ? 313.201849 ? ? ? ?20.507812 / > > <4>[ 6950.143005] ? ? ? ?hackbench ?3393 ? 2223058.859329 ? ? ?6962 > > 120 ? 2223058.859329 ? ? ? 314.147912 ? ? ? ?20.477294 / > > <4>[ 6950.143066] ? ? ? ?hackbench ?3394 ? 2223058.584693 ? ? ?7180 > > 120 ? 2223058.584693 ? ? ? 313.873275 ? ? ? ?20.416260 / > > <4>[ 6950.143096] ? ? ? ?hackbench ?3395 ? 2223059.042494 ? ? ?7120 > > 120 ? 2223059.042494 ? ? ? 314.361594 ? ? ? ?20.355225 / > > <4>[ 6950.143127] ? ? ? ?hackbench ?3396 ? 2223058.187924 ? ? ?7083 > > 120 ? 2223058.187924 ? ? ? 313.476507 ? ? ? ?20.324707 / > > <4>[ 6950.143157] ? ? ? ?hackbench ?3397 ? 2223058.310064 ? ? ?7203 > > 120 ? 2223058.310064 ? ? ? 313.598646 ? ? ? ?20.263672 / > > <4>[ 6950.143188] ? ? ? ?hackbench ?3398 ? 2223057.608173 ? ? ?6928 > > 120 ? 2223057.608173 ? ? ? 312.896756 ? ? ? ?20.233154 / > > <4>[ 6950.143218] ? ? ? ?hackbench ?3399 ? 2223059.225628 ? ? ?7253 > > 120 ? 2223059.225628 ? ? ? 314.544728 ? ? ? ?20.172119 / > > <4>[ 6950.143249] ? ? ? ?hackbench ?3400 ? 2223058.035102 ? ? ?3044 > > 120 ? 2223058.035102 ? ? ? 391.326887 ? ? ? ? 2.166748 / > > <4>[ 6950.143310] ? ? ? ?hackbench ?3401 ? 2223059.439242 ? ? ?6937 > > 120 ? 2223059.439242 ? ? ? 314.727825 ? ? ? ?20.141601 / > > <4>[ 6950.143341] ? ? ? ?hackbench ?3402 ? 2223057.481471 ? ? ?6749 > > 120 ? 2223057.481471 ? ? ? 309.753424 ? ? ? ? 2.075196 / > > <4>[ 6950.143371] ? ? ? ?hackbench ?3403 ? 2223059.439238 ? ? ?6983 > > 120 ? 2223059.439238 ? ? ? 314.727820 ? ? ? ?20.080567 / > > <4>[ 6950.143402] ? ? ? ?hackbench ?3404 ? 2223057.791245 ? ? ?7107 > > 120 ? 2223057.791245 ? ? ? 313.079828 ? ? ? ?20.050049 / > > <4>[ 6950.143432] ? ? ? ?hackbench ?3405 ? 2223057.908789 ? ? ?6948 > > 120 ? 2223057.908789 ? ? ? 310.180704 ? ? ? ? 1.953125 / > > <4>[ 6950.143463] ? ? ? ?hackbench ?3406 ? 2223058.523635 ? ? ?7068 > > 120 ? 2223058.523635 ? ? ? 313.812217 ? ? ? ?20.019532 / > > <4>[ 6950.143524] ? ? ? ?hackbench ?3428 ? 2223058.313422 ? ? ?5337 > > 120 ? 2223058.313422 ? ? ? 265.045082 ? ? ?9233.978271 / > > <4>[ 6950.143554] ? ? ? ?hackbench ?3429 ? 2223059.168004 ? ? ?5277 > > 120 ? 2223059.168004 ? ? ? 282.775870 ? ? ?8696.319582 / > > <4>[ 6950.143585] ? ? ? ?hackbench ?3430 ? 2223057.728820 ? ? ?6040 > > 120 ? 2223057.728820 ? ? ? 301.605244 ? ? ?3877.227783 / > > <4>[ 6950.143615] ? ? ? ?hackbench ?3431 ? 2223059.233894 ? ? ?2218 > > 120 ? 2223059.233894 ? ? ? 382.110606 ? ? ?3795.104981 / > > <4>[ 6950.143646] ? ? ? ?hackbench ?3432 ? 2223057.667812 ? ? ?5830 > > 120 ? 2223057.667812 ? ? ? 285.736138 ? ? ?6528.869629 / > > <4>[ 6950.143676] ? ? ? ?hackbench ?3433 ? 2223058.522277 ? ? ?5567 > > 120 ? 2223058.522277 ? ? ? 299.621600 ? ? ?5717.285156 / > > <4>[ 6950.143707] ? ? ? ?hackbench ?3434 ? 2223058.980062 ? ? ?6110 > > 120 ? 2223058.980062 ? ? ? 293.426557 ? ? ?5739.990234 / > > <4>[ 6950.143768] ? ? ? ?hackbench ?3435 ? 2223058.191454 ? ? ?5514 > > 120 ? 2223058.191454 ? ? ? 277.832045 ? ? ?8030.822755 / > > <4>[ 6950.143798] ? ? ? ?hackbench ?3436 ? 2223059.106975 ? ? ?5677 > > 120 ? 2223059.106975 ? ? ? 278.320255 ? ? ?6854.644777 / > > <4>[ 6950.143829] ? ? ? ?hackbench ?3437 ? 2223059.473183 ? ? ?6101 > > 120 ? 2223059.473183 ? ? ? 290.588355 ? ? ?5625.305176 / > > <4>[ 6950.143859] ? ? ? ?hackbench ?3438 ? 2223057.647029 ? ? ?5570 > > 120 ? 2223057.647029 ? ? ? 275.299082 ? ? ?8041.503907 / > > <4>[ 6950.143890] ? ? ? ?hackbench ?3439 ? 2223059.106971 ? ? ?5878 > > 120 ? 2223059.106971 ? ? ? 286.071772 ? ? ?6566.406251 / > > <4>[ 6950.143920] ? ? ? ?hackbench ?3440 ? 2223057.489483 ? ? ?6113 > > 120 ? 2223057.489483 ? ? ? 308.166449 ? ? ?2902.313233 / > > <4>[ 6950.143951] ? ? ? ?hackbench ?3441 ? 2223058.466070 ? ? ?6376 > > 120 ? 2223058.466070 ? ? ? 302.093487 ? ? ?3230.041504 / > > <4>[ 6950.144012] ? ? ? ?hackbench ?3442 ? 2223058.623568 ? ? ?5077 > > 120 ? 2223058.623568 ? ? ? 261.810318 ? ? 11294.525148 / > > <4>[ 6950.144042] ? ? ? ?hackbench ?3443 ? 2223058.379449 ? ? ?5345 > > 120 ? 2223058.379449 ? ? ? 276.397734 ? ? ?8350.708009 / > > <4>[ 6950.144073] ? ? ? ?hackbench ?3444 ? 2223058.654045 ? ? ?4896 > > 120 ? 2223058.654045 ? ? ? 277.343722 ? ? ?9959.838869 / > > <4>[ 6950.144104] ? ? ? ?hackbench ?3445 ? 2223114.709956 ? ? ?7669 > > 120 ? 2223114.709956 ? ? ? 342.468227 ? ? ?5719.573975 / > > <4>[ 6950.144134] ? ? ? ?hackbench ?3446 ? 2223057.585953 ? ? ?5494 > > 120 ? 2223057.585953 ? ? ? 277.252185 ? ? ?8900.085448 / > > <4>[ 6950.144165] ? ? ? ?hackbench ?3447 ? 2223059.259559 ? ? ?6293 > > 120 ? 2223059.259559 ? ? ? 302.734394 ? ? ?3191.955566 / > > <4>[ 6950.144195] ? ? ? churn_data ?3575 ? 2223057.707968 ? ? ? ?87 > > 120 ? 2223057.707968 ? ? ? 187.683096 ? ? 11222.930908 / > > <4>[ 6950.144287] ? ? ? ? ? ? ? ps ?3752 ? 2223059.719359 ? ? ? ?65 > > 120 ? 2223059.719359 ? ? ? 179.565417 ? ? ? ? 0.000000 / > > <4>[ 6950.144317] ?kkkkkkkkkkkkkkk ?3787 ? 2223058.346130 ? ? ? ?58 > > 120 ? 2223058.346130 ? ? ? ?71.044920 ? ? ? ? 4.821777 / > > <4>[ 6950.144348] ? ? ? ? ? pipeio ?3788 ? 2223059.320594 ? ? ? 182 > > 120 ? 2223059.320594 ? ? ? ?56.304934 ? ? ? ? 0.000000 / > > <4>[ 6950.144378] ? ? ? ? ? fork11 ?3818 ? 2223058.262515 ? ? ? ? 0 > > 120 ? 2223058.262515 ? ? ? ? 0.000000 ? ? ? ? 0.000000 / > > <4>[ 6950.144409] ? ? ? ? kthreadd ?3819 ? 2223060.868907 ? ? ? ? 0 > > 120 ? 2223060.868907 ? ? ? ? 0.000000 ? ? ? ? 0.000000 / > > <4>[ 6950.144439] > > > > > > -- > > Best Regards > > Hu Tao > > > > > > -- > Best Regards > Hu Tao > -- > To unsubscribe from this list: send the line "unsubscribe linux-kernel" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > Please read the FAQ at http://www.tux.org/lkml/ -- Only stand for myself ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Tasks schedule/migration issue with CPU hotplug? 2011-09-08 7:28 ` Yong Zhang @ 2011-09-08 7:39 ` Yong Zhang 2011-09-15 2:38 ` TAO HU 0 siblings, 1 reply; 5+ messages in thread From: Yong Zhang @ 2011-09-08 7:39 UTC (permalink / raw) To: TAO HU; +Cc: Ingo Molnar, peterz, linux-kernel, linux-arm-kernel, linux-omap On Thu, Sep 08, 2011 at 03:28:01PM +0800, Yong Zhang wrote: > On Thu, Sep 08, 2011 at 02:47:08PM +0800, TAO HU wrote: > > Resend with linux-kernel mail list included. > > Hmm, could you give a try with commit da7a735e? > > Thanks, > Yong > > --- > commit da7a735e51f9622eb3e1672594d4a41da01d7e4f > Author: Peter Zijlstra <a.p.zijlstra@chello.nl> > Date: Mon Jan 17 17:03:27 2011 +0100 > > sched: Fix switch_from_fair() > > When a task is taken out of the fair class we must ensure the vruntime > is properly normalized because when we put it back in it will assume > to be normalized. > > The case that goes wrong is when changing away from the fair class > while sleeping. Sleeping tasks have non-normalized vruntime in order > to make sleeper-fairness work. So treat the switch away from fair as a > wakeup and preserve the relative vruntime. > > Also update sysrq-n to call the ->switch_{to,from} methods. > > Reported-by: Onkalo Samu <samu.p.onkalo@nokia.com> > Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl> > LKML-Reference: <new-submission> > Signed-off-by: Ingo Molnar <mingo@elte.hu> > > > > > On Wed, Sep 7, 2011 at 10:22 PM, TAO HU <tghk48@motorola.com> wrote: > > > <4>[ 6950.136230] cfs_rq[0]:/ > > > <4>[ 6950.136230] ? .exec_clock ? ? ? ? ? ? ? ? ? ?: 6520265.283900 > > > <4>[ 6950.136260] ? .MIN_vruntime ? ? ? ? ? ? ? ? ?: 2223057.428522 > > > <4>[ 6950.136260] ? .min_vruntime ? ? ? ? ? ? ? ? ?: 2223057.428522 > > > <4>[ 6950.136291] ? .max_vruntime ? ? ? ? ? ? ? ? ?: 2223114.709956 > > > <4>[ 6950.136291] ? .spread ? ? ? ? ? ? ? ? ? ? ? ?: 57.281434 > > > <4>[ 6950.136291] ? .spread0 ? ? ? ? ? ? ? ? ? ? ? : 0.000000 > > > <4>[ 6950.136322] ? .nr_running ? ? ? ? ? ? ? ? ? ?: 212 > > > <4>[ 6950.136322] ? .load ? ? ? ? ? ? ? ? ? ? ? ? ?: 217650 > > > <4>[ 6950.136352] ? .nr_spread_over ? ? ? ? ? ? ? ?: 125034 > > > <4>[ 6950.136352] ? .shares ? ? ? ? ? ? ? ? ? ? ? ?: 0 > > > <4>[ 6950.136352] > > > <4>[ 6950.136566] runnable tasks: > > > <4>[ 6950.136566] ? ? ? ? ? ? task ? PID ? ? ? ? tree-key ?switches > > > prio ? ? exec-runtime ? ? ? ? sum-exec ? ? ? ?sum-sleep > > > <4>[ 6950.136596] > > > ---------------------------------------------------------------------------------------------------------- > > > <4>[ 6950.136627] ? ? ?omap2_mcspi ? ?21 ? 2223062.886210 ?29451523 The tree-key(2223062.886210) almost equals to cfs_rq.min_vruntime, so maybe you hit the bug which is cured by the mentioned commit. Thanks, Yong ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Tasks schedule/migration issue with CPU hotplug? 2011-09-08 7:39 ` Yong Zhang @ 2011-09-15 2:38 ` TAO HU 0 siblings, 0 replies; 5+ messages in thread From: TAO HU @ 2011-09-15 2:38 UTC (permalink / raw) To: Yong Zhang Cc: Ingo Molnar, peterz, linux-kernel, linux-arm-kernel, linux-omap Hi, Yong You're right. We figured out something is wrong (is negative) with vruntime of certain processes. Below link describes the same issue we observed. http://lkml.indiana.edu/hypermail/linux/kernel/1101.2/00333.html And the commite indicated by you is exactly the fix. Appreciate it!. On Thu, Sep 8, 2011 at 3:39 PM, Yong Zhang <yong.zhang0@gmail.com> wrote: > On Thu, Sep 08, 2011 at 03:28:01PM +0800, Yong Zhang wrote: >> On Thu, Sep 08, 2011 at 02:47:08PM +0800, TAO HU wrote: >> > Resend with linux-kernel mail list included. >> >> Hmm, could you give a try with commit da7a735e? >> >> Thanks, >> Yong >> >> --- >> commit da7a735e51f9622eb3e1672594d4a41da01d7e4f >> Author: Peter Zijlstra <a.p.zijlstra@chello.nl> >> Date: Mon Jan 17 17:03:27 2011 +0100 >> >> sched: Fix switch_from_fair() >> >> When a task is taken out of the fair class we must ensure the vruntime >> is properly normalized because when we put it back in it will assume >> to be normalized. >> >> The case that goes wrong is when changing away from the fair class >> while sleeping. Sleeping tasks have non-normalized vruntime in order >> to make sleeper-fairness work. So treat the switch away from fair as a >> wakeup and preserve the relative vruntime. >> >> Also update sysrq-n to call the ->switch_{to,from} methods. >> >> Reported-by: Onkalo Samu <samu.p.onkalo@nokia.com> >> Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl> >> LKML-Reference: <new-submission> >> Signed-off-by: Ingo Molnar <mingo@elte.hu> >> >> > >> > On Wed, Sep 7, 2011 at 10:22 PM, TAO HU <tghk48@motorola.com> wrote: >> > > <4>[ 6950.136230] cfs_rq[0]:/ >> > > <4>[ 6950.136230] ? .exec_clock ? ? ? ? ? ? ? ? ? ?: 6520265.283900 >> > > <4>[ 6950.136260] ? .MIN_vruntime ? ? ? ? ? ? ? ? ?: 2223057.428522 >> > > <4>[ 6950.136260] ? .min_vruntime ? ? ? ? ? ? ? ? ?: 2223057.428522 >> > > <4>[ 6950.136291] ? .max_vruntime ? ? ? ? ? ? ? ? ?: 2223114.709956 >> > > <4>[ 6950.136291] ? .spread ? ? ? ? ? ? ? ? ? ? ? ?: 57.281434 >> > > <4>[ 6950.136291] ? .spread0 ? ? ? ? ? ? ? ? ? ? ? : 0.000000 >> > > <4>[ 6950.136322] ? .nr_running ? ? ? ? ? ? ? ? ? ?: 212 >> > > <4>[ 6950.136322] ? .load ? ? ? ? ? ? ? ? ? ? ? ? ?: 217650 >> > > <4>[ 6950.136352] ? .nr_spread_over ? ? ? ? ? ? ? ?: 125034 >> > > <4>[ 6950.136352] ? .shares ? ? ? ? ? ? ? ? ? ? ? ?: 0 >> > > <4>[ 6950.136352] >> > > <4>[ 6950.136566] runnable tasks: >> > > <4>[ 6950.136566] ? ? ? ? ? ? task ? PID ? ? ? ? tree-key ?switches >> > > prio ? ? exec-runtime ? ? ? ? sum-exec ? ? ? ?sum-sleep >> > > <4>[ 6950.136596] >> > > ---------------------------------------------------------------------------------------------------------- >> > > <4>[ 6950.136627] ? ? ?omap2_mcspi ? ?21 ? 2223062.886210 ?29451523 > > The tree-key(2223062.886210) almost equals to cfs_rq.min_vruntime, > so maybe you hit the bug which is cured by the mentioned commit. > > Thanks, > Yong > -- Best Regards Hu Tao ^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: Tasks schedule/migration issue with CPU hotplug? 2011-09-08 6:47 ` Tasks schedule/migration issue with CPU hotplug? TAO HU 2011-09-08 7:28 ` Yong Zhang @ 2011-09-08 12:55 ` Peter Zijlstra 1 sibling, 0 replies; 5+ messages in thread From: Peter Zijlstra @ 2011-09-08 12:55 UTC (permalink / raw) To: TAO HU; +Cc: Ingo Molnar, linux-kernel, linux-arm-kernel, linux-omap, yong.zhang0 On Thu, 2011-09-08 at 14:47 +0800, TAO HU wrote: > > We seems got a schedule/migration issue in a OMAP4430 dual-core system. > > The kernel base is 2.6.35.7 and we're using CFS. step 1, try with a kernel that isn't quite as fossilized (3.0 or even better 3.1-rc) step 2, if no luck, report that step 3, when sending email, 3a, don't wrap machine output 3b, include .config like things ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2011-09-15 23:29 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <CAOwKts_WTDBLkz9=0MBhs6wzc67XD_bYgGMiZ-JUM+8O7gP_fw@mail.gmail.com>
2011-09-08 6:47 ` Tasks schedule/migration issue with CPU hotplug? TAO HU
2011-09-08 7:28 ` Yong Zhang
2011-09-08 7:39 ` Yong Zhang
2011-09-15 2:38 ` TAO HU
2011-09-08 12:55 ` Peter Zijlstra
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox