Yuyang, Here is another bisect result. The reduction of power consumption looks good. git://bee.sh.intel.com/git/ydu19/linux cc-v3-on-3.15-rc8 commit 1896c45c3d164ffc3d9d68fe15d5c85674ac4ed0 ("Intercept idle balancing") 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 1332 ~33% +75.9% 2344 ~ 7% brickland1/will-it-scale/pread2 1332 ~33% +75.9% 2344 ~ 7% TOTAL numa-vmstat.node1.nr_active_anon 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 5666 ~31% +65.7% 9388 ~ 7% brickland1/will-it-scale/pread2 5666 ~31% +65.7% 9388 ~ 7% TOTAL numa-meminfo.node1.AnonPages 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 5329 ~33% +75.9% 9375 ~ 7% brickland1/will-it-scale/pread2 5329 ~33% +75.9% 9375 ~ 7% TOTAL numa-meminfo.node1.Active(anon) 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 1418 ~31% +65.5% 2346 ~ 7% brickland1/will-it-scale/pread2 1418 ~31% +65.5% 2346 ~ 7% TOTAL numa-vmstat.node1.nr_anon_pages 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 1163 ~16% -27.5% 842 ~13% brickland1/will-it-scale/page_fault1 1163 ~16% -27.5% 842 ~13% TOTAL proc-vmstat.numa_pages_migrated 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 1163 ~16% -27.5% 842 ~13% brickland1/will-it-scale/page_fault1 1163 ~16% -27.5% 842 ~13% TOTAL proc-vmstat.pgmigrate_success 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 226 ~16% -26.3% 166 ~ 9% brickland1/will-it-scale/pread2 226 ~16% -26.3% 166 ~ 9% TOTAL cpuidle.POLL.usage 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 1275 ~ 5% +21.6% 1550 ~ 4% brickland1/will-it-scale/page_fault1 1275 ~ 5% +21.6% 1550 ~ 4% TOTAL slabinfo.sock_inode_cache.num_objs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 1275 ~ 5% +21.6% 1550 ~ 4% brickland1/will-it-scale/page_fault1 1275 ~ 5% +21.6% 1550 ~ 4% TOTAL slabinfo.sock_inode_cache.active_objs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 681 ~ 9% -16.9% 566 ~ 6% brickland1/will-it-scale/pread2 681 ~ 9% -16.9% 566 ~ 6% TOTAL slabinfo.vm_area_struct.active_slabs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 681 ~ 9% -16.9% 566 ~ 6% brickland1/will-it-scale/pread2 681 ~ 9% -16.9% 566 ~ 6% TOTAL slabinfo.vm_area_struct.num_slabs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 29997 ~ 9% -16.8% 24947 ~ 6% brickland1/will-it-scale/pread2 29997 ~ 9% -16.8% 24947 ~ 6% TOTAL slabinfo.vm_area_struct.num_objs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 29784 ~ 9% -16.9% 24755 ~ 6% brickland1/will-it-scale/pread2 29784 ~ 9% -16.9% 24755 ~ 6% TOTAL slabinfo.vm_area_struct.active_objs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 3928 ~ 6% -16.4% 3284 ~ 6% brickland1/will-it-scale/page_fault1 3928 ~ 6% -16.4% 3284 ~ 6% TOTAL numa-meminfo.node3.KernelStack 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 5491 ~ 1% -11.6% 4852 ~ 1% brickland1/will-it-scale/page_fault1 5540 ~ 1% -13.1% 4816 ~ 3% brickland1/will-it-scale/pread2 11031 ~ 1% -12.4% 9668 ~ 2% TOTAL slabinfo.sigqueue.num_objs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 5491 ~ 1% -11.6% 4852 ~ 1% brickland1/will-it-scale/page_fault1 5540 ~ 1% -13.1% 4816 ~ 3% brickland1/will-it-scale/pread2 11031 ~ 1% -12.4% 9668 ~ 2% TOTAL slabinfo.sigqueue.active_objs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 12383 ~ 3% -7.6% 11443 ~ 4% brickland1/will-it-scale/pread2 12383 ~ 3% -7.6% 11443 ~ 4% TOTAL slabinfo.proc_inode_cache.num_objs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 12206 ~ 2% -8.5% 11166 ~ 3% brickland1/will-it-scale/pread2 12206 ~ 2% -8.5% 11166 ~ 3% TOTAL slabinfo.proc_inode_cache.active_objs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 3298 ~ 3% -8.7% 3012 ~ 4% brickland1/will-it-scale/page_fault1 3298 ~ 3% -8.7% 3012 ~ 4% TOTAL slabinfo.shmem_inode_cache.active_objs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 3298 ~ 3% -8.7% 3012 ~ 4% brickland1/will-it-scale/page_fault1 3298 ~ 3% -8.7% 3012 ~ 4% TOTAL slabinfo.shmem_inode_cache.num_objs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 8105 ~ 2% +2062.5% 175284 ~ 4% brickland1/will-it-scale/page_fault1 6522 ~ 7% +1564.0% 108523 ~ 2% brickland1/will-it-scale/pread2 14627 ~ 4% +1840.2% 283807 ~ 3% TOTAL time.involuntary_context_switches 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 17535 ~ 0% +10.7% 19414 ~ 1% brickland1/will-it-scale/page_fault1 205434 ~ 0% +2.5% 210623 ~ 0% brickland1/will-it-scale/pread2 222969 ~ 0% +3.2% 230038 ~ 0% TOTAL vmstat.system.cs 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 56025 ~ 0% +1.8% 57041 ~ 0% brickland1/will-it-scale/page_fault1 71853 ~ 1% +5.8% 76038 ~ 1% brickland1/will-it-scale/pread2 127879 ~ 1% +4.1% 133080 ~ 1% TOTAL vmstat.system.in 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 271 ~ 0% -3.0% 263 ~ 0% brickland1/will-it-scale/pread2 271 ~ 0% -3.0% 263 ~ 0% TOTAL turbostat.Cor_W 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 285 ~ 0% -2.9% 276 ~ 0% brickland1/will-it-scale/pread2 285 ~ 0% -2.9% 276 ~ 0% TOTAL turbostat.Pkg_W 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 490 ~ 1% +2.3% 502 ~ 0% brickland1/will-it-scale/pread2 490 ~ 1% +2.3% 502 ~ 0% TOTAL time.percent_of_cpu_this_job_got 8552a4536239fc8 1896c45c3d164ffc3d9d68fe1 --------------- ------------------------- 1514 ~ 1% +2.3% 1548 ~ 0% brickland1/will-it-scale/pread2 1514 ~ 1% +2.3% 1548 ~ 0% TOTAL time.system_time Legend: ~XX% - stddev percent [+-]XX% - change percent Disclaimer: Results have been estimated based on internal Intel analysis and are provided for informational purposes only. Any difference in system hardware or software design or configuration may affect actual performance. Thanks, Fengguang