From: Huang Ying <ying.huang@intel.com>
To: lkp@lists.01.org
Subject: [sched] 66b0f3b16cc: 21.7% ebizzy.throughput.per_thread.max
Date: Fri, 19 Jun 2015 15:09:31 +0800 [thread overview]
Message-ID: <1434697771.21752.30.camel@intel.com> (raw)
[-- Attachment #1: Type: text/plain, Size: 47760 bytes --]
FYI, we noticed the below changes on
git://bee.sh.intel.com/git/ydu19/tip temp
commit 66b0f3b16ccfdef26d1ae20dca6ed73b2c6b4bcb ("sched: Rewrite runnable load and utilization average tracking")
=========================================================================================
tbox_group/testcase/rootfs/kconfig/compiler/cpufreq_governor/nr_threads/iterations/duration:
lkp-nex04/ebizzy/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/performance/200%/100x/10s
commit:
69aec05e924a239e9ccf969cf9f9ab842eccd8a6
66b0f3b16ccfdef26d1ae20dca6ed73b2c6b4bcb
69aec05e924a239e 66b0f3b16ccfdef26d1ae20dca
---------------- --------------------------
%stddev %change %stddev
\ | \
117.70 ± 1% +21.7% 143.20 ± 0% ebizzy.throughput.per_thread.max
0.05 ± 9% +118.4% 0.12 ± 1% ebizzy.throughput.per_thread.stddev_percent
5205629 ± 0% -8.8% 4747141 ± 0% ebizzy.time.involuntary_context_switches
44.86 ± 0% -1.9% 44.02 ± 0% ebizzy.time.user
4501 ± 0% -2.0% 4411 ± 0% ebizzy.time.user_time
214423 ± 8% -26.8% 157027 ± 4% cpuidle.C3-NHM.usage
210.60 ± 7% -27.1% 153.50 ± 4% numa-vmstat.node1.nr_kernel_stack
6368 ± 1% -8.5% 5829 ± 0% vmstat.system.cs
5552 ± 2% +13.7% 6311 ± 1% numa-meminfo.node0.KernelStack
3385 ± 7% -27.3% 2461 ± 4% numa-meminfo.node1.KernelStack
2203 ± 5% +19.3% 2629 ± 5% numa-meminfo.node3.KernelStack
808336 ± 3% -22.5% 626837 ± 0% proc-vmstat.numa_hint_faults_local
146402 ± 19% +106.9% 302878 ± 1% proc-vmstat.numa_pages_migrated
146402 ± 19% +106.9% 302878 ± 1% proc-vmstat.pgmigrate_success
1138 ± 14% +28.0% 1457 ± 10% slabinfo.blkdev_ioc.active_objs
1138 ± 14% +28.0% 1457 ± 10% slabinfo.blkdev_ioc.num_objs
1254 ± 21% +34.7% 1689 ± 12% slabinfo.blkdev_requests.active_objs
1254 ± 21% +34.7% 1689 ± 12% slabinfo.blkdev_requests.num_objs
1429 ± 15% +29.2% 1845 ± 9% slabinfo.mnt_cache.active_objs
1429 ± 15% +29.2% 1845 ± 9% slabinfo.mnt_cache.num_objs
756.20 ± 7% -41.8% 440.10 ± 3% latency_stats.avg.call_rwsem_down_read_failed.SyS_madvise.entry_SYSCALL_64_fastpath
1361 ± 6% -24.3% 1030 ± 1% latency_stats.avg.call_rwsem_down_read_failed.__do_page_fault.do_page_fault.page_fault
3787 ± 17% -42.1% 2191 ± 5% latency_stats.avg.call_rwsem_down_write_failed.SyS_mprotect.entry_SYSCALL_64_fastpath
1924 ± 9% -62.5% 722.00 ± 5% latency_stats.avg.call_rwsem_down_write_failed.vm_munmap.SyS_munmap.entry_SYSCALL_64_fastpath
717.70 ± 3% -18.2% 587.40 ± 1% latency_stats.avg.do_wait.SyS_wait4.entry_SYSCALL_64_fastpath
952.10 ± 16% +58.4% 1507 ± 13% latency_stats.avg.ep_poll.SyS_epoll_wait.entry_SYSCALL_64_fastpath
464.40 ± 4% -16.5% 387.60 ± 1% latency_stats.avg.pipe_wait.pipe_read.__vfs_read.vfs_read.SyS_read.entry_SYSCALL_64_fastpath
2990 ± 5% -13.4% 2590 ± 5% latency_stats.avg.pipe_wait.wait_for_partner.fifo_open.do_dentry_open.vfs_open.do_last.path_openat.do_filp_open.do_sys_open.SyS_open.entry_SYSCALL_64_fastpath
1496 ± 3% +11.9% 1673 ± 4% latency_stats.avg.wait_on_page_bit.__migration_entry_wait.migration_entry_wait.handle_pte_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
2541 ± 2% -12.4% 2226 ± 0% latency_stats.avg.wait_woken.inotify_read.__vfs_read.vfs_read.SyS_read.entry_SYSCALL_64_fastpath
3121 ± 4% -25.7% 2320 ± 8% latency_stats.hits.call_rwsem_down_read_failed.SyS_madvise.entry_SYSCALL_64_fastpath
2319 ± 5% -22.2% 1805 ± 4% latency_stats.hits.call_rwsem_down_write_failed.SyS_mprotect.entry_SYSCALL_64_fastpath
26304 ± 1% -25.2% 19678 ± 1% latency_stats.hits.pipe_wait.pipe_read.__vfs_read.vfs_read.SyS_read.entry_SYSCALL_64_fastpath
4.60 ± 65% +197.8% 13.70 ± 40% latency_stats.hits.pipe_wait.pipe_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
11014 ± 14% -29.0% 7823 ± 12% latency_stats.max.call_rwsem_down_write_failed.vm_munmap.SyS_munmap.entry_SYSCALL_64_fastpath
2359462 ± 7% -56.7% 1020748 ± 6% latency_stats.sum.call_rwsem_down_read_failed.SyS_madvise.entry_SYSCALL_64_fastpath
3.469e+08 ± 16% -29.6% 2.443e+08 ± 2% latency_stats.sum.call_rwsem_down_read_failed.__do_page_fault.do_page_fault.page_fault
8713241 ± 10% -54.6% 3954210 ± 5% latency_stats.sum.call_rwsem_down_write_failed.SyS_mprotect.entry_SYSCALL_64_fastpath
18472348 ± 4% -18.2% 15112810 ± 5% latency_stats.sum.call_rwsem_down_write_failed.vm_mmap_pgoff.SyS_mmap_pgoff.SyS_mmap.entry_SYSCALL_64_fastpath
11300496 ± 10% -66.6% 3771716 ± 7% latency_stats.sum.call_rwsem_down_write_failed.vm_munmap.SyS_munmap.entry_SYSCALL_64_fastpath
5578435 ± 7% -21.4% 4381874 ± 2% latency_stats.sum.do_wait.SyS_wait4.entry_SYSCALL_64_fastpath
12235259 ± 5% -37.6% 7637083 ± 2% latency_stats.sum.pipe_wait.pipe_read.__vfs_read.vfs_read.SyS_read.entry_SYSCALL_64_fastpath
29907 ± 5% -18.5% 24372 ± 9% latency_stats.sum.pipe_wait.wait_for_partner.fifo_open.do_dentry_open.vfs_open.do_last.path_openat.do_filp_open.do_sys_open.SyS_open.entry_SYSCALL_64_fastpath
14649856 ± 5% +19.6% 17525288 ± 4% latency_stats.sum.wait_on_page_bit.__migration_entry_wait.migration_entry_wait.handle_pte_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
1513840 ± 2% -13.2% 1314218 ± 1% latency_stats.sum.wait_woken.inotify_read.__vfs_read.vfs_read.SyS_read.entry_SYSCALL_64_fastpath
32834153 ± 0% +17.8% 38669467 ± 1% sched_debug.cfs_rq[0]:/.min_vruntime
69.10 ± 64% +236.6% 232.60 ± 17% sched_debug.cfs_rq[0]:/.nr_spread_over
14.00 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[0]:/.runnable_load_avg
6244 ± 39% -84.9% 940.80 ± 0% sched_debug.cfs_rq[0]:/.tg_load_avg
61.20 ±107% -100.0% 0.00 ± -1% sched_debug.cfs_rq[0]:/.tg_load_contrib
1031 ± 1% -100.0% 0.00 ± -1% sched_debug.cfs_rq[0]:/.utilization_load_avg
14.60 ± 12% -100.0% 0.00 ± -1% sched_debug.cfs_rq[10]:/.runnable_load_avg
1221910 ± 25% -240.4% -1716126 ±-49% sched_debug.cfs_rq[10]:/.spread0
5860 ± 43% -83.9% 941.30 ± 0% sched_debug.cfs_rq[10]:/.tg_load_avg
77.10 ±109% -100.0% 0.00 ± -1% sched_debug.cfs_rq[10]:/.tg_load_contrib
1041 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[10]:/.utilization_load_avg
13.80 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[11]:/.runnable_load_avg
1229568 ± 38% -233.0% -1634940 ±-53% sched_debug.cfs_rq[11]:/.spread0
5820 ± 43% -83.8% 941.20 ± 0% sched_debug.cfs_rq[11]:/.tg_load_avg
94.20 ±108% -100.0% 0.00 ± -1% sched_debug.cfs_rq[11]:/.tg_load_contrib
1022 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[11]:/.utilization_load_avg
84.80 ±133% -100.0% 0.00 ± -1% sched_debug.cfs_rq[12]:/.blocked_load_avg
13.70 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[12]:/.runnable_load_avg
1259738 ± 37% -245.3% -1830319 ±-32% sched_debug.cfs_rq[12]:/.spread0
5758 ± 42% -83.7% 940.50 ± 0% sched_debug.cfs_rq[12]:/.tg_load_avg
99.00 ±114% -100.0% 0.00 ± -1% sched_debug.cfs_rq[12]:/.tg_load_contrib
1028 ± 2% -100.0% 0.00 ± -1% sched_debug.cfs_rq[12]:/.utilization_load_avg
107.20 ± 81% -100.0% 0.00 ± -1% sched_debug.cfs_rq[13]:/.blocked_load_avg
14.10 ± 14% -100.0% 0.00 ± -1% sched_debug.cfs_rq[13]:/.runnable_load_avg
1101157 ± 37% -265.6% -1823351 ±-49% sched_debug.cfs_rq[13]:/.spread0
5676 ± 42% -83.4% 940.40 ± 0% sched_debug.cfs_rq[13]:/.tg_load_avg
121.90 ± 72% -100.0% 0.00 ± -1% sched_debug.cfs_rq[13]:/.tg_load_contrib
1042 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[13]:/.utilization_load_avg
98.20 ± 83% -100.0% 0.00 ± -1% sched_debug.cfs_rq[14]:/.blocked_load_avg
13.70 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[14]:/.runnable_load_avg
1185828 ± 31% -248.2% -1756859 ±-45% sched_debug.cfs_rq[14]:/.spread0
5668 ± 42% -83.4% 940.50 ± 0% sched_debug.cfs_rq[14]:/.tg_load_avg
112.50 ± 72% -100.0% 0.00 ± -1% sched_debug.cfs_rq[14]:/.tg_load_contrib
1026 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[14]:/.utilization_load_avg
4.60 ± 53% +678.3% 35.80 ±144% sched_debug.cfs_rq[15]:/.nr_spread_over
13.90 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[15]:/.runnable_load_avg
786517 ± 52% -317.2% -1708682 ±-38% sched_debug.cfs_rq[15]:/.spread0
5656 ± 43% -83.4% 940.90 ± 0% sched_debug.cfs_rq[15]:/.tg_load_avg
96.30 ± 58% -100.0% 0.00 ± -1% sched_debug.cfs_rq[15]:/.tg_load_contrib
1037 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[15]:/.utilization_load_avg
33605942 ± 1% +12.8% 37914951 ± 1% sched_debug.cfs_rq[16]:/.min_vruntime
14.50 ± 18% -100.0% 0.00 ± -1% sched_debug.cfs_rq[16]:/.runnable_load_avg
5591 ± 43% -83.2% 940.40 ± 0% sched_debug.cfs_rq[16]:/.tg_load_avg
79.30 ± 80% -100.0% 0.00 ± -1% sched_debug.cfs_rq[16]:/.tg_load_contrib
1051 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[16]:/.utilization_load_avg
33880249 ± 1% +11.5% 37778734 ± 1% sched_debug.cfs_rq[17]:/.min_vruntime
13.90 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[17]:/.runnable_load_avg
5564 ± 44% -83.1% 940.90 ± 0% sched_debug.cfs_rq[17]:/.tg_load_avg
99.20 ± 78% -100.0% 0.00 ± -1% sched_debug.cfs_rq[17]:/.tg_load_contrib
1030 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[17]:/.utilization_load_avg
69.00 ± 74% -100.0% 0.00 ± -1% sched_debug.cfs_rq[18]:/.blocked_load_avg
33673604 ± 1% +11.7% 37615766 ± 1% sched_debug.cfs_rq[18]:/.min_vruntime
13.70 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[18]:/.runnable_load_avg
5549 ± 44% -83.0% 940.80 ± 0% sched_debug.cfs_rq[18]:/.tg_load_avg
82.90 ± 61% -100.0% 0.00 ± -1% sched_debug.cfs_rq[18]:/.tg_load_contrib
1018 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[18]:/.utilization_load_avg
33855011 ± 2% +10.6% 37458215 ± 1% sched_debug.cfs_rq[19]:/.min_vruntime
14.60 ± 19% -100.0% 0.00 ± -1% sched_debug.cfs_rq[19]:/.runnable_load_avg
5506 ± 43% -82.9% 940.80 ± 0% sched_debug.cfs_rq[19]:/.tg_load_avg
92.00 ± 73% -100.0% 0.00 ± -1% sched_debug.cfs_rq[19]:/.tg_load_contrib
1026 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[19]:/.utilization_load_avg
32922723 ± 0% +11.8% 36820587 ± 1% sched_debug.cfs_rq[1]:/.min_vruntime
13.90 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[1]:/.runnable_load_avg
88390 ±332% -2191.8% -1848984 ±-37% sched_debug.cfs_rq[1]:/.spread0
6229 ± 40% -84.9% 940.40 ± 0% sched_debug.cfs_rq[1]:/.tg_load_avg
42.50 ±108% -100.0% 0.00 ± -1% sched_debug.cfs_rq[1]:/.tg_load_contrib
1030 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[1]:/.utilization_load_avg
33881670 ± 1% +11.9% 37898987 ± 1% sched_debug.cfs_rq[20]:/.min_vruntime
1.70 ±126% +1641.2% 29.60 ±115% sched_debug.cfs_rq[20]:/.nr_spread_over
14.00 ± 7% -100.0% 0.00 ± -1% sched_debug.cfs_rq[20]:/.runnable_load_avg
1046003 ± 53% -173.9% -773140 ±-91% sched_debug.cfs_rq[20]:/.spread0
5461 ± 43% -82.8% 941.20 ± 0% sched_debug.cfs_rq[20]:/.tg_load_avg
67.90 ± 78% -100.0% 0.00 ± -1% sched_debug.cfs_rq[20]:/.tg_load_contrib
1033 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[20]:/.utilization_load_avg
33643963 ± 1% +11.7% 37580155 ± 1% sched_debug.cfs_rq[21]:/.min_vruntime
14.40 ± 16% -100.0% 0.00 ± -1% sched_debug.cfs_rq[21]:/.runnable_load_avg
5440 ± 42% -82.7% 940.80 ± 0% sched_debug.cfs_rq[21]:/.tg_load_avg
71.20 ± 82% -100.0% 0.00 ± -1% sched_debug.cfs_rq[21]:/.tg_load_contrib
1035 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[21]:/.utilization_load_avg
33662992 ± 1% +11.8% 37640608 ± 2% sched_debug.cfs_rq[22]:/.min_vruntime
15.00 ± 18% -100.0% 0.00 ± -1% sched_debug.cfs_rq[22]:/.runnable_load_avg
5433 ± 42% -82.7% 940.80 ± 0% sched_debug.cfs_rq[22]:/.tg_load_avg
76.00 ± 85% -100.0% 0.00 ± -1% sched_debug.cfs_rq[22]:/.tg_load_contrib
1048 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[22]:/.utilization_load_avg
33314446 ± 1% +13.3% 37752799 ± 1% sched_debug.cfs_rq[23]:/.min_vruntime
2.20 ±121% +3109.1% 70.60 ± 88% sched_debug.cfs_rq[23]:/.nr_spread_over
13.90 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[23]:/.runnable_load_avg
5441 ± 43% -82.7% 941.10 ± 0% sched_debug.cfs_rq[23]:/.tg_load_avg
84.00 ± 56% -100.0% 0.00 ± -1% sched_debug.cfs_rq[23]:/.tg_load_contrib
1021 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[23]:/.utilization_load_avg
32890975 ± 1% +14.3% 37598483 ± 1% sched_debug.cfs_rq[24]:/.min_vruntime
14.10 ± 7% -100.0% 0.00 ± -1% sched_debug.cfs_rq[24]:/.runnable_load_avg
5360 ± 43% -82.4% 941.70 ± 0% sched_debug.cfs_rq[24]:/.tg_load_avg
54.20 ± 67% -100.0% 0.00 ± -1% sched_debug.cfs_rq[24]:/.tg_load_contrib
1031 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[24]:/.utilization_load_avg
32996974 ± 1% +13.4% 37432055 ± 1% sched_debug.cfs_rq[25]:/.min_vruntime
14.50 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[25]:/.runnable_load_avg
5326 ± 44% -82.3% 941.40 ± 0% sched_debug.cfs_rq[25]:/.tg_load_avg
71.30 ± 91% -100.0% 0.00 ± -1% sched_debug.cfs_rq[25]:/.tg_load_contrib
1050 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[25]:/.utilization_load_avg
52.40 ±115% -100.0% 0.00 ± -1% sched_debug.cfs_rq[26]:/.blocked_load_avg
33127889 ± 1% +13.5% 37587535 ± 2% sched_debug.cfs_rq[26]:/.min_vruntime
14.70 ± 17% -100.0% 0.00 ± -1% sched_debug.cfs_rq[26]:/.runnable_load_avg
5345 ± 44% -82.4% 941.50 ± 0% sched_debug.cfs_rq[26]:/.tg_load_avg
67.40 ± 88% -100.0% 0.00 ± -1% sched_debug.cfs_rq[26]:/.tg_load_contrib
1033 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[26]:/.utilization_load_avg
33165596 ± 1% +13.9% 37767085 ± 1% sched_debug.cfs_rq[27]:/.min_vruntime
14.50 ± 10% -100.0% 0.00 ± -1% sched_debug.cfs_rq[27]:/.runnable_load_avg
5322 ± 44% -82.3% 941.60 ± 0% sched_debug.cfs_rq[27]:/.tg_load_avg
96.10 ± 78% -100.0% 0.00 ± -1% sched_debug.cfs_rq[27]:/.tg_load_contrib
1051 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[27]:/.utilization_load_avg
33028387 ± 1% +14.2% 37725856 ± 2% sched_debug.cfs_rq[28]:/.min_vruntime
13.60 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[28]:/.runnable_load_avg
5317 ± 44% -82.3% 941.60 ± 0% sched_debug.cfs_rq[28]:/.tg_load_avg
110.80 ± 91% -100.0% 0.00 ± -1% sched_debug.cfs_rq[28]:/.tg_load_contrib
1013 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[28]:/.utilization_load_avg
33004132 ± 0% +14.2% 37695827 ± 2% sched_debug.cfs_rq[29]:/.min_vruntime
14.80 ± 15% -100.0% 0.00 ± -1% sched_debug.cfs_rq[29]:/.runnable_load_avg
5297 ± 43% -82.2% 941.90 ± 0% sched_debug.cfs_rq[29]:/.tg_load_avg
100.40 ±114% -100.0% 0.00 ± -1% sched_debug.cfs_rq[29]:/.tg_load_contrib
1036 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[29]:/.utilization_load_avg
33022220 ± 0% +11.7% 36870013 ± 2% sched_debug.cfs_rq[2]:/.min_vruntime
13.80 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[2]:/.runnable_load_avg
187870 ±177% -1058.0% -1799762 ±-47% sched_debug.cfs_rq[2]:/.spread0
6205 ± 40% -84.9% 940.10 ± 0% sched_debug.cfs_rq[2]:/.tg_load_avg
178.70 ±113% -100.0% 0.00 ± -1% sched_debug.cfs_rq[2]:/.tg_load_contrib
1022 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[2]:/.utilization_load_avg
33026863 ± 1% +12.9% 37301677 ± 1% sched_debug.cfs_rq[30]:/.min_vruntime
13.80 ± 7% -100.0% 0.00 ± -1% sched_debug.cfs_rq[30]:/.runnable_load_avg
190413 ±287% -820.3% -1371622 ±-61% sched_debug.cfs_rq[30]:/.spread0
5285 ± 43% -82.2% 941.90 ± 0% sched_debug.cfs_rq[30]:/.tg_load_avg
91.50 ± 79% -100.0% 0.00 ± -1% sched_debug.cfs_rq[30]:/.tg_load_contrib
1022 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[30]:/.utilization_load_avg
32768904 ± 1% +14.1% 37395464 ± 1% sched_debug.cfs_rq[31]:/.min_vruntime
13.70 ± 8% -100.0% 0.00 ± -1% sched_debug.cfs_rq[31]:/.runnable_load_avg
5258 ± 43% -82.1% 942.20 ± 0% sched_debug.cfs_rq[31]:/.tg_load_avg
84.00 ±113% -100.0% 0.00 ± -1% sched_debug.cfs_rq[31]:/.tg_load_contrib
1022 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[31]:/.utilization_load_avg
32957365 ± 0% +12.9% 37213196 ± 1% sched_debug.cfs_rq[32]:/.min_vruntime
20.60 ± 88% +307.8% 84.00 ± 50% sched_debug.cfs_rq[32]:/.nr_spread_over
14.00 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[32]:/.runnable_load_avg
120723 ±171% -1309.7% -1460365 ±-24% sched_debug.cfs_rq[32]:/.spread0
5219 ± 43% -82.0% 941.80 ± 0% sched_debug.cfs_rq[32]:/.tg_load_avg
49.60 ±113% -100.0% 0.00 ± -1% sched_debug.cfs_rq[32]:/.tg_load_contrib
1021 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[32]:/.utilization_load_avg
33111907 ± 0% +11.6% 36939635 ± 1% sched_debug.cfs_rq[33]:/.min_vruntime
13.70 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[33]:/.runnable_load_avg
275159 ±129% -730.2% -1734011 ±-43% sched_debug.cfs_rq[33]:/.spread0
5160 ± 44% -81.7% 942.60 ± 0% sched_debug.cfs_rq[33]:/.tg_load_avg
35.60 ±114% -100.0% 0.00 ± -1% sched_debug.cfs_rq[33]:/.tg_load_contrib
1014 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[33]:/.utilization_load_avg
33094533 ± 0% +11.7% 36967949 ± 2% sched_debug.cfs_rq[34]:/.min_vruntime
15.60 ± 23% -100.0% 0.00 ± -1% sched_debug.cfs_rq[34]:/.runnable_load_avg
257694 ±123% -762.0% -1705844 ±-36% sched_debug.cfs_rq[34]:/.spread0
5093 ± 45% -81.5% 942.70 ± 0% sched_debug.cfs_rq[34]:/.tg_load_avg
106.90 ±112% -100.0% 0.00 ± -1% sched_debug.cfs_rq[34]:/.tg_load_contrib
1044 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[34]:/.utilization_load_avg
33134655 ± 1% +11.1% 36796304 ± 1% sched_debug.cfs_rq[35]:/.min_vruntime
14.50 ± 22% -100.0% 0.00 ± -1% sched_debug.cfs_rq[35]:/.runnable_load_avg
297753 ±156% -730.6% -1877582 ±-44% sched_debug.cfs_rq[35]:/.spread0
5018 ± 45% -81.2% 942.40 ± 0% sched_debug.cfs_rq[35]:/.tg_load_avg
68.40 ± 99% -100.0% 0.00 ± -1% sched_debug.cfs_rq[35]:/.tg_load_contrib
1021 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[35]:/.utilization_load_avg
33052339 ± 1% +11.8% 36951950 ± 2% sched_debug.cfs_rq[36]:/.min_vruntime
14.00 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[36]:/.runnable_load_avg
215366 ±180% -899.6% -1722067 ±-43% sched_debug.cfs_rq[36]:/.spread0
4984 ± 46% -81.1% 942.20 ± 0% sched_debug.cfs_rq[36]:/.tg_load_avg
77.10 ± 99% -100.0% 0.00 ± -1% sched_debug.cfs_rq[36]:/.tg_load_contrib
1026 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[36]:/.utilization_load_avg
32872426 ± 0% +12.4% 36939827 ± 1% sched_debug.cfs_rq[37]:/.min_vruntime
1.10 ±188% +2372.7% 27.20 ±152% sched_debug.cfs_rq[37]:/.nr_spread_over
14.00 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[37]:/.runnable_load_avg
35376 ±889% -5002.4% -1734270 ±-26% sched_debug.cfs_rq[37]:/.spread0
4911 ± 43% -80.8% 942.00 ± 0% sched_debug.cfs_rq[37]:/.tg_load_avg
67.10 ±104% -100.0% 0.00 ± -1% sched_debug.cfs_rq[37]:/.tg_load_contrib
1026 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[37]:/.utilization_load_avg
33020465 ± 1% +10.6% 36510590 ± 1% sched_debug.cfs_rq[38]:/.min_vruntime
14.60 ± 12% -100.0% 0.00 ± -1% sched_debug.cfs_rq[38]:/.runnable_load_avg
183379 ±194% -1279.9% -2163649 ±-33% sched_debug.cfs_rq[38]:/.spread0
4913 ± 43% -80.8% 941.70 ± 0% sched_debug.cfs_rq[38]:/.tg_load_avg
28.30 ±100% -100.0% 0.00 ± -1% sched_debug.cfs_rq[38]:/.tg_load_contrib
1024 ± 2% -100.0% 0.00 ± -1% sched_debug.cfs_rq[38]:/.utilization_load_avg
32649942 ± 0% +12.1% 36601134 ± 2% sched_debug.cfs_rq[39]:/.min_vruntime
14.20 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[39]:/.runnable_load_avg
-187194 ±-154% +1007.5% -2073152 ±-27% sched_debug.cfs_rq[39]:/.spread0
4861 ± 44% -80.6% 941.50 ± 0% sched_debug.cfs_rq[39]:/.tg_load_avg
83.70 ±108% -100.0% 0.00 ± -1% sched_debug.cfs_rq[39]:/.tg_load_contrib
1025 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[39]:/.utilization_load_avg
32997866 ± 1% +10.8% 36573411 ± 1% sched_debug.cfs_rq[3]:/.min_vruntime
14.50 ± 20% -100.0% 0.00 ± -1% sched_debug.cfs_rq[3]:/.runnable_load_avg
6180 ± 40% -84.8% 940.50 ± 0% sched_debug.cfs_rq[3]:/.tg_load_avg
135.40 ±100% -100.0% 0.00 ± -1% sched_debug.cfs_rq[3]:/.tg_load_contrib
1034 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[3]:/.utilization_load_avg
13.90 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[40]:/.runnable_load_avg
1234363 ± 39% -202.5% -1265034 ±-89% sched_debug.cfs_rq[40]:/.spread0
4866 ± 43% -80.6% 942.00 ± 0% sched_debug.cfs_rq[40]:/.tg_load_avg
75.70 ± 96% -100.0% 0.00 ± -1% sched_debug.cfs_rq[40]:/.tg_load_contrib
1034 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[40]:/.utilization_load_avg
13.80 ± 7% -100.0% 0.00 ± -1% sched_debug.cfs_rq[41]:/.runnable_load_avg
1242936 ± 32% -198.9% -1229220 ±-67% sched_debug.cfs_rq[41]:/.spread0
4847 ± 44% -80.6% 942.20 ± 0% sched_debug.cfs_rq[41]:/.tg_load_avg
91.80 ± 80% -100.0% 0.00 ± -1% sched_debug.cfs_rq[41]:/.tg_load_contrib
1025 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[41]:/.utilization_load_avg
13.80 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[42]:/.runnable_load_avg
1309960 ± 31% -215.1% -1507974 ±-60% sched_debug.cfs_rq[42]:/.spread0
4834 ± 44% -80.5% 941.80 ± 0% sched_debug.cfs_rq[42]:/.tg_load_avg
69.20 ± 68% -100.0% 0.00 ± -1% sched_debug.cfs_rq[42]:/.tg_load_contrib
1042 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[42]:/.utilization_load_avg
13.50 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[43]:/.runnable_load_avg
1288476 ± 36% -201.0% -1301608 ±-68% sched_debug.cfs_rq[43]:/.spread0
4794 ± 45% -80.4% 942.00 ± 0% sched_debug.cfs_rq[43]:/.tg_load_avg
32.70 ± 96% -100.0% 0.00 ± -1% sched_debug.cfs_rq[43]:/.tg_load_contrib
1013 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[43]:/.utilization_load_avg
13.50 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[44]:/.runnable_load_avg
1444719 ± 35% -212.4% -1624486 ±-47% sched_debug.cfs_rq[44]:/.spread0
4793 ± 44% -80.4% 941.80 ± 0% sched_debug.cfs_rq[44]:/.tg_load_avg
73.30 ± 53% -100.0% 0.00 ± -1% sched_debug.cfs_rq[44]:/.tg_load_contrib
1040 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[44]:/.utilization_load_avg
85.20 ±100% -100.0% 0.00 ± -1% sched_debug.cfs_rq[45]:/.blocked_load_avg
33995676 ± 1% +9.6% 37245540 ± 1% sched_debug.cfs_rq[45]:/.min_vruntime
15.20 ± 30% -100.0% 0.00 ± -1% sched_debug.cfs_rq[45]:/.runnable_load_avg
1158251 ± 26% -223.4% -1429563 ±-50% sched_debug.cfs_rq[45]:/.spread0
4755 ± 44% -80.2% 942.20 ± 0% sched_debug.cfs_rq[45]:/.tg_load_avg
100.70 ± 88% -100.0% 0.00 ± -1% sched_debug.cfs_rq[45]:/.tg_load_contrib
1022 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[45]:/.utilization_load_avg
34078137 ± 0% +10.3% 37573183 ± 0% sched_debug.cfs_rq[46]:/.min_vruntime
13.80 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[46]:/.runnable_load_avg
1240663 ± 27% -188.8% -1102006 ±-74% sched_debug.cfs_rq[46]:/.spread0
4734 ± 44% -80.1% 941.70 ± 0% sched_debug.cfs_rq[46]:/.tg_load_avg
89.70 ± 94% -100.0% 0.00 ± -1% sched_debug.cfs_rq[46]:/.tg_load_contrib
1027 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[46]:/.utilization_load_avg
33683724 ± 1% +10.9% 37351384 ± 1% sched_debug.cfs_rq[47]:/.min_vruntime
14.10 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[47]:/.runnable_load_avg
846204 ± 51% -256.5% -1323945 ±-45% sched_debug.cfs_rq[47]:/.spread0
4671 ± 41% -79.8% 941.90 ± 0% sched_debug.cfs_rq[47]:/.tg_load_avg
85.60 ± 44% -100.0% 0.00 ± -1% sched_debug.cfs_rq[47]:/.tg_load_contrib
1029 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[47]:/.utilization_load_avg
33744780 ± 1% +13.2% 38210214 ± 1% sched_debug.cfs_rq[48]:/.min_vruntime
14.20 ± 12% -100.0% 0.00 ± -1% sched_debug.cfs_rq[48]:/.runnable_load_avg
4650 ± 41% -79.7% 941.80 ± 0% sched_debug.cfs_rq[48]:/.tg_load_avg
66.10 ± 78% -100.0% 0.00 ± -1% sched_debug.cfs_rq[48]:/.tg_load_contrib
1036 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[48]:/.utilization_load_avg
33992243 ± 1% +11.6% 37936853 ± 1% sched_debug.cfs_rq[49]:/.min_vruntime
13.90 ± 2% -100.0% 0.00 ± -1% sched_debug.cfs_rq[49]:/.runnable_load_avg
1154619 ± 50% -164.0% -738643 ±-109% sched_debug.cfs_rq[49]:/.spread0
4645 ± 41% -79.7% 942.20 ± 0% sched_debug.cfs_rq[49]:/.tg_load_avg
52.30 ± 77% -100.0% 0.00 ± -1% sched_debug.cfs_rq[49]:/.tg_load_contrib
1022 ± 2% -100.0% 0.00 ± -1% sched_debug.cfs_rq[49]:/.utilization_load_avg
32958620 ± 1% +11.4% 36707057 ± 1% sched_debug.cfs_rq[4]:/.min_vruntime
14.40 ± 9% -100.0% 0.00 ± -1% sched_debug.cfs_rq[4]:/.runnable_load_avg
124108 ±333% -1681.5% -1962817 ±-28% sched_debug.cfs_rq[4]:/.spread0
6105 ± 41% -84.6% 940.30 ± 0% sched_debug.cfs_rq[4]:/.tg_load_avg
107.60 ±131% -100.0% 0.00 ± -1% sched_debug.cfs_rq[4]:/.tg_load_contrib
1044 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[4]:/.utilization_load_avg
33720413 ± 1% +11.8% 37684974 ± 0% sched_debug.cfs_rq[50]:/.min_vruntime
14.30 ± 14% -100.0% 0.00 ± -1% sched_debug.cfs_rq[50]:/.runnable_load_avg
882727 ± 56% -212.2% -990621 ±-82% sched_debug.cfs_rq[50]:/.spread0
4592 ± 42% -79.5% 942.00 ± 0% sched_debug.cfs_rq[50]:/.tg_load_avg
79.60 ± 58% -100.0% 0.00 ± -1% sched_debug.cfs_rq[50]:/.tg_load_contrib
1023 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[50]:/.utilization_load_avg
33982195 ± 2% +11.5% 37883919 ± 1% sched_debug.cfs_rq[51]:/.min_vruntime
2.20 ±255% +2504.5% 57.30 ±106% sched_debug.cfs_rq[51]:/.nr_spread_over
13.80 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[51]:/.runnable_load_avg
4580 ± 42% -79.4% 942.20 ± 0% sched_debug.cfs_rq[51]:/.tg_load_avg
73.30 ± 89% -100.0% 0.00 ± -1% sched_debug.cfs_rq[51]:/.tg_load_contrib
1034 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[51]:/.utilization_load_avg
33882830 ± 1% +11.2% 37692720 ± 1% sched_debug.cfs_rq[52]:/.min_vruntime
13.90 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[52]:/.runnable_load_avg
1045016 ± 59% -194.1% -983095 ±-75% sched_debug.cfs_rq[52]:/.spread0
4574 ± 43% -79.4% 942.70 ± 0% sched_debug.cfs_rq[52]:/.tg_load_avg
81.00 ± 62% -100.0% 0.00 ± -1% sched_debug.cfs_rq[52]:/.tg_load_contrib
1033 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[52]:/.utilization_load_avg
33766641 ± 1% +11.5% 37634143 ± 1% sched_debug.cfs_rq[53]:/.min_vruntime
0.50 ±161% +5340.0% 27.20 ±115% sched_debug.cfs_rq[53]:/.nr_spread_over
13.40 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[53]:/.runnable_load_avg
4572 ± 42% -79.4% 942.80 ± 0% sched_debug.cfs_rq[53]:/.tg_load_avg
61.90 ± 82% -100.0% 0.00 ± -1% sched_debug.cfs_rq[53]:/.tg_load_contrib
1031 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[53]:/.utilization_load_avg
57.90 ± 90% -100.0% 0.00 ± -1% sched_debug.cfs_rq[54]:/.blocked_load_avg
33940155 ± 1% +11.4% 37824474 ± 1% sched_debug.cfs_rq[54]:/.min_vruntime
14.30 ± 12% -100.0% 0.00 ± -1% sched_debug.cfs_rq[54]:/.runnable_load_avg
1102161 ± 63% -177.3% -851502 ±-73% sched_debug.cfs_rq[54]:/.spread0
4552 ± 41% -79.3% 942.70 ± 0% sched_debug.cfs_rq[54]:/.tg_load_avg
72.30 ± 71% -100.0% 0.00 ± -1% sched_debug.cfs_rq[54]:/.tg_load_contrib
1036 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[54]:/.utilization_load_avg
33295741 ± 1% +14.2% 38039482 ± 1% sched_debug.cfs_rq[55]:/.min_vruntime
13.90 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[55]:/.runnable_load_avg
4535 ± 41% -79.2% 942.20 ± 0% sched_debug.cfs_rq[55]:/.tg_load_avg
43.10 ± 41% -100.0% 0.00 ± -1% sched_debug.cfs_rq[55]:/.tg_load_contrib
1022 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[55]:/.utilization_load_avg
32932658 ± 1% +14.2% 37596506 ± 1% sched_debug.cfs_rq[56]:/.min_vruntime
14.00 ± 7% -100.0% 0.00 ± -1% sched_debug.cfs_rq[56]:/.runnable_load_avg
4466 ± 42% -78.9% 941.60 ± 0% sched_debug.cfs_rq[56]:/.tg_load_avg
56.20 ± 67% -100.0% 0.00 ± -1% sched_debug.cfs_rq[56]:/.tg_load_contrib
1040 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[56]:/.utilization_load_avg
33099246 ± 1% +13.2% 37480903 ± 1% sched_debug.cfs_rq[57]:/.min_vruntime
1.70 ± 59% +1000.0% 18.70 ±110% sched_debug.cfs_rq[57]:/.nr_spread_over
14.30 ± 7% -100.0% 0.00 ± -1% sched_debug.cfs_rq[57]:/.runnable_load_avg
4463 ± 42% -78.9% 942.10 ± 0% sched_debug.cfs_rq[57]:/.tg_load_avg
67.90 ±111% -100.0% 0.00 ± -1% sched_debug.cfs_rq[57]:/.tg_load_contrib
1022 ± 2% -100.0% 0.00 ± -1% sched_debug.cfs_rq[57]:/.utilization_load_avg
33202874 ± 1% +13.9% 37829170 ± 1% sched_debug.cfs_rq[58]:/.min_vruntime
14.10 ± 12% -100.0% 0.00 ± -1% sched_debug.cfs_rq[58]:/.runnable_load_avg
4442 ± 43% -78.8% 942.10 ± 0% sched_debug.cfs_rq[58]:/.tg_load_avg
56.00 ± 87% -100.0% 0.00 ± -1% sched_debug.cfs_rq[58]:/.tg_load_contrib
1018 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[58]:/.utilization_load_avg
33227042 ± 1% +13.7% 37794431 ± 2% sched_debug.cfs_rq[59]:/.min_vruntime
7.25 ±218% +749.7% 61.60 ±107% sched_debug.cfs_rq[59]:/.nr_spread_over
14.10 ± 8% -100.0% 0.00 ± -1% sched_debug.cfs_rq[59]:/.runnable_load_avg
388582 ± 93% -327.0% -882076 ±-106% sched_debug.cfs_rq[59]:/.spread0
4458 ± 42% -78.9% 941.30 ± 0% sched_debug.cfs_rq[59]:/.tg_load_avg
87.20 ± 79% -100.0% 0.00 ± -1% sched_debug.cfs_rq[59]:/.tg_load_contrib
1032 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[59]:/.utilization_load_avg
32955689 ± 1% +10.4% 36375995 ± 1% sched_debug.cfs_rq[5]:/.min_vruntime
14.20 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[5]:/.runnable_load_avg
121157 ±281% -1993.6% -2294247 ±-22% sched_debug.cfs_rq[5]:/.spread0
6121 ± 41% -84.6% 940.20 ± 0% sched_debug.cfs_rq[5]:/.tg_load_avg
73.20 ±109% -100.0% 0.00 ± -1% sched_debug.cfs_rq[5]:/.tg_load_contrib
1031 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[5]:/.utilization_load_avg
33066767 ± 1% +14.1% 37743137 ± 1% sched_debug.cfs_rq[60]:/.min_vruntime
13.90 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[60]:/.runnable_load_avg
4438 ± 42% -78.8% 941.90 ± 0% sched_debug.cfs_rq[60]:/.tg_load_avg
70.00 ± 66% -100.0% 0.00 ± -1% sched_debug.cfs_rq[60]:/.tg_load_contrib
1023 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[60]:/.utilization_load_avg
32984063 ± 1% +14.9% 37910135 ± 2% sched_debug.cfs_rq[61]:/.min_vruntime
14.00 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[61]:/.runnable_load_avg
4450 ± 42% -78.8% 942.50 ± 0% sched_debug.cfs_rq[61]:/.tg_load_avg
50.40 ±117% -100.0% 0.00 ± -1% sched_debug.cfs_rq[61]:/.tg_load_contrib
1041 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[61]:/.utilization_load_avg
33050254 ± 1% +15.0% 38012765 ± 1% sched_debug.cfs_rq[62]:/.min_vruntime
14.60 ± 13% -100.0% 0.00 ± -1% sched_debug.cfs_rq[62]:/.runnable_load_avg
4413 ± 43% -78.6% 942.80 ± 0% sched_debug.cfs_rq[62]:/.tg_load_avg
49.20 ±101% -100.0% 0.00 ± -1% sched_debug.cfs_rq[62]:/.tg_load_contrib
1048 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[62]:/.utilization_load_avg
32698928 ± 1% +15.6% 37815109 ± 2% sched_debug.cfs_rq[63]:/.min_vruntime
14.20 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[63]:/.runnable_load_avg
4414 ± 43% -78.6% 942.70 ± 0% sched_debug.cfs_rq[63]:/.tg_load_avg
94.00 ± 80% -100.0% 0.00 ± -1% sched_debug.cfs_rq[63]:/.tg_load_contrib
1034 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[63]:/.utilization_load_avg
67.60 ± 98% -100.0% 0.00 ± -1% sched_debug.cfs_rq[6]:/.blocked_load_avg
32990477 ± 0% +9.9% 36250445 ± 1% sched_debug.cfs_rq[6]:/.min_vruntime
14.00 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[6]:/.runnable_load_avg
155891 ±223% -1652.3% -2419900 ±-30% sched_debug.cfs_rq[6]:/.spread0
6092 ± 41% -84.6% 940.30 ± 0% sched_debug.cfs_rq[6]:/.tg_load_avg
82.00 ± 80% -100.0% 0.00 ± -1% sched_debug.cfs_rq[6]:/.tg_load_contrib
1027 ± 3% -100.0% 0.00 ± -1% sched_debug.cfs_rq[6]:/.utilization_load_avg
32605157 ± 0% +11.6% 36393126 ± 1% sched_debug.cfs_rq[7]:/.min_vruntime
14.30 ± 8% -100.0% 0.00 ± -1% sched_debug.cfs_rq[7]:/.runnable_load_avg
-229652 ±-118% +891.6% -2277287 ±-13% sched_debug.cfs_rq[7]:/.spread0
6053 ± 41% -84.5% 941.30 ± 0% sched_debug.cfs_rq[7]:/.tg_load_avg
115.40 ±138% -100.0% 0.00 ± -1% sched_debug.cfs_rq[7]:/.tg_load_contrib
1025 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[7]:/.utilization_load_avg
146.20 ± 94% -100.0% 0.00 ± -1% sched_debug.cfs_rq[8]:/.blocked_load_avg
14.40 ± 8% -100.0% 0.00 ± -1% sched_debug.cfs_rq[8]:/.runnable_load_avg
1153532 ± 36% -243.9% -1660087 ±-54% sched_debug.cfs_rq[8]:/.spread0
6070 ± 40% -84.5% 941.20 ± 0% sched_debug.cfs_rq[8]:/.tg_load_avg
161.50 ± 86% -100.0% 0.00 ± -1% sched_debug.cfs_rq[8]:/.tg_load_contrib
1047 ± 4% -100.0% 0.00 ± -1% sched_debug.cfs_rq[8]:/.utilization_load_avg
101.50 ±107% -100.0% 0.00 ± -1% sched_debug.cfs_rq[9]:/.blocked_load_avg
13.80 ± 6% -100.0% 0.00 ± -1% sched_debug.cfs_rq[9]:/.runnable_load_avg
1214974 ± 27% -218.0% -1433345 ±-62% sched_debug.cfs_rq[9]:/.spread0
6041 ± 40% -84.4% 941.30 ± 0% sched_debug.cfs_rq[9]:/.tg_load_avg
115.70 ± 93% -100.0% 0.00 ± -1% sched_debug.cfs_rq[9]:/.tg_load_contrib
1024 ± 5% -100.0% 0.00 ± -1% sched_debug.cfs_rq[9]:/.utilization_load_avg
-51.70 ±-49% +408.5% -262.90 ±-19% sched_debug.cpu#0.nr_uninterruptible
54454 ± 10% -16.7% 45367 ± 2% sched_debug.cpu#10.nr_switches
55931 ± 10% -13.8% 48233 ± 3% sched_debug.cpu#10.sched_count
11485 ± 28% -35.2% 7442 ± 8% sched_debug.cpu#10.ttwu_count
54543 ± 5% -15.7% 45994 ± 5% sched_debug.cpu#11.nr_switches
56038 ± 5% -13.4% 48556 ± 5% sched_debug.cpu#11.sched_count
11221 ± 19% -30.6% 7789 ± 15% sched_debug.cpu#11.ttwu_count
54031 ± 13% -16.8% 44931 ± 2% sched_debug.cpu#12.nr_switches
55586 ± 12% -14.6% 47478 ± 2% sched_debug.cpu#12.sched_count
2675 ± 37% -36.8% 1692 ± 16% sched_debug.cpu#12.sched_goidle
52358 ± 7% -14.2% 44916 ± 2% sched_debug.cpu#14.nr_switches
2648 ± 26% -34.1% 1746 ± 15% sched_debug.cpu#14.sched_goidle
52553 ± 8% -15.0% 44686 ± 2% sched_debug.cpu#16.nr_switches
2322 ± 24% -30.6% 1611 ± 16% sched_debug.cpu#16.sched_goidle
1963 ± 6% -14.7% 1674 ± 8% sched_debug.cpu#18.sched_goidle
50172 ± 7% -10.7% 44805 ± 3% sched_debug.cpu#19.nr_switches
-17.70 ±-146% +693.2% -140.40 ±-35% sched_debug.cpu#2.nr_uninterruptible
49164 ± 4% -8.5% 44971 ± 3% sched_debug.cpu#21.nr_switches
5769 ± 17% +30.6% 7535 ± 9% sched_debug.cpu#29.ttwu_count
2032 ± 39% +114.6% 4361 ± 15% sched_debug.cpu#29.ttwu_local
-12.60 ±-214% +833.3% -117.60 ±-46% sched_debug.cpu#3.nr_uninterruptible
1564 ± 6% -34.2% 1029 ± 17% sched_debug.cpu#32.sched_goidle
1666 ± 13% -32.8% 1120 ± 11% sched_debug.cpu#33.sched_goidle
1874 ± 37% -43.1% 1067 ± 11% sched_debug.cpu#36.sched_goidle
1528 ± 6% -26.0% 1130 ± 12% sched_debug.cpu#37.sched_goidle
1574 ± 7% -29.6% 1109 ± 11% sched_debug.cpu#38.sched_goidle
1651 ± 6% -41.7% 962.30 ± 10% sched_debug.cpu#40.sched_goidle
1697 ± 12% -42.2% 981.50 ± 14% sched_debug.cpu#41.sched_goidle
12.70 ±219% +629.1% 92.60 ± 59% sched_debug.cpu#42.nr_uninterruptible
1798 ± 29% -46.4% 964.20 ± 9% sched_debug.cpu#42.sched_goidle
22.40 ±165% +314.7% 92.90 ± 61% sched_debug.cpu#43.nr_uninterruptible
48640 ± 5% -11.4% 43112 ± 1% sched_debug.cpu#44.nr_switches
10.30 ±370% +777.7% 90.40 ± 39% sched_debug.cpu#44.nr_uninterruptible
1824 ± 28% -48.7% 936.00 ± 7% sched_debug.cpu#44.sched_goidle
49362 ± 7% -11.3% 43765 ± 4% sched_debug.cpu#45.nr_switches
1790 ± 10% -47.7% 937.20 ± 8% sched_debug.cpu#46.sched_goidle
1752 ± 30% -39.9% 1054 ± 16% sched_debug.cpu#48.sched_goidle
11.70 ±260% +547.9% 75.80 ± 60% sched_debug.cpu#51.nr_uninterruptible
47186 ± 8% -9.9% 42506 ± 1% sched_debug.cpu#52.nr_switches
1597 ± 7% -43.4% 903.50 ± 13% sched_debug.cpu#52.sched_goidle
1658 ± 16% -44.5% 921.00 ± 9% sched_debug.cpu#53.sched_goidle
48232 ± 14% -11.4% 42742 ± 1% sched_debug.cpu#54.nr_switches
15.80 ±209% +391.8% 77.70 ± 26% sched_debug.cpu#54.nr_uninterruptible
1737 ± 26% -44.2% 969.00 ± 12% sched_debug.cpu#54.sched_goidle
1635 ± 23% -44.5% 907.20 ± 22% sched_debug.cpu#56.sched_goidle
1535 ± 6% -44.8% 847.20 ± 14% sched_debug.cpu#57.sched_goidle
4249 ± 16% +30.3% 5534 ± 5% sched_debug.cpu#57.ttwu_count
1625 ± 34% +128.7% 3718 ± 7% sched_debug.cpu#57.ttwu_local
1556 ± 7% -47.3% 820.60 ± 15% sched_debug.cpu#59.sched_goidle
8.60 ±429% +1058.1% 99.60 ± 44% sched_debug.cpu#60.nr_uninterruptible
1606 ± 12% -43.9% 901.50 ± 15% sched_debug.cpu#60.sched_goidle
1705 ± 45% +147.1% 4213 ± 10% sched_debug.cpu#60.ttwu_local
18.00 ±200% +351.1% 81.20 ± 39% sched_debug.cpu#61.nr_uninterruptible
2970 ± 97% -69.9% 894.20 ± 15% sched_debug.cpu#62.sched_goidle
-13.40 ±-88% +760.4% -115.30 ±-36% sched_debug.cpu#7.nr_uninterruptible
3396 ± 32% -40.1% 2034 ± 30% sched_debug.cpu#8.sched_goidle
54316 ± 8% -14.0% 46734 ± 5% sched_debug.cpu#9.nr_switches
55815 ± 8% -11.8% 49252 ± 5% sched_debug.cpu#9.sched_count
lkp-nex04: Nehalem-EX
Memory: 256G
ebizzy.throughput.per_thread.max
145 ++--------------------------------O----O-O-O--------------------------+
| O O O O O O |
140 O+O O O O O O O O |
| O |
135 ++ |
| |
130 ++ |
| |
125 ++ |
| .*.*..*. .*. |
120 *+*.. .*.*.*. *..*.*.*. *..* .*. .*.*.. .*.. *.. |
| *.*. + .*. *. *.* + .*
115 ++ * * * |
| |
110 ++--------------------------------------------------------------------+
ebizzy.throughput.per_thread.stddev_percent
0.13 ++-------------------------------------------------------------------+
| O O O O |
0.12 O+ O O O O O O O O O O |
0.11 ++O O O O O |
| |
0.1 ++ |
0.09 ++ |
| |
0.08 ++ |
0.07 ++ |
| .*. |
0.06 *+*..*.*.. .*.. .*. *.. |
0.05 ++ *.*.*..*.*.*..*.*..*.* *.*. .*.*..*.*.*..*.* .*
| *. * |
0.04 ++-------------------------------------------------------------------+
ebizzy.time.involuntary_context_switches
5.3e+06 ++----------------------------------------------------------------+
| |
5.2e+06 *+*.. .*.*.*..*. .*.*..*.*.*..*.*.*.*..*.*.*..*.*.*.*..*.* *..*.*
| * * + + |
| * |
5.1e+06 ++ |
| |
5e+06 ++ |
| |
4.9e+06 ++ |
| |
| |
4.8e+06 ++ |
O O O O O O O O O O O O O O O O O O O |
4.7e+06 ++----------------O-----------------------------------------------+
[*] bisect-good sample
[O] bisect-bad sample
To reproduce:
apt-get install ruby
git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
cd lkp-tests
bin/setup-local job.yaml # the job file attached in this email
bin/run-local job.yaml
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
Thanks,
Ying Huang
-------------------------------------
lkp(a)eclists.intel.com
https://eclists.intel.com/sympa/info/lkp
Unsubscribe by sending email to sympa(a)eclists.intel.com with subject "Unsubscribe lkp"
[-- Attachment #2: job.yaml --]
[-- Type: text/plain, Size: 3181 bytes --]
---
LKP_SERVER: inn
LKP_CGI_PORT: 80
LKP_CIFS_PORT: 139
testcase: ebizzy
default-monitors:
wait: pre-test
uptime:
iostat:
vmstat:
numa-numastat:
numa-vmstat:
numa-meminfo:
proc-vmstat:
proc-stat:
interval: 10
meminfo:
slabinfo:
interrupts:
lock_stat:
latency_stats:
softirqs:
bdi_dev_mapping:
diskstats:
nfsstat:
cpuidle:
cpufreq-stats:
turbostat:
pmeter:
sched_debug:
interval: 60
default-watchdogs:
watch-oom:
watchdog:
cpufreq_governor: performance
model: Nehalem-EX
memory: 256G
nr_ssd_partitions: 6
ssd_partitions: "/dev/disk/by-id/ata-INTEL_SSD*part1"
swap_partitions: "/dev/disk/by-id/ata-WDC_WD10EARS-00Y5B1_WD-WCAV5F059074-part2"
nr_threads: 200%
iterations: 100x
ebizzy:
duration: 10s
branch: yuyang-tip/for-lkp
commit: 11a3ce832138b131965eea06e7be7e8df25640ef
queue: unit
repeat_to: 2
testbox: lkp-nex04
tbox_group: lkp-nex04
kconfig: x86_64-rhel
enqueue_time: 2015-06-18 08:49:09.546380779 +08:00
user: lkp
compiler: gcc-4.9
head_commit: 11a3ce832138b131965eea06e7be7e8df25640ef
base_commit: fa16c1bf3c4717f82b9ccca61156656068e0b14c
kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/11a3ce832138b131965eea06e7be7e8df25640ef/vmlinuz-4.1.0-rc8-02642-g11a3ce8"
rootfs: debian-x86_64-2015-02-07.cgz
result_root: "/result/ebizzy/performance-200%-100x-10s/lkp-nex04/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/11a3ce832138b131965eea06e7be7e8df25640ef/0"
job_file: "/lkp/scheduled/lkp-nex04/unit_ebizzy-performance-200%-100x-10s-x86_64-rhel-HEAD-11a3ce832138b131965eea06e7be7e8df25640ef-1-20150618-42871-1i12387.yaml"
dequeue_time: 2015-06-18 09:30:24.855264566 +08:00
nr_cpu: "$(nproc)"
max_uptime: 3600
initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz"
bootloader_append:
- root=/dev/ram0
- user=lkp
- job=/lkp/scheduled/lkp-nex04/unit_ebizzy-performance-200%-100x-10s-x86_64-rhel-HEAD-11a3ce832138b131965eea06e7be7e8df25640ef-1-20150618-42871-1i12387.yaml
- ARCH=x86_64
- kconfig=x86_64-rhel
- branch=yuyang-tip/for-lkp
- commit=11a3ce832138b131965eea06e7be7e8df25640ef
- BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/11a3ce832138b131965eea06e7be7e8df25640ef/vmlinuz-4.1.0-rc8-02642-g11a3ce8
- max_uptime=3600
- RESULT_ROOT=/result/ebizzy/performance-200%-100x-10s/lkp-nex04/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/11a3ce832138b131965eea06e7be7e8df25640ef/0
- LKP_SERVER=inn
- |2-
earlyprintk=ttyS0,115200 systemd.log_level=err
debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100
panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0
console=ttyS0,115200 console=tty0 vga=normal
rw
lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz"
modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/11a3ce832138b131965eea06e7be7e8df25640ef/modules.cgz"
bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/turbostat.cgz,/lkp/benchmarks/turbostat.cgz,/lkp/benchmarks/ebizzy-x86_64.cgz"
job_state: finished
loadavg: 99.72 116.41 82.95 1/600 43280
start_time: '1434591087'
end_time: '1434592097'
version: "/lkp/lkp/.src-20150617-214309"
[-- Attachment #3: reproduce.ksh --]
[-- Type: text/plain, Size: 6926 bytes --]
echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu10/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu11/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu12/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu13/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu14/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu15/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu16/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu17/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu18/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu19/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu20/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu21/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu22/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu23/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu24/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu25/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu26/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu27/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu28/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu29/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu30/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu31/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu32/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu33/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu34/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu35/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu36/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu37/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu38/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu39/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu4/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu40/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu41/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu42/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu43/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu44/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu45/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu46/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu47/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu48/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu49/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu5/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu50/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu51/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu52/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu53/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu54/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu55/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu56/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu57/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu58/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu59/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu6/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu60/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu61/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu62/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu63/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu7/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu8/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu9/cpufreq/scaling_governor
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
./ebizzy -t 128 -S 10
reply other threads:[~2015-06-19 7:09 UTC|newest]
Thread overview: [no followups] expand[flat|nested] mbox.gz Atom feed
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1434697771.21752.30.camel@intel.com \
--to=ying.huang@intel.com \
--cc=lkp@lists.01.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.