From: kernel test robot <oliver.sang@intel.com>
To: Peter Zijlstra <peterz@infradead.org>
Cc: <oe-lkp@lists.linux.dev>, <lkp@intel.com>, <oliver.sang@intel.com>
Subject: [peterz-queue:sched/eevdf] [sched/fair] 80a1fb6b3d: lmbench3.TCP.socket.bandwidth.10MB.MB/sec -11.2% regression
Date: Mon, 13 Nov 2023 22:52:34 +0800 [thread overview]
Message-ID: <202311132202.1eabb13e-oliver.sang@intel.com> (raw)
Hello,
kernel test robot noticed a -11.2% regression of lmbench3.TCP.socket.bandwidth.10MB.MB/sec on:
commit: 80a1fb6b3d64dbeafe3f699748d29179131a3080 ("sched/fair: Add trivial fair server")
https://git.kernel.org/cgit/linux/kernel/git/peterz/queue.git sched/eevdf
testcase: lmbench3
test machine: 48 threads 2 sockets Intel(R) Xeon(R) CPU E5-2697 v2 @ 2.70GHz (Ivy Bridge-EP) with 112G memory
parameters:
test_memory_size: 50%
nr_threads: 1
mode: development
test: TCP
cpufreq_governor: performance
In addition to that, the commit also has significant impact on the following tests:
+------------------+--------------------------------------------------------------------------------------------+
| testcase: change | adrestia: adrestia.wakeup_cost_periodic_us 133.3% regression |
| test machine | 8 threads 1 sockets Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz (Haswell) with 8G memory |
| test parameters | cpufreq_governor=performance |
| | nr_threads=100 |
+------------------+--------------------------------------------------------------------------------------------+
If you fix the issue in a separate patch/commit (i.e. not just a new version of
the same patch/commit), kindly add following tags
| Reported-by: kernel test robot <oliver.sang@intel.com>
| Closes: https://lore.kernel.org/oe-lkp/202311132202.1eabb13e-oliver.sang@intel.com
Details are as below:
-------------------------------------------------------------------------------------------------->
The kernel config and materials to reproduce are available at:
https://download.01.org/0day-ci/archive/20231113/202311132202.1eabb13e-oliver.sang@intel.com
=========================================================================================
compiler/cpufreq_governor/kconfig/mode/nr_threads/rootfs/tbox_group/test/test_memory_size/testcase:
gcc-12/performance/x86_64-rhel-8.3/development/1/debian-11.1-x86_64-20220510.cgz/lkp-ivb-2ep1/TCP/50%/lmbench3
commit:
837b5e5eb8 ("sched/deadline: Introduce deadline servers")
80a1fb6b3d ("sched/fair: Add trivial fair server")
837b5e5eb8eec6d0 80a1fb6b3d64dbeafe3f699748d
---------------- ---------------------------
%stddev %change %stddev
\ | \
10989170 ± 7% +39.1% 15281375 ± 31% cpuidle..usage
4072 ±110% +1077.6% 47954 ± 40% sched_debug.cpu.max_idle_balance_cost.stddev
798.85 ± 37% +313.4% 3302 ± 89% sched_debug.cpu.nr_switches.min
22185 ± 6% +343.7% 98441 ± 19% meminfo.Active
21294 ± 6% +358.1% 97552 ± 19% meminfo.Active(anon)
22761 ± 6% +341.4% 100479 ± 18% meminfo.Shmem
19993 ± 7% +368.9% 93747 ± 19% numa-meminfo.node1.Active
19280 ± 7% +384.9% 93482 ± 20% numa-meminfo.node1.Active(anon)
20415 ± 6% +370.3% 96021 ± 19% numa-meminfo.node1.Shmem
4817 ± 7% +385.0% 23366 ± 20% numa-vmstat.node1.nr_active_anon
5102 ± 6% +370.4% 24003 ± 19% numa-vmstat.node1.nr_shmem
4817 ± 7% +385.0% 23366 ± 20% numa-vmstat.node1.nr_zone_active_anon
1.59 ± 5% +81.2% 2.88 ± 13% vmstat.procs.r
51860 ± 5% -31.7% 35411 ± 23% vmstat.system.cs
48849 +78.9% 87368 ± 8% vmstat.system.in
24576 ± 6% +140.2% 59037 ± 23% turbostat.C1E
0.09 ± 6% +0.0 0.14 ± 11% turbostat.C1E%
6858510 ± 8% +158.3% 17717813 ± 26% turbostat.IRQ
30311 ± 15% +1551.0% 500443 ± 6% turbostat.POLL
0.00 ±152% +0.0 0.02 ± 25% turbostat.POLL%
14.77 +12.9% 16.68 lmbench3.TCP.localhost.latency
5170 -11.2% 4591 ± 5% lmbench3.TCP.socket.bandwidth.10MB.MB/sec
130.11 ± 5% +23.2% 160.24 ± 9% lmbench3.time.elapsed_time
130.11 ± 5% +23.2% 160.24 ± 9% lmbench3.time.elapsed_time.max
924.80 ± 8% +1043.5% 10575 ± 11% lmbench3.time.involuntary_context_switches
651776 +0.9% 657325 lmbench3.time.minor_page_faults
1862703 ± 4% -8.3% 1707320 ± 3% lmbench3.time.voluntary_context_switches
5323 ± 6% +358.0% 24381 ± 19% proc-vmstat.nr_active_anon
677885 +2.9% 697307 proc-vmstat.nr_file_pages
5690 ± 6% +341.3% 25114 ± 18% proc-vmstat.nr_shmem
5323 ± 6% +358.0% 24381 ± 19% proc-vmstat.nr_zone_active_anon
19211 ± 5% +17.4% 22554 ± 7% proc-vmstat.numa_huge_pte_updates
9881073 ± 5% +17.6% 11616589 ± 7% proc-vmstat.numa_pte_updates
8254 ± 2% +261.7% 29853 ± 12% proc-vmstat.pgactivate
1142589 ± 2% +15.3% 1317289 ± 13% proc-vmstat.pgfault
22349 ± 5% +37.1% 30645 ± 26% proc-vmstat.pgreuse
1167 ± 4% +5.0% 1225 ± 2% proc-vmstat.unevictable_pgs_culled
33065559 ± 4% -13.8% 28491307 ± 13% perf-stat.i.branch-misses
53094 ± 5% -32.3% 35964 ± 23% perf-stat.i.context-switches
68.78 ± 2% +138.7% 164.19 ± 9% perf-stat.i.cpu-migrations
923.62 -8.6% 843.76 ± 9% perf-stat.i.cycles-between-cache-misses
9.91e+08 ± 4% -15.7% 8.35e+08 ± 18% perf-stat.i.dTLB-loads
2625921 ± 5% -18.8% 2131798 ± 16% perf-stat.i.dTLB-store-misses
7.418e+08 ± 4% -14.9% 6.315e+08 ± 14% perf-stat.i.dTLB-stores
461.72 ± 4% +23.0% 567.97 ± 5% perf-stat.i.metric.K/sec
34.98 ± 3% +5.1 40.11 ± 5% perf-stat.i.node-load-miss-rate%
103413 ± 36% +285.1% 398237 ± 48% perf-stat.i.node-store-misses
0.35 ± 2% -0.0 0.34 ± 3% perf-stat.overall.dTLB-store-miss-rate%
1.54 ± 34% +5.5 7.06 ± 34% perf-stat.overall.node-store-miss-rate%
32848650 ± 4% -13.7% 28347126 ± 13% perf-stat.ps.branch-misses
52541 ± 5% -32.1% 35688 ± 23% perf-stat.ps.context-switches
68.33 ± 2% +139.1% 163.37 ± 9% perf-stat.ps.cpu-migrations
9.841e+08 ± 4% -15.6% 8.307e+08 ± 18% perf-stat.ps.dTLB-loads
2606037 ± 5% -18.6% 2121205 ± 16% perf-stat.ps.dTLB-store-misses
7.363e+08 ± 4% -14.7% 6.282e+08 ± 14% perf-stat.ps.dTLB-stores
102590 ± 35% +285.6% 395600 ± 48% perf-stat.ps.node-store-misses
1.32 ± 24% -0.6 0.67 ± 34% perf-profile.children.cycles-pp.rep_movs_alternative
0.50 ± 33% -0.3 0.18 ± 39% perf-profile.children.cycles-pp._copy_to_iter
0.45 ± 36% -0.3 0.13 ± 57% perf-profile.children.cycles-pp.copyout
0.07 ± 45% +0.1 0.15 ± 34% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.08 ± 29% +0.1 0.17 ± 33% perf-profile.children.cycles-pp.kthread
0.08 ± 30% +0.1 0.17 ± 34% perf-profile.children.cycles-pp.ret_from_fork
0.08 ± 30% +0.1 0.17 ± 34% perf-profile.children.cycles-pp.ret_from_fork_asm
0.17 ± 17% +0.1 0.29 ± 17% perf-profile.children.cycles-pp.native_irq_return_iret
0.00 +0.1 0.14 ± 77% perf-profile.children.cycles-pp.set_next_entity
0.00 +0.2 0.16 ± 46% perf-profile.children.cycles-pp.put_prev_task_fair
0.00 +0.2 0.16 ± 57% perf-profile.children.cycles-pp.newidle_balance
0.07 ± 68% +0.2 0.29 ± 72% perf-profile.children.cycles-pp.update_load_avg
0.00 +0.2 0.24 ± 52% perf-profile.children.cycles-pp.pick_task_dl
0.25 ± 19% +0.3 0.52 ± 15% perf-profile.children.cycles-pp.lapic_next_deadline
0.04 ± 86% +0.3 0.33 ± 31% perf-profile.children.cycles-pp.task_tick_fair
0.00 +0.3 0.34 ± 68% perf-profile.children.cycles-pp.hrtimer_start_range_ns
0.42 ± 15% +0.3 0.76 ± 13% perf-profile.children.cycles-pp.clockevents_program_event
0.00 +0.4 0.37 ± 83% perf-profile.children.cycles-pp.pick_next_task_fair
0.00 +0.4 0.37 ± 31% perf-profile.children.cycles-pp.hrtick
0.01 ±299% +0.5 0.46 ± 33% perf-profile.children.cycles-pp.irqentry_exit_to_user_mode
0.00 +0.6 0.62 ± 45% perf-profile.children.cycles-pp.pick_next_task_dl
0.00 +0.6 0.64 ± 38% perf-profile.children.cycles-pp.exit_to_user_mode_loop
0.13 ± 17% +0.6 0.78 ± 31% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.11 ± 34% +1.1 1.22 ±129% perf-profile.children.cycles-pp.schedule
0.20 ± 22% +1.7 1.90 ±131% perf-profile.children.cycles-pp.__schedule
1.20 ± 25% -0.6 0.56 ± 37% perf-profile.self.cycles-pp.rep_movs_alternative
0.06 ± 58% +0.1 0.15 ± 31% perf-profile.self.cycles-pp.__update_load_avg_cfs_rq
0.01 ±299% +0.1 0.11 ± 82% perf-profile.self.cycles-pp.update_load_avg
0.17 ± 17% +0.1 0.29 ± 17% perf-profile.self.cycles-pp.native_irq_return_iret
0.24 ± 20% +0.3 0.51 ± 15% perf-profile.self.cycles-pp.lapic_next_deadline
0.02 ± 5% -81.4% 0.00 ± 14% perf-sched.sch_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.02 ± 7% +45.1% 0.02 ± 12% perf-sched.sch_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.00 +47.5% 0.01 ± 5% perf-sched.sch_delay.avg.ms.pipe_read.vfs_read.ksys_read.do_syscall_64
0.01 ± 13% -50.8% 0.01 ± 28% perf-sched.sch_delay.avg.ms.schedule_hrtimeout_range_clock.do_poll.constprop.0.do_sys_poll
1.45 ±289% -99.4% 0.01 ±210% perf-sched.sch_delay.avg.ms.syslog_print.do_syslog.kmsg_read.vfs_read
0.03 ± 13% -99.6% 0.00 ±300% perf-sched.sch_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open
0.01 ±124% +387.3% 0.03 ± 7% perf-sched.sch_delay.max.ms.__cond_resched.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
0.01 ±156% +575.0% 0.10 ± 21% perf-sched.sch_delay.max.ms.__cond_resched.stop_one_cpu.sched_exec.bprm_execve.part
0.12 ± 13% -62.9% 0.05 ± 23% perf-sched.sch_delay.max.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.09 ± 27% +44.2% 0.13 ± 11% perf-sched.sch_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.09 ± 32% -96.0% 0.00 ±200% perf-sched.sch_delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open
129.16 ± 3% -26.8% 94.55 ± 2% perf-sched.total_wait_and_delay.average.ms
3810 +61.2% 6143 ± 3% perf-sched.total_wait_and_delay.count.ms
4983 -39.5% 3016 ± 24% perf-sched.total_wait_and_delay.max.ms
129.15 ± 3% -26.8% 94.54 ± 2% perf-sched.total_wait_time.average.ms
4983 -39.5% 3016 ± 24% perf-sched.total_wait_time.max.ms
32.76 ± 5% -55.9% 14.43 ± 4% perf-sched.wait_and_delay.avg.ms.__cond_resched.__wait_for_common.affine_move_task.__set_cpus_allowed_ptr.__sched_setaffinity
0.56 ± 4% +98.2% 1.12 ± 2% perf-sched.wait_and_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
4.29 ± 8% -17.7% 3.53 ± 6% perf-sched.wait_and_delay.avg.ms.rcu_gp_kthread.kthread.ret_from_fork.ret_from_fork_asm
583.69 ± 3% -33.8% 386.15 ± 15% perf-sched.wait_and_delay.avg.ms.schedule_hrtimeout_range_clock.do_poll.constprop.0.do_sys_poll
0.63 ± 4% +76.2% 1.11 perf-sched.wait_and_delay.avg.ms.schedule_timeout.__wait_for_common.wait_for_completion_state.kernel_clone
29.03 ± 15% -40.4% 17.30 ± 24% perf-sched.wait_and_delay.avg.ms.schedule_timeout.rcu_gp_fqs_loop.rcu_gp_kthread.kthread
623.88 ± 7% -67.9% 199.98 ± 4% perf-sched.wait_and_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
469.42 ± 7% +15.3% 541.30 ± 2% perf-sched.wait_and_delay.avg.ms.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
4.10 ±201% +4297.6% 180.30 ± 28% perf-sched.wait_and_delay.count.exit_to_user_mode_loop.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt
20.60 ± 3% +98.5% 40.90 ± 16% perf-sched.wait_and_delay.count.schedule_hrtimeout_range_clock.do_poll.constprop.0.do_sys_poll
167.50 ± 15% +72.7% 289.30 ± 24% perf-sched.wait_and_delay.count.schedule_timeout.rcu_gp_fqs_loop.rcu_gp_kthread.kthread
361.30 ± 8% +240.1% 1228 ± 6% perf-sched.wait_and_delay.count.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
261.10 ± 9% +28.6% 335.70 ± 2% perf-sched.wait_and_delay.count.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
4983 -79.9% 1000 perf-sched.wait_and_delay.max.ms.__cond_resched.__wait_for_common.affine_move_task.__set_cpus_allowed_ptr.__sched_setaffinity
21.38 ± 2% +78.1% 38.08 ± 3% perf-sched.wait_and_delay.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.01 ±200% +8768.5% 1.32 ±144% perf-sched.wait_and_delay.max.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt
1.37 ± 7% +71.6% 2.35 ± 5% perf-sched.wait_and_delay.max.ms.schedule_timeout.__wait_for_common.wait_for_completion_state.kernel_clone
0.09 ± 32% -48.2% 0.05 ± 9% perf-sched.wait_and_delay.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open
32.76 ± 5% -56.0% 14.43 ± 4% perf-sched.wait_time.avg.ms.__cond_resched.__wait_for_common.affine_move_task.__set_cpus_allowed_ptr.__sched_setaffinity
16.68 ± 12% -89.5% 1.75 ±268% perf-sched.wait_time.avg.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
0.55 ± 4% +99.9% 1.09 ± 2% perf-sched.wait_time.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
4.28 ± 8% -17.8% 3.52 ± 6% perf-sched.wait_time.avg.ms.rcu_gp_kthread.kthread.ret_from_fork.ret_from_fork_asm
583.67 ± 3% -33.8% 386.14 ± 15% perf-sched.wait_time.avg.ms.schedule_hrtimeout_range_clock.do_poll.constprop.0.do_sys_poll
0.61 ± 5% +78.9% 1.09 perf-sched.wait_time.avg.ms.schedule_timeout.__wait_for_common.wait_for_completion_state.kernel_clone
29.01 ± 15% -40.4% 17.28 ± 24% perf-sched.wait_time.avg.ms.schedule_timeout.rcu_gp_fqs_loop.rcu_gp_kthread.kthread
623.86 ± 7% -67.9% 199.97 ± 4% perf-sched.wait_time.avg.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
15.80 ± 28% -88.9% 1.76 ±267% perf-sched.wait_time.avg.ms.syslog_print.do_syslog.kmsg_read.vfs_read
469.40 ± 7% +15.3% 541.27 ± 2% perf-sched.wait_time.avg.ms.worker_thread.kthread.ret_from_fork.ret_from_fork_asm
4983 -79.9% 1000 perf-sched.wait_time.max.ms.__cond_resched.__wait_for_common.affine_move_task.__set_cpus_allowed_ptr.__sched_setaffinity
55.91 -89.5% 5.86 ±280% perf-sched.wait_time.max.ms.devkmsg_read.vfs_read.ksys_read.do_syscall_64
21.34 ± 2% +78.3% 38.05 ± 3% perf-sched.wait_time.max.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.01 ±134% +83934.9% 12.52 ±289% perf-sched.wait_time.max.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
0.20 ± 7% -20.9% 0.16 ± 14% perf-sched.wait_time.max.ms.ipmi_thread.kthread.ret_from_fork.ret_from_fork_asm
1.32 ± 5% +73.0% 2.29 ± 5% perf-sched.wait_time.max.ms.schedule_timeout.__wait_for_common.wait_for_completion_state.kernel_clone
50.70 ± 30% -88.4% 5.87 ±280% perf-sched.wait_time.max.ms.syslog_print.do_syslog.kmsg_read.vfs_read
0.00 ±200% +1860.0% 0.05 ± 9% perf-sched.wait_time.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open
***************************************************************************************************
lkp-hsw-d04: 8 threads 1 sockets Intel(R) Core(TM) i7-4770K CPU @ 3.50GHz (Haswell) with 8G memory
=========================================================================================
compiler/cpufreq_governor/kconfig/nr_threads/rootfs/tbox_group/testcase:
gcc-12/performance/x86_64-rhel-8.3/100/debian-11.1-x86_64-20220510.cgz/lkp-hsw-d04/adrestia
commit:
837b5e5eb8 ("sched/deadline: Introduce deadline servers")
80a1fb6b3d ("sched/fair: Add trivial fair server")
837b5e5eb8eec6d0 80a1fb6b3d64dbeafe3f699748d
---------------- ---------------------------
%stddev %change %stddev
\ | \
0.43 ± 12% +328.9% 1.85 ± 5% vmstat.procs.r
10843 +336.0% 47282 vmstat.system.in
0.81 ± 9% +0.4 1.25 mpstat.cpu.all.irq%
0.05 ± 2% +0.0 0.06 mpstat.cpu.all.soft%
2.69 ± 7% +1.2 3.88 mpstat.cpu.all.sys%
1.57 ± 7% +0.2 1.82 ± 4% mpstat.cpu.all.usr%
534.01 +3.4% 552.06 adrestia.time.elapsed_time
534.01 +3.4% 552.06 adrestia.time.elapsed_time.max
138.00 ± 6% +1.1e+05% 150811 ± 2% adrestia.time.involuntary_context_switches
35.00 +22.9% 43.00 adrestia.time.percent_of_cpu_this_job_got
126.44 +35.3% 171.12 adrestia.time.system_time
64.37 +8.2% 69.66 ± 4% adrestia.time.user_time
3.00 +133.3% 7.00 adrestia.wakeup_cost_periodic_us
339.60 ± 6% +36.5% 463.40 turbostat.Avg_MHz
9.05 ± 6% +3.3 12.38 turbostat.Busy%
15751443 -15.0% 13389775 turbostat.C1
50.68 ± 7% -17.8 32.91 ± 3% turbostat.C1%
2761471 -59.4% 1121889 turbostat.C1E
3.63 ± 7% -2.0 1.61 turbostat.C1E%
2121421 -22.1% 1653050 turbostat.C3
84118 ± 2% +691.4% 665709 turbostat.C6
0.90 ± 7% +8.7 9.65 turbostat.C6%
1047748 ± 36% +72.6% 1808036 ± 5% turbostat.C7s
73.29 ± 7% -23.9% 55.75 ± 2% turbostat.CPU%c1
7.71 ± 6% +35.3% 10.42 turbostat.CPU%c3
0.09 ± 7% +7855.6% 7.16 turbostat.CPU%c6
6135197 ± 6% +338.4% 26895159 turbostat.IRQ
44640334 +10.7% 49429178 turbostat.POLL
1.98 ± 8% +0.8 2.80 turbostat.POLL%
48565 ± 3% +16.5% 56588 sched_debug.cfs_rq:/.avg_vruntime.avg
31794 ± 7% +31.5% 41816 ± 8% sched_debug.cfs_rq:/.avg_vruntime.min
48565 ± 3% +16.5% 56588 sched_debug.cfs_rq:/.min_vruntime.avg
31794 ± 7% +31.5% 41811 ± 8% sched_debug.cfs_rq:/.min_vruntime.min
42.23 ± 48% -69.7% 12.80 ± 89% sched_debug.cfs_rq:/.removed.load_avg.avg
321.99 ± 51% -68.2% 102.38 ± 89% sched_debug.cfs_rq:/.removed.load_avg.max
107.97 ± 50% -68.6% 33.86 ± 89% sched_debug.cfs_rq:/.removed.load_avg.stddev
19.19 ± 55% -70.9% 5.58 ±103% sched_debug.cfs_rq:/.removed.runnable_avg.avg
152.72 ± 56% -70.8% 44.66 ±103% sched_debug.cfs_rq:/.removed.runnable_avg.max
50.53 ± 56% -70.8% 14.77 ±103% sched_debug.cfs_rq:/.removed.runnable_avg.stddev
19.01 ± 56% -71.5% 5.41 ±108% sched_debug.cfs_rq:/.removed.util_avg.avg
151.76 ± 57% -71.5% 43.28 ±108% sched_debug.cfs_rq:/.removed.util_avg.max
50.20 ± 57% -71.5% 14.31 ±108% sched_debug.cfs_rq:/.removed.util_avg.stddev
290789 ± 24% -24.0% 220891 ± 4% sched_debug.cpu.avg_idle.avg
932676 ± 2% -18.8% 757517 ± 8% sched_debug.cpu.avg_idle.max
288735 ± 4% -17.8% 237197 ± 6% sched_debug.cpu.avg_idle.stddev
0.48 ± 11% +59.9% 0.76 ± 17% sched_debug.cpu.nr_running.avg
1.39 ± 8% +77.3% 2.46 ± 13% sched_debug.cpu.nr_running.max
0.53 ± 9% +81.2% 0.96 ± 14% sched_debug.cpu.nr_running.stddev
66.31 ± 24% -42.4% 38.20 ± 32% sched_debug.cpu.nr_uninterruptible.max
0.01 ± 23% -54.8% 0.00 ± 14% perf-sched.sch_delay.avg.ms.do_task_dead.do_exit.do_group_exit.__x64_sys_exit_group.do_syscall_64
0.01 ± 55% -66.7% 0.00 ± 20% perf-sched.sch_delay.avg.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
0.00 +100.0% 0.00 perf-sched.sch_delay.avg.ms.pipe_read.vfs_read.ksys_read.do_syscall_64
0.01 ± 33% -69.2% 0.00 ± 84% perf-sched.sch_delay.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open
0.00 +100.0% 0.00 perf-sched.total_sch_delay.average.ms
0.44 ± 7% +21.4% 0.53 ± 10% perf-sched.wait_and_delay.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.35 +23.1% 0.43 ± 8% perf-sched.wait_and_delay.avg.ms.schedule_timeout.__wait_for_common.wait_for_completion_state.kernel_clone
502.06 ± 3% -42.6% 288.30 ± 11% perf-sched.wait_and_delay.avg.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
93.40 ± 4% +78.2% 166.40 ± 9% perf-sched.wait_and_delay.count.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
1190 ± 62% +85.6% 2209 ± 33% perf-sched.wait_and_delay.max.ms.__cond_resched.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
0.97 ± 10% +57.0% 1.52 ± 23% perf-sched.wait_and_delay.max.ms.schedule_timeout.__wait_for_common.wait_for_completion_state.kernel_clone
0.43 ± 7% +21.9% 0.52 ± 11% perf-sched.wait_time.avg.ms.do_wait.kernel_wait4.__do_sys_wait4.do_syscall_64
0.01 ±178% +23380.6% 3.15 ± 65% perf-sched.wait_time.avg.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt
0.00 ±133% +1.4e+05% 0.86 ± 87% perf-sched.wait_time.avg.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
0.35 +23.4% 0.43 ± 8% perf-sched.wait_time.avg.ms.schedule_timeout.__wait_for_common.wait_for_completion_state.kernel_clone
502.05 ± 3% -42.6% 288.29 ± 11% perf-sched.wait_time.avg.ms.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
0.00 ± 63% +540.0% 0.01 ± 15% perf-sched.wait_time.avg.ms.wait_for_partner.fifo_open.do_dentry_open.do_open
1190 ± 62% +85.6% 2209 ± 33% perf-sched.wait_time.max.ms.__cond_resched.smpboot_thread_fn.kthread.ret_from_fork.ret_from_fork_asm
0.01 ±159% +81047.3% 12.01 ± 52% perf-sched.wait_time.max.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.irqentry_exit_to_user_mode.asm_sysvec_apic_timer_interrupt
0.00 ±122% +1.2e+06% 9.31 ± 63% perf-sched.wait_time.max.ms.exit_to_user_mode_loop.exit_to_user_mode_prepare.syscall_exit_to_user_mode.do_syscall_64
0.97 ± 10% +56.6% 1.51 ± 24% perf-sched.wait_time.max.ms.schedule_timeout.__wait_for_common.wait_for_completion_state.kernel_clone
0.01 ± 42% +107.0% 0.02 ± 6% perf-sched.wait_time.max.ms.wait_for_partner.fifo_open.do_dentry_open.do_open
3.758e+08 ± 7% +24.7% 4.686e+08 perf-stat.i.branch-instructions
5644510 ± 6% +66.8% 9416820 ± 2% perf-stat.i.branch-misses
243151 ± 7% +37.5% 334402 perf-stat.i.cache-misses
13321740 ± 4% +70.2% 22679135 perf-stat.i.cache-references
2.691e+09 ± 6% +37.8% 3.708e+09 perf-stat.i.cpu-cycles
701.43 ± 7% +2113.4% 15525 perf-stat.i.cpu-migrations
723725 ± 6% +48.0% 1071102 ± 12% perf-stat.i.dTLB-load-misses
4.57e+08 ± 7% +25.3% 5.726e+08 perf-stat.i.dTLB-loads
405856 ± 6% +25.7% 510074 ± 4% perf-stat.i.dTLB-store-misses
2.846e+08 ± 6% +24.8% 3.551e+08 perf-stat.i.dTLB-stores
1.713e+09 ± 7% +25.1% 2.144e+09 perf-stat.i.instructions
2815 ± 4% +41.1% 3971 ± 2% perf-stat.i.instructions-per-iTLB-miss
0.34 ± 6% +37.8% 0.46 perf-stat.i.metric.GHz
141.28 ± 7% +25.5% 177.34 perf-stat.i.metric.M/sec
1.50 ± 3% +0.5 2.01 perf-stat.overall.branch-miss-rate%
1.84 ± 12% -0.4 1.48 ± 2% perf-stat.overall.cache-miss-rate%
1.57 +10.0% 1.73 perf-stat.overall.cpi
0.16 +0.0 0.19 ± 11% perf-stat.overall.dTLB-load-miss-rate%
41.38 +3.4 44.76 perf-stat.overall.iTLB-load-miss-rate%
2997 +26.3% 3785 perf-stat.overall.instructions-per-iTLB-miss
0.64 -9.1% 0.58 perf-stat.overall.ipc
3.752e+08 ± 7% +24.7% 4.678e+08 perf-stat.ps.branch-instructions
5637809 ± 6% +66.8% 9402578 ± 2% perf-stat.ps.branch-misses
242846 ± 7% +37.5% 333900 perf-stat.ps.cache-misses
13298995 ± 4% +70.2% 22639518 perf-stat.ps.cache-references
2.687e+09 ± 6% +37.8% 3.702e+09 perf-stat.ps.cpu-cycles
700.14 ± 7% +2113.5% 15497 perf-stat.ps.cpu-migrations
722454 ± 6% +48.0% 1069218 ± 12% perf-stat.ps.dTLB-load-misses
4.563e+08 ± 7% +25.3% 5.716e+08 perf-stat.ps.dTLB-loads
405155 ± 6% +25.7% 509189 ± 4% perf-stat.ps.dTLB-store-misses
2.842e+08 ± 6% +24.8% 3.546e+08 perf-stat.ps.dTLB-stores
1.711e+09 ± 7% +25.1% 2.141e+09 perf-stat.ps.instructions
9.597e+11 +26.5% 1.214e+12 perf-stat.total.instructions
33.74 ± 5% -9.6 24.15 perf-profile.calltrace.cycles-pp.intel_idle.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle
56.18 ± 4% -7.9 48.25 perf-profile.calltrace.cycles-pp.cpuidle_enter_state.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry
48.42 ± 2% -5.6 42.85 ± 4% perf-profile.calltrace.cycles-pp.cpuidle_enter.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary
50.76 ± 2% -5.5 45.31 ± 4% perf-profile.calltrace.cycles-pp.cpuidle_idle_call.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
66.67 ± 4% -5.3 61.40 perf-profile.calltrace.cycles-pp.secondary_startup_64_no_verify
5.69 ± 6% -1.1 4.59 ± 5% perf-profile.calltrace.cycles-pp.__libc_write.start_thread
4.40 ± 6% -0.8 3.60 ± 6% perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write.start_thread
4.45 ± 6% -0.8 3.67 ± 5% perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_write.start_thread
1.92 ± 12% -0.4 1.50 ± 7% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read.start_thread
1.41 ± 5% -0.4 1.02 ± 9% perf-profile.calltrace.cycles-pp.syscall_exit_to_user_mode.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_write.start_thread
1.28 ± 10% +0.3 1.53 ± 5% perf-profile.calltrace.cycles-pp.hrtimer_interrupt.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state
1.30 ± 11% +0.3 1.56 ± 6% perf-profile.calltrace.cycles-pp.__sysvec_apic_timer_interrupt.sysvec_apic_timer_interrupt.asm_sysvec_apic_timer_interrupt.cpuidle_enter_state.cpuidle_enter
0.59 ± 50% +0.5 1.13 ± 4% perf-profile.calltrace.cycles-pp.select_task_rq.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock
0.53 ± 51% +0.6 1.09 ± 7% perf-profile.calltrace.cycles-pp.select_task_rq_fair.select_task_rq.try_to_wake_up.autoremove_wake_function.__wake_up_common
0.00 +0.6 0.59 ± 10% perf-profile.calltrace.cycles-pp.finish_task_switch.__schedule.schedule.pipe_read.vfs_read
1.89 ± 22% +0.6 2.54 ± 6% perf-profile.calltrace.cycles-pp.__wake_up_common.__wake_up_common_lock.pipe_write.vfs_write.ksys_write
0.00 +0.7 0.68 ± 9% perf-profile.calltrace.cycles-pp.select_idle_sibling.select_task_rq_fair.select_task_rq.try_to_wake_up.autoremove_wake_function
0.00 +0.7 0.69 ± 12% perf-profile.calltrace.cycles-pp.pick_next_task_fair.pick_task_dl.pick_next_task_dl.__schedule.schedule_idle
1.64 ± 23% +0.7 2.36 ± 6% perf-profile.calltrace.cycles-pp.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write.vfs_write
1.53 ± 25% +0.8 2.29 ± 5% perf-profile.calltrace.cycles-pp.try_to_wake_up.autoremove_wake_function.__wake_up_common.__wake_up_common_lock.pipe_write
0.00 +0.8 0.81 ± 14% perf-profile.calltrace.cycles-pp.cpudl_clear.__dequeue_dl_entity.dl_server_stop.dequeue_task_fair.__schedule
0.00 +0.8 0.81 ± 25% perf-profile.calltrace.cycles-pp.hrtimer_start_range_ns.pick_next_task_dl.__schedule.schedule_idle.do_idle
2.02 ± 23% +0.8 2.84 ± 6% perf-profile.calltrace.cycles-pp.__wake_up_common_lock.pipe_write.vfs_write.ksys_write.do_syscall_64
0.00 +0.8 0.82 ± 9% perf-profile.calltrace.cycles-pp.pick_task_dl.pick_next_task_dl.__schedule.schedule_idle.do_idle
2.72 ± 5% +0.9 3.58 ± 9% perf-profile.calltrace.cycles-pp.__flush_smp_call_function_queue.flush_smp_call_function_queue.do_idle.cpu_startup_entry.start_secondary
0.00 +0.9 0.91 ± 14% perf-profile.calltrace.cycles-pp.__dequeue_dl_entity.dl_server_stop.dequeue_task_fair.__schedule.schedule
1.69 ± 11% +1.1 2.77 ± 2% perf-profile.calltrace.cycles-pp.enqueue_task_fair.activate_task.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue
2.36 ± 8% +1.1 3.45 ± 2% perf-profile.calltrace.cycles-pp.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue.do_idle.cpu_startup_entry
0.00 +1.1 1.11 ± 5% perf-profile.calltrace.cycles-pp.update_blocked_averages.newidle_balance.pick_next_task_fair.__schedule.schedule
1.89 ± 8% +1.1 3.02 ± 2% perf-profile.calltrace.cycles-pp.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue.do_idle
1.73 ± 9% +1.1 2.86 ± 2% perf-profile.calltrace.cycles-pp.activate_task.ttwu_do_activate.sched_ttwu_pending.__flush_smp_call_function_queue.flush_smp_call_function_queue
0.00 +1.1 1.14 ± 14% perf-profile.calltrace.cycles-pp.dl_server_stop.dequeue_task_fair.__schedule.schedule.pipe_read
2.90 ± 7% +1.1 4.04 ± 6% perf-profile.calltrace.cycles-pp.flush_smp_call_function_queue.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
2.37 ± 8% +1.4 3.74 ± 10% perf-profile.calltrace.cycles-pp.schedule_idle.do_idle.cpu_startup_entry.start_secondary.secondary_startup_64_no_verify
2.26 ± 8% +1.4 3.66 ± 10% perf-profile.calltrace.cycles-pp.__schedule.schedule_idle.do_idle.cpu_startup_entry.start_secondary
2.23 ± 5% +1.6 3.80 ± 7% perf-profile.calltrace.cycles-pp.dequeue_task_fair.__schedule.schedule.pipe_read.vfs_read
0.00 +1.9 1.90 ± 14% perf-profile.calltrace.cycles-pp.pick_next_task_dl.__schedule.schedule_idle.do_idle.cpu_startup_entry
0.00 +2.8 2.84 ± 11% perf-profile.calltrace.cycles-pp.update_sg_lb_stats.update_sd_lb_stats.find_busiest_group.load_balance.newidle_balance
0.00 +3.6 3.58 ± 10% perf-profile.calltrace.cycles-pp.update_sd_lb_stats.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair
0.00 +3.9 3.91 ± 10% perf-profile.calltrace.cycles-pp.find_busiest_group.load_balance.newidle_balance.pick_next_task_fair.__schedule
0.00 +6.1 6.11 ± 6% perf-profile.calltrace.cycles-pp.load_balance.newidle_balance.pick_next_task_fair.__schedule.schedule
19.65 +6.8 26.47 perf-profile.calltrace.cycles-pp.start_thread
0.00 +7.8 7.83 ± 5% perf-profile.calltrace.cycles-pp.newidle_balance.pick_next_task_fair.__schedule.schedule.pipe_read
0.00 +7.9 7.91 ± 4% perf-profile.calltrace.cycles-pp.pick_next_task_fair.__schedule.schedule.pipe_read.vfs_read
13.30 ± 3% +8.1 21.36 perf-profile.calltrace.cycles-pp.__libc_read.start_thread
11.18 ± 4% +8.5 19.65 perf-profile.calltrace.cycles-pp.entry_SYSCALL_64_after_hwframe.__libc_read.start_thread
10.98 ± 4% +8.6 19.55 perf-profile.calltrace.cycles-pp.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read.start_thread
9.93 ± 4% +8.6 18.57 perf-profile.calltrace.cycles-pp.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read
8.88 ± 6% +9.0 17.84 perf-profile.calltrace.cycles-pp.pipe_read.vfs_read.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe
8.83 ± 4% +9.0 17.86 perf-profile.calltrace.cycles-pp.ksys_read.do_syscall_64.entry_SYSCALL_64_after_hwframe.__libc_read.start_thread
4.68 ± 4% +9.7 14.34 perf-profile.calltrace.cycles-pp.schedule.pipe_read.vfs_read.ksys_read.do_syscall_64
4.59 ± 4% +9.7 14.26 perf-profile.calltrace.cycles-pp.__schedule.schedule.pipe_read.vfs_read.ksys_read
33.75 ± 5% -9.6 24.15 perf-profile.children.cycles-pp.intel_idle
56.46 ± 4% -7.9 48.59 perf-profile.children.cycles-pp.cpuidle_enter
56.42 ± 4% -7.9 48.56 perf-profile.children.cycles-pp.cpuidle_enter_state
59.19 ± 4% -7.8 51.36 perf-profile.children.cycles-pp.cpuidle_idle_call
66.67 ± 4% -5.3 61.40 perf-profile.children.cycles-pp.secondary_startup_64_no_verify
66.67 ± 4% -5.3 61.40 perf-profile.children.cycles-pp.cpu_startup_entry
66.64 ± 4% -5.3 61.37 perf-profile.children.cycles-pp.do_idle
6.04 ± 10% -1.4 4.65 ± 4% perf-profile.children.cycles-pp.syscall_exit_to_user_mode
2.21 ± 14% -0.8 1.40 ± 7% perf-profile.children.cycles-pp.__entry_text_start
1.97 ± 14% -0.6 1.41 ± 9% perf-profile.children.cycles-pp.syscall_return_via_sysret
1.25 ± 12% -0.4 0.88 ± 8% perf-profile.children.cycles-pp.__fdget_pos
1.15 ± 11% -0.3 0.83 ± 9% perf-profile.children.cycles-pp.__fget_light
1.05 ± 15% -0.3 0.77 ± 9% perf-profile.children.cycles-pp.generic_update_time
0.55 ± 19% -0.3 0.28 ± 11% perf-profile.children.cycles-pp.mutex_unlock
0.89 ± 8% -0.2 0.64 ± 10% perf-profile.children.cycles-pp.security_file_permission
0.55 ± 25% -0.2 0.31 ± 16% perf-profile.children.cycles-pp.__mark_inode_dirty
0.76 ± 9% -0.2 0.59 ± 8% perf-profile.children.cycles-pp.apparmor_file_permission
0.32 ± 9% -0.1 0.18 ± 22% perf-profile.children.cycles-pp.__mnt_want_write
0.37 ± 12% -0.1 0.23 ± 22% perf-profile.children.cycles-pp.entry_SYSRETQ_unsafe_stack
0.30 ± 18% -0.1 0.20 ± 31% perf-profile.children.cycles-pp.restore_fpregs_from_fpstate
0.26 ± 8% -0.1 0.18 ± 19% perf-profile.children.cycles-pp.__dequeue_entity
0.32 ± 15% -0.1 0.26 ± 21% perf-profile.children.cycles-pp.tick_nohz_idle_exit
0.09 ± 29% -0.0 0.05 ± 52% perf-profile.children.cycles-pp.filemap_map_pages
0.04 ± 83% +0.1 0.09 ± 15% perf-profile.children.cycles-pp.update_curr_se
0.00 +0.1 0.07 ± 12% perf-profile.children.cycles-pp.tick_check_oneshot_broadcast_this_cpu
0.00 +0.1 0.07 ± 17% perf-profile.children.cycles-pp.rcu_sched_clock_irq
0.00 +0.1 0.07 ± 19% perf-profile.children.cycles-pp.irqentry_exit
0.00 +0.1 0.07 ± 20% perf-profile.children.cycles-pp.__update_load_avg_blocked_se
0.04 ± 83% +0.1 0.12 ± 10% perf-profile.children.cycles-pp.tick_nohz_stop_idle
0.10 ± 22% +0.1 0.18 ± 12% perf-profile.children.cycles-pp.hrtimer_next_event_without
0.01 ±200% +0.1 0.09 ± 12% perf-profile.children.cycles-pp.error_entry
0.00 +0.1 0.08 ± 33% perf-profile.children.cycles-pp.hrtimer_active
0.00 +0.1 0.09 ± 23% perf-profile.children.cycles-pp.fair_server_pick
0.00 +0.1 0.09 ± 30% perf-profile.children.cycles-pp.ct_nmi_enter
0.00 +0.1 0.09 ± 21% perf-profile.children.cycles-pp.cpudl_heapify_up
0.08 ± 60% +0.1 0.16 ± 30% perf-profile.children.cycles-pp.common_nsleep
0.08 ± 60% +0.1 0.16 ± 30% perf-profile.children.cycles-pp.do_nanosleep
0.08 ± 60% +0.1 0.16 ± 30% perf-profile.children.cycles-pp.hrtimer_nanosleep
0.00 +0.1 0.09 ± 27% perf-profile.children.cycles-pp.resched_curr
0.00 +0.1 0.09 ± 18% perf-profile.children.cycles-pp.update_dl_rq_load_avg
0.04 ± 84% +0.1 0.14 ± 37% perf-profile.children.cycles-pp.__enqueue_entity
0.12 ± 29% +0.1 0.23 ± 33% perf-profile.children.cycles-pp._raw_spin_unlock_irqrestore
0.00 +0.1 0.10 ± 36% perf-profile.children.cycles-pp.can_migrate_task
0.08 ± 69% +0.1 0.19 ± 35% perf-profile.children.cycles-pp.__x64_sys_clock_nanosleep
0.13 ± 39% +0.1 0.25 ± 29% perf-profile.children.cycles-pp.put_prev_entity
0.08 ± 66% +0.1 0.19 ± 17% perf-profile.children.cycles-pp.wakeup_preempt
0.00 +0.1 0.11 ± 10% perf-profile.children.cycles-pp.tick_program_event
0.03 ±133% +0.1 0.15 ± 17% perf-profile.children.cycles-pp.remove_entity_load_avg
0.00 +0.1 0.12 ± 44% perf-profile.children.cycles-pp.should_we_balance
0.10 ± 35% +0.1 0.21 ± 39% perf-profile.children.cycles-pp.__update_idle_core
0.07 ± 23% +0.1 0.19 ± 6% perf-profile.children.cycles-pp.__hrtimer_next_event_base
0.00 +0.1 0.12 ± 40% perf-profile.children.cycles-pp.rb_insert_color
0.00 +0.1 0.12 ± 38% perf-profile.children.cycles-pp.pick_next_task_stop
0.03 ±123% +0.1 0.15 ± 20% perf-profile.children.cycles-pp.ktime_get_update_offsets_now
0.00 +0.1 0.13 ± 42% perf-profile.children.cycles-pp.update_rt_rq_load_avg
0.00 +0.1 0.13 ± 27% perf-profile.children.cycles-pp.irqentry_enter
0.01 ±200% +0.1 0.14 ± 18% perf-profile.children.cycles-pp._find_next_bit
0.00 +0.1 0.13 ± 16% perf-profile.children.cycles-pp.task_non_contending
0.00 +0.1 0.14 ± 26% perf-profile.children.cycles-pp.task_h_load
0.00 +0.1 0.14 ± 23% perf-profile.children.cycles-pp.cpudl_heapify
0.01 ±200% +0.2 0.17 ± 21% perf-profile.children.cycles-pp.hrtimer_update_next_event
0.57 ± 10% +0.2 0.73 ± 9% perf-profile.children.cycles-pp.irq_exit_rcu
0.11 ± 30% +0.2 0.27 ± 16% perf-profile.children.cycles-pp.irqtime_account_irq
0.15 ± 30% +0.2 0.31 ± 17% perf-profile.children.cycles-pp.__cond_resched
0.00 +0.2 0.17 ± 26% perf-profile.children.cycles-pp.__remove_hrtimer
0.00 +0.2 0.17 ± 17% perf-profile.children.cycles-pp.update_sd_pick_busiest
0.04 ±124% +0.2 0.22 ± 16% perf-profile.children.cycles-pp.migrate_task_rq_fair
0.05 ± 83% +0.2 0.23 ± 13% perf-profile.children.cycles-pp.tick_irq_enter
0.00 +0.2 0.20 ± 16% perf-profile.children.cycles-pp.find_busiest_queue
0.31 ± 23% +0.2 0.51 ± 19% perf-profile.children.cycles-pp.__x86_indirect_thunk_rax
0.06 ± 58% +0.2 0.27 ± 24% perf-profile.children.cycles-pp.wake_affine
0.00 +0.2 0.21 ± 27% perf-profile.children.cycles-pp.rb_erase
0.06 ± 70% +0.2 0.28 ± 31% perf-profile.children.cycles-pp.update_irq_load_avg
0.06 ± 81% +0.2 0.28 ± 19% perf-profile.children.cycles-pp.irq_enter_rcu
0.46 ± 15% +0.2 0.69 ± 19% perf-profile.children.cycles-pp.__update_load_avg_cfs_rq
0.03 ±125% +0.2 0.27 ± 24% perf-profile.children.cycles-pp.select_idle_core
0.15 ± 44% +0.2 0.39 ± 16% perf-profile.children.cycles-pp.native_irq_return_iret
0.06 ± 92% +0.2 0.30 ± 22% perf-profile.children.cycles-pp.set_task_cpu
0.18 ± 38% +0.3 0.43 ± 6% perf-profile.children.cycles-pp.update_rq_clock
0.00 +0.3 0.25 ± 24% perf-profile.children.cycles-pp.delay_tsc
0.05 ± 51% +0.3 0.31 ± 37% perf-profile.children.cycles-pp.timerqueue_add
0.04 ± 85% +0.3 0.31 ± 22% perf-profile.children.cycles-pp.timerqueue_del
0.00 +0.3 0.28 ± 12% perf-profile.children.cycles-pp.task_tick_fair
0.01 ±200% +0.3 0.29 ± 16% perf-profile.children.cycles-pp.irqentry_exit_to_user_mode
0.00 +0.3 0.28 ± 25% perf-profile.children.cycles-pp.hrtick_start
0.37 ± 13% +0.3 0.68 ± 9% perf-profile.children.cycles-pp.select_idle_sibling
0.04 ±141% +0.3 0.35 ± 25% perf-profile.children.cycles-pp.cpu_util
0.08 ± 26% +0.3 0.40 ± 33% perf-profile.children.cycles-pp.enqueue_hrtimer
0.00 +0.3 0.32 ± 17% perf-profile.children.cycles-pp.io_serial_in
0.37 ± 24% +0.3 0.70 ± 9% perf-profile.children.cycles-pp.sched_clock
0.49 ± 16% +0.4 0.84 ± 10% perf-profile.children.cycles-pp.read_tsc
0.00 +0.4 0.35 ± 20% perf-profile.children.cycles-pp.idle_cpu
0.00 +0.4 0.36 ± 17% perf-profile.children.cycles-pp.hrtimer_try_to_cancel
0.43 ± 20% +0.4 0.81 ± 9% perf-profile.children.cycles-pp.sched_clock_cpu
0.25 ± 41% +0.4 0.64 ± 13% perf-profile.children.cycles-pp.update_rq_clock_task
0.63 ± 5% +0.4 1.03 ± 12% perf-profile.children.cycles-pp.exit_to_user_mode_prepare
0.00 +0.4 0.41 ± 8% perf-profile.children.cycles-pp._find_next_and_bit
0.03 ±125% +0.4 0.46 ± 14% perf-profile.children.cycles-pp.select_idle_cpu
0.00 +0.4 0.42 ± 19% perf-profile.children.cycles-pp.task_contending
0.70 ± 14% +0.4 1.14 ± 4% perf-profile.children.cycles-pp.select_task_rq
0.65 ± 19% +0.4 1.09 ± 7% perf-profile.children.cycles-pp.select_task_rq_fair
0.09 ± 33% +0.5 0.54 ± 19% perf-profile.children.cycles-pp.__sysvec_call_function_single
0.00 +0.5 0.46 ± 15% perf-profile.children.cycles-pp.detach_tasks
0.63 ± 19% +0.5 1.09 ± 9% perf-profile.children.cycles-pp.ktime_get
1.50 ± 11% +0.5 2.01 ± 7% perf-profile.children.cycles-pp.update_load_avg
0.12 ± 21% +0.5 0.64 ± 14% perf-profile.children.cycles-pp.__update_blocked_fair
0.12 ± 30% +0.5 0.65 ± 17% perf-profile.children.cycles-pp.sysvec_call_function_single
0.00 +0.6 0.57 ± 13% perf-profile.children.cycles-pp.exit_to_user_mode_loop
0.00 +0.6 0.58 ± 9% perf-profile.children.cycles-pp.wait_for_lsr
0.15 ± 30% +0.6 0.73 ± 12% perf-profile.children.cycles-pp.asm_sysvec_call_function_single
0.00 +0.6 0.59 ± 9% perf-profile.children.cycles-pp.serial8250_console_write
0.00 +0.6 0.59 ± 14% perf-profile.children.cycles-pp.cpudl_set
0.00 +0.6 0.60 ± 10% perf-profile.children.cycles-pp.asm_sysvec_irq_work
0.00 +0.6 0.60 ± 10% perf-profile.children.cycles-pp.sysvec_irq_work
0.00 +0.6 0.60 ± 10% perf-profile.children.cycles-pp.__sysvec_irq_work
0.00 +0.6 0.60 ± 10% perf-profile.children.cycles-pp.irq_work_run
0.00 +0.6 0.60 ± 10% perf-profile.children.cycles-pp.irq_work_single
0.00 +0.6 0.60 ± 10% perf-profile.children.cycles-pp._printk
0.00 +0.6 0.60 ± 10% perf-profile.children.cycles-pp.vprintk_emit
0.00 +0.6 0.60 ± 10% perf-profile.children.cycles-pp.console_unlock
0.00 +0.6 0.60 ± 10% perf-profile.children.cycles-pp.console_flush_all
0.00 +0.6 0.61 ± 9% perf-profile.children.cycles-pp.irq_work_run_list
0.00 +0.6 0.63 ± 9% perf-profile.children.cycles-pp.hrtick
1.91 ± 22% +0.6 2.56 ± 6% perf-profile.children.cycles-pp.__wake_up_common
0.00 +0.7 0.66 ± 7% perf-profile.children.cycles-pp.cpupri_set
0.46 ± 15% +0.7 1.17 ± 9% perf-profile.children.cycles-pp.finish_task_switch
1.65 ± 23% +0.7 2.37 ± 6% perf-profile.children.cycles-pp.autoremove_wake_function
0.86 ± 16% +0.7 1.58 ± 15% perf-profile.children.cycles-pp._raw_spin_lock_irqsave
1.61 ± 24% +0.8 2.39 ± 4% perf-profile.children.cycles-pp.try_to_wake_up
0.00 +0.8 0.83 ± 13% perf-profile.children.cycles-pp.cpudl_clear
0.17 ± 12% +0.9 1.03 ± 43% perf-profile.children.cycles-pp.clockevents_program_event
0.01 ±200% +0.9 0.91 ± 16% perf-profile.children.cycles-pp.raw_spin_rq_lock_nested
2.17 ± 21% +0.9 3.11 ± 5% perf-profile.children.cycles-pp.__wake_up_common_lock
1.24 ± 8% +1.0 2.19 perf-profile.children.cycles-pp.__hrtimer_run_queues
0.00 +1.0 0.96 ± 12% perf-profile.children.cycles-pp.__dequeue_dl_entity
0.52 ± 14% +1.0 1.55 ± 8% perf-profile.children.cycles-pp._raw_spin_lock
0.00 +1.0 1.03 ± 12% perf-profile.children.cycles-pp.enqueue_dl_entity
0.00 +1.1 1.06 ± 17% perf-profile.children.cycles-pp.__hrtimer_start_range_ns
0.01 ±200% +1.1 1.09 ± 12% perf-profile.children.cycles-pp.native_queued_spin_lock_slowpath
0.00 +1.1 1.10 ± 12% perf-profile.children.cycles-pp.pick_task_dl
0.18 ± 13% +1.2 1.36 ± 4% perf-profile.children.cycles-pp.update_blocked_averages
0.00 +1.2 1.19 ± 12% perf-profile.children.cycles-pp.dl_server_stop
3.20 ± 3% +1.3 4.53 ± 4% perf-profile.children.cycles-pp.__flush_smp_call_function_queue
3.32 ± 4% +1.4 4.70 ± 4% perf-profile.children.cycles-pp.flush_smp_call_function_queue
2.77 ± 9% +1.4 4.21 ± 7% perf-profile.children.cycles-pp.schedule_idle
2.74 ± 5% +1.5 4.20 ± 4% perf-profile.children.cycles-pp.sched_ttwu_pending
0.00 +1.6 1.62 ± 23% perf-profile.children.cycles-pp.hrtimer_start_range_ns
2.01 ± 7% +1.6 3.65 ± 3% perf-profile.children.cycles-pp.enqueue_task_fair
2.25 ± 6% +1.6 3.89 ± 5% perf-profile.children.cycles-pp.ttwu_do_activate
1.54 ± 6% +1.7 3.23 ± 6% perf-profile.children.cycles-pp.hrtimer_interrupt
2.07 ± 7% +1.7 3.79 ± 4% perf-profile.children.cycles-pp.activate_task
1.57 ± 7% +1.7 3.29 ± 6% perf-profile.children.cycles-pp.__sysvec_apic_timer_interrupt
2.28 ± 6% +1.8 4.05 ± 6% perf-profile.children.cycles-pp.dequeue_task_fair
2.26 ± 4% +2.4 4.63 ± 5% perf-profile.children.cycles-pp.sysvec_apic_timer_interrupt
0.00 +2.6 2.63 ± 12% perf-profile.children.cycles-pp.pick_next_task_dl
0.08 ± 96% +2.9 3.01 ± 12% perf-profile.children.cycles-pp.update_sg_lb_stats
2.48 ± 3% +3.3 5.79 ± 4% perf-profile.children.cycles-pp.asm_sysvec_apic_timer_interrupt
0.12 ± 73% +3.6 3.75 ± 10% perf-profile.children.cycles-pp.update_sd_lb_stats
0.15 ± 56% +3.9 4.07 ± 10% perf-profile.children.cycles-pp.find_busiest_group
0.22 ± 40% +6.2 6.43 ± 6% perf-profile.children.cycles-pp.load_balance
17.73 ± 4% +6.5 24.27 ± 2% perf-profile.children.cycles-pp.__libc_read
25.57 ± 8% +6.8 32.38 perf-profile.children.cycles-pp.entry_SYSCALL_64_after_hwframe
19.65 +6.8 26.47 perf-profile.children.cycles-pp.start_thread
25.19 ± 8% +6.9 32.09 perf-profile.children.cycles-pp.do_syscall_64
1.54 ± 16% +7.5 9.03 ± 4% perf-profile.children.cycles-pp.pick_next_task_fair
0.28 ± 29% +7.7 7.97 ± 5% perf-profile.children.cycles-pp.newidle_balance
10.89 ± 4% +8.3 19.20 perf-profile.children.cycles-pp.ksys_read
10.03 ± 4% +8.7 18.69 perf-profile.children.cycles-pp.vfs_read
9.02 ± 5% +8.9 17.93 perf-profile.children.cycles-pp.pipe_read
4.76 ± 4% +10.3 15.10 perf-profile.children.cycles-pp.schedule
7.39 ± 5% +11.9 19.34 ± 2% perf-profile.children.cycles-pp.__schedule
33.74 ± 5% -9.6 24.14 perf-profile.self.cycles-pp.intel_idle
5.36 ± 12% -1.6 3.76 ± 4% perf-profile.self.cycles-pp.syscall_exit_to_user_mode
1.90 ± 14% -0.7 1.19 ± 10% perf-profile.self.cycles-pp.__entry_text_start
1.96 ± 15% -0.6 1.40 ± 9% perf-profile.self.cycles-pp.syscall_return_via_sysret
1.12 ± 9% -0.3 0.77 ± 9% perf-profile.self.cycles-pp.__fget_light
0.55 ± 19% -0.3 0.26 ± 13% perf-profile.self.cycles-pp.mutex_unlock
0.54 ± 24% -0.2 0.31 ± 15% perf-profile.self.cycles-pp.__mark_inode_dirty
0.60 ± 11% -0.2 0.38 ± 20% perf-profile.self.cycles-pp.mutex_lock
0.36 ± 26% -0.2 0.19 ± 50% perf-profile.self.cycles-pp.do_idle
0.32 ± 9% -0.1 0.17 ± 22% perf-profile.self.cycles-pp.__mnt_want_write
0.36 ± 9% -0.1 0.23 ± 26% perf-profile.self.cycles-pp.__pthread_enable_asynccancel
0.30 ± 11% -0.1 0.20 ± 25% perf-profile.self.cycles-pp.entry_SYSRETQ_unsafe_stack
0.30 ± 18% -0.1 0.20 ± 31% perf-profile.self.cycles-pp.restore_fpregs_from_fpstate
0.28 ± 5% -0.1 0.19 ± 11% perf-profile.self.cycles-pp.__flush_smp_call_function_queue
0.03 ± 82% +0.1 0.09 ± 9% perf-profile.self.cycles-pp.update_curr_se
0.06 ± 58% +0.1 0.12 ± 23% perf-profile.self.cycles-pp.select_idle_sibling
0.00 +0.1 0.07 ± 11% perf-profile.self.cycles-pp.tick_nohz_stop_idle
0.01 ±200% +0.1 0.09 ± 23% perf-profile.self.cycles-pp.error_entry
0.00 +0.1 0.07 ± 20% perf-profile.self.cycles-pp.__update_load_avg_blocked_se
0.00 +0.1 0.07 ± 36% perf-profile.self.cycles-pp.hrtimer_active
0.04 ± 85% +0.1 0.11 ± 29% perf-profile.self.cycles-pp.irqtime_account_irq
0.01 ±200% +0.1 0.09 ± 35% perf-profile.self.cycles-pp.sysvec_apic_timer_interrupt
0.00 +0.1 0.08 ± 27% perf-profile.self.cycles-pp.ct_nmi_enter
0.00 +0.1 0.08 ± 28% perf-profile.self.cycles-pp.resched_curr
0.00 +0.1 0.09 ± 34% perf-profile.self.cycles-pp.can_migrate_task
0.00 +0.1 0.09 ± 21% perf-profile.self.cycles-pp.cpudl_heapify_up
0.00 +0.1 0.09 ± 22% perf-profile.self.cycles-pp.update_dl_rq_load_avg
0.16 ± 18% +0.1 0.26 ± 26% perf-profile.self.cycles-pp.newidle_balance
0.00 +0.1 0.10 ± 21% perf-profile.self.cycles-pp.tick_program_event
0.03 ±124% +0.1 0.13 ± 36% perf-profile.self.cycles-pp.__enqueue_entity
0.00 +0.1 0.10 ± 28% perf-profile.self.cycles-pp.select_idle_cpu
0.06 ± 94% +0.1 0.16 ± 19% perf-profile.self.cycles-pp.__hrtimer_run_queues
0.00 +0.1 0.11 ± 31% perf-profile.self.cycles-pp.hrtick
0.00 +0.1 0.11 ± 39% perf-profile.self.cycles-pp.pick_next_task_stop
0.00 +0.1 0.11 ± 39% perf-profile.self.cycles-pp.rb_insert_color
0.00 +0.1 0.11 ± 32% perf-profile.self.cycles-pp.update_blocked_averages
0.02 ±200% +0.1 0.13 ± 50% perf-profile.self.cycles-pp.clockevents_program_event
0.05 ± 91% +0.1 0.17 ± 24% perf-profile.self.cycles-pp.__wake_up_common_lock
0.00 +0.1 0.12 ± 29% perf-profile.self.cycles-pp.pick_next_task_dl
0.00 +0.1 0.12 ± 10% perf-profile.self.cycles-pp.detach_tasks
0.01 ±200% +0.1 0.14 ± 21% perf-profile.self.cycles-pp._find_next_bit
0.00 +0.1 0.13 ± 42% perf-profile.self.cycles-pp.update_rt_rq_load_avg
0.04 ± 83% +0.1 0.17 ± 16% perf-profile.self.cycles-pp.__hrtimer_next_event_base
0.02 ±200% +0.1 0.15 ± 13% perf-profile.self.cycles-pp.hrtimer_interrupt
0.00 +0.1 0.14 ± 26% perf-profile.self.cycles-pp.task_h_load
0.00 +0.1 0.14 ± 23% perf-profile.self.cycles-pp.cpudl_heapify
0.00 +0.2 0.15 ± 18% perf-profile.self.cycles-pp.enqueue_dl_entity
0.01 ±200% +0.2 0.16 ± 9% perf-profile.self.cycles-pp.update_rq_clock
0.00 +0.2 0.16 ± 18% perf-profile.self.cycles-pp.find_busiest_queue
0.15 ± 33% +0.2 0.31 ± 9% perf-profile.self.cycles-pp.ktime_get
0.28 ± 27% +0.2 0.45 ± 17% perf-profile.self.cycles-pp.__x86_indirect_thunk_rax
0.00 +0.2 0.17 ± 21% perf-profile.self.cycles-pp.update_sd_pick_busiest
0.00 +0.2 0.19 ± 23% perf-profile.self.cycles-pp.cpudl_set
0.00 +0.2 0.19 ± 31% perf-profile.self.cycles-pp.rb_erase
0.03 ±122% +0.2 0.23 ± 32% perf-profile.self.cycles-pp.timerqueue_add
0.06 ± 70% +0.2 0.27 ± 33% perf-profile.self.cycles-pp.update_irq_load_avg
0.00 +0.2 0.22 ± 26% perf-profile.self.cycles-pp.__hrtimer_start_range_ns
0.07 ± 15% +0.2 0.30 ± 22% perf-profile.self.cycles-pp.__update_blocked_fair
0.15 ± 44% +0.2 0.39 ± 16% perf-profile.self.cycles-pp.native_irq_return_iret
0.19 ± 29% +0.3 0.44 ± 29% perf-profile.self.cycles-pp.update_rq_clock_task
0.00 +0.3 0.25 ± 24% perf-profile.self.cycles-pp.delay_tsc
0.00 +0.3 0.27 ± 30% perf-profile.self.cycles-pp.find_busiest_group
0.04 ±141% +0.3 0.34 ± 27% perf-profile.self.cycles-pp.cpu_util
0.00 +0.3 0.32 ± 17% perf-profile.self.cycles-pp.io_serial_in
0.00 +0.3 0.34 ± 22% perf-profile.self.cycles-pp.idle_cpu
0.44 ± 17% +0.3 0.79 ± 11% perf-profile.self.cycles-pp.read_tsc
0.00 +0.4 0.37 ± 8% perf-profile.self.cycles-pp._find_next_and_bit
0.42 ± 29% +0.4 0.80 ± 19% perf-profile.self.cycles-pp.update_load_avg
0.00 +0.4 0.41 ± 18% perf-profile.self.cycles-pp.cpudl_clear
0.00 +0.4 0.44 ± 23% perf-profile.self.cycles-pp.load_balance
0.85 ± 17% +0.5 1.35 ± 15% perf-profile.self.cycles-pp._raw_spin_lock_irqsave
0.02 ±125% +0.6 0.58 ± 14% perf-profile.self.cycles-pp.update_sd_lb_stats
0.00 +0.7 0.66 ± 7% perf-profile.self.cycles-pp.cpupri_set
0.01 ±200% +1.1 1.09 ± 12% perf-profile.self.cycles-pp.native_queued_spin_lock_slowpath
0.05 ±127% +2.0 2.09 ± 13% perf-profile.self.cycles-pp.update_sg_lb_stats
Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.
--
0-DAY CI Kernel Test Service
https://github.com/intel/lkp-tests/wiki
reply other threads:[~2023-11-13 14:52 UTC|newest]
Thread overview: [no followups] expand[flat|nested] mbox.gz Atom feed
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=202311132202.1eabb13e-oliver.sang@intel.com \
--to=oliver.sang@intel.com \
--cc=lkp@intel.com \
--cc=oe-lkp@lists.linux.dev \
--cc=peterz@infradead.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.