All of lore.kernel.org
 help / color / mirror / Atom feed
From: kernel test robot <ying.huang@intel.com>
To: lkp@lists.01.org
Subject: [net] 192132b9a0: -17.5% netperf.Throughput_tps
Date: Sun, 20 Sep 2015 20:30:07 +0800	[thread overview]
Message-ID: <87eghtb7e8.fsf@yhuang-dev.intel.com> (raw)

[-- Attachment #1: Type: text/plain, Size: 75954 bytes --]

FYI, we noticed the below changes on

https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git master
commit 192132b9a034d87566294be0fba5f8f75c2cf16b ("net: Add support for VRFs to inetpeer cache")


=========================================================================================
tbox_group/testcase/rootfs/kconfig/compiler/cpufreq_governor/runtime/nr_threads/cluster/test:
  lkp-sbx04/netperf/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/performance/300s/200%/cs-localhost/TCP_CRR

commit: 
  5345c2e12d41f815c1009c9dee72f3d5fcfd4282
  192132b9a034d87566294be0fba5f8f75c2cf16b

5345c2e12d41f815 192132b9a034d87566294be0fb 
---------------- -------------------------- 
         %stddev     %change         %stddev
             \          |                \  
      2841 ±  2%     -17.5%       2344 ±  1%  netperf.Throughput_tps
 1.095e+08 ±  2%     -17.3%   90493497 ±  1%  netperf.time.involuntary_context_switches
 1.093e+08 ±  2%     -17.5%   90186076 ±  1%  netperf.time.minor_page_faults
      4612 ±  0%      +9.8%       5062 ±  1%  netperf.time.percent_of_cpu_this_job_got
     13149 ±  0%     +11.7%      14686 ±  1%  netperf.time.system_time
    943.49 ±  3%     -17.1%     781.88 ±  1%  netperf.time.user_time
 1.091e+08 ±  2%     -17.5%   90055371 ±  1%  netperf.time.voluntary_context_switches
 4.367e+08 ±  2%     -17.5%  3.604e+08 ±  1%  softirqs.NET_RX
    320.02 ±  0%      -2.2%     312.95 ±  0%  turbostat.CorWatt
    375.96 ±  0%      -1.9%     368.88 ±  0%  turbostat.PkgWatt
   1428128 ±  2%     -17.3%    1180769 ±  1%  vmstat.system.cs
     68804 ±  0%      +1.2%      69635 ±  0%  vmstat.system.in
     23930 ±148%     -97.8%     522.50 ± 21%  numa-meminfo.node0.Shmem
      1358 ±141%    +301.8%       5457 ± 19%  numa-meminfo.node2.AnonHugePages
    118910 ±  3%     +40.5%     167013 ± 25%  numa-meminfo.node2.FilePages
      2519 ±143%    +279.0%       9548 ±  9%  numa-meminfo.node2.Inactive(anon)
      2604 ±140%   +1850.5%      50791 ± 82%  numa-meminfo.node2.Shmem
 1.095e+08 ±  2%     -17.3%   90493497 ±  1%  time.involuntary_context_switches
 1.093e+08 ±  2%     -17.5%   90186076 ±  1%  time.minor_page_faults
      4612 ±  0%      +9.8%       5062 ±  1%  time.percent_of_cpu_this_job_got
     13149 ±  0%     +11.7%      14686 ±  1%  time.system_time
    943.49 ±  3%     -17.1%     781.88 ±  1%  time.user_time
 1.091e+08 ±  2%     -17.5%   90055371 ±  1%  time.voluntary_context_switches
      0.00 ± -1%      +Inf%   12974495 ±167%  latency_stats.avg.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
 1.092e+08 ±  2%     -17.5%   90102386 ±  1%  latency_stats.hits.inet_csk_accept.inet_accept.SYSC_accept4.SyS_accept.entry_SYSCALL_64_fastpath
 2.183e+08 ±  2%     -17.5%  1.801e+08 ±  1%  latency_stats.hits.sk_wait_data.tcp_recvmsg.inet_recvmsg.sock_recvmsg.SYSC_recvfrom.SyS_recvfrom.entry_SYSCALL_64_fastpath
      0.00 ± -1%      +Inf%   13170498 ±164%  latency_stats.max.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
     13924 ± 43%    +112.0%      29515 ± 95%  latency_stats.sum.call_rwsem_down_write_failed.unlink_file_vma.free_pgtables.unmap_region.do_munmap.mmap_region.do_mmap_pgoff.vm_mmap_pgoff.SyS_mmap_pgoff.SyS_mmap.entry_SYSCALL_64_fastpath
 1.794e+10 ±  2%     +16.6%  2.092e+10 ±  2%  latency_stats.sum.inet_csk_accept.inet_accept.SYSC_accept4.SyS_accept.entry_SYSCALL_64_fastpath
      0.00 ± -1%      +Inf%   13298537 ±162%  latency_stats.sum.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
 1.281e+10 ±  0%      -5.8%  1.207e+10 ±  0%  latency_stats.sum.sk_wait_data.tcp_recvmsg.inet_recvmsg.sock_recvmsg.SYSC_recvfrom.SyS_recvfrom.entry_SYSCALL_64_fastpath
 1.126e+08 ±  2%     -17.4%   93008884 ±  1%  proc-vmstat.numa_hit
 1.126e+08 ±  2%     -17.4%   93008682 ±  1%  proc-vmstat.numa_local
      3937 ±  4%     -11.5%       3483 ±  7%  proc-vmstat.numa_pages_migrated
   6363343 ±  2%     -18.4%    5191906 ±  2%  proc-vmstat.pgalloc_dma32
 1.077e+08 ±  2%     -17.2%   89162443 ±  1%  proc-vmstat.pgalloc_normal
 1.101e+08 ±  2%     -17.3%   91044527 ±  1%  proc-vmstat.pgfault
  1.14e+08 ±  2%     -17.3%   94305253 ±  1%  proc-vmstat.pgfree
      3937 ±  4%     -11.5%       3483 ±  7%  proc-vmstat.pgmigrate_success
  28042466 ±  2%     -17.5%   23130696 ±  2%  numa-numastat.node0.local_node
  28042466 ±  2%     -17.5%   23130763 ±  2%  numa-numastat.node0.numa_hit
      0.00 ± 40%      +Inf%      67.50 ±  8%  numa-numastat.node0.other_node
  28130811 ±  3%     -15.6%   23732122 ±  1%  numa-numastat.node1.local_node
  28130861 ±  3%     -15.6%   23732168 ±  1%  numa-numastat.node1.numa_hit
  28109208 ±  2%     -18.4%   22948672 ±  2%  numa-numastat.node2.local_node
  28109647 ±  2%     -18.4%   22948710 ±  2%  numa-numastat.node2.numa_hit
  28283999 ±  2%     -18.0%   23200094 ±  1%  numa-numastat.node3.local_node
  28284539 ±  2%     -18.0%   23200610 ±  1%  numa-numastat.node3.numa_hit
     89720 ±  2%     -10.5%      80327 ±  1%  slabinfo.Acpi-State.active_objs
      1766 ±  2%     -10.4%       1581 ±  1%  slabinfo.Acpi-State.active_slabs
     90097 ±  2%     -10.4%      80684 ±  1%  slabinfo.Acpi-State.num_objs
      1766 ±  2%     -10.4%       1581 ±  1%  slabinfo.Acpi-State.num_slabs
      1165 ±  4%     +23.6%       1440 ±  9%  slabinfo.blkdev_requests.active_objs
      1165 ±  4%     +23.6%       1440 ±  9%  slabinfo.blkdev_requests.num_objs
     45272 ±  5%     -27.6%      32776 ±  3%  slabinfo.kmalloc-256.active_objs
    792.50 ±  5%     -29.8%     556.50 ±  4%  slabinfo.kmalloc-256.active_slabs
     50753 ±  5%     -29.7%      35654 ±  4%  slabinfo.kmalloc-256.num_objs
    792.50 ±  5%     -29.8%     556.50 ±  4%  slabinfo.kmalloc-256.num_slabs
     78268 ±  3%     -11.2%      69534 ±  1%  slabinfo.kmalloc-64.active_objs
      1289 ±  2%     -13.1%       1120 ±  1%  slabinfo.kmalloc-64.active_slabs
     82539 ±  2%     -13.1%      71749 ±  1%  slabinfo.kmalloc-64.num_objs
      1289 ±  2%     -13.1%       1120 ±  1%  slabinfo.kmalloc-64.num_slabs
    152.50 ± 37%     -72.0%      42.67 ± 85%  numa-vmstat.node0.nr_dirtied
      5982 ±148%     -97.8%     130.00 ± 21%  numa-vmstat.node0.nr_shmem
    148.75 ± 37%     -71.5%      42.33 ± 86%  numa-vmstat.node0.nr_written
  14143937 ±  2%     -17.2%   11706912 ±  2%  numa-vmstat.node0.numa_hit
  14109627 ±  2%     -17.3%   11671407 ±  2%  numa-vmstat.node0.numa_local
     32.00 ±119%    +244.5%     110.25 ± 75%  numa-vmstat.node1.nr_dirtied
     30.67 ±121%    +252.2%     108.00 ± 75%  numa-vmstat.node1.nr_written
  14248863 ±  3%     -15.3%   12069600 ±  1%  numa-vmstat.node1.numa_hit
  14238070 ±  3%     -15.3%   12059120 ±  1%  numa-vmstat.node1.numa_local
     29727 ±  3%     +40.5%      41752 ± 25%  numa-vmstat.node2.nr_file_pages
    629.25 ±144%    +279.3%       2386 ±  9%  numa-vmstat.node2.nr_inactive_anon
    650.50 ±140%   +1851.9%      12697 ± 82%  numa-vmstat.node2.nr_shmem
  14166575 ±  2%     -18.0%   11610237 ±  2%  numa-vmstat.node2.numa_hit
  14124116 ±  2%     -18.1%   11569737 ±  2%  numa-vmstat.node2.numa_local
  14255093 ±  2%     -17.7%   11737181 ±  1%  numa-vmstat.node3.numa_hit
  14214429 ±  2%     -17.7%   11695545 ±  1%  numa-vmstat.node3.numa_local
      4.22 ±  7%     -27.1%       3.07 ±  6%  perf-profile.cpu-cycles.SYSC_accept4.sys_accept.entry_SYSCALL_64_fastpath
      2.12 ±  3%     -24.3%       1.60 ±  4%  perf-profile.cpu-cycles.SYSC_bind.sys_bind.entry_SYSCALL_64_fastpath
     25.95 ±  1%     +21.2%      31.45 ±  3%  perf-profile.cpu-cycles.SYSC_connect.sys_connect.entry_SYSCALL_64_fastpath
     10.69 ±  2%     -20.7%       8.48 ±  2%  perf-profile.cpu-cycles.SYSC_recvfrom.sys_recvfrom.entry_SYSCALL_64_fastpath
     23.42 ±  6%     -37.4%      14.65 ±  9%  perf-profile.cpu-cycles.SYSC_sendto.sys_sendto.entry_SYSCALL_64_fastpath
     15.88 ±  4%     +67.7%      26.64 ±  5%  perf-profile.cpu-cycles.____fput.task_work_run.do_notify_resume.int_signal
     21.77 ± 12%     -47.6%      11.40 ± 15%  perf-profile.cpu-cycles.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.enqueue_task.activate_task
      3.14 ± 14%     -23.2%       2.41 ±  4%  perf-profile.cpu-cycles.__dentry_kill.dput.__fput.____fput.task_work_run
      2.52 ±  6%     -59.8%       1.01 ± 36%  perf-profile.cpu-cycles.__destroy_inode.destroy_inode.evict.iput.__dentry_kill
      3.01 ±  2%     -31.9%       2.05 ±  3%  perf-profile.cpu-cycles.__dev_queue_xmit.dev_queue_xmit_sk.ip_finish_output2.ip_finish_output.ip_output
     12.36 ±  6%     +12.4%      13.89 ±  1%  perf-profile.cpu-cycles.__do_softirq.do_softirq_own_stack.do_softirq.__local_bh_enable_ip._raw_spin_unlock_bh
     29.10 ±  4%     -13.3%      25.23 ±  2%  perf-profile.cpu-cycles.__do_softirq.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2
      2.16 ± 16%     -43.8%       1.21 ±  3%  perf-profile.cpu-cycles.__do_softirq.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.tcp_prequeue_process
     15.70 ±  4%     +68.6%      26.47 ±  4%  perf-profile.cpu-cycles.__fput.____fput.task_work_run.do_notify_resume.int_signal
      0.67 ± 17%     +69.9%       1.14 ±  5%  perf-profile.cpu-cycles.__hrtimer_run_queues.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt.apic_timer_interrupt
     25.34 ±  1%     +22.3%      30.99 ±  3%  perf-profile.cpu-cycles.__inet_stream_connect.inet_stream_connect.SYSC_connect.sys_connect.entry_SYSCALL_64_fastpath
      3.18 ±  2%     -20.8%       2.52 ±  3%  perf-profile.cpu-cycles.__kernel_text_address.print_context_stack.dump_trace.save_stack_trace_tsk.__account_scheduler_latency
     12.44 ±  6%     +12.0%      13.94 ±  1%  perf-profile.cpu-cycles.__local_bh_enable_ip._raw_spin_unlock_bh.release_sock.__inet_stream_connect.inet_stream_connect
     29.46 ±  4%     -13.3%      25.54 ±  2%  perf-profile.cpu-cycles.__local_bh_enable_ip.ip_finish_output2.ip_finish_output.ip_output.ip_local_out_sk
      2.40 ± 15%     -47.1%       1.27 ±  4%  perf-profile.cpu-cycles.__local_bh_enable_ip.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg.sock_recvmsg
      1.49 ±  3%     -15.6%       1.26 ±  1%  perf-profile.cpu-cycles.__schedule.schedule.schedule_timeout.sk_wait_data.tcp_recvmsg
      1.49 ±  4%     -12.4%       1.31 ±  1%  perf-profile.cpu-cycles.__sock_create.sys_socket.entry_SYSCALL_64_fastpath
     21.55 ±  7%     -38.8%      13.18 ± 10%  perf-profile.cpu-cycles.__tcp_push_pending_frames.tcp_push.tcp_sendmsg.inet_sendmsg.sock_sendmsg
      7.71 ±  3%     +56.6%      12.09 ±  4%  perf-profile.cpu-cycles.__tcp_push_pending_frames.tcp_send_fin.tcp_close.inet_release.sock_release
      2.66 ±  2%     -21.8%       2.08 ±  6%  perf-profile.cpu-cycles.__vfs_read.vfs_read.sys_read.entry_SYSCALL_64_fastpath
      8.51 ± 10%     -44.9%       4.70 ± 13%  perf-profile.cpu-cycles.__wake_up_common.__wake_up_sync_key.sock_def_readable.tcp_child_process.tcp_v4_do_rcv
     16.79 ± 10%     -43.8%       9.44 ± 12%  perf-profile.cpu-cycles.__wake_up_common.__wake_up_sync_key.tcp_prequeue.tcp_v4_rcv.ip_local_deliver_finish
      8.60 ± 11%     -44.8%       4.75 ± 12%  perf-profile.cpu-cycles.__wake_up_sync_key.sock_def_readable.tcp_child_process.tcp_v4_do_rcv.tcp_v4_rcv
     16.96 ± 10%     -43.6%       9.56 ± 12%  perf-profile.cpu-cycles.__wake_up_sync_key.tcp_prequeue.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver
      0.82 ± 24%     -42.1%       0.47 ±  6%  perf-profile.cpu-cycles._raw_spin_lock.inode_doinit_with_dentry.selinux_d_instantiate.security_d_instantiate.d_instantiate
      1.74 ± 20%     -52.2%       0.83 ±  6%  perf-profile.cpu-cycles._raw_spin_lock.selinux_inode_free_security.security_inode_free.__destroy_inode.destroy_inode
      0.00 ± -1%      +Inf%       6.25 ± 17%  perf-profile.cpu-cycles._raw_spin_lock_bh.tcp_get_metrics.tcp_init_metrics.tcp_finish_connect.tcp_rcv_state_process
      0.00 ± -1%      +Inf%       5.69 ± 12%  perf-profile.cpu-cycles._raw_spin_lock_bh.tcp_get_metrics.tcp_init_metrics.tcp_rcv_state_process.tcp_child_process
      0.00 ± -1%      +Inf%       8.21 ± 12%  perf-profile.cpu-cycles._raw_spin_lock_bh.tcp_get_metrics.tcp_update_metrics.tcp_rcv_state_process.tcp_v4_do_rcv
      0.00 ± -1%      +Inf%       5.65 ± 13%  perf-profile.cpu-cycles._raw_spin_lock_bh.tcp_get_metrics.tcp_update_metrics.tcp_time_wait.tcp_fin
     14.89 ± 19%     -60.2%       5.92 ± 26%  perf-profile.cpu-cycles._raw_spin_lock_irqsave.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.enqueue_task
     12.46 ±  6%     +11.8%      13.92 ±  1%  perf-profile.cpu-cycles._raw_spin_unlock_bh.release_sock.__inet_stream_connect.inet_stream_connect.SYSC_connect
     23.55 ± 11%     -45.6%      12.82 ± 13%  perf-profile.cpu-cycles.activate_task.ttwu_do_activate.try_to_wake_up.default_wake_function.autoremove_wake_function
      8.49 ± 11%     -45.0%       4.67 ± 13%  perf-profile.cpu-cycles.autoremove_wake_function.__wake_up_common.__wake_up_sync_key.sock_def_readable.tcp_child_process
     16.75 ± 10%     -43.9%       9.40 ± 12%  perf-profile.cpu-cycles.autoremove_wake_function.__wake_up_common.__wake_up_sync_key.tcp_prequeue.tcp_v4_rcv
      1.82 ±  1%     -23.9%       1.39 ±  1%  perf-profile.cpu-cycles.copy_page_to_iter.generic_file_read_iter.__vfs_read.vfs_read.sys_read
      1.29 ±  7%     -42.3%       0.75 ± 26%  perf-profile.cpu-cycles.d_instantiate.sock_alloc_file.SYSC_accept4.sys_accept.entry_SYSCALL_64_fastpath
      8.47 ± 11%     -44.9%       4.67 ± 12%  perf-profile.cpu-cycles.default_wake_function.autoremove_wake_function.__wake_up_common.__wake_up_sync_key.sock_def_readable
     16.71 ± 10%     -44.0%       9.36 ± 12%  perf-profile.cpu-cycles.default_wake_function.autoremove_wake_function.__wake_up_common.__wake_up_sync_key.tcp_prequeue
      1.12 ±  5%     -28.6%       0.80 ± 11%  perf-profile.cpu-cycles.dequeue_task.deactivate_task.__schedule.schedule.schedule_timeout
      2.62 ±  5%     -45.4%       1.43 ± 25%  perf-profile.cpu-cycles.destroy_inode.evict.iput.__dentry_kill.dput
      1.44 ±  3%     -16.1%       1.21 ±  2%  perf-profile.cpu-cycles.dev_hard_start_xmit.__dev_queue_xmit.dev_queue_xmit_sk.ip_finish_output2.ip_finish_output
      3.15 ±  3%     -30.5%       2.18 ±  4%  perf-profile.cpu-cycles.dev_queue_xmit_sk.ip_finish_output2.ip_finish_output.ip_output.ip_local_out_sk
      2.07 ±  7%     -32.2%       1.40 ±  3%  perf-profile.cpu-cycles.do_filp_open.do_sys_open.sys_open.entry_SYSCALL_64_fastpath
      1.65 ±  3%     -17.7%       1.36 ±  2%  perf-profile.cpu-cycles.do_mmap_pgoff.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.entry_SYSCALL_64_fastpath
      2.42 ±  2%     -25.6%       1.80 ±  5%  perf-profile.cpu-cycles.do_munmap.vm_munmap.sys_munmap.entry_SYSCALL_64_fastpath
     16.19 ±  4%     +65.9%      26.85 ±  4%  perf-profile.cpu-cycles.do_notify_resume.int_signal
     12.40 ±  6%     +12.3%      13.92 ±  1%  perf-profile.cpu-cycles.do_softirq.part.13.__local_bh_enable_ip._raw_spin_unlock_bh.release_sock.__inet_stream_connect
     29.32 ±  4%     -13.3%      25.43 ±  2%  perf-profile.cpu-cycles.do_softirq.part.13.__local_bh_enable_ip.ip_finish_output2.ip_finish_output.ip_output
      2.36 ± 15%     -47.0%       1.25 ±  3%  perf-profile.cpu-cycles.do_softirq.part.13.__local_bh_enable_ip.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg
     12.38 ±  6%     +12.4%      13.91 ±  1%  perf-profile.cpu-cycles.do_softirq_own_stack.do_softirq.__local_bh_enable_ip._raw_spin_unlock_bh.release_sock
     29.23 ±  4%     -13.3%      25.34 ±  2%  perf-profile.cpu-cycles.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.ip_finish_output2.ip_finish_output
      2.27 ± 16%     -45.7%       1.23 ±  3%  perf-profile.cpu-cycles.do_softirq_own_stack.do_softirq.__local_bh_enable_ip.tcp_prequeue_process.tcp_recvmsg
      2.44 ±  2%     -30.5%       1.70 ±  6%  perf-profile.cpu-cycles.do_sys_open.sys_open.entry_SYSCALL_64_fastpath
      3.60 ± 15%     -31.8%       2.46 ±  1%  perf-profile.cpu-cycles.dput.__fput.____fput.task_work_run.do_notify_resume
      5.97 ±  3%     -24.1%       4.53 ±  4%  perf-profile.cpu-cycles.dump_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair
     22.90 ± 12%     -46.4%      12.28 ± 14%  perf-profile.cpu-cycles.enqueue_entity.enqueue_task_fair.enqueue_task.activate_task.ttwu_do_activate
     23.53 ± 11%     -45.6%      12.80 ± 13%  perf-profile.cpu-cycles.enqueue_task.activate_task.ttwu_do_activate.try_to_wake_up.default_wake_function
     23.30 ± 11%     -46.0%      12.59 ± 13%  perf-profile.cpu-cycles.enqueue_task_fair.enqueue_task.activate_task.ttwu_do_activate.try_to_wake_up
     81.30 ±  1%     -12.6%      71.09 ±  1%  perf-profile.cpu-cycles.entry_SYSCALL_64_fastpath
      2.79 ±  9%     -26.7%       2.05 ± 13%  perf-profile.cpu-cycles.evict.iput.__dentry_kill.dput.__fput
      2.63 ±  1%     -24.7%       1.98 ±  5%  perf-profile.cpu-cycles.generic_file_read_iter.__vfs_read.vfs_read.sys_read.entry_SYSCALL_64_fastpath
      1.25 ±  1%     -11.6%       1.10 ±  6%  perf-profile.cpu-cycles.handle_mm_fault.__do_page_fault.do_page_fault.page_fault.copy_page_to_iter
      1.61 ±  4%     -17.0%       1.34 ±  2%  perf-profile.cpu-cycles.inet_accept.SYSC_accept4.sys_accept.entry_SYSCALL_64_fastpath
      1.08 ±  4%     -27.3%       0.79 ±  5%  perf-profile.cpu-cycles.inet_bind.SYSC_bind.sys_bind.entry_SYSCALL_64_fastpath
      1.42 ±  4%      -9.7%       1.28 ±  1%  perf-profile.cpu-cycles.inet_csk_accept.inet_accept.SYSC_accept4.sys_accept.entry_SYSCALL_64_fastpath
     10.13 ±  2%     -20.2%       8.09 ±  3%  perf-profile.cpu-cycles.inet_recvmsg.sock_recvmsg.SYSC_recvfrom.sys_recvfrom.entry_SYSCALL_64_fastpath
     10.96 ±  2%    +112.9%      23.33 ±  6%  perf-profile.cpu-cycles.inet_release.sock_release.sock_close.__fput.____fput
     23.08 ±  6%     -37.9%      14.34 ±  9%  perf-profile.cpu-cycles.inet_sendmsg.sock_sendmsg.SYSC_sendto.sys_sendto.entry_SYSCALL_64_fastpath
     25.43 ±  1%     +22.3%      31.09 ±  3%  perf-profile.cpu-cycles.inet_stream_connect.SYSC_connect.sys_connect.entry_SYSCALL_64_fastpath
      1.18 ± 13%     -70.0%       0.35 ± 45%  perf-profile.cpu-cycles.inode_doinit_with_dentry.selinux_d_instantiate.security_d_instantiate.d_instantiate.sock_alloc_file
     16.22 ±  4%     +65.8%      26.88 ±  4%  perf-profile.cpu-cycles.int_signal
     32.31 ±  4%     -13.9%      27.82 ±  2%  perf-profile.cpu-cycles.ip_finish_output.ip_output.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb
     32.07 ±  3%     -13.9%      27.61 ±  2%  perf-profile.cpu-cycles.ip_finish_output2.ip_finish_output.ip_output.ip_local_out_sk.ip_queue_xmit
      5.52 ±  2%     -19.1%       4.46 ±  2%  perf-profile.cpu-cycles.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb.tcp_connect.tcp_v4_connect
     26.33 ±  5%     -12.7%      22.97 ±  2%  perf-profile.cpu-cycles.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames
      5.46 ±  2%     -19.2%       4.41 ±  2%  perf-profile.cpu-cycles.ip_output.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb.tcp_connect
      1.52 ± 11%     -28.4%       1.09 ±  4%  perf-profile.cpu-cycles.ip_output.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb.tcp_send_ack
     26.05 ±  5%     -12.6%      22.77 ±  2%  perf-profile.cpu-cycles.ip_output.ip_local_out_sk.ip_queue_xmit.tcp_transmit_skb.tcp_write_xmit
      6.14 ±  2%     -19.2%       4.96 ±  2%  perf-profile.cpu-cycles.ip_queue_xmit.tcp_transmit_skb.tcp_connect.tcp_v4_connect.__inet_stream_connect
      1.29 ± 10%     -17.7%       1.06 ±  2%  perf-profile.cpu-cycles.ip_queue_xmit.tcp_transmit_skb.tcp_send_ack.__tcp_ack_snd_check.tcp_rcv_established
     20.46 ±  7%     -40.0%      12.29 ± 10%  perf-profile.cpu-cycles.ip_queue_xmit.tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_push
      6.16 ±  3%     +76.8%      10.88 ±  5%  perf-profile.cpu-cycles.ip_queue_xmit.tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_send_fin
      2.96 ± 13%     -23.7%       2.25 ±  7%  perf-profile.cpu-cycles.iput.__dentry_kill.dput.__fput.____fput
      1.23 ±  5%     -25.3%       0.92 ±  9%  perf-profile.cpu-cycles.is_module_text_address.__kernel_text_address.print_context_stack.dump_trace.save_stack_trace_tsk
      1.18 ±  3%     -23.6%       0.90 ±  4%  perf-profile.cpu-cycles.loopback_xmit.dev_hard_start_xmit.__dev_queue_xmit.dev_queue_xmit_sk.ip_finish_output2
      1.40 ± 23%     -79.7%       0.28 ± 17%  perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock.selinux_inode_free_security.security_inode_free.__destroy_inode
      0.00 ± -1%      +Inf%       6.06 ± 17%  perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock_bh.tcp_get_metrics.tcp_init_metrics.tcp_finish_connect
      0.00 ± -1%      +Inf%       5.52 ± 12%  perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock_bh.tcp_get_metrics.tcp_init_metrics.tcp_rcv_state_process
      0.00 ± -1%      +Inf%       7.96 ± 12%  perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock_bh.tcp_get_metrics.tcp_update_metrics.tcp_rcv_state_process
      0.00 ± -1%      +Inf%       5.49 ± 14%  perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock_bh.tcp_get_metrics.tcp_update_metrics.tcp_time_wait
     14.34 ± 20%     -61.6%       5.50 ± 28%  perf-profile.cpu-cycles.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.__account_scheduler_latency.enqueue_entity.enqueue_task_fair
      1.91 ±  7%     -29.3%       1.35 ±  3%  perf-profile.cpu-cycles.path_openat.do_filp_open.do_sys_open.sys_open.entry_SYSCALL_64_fastpath
      5.42 ±  4%     -24.0%       4.12 ±  2%  perf-profile.cpu-cycles.print_context_stack.dump_trace.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity
     15.36 ±  4%     +49.3%      22.93 ±  5%  perf-profile.cpu-cycles.release_sock.__inet_stream_connect.inet_stream_connect.SYSC_connect.sys_connect
      1.47 ±  4%    +572.7%       9.86 ±  9%  perf-profile.cpu-cycles.release_sock.tcp_close.inet_release.sock_release.sock_close
      5.99 ±  3%     -23.9%       4.56 ±  4%  perf-profile.cpu-cycles.save_stack_trace_tsk.__account_scheduler_latency.enqueue_entity.enqueue_task_fair.enqueue_task
      0.94 ±  3%     -21.5%       0.74 ±  3%  perf-profile.cpu-cycles.schedule.schedule_timeout.inet_csk_accept.inet_accept.SYSC_accept4
      1.55 ±  4%     -17.0%       1.28 ±  1%  perf-profile.cpu-cycles.schedule.schedule_timeout.sk_wait_data.tcp_recvmsg.inet_recvmsg
      0.96 ±  3%     -22.1%       0.75 ±  3%  perf-profile.cpu-cycles.schedule_timeout.inet_csk_accept.inet_accept.SYSC_accept4.sys_accept
      1.58 ±  3%     -18.3%       1.29 ±  1%  perf-profile.cpu-cycles.schedule_timeout.sk_wait_data.tcp_recvmsg.inet_recvmsg.sock_recvmsg
      1.25 ±  7%     -57.6%       0.53 ± 40%  perf-profile.cpu-cycles.security_d_instantiate.d_instantiate.sock_alloc_file.SYSC_accept4.sys_accept
      2.41 ±  9%     -73.2%       0.65 ± 47%  perf-profile.cpu-cycles.security_inode_free.__destroy_inode.destroy_inode.evict.iput
      1.01 ±  8%     -36.1%       0.64 ±  6%  perf-profile.cpu-cycles.security_sock_rcv_skb.sk_filter.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver
      1.21 ±  2%     -20.3%       0.96 ±  1%  perf-profile.cpu-cycles.security_socket_bind.SYSC_bind.sys_bind.entry_SYSCALL_64_fastpath
      1.24 ±  8%     -58.7%       0.51 ± 42%  perf-profile.cpu-cycles.selinux_d_instantiate.security_d_instantiate.d_instantiate.sock_alloc_file.SYSC_accept4
      2.38 ±  9%     -74.9%       0.60 ± 47%  perf-profile.cpu-cycles.selinux_inode_free_security.security_inode_free.__destroy_inode.destroy_inode.evict
      1.19 ±  3%     -23.6%       0.91 ±  2%  perf-profile.cpu-cycles.selinux_socket_bind.security_socket_bind.SYSC_bind.sys_bind.entry_SYSCALL_64_fastpath
      1.14 ±  4%     -19.7%       0.92 ±  3%  perf-profile.cpu-cycles.sk_filter.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv_finish
      2.45 ±  2%     -12.9%       2.14 ±  5%  perf-profile.cpu-cycles.sk_wait_data.tcp_recvmsg.inet_recvmsg.sock_recvmsg.SYSC_recvfrom
      1.48 ± 11%     -18.1%       1.21 ±  3%  perf-profile.cpu-cycles.sock_alloc_file.SYSC_accept4.sys_accept.entry_SYSCALL_64_fastpath
     11.04 ±  2%    +112.7%      23.48 ±  6%  perf-profile.cpu-cycles.sock_close.__fput.____fput.task_work_run.do_notify_resume
      8.65 ± 10%     -44.5%       4.80 ± 12%  perf-profile.cpu-cycles.sock_def_readable.tcp_child_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish
     10.42 ±  2%     -20.3%       8.30 ±  3%  perf-profile.cpu-cycles.sock_recvmsg.SYSC_recvfrom.sys_recvfrom.entry_SYSCALL_64_fastpath
     11.02 ±  2%    +113.0%      23.48 ±  6%  perf-profile.cpu-cycles.sock_release.sock_close.__fput.____fput.task_work_run
     23.26 ±  6%     -37.7%      14.49 ±  9%  perf-profile.cpu-cycles.sock_sendmsg.SYSC_sendto.sys_sendto.entry_SYSCALL_64_fastpath
      4.31 ±  7%     -26.6%       3.17 ±  6%  perf-profile.cpu-cycles.sys_accept.entry_SYSCALL_64_fastpath
      2.16 ±  3%     -25.0%       1.62 ±  4%  perf-profile.cpu-cycles.sys_bind.entry_SYSCALL_64_fastpath
     26.02 ±  1%     +21.0%      31.48 ±  3%  perf-profile.cpu-cycles.sys_connect.entry_SYSCALL_64_fastpath
      2.09 ±  4%     -27.8%       1.51 ±  3%  perf-profile.cpu-cycles.sys_mmap.entry_SYSCALL_64_fastpath
      2.07 ±  4%     -27.4%       1.50 ±  3%  perf-profile.cpu-cycles.sys_mmap_pgoff.sys_mmap.entry_SYSCALL_64_fastpath
      2.53 ±  2%     -21.6%       1.98 ±  5%  perf-profile.cpu-cycles.sys_munmap.entry_SYSCALL_64_fastpath
      2.49 ±  3%     -28.9%       1.77 ±  7%  perf-profile.cpu-cycles.sys_open.entry_SYSCALL_64_fastpath
      2.96 ±  3%     -20.2%       2.37 ±  2%  perf-profile.cpu-cycles.sys_read.entry_SYSCALL_64_fastpath
     10.74 ±  2%     -20.7%       8.52 ±  2%  perf-profile.cpu-cycles.sys_recvfrom.entry_SYSCALL_64_fastpath
     23.48 ±  6%     -37.4%      14.69 ±  9%  perf-profile.cpu-cycles.sys_sendto.entry_SYSCALL_64_fastpath
      2.43 ±  2%     -23.8%       1.85 ±  6%  perf-profile.cpu-cycles.sys_socket.entry_SYSCALL_64_fastpath
     16.06 ±  4%     +66.8%      26.79 ±  5%  perf-profile.cpu-cycles.task_work_run.do_notify_resume.int_signal
      1.94 ±  5%     -24.0%       1.48 ±  2%  perf-profile.cpu-cycles.tcp_check_req.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver
      9.42 ±  9%     +21.5%      11.45 ±  1%  perf-profile.cpu-cycles.tcp_child_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver
     10.82 ±  2%    +114.2%      23.18 ±  6%  perf-profile.cpu-cycles.tcp_close.inet_release.sock_release.sock_close.__fput
      2.44 ±  2%     -24.6%       1.84 ±  4%  perf-profile.cpu-cycles.tcp_conn_request.tcp_v4_conn_request.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv
      7.43 ±  2%     -19.2%       6.00 ±  2%  perf-profile.cpu-cycles.tcp_connect.tcp_v4_connect.__inet_stream_connect.inet_stream_connect.SYSC_connect
      1.16 ±  6%     -35.6%       0.74 ±  8%  perf-profile.cpu-cycles.tcp_create_openreq_child.tcp_v4_syn_recv_sock.tcp_check_req.tcp_v4_do_rcv.tcp_v4_rcv
      2.52 ±  4%    +215.6%       7.96 ±  9%  perf-profile.cpu-cycles.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish
      1.14 ±  7%     -26.3%       0.84 ±  3%  perf-profile.cpu-cycles.tcp_done.tcp_time_wait.tcp_fin.tcp_data_queue.tcp_rcv_state_process
      2.41 ±  3%    +224.9%       7.82 ±  9%  perf-profile.cpu-cycles.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv
      1.10 ±  2%    +565.6%       7.30 ± 15%  perf-profile.cpu-cycles.tcp_finish_connect.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock.__inet_stream_connect
      0.11 ± 19%   +5669.6%       6.63 ± 17%  perf-profile.cpu-cycles.tcp_get_metrics.tcp_init_metrics.tcp_finish_connect.tcp_rcv_state_process.tcp_v4_do_rcv
      0.10 ± 15%   +5890.0%       5.99 ± 11%  perf-profile.cpu-cycles.tcp_get_metrics.tcp_init_metrics.tcp_rcv_state_process.tcp_child_process.tcp_v4_do_rcv
      0.10 ± 15%   +8738.5%       8.62 ± 11%  perf-profile.cpu-cycles.tcp_get_metrics.tcp_update_metrics.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock
      0.11 ± 18%   +5345.5%       5.99 ± 12%  perf-profile.cpu-cycles.tcp_get_metrics.tcp_update_metrics.tcp_time_wait.tcp_fin.tcp_data_queue
      0.03 ± 35%  +25137.5%       6.73 ± 16%  perf-profile.cpu-cycles.tcp_init_metrics.tcp_finish_connect.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock
      0.02 ± 53%  +25935.7%       6.08 ± 11%  perf-profile.cpu-cycles.tcp_init_metrics.tcp_rcv_state_process.tcp_child_process.tcp_v4_do_rcv.tcp_v4_rcv
     17.50 ±  9%     -43.1%       9.95 ± 12%  perf-profile.cpu-cycles.tcp_prequeue.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv_finish
      7.24 ±  3%     -19.9%       5.80 ±  3%  perf-profile.cpu-cycles.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg.sock_recvmsg.SYSC_recvfrom
     21.65 ±  7%     -39.0%      13.21 ± 10%  perf-profile.cpu-cycles.tcp_push.tcp_sendmsg.inet_sendmsg.sock_sendmsg.SYSC_sendto
      3.75 ±  3%     -30.0%       2.62 ±  2%  perf-profile.cpu-cycles.tcp_rcv_established.tcp_v4_do_rcv.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg
      0.49 ±  8%   +1221.9%       6.48 ± 10%  perf-profile.cpu-cycles.tcp_rcv_state_process.tcp_child_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish
      2.71 ±  2%    +226.3%       8.84 ± 12%  perf-profile.cpu-cycles.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock.__inet_stream_connect.inet_stream_connect
      1.37 ±  4%    +610.4%       9.75 ±  9%  perf-profile.cpu-cycles.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock.tcp_close.inet_release
      6.49 ±  3%     +71.7%      11.15 ±  5%  perf-profile.cpu-cycles.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver
     10.02 ±  3%     -20.1%       8.01 ±  3%  perf-profile.cpu-cycles.tcp_recvmsg.inet_recvmsg.sock_recvmsg.SYSC_recvfrom.sys_recvfrom
      2.40 ±  1%     -14.1%       2.06 ±  3%  perf-profile.cpu-cycles.tcp_send_ack.__tcp_ack_snd_check.tcp_rcv_established.tcp_v4_do_rcv.tcp_prequeue_process
      8.41 ±  2%     +47.8%      12.42 ±  4%  perf-profile.cpu-cycles.tcp_send_fin.tcp_close.inet_release.sock_release.sock_close
     22.87 ±  6%     -38.2%      14.14 ±  9%  perf-profile.cpu-cycles.tcp_sendmsg.inet_sendmsg.sock_sendmsg.SYSC_sendto.sys_sendto
      1.43 ±  3%    +400.0%       7.14 ± 10%  perf-profile.cpu-cycles.tcp_time_wait.tcp_fin.tcp_data_queue.tcp_rcv_state_process.tcp_v4_do_rcv
      6.51 ±  2%     -19.0%       5.27 ±  2%  perf-profile.cpu-cycles.tcp_transmit_skb.tcp_connect.tcp_v4_connect.__inet_stream_connect.inet_stream_connect
      1.71 ±  4%     -19.6%       1.37 ±  2%  perf-profile.cpu-cycles.tcp_transmit_skb.tcp_send_ack.__tcp_ack_snd_check.tcp_rcv_established.tcp_v4_do_rcv
     20.86 ±  7%     -39.4%      12.65 ± 10%  perf-profile.cpu-cycles.tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_push.tcp_sendmsg
      6.46 ±  2%     +72.5%      11.13 ±  5%  perf-profile.cpu-cycles.tcp_transmit_skb.tcp_write_xmit.__tcp_push_pending_frames.tcp_send_fin.tcp_close
      0.06 ± 48%  +14437.5%       8.72 ± 11%  perf-profile.cpu-cycles.tcp_update_metrics.tcp_rcv_state_process.tcp_v4_do_rcv.release_sock.tcp_close
      0.07 ± 57%   +8066.7%       6.12 ± 12%  perf-profile.cpu-cycles.tcp_update_metrics.tcp_time_wait.tcp_fin.tcp_data_queue.tcp_rcv_state_process
      2.53 ±  1%     -22.5%       1.96 ±  3%  perf-profile.cpu-cycles.tcp_v4_conn_request.tcp_rcv_state_process.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish
      8.76 ±  2%     -19.5%       7.05 ±  2%  perf-profile.cpu-cycles.tcp_v4_connect.__inet_stream_connect.inet_stream_connect.SYSC_connect.sys_connect
      2.81 ±  2%    +216.7%       8.91 ± 12%  perf-profile.cpu-cycles.tcp_v4_do_rcv.release_sock.__inet_stream_connect.inet_stream_connect.SYSC_connect
      1.40 ±  4%    +602.0%       9.79 ±  9%  perf-profile.cpu-cycles.tcp_v4_do_rcv.release_sock.tcp_close.inet_release.sock_release
      3.92 ±  2%     -64.3%       1.40 ± 18%  perf-profile.cpu-cycles.tcp_v4_do_rcv.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg.sock_recvmsg
     19.08 ±  3%     +31.2%      25.04 ±  2%  perf-profile.cpu-cycles.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv_finish
      1.24 ±  1%     -13.7%       1.07 ±  5%  perf-profile.cpu-cycles.tcp_v4_send_synack.tcp_conn_request.tcp_v4_conn_request.tcp_rcv_state_process.tcp_v4_do_rcv
      1.48 ±  2%     -11.1%       1.32 ±  1%  perf-profile.cpu-cycles.tcp_v4_syn_recv_sock.tcp_check_req.tcp_v4_do_rcv.tcp_v4_rcv.ip_local_deliver_finish
     21.47 ±  7%     -39.0%      13.11 ±  9%  perf-profile.cpu-cycles.tcp_write_xmit.__tcp_push_pending_frames.tcp_push.tcp_sendmsg.inet_sendmsg
      7.65 ±  2%     +57.3%      12.04 ±  5%  perf-profile.cpu-cycles.tcp_write_xmit.__tcp_push_pending_frames.tcp_send_fin.tcp_close.inet_release
      0.43 ± 20%    +135.6%       1.03 ±  7%  perf-profile.cpu-cycles.tick_sched_handle.isra.17.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.local_apic_timer_interrupt
      0.51 ± 18%    +107.4%       1.06 ±  7%  perf-profile.cpu-cycles.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt.local_apic_timer_interrupt.smp_apic_timer_interrupt
     25.09 ± 10%     -44.3%      13.97 ± 12%  perf-profile.cpu-cycles.try_to_wake_up.default_wake_function.autoremove_wake_function.__wake_up_common.__wake_up_sync_key
     23.97 ± 11%     -45.4%      13.10 ± 13%  perf-profile.cpu-cycles.ttwu_do_activate.constprop.83.try_to_wake_up.default_wake_function.autoremove_wake_function.__wake_up_common
      0.39 ± 24%    +153.9%       0.98 ±  8%  perf-profile.cpu-cycles.update_process_times.tick_sched_handle.tick_sched_timer.__hrtimer_run_queues.hrtimer_interrupt
      2.88 ±  3%     -19.8%       2.31 ±  4%  perf-profile.cpu-cycles.vfs_read.sys_read.entry_SYSCALL_64_fastpath
      2.01 ±  4%     -26.9%       1.47 ±  2%  perf-profile.cpu-cycles.vm_mmap_pgoff.sys_mmap_pgoff.sys_mmap.entry_SYSCALL_64_fastpath
      2.50 ±  2%     -24.4%       1.89 ±  5%  perf-profile.cpu-cycles.vm_munmap.sys_munmap.entry_SYSCALL_64_fastpath
    175.75 ± 26%     -67.3%      57.50 ± 62%  sched_debug.cfs_rq[0]:/.blocked_load_avg
    195.75 ± 24%     -61.9%      74.50 ± 45%  sched_debug.cfs_rq[0]:/.tg_load_contrib
   1267483 ± 58%    +241.8%    4331730 ± 32%  sched_debug.cfs_rq[10]:/.MIN_vruntime
    106.50 ± 67%    +167.1%     284.50 ± 43%  sched_debug.cfs_rq[10]:/.blocked_load_avg
     20.25 ± 21%     +95.1%      39.50 ±  9%  sched_debug.cfs_rq[10]:/.load
   1267483 ± 58%    +241.8%    4331730 ± 32%  sched_debug.cfs_rq[10]:/.max_vruntime
   7064228 ±  4%     +24.8%    8816370 ±  6%  sched_debug.cfs_rq[10]:/.min_vruntime
    124.00 ± 57%    +150.2%     310.25 ± 39%  sched_debug.cfs_rq[10]:/.tg_load_contrib
   7354915 ± 10%     +30.2%    9574721 ± 15%  sched_debug.cfs_rq[11]:/.min_vruntime
    562.00 ± 14%     +29.7%     729.00 ±  9%  sched_debug.cfs_rq[11]:/.utilization_load_avg
    328.50 ± 84%     -74.7%      83.00 ±120%  sched_debug.cfs_rq[17]:/.blocked_load_avg
    348.75 ± 79%     -70.8%     102.00 ± 94%  sched_debug.cfs_rq[17]:/.tg_load_contrib
    550.25 ±  7%     +17.9%     648.50 ±  9%  sched_debug.cfs_rq[20]:/.utilization_load_avg
   3859894 ± 33%     -84.1%     613604 ±133%  sched_debug.cfs_rq[21]:/.MIN_vruntime
   3859894 ± 33%     -84.1%     613604 ±133%  sched_debug.cfs_rq[21]:/.max_vruntime
   3393438 ± 42%    -100.0%       0.00 ±  0%  sched_debug.cfs_rq[23]:/.MIN_vruntime
   3393438 ± 42%    -100.0%       0.00 ±  0%  sched_debug.cfs_rq[23]:/.max_vruntime
   6969709 ±  6%      +9.1%    7603127 ±  4%  sched_debug.cfs_rq[23]:/.min_vruntime
     20.25 ± 18%     -38.3%      12.50 ±  4%  sched_debug.cfs_rq[23]:/.runnable_load_avg
     21.50 ± 19%    +445.3%     117.25 ± 68%  sched_debug.cfs_rq[27]:/.load
     16.50 ± 10%     +31.8%      21.75 ±  5%  sched_debug.cfs_rq[27]:/.runnable_load_avg
    784.00 ± 91%     -87.7%      96.75 ± 92%  sched_debug.cfs_rq[28]:/.blocked_load_avg
    800.25 ± 89%     -85.6%     115.25 ± 75%  sched_debug.cfs_rq[28]:/.tg_load_contrib
   6864371 ± 11%     +28.0%    8788136 ± 10%  sched_debug.cfs_rq[2]:/.min_vruntime
   -160064 ±-318%    -624.8%     839954 ± 61%  sched_debug.cfs_rq[2]:/.spread0
     91.50 ± 28%     -62.0%      34.75 ± 78%  sched_debug.cfs_rq[30]:/.nr_spread_over
    488.75 ± 18%     +29.1%     631.00 ± 10%  sched_debug.cfs_rq[30]:/.utilization_load_avg
     84.00 ± 36%     -54.2%      38.50 ± 60%  sched_debug.cfs_rq[31]:/.nr_spread_over
   6916568 ± 11%     +13.9%    7879054 ±  6%  sched_debug.cfs_rq[32]:/.min_vruntime
    116.50 ±125%     -82.6%      20.25 ± 42%  sched_debug.cfs_rq[34]:/.load
   6871979 ± 12%     +28.6%    8834078 ± 11%  sched_debug.cfs_rq[34]:/.min_vruntime
     23.25 ± 11%     -37.6%      14.50 ± 24%  sched_debug.cfs_rq[34]:/.runnable_load_avg
   -153189 ±-326%    -677.7%     885021 ± 64%  sched_debug.cfs_rq[34]:/.spread0
      7.75 ± 27%    +377.4%      37.00 ± 57%  sched_debug.cfs_rq[35]:/.blocked_load_avg
   6977299 ± 10%     +21.0%    8439329 ± 15%  sched_debug.cfs_rq[35]:/.min_vruntime
   6848733 ± 11%     +22.6%    8396951 ± 10%  sched_debug.cfs_rq[37]:/.min_vruntime
   -176509 ±-214%    -353.7%     447796 ±108%  sched_debug.cfs_rq[37]:/.spread0
   6783146 ±  8%     +25.7%    8525859 ± 14%  sched_debug.cfs_rq[38]:/.min_vruntime
    511.50 ±  9%     +37.9%     705.25 ±  3%  sched_debug.cfs_rq[38]:/.utilization_load_avg
   6750617 ±  4%     +24.5%    8403331 ± 11%  sched_debug.cfs_rq[39]:/.min_vruntime
   6957525 ±  8%     +20.8%    8406635 ± 15%  sched_debug.cfs_rq[3]:/.min_vruntime
   7280418 ±  2%     +22.5%    8920591 ± 14%  sched_debug.cfs_rq[40]:/.min_vruntime
   7111998 ±  5%     +25.1%    8894040 ±  7%  sched_debug.cfs_rq[42]:/.min_vruntime
   7354642 ± 10%     +30.2%    9579368 ± 15%  sched_debug.cfs_rq[43]:/.min_vruntime
     48.50 ±103%    +123.7%     108.50 ± 60%  sched_debug.cfs_rq[43]:/.nr_spread_over
   7446762 ±  7%     +21.6%    9051878 ± 17%  sched_debug.cfs_rq[44]:/.min_vruntime
    435.50 ± 22%     +43.4%     624.50 ± 12%  sched_debug.cfs_rq[46]:/.utilization_load_avg
    489.00 ±  7%     +34.3%     656.50 ±  8%  sched_debug.cfs_rq[48]:/.utilization_load_avg
     21.75 ± 51%     +55.2%      33.75 ± 14%  sched_debug.cfs_rq[49]:/.nr_spread_over
    282.00 ± 81%     -83.5%      46.50 ±117%  sched_debug.cfs_rq[4]:/.blocked_load_avg
    302.25 ± 75%     -79.2%      62.75 ± 88%  sched_debug.cfs_rq[4]:/.tg_load_contrib
    568.50 ± 19%     +24.7%     709.00 ±  1%  sched_debug.cfs_rq[4]:/.utilization_load_avg
     47.75 ± 69%    +703.1%     383.50 ± 78%  sched_debug.cfs_rq[50]:/.blocked_load_avg
     62.75 ± 52%    +541.4%     402.50 ± 75%  sched_debug.cfs_rq[50]:/.tg_load_contrib
    516.00 ± 13%     +34.1%     691.75 ± 12%  sched_debug.cfs_rq[50]:/.utilization_load_avg
   6918551 ±  5%      +9.8%    7594242 ±  5%  sched_debug.cfs_rq[55]:/.min_vruntime
     70.00 ± 45%     -49.6%      35.25 ± 67%  sched_debug.cfs_rq[58]:/.nr_spread_over
    518.25 ± 22%     +33.3%     691.00 ±  6%  sched_debug.cfs_rq[58]:/.utilization_load_avg
    482.00 ± 15%     +30.7%     630.00 ±  5%  sched_debug.cfs_rq[59]:/.utilization_load_avg
   6893442 ± 10%     +22.3%    8433961 ±  9%  sched_debug.cfs_rq[5]:/.min_vruntime
    561.50 ±  5%     +18.1%     663.00 ±  9%  sched_debug.cfs_rq[5]:/.utilization_load_avg
   2118027 ± 62%     -82.9%     361211 ±109%  sched_debug.cfs_rq[61]:/.MIN_vruntime
   2118027 ± 62%     -82.9%     361211 ±109%  sched_debug.cfs_rq[61]:/.max_vruntime
   3804794 ± 35%     -60.4%    1508156 ± 71%  sched_debug.cfs_rq[62]:/.MIN_vruntime
   3804794 ± 35%     -60.4%    1508156 ± 71%  sched_debug.cfs_rq[62]:/.max_vruntime
   3234850 ± 51%     -64.2%    1157307 ±145%  sched_debug.cfs_rq[6]:/.MIN_vruntime
   3234850 ± 51%     -64.2%    1157307 ±145%  sched_debug.cfs_rq[6]:/.max_vruntime
   6791201 ±  8%     +26.7%    8601638 ± 15%  sched_debug.cfs_rq[6]:/.min_vruntime
   6657096 ±  4%     +26.2%    8398917 ± 11%  sched_debug.cfs_rq[7]:/.min_vruntime
    558.75 ± 11%     +29.8%     725.00 ± 11%  sched_debug.cfs_rq[7]:/.utilization_load_avg
   7286102 ±  1%     +23.1%    8965833 ± 15%  sched_debug.cfs_rq[8]:/.min_vruntime
   3383122 ±  2%     -17.9%    2775877 ±  1%  sched_debug.cpu#0.nr_switches
   3392389 ±  2%     -17.9%    2785232 ±  1%  sched_debug.cpu#0.sched_count
   3380345 ±  2%     -19.0%    2737980 ±  1%  sched_debug.cpu#0.ttwu_count
   3364390 ±  2%     -18.8%    2733371 ±  1%  sched_debug.cpu#0.ttwu_local
     34.25 ± 59%     -56.9%      14.75 ± 12%  sched_debug.cpu#1.cpu_load[0]
     28.50 ± 42%     -48.2%      14.75 ± 10%  sched_debug.cpu#1.cpu_load[1]
     26.75 ± 36%     -43.9%      15.00 ± 12%  sched_debug.cpu#1.cpu_load[2]
     25.25 ± 34%     -40.6%      15.00 ±  9%  sched_debug.cpu#1.cpu_load[3]
     22.50 ± 34%     -44.4%      12.50 ±  8%  sched_debug.cpu#1.cpu_load[4]
   3369428 ±  2%     -16.2%    2824862 ±  1%  sched_debug.cpu#1.nr_switches
   3371094 ±  2%     -16.1%    2827260 ±  1%  sched_debug.cpu#1.sched_count
   3389319 ±  2%     -17.1%    2810445 ±  1%  sched_debug.cpu#1.ttwu_count
   3353366 ±  2%     -16.3%    2807598 ±  1%  sched_debug.cpu#1.ttwu_local
   3335017 ±  2%     -15.4%    2820801 ±  1%  sched_debug.cpu#10.nr_switches
   3335956 ±  2%     -15.4%    2821090 ±  1%  sched_debug.cpu#10.sched_count
   3336430 ±  2%     -15.9%    2806740 ±  1%  sched_debug.cpu#10.ttwu_count
   3318441 ±  2%     -15.5%    2804699 ±  1%  sched_debug.cpu#10.ttwu_local
   3370289 ±  3%     -16.3%    2821155 ±  2%  sched_debug.cpu#11.nr_switches
   3371290 ±  3%     -16.3%    2821629 ±  2%  sched_debug.cpu#11.sched_count
   3361232 ±  3%     -15.8%    2829002 ±  2%  sched_debug.cpu#11.ttwu_count
   3358106 ±  3%     -16.4%    2807327 ±  2%  sched_debug.cpu#11.ttwu_local
     16.50 ± 13%     -25.8%      12.25 ± 15%  sched_debug.cpu#12.cpu_load[4]
   3398141 ±  3%     -17.9%    2791418 ±  2%  sched_debug.cpu#12.nr_switches
   3400097 ±  3%     -17.9%    2793004 ±  2%  sched_debug.cpu#12.sched_count
      1646 ± 32%     +66.4%       2739 ± 24%  sched_debug.cpu#12.sched_goidle
   3395185 ±  3%     -17.7%    2792849 ±  3%  sched_debug.cpu#12.ttwu_count
   3392814 ±  3%     -18.5%    2766292 ±  2%  sched_debug.cpu#12.ttwu_local
   3384418 ±  4%     -16.9%    2813855 ±  1%  sched_debug.cpu#13.nr_switches
   3385991 ±  4%     -16.8%    2817516 ±  1%  sched_debug.cpu#13.sched_count
   3385348 ±  3%     -17.2%    2804182 ±  2%  sched_debug.cpu#13.ttwu_count
   3369621 ±  4%     -16.9%    2800765 ±  2%  sched_debug.cpu#13.ttwu_local
   3377257 ±  3%     -16.1%    2833788 ±  2%  sched_debug.cpu#14.nr_switches
   3379864 ±  3%     -16.1%    2836414 ±  2%  sched_debug.cpu#14.sched_count
   3360760 ±  3%     -15.9%    2826049 ±  2%  sched_debug.cpu#14.ttwu_count
   3357666 ±  3%     -15.9%    2823748 ±  2%  sched_debug.cpu#14.ttwu_local
   3380508 ±  3%     -16.2%    2833752 ±  1%  sched_debug.cpu#15.nr_switches
   3381560 ±  3%     -16.2%    2834059 ±  1%  sched_debug.cpu#15.sched_count
   3381759 ±  3%     -16.1%    2838452 ±  2%  sched_debug.cpu#15.ttwu_count
   3368631 ±  3%     -16.4%    2814682 ±  1%  sched_debug.cpu#15.ttwu_local
   3389967 ±  2%     -17.6%    2791917 ±  1%  sched_debug.cpu#16.nr_switches
   3392333 ±  2%     -17.6%    2794492 ±  1%  sched_debug.cpu#16.sched_count
   3395971 ±  2%     -18.1%    2780908 ±  1%  sched_debug.cpu#16.ttwu_count
   3380594 ±  2%     -18.0%    2770502 ±  1%  sched_debug.cpu#16.ttwu_local
   3379066 ±  2%     -17.0%    2804619 ±  2%  sched_debug.cpu#17.nr_switches
   3379518 ±  2%     -17.0%    2806250 ±  2%  sched_debug.cpu#17.sched_count
   3369568 ±  3%     -17.2%    2790359 ±  2%  sched_debug.cpu#17.ttwu_count
   3366929 ±  3%     -17.2%    2788295 ±  2%  sched_debug.cpu#17.ttwu_local
   3364431 ±  2%     -17.1%    2787730 ±  1%  sched_debug.cpu#18.nr_switches
   3364899 ±  2%     -17.1%    2788705 ±  1%  sched_debug.cpu#18.sched_count
   3358511 ±  2%     -17.3%    2776889 ±  1%  sched_debug.cpu#18.ttwu_count
   3348289 ±  2%     -17.6%    2759313 ±  1%  sched_debug.cpu#18.ttwu_local
     16.75 ± 10%     -17.9%      13.75 ± 12%  sched_debug.cpu#19.cpu_load[4]
   3389035 ±  2%     -17.5%    2794874 ±  1%  sched_debug.cpu#19.nr_switches
   3390379 ±  2%     -17.4%    2800760 ±  1%  sched_debug.cpu#19.sched_count
   3382434 ±  2%     -17.7%    2785348 ±  1%  sched_debug.cpu#19.ttwu_count
   3379051 ±  2%     -17.7%    2781538 ±  1%  sched_debug.cpu#19.ttwu_local
     23.00 ± 21%     -38.0%      14.25 ±  7%  sched_debug.cpu#2.cpu_load[3]
   3360803 ±  2%     -16.7%    2800049 ±  1%  sched_debug.cpu#2.nr_switches
   3361823 ±  2%     -16.5%    2805748 ±  1%  sched_debug.cpu#2.sched_count
   3343040 ±  2%     -16.6%    2789182 ±  1%  sched_debug.cpu#2.ttwu_count
   3338401 ±  2%     -16.5%    2787168 ±  1%  sched_debug.cpu#2.ttwu_local
   3341149 ±  2%     -16.8%    2779014 ±  2%  sched_debug.cpu#20.nr_switches
   3341677 ±  2%     -16.8%    2780361 ±  2%  sched_debug.cpu#20.sched_count
   3317813 ±  1%     -16.5%    2771814 ±  2%  sched_debug.cpu#20.ttwu_count
   3313754 ±  1%     -16.9%    2752947 ±  3%  sched_debug.cpu#20.ttwu_local
   3393487 ±  2%     -17.6%    2795372 ±  1%  sched_debug.cpu#21.nr_switches
   3400093 ±  2%     -17.7%    2796868 ±  1%  sched_debug.cpu#21.sched_count
   3378310 ±  2%     -17.5%    2787801 ±  2%  sched_debug.cpu#21.ttwu_count
   3376315 ±  2%     -17.7%    2780178 ±  2%  sched_debug.cpu#21.ttwu_local
     16.75 ±  2%     -14.9%      14.25 ±  7%  sched_debug.cpu#22.cpu_load[4]
   3387714 ±  2%     -17.2%    2803908 ±  2%  sched_debug.cpu#22.nr_switches
   3388108 ±  2%     -17.2%    2805212 ±  2%  sched_debug.cpu#22.sched_count
   3384725 ±  2%     -17.5%    2792197 ±  2%  sched_debug.cpu#22.ttwu_count
   3382935 ±  2%     -17.6%    2788179 ±  2%  sched_debug.cpu#22.ttwu_local
     21.25 ± 13%     -24.7%      16.00 ± 13%  sched_debug.cpu#23.cpu_load[3]
     18.00 ± 13%     -23.6%      13.75 ±  9%  sched_debug.cpu#23.cpu_load[4]
   3401316 ±  2%     -17.5%    2805389 ±  2%  sched_debug.cpu#23.nr_switches
   3405993 ±  2%     -17.6%    2807165 ±  2%  sched_debug.cpu#23.sched_count
   3390254 ±  2%     -17.0%    2814478 ±  1%  sched_debug.cpu#23.ttwu_count
   3386402 ±  2%     -17.5%    2794862 ±  2%  sched_debug.cpu#23.ttwu_local
   3426699 ±  2%     -18.1%    2807177 ±  2%  sched_debug.cpu#24.nr_switches
   3427534 ±  2%     -18.1%    2807540 ±  2%  sched_debug.cpu#24.sched_count
   3419707 ±  2%     -17.2%    2830470 ±  2%  sched_debug.cpu#24.ttwu_count
   3417657 ±  2%     -18.3%    2793422 ±  2%  sched_debug.cpu#24.ttwu_local
     17.75 ±  7%     -15.5%      15.00 ±  4%  sched_debug.cpu#25.cpu_load[3]
     15.50 ±  9%     -16.1%      13.00 ±  5%  sched_debug.cpu#25.cpu_load[4]
   3390931 ±  3%     -16.7%    2825710 ±  2%  sched_debug.cpu#25.nr_switches
   3394428 ±  3%     -16.7%    2826362 ±  2%  sched_debug.cpu#25.sched_count
   3386135 ±  3%     -17.1%    2806667 ±  2%  sched_debug.cpu#25.ttwu_count
   3374191 ±  3%     -17.0%    2800759 ±  2%  sched_debug.cpu#25.ttwu_local
   3382304 ±  3%     -16.8%    2815129 ±  1%  sched_debug.cpu#26.nr_switches
   3382617 ±  3%     -16.8%    2815612 ±  1%  sched_debug.cpu#26.sched_count
   3391284 ±  2%     -17.4%    2800669 ±  2%  sched_debug.cpu#26.ttwu_count
   3368626 ±  3%     -17.0%    2797457 ±  1%  sched_debug.cpu#26.ttwu_local
     21.75 ± 13%    +448.3%     119.25 ±114%  sched_debug.cpu#27.load
   3377532 ±  2%     -17.0%    2802024 ±  1%  sched_debug.cpu#27.nr_switches
   3377791 ±  2%     -17.0%    2803686 ±  1%  sched_debug.cpu#27.sched_count
    913.75 ± 15%     +96.1%       1792 ± 34%  sched_debug.cpu#27.sched_goidle
   3378183 ±  3%     -17.9%    2772945 ±  1%  sched_debug.cpu#27.ttwu_count
   3361335 ±  3%     -17.6%    2769863 ±  1%  sched_debug.cpu#27.ttwu_local
    126632 ± 46%     +52.9%     193604 ±  4%  sched_debug.cpu#28.avg_idle
   3391259 ±  3%     -17.1%    2813047 ±  1%  sched_debug.cpu#28.nr_switches
   3391775 ±  3%     -17.0%    2815887 ±  1%  sched_debug.cpu#28.sched_count
   3379019 ±  3%     -16.9%    2808674 ±  1%  sched_debug.cpu#28.ttwu_count
   3377041 ±  3%     -16.9%    2806132 ±  1%  sched_debug.cpu#28.ttwu_local
   3374213 ±  3%     -16.6%    2812863 ±  1%  sched_debug.cpu#29.nr_switches
   3374449 ±  3%     -16.6%    2815602 ±  1%  sched_debug.cpu#29.sched_count
      1120 ± 28%     +92.2%       2153 ± 33%  sched_debug.cpu#29.sched_goidle
   3368967 ±  3%     -17.4%    2783822 ±  0%  sched_debug.cpu#29.ttwu_count
   3360964 ±  3%     -17.4%    2777215 ±  0%  sched_debug.cpu#29.ttwu_local
   3380214 ±  2%     -17.8%    2777895 ±  1%  sched_debug.cpu#3.nr_switches
   3380943 ±  2%     -17.8%    2779026 ±  1%  sched_debug.cpu#3.sched_count
   3371958 ±  2%     -17.7%    2773613 ±  1%  sched_debug.cpu#3.ttwu_count
   3368641 ±  2%     -17.8%    2770455 ±  1%  sched_debug.cpu#3.ttwu_local
   3399413 ±  2%     -17.2%    2813130 ±  1%  sched_debug.cpu#30.nr_switches
   3399925 ±  2%     -17.3%    2813415 ±  1%  sched_debug.cpu#30.sched_count
   3388030 ±  2%     -17.2%    2805998 ±  1%  sched_debug.cpu#30.ttwu_count
   3384874 ±  2%     -17.2%    2803761 ±  1%  sched_debug.cpu#30.ttwu_local
   3424347 ±  2%     -17.9%    2809733 ±  1%  sched_debug.cpu#31.nr_switches
   3424975 ±  2%     -18.0%    2809973 ±  1%  sched_debug.cpu#31.sched_count
   3413707 ±  2%     -17.9%    2802556 ±  1%  sched_debug.cpu#31.ttwu_count
   3411722 ±  2%     -17.9%    2800372 ±  1%  sched_debug.cpu#31.ttwu_local
    161244 ± 31%    +141.0%     388617 ± 75%  sched_debug.cpu#32.avg_idle
   3340294 ±  4%     -16.8%    2779491 ±  1%  sched_debug.cpu#32.nr_switches
   3340509 ±  4%     -16.8%    2779888 ±  1%  sched_debug.cpu#32.sched_count
   3336888 ±  3%     -16.4%    2788296 ±  2%  sched_debug.cpu#32.ttwu_count
   3327022 ±  4%     -17.1%    2756567 ±  1%  sched_debug.cpu#32.ttwu_local
   3369761 ±  2%     -18.2%    2756152 ±  2%  sched_debug.cpu#33.nr_switches
   3370085 ±  2%     -18.2%    2757175 ±  2%  sched_debug.cpu#33.sched_count
   3353138 ±  2%     -17.9%    2754433 ±  1%  sched_debug.cpu#33.ttwu_count
   3350768 ±  2%     -18.5%    2731749 ±  2%  sched_debug.cpu#33.ttwu_local
   3353463 ±  2%     -17.1%    2778380 ±  1%  sched_debug.cpu#34.nr_switches
   3353783 ±  2%     -17.1%    2778950 ±  1%  sched_debug.cpu#34.sched_count
   3338913 ±  2%     -17.1%    2769303 ±  1%  sched_debug.cpu#34.ttwu_count
   3336154 ±  2%     -17.0%    2767598 ±  1%  sched_debug.cpu#34.ttwu_local
     19.75 ±  6%     -13.9%      17.00 ±  7%  sched_debug.cpu#35.cpu_load[1]
     19.75 ±  4%     -17.7%      16.25 ±  6%  sched_debug.cpu#35.cpu_load[2]
     19.75 ±  4%     -17.7%      16.25 ±  5%  sched_debug.cpu#35.cpu_load[3]
     17.25 ± 11%     -20.3%      13.75 ± 10%  sched_debug.cpu#35.cpu_load[4]
   3357618 ±  2%     -17.1%    2784568 ±  1%  sched_debug.cpu#35.nr_switches
   3357860 ±  2%     -17.0%    2785577 ±  1%  sched_debug.cpu#35.sched_count
   3350978 ±  2%     -17.1%    2779124 ±  1%  sched_debug.cpu#35.ttwu_count
   3348950 ±  2%     -17.1%    2775164 ±  1%  sched_debug.cpu#35.ttwu_local
     33.50 ±  8%     -29.9%      23.50 ± 24%  sched_debug.cpu#36.load
      2.00 ±  0%     -50.0%       1.00 ±  0%  sched_debug.cpu#36.nr_running
   3378181 ±  2%     -17.8%    2776642 ±  2%  sched_debug.cpu#36.nr_switches
   3378466 ±  2%     -17.8%    2777079 ±  2%  sched_debug.cpu#36.sched_count
   3374695 ±  2%     -17.8%    2774072 ±  2%  sched_debug.cpu#36.ttwu_count
   3370536 ±  2%     -18.0%    2763776 ±  2%  sched_debug.cpu#36.ttwu_local
     17.50 ± 13%     -22.9%      13.50 ± 12%  sched_debug.cpu#37.cpu_load[1]
   3340460 ±  3%     -16.8%    2779658 ±  2%  sched_debug.cpu#37.nr_switches
   3340683 ±  3%     -16.8%    2779914 ±  2%  sched_debug.cpu#37.sched_count
   3341001 ±  2%     -17.4%    2760062 ±  3%  sched_debug.cpu#37.ttwu_count
   3324668 ±  3%     -17.1%    2756964 ±  2%  sched_debug.cpu#37.ttwu_local
     18.75 ±  7%     -21.3%      14.75 ± 12%  sched_debug.cpu#38.cpu_load[3]
     17.50 ± 12%     -27.1%      12.75 ±  3%  sched_debug.cpu#38.cpu_load[4]
   3401218 ±  2%     -18.2%    2782005 ±  1%  sched_debug.cpu#38.nr_switches
   3401410 ±  2%     -18.2%    2782445 ±  1%  sched_debug.cpu#38.sched_count
   3400794 ±  2%     -18.1%    2784512 ±  2%  sched_debug.cpu#38.ttwu_count
   3399813 ±  2%     -18.6%    2768586 ±  1%  sched_debug.cpu#38.ttwu_local
     17.50 ± 11%     -22.9%      13.50 ± 15%  sched_debug.cpu#39.cpu_load[4]
   3392132 ±  2%     -17.0%    2815024 ±  2%  sched_debug.cpu#39.nr_switches
   3392712 ±  2%     -17.0%    2815476 ±  2%  sched_debug.cpu#39.sched_count
   3389117 ±  2%     -16.9%    2816247 ±  1%  sched_debug.cpu#39.ttwu_count
   3387435 ±  2%     -17.3%    2802276 ±  2%  sched_debug.cpu#39.ttwu_local
    165738 ± 10%     +22.5%     203085 ± 10%  sched_debug.cpu#4.avg_idle
     20.00 ± 15%     -26.2%      14.75 ±  5%  sched_debug.cpu#4.cpu_load[2]
     20.00 ± 15%     -27.5%      14.50 ±  5%  sched_debug.cpu#4.cpu_load[3]
     17.75 ± 21%     -29.6%      12.50 ±  6%  sched_debug.cpu#4.cpu_load[4]
   3373163 ±  2%     -17.8%    2772508 ±  2%  sched_debug.cpu#4.nr_switches
   3373753 ±  2%     -17.8%    2773251 ±  2%  sched_debug.cpu#4.sched_count
   3362050 ±  2%     -17.9%    2761172 ±  2%  sched_debug.cpu#4.ttwu_count
   3356987 ±  2%     -17.9%    2755498 ±  2%  sched_debug.cpu#4.ttwu_local
     18.25 ±  9%     -17.8%      15.00 ±  0%  sched_debug.cpu#40.cpu_load[3]
     15.75 ± 12%     -22.2%      12.25 ±  3%  sched_debug.cpu#40.cpu_load[4]
   3387417 ±  3%     -16.6%    2826272 ±  1%  sched_debug.cpu#40.nr_switches
   3388123 ±  3%     -16.6%    2826849 ±  1%  sched_debug.cpu#40.sched_count
   3379250 ±  3%     -16.0%    2837310 ±  2%  sched_debug.cpu#40.ttwu_count
   3375881 ±  3%     -16.5%    2817881 ±  1%  sched_debug.cpu#40.ttwu_local
   3339240 ±  2%     -16.2%    2796813 ±  0%  sched_debug.cpu#41.nr_switches
      4.75 ± 40%    -100.0%       0.00 ±  2%  sched_debug.cpu#41.nr_uninterruptible
   3339755 ±  2%     -16.2%    2797077 ±  0%  sched_debug.cpu#41.sched_count
   3340575 ±  2%     -17.0%    2773377 ±  0%  sched_debug.cpu#41.ttwu_count
   3320958 ±  2%     -16.5%    2771410 ±  0%  sched_debug.cpu#41.ttwu_local
   3383562 ±  2%     -16.9%    2811241 ±  1%  sched_debug.cpu#42.nr_switches
   3383989 ±  2%     -16.9%    2811641 ±  1%  sched_debug.cpu#42.sched_count
   3375932 ±  2%     -16.9%    2803836 ±  1%  sched_debug.cpu#42.ttwu_count
   3373666 ±  2%     -16.9%    2801995 ±  1%  sched_debug.cpu#42.ttwu_local
      1465 ±  2%     +19.7%       1753 ± 12%  sched_debug.cpu#43.curr->pid
   3369174 ±  3%     -16.5%    2814479 ±  2%  sched_debug.cpu#43.nr_switches
   3369600 ±  3%     -16.5%    2815000 ±  2%  sched_debug.cpu#43.sched_count
   3381844 ±  3%     -16.8%    2813877 ±  2%  sched_debug.cpu#43.ttwu_count
   3363319 ±  3%     -16.6%    2805345 ±  2%  sched_debug.cpu#43.ttwu_local
   3373569 ±  3%     -16.8%    2805446 ±  2%  sched_debug.cpu#44.nr_switches
   3374319 ±  3%     -16.8%    2806109 ±  2%  sched_debug.cpu#44.sched_count
   3366509 ±  3%     -16.6%    2808499 ±  2%  sched_debug.cpu#44.ttwu_count
   3364864 ±  3%     -17.1%    2788871 ±  2%  sched_debug.cpu#44.ttwu_local
     19.00 ± 13%     -25.0%      14.25 ± 12%  sched_debug.cpu#45.cpu_load[0]
   3386942 ±  3%     -16.9%    2816202 ±  2%  sched_debug.cpu#45.nr_switches
   3387927 ±  3%     -16.8%    2817175 ±  2%  sched_debug.cpu#45.sched_count
   3379784 ±  4%     -17.1%    2802342 ±  2%  sched_debug.cpu#45.ttwu_count
   3374320 ±  4%     -17.0%    2799191 ±  2%  sched_debug.cpu#45.ttwu_local
     17.50 ±  6%     -18.6%      14.25 ± 13%  sched_debug.cpu#46.cpu_load[1]
     14.50 ±  7%     -19.0%      11.75 ± 12%  sched_debug.cpu#46.cpu_load[4]
   3362941 ±  3%     -15.9%    2828995 ±  2%  sched_debug.cpu#46.nr_switches
   3363152 ±  3%     -15.9%    2829614 ±  2%  sched_debug.cpu#46.sched_count
   3365155 ±  3%     -16.0%    2825366 ±  2%  sched_debug.cpu#46.ttwu_count
   3352628 ±  3%     -15.8%    2823128 ±  2%  sched_debug.cpu#46.ttwu_local
    182936 ±  1%      +8.1%     197759 ±  4%  sched_debug.cpu#47.avg_idle
   3411346 ±  3%     -17.3%    2820818 ±  1%  sched_debug.cpu#47.nr_switches
   3412191 ±  3%     -17.3%    2821388 ±  1%  sched_debug.cpu#47.sched_count
   3405411 ±  3%     -17.2%    2819712 ±  1%  sched_debug.cpu#47.ttwu_count
   3403059 ±  3%     -17.3%    2815610 ±  1%  sched_debug.cpu#47.ttwu_local
   3384910 ±  2%     -17.8%    2782329 ±  2%  sched_debug.cpu#48.nr_switches
   3385314 ±  2%     -17.8%    2782524 ±  2%  sched_debug.cpu#48.sched_count
   3372909 ±  2%     -17.2%    2792501 ±  2%  sched_debug.cpu#48.ttwu_count
   3371515 ±  2%     -18.1%    2760527 ±  3%  sched_debug.cpu#48.ttwu_local
     20.00 ± 10%     -25.0%      15.00 ± 16%  sched_debug.cpu#49.cpu_load[3]
     19.75 ± 16%     -32.9%      13.25 ± 16%  sched_debug.cpu#49.cpu_load[4]
   3361041 ±  1%     -16.7%    2799376 ±  1%  sched_debug.cpu#49.nr_switches
   3361389 ±  2%     -16.7%    2799954 ±  1%  sched_debug.cpu#49.sched_count
    803.25 ± 66%     +81.8%       1460 ± 12%  sched_debug.cpu#49.sched_goidle
   3381487 ±  2%     -17.5%    2790957 ±  2%  sched_debug.cpu#49.ttwu_count
   3353421 ±  1%     -16.8%    2788906 ±  2%  sched_debug.cpu#49.ttwu_local
     15.75 ±  9%     +50.8%      23.75 ± 35%  sched_debug.cpu#5.cpu_load[0]
   3391672 ±  2%     -17.9%    2785157 ±  2%  sched_debug.cpu#5.nr_switches
   3391868 ±  2%     -17.9%    2786330 ±  2%  sched_debug.cpu#5.sched_count
   3383157 ±  2%     -18.0%    2774308 ±  2%  sched_debug.cpu#5.ttwu_count
   3378359 ±  2%     -18.0%    2771534 ±  2%  sched_debug.cpu#5.ttwu_local
   3378831 ±  2%     -18.2%    2764907 ±  1%  sched_debug.cpu#50.nr_switches
   3379167 ±  2%     -18.2%    2765068 ±  1%  sched_debug.cpu#50.sched_count
   3381931 ±  2%     -18.4%    2759976 ±  2%  sched_debug.cpu#50.ttwu_count
   3372100 ±  2%     -19.0%    2732913 ±  2%  sched_debug.cpu#50.ttwu_local
   3391742 ±  2%     -17.8%    2787873 ±  2%  sched_debug.cpu#51.nr_switches
   3393991 ±  3%     -17.9%    2788131 ±  2%  sched_debug.cpu#51.sched_count
   3388915 ±  2%     -18.0%    2779415 ±  2%  sched_debug.cpu#51.ttwu_count
   3386448 ±  2%     -18.0%    2776396 ±  2%  sched_debug.cpu#51.ttwu_local
   3353919 ±  2%     -17.8%    2755852 ±  2%  sched_debug.cpu#52.nr_switches
   3354723 ±  2%     -17.8%    2756388 ±  2%  sched_debug.cpu#52.sched_count
   3341951 ±  2%     -18.3%    2731052 ±  3%  sched_debug.cpu#52.ttwu_count
   3337845 ±  2%     -18.5%    2720797 ±  3%  sched_debug.cpu#52.ttwu_local
   3373578 ±  3%     -17.1%    2796911 ±  2%  sched_debug.cpu#53.nr_switches
   3375925 ±  3%     -17.1%    2797166 ±  2%  sched_debug.cpu#53.sched_count
   3383459 ±  2%     -17.5%    2790891 ±  2%  sched_debug.cpu#53.ttwu_count
   3366616 ±  3%     -17.3%    2784981 ±  2%  sched_debug.cpu#53.ttwu_local
   3390257 ±  3%     -17.9%    2782148 ±  2%  sched_debug.cpu#54.nr_switches
   3391465 ±  3%     -18.0%    2782549 ±  2%  sched_debug.cpu#54.sched_count
   3386304 ±  3%     -16.9%    2812809 ±  1%  sched_debug.cpu#54.ttwu_count
   3384612 ±  3%     -18.3%    2766815 ±  3%  sched_debug.cpu#54.ttwu_local
     22.25 ± 17%     -23.6%      17.00 ±  7%  sched_debug.cpu#55.cpu_load[1]
     21.00 ± 16%     -21.4%      16.50 ±  3%  sched_debug.cpu#55.cpu_load[2]
     19.75 ± 13%     -20.3%      15.75 ±  5%  sched_debug.cpu#55.cpu_load[3]
   3374233 ±  1%     -16.8%    2807090 ±  1%  sched_debug.cpu#55.nr_switches
   3374808 ±  1%     -16.8%    2807431 ±  1%  sched_debug.cpu#55.sched_count
   3366364 ±  1%     -17.2%    2786327 ±  1%  sched_debug.cpu#55.ttwu_count
   3362765 ±  1%     -17.3%    2780406 ±  1%  sched_debug.cpu#55.ttwu_local
   3411822 ±  2%     -17.6%    2811122 ±  2%  sched_debug.cpu#56.nr_switches
   3412183 ±  2%     -17.6%    2811594 ±  2%  sched_debug.cpu#56.sched_count
   3407786 ±  2%     -17.6%    2809656 ±  2%  sched_debug.cpu#56.ttwu_count
   3406197 ±  2%     -17.7%    2804844 ±  2%  sched_debug.cpu#56.ttwu_local
   3397172 ±  3%     -17.2%    2811744 ±  2%  sched_debug.cpu#57.nr_switches
   3397605 ±  3%     -17.2%    2812005 ±  2%  sched_debug.cpu#57.sched_count
   3384695 ±  3%     -16.6%    2822416 ±  2%  sched_debug.cpu#57.ttwu_count
   3382809 ±  3%     -17.3%    2798177 ±  2%  sched_debug.cpu#57.ttwu_local
    188353 ±  1%     +77.7%     334775 ± 61%  sched_debug.cpu#58.avg_idle
   3368337 ±  3%     -16.7%    2805233 ±  2%  sched_debug.cpu#58.nr_switches
   3368535 ±  3%     -16.7%    2805585 ±  2%  sched_debug.cpu#58.sched_count
   3360154 ±  4%     -16.7%    2799389 ±  2%  sched_debug.cpu#58.ttwu_count
   3350965 ±  4%     -16.5%    2796475 ±  1%  sched_debug.cpu#58.ttwu_local
   3386769 ±  3%     -17.8%    2784174 ±  1%  sched_debug.cpu#59.nr_switches
   3387003 ±  3%     -17.8%    2784602 ±  1%  sched_debug.cpu#59.sched_count
   3374107 ±  3%     -17.4%    2786119 ±  1%  sched_debug.cpu#59.ttwu_count
   3371740 ±  3%     -17.9%    2767788 ±  1%  sched_debug.cpu#59.ttwu_local
   3404679 ±  2%     -17.7%    2803402 ±  2%  sched_debug.cpu#6.nr_switches
   3404946 ±  2%     -17.6%    2804520 ±  2%  sched_debug.cpu#6.sched_count
   3396778 ±  2%     -17.7%    2794779 ±  2%  sched_debug.cpu#6.ttwu_count
   3395316 ±  2%     -17.8%    2789570 ±  2%  sched_debug.cpu#6.ttwu_local
     20.50 ±  8%     -24.4%      15.50 ±  5%  sched_debug.cpu#60.cpu_load[0]
   3378881 ±  3%     -17.1%    2799854 ±  1%  sched_debug.cpu#60.nr_switches
   3379401 ±  3%     -17.1%    2800303 ±  1%  sched_debug.cpu#60.sched_count
   3370998 ±  3%     -17.4%    2784997 ±  2%  sched_debug.cpu#60.ttwu_count
   3369479 ±  3%     -17.4%    2783285 ±  2%  sched_debug.cpu#60.ttwu_local
   3389402 ±  2%     -18.2%    2771097 ±  1%  sched_debug.cpu#61.nr_switches
      2.75 ±104%     -72.7%       0.75 ±110%  sched_debug.cpu#61.nr_uninterruptible
   3389770 ±  2%     -18.2%    2771881 ±  1%  sched_debug.cpu#61.sched_count
    448.25 ± 43%    +362.6%       2073 ± 18%  sched_debug.cpu#61.sched_goidle
   3382036 ±  2%     -18.4%    2761058 ±  3%  sched_debug.cpu#61.ttwu_count
   3374996 ±  2%     -18.8%    2738991 ±  2%  sched_debug.cpu#61.ttwu_local
   3401719 ±  2%     -17.5%    2806660 ±  1%  sched_debug.cpu#62.nr_switches
   3401992 ±  2%     -17.5%    2807250 ±  1%  sched_debug.cpu#62.sched_count
   3409442 ±  3%     -17.8%    2801102 ±  1%  sched_debug.cpu#62.ttwu_count
   3396668 ±  2%     -17.6%    2799344 ±  1%  sched_debug.cpu#62.ttwu_local
    188622 ±  1%     +82.6%     344360 ± 61%  sched_debug.cpu#63.avg_idle
   3403259 ±  1%     -17.7%    2800949 ±  2%  sched_debug.cpu#63.nr_switches
   3403635 ±  1%     -17.7%    2801160 ±  2%  sched_debug.cpu#63.sched_count
      1502 ± 36%     -60.9%     587.25 ± 38%  sched_debug.cpu#63.sched_goidle
   3407423 ±  1%     -18.1%    2792346 ±  2%  sched_debug.cpu#63.ttwu_count
   3394668 ±  1%     -17.8%    2791028 ±  2%  sched_debug.cpu#63.ttwu_local
   3395141 ±  2%     -17.1%    2815960 ±  1%  sched_debug.cpu#7.nr_switches
   3395368 ±  2%     -17.0%    2817099 ±  1%  sched_debug.cpu#7.sched_count
   3390104 ±  2%     -16.8%    2819988 ±  1%  sched_debug.cpu#7.ttwu_count
   3388220 ±  2%     -17.2%    2806057 ±  2%  sched_debug.cpu#7.ttwu_local
     20.75 ± 26%     -32.5%      14.00 ±  8%  sched_debug.cpu#8.cpu_load[3]
     19.00 ± 21%     -35.5%      12.25 ± 12%  sched_debug.cpu#8.cpu_load[4]
   3412535 ±  3%     -16.9%    2834133 ±  2%  sched_debug.cpu#8.nr_switches
   3414440 ±  3%     -17.0%    2834516 ±  2%  sched_debug.cpu#8.sched_count
   3400639 ±  3%     -16.8%    2828023 ±  2%  sched_debug.cpu#8.ttwu_count
   3397501 ±  3%     -16.9%    2822112 ±  1%  sched_debug.cpu#8.ttwu_local
     21.75 ± 30%     -32.2%      14.75 ± 10%  sched_debug.cpu#9.cpu_load[1]
     20.50 ± 22%     -26.8%      15.00 ± 12%  sched_debug.cpu#9.cpu_load[2]
   3361173 ±  2%     -15.8%    2828970 ±  2%  sched_debug.cpu#9.nr_switches
   3363065 ±  2%     -15.9%    2829633 ±  2%  sched_debug.cpu#9.sched_count
   3352680 ±  3%     -15.8%    2822914 ±  1%  sched_debug.cpu#9.ttwu_count
   3339358 ±  2%     -15.6%    2819319 ±  2%  sched_debug.cpu#9.ttwu_local


lkp-sbx04: Sandy Bridge-EX
Memory: 64G




          perf-profile.cpu-cycles.sys_connect.entry_SYSCALL_64_fastpath

  33 ++---------------------------------------------------------------------+
     |                                      O   O                           |
  32 ++                              O                                      |
  31 ++                                   O                                 |
     |                             O          O                             |
  30 O+  O O O                         O          O                         |
     | O         O     O   O O O O                                          |
  29 ++        O   O O   O                                                  |
     |                                                                      |
  28 ++                                                                     |
  27 ++        *.                                      .*.*                 |
     | *.*.*. +  *.                                  .*    +               .*
  26 ++      *     *.*.*.*.*.     .*. .*.. .*.*. .*.*       *.*. .*.*.*. .* |
     *                       *.*.*   *    *     *               *       *   |
  25 ++---------------------------------------------------------------------+


   perf-profile.cpu-cycles.SYSC_connect.sys_connect.entry_SYSCALL_64_fastpath

  33 ++---------------------------------------------------------------------+
     |                                          O                           |
  32 ++                              O      O                               |
  31 ++                                   O                                 |
     |                             O          O                             |
  30 O+  O O O                         O          O                         |
     | O               O   O O O O                                          |
  29 ++        O O O O   O                                                  |
     |                                                                      |
  28 ++                                                                     |
  27 ++        *.                                      .*.                  |
     | *.*.*. +  *.                                   *   *.               .*
  26 ++      *     *.*.*.*.*.      *   *.. .*.*. .*. +      *.*. .*.*.*   * |
     *                       *.   + + +   *     *   *           *      + +  |
  25 ++------------------------*-*---*----------------------------------*---+


  perf-profile.cpu-cycles.sock_release.sock_close.__fput.____fput.task_work_run

  26 ++-----------------------------------------O---------------------------+
     |                                                                      |
  24 ++                              O    O O                               |
  22 ++                                       O                             |
     |                             O              O                         |
  20 ++                                O                                    |
     |                                                                      |
  18 ++                                                                     |
     |       O                                                              |
  16 O+O O O     O                                                          |
  14 ++        O   O O O O O O O O                                          |
     |                                                                      |
  12 ++                     .*.                                             |
     *.   .*.*. .*.*.*.*.*.*   *.*.*.*.*..*.*.*.*.*.*.*.   .*.*.*.*.*.*.*.*.|
  10 ++*-*-----*----------------------------------------*-*-----------------*


  perf-profile.cpu-cycles.inet_release.sock_release.sock_close.__fput.____fput

  26 ++---------------------------------------------------------------------+
     |                                          O                           |
  24 ++                                   O O                               |
  22 ++                              O        O                             |
     |                             O              O                         |
  20 ++                                O                                    |
     |                                                                      |
  18 ++                                                                     |
     |       O                                                              |
  16 O+O O O     O                                                          |
  14 ++        O   O O O O O O O O                                          |
     |                                                                      |
  12 ++                                                                     |
     *.   .*.*. .*.*.*.*.*.*.*.*.*.*.*.*..*.*.*.*.*.*.*.   .*.*.*.*.*.*.*.*.|
  10 ++*-*-----*----------------------------------------*-*-----------------*


  perf-profile.cpu-cycles.tcp_close.inet_release.sock_release.sock_close.__fput

  26 ++---------------------------------------------------------------------+
     |                                          O                           |
  24 ++                              O    O O                               |
  22 ++                                       O                             |
     |                             O   O          O                         |
  20 ++                                                                     |
  18 ++                                                                     |
     |                                                                      |
  16 O+O O   O                                                              |
  14 ++    O   O O O O O O O O O O                                          |
     |                                                                      |
  12 *+                     .*.*.*. .*.                                     |
  10 ++*.*.*.*.*.*.*.*.*.*.*       *   *..*.*.*.*.*.*.*. .*.*.*.*.*.*.*.*.*.*
     |                                                  *                   |
   8 ++---------------------------------------------------------------------+


                              netperf.time.system_time

  15000 ++------------------------------------------------------------------+
  14800 ++                                   O   O                          |
        |                              O   O                                |
  14600 ++                                     O                            |
  14400 ++                           O             O                        |
        |                                O                                  |
  14200 ++                                                                  |
  14000 ++                                                                  |
  13800 O+O O O O                                                           |
        |         O O O OO O O   O                                          |
  13600 ++                     O   O                                        |
  13400 ++                                                                  |
        |                                                                   |
  13200 *+*.*.*.*.*.*.*.**.*.*.*.*.*.*.*.*.*.*.*.*.*.*.*.*.**.*.*.*.*.*.*.*.*
  13000 ++------------------------------------------------------------------+


                     netperf.time.percent_of_cpu_this_job_got

  5200 ++-------------------------------------------------------------------+
       |                                        O                           |
  5100 ++                                   O                               |
       |                               O  O   O                             |
  5000 ++                            O            O                         |
       |                                 O                                  |
  4900 ++                                                                   |
       |       O                                                            |
  4800 O+O O O   O O O   O                                                  |
       |               O   O O O O O                                        |
  4700 ++                                                                   |
       *.                       .*.              .*.                        |
  4600 ++*.*.*.*.*.*.*.*.*.*.*.*   *.*.*.**.*.*.*   *.*.*.*.*.*.*.*.*.*.*.*.*
       |                                                                    |
  4500 ++-------------------------------------------------------------------+


	[*] bisect-good sample
	[O] bisect-bad  sample

To reproduce:

        git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Ying Huang

[-- Attachment #2: job.yaml --]
[-- Type: text/plain, Size: 3506 bytes --]

---
LKP_SERVER: inn
LKP_CGI_PORT: 80
LKP_CIFS_PORT: 139
testcase: netperf
default-monitors:
  wait: activate-monitor
  kmsg: 
  uptime: 
  iostat: 
  vmstat: 
  numa-numastat: 
  numa-vmstat: 
  numa-meminfo: 
  proc-vmstat: 
  proc-stat:
    interval: 10
  meminfo: 
  slabinfo: 
  interrupts: 
  lock_stat: 
  latency_stats: 
  softirqs: 
  bdi_dev_mapping: 
  diskstats: 
  nfsstat: 
  cpuidle: 
  cpufreq-stats: 
  turbostat: 
  pmeter: 
  sched_debug:
    interval: 60
cpufreq_governor: performance
default-watchdogs:
  oom-killer: 
  watchdog: 
commit: 2930b5b0df6dffe4626ac0a41c4129bddfe29179
model: Sandy Bridge-EX
nr_cpu: 64
memory: 64G
nr_ssd_partitions: 4
ssd_partitions: "/dev/disk/by-id/ata-INTEL_SSDSC2CW240A3_CVCV20430*-part1"
swap_partitions: 
category: benchmark
runtime: 300s
nr_threads: 200%
perf-profile:
  freq: 800
cluster: cs-localhost
if role server:
  netserver: 
if role client:
  netperf:
    test: TCP_CRR
queue: cyclic
testbox: lkp-sbx04
tbox_group: lkp-sbx04
kconfig: x86_64-rhel
enqueue_time: 2015-09-10 12:40:35.638150254 +08:00
id: 033f439d0806e425a9f121692d7bccc9c3636d2d
user: lkp
compiler: gcc-4.9
head_commit: 2930b5b0df6dffe4626ac0a41c4129bddfe29179
base_commit: 64291f7db5bd8150a74ad2036f1037e6a0428df2
branch: linux-devel/devel-hourly-2015091016
kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/2930b5b0df6dffe4626ac0a41c4129bddfe29179/vmlinuz-4.2.0-wl-ath-07145-g2930b5b"
rootfs: debian-x86_64-2015-02-07.cgz
node_roles: server client
result_root: "/result/netperf/performance-300s-200%-cs-localhost-TCP_CRR/lkp-sbx04/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/2930b5b0df6dffe4626ac0a41c4129bddfe29179/0"
job_file: "/lkp/scheduled/lkp-sbx04/cyclic_netperf-performance-300s-200%-cs-localhost-TCP_CRR-x86_64-rhel-CYCLIC_HEAD-2930b5b0df6dffe4626ac0a41c4129bddfe29179-20150910-23064-6i2atx-0.yaml"
dequeue_time: 2015-09-10 23:46:29.122430045 +08:00
max_uptime: 1500
initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz"
bootloader_append:
- root=/dev/ram0
- user=lkp
- job=/lkp/scheduled/lkp-sbx04/cyclic_netperf-performance-300s-200%-cs-localhost-TCP_CRR-x86_64-rhel-CYCLIC_HEAD-2930b5b0df6dffe4626ac0a41c4129bddfe29179-20150910-23064-6i2atx-0.yaml
- ARCH=x86_64
- kconfig=x86_64-rhel
- branch=linux-devel/devel-hourly-2015091016
- commit=2930b5b0df6dffe4626ac0a41c4129bddfe29179
- BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/2930b5b0df6dffe4626ac0a41c4129bddfe29179/vmlinuz-4.2.0-wl-ath-07145-g2930b5b
- max_uptime=1500
- RESULT_ROOT=/result/netperf/performance-300s-200%-cs-localhost-TCP_CRR/lkp-sbx04/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/2930b5b0df6dffe4626ac0a41c4129bddfe29179/0
- LKP_SERVER=inn
- |2-


  earlyprintk=ttyS0,115200 systemd.log_level=err
  debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100
  panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0
  console=ttyS0,115200 console=tty0 vga=normal

  rw
lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz"
modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/2930b5b0df6dffe4626ac0a41c4129bddfe29179/modules.cgz"
bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/turbostat.cgz,/lkp/benchmarks/turbostat.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/netperf.cgz,/lkp/benchmarks/netperf.cgz"
job_state: finished
loadavg: 88.72 85.13 39.87 1/665 11385
start_time: '1441900039'
end_time: '1441900345'
version: "/lkp/lkp/.src-20150910-124314"

[-- Attachment #3: reproduce.ksh --]
[-- Type: text/plain, Size: 10496 bytes --]

echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu10/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu11/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu12/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu13/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu14/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu15/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu16/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu17/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu18/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu19/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu2/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu20/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu21/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu22/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu23/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu24/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu25/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu26/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu27/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu28/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu29/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu3/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu30/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu31/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu32/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu33/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu34/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu35/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu36/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu37/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu38/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu39/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu4/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu40/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu41/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu42/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu43/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu44/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu45/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu46/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu47/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu48/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu49/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu5/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu50/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu51/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu52/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu53/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu54/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu55/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu56/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu57/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu58/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu59/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu6/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu60/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu61/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu62/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu63/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu7/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu8/cpufreq/scaling_governor
echo performance > /sys/devices/system/cpu/cpu9/cpufreq/scaling_governor
netserver
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1
netperf -t TCP_CRR -c -C -l 300 -H 127.0.0.1

             reply	other threads:[~2015-09-20 12:30 UTC|newest]

Thread overview: 15+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-09-20 12:30 kernel test robot [this message]
2015-09-21  1:19 ` [net] 192132b9a0: -17.5% netperf.Throughput_tps David Ahern
2015-09-21  1:19   ` [lkp] " David Ahern
2015-09-21  1:33   ` Huang Ying
2015-09-21  1:33     ` [lkp] " Huang Ying
2015-09-21  3:48     ` David Ahern
2015-09-21  3:48       ` [lkp] " David Ahern
2015-09-23 18:06     ` David Ahern
2015-09-23 18:06       ` [lkp] " David Ahern
2015-09-24  0:37       ` Huang Ying
2015-09-24  0:37         ` [lkp] " Huang Ying
2015-09-24  3:12         ` David Ahern
2015-09-24  3:12           ` [lkp] " David Ahern
2015-09-29  8:45           ` Huang, Ying
2015-09-29  8:45             ` [lkp] " Huang, Ying

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=87eghtb7e8.fsf@yhuang-dev.intel.com \
    --to=ying.huang@intel.com \
    --cc=lkp@lists.01.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.