All of lore.kernel.org
 help / color / mirror / Atom feed
* [mm] 5c6dc7978a: -17.6% blogbench.read_score, +19.3% blogbench.write_score
@ 2016-02-02  2:18 kernel test robot
  0 siblings, 0 replies; only message in thread
From: kernel test robot @ 2016-02-02  2:18 UTC (permalink / raw)
  To: lkp

[-- Attachment #1: Type: text/plain, Size: 66394 bytes --]

FYI, we noticed the below changes on

https://git.kernel.org/pub/scm/linux/kernel/git/mel/linux-balancenuma mm-vmscan-node-lru-v2r26
commit 5c6dc7978afb41bff22b2b9002b8a619b3a76955 ("mm: vmscan: Do not reclaim from kswapd if there is any eligible zone")


=========================================================================================
compiler/cpufreq_governor/disk/fs/kconfig/rootfs/tbox_group/testcase:
  gcc-4.9/performance/1SSD/btrfs/x86_64-rhel/debian-x86_64-2015-02-07.cgz/lkp-bdw01/blogbench

commit: 
  26599ca376581478c5da5fb2316eda236b6fd1e1
  5c6dc7978afb41bff22b2b9002b8a619b3a76955

26599ca376581478 5c6dc7978afb41bff22b2b9002 
---------------- -------------------------- 
         %stddev     %change         %stddev
             \          |                \  
    459703 ±  3%     -17.6%     378624 ±  3%  blogbench.read_score
 1.049e+08 ±  3%      +8.0%  1.134e+08 ±  2%  blogbench.time.file_system_inputs
  34609582 ±  2%     +23.5%   42737212 ±  1%  blogbench.time.file_system_outputs
   4686729 ±  2%     +18.2%    5540148 ±  0%  blogbench.time.involuntary_context_switches
      2854 ±  1%    +204.1%       8679 ±  2%  blogbench.time.maximum_resident_set_size
     48.88 ±  2%     -14.7%      41.71 ±  1%  blogbench.time.user_time
   4624746 ±  3%     +42.5%    6590480 ±  2%  blogbench.time.voluntary_context_switches
      3447 ±  2%     +19.3%       4112 ±  1%  blogbench.write_score
    131671 ±  2%     +34.1%     176572 ±  1%  softirqs.SCHED
      3.17 ±  6%     -27.5%       2.30 ±  2%  turbostat.CPU%c1
      0.02 ± 48%     -55.6%       0.01 ±-10000%  turbostat.CPU%c3
  34609582 ±  2%     +23.5%   42737212 ±  1%  time.file_system_outputs
   4686729 ±  2%     +18.2%    5540148 ±  0%  time.involuntary_context_switches
      2854 ±  1%    +204.1%       8679 ±  2%  time.maximum_resident_set_size
     48.88 ±  2%     -14.7%      41.71 ±  1%  time.user_time
   4624746 ±  3%     +42.5%    6590480 ±  2%  time.voluntary_context_switches
    173695 ±  3%      +7.7%     187054 ±  2%  vmstat.io.bi
     67545 ±  2%     +28.5%      86794 ±  1%  vmstat.io.bo
    532739 ±  1%     +53.1%     815649 ±  1%  vmstat.memory.free
     47.75 ±  1%     +20.4%      57.50 ±  1%  vmstat.procs.b
     53.75 ±  1%     -16.7%      44.75 ±  2%  vmstat.procs.r
     63290 ±  2%     +23.2%      77966 ±  0%  vmstat.system.cs
     16184 ±  2%     +21.2%      19619 ±  0%  vmstat.system.in
  32931925 ±  7%     -24.4%   24884744 ±  2%  cpuidle.C1-BDW.time
    156977 ±  2%     -23.9%     119495 ±  1%  cpuidle.C1-BDW.usage
   4329633 ±  5%     -50.4%    2146304 ± 18%  cpuidle.C1E-BDW.time
     12510 ±  7%     -44.2%       6979 ± 16%  cpuidle.C1E-BDW.usage
    655993 ± 10%     -62.5%     245977 ± 19%  cpuidle.C3-BDW.time
      1792 ± 19%     -59.6%     723.75 ± 13%  cpuidle.C3-BDW.usage
    199.00 ± 35%     -66.0%      67.75 ± 25%  cpuidle.C7s-BDW.usage
     98.25 ± 36%     -47.8%      51.25 ± 39%  cpuidle.C8-BDW.usage
   1533646 ±  3%     +25.0%    1916951 ±  1%  cpuidle.POLL.usage
     37068 ± 78%     -80.0%       7416 ± 80%  latency_stats.max.btrfs_tree_lock.[btrfs].btrfs_lock_root_node.[btrfs].btrfs_search_slot.[btrfs].btrfs_insert_empty_items.[btrfs].insert_with_overflow.[btrfs].btrfs_insert_dir_item.[btrfs].btrfs_add_link.[btrfs].btrfs_mkdir.[btrfs].vfs_mkdir.SyS_mkdir.entry_SYSCALL_64_fastpath
      5502 ± 69%    +199.2%      16461 ±108%  latency_stats.max.btrfs_tree_read_lock.[btrfs].btrfs_read_lock_root_node.[btrfs].btrfs_search_slot.[btrfs].btrfs_insert_empty_items.[btrfs].cow_file_range_inline.[btrfs].cow_file_range.[btrfs].run_delalloc_range.[btrfs].writepage_delalloc.[btrfs].__extent_writepage.[btrfs].extent_write_cache_pages.[btrfs].extent_writepages.[btrfs].btrfs_writepages.[btrfs]
      0.00 ± -1%      +Inf%      85685 ±100%  latency_stats.max.filename_create.SyS_mkdir.entry_SYSCALL_64_fastpath
     75945 ± 46%     -83.1%      12804 ±100%  latency_stats.sum.btrfs_commit_inode_delayed_inode.[btrfs].btrfs_evict_inode.[btrfs].evict.iput.__dentry_kill.dput.SyS_rename.entry_SYSCALL_64_fastpath
   1555524 ± 11%     -71.4%     445632 ± 21%  latency_stats.sum.btrfs_delete_delayed_dir_index.[btrfs].__btrfs_unlink_inode.[btrfs].btrfs_rename2.[btrfs].vfs_rename.SyS_rename.entry_SYSCALL_64_fastpath
    127279 ± 85%     -79.4%      26177 ± 42%  latency_stats.sum.btrfs_tree_lock.[btrfs].btrfs_lock_root_node.[btrfs].btrfs_search_slot.[btrfs].btrfs_insert_empty_items.[btrfs].insert_with_overflow.[btrfs].btrfs_insert_dir_item.[btrfs].btrfs_add_link.[btrfs].btrfs_mkdir.[btrfs].vfs_mkdir.SyS_mkdir.entry_SYSCALL_64_fastpath
      0.00 ± -1%      +Inf%      59705 ± 64%  latency_stats.sum.btrfs_tree_lock.[btrfs].btrfs_search_slot.[btrfs].btrfs_lookup_file_extent.[btrfs].__btrfs_drop_extents.[btrfs].cow_file_range_inline.[btrfs].cow_file_range.[btrfs].run_delalloc_range.[btrfs].writepage_delalloc.[btrfs].__extent_writepage.[btrfs].extent_write_cache_pages.[btrfs].extent_writepages.[btrfs].btrfs_writepages.[btrfs]
  42284072 ± 12%     -70.0%   12684139 ±  7%  latency_stats.sum.btrfs_tree_read_lock.[btrfs].btrfs_read_lock_root_node.[btrfs].btrfs_search_slot.[btrfs].btrfs_lookup_dir_item.[btrfs].btrfs_lookup_dentry.[btrfs].btrfs_lookup.[btrfs].lookup_real.path_openat.do_filp_open.do_sys_open.SyS_open.entry_SYSCALL_64_fastpath
      0.00 ± -1%      +Inf%     274080 ±102%  latency_stats.sum.filename_create.SyS_mkdir.entry_SYSCALL_64_fastpath
     21264 ±  4%     +23.6%      26279 ±  3%  meminfo.Active
      1320 ±  2%     -24.3%       1000 ±  2%  meminfo.Active(anon)
     19943 ±  4%     +26.8%      25278 ±  3%  meminfo.Active(file)
      5120 ± 20%    +109.5%      10726 ±  8%  meminfo.AnonHugePages
     19943 ±  4%     +26.8%      25278 ±  3%  meminfo.AnonPages
    499678 ±  1%     +58.6%     792537 ±  1%  meminfo.Inactive
    499678 ±  1%     +58.6%     792537 ±  1%  meminfo.Inactive(anon)
    781175 ±  1%     +29.4%    1010738 ±  1%  meminfo.MemAvailable
    499678 ±  1%     +58.6%     792537 ±  1%  meminfo.MemFree
    313044 ±  0%     -21.9%     244568 ±  1%  meminfo.SReclaimable
    347708 ±  0%     -20.3%     277117 ±  1%  meminfo.Slab
      4042 ± 12%     +38.6%       5601 ±  9%  meminfo.Writeback
    342347 ±  8%     -29.2%     242451 ± 14%  sched_debug.cpu.avg_idle.2
    348057 ±  4%     -20.7%     276024 ± 17%  sched_debug.cpu.avg_idle.avg
    194.50 ± 15%     +47.0%     286.00 ± 22%  sched_debug.cpu.cpu_load[0].1
     65.70 ± 27%     +32.0%      86.71 ± 17%  sched_debug.cpu.cpu_load[1].stddev
   1827889 ±  7%     +22.8%    2244113 ±  2%  sched_debug.cpu.nr_switches.0
   1834119 ±  6%     +32.1%    2423230 ±  4%  sched_debug.cpu.nr_switches.1
   2035714 ±  5%     +25.2%    2549686 ±  5%  sched_debug.cpu.nr_switches.2
   2019975 ±  2%     +19.2%    2407047 ±  1%  sched_debug.cpu.nr_switches.3
   1929425 ±  2%     +24.7%    2406019 ±  1%  sched_debug.cpu.nr_switches.avg
   2113648 ±  1%     +22.9%    2597031 ±  3%  sched_debug.cpu.nr_switches.max
   1732554 ±  5%     +27.1%    2202672 ±  1%  sched_debug.cpu.nr_switches.min
   2138340 ±  6%     +19.5%    2555213 ±  2%  sched_debug.cpu.sched_count.0
   1835798 ±  6%     +32.1%    2425180 ±  4%  sched_debug.cpu.sched_count.1
   2037410 ±  5%     +25.2%    2551583 ±  5%  sched_debug.cpu.sched_count.2
   2021688 ±  2%     +19.2%    2409014 ±  1%  sched_debug.cpu.sched_count.3
   2008309 ±  2%     +23.7%    2485248 ±  1%  sched_debug.cpu.sched_count.avg
   2225771 ±  2%     +21.6%    2706711 ±  3%  sched_debug.cpu.sched_count.max
   1813605 ±  5%     +27.4%    2311275 ±  1%  sched_debug.cpu.sched_count.min
    113405 ±  2%     +29.4%     146787 ±  4%  sched_debug.cpu.sched_goidle.0
    162197 ±  4%     +34.7%     218436 ±  1%  sched_debug.cpu.sched_goidle.1
    140829 ±  4%     +33.9%     188508 ±  2%  sched_debug.cpu.sched_goidle.2
    156043 ±  3%     +35.9%     212014 ±  2%  sched_debug.cpu.sched_goidle.3
    143119 ±  3%     +33.8%     191437 ±  2%  sched_debug.cpu.sched_goidle.avg
    162420 ±  4%     +34.7%     218756 ±  1%  sched_debug.cpu.sched_goidle.max
    112440 ±  2%     +29.7%     145784 ±  4%  sched_debug.cpu.sched_goidle.min
     19494 ±  7%     +48.3%      28918 ±  9%  sched_debug.cpu.sched_goidle.stddev
   1542496 ±  5%     +20.0%    1850574 ±  2%  sched_debug.cpu.ttwu_count.0
   1032479 ±  6%     +38.0%    1424732 ±  4%  sched_debug.cpu.ttwu_count.1
   1171762 ±  3%     +30.3%    1526534 ±  5%  sched_debug.cpu.ttwu_count.2
   1095693 ±  1%     +27.5%    1396581 ±  0%  sched_debug.cpu.ttwu_count.3
   1210608 ±  3%     +28.0%    1549606 ±  1%  sched_debug.cpu.ttwu_count.avg
   1568449 ±  4%     +18.2%    1853276 ±  2%  sched_debug.cpu.ttwu_count.max
   1012973 ±  4%     +35.5%    1372386 ±  1%  sched_debug.cpu.ttwu_count.min
    379141 ± 11%     +26.2%     478424 ± 10%  sched_debug.cpu.ttwu_local.1
    464858 ±  1%     +10.0%     511132 ±  1%  sched_debug.cpu.ttwu_local.avg
    358796 ±  8%     +21.8%     436860 ±  6%  sched_debug.cpu.ttwu_local.min
     37501 ±115%    -100.0%       5.50 ± 58%  proc-vmstat.allocstall
    322.00 ±  1%     -99.7%       1.00 ±  0%  proc-vmstat.compact_fail
  29862869 ±  6%     -99.8%      56638 ± 36%  proc-vmstat.compact_free_scanned
   1756818 ±  9%    -100.0%     113.00 ± 47%  proc-vmstat.compact_isolated
   3699714 ± 40%     -99.9%       3875 ±  2%  proc-vmstat.compact_migrate_scanned
    387.75 ±  2%     -99.5%       1.75 ± 47%  proc-vmstat.compact_stall
     23849 ±  5%    -100.0%       0.00 ± -1%  proc-vmstat.kswapd_high_wmark_hit_quickly
   4798041 ±  2%    +277.7%   18120500 ±  2%  proc-vmstat.kswapd_inodesteal
     56675 ±  4%    -100.0%       0.33 ±141%  proc-vmstat.kswapd_low_wmark_hit_quickly
      5058 ±  4%     +26.4%       6393 ±  3%  proc-vmstat.nr_active_anon
    499504 ±  0%     -16.9%     414900 ±  2%  proc-vmstat.nr_active_file
    328.50 ±  3%     -25.9%     243.50 ±  1%  proc-vmstat.nr_alloc_batch
      4984 ±  4%     +26.8%       6318 ±  3%  proc-vmstat.nr_anon_pages
   5307143 ±  2%     +28.3%    6810058 ±  1%  proc-vmstat.nr_dirtied
    125249 ±  2%     +57.7%     197501 ±  1%  proc-vmstat.nr_free_pages
    229322 ±  1%     +22.8%     281647 ±  2%  proc-vmstat.nr_inactive_file
     78209 ±  0%     -21.8%      61189 ±  1%  proc-vmstat.nr_slab_reclaimable
     33245 ± 15%     -71.8%       9384 ± 88%  proc-vmstat.nr_unevictable
    356807 ± 11%    -100.0%       0.00 ± -1%  proc-vmstat.nr_vmscan_immediate_reclaim
     82546 ±  7%    -100.0%       0.00 ± -1%  proc-vmstat.nr_vmscan_write
    994.50 ± 14%     +47.3%       1464 ±  7%  proc-vmstat.nr_writeback
   5224316 ±  2%     +28.3%    6704211 ±  1%  proc-vmstat.nr_written
     87262 ±  4%     -99.9%     112.50 ±  2%  proc-vmstat.pageoutrun
   8209800 ±  2%     -22.6%    6357584 ±  2%  proc-vmstat.pgactivate
   5918065 ±  1%    +146.2%   14568370 ±  1%  proc-vmstat.pgalloc_dma32
  13467120 ±  2%     -50.8%    6626596 ±  2%  proc-vmstat.pgalloc_normal
  10143912 ±  3%     -99.9%      13934 ±140%  proc-vmstat.pgdeactivate
     34957 ±  5%     -96.3%       1300 ±124%  proc-vmstat.pginodesteal
    175912 ± 19%    -100.0%       1.33 ±141%  proc-vmstat.pgmigrate_fail
     83594 ±  4%     -99.9%      55.00 ± 45%  proc-vmstat.pgmigrate_success
  20440083 ±  2%     +28.5%   26272256 ±  1%  proc-vmstat.pgpgout
  10157444 ±  3%     -99.8%      19647 ±108%  proc-vmstat.pgrefill
    187716 ± 10%    -100.0%       0.00 ±  0%  proc-vmstat.pgrotated
     96040 ± 11%     -90.2%       9415 ±131%  proc-vmstat.pgscan_direct
  12320286 ±  3%    -100.0%       0.00 ± -1%  proc-vmstat.pgscan_kswapd
     89886 ± 10%     -99.9%      55.00 ±100%  proc-vmstat.pgsteal_direct
  11628160 ±  2%    -100.0%       0.00 ± -1%  proc-vmstat.pgsteal_kswapd
  18528288 ±  2%     +44.4%   26754604 ±  3%  proc-vmstat.slabs_scanned
     48971 ± 15%     -69.2%      15100 ± 94%  proc-vmstat.unevictable_pgs_culled
   2159015 ±  5%    -100.0%       0.00 ± -1%  proc-vmstat.workingset_activate
   2363876 ±  5%    -100.0%       0.50 ±100%  proc-vmstat.workingset_refault
    163809 ±  0%     -26.2%     120877 ±  0%  slabinfo.Acpi-State.active_objs
      3280 ±  0%     -17.1%       2720 ±  1%  slabinfo.Acpi-State.active_slabs
    167286 ±  0%     -17.1%     138763 ±  1%  slabinfo.Acpi-State.num_objs
      3280 ±  0%     -17.1%       2720 ±  1%  slabinfo.Acpi-State.num_slabs
     78003 ±  1%     -39.7%      47031 ±  1%  slabinfo.btrfs_delayed_node.active_objs
      3637 ±  1%     -40.3%       2172 ±  0%  slabinfo.btrfs_delayed_node.active_slabs
     94577 ±  1%     -40.3%      56509 ±  0%  slabinfo.btrfs_delayed_node.num_objs
      3637 ±  1%     -40.3%       2172 ±  0%  slabinfo.btrfs_delayed_node.num_slabs
      6691 ± 17%     -30.2%       4674 ±  8%  slabinfo.btrfs_delayed_ref_head.active_objs
      7097 ± 16%     -29.8%       4981 ±  7%  slabinfo.btrfs_delayed_ref_head.num_objs
     16611 ±  3%     +35.3%      22475 ±  0%  slabinfo.btrfs_extent_buffer.active_objs
    581.75 ±  2%     +34.5%     782.50 ±  0%  slabinfo.btrfs_extent_buffer.active_slabs
     16862 ±  2%     +34.7%      22709 ±  0%  slabinfo.btrfs_extent_buffer.num_objs
    581.75 ±  2%     +34.5%     782.50 ±  0%  slabinfo.btrfs_extent_buffer.num_slabs
    116112 ±  0%     -33.4%      77363 ±  1%  slabinfo.btrfs_extent_map.active_objs
      4287 ±  0%     -22.8%       3310 ±  1%  slabinfo.btrfs_extent_map.active_slabs
    120054 ±  0%     -22.8%      92699 ±  1%  slabinfo.btrfs_extent_map.num_objs
      4287 ±  0%     -22.8%       3310 ±  1%  slabinfo.btrfs_extent_map.num_slabs
    102061 ±  0%     -19.7%      81986 ±  0%  slabinfo.btrfs_extent_state.active_objs
      2379 ±  0%     -18.6%       1936 ±  1%  slabinfo.btrfs_extent_state.active_slabs
    121372 ±  0%     -18.6%      98788 ±  1%  slabinfo.btrfs_extent_state.num_objs
      2379 ±  0%     -18.6%       1936 ±  1%  slabinfo.btrfs_extent_state.num_slabs
    125087 ±  0%     -31.8%      85358 ±  1%  slabinfo.btrfs_inode.active_objs
      4258 ±  2%     -24.8%       3203 ±  1%  slabinfo.btrfs_inode.active_slabs
    128521 ±  0%     -20.5%     102190 ±  2%  slabinfo.btrfs_inode.num_objs
      4258 ±  2%     -24.8%       3203 ±  1%  slabinfo.btrfs_inode.num_slabs
      1166 ±  2%     +21.4%       1416 ±  2%  slabinfo.btrfs_ordered_extent.active_objs
      1287 ±  2%     +22.3%       1574 ±  2%  slabinfo.btrfs_ordered_extent.num_objs
      4545 ± 16%     -26.2%       3353 ± 12%  slabinfo.btrfs_path.active_objs
      4650 ± 15%     -25.7%       3457 ± 11%  slabinfo.btrfs_path.num_objs
      3349 ± 10%     -20.8%       2651 ±  3%  slabinfo.buffer_head.active_objs
      3530 ± 10%     -21.6%       2768 ±  3%  slabinfo.buffer_head.num_objs
    132150 ±  0%     -30.8%      91384 ±  0%  slabinfo.dentry.active_objs
      6915 ±  0%     -35.0%       4493 ±  0%  slabinfo.dentry.active_slabs
    145225 ±  0%     -35.0%      94359 ±  0%  slabinfo.dentry.num_objs
      6915 ±  0%     -35.0%       4493 ±  0%  slabinfo.dentry.num_slabs
      2389 ±  1%     +13.4%       2710 ±  3%  slabinfo.ext4_io_end.active_objs
      2473 ±  1%     +16.0%       2869 ±  2%  slabinfo.ext4_io_end.num_objs
    862.25 ±  3%     -13.0%     749.75 ±  8%  slabinfo.kmalloc-1024.active_objs
    866.75 ±  2%     -11.5%     766.75 ±  6%  slabinfo.kmalloc-1024.num_objs
      1299 ±  1%     -37.1%     816.75 ± 12%  slabinfo.proc_inode_cache.active_objs
      1344 ±  4%     -31.4%     922.75 ±  9%  slabinfo.proc_inode_cache.num_objs
    120832 ±  0%     -33.5%      80360 ±  0%  slabinfo.radix_tree_node.active_objs
      4457 ±  0%     -21.2%       3510 ±  1%  slabinfo.radix_tree_node.active_slabs
    123934 ±  0%     -20.7%      98312 ±  1%  slabinfo.radix_tree_node.num_objs
      4457 ±  0%     -21.2%       3510 ±  1%  slabinfo.radix_tree_node.num_slabs

=========================================================================================
compiler/cpufreq_governor/kconfig/rootfs/runtime/tbox_group/test/testcase:
  gcc-4.9/performance/x86_64-rhel/debian-x86_64-2015-02-07.cgz/300s/lkp-hsw-ep2/lru-file-mmap-read/vm-scalability

commit: 
  26599ca376581478c5da5fb2316eda236b6fd1e1
  5c6dc7978afb41bff22b2b9002b8a619b3a76955

26599ca376581478 5c6dc7978afb41bff22b2b9002 
---------------- -------------------------- 
         %stddev     %change         %stddev
             \          |                \  
  12328762 ±  5%     -24.7%    9277920 ±  9%  vm-scalability.throughput
   2474335 ±  3%      +8.6%    2687066 ±  2%  vm-scalability.time.maximum_resident_set_size
  39367796 ± 17%     -49.6%   19859813 ± 15%  vm-scalability.time.minor_page_faults
      1222 ±  5%     -28.2%     878.27 ± 11%  vm-scalability.time.user_time
      1496 ±  0%   +2160.9%      33829 ±108%  vm-scalability.time.voluntary_context_switches
   3266412 ±  4%     -25.5%    2433401 ±  7%  meminfo.PageTables
    476675 ±  2%     -17.4%     393600 ± 11%  meminfo.Shmem
   1623436 ±  4%     -26.9%    1186308 ±  7%  numa-meminfo.node0.PageTables
   1618915 ±  3%     -24.9%    1216339 ±  7%  numa-meminfo.node1.PageTables
      2.50 ±  8%     -35.5%       1.61 ± 30%  turbostat.Pkg%pc2
     71.22 ±  1%      -7.5%      65.91 ±  3%  turbostat.RAMWatt
      5068 ±  3%     -10.8%       4519 ±  5%  vmstat.system.cs
    374306 ±  0%     -15.8%     315290 ±  5%  vmstat.system.in
   3128873 ± 35%    +109.4%    6551158 ± 29%  cpuidle.C1-HSW.time
   3849893 ± 43%    +124.7%    8649880 ± 27%  cpuidle.C1E-HSW.time
      1752 ± 16%    +480.4%      10169 ± 92%  cpuidle.C1E-HSW.usage
  38799823 ± 25%     -49.1%   19750901 ± 25%  cpuidle.POLL.time
   2474335 ±  3%      +8.6%    2687066 ±  2%  time.maximum_resident_set_size
  39367796 ± 17%     -49.6%   19859813 ± 15%  time.minor_page_faults
      1222 ±  5%     -28.2%     878.27 ± 11%  time.user_time
      1496 ±  0%   +2160.9%      33829 ±108%  time.voluntary_context_switches
 2.986e+08 ±  3%     -24.0%   2.27e+08 ± 12%  numa-numastat.node0.local_node
 1.023e+08 ± 17%     -44.8%   56480884 ± 15%  numa-numastat.node0.numa_foreign
 2.986e+08 ±  3%     -24.0%   2.27e+08 ± 12%  numa-numastat.node0.numa_hit
  97234595 ± 17%     -47.9%   50703373 ±  5%  numa-numastat.node0.numa_miss
  97239280 ± 17%     -47.9%   50708053 ±  5%  numa-numastat.node0.other_node
 2.965e+08 ±  2%     -22.3%  2.303e+08 ± 10%  numa-numastat.node1.local_node
  97234595 ± 17%     -47.9%   50703373 ±  5%  numa-numastat.node1.numa_foreign
 2.965e+08 ±  2%     -22.3%  2.303e+08 ± 10%  numa-numastat.node1.numa_hit
 1.023e+08 ± 17%     -44.8%   56480884 ± 15%  numa-numastat.node1.numa_miss
 1.023e+08 ± 17%     -44.8%   56485577 ± 15%  numa-numastat.node1.other_node
      4216 ±141%    +807.1%      38249 ± 51%  latency_stats.avg.pipe_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
     27.50 ± 61%  +1.1e+05%      29406 ±113%  latency_stats.hits.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.filemap_fault.xfs_filemap_fault.__do_fault.handle_mm_fault.__do_page_fault.do_page_fault
   4283070 ± 41%    +251.9%   15071625 ±132%  latency_stats.max.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
   2837250 ± 57%     -97.1%      83492 ± 43%  latency_stats.max.pipe_wait.pipe_read.__vfs_read.vfs_read.SyS_read.entry_SYSCALL_64_fastpath
      4216 ±141%   +2176.3%      95985 ± 20%  latency_stats.max.pipe_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
      8459 ±117%     -90.4%     814.00 ± 25%  latency_stats.max.rpc_wait_bit_killable.__rpc_wait_for_completion_task.nfs4_run_open_task.[nfsv4]._nfs4_open_and_get_state.[nfsv4].nfs4_do_open.[nfsv4].nfs4_atomic_open.[nfsv4].nfs4_file_open.[nfsv4].do_dentry_open.vfs_open.path_openat.do_filp_open.do_sys_open
   8532453 ± 89%    +210.7%   26512390 ±123%  latency_stats.sum.nfs_wait_on_request.nfs_updatepage.nfs_write_end.generic_perform_write.__generic_file_write_iter.generic_file_write_iter.nfs_file_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
      4216 ±141%   +3253.8%     141418 ± 18%  latency_stats.sum.pipe_write.__vfs_write.vfs_write.SyS_write.entry_SYSCALL_64_fastpath
      0.00 ± -1%      +Inf%       4823 ±101%  latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.__get_free_pages.pgd_alloc.mm_init.mm_alloc.do_execveat_common.SyS_execve.return_from_execve
      2363 ±127%  +11355.4%     270748 ±125%  latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.__do_page_cache_readahead.ondemand_readahead.page_cache_async_readahead.filemap_fault.xfs_filemap_fault.__do_fault
     10160 ± 67%  +37000.6%    3769701 ±117%  latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.filemap_fault.xfs_filemap_fault.__do_fault.handle_mm_fault.__do_page_fault.do_page_fault
    781.00 ± 25%   +2356.8%      19187 ± 56%  latency_stats.sum.throttle_direct_reclaim.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.pte_alloc_one.__pte_alloc.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
     65025 ± 34%  +16343.4%   10692430 ±172%  latency_stats.sum.wait_on_page_bit.__filemap_fdatawait_range.filemap_fdatawait_range.filemap_write_and_wait_range.nfs4_file_fsync.[nfsv4].vfs_fsync_range.vfs_fsync.nfs4_file_flush.[nfsv4].filp_close.do_dup2.SyS_dup2.entry_SYSCALL_64_fastpath
      0.00 ± -1%      +Inf%     803404 ± 72%  latency_stats.sum.xfs_iget.xfs_lookup.xfs_vn_lookup.lookup_real.__lookup_hash.walk_component.path_lookupat.filename_lookup.user_path_at_empty.vfs_fstatat.SYSC_newfstatat.SyS_newfstatat
    405453 ±  4%     -26.9%     296585 ±  7%  numa-vmstat.node0.nr_page_table_pages
      2893 ± 23%     -86.7%     383.50 ±118%  numa-vmstat.node0.nr_pages_scanned
  58018952 ± 15%     -39.8%   34901400 ± 18%  numa-vmstat.node0.numa_foreign
  1.88e+08 ±  2%     -18.2%  1.538e+08 ± 12%  numa-vmstat.node0.numa_hit
  1.88e+08 ±  2%     -18.2%  1.537e+08 ± 13%  numa-vmstat.node0.numa_local
  55114581 ± 15%     -44.3%   30679438 ±  8%  numa-vmstat.node0.numa_miss
  55187040 ± 14%     -44.3%   30750686 ±  7%  numa-vmstat.node0.numa_other
   2811824 ±  7%     -40.2%    1680948 ± 22%  numa-vmstat.node0.workingset_nodereclaim
    119.50 ± 15%     -48.1%      62.00 ± 17%  numa-vmstat.node1.nr_isolated_file
    404543 ±  3%     -24.8%     304160 ±  7%  numa-vmstat.node1.nr_page_table_pages
      4355 ± 92%     -85.0%     651.25 ± 85%  numa-vmstat.node1.nr_pages_scanned
  55140101 ± 15%     -44.3%   30691651 ±  8%  numa-vmstat.node1.numa_foreign
 1.864e+08 ±  2%     -16.8%  1.551e+08 ± 10%  numa-vmstat.node1.numa_hit
 1.864e+08 ±  2%     -16.8%  1.551e+08 ± 10%  numa-vmstat.node1.numa_local
  58043707 ± 15%     -39.8%   34915222 ± 18%  numa-vmstat.node1.numa_miss
  58077679 ± 15%     -39.8%   34950390 ± 18%  numa-vmstat.node1.numa_other
   2256172 ±  6%     -24.3%    1708157 ± 18%  numa-vmstat.node1.workingset_nodereclaim
     53141 ±  3%     -14.5%      45432 ±  0%  slabinfo.Acpi-State.active_objs
      1049 ±  3%     -14.6%     896.25 ±  0%  slabinfo.Acpi-State.active_slabs
     53538 ±  3%     -14.6%      45736 ±  0%  slabinfo.Acpi-State.num_objs
      1049 ±  3%     -14.6%     896.25 ±  0%  slabinfo.Acpi-State.num_slabs
     54816 ±  1%      -8.6%      50125 ±  2%  slabinfo.dentry.active_objs
      1330 ±  1%      -9.0%       1211 ±  2%  slabinfo.dentry.active_slabs
     55894 ±  1%      -8.9%      50892 ±  2%  slabinfo.dentry.num_objs
      1330 ±  1%      -9.0%       1211 ±  2%  slabinfo.dentry.num_slabs
     43069 ±  1%     -10.3%      38631 ±  0%  slabinfo.inode_cache.active_objs
    789.00 ±  0%     -13.4%     683.50 ±  0%  slabinfo.inode_cache.active_slabs
     44983 ±  0%     -13.3%      38994 ±  0%  slabinfo.inode_cache.num_objs
    789.00 ±  0%     -13.4%     683.50 ±  0%  slabinfo.inode_cache.num_slabs
    184.25 ± 16%     -64.7%      65.00 ± 23%  slabinfo.nfs_commit_data.active_objs
    184.25 ± 16%     -64.7%      65.00 ± 23%  slabinfo.nfs_commit_data.num_objs
      9279 ±  3%     -31.3%       6376 ±  3%  slabinfo.proc_inode_cache.active_objs
      9674 ±  2%     -30.8%       6694 ±  2%  slabinfo.proc_inode_cache.num_objs
     81516 ±  9%     -47.7%      42665 ±  7%  slabinfo.radix_tree_node.active_slabs
     81516 ±  9%     -47.7%      42665 ±  7%  slabinfo.radix_tree_node.num_slabs
  40361834 ±  8%     +25.1%   50511172 ±  4%  proc-vmstat.allocstall
  22880785 ± 25%    -100.0%       0.00 ± -1%  proc-vmstat.compact_free_scanned
     99071 ± 22%    -100.0%       0.00 ± -1%  proc-vmstat.compact_isolated
    246347 ± 29%    -100.0%       0.00 ± -1%  proc-vmstat.compact_migrate_scanned
    391095 ± 12%    +896.3%    3896431 ±  3%  proc-vmstat.kswapd_high_wmark_hit_quickly
     34910 ± 30%     -65.1%      12168 ± 12%  proc-vmstat.kswapd_low_wmark_hit_quickly
    106660 ±  2%     -19.6%      85755 ± 12%  proc-vmstat.nr_active_anon
    193.25 ± 15%     -46.7%     103.00 ± 18%  proc-vmstat.nr_isolated_file
    816349 ±  4%     -25.8%     605667 ±  7%  proc-vmstat.nr_page_table_pages
      7441 ± 38%     -91.5%     634.00 ±112%  proc-vmstat.nr_pages_scanned
    119186 ±  1%     -17.7%      98074 ± 11%  proc-vmstat.nr_shmem
 1.995e+08 ± 17%     -46.3%  1.072e+08 ± 10%  proc-vmstat.numa_foreign
     10329 ±  4%     +26.8%      13096 ± 12%  proc-vmstat.numa_hint_faults
      8516 ±  3%     +27.5%      10854 ± 16%  proc-vmstat.numa_hint_faults_local
 5.951e+08 ±  3%     -23.1%  4.573e+08 ± 11%  proc-vmstat.numa_hit
 5.951e+08 ±  3%     -23.1%  4.573e+08 ± 11%  proc-vmstat.numa_local
 1.995e+08 ± 17%     -46.3%  1.072e+08 ± 10%  proc-vmstat.numa_miss
 1.995e+08 ± 17%     -46.3%  1.072e+08 ± 10%  proc-vmstat.numa_other
    443443 ± 13%    +796.6%    3975774 ±  3%  proc-vmstat.pageoutrun
 7.946e+08 ±  6%     -29.0%  5.645e+08 ± 11%  proc-vmstat.pgalloc_normal
 7.944e+08 ±  6%     -28.9%  5.645e+08 ± 11%  proc-vmstat.pgfree
 1.276e+09 ±  7%     -16.3%  1.069e+09 ± 11%  proc-vmstat.pgscan_direct
     36.00 ± 68%   +2734.7%       1020 ± 10%  proc-vmstat.pgscan_direct_throttle
 2.547e+08 ±  2%    -100.0%       0.00 ± -1%  proc-vmstat.pgscan_kswapd
 6.613e+08 ±  9%     -19.9%  5.297e+08 ± 11%  proc-vmstat.pgsteal_direct
 1.001e+08 ± 14%    -100.0%       0.00 ± -1%  proc-vmstat.pgsteal_kswapd
  10440768 ±  8%     -38.8%    6394742 ± 16%  proc-vmstat.slabs_scanned
   5047407 ±  6%     -32.7%    3394455 ± 20%  proc-vmstat.workingset_nodereclaim
      2373 ± 23%     +43.2%       3399 ± 12%  proc-vmstat.workingset_refault
      0.88 ± 23%     -99.6%       0.00 ±141%  perf-profile.cycles-pp.___slab_alloc.__slab_alloc.kmem_cache_alloc.__radix_tree_preload.radix_tree_maybe_preload
      1.33 ± 22%     -93.4%       0.09 ± 61%  perf-profile.cycles-pp.__add_to_page_cache_locked.add_to_page_cache_lru.mpage_readpages.xfs_vm_readpages.__do_page_cache_readahead
     18.84 ± 18%     -78.8%       3.99 ± 64%  perf-profile.cycles-pp.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.__do_page_cache_readahead.ondemand_readahead
     27.73 ± 47%    +172.6%      75.61 ±  9%  perf-profile.cycles-pp.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.filemap_fault.xfs_filemap_fault
     24.23 ± 27%     -83.8%       3.92 ± 58%  perf-profile.cycles-pp.__alloc_pages_nodemask.alloc_pages_current.pte_alloc_one.__pte_alloc.handle_mm_fault
     16.23 ± 12%     -76.0%       3.90 ± 63%  perf-profile.cycles-pp.__alloc_pages_slowpath.constprop.89.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.__do_page_cache_readahead
     26.38 ± 49%    +183.2%      74.72 ± 10%  perf-profile.cycles-pp.__alloc_pages_slowpath.constprop.89.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.filemap_fault
     24.33 ± 26%     -83.6%       4.00 ± 57%  perf-profile.cycles-pp.__alloc_pages_slowpath.constprop.89.__alloc_pages_nodemask.alloc_pages_current.pte_alloc_one.__pte_alloc
     68.45 ±  8%     +26.4%      86.53 ±  3%  perf-profile.cycles-pp.__do_fault.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
     32.39 ± 26%     -84.6%       5.00 ± 64%  perf-profile.cycles-pp.__do_page_cache_readahead.ondemand_readahead.page_cache_async_readahead.filemap_fault.xfs_filemap_fault
      4.65 ±  6%     -50.6%       2.30 ± 23%  perf-profile.cycles-pp.__lru_cache_add.lru_cache_add.add_to_page_cache_lru.filemap_fault.xfs_filemap_fault
      7.99 ± 47%     -96.2%       0.30 ± 68%  perf-profile.cycles-pp.__lru_cache_add.lru_cache_add.add_to_page_cache_lru.mpage_readpages.xfs_vm_readpages
     18.91 ± 18%     -78.8%       4.00 ± 64%  perf-profile.cycles-pp.__page_cache_alloc.__do_page_cache_readahead.ondemand_readahead.page_cache_async_readahead.filemap_fault
     27.80 ± 47%    +172.2%      75.69 ±  9%  perf-profile.cycles-pp.__page_cache_alloc.filemap_fault.xfs_filemap_fault.__do_fault.handle_mm_fault
     24.52 ± 25%     -75.9%       5.90 ± 35%  perf-profile.cycles-pp.__pte_alloc.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
      0.85 ± 25%     -99.6%       0.00 ±141%  perf-profile.cycles-pp.__radix_tree_preload.radix_tree_maybe_preload.__add_to_page_cache_locked.add_to_page_cache_lru.mpage_readpages
      1.32 ±  2%     -60.2%       0.53 ± 40%  perf-profile.cycles-pp.__remove_mapping.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_node
      0.88 ± 23%     -99.6%       0.00 ±141%  perf-profile.cycles-pp.__slab_alloc.kmem_cache_alloc.__radix_tree_preload.radix_tree_maybe_preload.__add_to_page_cache_locked
      0.00 ± -1%      +Inf%       1.00 ± 19%  perf-profile.cycles-pp.__wake_up.wakeup_kswapd.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current
      6.57 ± 47%     -61.8%       2.51 ± 27%  perf-profile.cycles-pp._raw_spin_lock.free_pcppages_bulk.drain_pages_zone.drain_pages.drain_local_pages
      1.47 ± 10%     -81.9%       0.27 ± 53%  perf-profile.cycles-pp._raw_spin_lock.free_pcppages_bulk.free_hot_cold_page.free_hot_cold_page_list.shrink_page_list
      2.96 ± 51%     -89.8%       0.30 ± 50%  perf-profile.cycles-pp._raw_spin_lock.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc
      7.79 ± 21%     -53.4%       3.64 ± 13%  perf-profile.cycles-pp._raw_spin_lock.get_page_from_freelist.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current
      0.05 ±173%   +2295.2%       1.26 ± 21%  perf-profile.cycles-pp._raw_spin_lock.vmpressure.vmpressure_prio.do_try_to_free_pages.try_to_free_pages
     24.26 ± 49%    +147.7%      60.09 ±  5%  perf-profile.cycles-pp._raw_spin_lock_irq.mem_cgroup_soft_limit_reclaim.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
      0.11 ± 52%   +1034.1%       1.25 ±  4%  perf-profile.cycles-pp._raw_spin_lock_irq.mem_cgroup_soft_limit_reclaim.kswapd.kthread.ret_from_fork
     10.22 ± 28%     -84.2%       1.61 ± 57%  perf-profile.cycles-pp._raw_spin_lock_irq.shrink_inactive_list.shrink_zone_memcg.shrink_node.do_try_to_free_pages
      0.00 ± -1%      +Inf%       1.01 ± 11%  perf-profile.cycles-pp._raw_spin_lock_irqsave.__wake_up.wakeup_kswapd.__alloc_pages_slowpath.__alloc_pages_nodemask
     11.10 ± 28%     -79.8%       2.24 ± 32%  perf-profile.cycles-pp._raw_spin_lock_irqsave.pagevec_lru_move_fn.__lru_cache_add.lru_cache_add.add_to_page_cache_lru
      5.06 ±  7%     -48.5%       2.60 ± 26%  perf-profile.cycles-pp.add_to_page_cache_lru.filemap_fault.xfs_filemap_fault.__do_fault.handle_mm_fault
      9.43 ± 43%     -95.6%       0.41 ± 69%  perf-profile.cycles-pp.add_to_page_cache_lru.mpage_readpages.xfs_vm_readpages.__do_page_cache_readahead.ondemand_readahead
     18.91 ± 18%     -78.9%       4.00 ± 64%  perf-profile.cycles-pp.alloc_pages_current.__page_cache_alloc.__do_page_cache_readahead.ondemand_readahead.page_cache_async_readahead
     27.77 ± 47%    +172.5%      75.68 ±  9%  perf-profile.cycles-pp.alloc_pages_current.__page_cache_alloc.filemap_fault.xfs_filemap_fault.__do_fault
     24.21 ± 27%     -83.8%       3.92 ± 58%  perf-profile.cycles-pp.alloc_pages_current.pte_alloc_one.__pte_alloc.handle_mm_fault.__do_page_fault
      0.91 ± 71%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.call_function_interrupt.pagevec_lru_move_fn.__lru_cache_add.lru_cache_add.add_to_page_cache_lru
      1.29 ± 72%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.call_function_interrupt.shrink_zone_memcg.shrink_node.do_try_to_free_pages.try_to_free_pages
      3.66 ± 18%     -85.3%       0.54 ± 66%  perf-profile.cycles-pp.do_mpage_readpage.mpage_readpages.xfs_vm_readpages.__do_page_cache_readahead.ondemand_readahead
     57.73 ± 11%     +34.1%      77.44 ±  2%  perf-profile.cycles-pp.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current
      6.80 ± 47%     -61.4%       2.62 ± 28%  perf-profile.cycles-pp.drain_local_pages.flush_smp_call_function_queue.generic_smp_call_function_single_interrupt.smp_call_function_interrupt.call_function_interrupt
      6.80 ± 47%     -61.4%       2.62 ± 28%  perf-profile.cycles-pp.drain_pages.drain_local_pages.flush_smp_call_function_queue.generic_smp_call_function_single_interrupt.smp_call_function_interrupt
      6.80 ± 47%     -61.6%       2.61 ± 29%  perf-profile.cycles-pp.drain_pages_zone.drain_pages.drain_local_pages.flush_smp_call_function_queue.generic_smp_call_function_single_interrupt
     68.34 ±  8%     +26.4%      86.41 ±  3%  perf-profile.cycles-pp.filemap_fault.xfs_filemap_fault.__do_fault.handle_mm_fault.__do_page_fault
      0.99 ± 10%     -28.5%       0.71 ±  2%  perf-profile.cycles-pp.filemap_map_pages.handle_mm_fault.__do_page_fault.do_page_fault.page_fault
      0.94 ± 71%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.flush_smp_call_function_queue.generic_smp_call_function_single_interrupt.smp_call_function_interrupt.call_function_interrupt.pagevec_lru_move_fn
      1.36 ± 71%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.flush_smp_call_function_queue.generic_smp_call_function_single_interrupt.smp_call_function_interrupt.call_function_interrupt.shrink_zone_memcg
      2.20 ± 10%     -73.6%       0.58 ± 43%  perf-profile.cycles-pp.free_hot_cold_page.free_hot_cold_page_list.shrink_page_list.shrink_inactive_list.shrink_zone_memcg
      2.52 ±  5%     -74.2%       0.65 ± 40%  perf-profile.cycles-pp.free_hot_cold_page_list.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_node
      6.78 ± 47%     -61.3%       2.62 ± 28%  perf-profile.cycles-pp.free_pcppages_bulk.drain_pages_zone.drain_pages.drain_local_pages.flush_smp_call_function_queue
      1.91 ± 11%     -72.0%       0.53 ± 37%  perf-profile.cycles-pp.free_pcppages_bulk.free_hot_cold_page.free_hot_cold_page_list.shrink_page_list.shrink_inactive_list
      0.92 ± 71%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.generic_smp_call_function_single_interrupt.smp_call_function_interrupt.call_function_interrupt.pagevec_lru_move_fn.__lru_cache_add
      1.36 ± 71%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.generic_smp_call_function_single_interrupt.smp_call_function_interrupt.call_function_interrupt.shrink_zone_memcg.shrink_node
      2.73 ± 54%     -95.5%       0.12 ± 69%  perf-profile.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.__do_page_cache_readahead
      1.23 ±  6%     -40.0%       0.73 ± 19%  perf-profile.cycles-pp.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc.filemap_fault
      8.78 ± 17%     -49.8%       4.41 ± 10%  perf-profile.cycles-pp.get_page_from_freelist.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc
      1.03 ± 11%     -51.8%       0.49 ± 47%  perf-profile.cycles-pp.isolate_lru_pages.isra.53.shrink_inactive_list.shrink_zone_memcg.shrink_node.do_try_to_free_pages
      0.89 ± 23%     -99.6%       0.00 ±141%  perf-profile.cycles-pp.kmem_cache_alloc.__radix_tree_preload.radix_tree_maybe_preload.__add_to_page_cache_locked.add_to_page_cache_lru
      2.81 ±  3%     +17.6%       3.31 ±  7%  perf-profile.cycles-pp.kswapd.kthread.ret_from_fork
      4.65 ±  6%     -50.6%       2.30 ± 23%  perf-profile.cycles-pp.lru_cache_add.add_to_page_cache_lru.filemap_fault.xfs_filemap_fault.__do_fault
      7.99 ± 47%     -96.2%       0.30 ± 68%  perf-profile.cycles-pp.lru_cache_add.add_to_page_cache_lru.mpage_readpages.xfs_vm_readpages.__do_page_cache_readahead
      2.00 ± 29%     +63.3%       3.27 ±  6%  perf-profile.cycles-pp.mem_cgroup_iter.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
     24.44 ± 49%    +146.9%      60.34 ±  5%  perf-profile.cycles-pp.mem_cgroup_soft_limit_reclaim.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
      0.12 ± 46%    +989.1%       1.25 ±  4%  perf-profile.cycles-pp.mem_cgroup_soft_limit_reclaim.kswapd.kthread.ret_from_fork
     13.27 ± 36%     -92.8%       0.96 ± 67%  perf-profile.cycles-pp.mpage_readpages.xfs_vm_readpages.__do_page_cache_readahead.ondemand_readahead.page_cache_async_readahead
      6.56 ± 47%     -62.0%       2.50 ± 27%  perf-profile.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_pcppages_bulk.drain_pages_zone.drain_pages
      1.45 ± 10%     -83.4%       0.24 ± 56%  perf-profile.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.free_pcppages_bulk.free_hot_cold_page.free_hot_cold_page_list
      3.08 ± 51%     -89.8%       0.31 ± 51%  perf-profile.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.get_page_from_freelist.__alloc_pages_nodemask.alloc_pages_current
      7.79 ± 21%     -53.5%       3.63 ± 13%  perf-profile.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.get_page_from_freelist.__alloc_pages_slowpath.__alloc_pages_nodemask
      0.00 ± -1%      +Inf%       1.14 ± 22%  perf-profile.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock.vmpressure.vmpressure_prio.do_try_to_free_pages
     23.60 ± 50%    +150.0%      59.00 ±  5%  perf-profile.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.mem_cgroup_soft_limit_reclaim.do_try_to_free_pages.try_to_free_pages
      0.11 ± 52%   +1023.3%       1.21 ±  4%  perf-profile.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.mem_cgroup_soft_limit_reclaim.kswapd.kthread
     10.92 ± 27%     -85.4%       1.60 ± 57%  perf-profile.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irq.shrink_inactive_list.shrink_zone_memcg.shrink_node
     11.04 ± 28%     -91.8%       0.90 ±134%  perf-profile.cycles-pp.native_queued_spin_lock_slowpath._raw_spin_lock_irqsave.pagevec_lru_move_fn.__lru_cache_add.lru_cache_add
      0.88 ± 23%     -99.6%       0.00 ±141%  perf-profile.cycles-pp.new_slab.___slab_alloc.__slab_alloc.kmem_cache_alloc.__radix_tree_preload
     32.41 ± 26%     -84.6%       4.99 ± 64%  perf-profile.cycles-pp.ondemand_readahead.page_cache_async_readahead.filemap_fault.xfs_filemap_fault.__do_fault
     32.42 ± 26%     -84.6%       4.99 ± 64%  perf-profile.cycles-pp.page_cache_async_readahead.filemap_fault.xfs_filemap_fault.__do_fault.handle_mm_fault
      1.89 ±  5%     -58.7%       0.78 ± 46%  perf-profile.cycles-pp.page_referenced.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_node
      4.62 ±  6%     -50.6%       2.28 ± 23%  perf-profile.cycles-pp.pagevec_lru_move_fn.__lru_cache_add.lru_cache_add.add_to_page_cache_lru.filemap_fault
      7.95 ± 47%     -96.3%       0.29 ± 69%  perf-profile.cycles-pp.pagevec_lru_move_fn.__lru_cache_add.lru_cache_add.add_to_page_cache_lru.mpage_readpages
     24.52 ± 25%     -75.9%       5.90 ± 35%  perf-profile.cycles-pp.pte_alloc_one.__pte_alloc.handle_mm_fault.__do_page_fault.do_page_fault
      0.86 ± 25%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.radix_tree_maybe_preload.__add_to_page_cache_locked.add_to_page_cache_lru.mpage_readpages.xfs_vm_readpages
      1.67 ±  3%     -50.2%       0.83 ± 34%  perf-profile.cycles-pp.rmap_walk.page_referenced.shrink_page_list.shrink_inactive_list.shrink_zone_memcg
      1.42 ±  0%     -43.1%       0.81 ± 19%  perf-profile.cycles-pp.rmap_walk.try_to_unmap.shrink_page_list.shrink_inactive_list.shrink_zone_memcg
     24.99 ± 21%     -68.9%       7.78 ± 34%  perf-profile.cycles-pp.shrink_inactive_list.shrink_zone_memcg.shrink_node.do_try_to_free_pages.try_to_free_pages
      2.25 ±  3%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.shrink_inactive_list.shrink_zone_memcg.shrink_node.kswapd.kthread
     30.41 ± 17%     -54.6%      13.81 ± 16%  perf-profile.cycles-pp.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
      2.57 ±  1%     -50.5%       1.27 ± 10%  perf-profile.cycles-pp.shrink_node.kswapd.kthread.ret_from_fork
     12.95 ± 19%     -61.5%       4.98 ± 26%  perf-profile.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_node.do_try_to_free_pages
      1.28 ± 10%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_node.kswapd
      0.21 ± 10%    +385.7%       1.02 ± 10%  perf-profile.cycles-pp.shrink_slab.part.45.shrink_node.kswapd.kthread.ret_from_fork
     27.44 ± 21%     -66.6%       9.16 ± 28%  perf-profile.cycles-pp.shrink_zone_memcg.shrink_node.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
      2.32 ±  1%     -97.2%       0.07 ± 13%  perf-profile.cycles-pp.shrink_zone_memcg.shrink_node.kswapd.kthread.ret_from_fork
      0.91 ± 71%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.smp_call_function_interrupt.call_function_interrupt.pagevec_lru_move_fn.__lru_cache_add.lru_cache_add
      1.29 ± 72%    -100.0%       0.00 ± -1%  perf-profile.cycles-pp.smp_call_function_interrupt.call_function_interrupt.shrink_zone_memcg.shrink_node.do_try_to_free_pages
      5.56 ± 38%     -76.8%       1.29 ± 19%  perf-profile.cycles-pp.smp_call_function_many.try_to_unmap_flush.shrink_page_list.shrink_inactive_list.shrink_zone_memcg
     31.63 ± 40%    +122.8%      70.45 ±  6%  perf-profile.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc
     24.14 ± 26%     -83.4%       4.01 ± 57%  perf-profile.cycles-pp.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.pte_alloc_one
      1.42 ±  2%     -44.3%       0.79 ± 25%  perf-profile.cycles-pp.try_to_unmap.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_node
      5.85 ± 38%     -76.3%       1.39 ± 18%  perf-profile.cycles-pp.try_to_unmap_flush.shrink_page_list.shrink_inactive_list.shrink_zone_memcg.shrink_node
      0.96 ±  7%     -59.7%       0.39 ± 33%  perf-profile.cycles-pp.try_to_unmap_one.rmap_walk.try_to_unmap.shrink_page_list.shrink_inactive_list
      0.29 ± 62%    +381.6%       1.37 ± 20%  perf-profile.cycles-pp.vmpressure.vmpressure_prio.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath
      0.30 ± 60%    +367.2%       1.39 ± 17%  perf-profile.cycles-pp.vmpressure_prio.do_try_to_free_pages.try_to_free_pages.__alloc_pages_slowpath.__alloc_pages_nodemask
      0.09 ± 59%   +1700.0%       1.53 ± 12%  perf-profile.cycles-pp.wakeup_kswapd.__alloc_pages_slowpath.__alloc_pages_nodemask.alloc_pages_current.__page_cache_alloc
     68.44 ±  8%     +26.4%      86.51 ±  3%  perf-profile.cycles-pp.xfs_filemap_fault.__do_fault.handle_mm_fault.__do_page_fault.do_page_fault
     13.28 ± 36%     -92.8%       0.96 ± 67%  perf-profile.cycles-pp.xfs_vm_readpages.__do_page_cache_readahead.ondemand_readahead.page_cache_async_readahead.filemap_fault
    108.50 ±129%     -92.2%       8.50 ± 10%  sched_debug.cfs_rq:/.load.35
     15.50 ± 26%     -40.3%       9.25 ± 23%  sched_debug.cfs_rq:/.load.5
     29.02 ±  4%     +24.6%      36.15 ±  3%  sched_debug.cfs_rq:/.load.avg
    762.38 ±  8%     +11.0%     845.92 ±  4%  sched_debug.cfs_rq:/.load.max
    114.31 ±  2%     +25.0%     142.89 ±  3%  sched_debug.cfs_rq:/.load.stddev
     98.75 ± 81%     -91.1%       8.75 ±  4%  sched_debug.cfs_rq:/.load_avg.20
     98.25 ±142%     -87.0%      12.75 ± 16%  sched_debug.cfs_rq:/.load_avg.35
     97.75 ± 81%     -88.5%      11.25 ± 14%  sched_debug.cfs_rq:/.load_avg.4
     23.75 ± 55%     -58.9%       9.75 ±  4%  sched_debug.cfs_rq:/.load_avg.40
     25.00 ± 28%     -68.0%       8.00 ±  0%  sched_debug.cfs_rq:/.load_avg.54
    105.00 ±131%     -90.7%       9.75 ± 25%  sched_debug.cfs_rq:/.load_avg.63
     21.25 ± 52%     -55.3%       9.50 ± 27%  sched_debug.cfs_rq:/.load_avg.64
     37.27 ±  6%      +9.9%      40.97 ±  4%  sched_debug.cfs_rq:/.load_avg.avg
    130.36 ±  6%     +17.7%     153.48 ±  6%  sched_debug.cfs_rq:/.load_avg.stddev
  11057974 ±  0%     -17.4%    9132164 ± 15%  sched_debug.cfs_rq:/.min_vruntime.10
  11299584 ±  0%     -26.8%    8266403 ± 26%  sched_debug.cfs_rq:/.min_vruntime.46
      1.25 ±131%   +1900.0%      25.00 ±126%  sched_debug.cfs_rq:/.nr_spread_over.34
      0.00 ±  0%      +Inf%      45.00 ±116%  sched_debug.cfs_rq:/.nr_spread_over.46
     10.75 ± 12%     -23.3%       8.25 ±  5%  sched_debug.cfs_rq:/.runnable_load_avg.23
     52.75 ±128%     -83.4%       8.75 ±  9%  sched_debug.cfs_rq:/.runnable_load_avg.4
     12.00 ± 17%     -35.4%       7.75 ±  5%  sched_debug.cfs_rq:/.runnable_load_avg.54
     52.75 ±136%     -84.8%       8.00 ± 17%  sched_debug.cfs_rq:/.runnable_load_avg.62
     92.50 ±154%     -91.4%       8.00 ±  0%  sched_debug.cfs_rq:/.runnable_load_avg.63
     27.47 ±  3%     +18.1%      32.45 ±  8%  sched_debug.cfs_rq:/.runnable_load_avg.avg
     47063 ±234%   -4172.4%   -1916598 ±-70%  sched_debug.cfs_rq:/.spread0.10
    124719 ±153%   -1456.9%   -1692374 ±-158%  sched_debug.cfs_rq:/.spread0.13
   -204689 ±-113%    -151.2%     104824 ± 69%  sched_debug.cfs_rq:/.spread0.22
     14333 ±1307%   +1312.1%     202407 ± 48%  sched_debug.cfs_rq:/.spread0.23
   -134666 ±-108%    -238.6%     186606 ± 54%  sched_debug.cfs_rq:/.spread0.24
  -1118648 ±-159%    -121.6%     241345 ± 47%  sched_debug.cfs_rq:/.spread0.30
    -25248 ±-177%   +7559.7%   -1933975 ±-139%  sched_debug.cfs_rq:/.spread0.34
    342215 ± 55%    -123.1%     -79023 ±-367%  sched_debug.cfs_rq:/.spread0.43
    281351 ± 66%   -1090.5%   -2786704 ±-75%  sched_debug.cfs_rq:/.spread0.46
   -356882 ±-233%    -179.1%     282353 ± 28%  sched_debug.cfs_rq:/.spread0.54
    146463 ± 33%    -598.6%    -730203 ±-168%  sched_debug.cfs_rq:/.spread0.70
    778.25 ±  9%     -13.0%     677.00 ±  1%  sched_debug.cfs_rq:/.util_avg.0
    828.25 ±  8%     -16.3%     693.50 ±  9%  sched_debug.cfs_rq:/.util_avg.1
    811.00 ±  7%     -13.7%     700.25 ±  3%  sched_debug.cfs_rq:/.util_avg.10
    772.00 ±  9%     -13.3%     669.25 ±  3%  sched_debug.cfs_rq:/.util_avg.13
    771.00 ± 10%     -10.1%     692.75 ±  2%  sched_debug.cfs_rq:/.util_avg.21
    813.00 ±  5%     -15.6%     686.50 ±  1%  sched_debug.cfs_rq:/.util_avg.25
    781.00 ± 11%     -13.2%     678.00 ±  0%  sched_debug.cfs_rq:/.util_avg.35
    884.50 ± 10%     -23.1%     679.75 ±  0%  sched_debug.cfs_rq:/.util_avg.4
    780.25 ±  9%     -12.9%     679.50 ±  0%  sched_debug.cfs_rq:/.util_avg.40
    763.25 ±  8%     -12.0%     671.50 ±  1%  sched_debug.cfs_rq:/.util_avg.42
    764.75 ±  6%      -9.4%     692.75 ±  3%  sched_debug.cfs_rq:/.util_avg.44
    770.75 ± 10%     -11.7%     680.50 ±  0%  sched_debug.cfs_rq:/.util_avg.45
    781.00 ±  8%     -12.9%     680.00 ±  0%  sched_debug.cfs_rq:/.util_avg.46
    802.75 ±  4%     -13.9%     691.50 ±  1%  sched_debug.cfs_rq:/.util_avg.53
    808.50 ±  9%     -16.2%     677.25 ±  0%  sched_debug.cfs_rq:/.util_avg.54
    819.50 ± 10%     -22.0%     639.00 ±  9%  sched_debug.cfs_rq:/.util_avg.62
    762.50 ± 10%     -11.0%     679.00 ±  0%  sched_debug.cfs_rq:/.util_avg.68
    772.00 ± 10%     -11.3%     684.50 ±  3%  sched_debug.cfs_rq:/.util_avg.70
    763.75 ± 10%     -11.4%     676.50 ±  0%  sched_debug.cfs_rq:/.util_avg.71
    772.50 ± 10%     -10.1%     694.25 ±  3%  sched_debug.cfs_rq:/.util_avg.9
    915949 ±  4%     -28.6%     653920 ± 33%  sched_debug.cpu.avg_idle.19
    946762 ±  3%     -35.3%     612888 ± 13%  sched_debug.cpu.avg_idle.20
   1285759 ± 42%     -51.3%     626701 ± 14%  sched_debug.cpu.avg_idle.23
    953325 ±  5%     -30.7%     660871 ± 13%  sched_debug.cpu.avg_idle.29
    957657 ±  1%     -30.6%     664474 ± 25%  sched_debug.cpu.avg_idle.30
   1896042 ± 91%     -66.2%     641472 ± 16%  sched_debug.cpu.avg_idle.31
    961262 ±  4%     -30.5%     668351 ± 24%  sched_debug.cpu.avg_idle.33
    987474 ±  1%     -17.9%     810690 ± 15%  sched_debug.cpu.avg_idle.34
    942078 ±  5%     -21.3%     741238 ± 10%  sched_debug.cpu.avg_idle.35
    891666 ± 11%     -30.5%     620080 ± 10%  sched_debug.cpu.avg_idle.55
    947867 ±  2%     -29.4%     669528 ± 14%  sched_debug.cpu.avg_idle.56
    968395 ±  1%     -34.8%     631497 ± 36%  sched_debug.cpu.avg_idle.58
    965380 ±  3%     -32.5%     651434 ± 23%  sched_debug.cpu.avg_idle.59
    938254 ±  4%     -35.0%     609908 ± 13%  sched_debug.cpu.avg_idle.60
    943098 ±  7%     -33.0%     631792 ± 20%  sched_debug.cpu.avg_idle.61
    962675 ±  2%     -31.9%     655593 ± 15%  sched_debug.cpu.avg_idle.62
    919345 ±  8%     -40.5%     546855 ± 21%  sched_debug.cpu.avg_idle.63
    971231 ±  2%     -37.5%     607096 ± 24%  sched_debug.cpu.avg_idle.64
    965548 ±  3%     -32.4%     653130 ± 16%  sched_debug.cpu.avg_idle.65
    910816 ± 15%     -32.9%     611123 ±  7%  sched_debug.cpu.avg_idle.66
    916841 ±  8%     -35.9%     588047 ± 27%  sched_debug.cpu.avg_idle.67
    951406 ±  2%     -39.9%     571448 ± 25%  sched_debug.cpu.avg_idle.68
    917218 ±  5%     -32.0%     623827 ± 21%  sched_debug.cpu.avg_idle.69
    968216 ±  1%     -34.1%     637949 ±  9%  sched_debug.cpu.avg_idle.71
   1073266 ± 19%     -21.3%     844924 ±  5%  sched_debug.cpu.avg_idle.avg
    495329 ± 10%     -62.7%     184682 ± 32%  sched_debug.cpu.avg_idle.min
     52.50 ±129%     -83.3%       8.75 ±  9%  sched_debug.cpu.cpu_load[0].4
     12.25 ± 17%     -36.7%       7.75 ±  5%  sched_debug.cpu.cpu_load[0].54
     52.75 ±136%     -83.9%       8.50 ± 10%  sched_debug.cpu.cpu_load[0].62
     92.50 ±154%     -91.4%       8.00 ±  0%  sched_debug.cpu.cpu_load[0].63
     52.25 ±129%     -83.3%       8.75 ±  9%  sched_debug.cpu.cpu_load[1].4
     12.00 ± 18%     -35.4%       7.75 ±  5%  sched_debug.cpu.cpu_load[1].54
     52.75 ±136%     -83.9%       8.50 ± 10%  sched_debug.cpu.cpu_load[1].62
     92.75 ±154%     -91.4%       8.00 ±  0%  sched_debug.cpu.cpu_load[1].63
     28.77 ±  1%     +12.9%      32.48 ±  6%  sched_debug.cpu.cpu_load[1].avg
     51.25 ±128%     -82.9%       8.75 ±  9%  sched_debug.cpu.cpu_load[2].4
     12.00 ± 18%     -35.4%       7.75 ±  5%  sched_debug.cpu.cpu_load[2].54
     52.75 ±136%     -83.9%       8.50 ± 10%  sched_debug.cpu.cpu_load[2].62
     92.75 ±154%     -91.4%       8.00 ±  0%  sched_debug.cpu.cpu_load[2].63
     28.28 ±  1%     +13.7%      32.14 ±  6%  sched_debug.cpu.cpu_load[2].avg
     51.00 ±128%     -82.8%       8.75 ±  9%  sched_debug.cpu.cpu_load[3].4
     12.00 ± 18%     -35.4%       7.75 ±  5%  sched_debug.cpu.cpu_load[3].54
     92.75 ±154%     -91.4%       8.00 ±  0%  sched_debug.cpu.cpu_load[3].63
     28.20 ±  0%     +12.3%      31.68 ±  6%  sched_debug.cpu.cpu_load[3].avg
     51.50 ±128%     -83.0%       8.75 ±  9%  sched_debug.cpu.cpu_load[4].4
     12.00 ± 18%     -35.4%       7.75 ±  5%  sched_debug.cpu.cpu_load[4].54
     92.75 ±154%     -91.4%       8.00 ±  0%  sched_debug.cpu.cpu_load[4].63
      1520 ± 17%     -21.2%       1197 ± 10%  sched_debug.cpu.curr->pid.11
      1638 ± 17%     -23.7%       1249 ±  2%  sched_debug.cpu.curr->pid.20
      1416 ±  8%      -9.8%       1277 ±  0%  sched_debug.cpu.curr->pid.22
      1489 ±  8%     -14.8%       1270 ±  2%  sched_debug.cpu.curr->pid.23
      1689 ± 14%     -26.0%       1249 ±  3%  sched_debug.cpu.curr->pid.31
      1488 ±  8%     -19.8%       1193 ±  8%  sched_debug.cpu.curr->pid.46
      1618 ±  6%     -21.4%       1273 ±  2%  sched_debug.cpu.curr->pid.5
      1553 ±  2%     -23.5%       1188 ±  8%  sched_debug.cpu.curr->pid.52
      1374 ± 12%     -13.6%       1187 ± 16%  sched_debug.cpu.curr->pid.55
      1615 ± 13%     -25.5%       1203 ±  3%  sched_debug.cpu.curr->pid.6
      1707 ± 26%     -29.9%       1197 ±  9%  sched_debug.cpu.curr->pid.70
      1985 ± 33%     -37.6%       1238 ±  1%  sched_debug.cpu.curr->pid.8
      1514 ±  3%     -16.8%       1259 ±  0%  sched_debug.cpu.curr->pid.9
      1467 ±  7%     -10.4%       1314 ±  1%  sched_debug.cpu.curr->pid.avg
    137.25 ±160%     -93.8%       8.50 ± 10%  sched_debug.cpu.load.14
    108.50 ±129%     -92.2%       8.50 ± 10%  sched_debug.cpu.load.35
     15.50 ± 26%     -40.3%       9.25 ± 23%  sched_debug.cpu.load.5
     29.67 ±  4%     +21.7%      36.10 ±  3%  sched_debug.cpu.load.avg
    762.92 ±  8%     +10.9%     845.88 ±  4%  sched_debug.cpu.load.max
    116.42 ±  0%     +22.7%     142.85 ±  3%  sched_debug.cpu.load.stddev
      4935 ± 46%    +574.9%      33310 ± 70%  sched_debug.cpu.nr_switches.10
      5147 ± 20%    +323.8%      21814 ± 45%  sched_debug.cpu.nr_switches.13
     19240 ± 25%     -79.9%       3873 ± 26%  sched_debug.cpu.nr_switches.31
     15958 ± 63%     -70.4%       4728 ± 13%  sched_debug.cpu.nr_switches.34
      1996 ±  9%    +795.5%      17873 ±135%  sched_debug.cpu.nr_switches.43
      1894 ± 26%    +900.0%      18942 ± 78%  sched_debug.cpu.nr_switches.48
     -6.25 ±-32%    -120.0%       1.25 ±198%  sched_debug.cpu.nr_uninterruptible.16
     -2.25 ±-79%    -133.3%       0.75 ±110%  sched_debug.cpu.nr_uninterruptible.2
      1.25 ±273%    -840.0%      -9.25 ±-30%  sched_debug.cpu.nr_uninterruptible.28
      0.50 ±223%   -1033.3%      -4.67 ±-61%  sched_debug.cpu.nr_uninterruptible.31
      0.00 ±  1%      +Inf%       5.50 ± 48%  sched_debug.cpu.nr_uninterruptible.41
      6.75 ± 56%     -90.1%       0.67 ±141%  sched_debug.cpu.nr_uninterruptible.52
      0.75 ±256%    +600.0%       5.25 ± 45%  sched_debug.cpu.nr_uninterruptible.54
      1.00 ±122%    +275.0%       3.75 ± 34%  sched_debug.cpu.nr_uninterruptible.56
      1.50 ±166%     +33.3%       2.00 ± 35%  sched_debug.cpu.nr_uninterruptible.61
      0.00 ±  1%      +Inf%       1.50 ±218%  sched_debug.cpu.nr_uninterruptible.69
     11809 ± 84%    +294.5%      46581 ± 68%  sched_debug.cpu.sched_count.10
      6201 ± 20%    +268.0%      22818 ± 43%  sched_debug.cpu.sched_count.13
     15343 ± 61%     -53.2%       7181 ± 51%  sched_debug.cpu.sched_count.14
     20306 ± 23%     -75.4%       5004 ± 22%  sched_debug.cpu.sched_count.31
     17210 ± 57%     -61.9%       6558 ± 12%  sched_debug.cpu.sched_count.34
     38498 ± 55%     -80.8%       7373 ± 18%  sched_debug.cpu.sched_count.4
      2732 ±  9%    +819.1%      25117 ± 91%  sched_debug.cpu.sched_count.43
      5544 ± 95%    +379.5%      26588 ± 44%  sched_debug.cpu.sched_count.48
      5047 ± 42%    +205.1%      15399 ± 96%  sched_debug.cpu.sched_count.61
      2009 ±  2%     +25.7%       2524 ± 19%  sched_debug.cpu.sched_count.min
      1278 ± 18%     +26.6%       1617 ±  4%  sched_debug.cpu.sched_goidle.0
    298.25 ± 12%    +298.1%       1187 ± 43%  sched_debug.cpu.sched_goidle.10
    560.25 ± 42%     +90.9%       1069 ± 47%  sched_debug.cpu.sched_goidle.29
    441.75 ± 32%     +91.4%     845.50 ± 44%  sched_debug.cpu.sched_goidle.31
    308.25 ± 75%    +194.6%     908.00 ± 74%  sched_debug.cpu.sched_goidle.55
    174.50 ± 40%    +691.7%       1381 ± 76%  sched_debug.cpu.sched_goidle.57
    188.50 ± 24%    +249.1%     658.00 ± 93%  sched_debug.cpu.sched_goidle.62
    235.75 ± 71%    +205.2%     719.50 ± 80%  sched_debug.cpu.sched_goidle.64
    183.00 ±  7%    +192.2%     534.75 ± 44%  sched_debug.cpu.sched_goidle.65
    172.75 ± 14%    +284.4%     664.00 ± 98%  sched_debug.cpu.sched_goidle.67
      3207 ± 41%    +639.6%      23720 ± 55%  sched_debug.cpu.ttwu_count.10
      4399 ± 98%    +350.6%      19822 ± 74%  sched_debug.cpu.ttwu_count.12
      3161 ± 17%    +411.9%      16181 ± 23%  sched_debug.cpu.ttwu_count.13
      5397 ± 49%    +106.8%      11159 ±  6%  sched_debug.cpu.ttwu_count.14
      6285 ± 43%    +179.0%      17536 ± 40%  sched_debug.cpu.ttwu_count.16
      2315 ± 21%    +536.4%      14732 ± 44%  sched_debug.cpu.ttwu_count.17
      4673 ± 37%    +159.8%      12140 ±  3%  sched_debug.cpu.ttwu_count.20
      3256 ± 50%    +360.9%      15006 ± 43%  sched_debug.cpu.ttwu_count.29
      3694 ± 24%    +296.4%      14644 ± 29%  sched_debug.cpu.ttwu_count.3
      6425 ± 67%    +127.3%      14605 ± 33%  sched_debug.cpu.ttwu_count.32
      4574 ± 54%    +128.4%      10446 ±  6%  sched_debug.cpu.ttwu_count.36
      2164 ± 31%    +377.9%      10342 ±  3%  sched_debug.cpu.ttwu_count.37
      3858 ± 60%    +191.1%      11232 ±  6%  sched_debug.cpu.ttwu_count.38
      2829 ± 40%    +317.0%      11796 ± 15%  sched_debug.cpu.ttwu_count.39
      5410 ± 48%    +258.7%      19407 ± 77%  sched_debug.cpu.ttwu_count.40
      2970 ± 19%    +512.5%      18195 ± 47%  sched_debug.cpu.ttwu_count.41
      1881 ± 23%    +870.4%      18259 ± 69%  sched_debug.cpu.ttwu_count.43
      4395 ± 67%    +253.1%      15523 ± 29%  sched_debug.cpu.ttwu_count.44
      2470 ± 11%    +403.2%      12432 ± 19%  sched_debug.cpu.ttwu_count.45
      3261 ± 24%    +287.7%      12644 ± 55%  sched_debug.cpu.ttwu_count.46
      1529 ± 27%   +1033.9%      17346 ± 44%  sched_debug.cpu.ttwu_count.48
      4699 ± 92%    +203.9%      14282 ± 28%  sched_debug.cpu.ttwu_count.49
      2338 ± 38%    +500.1%      14032 ± 45%  sched_debug.cpu.ttwu_count.50
      3432 ± 38%    +273.9%      12834 ± 53%  sched_debug.cpu.ttwu_count.52
      3897 ± 53%    +133.3%       9093 ±  5%  sched_debug.cpu.ttwu_count.53
      4456 ± 38%    +134.1%      10430 ± 10%  sched_debug.cpu.ttwu_count.56
      3914 ± 65%    +217.6%      12430 ± 39%  sched_debug.cpu.ttwu_count.57
      1918 ± 33%    +388.7%       9375 ± 17%  sched_debug.cpu.ttwu_count.59
      4774 ± 62%    +178.6%      13300 ± 17%  sched_debug.cpu.ttwu_count.6
      2338 ± 37%    +287.9%       9069 ± 12%  sched_debug.cpu.ttwu_count.60
      2729 ± 29%    +441.2%      14769 ± 56%  sched_debug.cpu.ttwu_count.61
      3229 ± 49%    +256.6%      11517 ± 19%  sched_debug.cpu.ttwu_count.62
      3826 ± 52%    +176.1%      10562 ± 17%  sched_debug.cpu.ttwu_count.63
      2502 ± 33%    +324.5%      10623 ± 15%  sched_debug.cpu.ttwu_count.64
      1900 ± 25%    +367.0%       8874 ±  8%  sched_debug.cpu.ttwu_count.67
      2724 ± 52%    +365.3%      12676 ± 38%  sched_debug.cpu.ttwu_count.69
      2296 ± 35%    +339.4%      10088 ±  7%  sched_debug.cpu.ttwu_count.70
      2668 ± 16%    +277.5%      10074 ± 12%  sched_debug.cpu.ttwu_count.71
      3077 ± 17%    +430.4%      16319 ± 27%  sched_debug.cpu.ttwu_count.8
      6075 ±  4%    +126.3%      13750 ±  4%  sched_debug.cpu.ttwu_count.avg
     37108 ±  8%     +55.5%      57712 ± 11%  sched_debug.cpu.ttwu_count.max
      1158 ± 18%    +530.1%       7298 ± 11%  sched_debug.cpu.ttwu_count.min
      1844 ± 62%    +673.1%      14259 ± 87%  sched_debug.cpu.ttwu_local.10
      1819 ± 33%    +366.2%       8481 ± 47%  sched_debug.cpu.ttwu_local.13
      3967 ± 65%     -69.4%       1214 ± 68%  sched_debug.cpu.ttwu_local.14
      8652 ± 27%     -92.9%     613.50 ± 41%  sched_debug.cpu.ttwu_local.31
      7011 ± 73%     -85.4%       1025 ± 37%  sched_debug.cpu.ttwu_local.34
      5342 ± 80%     -61.2%       2075 ± 34%  sched_debug.cpu.ttwu_local.4
    607.25 ± 23%   +1252.9%       8215 ±146%  sched_debug.cpu.ttwu_local.43
    577.25 ± 30%   +1378.3%       8533 ± 89%  sched_debug.cpu.ttwu_local.48
      3079 ± 46%     -72.9%     834.50 ± 74%  sched_debug.cpu.ttwu_local.56
    861.50 ± 37%     -59.5%     348.50 ± 23%  sched_debug.cpu.ttwu_local.67
      4690 ±  3%     -11.7%       4141 ±  7%  sched_debug.cpu.ttwu_local.avg
     35180 ±  9%     +23.6%      43479 ± 13%  sched_debug.cpu.ttwu_local.max
    273.67 ±  6%     -17.3%     226.38 ± 10%  sched_debug.cpu.ttwu_local.min


lkp-bdw01: Broadwell ULT
Memory: 4G

lkp-hsw-ep2: Brickland Haswell-EP
Memory: 128G

                      blogbench.time.voluntary_context_switches

  1e+07 ++------------------------------------------------------------------+
        O   O                                                               |
  9e+06 ++O  O O O O                                                        |
        |                                                                   |
  8e+06 ++                                                                  |
        |                                                                   |
  7e+06 ++                O                          O                      |
        |            OO O   OO   O O OO O O   OO O     OO O                 |
  6e+06 ++                     O            O      O                        |
        |                                                      *.*          |
  5e+06 ++                                                     :  +   .*    |
        |                                                  .*.*    *.*  *.*.*
  4e+06 *+*.**.*.*.*.**.*.*.**.*.*.*.**.*.*.*.**.*.*.*.**.*                 |
        |                                                                   |
  3e+06 ++------------------------------------------------------------------+


                             proc-vmstat.kswapd_inodesteal

    2e+07 ++----------------------------------------------------------------+
  1.8e+07 O+OO O O OO     OO O          OO    O O    O O O                  |
          |           O O      O OO O O    O O    O O      O                |
  1.6e+07 ++                                                                |
  1.4e+07 ++                                                                |
          |                                                                 |
  1.2e+07 ++                                                                |
    1e+07 ++                                                                |
    8e+06 ++                                                                |
          |                                                                 |
    6e+06 ++                                                                |
    4e+06 ++                                                *.*.   *.*.*.**.*
          |                                                 :   *.*         |
    2e+06 *+**.*.*.**.*.*.**.*.*.**.*.*.**.*.**.*.*.**.*.*.*                |
        0 ++----------------------------------------------------------------+


                       proc-vmstat.nr_vmscan_immediate_reclaim

  500000 ++-----------------------------------------------------------------+
  450000 ++                                                   *             |
         |                                                   ::      *.     |
  400000 ++                                                  ::     +  *    |
  350000 ++                                                 *  :   *    *.* |
         |                                                  :  :   :       +|
  300000 ++                                                :   :  :         *
  250000 ++                                                :   :  :         |
  200000 ++                                                :   :  :         |
         |                                                 :   :  :         |
  150000 ++ .**.*.*. *. .*.* .*.      .*.*.**.     *.*.*.*:     ::          |
  100000 ++*        *  *    *   *.* .*        *. .*       *     :*          |
         *                         *            *               *           |
   50000 ++                                                                 |
       0 O+O-OO-O-O-OO-O-O-OO-O-O-------------------------------------------+


	[*] bisect-good sample
	[O] bisect-bad  sample

To reproduce:

        git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git
        cd lkp-tests
        bin/lkp install job.yaml  # job file is attached in this email
        bin/lkp run     job.yaml


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.


Thanks,
Ying Huang

[-- Attachment #2: job.yaml --]
[-- Type: text/plain, Size: 3528 bytes --]

---
LKP_SERVER: inn
LKP_CGI_PORT: 80
LKP_CIFS_PORT: 139
testcase: blogbench
default-monitors:
  wait: activate-monitor
  kmsg: 
  uptime: 
  iostat: 
  vmstat: 
  numa-numastat: 
  numa-vmstat: 
  numa-meminfo: 
  proc-vmstat: 
  proc-stat:
    interval: 10
  meminfo: 
  slabinfo: 
  interrupts: 
  lock_stat: 
  latency_stats: 
  softirqs: 
  bdi_dev_mapping: 
  diskstats: 
  nfsstat: 
  cpuidle: 
  cpufreq-stats: 
  turbostat: 
  pmeter: 
  sched_debug:
    interval: 60
cpufreq_governor: performance
default-watchdogs:
  oom-killer: 
  watchdog: 
commit: 5c6dc7978afb41bff22b2b9002b8a619b3a76955
model: Broadwell ULT
nr_cpu: 4
memory: 4G
nr_ssd_partitions: 1
ssd_partitions: "/dev/disk/by-id/ata-INTEL_SSDSC2CW120A3_CVCV252505YF120BGN-part1"
rootfs_partition: "/dev/disk/by-id/ata-INTEL_SSDSC2CW120A3_CVCV252505YF120BGN-part2"
category: benchmark
disk: 1SSD
fs: btrfs
blogbench: 
queue: bisect
testbox: lkp-bdw01
tbox_group: lkp-bdw01
kconfig: x86_64-rhel
enqueue_time: 2016-02-01 09:24:51.534490486 +08:00
id: 9fe946ed81ed2edc64c833e78c223899ee408e39
user: lkp
compiler: gcc-4.9
head_commit: a66aef2038ce0ce7386c40e2a010beb2cb7895d2
base_commit: 92e963f50fc74041b5e9e744c330dca48e04f08d
branch: linux-devel/devel-hourly-2016013119
rootfs: debian-x86_64-2015-02-07.cgz
result_root: "/result/blogbench/performance-1SSD-btrfs/lkp-bdw01/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/5c6dc7978afb41bff22b2b9002b8a619b3a76955/0"
job_file: "/lkp/scheduled/lkp-bdw01/bisect_blogbench-performance-1SSD-btrfs-debian-x86_64-2015-02-07.cgz-x86_64-rhel-5c6dc7978afb41bff22b2b9002b8a619b3a76955-20160201-65302-17e67lw-0.yaml"
max_uptime: 1279.7800000000002
initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz"
bootloader_append:
- root=/dev/ram0
- user=lkp
- job=/lkp/scheduled/lkp-bdw01/bisect_blogbench-performance-1SSD-btrfs-debian-x86_64-2015-02-07.cgz-x86_64-rhel-5c6dc7978afb41bff22b2b9002b8a619b3a76955-20160201-65302-17e67lw-0.yaml
- ARCH=x86_64
- kconfig=x86_64-rhel
- branch=linux-devel/devel-hourly-2016013119
- commit=5c6dc7978afb41bff22b2b9002b8a619b3a76955
- BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/5c6dc7978afb41bff22b2b9002b8a619b3a76955/vmlinuz-4.5.0-rc1-00012-g5c6dc79
- max_uptime=1279
- RESULT_ROOT=/result/blogbench/performance-1SSD-btrfs/lkp-bdw01/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/5c6dc7978afb41bff22b2b9002b8a619b3a76955/0
- LKP_SERVER=inn
- |2-


  earlyprintk=ttyS0,115200 systemd.log_level=err
  debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100
  panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0
  console=ttyS0,115200 console=tty0 vga=normal

  rw
lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz"
modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/5c6dc7978afb41bff22b2b9002b8a619b3a76955/modules.cgz"
bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/turbostat.cgz,/lkp/benchmarks/turbostat.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/fs.cgz,/lkp/benchmarks/blogbench.cgz"
linux_headers_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/5c6dc7978afb41bff22b2b9002b8a619b3a76955/linux-headers.cgz"
repeat_to: 2
kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/5c6dc7978afb41bff22b2b9002b8a619b3a76955/vmlinuz-4.5.0-rc1-00012-g5c6dc79"
dequeue_time: 2016-02-01 09:26:14.798141905 +08:00
job_state: finished
loadavg: 110.48 69.63 30.20 1/152 4564
start_time: '1454290025'
end_time: '1454290325'
version: "/lkp/lkp/.src-20160127-223853"

[-- Attachment #3: reproduce.sh --]
[-- Type: application/x-sh, Size: 514 bytes --]

^ permalink raw reply	[flat|nested] only message in thread

only message in thread, other threads:[~2016-02-02  2:18 UTC | newest]

Thread overview: (only message) (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2016-02-02  2:18 [mm] 5c6dc7978a: -17.6% blogbench.read_score, +19.3% blogbench.write_score kernel test robot

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.