linux-fsdevel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* [writeback] 6903673566d: +2.5% fileio.requests_per_sec
@ 2014-04-10 12:41 Fengguang Wu
  2014-04-10 13:05 ` Fengguang Wu
  2014-04-10 13:08 ` Fengguang Wu
  0 siblings, 2 replies; 6+ messages in thread
From: Fengguang Wu @ 2014-04-10 12:41 UTC (permalink / raw)
  To: Jan Kara; +Cc: LKML, linux-fsdevel, lkp

Hi Jan,

I tried your writeback dirty list patchset and noticed some ups/downs.
The main performance changes are

1) +2.5% fileio.requests_per_sec
2) -7.1% iostat.md0.wkB/s

git://bee.sh.intel.com/git/wfg/linux-devel.git jan-dirty-list
commit 6903673566d0289680e593dac088c787d119b067 ("writeback: Replace several writeback lists with inode tagging")

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      6526 ~ 0%      +3.2%       6736 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
      6441 ~ 0%      +1.8%       6558 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
     12968 ~ 0%      +2.5%      13295 ~ 0%  TOTAL fileio.requests_per_sec

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
    398147 ~ 0%      -7.1%     369866 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    398147 ~ 0%      -7.1%     369866 ~ 0%  TOTAL iostat.md0.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       861 ~30%     -78.7%        183 ~33%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
       464 ~48%     -91.7%         38 ~27%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       109 ~18%  +54509.0%      59960 ~ 2%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      1436 ~35%   +4089.8%      60182 ~ 2%  TOTAL proc-vmstat.nr_vmscan_immediate_reclaim

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       123 ~29%     -94.3%          7 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       123 ~29%     -94.3%          7 ~ 0%  TOTAL ftrace.writeback_single_inode.md0.age

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
        55 ~19%  +19305.5%      10750 ~17%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
        55 ~19%  +19305.5%      10750 ~17%  TOTAL numa-vmstat.node1.nr_vmscan_immediate_reclaim

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
        38 ~26%  +22737.7%       8815 ~17%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
        38 ~26%  +22737.7%       8815 ~17%  TOTAL numa-vmstat.node0.nr_vmscan_immediate_reclaim

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       145 ~16%    +668.1%       1115 ~17%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       145 ~16%    +668.1%       1115 ~17%  TOTAL proc-vmstat.pgrotated

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      1477 ~ 0%    +275.0%       5541 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      1477 ~ 0%    +275.0%       5541 ~ 1%  TOTAL meminfo.Buffers

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      1486 ~ 0%    +273.3%       5546 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      1486 ~ 0%    +273.3%       5546 ~ 1%  TOTAL vmstat.memory.buff

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     13328 ~ 0%     -68.6%       4180 ~ 7%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
     13328 ~ 0%     -68.6%       4180 ~ 7%  TOTAL proc-vmstat.pgpgin

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      0.36 ~11%     -78.9%       0.08 ~16%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      0.12 ~ 6%     -22.0%       0.09 ~ 8%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
      0.48 ~10%     -65.0%       0.17 ~11%  TOTAL turbostat.%pc3

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
         2 ~ 0%     +50.0%          3 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
         1 ~ 0%    +300.0%          4 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
         3 ~ 0%    +133.3%          7 ~ 0%  TOTAL ftrace.writeback_single_inode.sda.age

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       105 ~11%    +125.9%        237 ~ 9%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
       105 ~11%    +125.9%        237 ~ 9%  TOTAL slabinfo.xfs_trans.active_objs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       105 ~11%    +125.9%        237 ~ 9%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
       105 ~11%    +125.9%        237 ~ 9%  TOTAL slabinfo.xfs_trans.num_objs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       868 ~ 2%    +124.1%       1946 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       868 ~ 2%    +124.1%       1946 ~ 1%  TOTAL slabinfo.journal_head.active_objs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       868 ~ 2%    +124.1%       1946 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       868 ~ 2%    +124.1%       1946 ~ 1%  TOTAL slabinfo.journal_head.num_objs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       725 ~ 9%    +119.1%       1589 ~ 6%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
       194 ~ 0%     +56.2%        303 ~13%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
       919 ~ 7%    +105.8%       1892 ~ 7%  TOTAL slabinfo.blkdev_ioc.num_objs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       725 ~ 9%    +118.5%       1584 ~ 6%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
       194 ~ 0%     +56.2%        303 ~13%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
       919 ~ 7%    +105.3%       1887 ~ 7%  TOTAL slabinfo.blkdev_ioc.active_objs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     13970 ~20%     -35.8%       8963 ~12%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
     13970 ~20%     -35.8%       8963 ~12%  TOTAL numa-vmstat.node1.nr_anon_pages

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     55871 ~20%     -35.8%      35844 ~12%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
     55871 ~20%     -35.8%      35844 ~12%  TOTAL numa-meminfo.node1.AnonPages

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     55793 ~20%     -35.9%      35791 ~12%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
     55793 ~20%     -35.9%      35791 ~12%  TOTAL numa-meminfo.node1.Active(anon)

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     13949 ~20%     -35.8%       8950 ~12%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
     13949 ~20%     -35.8%       8950 ~12%  TOTAL numa-vmstat.node1.nr_active_anon

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      0.64 ~ 8%     +53.1%       0.98 ~ 3%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      0.64 ~ 8%     +53.1%       0.98 ~ 3%  TOTAL perf-profile.cpu-cycles.sys_write.system_call_fastpath.write

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       727 ~ 1%     +41.3%       1027 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       727 ~ 1%     +41.3%       1027 ~ 1%  TOTAL slabinfo.dquot.num_objs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       727 ~ 1%     +41.3%       1027 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       727 ~ 1%     +41.3%       1027 ~ 1%  TOTAL slabinfo.dquot.active_objs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
        17 ~ 4%     -17.6%         14 ~13%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
        17 ~ 4%     -17.6%         14 ~13%  TOTAL ftrace.balance_dirty_pages.sdj.think

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     41483 ~ 1%     -25.4%      30966 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     41483 ~ 1%     -25.4%      30966 ~ 0%  TOTAL ftrace.writeback_single_inode.md0.wrote

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      0.42 ~26%     -35.4%       0.27 ~ 9%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
      0.42 ~26%     -35.4%       0.27 ~ 9%  TOTAL turbostat.%pc6

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      1.00 ~ 3%     +33.3%       1.33 ~ 5%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      1.00 ~ 3%     +33.3%       1.33 ~ 5%  TOTAL perf-profile.cpu-cycles.__generic_file_aio_write.generic_file_aio_write.ext4_file_write.do_sync_write.vfs_write

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      0.52 ~24%     +66.5%       0.87 ~25%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
      0.52 ~24%     +66.5%       0.87 ~25%  TOTAL perf-profile.cpu-cycles.do_sync_write.vfs_write.sys_write.system_call_fastpath.write

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     17614 ~ 0%     -18.5%      14355 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     39820 ~ 2%     -20.9%      31511 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     57435 ~ 1%     -20.1%      45866 ~ 0%  TOTAL proc-vmstat.nr_writeback

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     70430 ~ 0%     -18.5%      57410 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
    159175 ~ 2%     -21.0%     125784 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    229605 ~ 1%     -20.2%     183195 ~ 0%  TOTAL meminfo.Writeback

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      8.14 ~ 8%     -16.0%       6.83 ~ 8%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
      8.14 ~ 8%     -16.0%       6.83 ~ 8%  TOTAL perf-profile.cpu-cycles.__block_write_begin.xfs_vm_write_begin.generic_file_buffered_write.xfs_file_buffered_aio_write.xfs_file_aio_write

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     17680 ~ 0%     -18.2%      14463 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     39997 ~ 1%     -20.6%      31757 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     57677 ~ 1%     -19.9%      46220 ~ 1%  TOTAL ftrace.global_dirty_state.writeback

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     31031 ~ 5%     -23.4%      23763 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
    439570 ~ 3%     +11.8%     491310 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
    470602 ~ 3%      +9.4%     515073 ~ 1%  TOTAL ftrace.writeback_single_inode.sda.index

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
   2239375 ~ 5%     -20.2%    1787786 ~ 3%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
   2239375 ~ 5%     -20.2%    1787786 ~ 3%  TOTAL ftrace.writeback_single_inode.md0.index

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      0.89 ~ 9%     -20.0%       0.71 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      0.89 ~ 9%     -20.0%       0.71 ~ 1%  TOTAL perf-profile.cpu-cycles.vfs_read.sys_read.system_call_fastpath.read

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       518 ~ 1%     +21.7%        630 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
      4406 ~ 0%     -17.6%       3629 ~ 2%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
      4924 ~ 0%     -13.5%       4260 ~ 2%  TOTAL ftrace.writeback_single_inode.sda.wrote

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      2.46 ~10%     -16.8%       2.05 ~ 5%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
      2.46 ~10%     -16.8%       2.05 ~ 5%  TOTAL perf-profile.cpu-cycles.__clear_user.read_zero.read_zero.vfs_read.sys_read

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      0.77 ~ 7%     -14.5%       0.66 ~ 7%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
      0.77 ~ 7%     -14.5%       0.66 ~ 7%  TOTAL turbostat.%pc2

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       753 ~ 6%     -17.2%        623 ~ 4%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
       753 ~ 6%     -17.2%        623 ~ 4%  TOTAL ftrace.bdi_dirty_ratelimit.sda.task_ratelimit

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      1.45 ~ 7%     -18.5%       1.18 ~14%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
      1.45 ~ 7%     -18.5%       1.18 ~14%  TOTAL perf-profile.cpu-cycles.xfs_file_aio_write.do_sync_write.vfs_write.sys_write.system_call_fastpath

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     67019 ~ 5%     -15.5%      56616 ~ 3%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
     67019 ~ 5%     -15.5%      56616 ~ 3%  TOTAL numa-vmstat.node1.nr_free_pages

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
    268013 ~ 5%     -15.6%     226330 ~ 3%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
    268013 ~ 5%     -15.6%     226330 ~ 3%  TOTAL numa-meminfo.node1.MemFree

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 2.716e+08 ~ 7%     -10.2%  2.438e+08 ~ 8%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 2.716e+08 ~ 7%     -10.2%  2.438e+08 ~ 8%  TOTAL cpuidle.C1-NHM.time

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      1.30 ~ 6%     +15.0%       1.49 ~ 3%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      1.30 ~ 6%     +15.0%       1.49 ~ 3%  TOTAL perf-profile.cpu-cycles.jbd2_journal_stop.__ext4_journal_stop.ext4_da_write_end.generic_file_buffered_write.__generic_file_aio_write

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
   5624475 ~ 0%     -14.3%    4817546 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
   5624475 ~ 0%     -14.3%    4817546 ~ 0%  TOTAL ftrace.global_dirty_state.written

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
   5665317 ~ 0%     -14.2%    4858497 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
   5665317 ~ 0%     -14.2%    4858497 ~ 0%  TOTAL ftrace.global_dirty_state.dirtied

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
    284093 ~ 0%     -14.3%     243524 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    284093 ~ 0%     -14.3%     243524 ~ 1%  TOTAL softirqs.TIMER

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
    144616 ~ 2%     -13.1%     125601 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
    144616 ~ 2%     -13.1%     125601 ~ 0%  TOTAL interrupts.RES

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  10513311 ~ 1%     -14.2%    9018488 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  10513311 ~ 1%     -14.2%    9018488 ~ 0%  TOTAL proc-vmstat.pgsteal_kswapd_dma32

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  10616278 ~ 1%     -14.1%    9120337 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  10616278 ~ 1%     -14.1%    9120337 ~ 0%  TOTAL proc-vmstat.pgdeactivate

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  10646283 ~ 1%     -14.1%    9150342 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  10646283 ~ 1%     -14.1%    9150342 ~ 0%  TOTAL proc-vmstat.pgrefill_dma32

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  10700780 ~ 1%     -13.9%    9213386 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  10700780 ~ 1%     -13.9%    9213386 ~ 0%  TOTAL proc-vmstat.pgscan_kswapd_dma32

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     97209 ~ 0%     +16.0%     112763 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     97209 ~ 0%     +16.0%     112763 ~ 0%  TOTAL interrupts.46:PCI-MSI-edge.ahci

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     48817 ~ 0%     +15.8%      56548 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     48817 ~ 0%     +15.8%      56548 ~ 0%  TOTAL interrupts.CAL

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
        32 ~ 2%     +13.7%         36 ~ 2%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
        32 ~ 2%     +13.7%         36 ~ 2%  TOTAL ftrace.balance_dirty_pages.sda.pause

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  42947776 ~ 1%     -13.8%   37036031 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  42947776 ~ 1%     -13.8%   37036031 ~ 0%  TOTAL proc-vmstat.pgpgout

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  10738479 ~ 1%     -13.8%    9260807 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  10738479 ~ 1%     -13.8%    9260807 ~ 0%  TOTAL proc-vmstat.nr_written

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  10756692 ~ 1%     -13.7%    9282691 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  10756692 ~ 1%     -13.7%    9282691 ~ 0%  TOTAL proc-vmstat.nr_dirtied

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     71616 ~ 1%     -13.6%      61867 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     71616 ~ 1%     -13.6%      61867 ~ 0%  TOTAL ftrace.bdi_dirty_ratelimit.sda.write_bw

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     72368 ~ 1%     -13.7%      62469 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     72368 ~ 1%     -13.7%      62469 ~ 0%  TOTAL ftrace.bdi_dirty_ratelimit.sda.dirty_rate

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     50797 ~ 0%     +15.3%      58562 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     50797 ~ 0%     +15.3%      58562 ~ 0%  TOTAL softirqs.BLOCK

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     71851 ~ 1%     -13.5%      62185 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     71851 ~ 1%     -13.5%      62185 ~ 0%  TOTAL ftrace.bdi_dirty_ratelimit.sda.awrite_bw

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  11603962 ~ 1%     -12.9%   10106747 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  11603962 ~ 1%     -12.9%   10106747 ~ 0%  TOTAL proc-vmstat.pgfree

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  11598185 ~ 1%     -12.9%   10103278 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  11598185 ~ 1%     -12.9%   10103278 ~ 0%  TOTAL proc-vmstat.numa_local

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  11598185 ~ 1%     -12.9%   10103278 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  11598185 ~ 1%     -12.9%   10103278 ~ 0%  TOTAL proc-vmstat.numa_hit

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  11615252 ~ 1%     -12.9%   10119889 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  11615252 ~ 1%     -12.9%   10119889 ~ 0%  TOTAL proc-vmstat.pgalloc_dma32

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     23008 ~ 1%     +14.2%      26276 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     23008 ~ 1%     +14.2%      26276 ~ 0%  TOTAL proc-vmstat.nr_dirty

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     92088 ~ 1%     +14.2%     105124 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     92088 ~ 1%     +14.2%     105124 ~ 0%  TOTAL meminfo.Dirty

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     23126 ~ 1%     +14.3%      26444 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     23126 ~ 1%     +14.3%      26444 ~ 0%  TOTAL ftrace.global_dirty_state.dirty

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      1.78 ~17%     -30.2%       1.24 ~14%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
      1.78 ~17%     -30.2%       1.24 ~14%  TOTAL perf-profile.cpu-cycles.generic_file_buffered_write.xfs_file_buffered_aio_write.xfs_file_aio_write.do_sync_write.vfs_write

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
    541298 ~ 1%     -11.9%     476647 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
    541298 ~ 1%     -11.9%     476647 ~ 0%  TOTAL meminfo.MemFree

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
    135390 ~ 1%     -11.9%     119229 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
    135390 ~ 1%     -11.9%     119229 ~ 0%  TOTAL proc-vmstat.nr_free_pages

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
        32 ~ 2%     +12.2%         36 ~ 2%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
        32 ~ 2%     +12.2%         36 ~ 2%  TOTAL ftrace.balance_dirty_pages.sda.period

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
    550275 ~ 1%     -11.1%     489385 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
    550275 ~ 1%     -11.1%     489385 ~ 0%  TOTAL vmstat.memory.free

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
    362273 ~ 1%     -11.0%     322470 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
    362273 ~ 1%     -11.0%     322470 ~ 0%  TOTAL proc-vmstat.pgactivate

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      4191 ~ 1%     -10.0%       3772 ~ 2%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
      4191 ~ 1%     -10.0%       3772 ~ 2%  TOTAL proc-vmstat.kswapd_high_wmark_hit_quickly

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       516 ~ 5%     +13.4%        585 ~ 5%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       516 ~ 5%     +13.4%        585 ~ 5%  TOTAL numa-vmstat.node0.nr_page_table_pages

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      1085 ~ 5%     +10.0%       1194 ~ 2%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      1085 ~ 5%     +10.0%       1194 ~ 2%  TOTAL slabinfo.task_struct.num_objs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
        31 ~ 1%      -8.2%         29 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
        31 ~ 1%      -8.2%         29 ~ 0%  TOTAL ftrace.balance_dirty_pages.sda.dirtied_pause

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
    227121 ~ 0%      -9.4%     205850 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    227121 ~ 0%      -9.4%     205850 ~ 1%  TOTAL softirqs.RCU

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      2055 ~ 5%     +13.5%       2332 ~ 5%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      2055 ~ 5%     +13.5%       2332 ~ 5%  TOTAL numa-meminfo.node0.PageTables

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      1069 ~ 3%     -10.8%        954 ~ 4%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
      1069 ~ 3%     -10.8%        954 ~ 4%  TOTAL ftrace.balance_dirty_pages.sda.task_ratelimit

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     23923 ~ 0%     -76.5%       5626 ~11%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
     23923 ~ 0%     -76.5%       5626 ~11%  TOTAL time.file_system_inputs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      4.79 ~ 2%    +806.0%      43.40 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
      1.64 ~ 0%      +3.8%       1.71 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
      6.43 ~ 2%    +601.0%      45.11 ~ 1%  TOTAL iostat.sda.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       546 ~ 2%     +91.7%       1047 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       546 ~ 2%     +91.7%       1047 ~ 0%  TOTAL iostat.sdj.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       129 ~ 2%     +91.6%        248 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       129 ~ 2%     +91.6%        248 ~ 0%  TOTAL iostat.sdj.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       538 ~ 1%     +92.4%       1035 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       538 ~ 1%     +92.4%       1035 ~ 2%  TOTAL iostat.sde.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       127 ~ 1%     +92.2%        244 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       127 ~ 1%     +92.2%        244 ~ 2%  TOTAL iostat.sde.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       535 ~ 1%     +91.6%       1026 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       535 ~ 1%     +91.6%       1026 ~ 1%  TOTAL iostat.sdd.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       126 ~ 1%     +91.5%        242 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       126 ~ 1%     +91.5%        242 ~ 1%  TOTAL iostat.sdd.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       551 ~ 2%     +89.5%       1045 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       551 ~ 2%     +89.5%       1045 ~ 2%  TOTAL iostat.sdf.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       130 ~ 2%     +89.3%        247 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       130 ~ 2%     +89.3%        247 ~ 2%  TOTAL iostat.sdf.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       538 ~ 1%     +92.2%       1034 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       538 ~ 1%     +92.2%       1034 ~ 0%  TOTAL iostat.sdc.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       127 ~ 1%     +92.0%        244 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       127 ~ 1%     +92.0%        244 ~ 0%  TOTAL iostat.sdc.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       543 ~ 1%     +91.8%       1041 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       543 ~ 1%     +91.8%       1041 ~ 1%  TOTAL iostat.sdi.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       128 ~ 1%     +91.6%        246 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       128 ~ 1%     +91.6%        246 ~ 1%  TOTAL iostat.sdi.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       129 ~ 1%     +91.2%        247 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       129 ~ 1%     +91.2%        247 ~ 1%  TOTAL iostat.sdb.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       545 ~ 1%     +91.3%       1043 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       545 ~ 1%     +91.3%       1043 ~ 1%  TOTAL iostat.sdb.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       546 ~ 2%     +91.1%       1045 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       546 ~ 2%     +91.1%       1045 ~ 1%  TOTAL iostat.sdh.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       129 ~ 2%     +91.1%        247 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       129 ~ 2%     +91.1%        247 ~ 1%  TOTAL iostat.sdh.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       552 ~ 2%     +88.6%       1041 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       552 ~ 2%     +88.6%       1041 ~ 1%  TOTAL iostat.sdl.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       130 ~ 2%     +88.6%        246 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       130 ~ 2%     +88.6%        246 ~ 1%  TOTAL iostat.sdl.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       556 ~ 2%     +88.5%       1048 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       556 ~ 2%     +88.5%       1048 ~ 1%  TOTAL iostat.sdg.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       131 ~ 2%     +88.4%        248 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       131 ~ 2%     +88.4%        248 ~ 1%  TOTAL iostat.sdg.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       555 ~ 3%     +88.2%       1044 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       555 ~ 3%     +88.2%       1044 ~ 1%  TOTAL iostat.sdk.rkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       131 ~ 3%     +88.1%        247 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       131 ~ 3%     +88.1%        247 ~ 1%  TOTAL iostat.sdk.rrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      3290 ~ 1%     -69.0%       1019 ~ 7%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
   3596794 ~ 0%      +3.3%    3714366 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
   3546724 ~ 0%      +1.9%    3614254 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
   7146809 ~ 0%      +2.6%    7329639 ~ 0%  TOTAL time.voluntary_context_switches

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       879 ~ 1%     -25.2%        657 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
       879 ~ 1%     -25.2%        657 ~ 0%  TOTAL iostat.sda.avgrq-sz

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  48923640 ~ 7%     +33.4%   65269752 ~ 7%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
  48923640 ~ 7%     +33.4%   65269752 ~ 7%  TOTAL perf-stat.dTLB-store-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 1.478e+10 ~13%     +18.6%  1.753e+10 ~ 5%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 1.478e+10 ~13%     +18.6%  1.753e+10 ~ 5%  TOTAL perf-stat.dTLB-load-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       161 ~ 0%     +16.0%        186 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
       161 ~ 0%     +16.0%        186 ~ 0%  TOTAL iostat.sda.w/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       877 ~ 0%     -12.9%        763 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
       877 ~ 0%     -12.9%        763 ~ 0%  TOTAL iostat.sda.await

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       877 ~ 0%     -12.9%        763 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
       877 ~ 0%     -12.9%        763 ~ 0%  TOTAL iostat.sda.w_await

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 9.069e+08 ~ 1%      +6.2%  9.628e+08 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 3.994e+09 ~ 1%      +8.0%  4.312e+09 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 1.377e+10 ~ 0%     -18.7%   1.12e+10 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 1.867e+10 ~ 1%     -11.8%  1.648e+10 ~ 0%  TOTAL perf-stat.branch-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 3.005e+08 ~ 2%     -11.1%   2.67e+08 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 3.005e+08 ~ 2%     -11.1%   2.67e+08 ~ 0%  TOTAL perf-stat.LLC-stores

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 1.477e+11 ~ 0%     -14.4%  1.265e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 2.034e+11 ~ 0%      -7.9%  1.874e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 9.544e+11 ~ 0%      -8.2%  8.766e+11 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 1.306e+12 ~ 0%      -8.8%  1.191e+12 ~ 0%  TOTAL perf-stat.dTLB-loads

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  4.27e+11 ~ 2%     -14.2%  3.664e+11 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 5.714e+11 ~ 1%      -7.1%  5.306e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 3.604e+12 ~ 0%      -7.3%  3.341e+12 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 4.603e+12 ~ 0%      -7.9%  4.238e+12 ~ 0%  TOTAL perf-stat.L1-icache-loads

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  93487860 ~ 2%     -16.4%   78168769 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  1.09e+08 ~ 0%      -4.3%  1.044e+08 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 1.792e+09 ~ 0%      -7.1%  1.665e+09 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 1.995e+09 ~ 0%      -7.4%  1.847e+09 ~ 0%  TOTAL perf-stat.LLC-store-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 1.484e+11 ~ 1%     -14.5%  1.269e+11 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 2.041e+11 ~ 0%      -7.6%  1.886e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 9.549e+11 ~ 0%      -8.1%  8.778e+11 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 1.489e+12 ~ 0%      +3.0%  1.534e+12 ~ 2%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 2.797e+12 ~ 0%      -2.5%  2.728e+12 ~ 1%  TOTAL perf-stat.L1-dcache-loads

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 7.739e+10 ~ 2%     -12.1%  6.799e+10 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 1.104e+11 ~ 0%      -6.6%  1.031e+11 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 4.741e+11 ~ 0%      -6.5%  4.432e+11 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 6.618e+11 ~ 0%      -7.2%  6.143e+11 ~ 0%  TOTAL perf-stat.branch-loads

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 3.927e+11 ~ 2%     -11.8%  3.465e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 5.519e+11 ~ 1%      -5.8%  5.198e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 2.415e+12 ~ 0%      -6.9%   2.25e+12 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
  3.36e+12 ~ 0%      -7.3%  3.116e+12 ~ 0%  TOTAL perf-stat.instructions

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 9.313e+10 ~ 1%     -12.4%  8.163e+10 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 1.283e+11 ~ 0%      -5.2%  1.217e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 5.998e+11 ~ 0%      -7.0%  5.576e+11 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 8.213e+11 ~ 0%      -7.3%  7.609e+11 ~ 0%  TOTAL perf-stat.L1-dcache-stores

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 9.304e+10 ~ 1%     -12.2%  8.167e+10 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 1.284e+11 ~ 1%      -5.7%  1.211e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 5.981e+11 ~ 0%      -6.3%  5.603e+11 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 8.196e+11 ~ 0%      -6.9%  7.631e+11 ~ 0%  TOTAL perf-stat.dTLB-stores

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 7.728e+10 ~ 1%     -11.9%  6.808e+10 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 1.096e+11 ~ 0%      -6.2%  1.028e+11 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 4.747e+11 ~ 0%      -6.7%   4.43e+11 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 6.615e+11 ~ 0%      -7.2%  6.139e+11 ~ 0%  TOTAL perf-stat.branch-instructions

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 3.934e+11 ~ 1%     -11.9%  3.466e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
  5.51e+11 ~ 1%      -6.1%  5.174e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 2.417e+12 ~ 0%      -6.5%  2.261e+12 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 3.362e+12 ~ 0%      -7.0%  3.125e+12 ~ 0%  TOTAL perf-stat.iTLB-loads

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 6.663e+08 ~ 3%      +7.5%  7.164e+08 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 6.663e+08 ~ 3%      +7.5%  7.164e+08 ~ 1%  TOTAL perf-stat.LLC-prefetch-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 6.128e+10 ~ 1%     -11.2%  5.441e+10 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 7.652e+10 ~ 0%      -5.6%  7.222e+10 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 5.005e+11 ~ 0%      -6.6%  4.677e+11 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 6.383e+11 ~ 0%      -6.9%  5.944e+11 ~ 0%  TOTAL perf-stat.bus-cycles

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
    100757 ~ 7%     -17.1%      83525 ~ 2%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     75328 ~ 2%      -4.8%      71699 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
    229589 ~ 0%      +1.8%     233703 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    405674 ~ 2%      -4.1%     388927 ~ 1%  TOTAL perf-stat.cpu-migrations

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 1.753e+09 ~ 2%      -6.7%  1.635e+09 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 3.862e+10 ~ 0%      -6.5%  3.609e+10 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 4.037e+10 ~ 0%      -6.5%  3.773e+10 ~ 1%  TOTAL perf-stat.L1-dcache-load-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9670 ~ 0%      -7.0%       8996 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9670 ~ 0%      -7.0%       8996 ~ 0%  TOTAL iostat.sdd.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9671 ~ 0%      -7.0%       8996 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9671 ~ 0%      -7.0%       8996 ~ 0%  TOTAL iostat.sdl.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9670 ~ 0%      -7.0%       8997 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9670 ~ 0%      -7.0%       8997 ~ 0%  TOTAL iostat.sdg.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9672 ~ 0%      -7.0%       8997 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9672 ~ 0%      -7.0%       8997 ~ 0%  TOTAL iostat.sdj.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9671 ~ 0%      -7.0%       8996 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9671 ~ 0%      -7.0%       8996 ~ 0%  TOTAL iostat.sdk.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9670 ~ 0%      -7.0%       8996 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9670 ~ 0%      -7.0%       8996 ~ 0%  TOTAL iostat.sdf.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9671 ~ 0%      -7.0%       8996 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9671 ~ 0%      -7.0%       8996 ~ 0%  TOTAL iostat.sdb.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9671 ~ 0%      -7.0%       8996 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9671 ~ 0%      -7.0%       8996 ~ 0%  TOTAL iostat.sdc.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9670 ~ 0%      -6.9%       8998 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9670 ~ 0%      -6.9%       8998 ~ 0%  TOTAL iostat.sdh.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39934 ~ 0%      -6.9%      37184 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39934 ~ 0%      -6.9%      37184 ~ 0%  TOTAL iostat.sdd.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9670 ~ 0%      -7.0%       8998 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9670 ~ 0%      -7.0%       8998 ~ 0%  TOTAL iostat.sde.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      9672 ~ 0%      -7.0%       9000 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9672 ~ 0%      -7.0%       9000 ~ 0%  TOTAL iostat.sdi.wrqm/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39938 ~ 0%      -6.9%      37180 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39938 ~ 0%      -6.9%      37180 ~ 0%  TOTAL iostat.sdl.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39932 ~ 0%      -6.9%      37188 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39932 ~ 0%      -6.9%      37188 ~ 0%  TOTAL iostat.sdg.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39943 ~ 0%      -6.9%      37188 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39943 ~ 0%      -6.9%      37188 ~ 0%  TOTAL iostat.sdj.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39938 ~ 0%      -6.9%      37184 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39938 ~ 0%      -6.9%      37184 ~ 0%  TOTAL iostat.sdk.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 5.549e+11 ~ 1%     -11.4%  4.915e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 6.897e+11 ~ 0%      -5.5%  6.517e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 4.012e+12 ~ 0%      -6.7%  3.745e+12 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 5.776e+12 ~ 1%      +5.4%  6.087e+12 ~ 2%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 1.103e+13 ~ 0%      -0.5%  1.098e+13 ~ 1%  TOTAL perf-stat.ref-cycles

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39933 ~ 0%      -6.9%      37182 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39933 ~ 0%      -6.9%      37182 ~ 0%  TOTAL iostat.sdf.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39935 ~ 0%      -6.9%      37181 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39935 ~ 0%      -6.9%      37181 ~ 0%  TOTAL iostat.sdb.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39937 ~ 0%      -6.9%      37183 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39937 ~ 0%      -6.9%      37183 ~ 0%  TOTAL iostat.sdc.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39932 ~ 0%      -6.9%      37189 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39932 ~ 0%      -6.9%      37189 ~ 0%  TOTAL iostat.sde.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39940 ~ 0%      -6.9%      37198 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39940 ~ 0%      -6.9%      37198 ~ 0%  TOTAL iostat.sdi.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 4.924e+11 ~ 1%     -12.1%  4.326e+11 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 6.465e+11 ~ 0%      -5.1%  6.136e+11 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 4.012e+12 ~ 0%      -6.7%  3.744e+12 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 5.844e+12 ~ 1%      +4.0%  6.078e+12 ~ 2%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
   1.1e+13 ~ 0%      -1.2%  1.087e+13 ~ 1%  TOTAL perf-stat.cpu-cycles

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      3114 ~ 0%      -6.7%       2904 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      3114 ~ 0%      -6.7%       2904 ~ 0%  TOTAL iostat.md0.w/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 7.507e+09 ~ 1%     -11.4%  6.648e+09 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 9.442e+09 ~ 1%      -2.7%  9.183e+09 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 7.953e+10 ~ 0%      -6.2%  7.464e+10 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 1.016e+10 ~ 1%      +6.2%   1.08e+10 ~ 2%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 1.066e+11 ~ 0%      -5.0%  1.013e+11 ~ 0%  TOTAL perf-stat.L1-dcache-store-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 1.429e+08 ~ 3%      +6.7%  1.524e+08 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 1.429e+08 ~ 3%      +6.7%  1.524e+08 ~ 1%  TOTAL perf-stat.node-prefetch-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 3.414e+08 ~ 1%     -10.2%  3.064e+08 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 3.344e+08 ~ 0%      -5.7%  3.153e+08 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 4.325e+09 ~ 0%      -6.5%  4.045e+09 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 7.883e+09 ~ 2%      +4.2%   8.21e+09 ~ 2%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 1.288e+10 ~ 2%      -0.0%  1.288e+10 ~ 1%  TOTAL perf-stat.cache-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
  2.17e+08 ~ 1%      -9.4%  1.965e+08 ~ 2%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
   1.8e+08 ~ 1%      -3.2%  1.741e+08 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 1.902e+09 ~ 0%      -6.6%  1.776e+09 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 2.298e+09 ~ 0%      -6.6%  2.146e+09 ~ 0%  TOTAL perf-stat.LLC-load-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
        15 ~ 0%      +6.7%         16 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
        15 ~ 0%      +6.7%         16 ~ 0%  TOTAL time.percent_of_cpu_this_job_got

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     71087 ~ 1%     -13.7%      61323 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     96152 ~ 0%      -4.6%      91690 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
    398295 ~ 0%      -7.1%     369881 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    101932 ~ 0%      +3.3%     105271 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
    100595 ~ 0%      +1.9%     102504 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
    768062 ~ 0%      -4.9%     730670 ~ 0%  TOTAL vmstat.io.bo

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     71101 ~ 1%     -13.7%      61338 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
     96102 ~ 0%      -4.6%      91674 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
    101782 ~ 0%      +3.3%     105125 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
    100447 ~ 0%      +1.9%     102354 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
    369434 ~ 0%      -2.4%     360491 ~ 0%  TOTAL iostat.sda.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 6.563e+08 ~ 5%      +7.1%   7.03e+08 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 6.563e+08 ~ 5%      +7.1%   7.03e+08 ~ 0%  TOTAL perf-stat.node-prefetches

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 3.096e+09 ~ 0%      +8.9%  3.373e+09 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 1.218e+10 ~ 0%      +8.2%  1.318e+10 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 3.118e+11 ~ 0%      +1.9%  3.177e+11 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 3.271e+11 ~ 0%      +2.2%  3.342e+11 ~ 1%  TOTAL perf-stat.L1-icache-load-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
   1144176 ~ 2%      -6.4%    1071004 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
    844745 ~ 0%      -5.9%     795214 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
   1988921 ~ 1%      -6.2%    1866219 ~ 0%  TOTAL perf-stat.context-switches

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 1.193e+09 ~ 1%      -4.4%  1.141e+09 ~ 1%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 1.705e+10 ~ 1%      -6.2%  1.599e+10 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 1.824e+10 ~ 1%      -6.1%  1.713e+10 ~ 2%  TOTAL perf-stat.LLC-loads

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 9.048e+08 ~ 1%      +6.4%  9.628e+08 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 4.005e+09 ~ 1%      +7.6%  4.309e+09 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 9.552e+11 ~ 0%      -2.5%  9.314e+11 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 9.601e+11 ~ 0%      -2.4%  9.367e+11 ~ 0%  TOTAL perf-stat.branch-load-misses

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     39933 ~ 0%      -6.9%      37192 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     63184 ~ 0%      +1.8%      64293 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
    103117 ~ 0%      -1.6%     101486 ~ 0%  TOTAL iostat.sdh.wkB/s

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
      1887 ~ 2%      -6.4%       1766 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
      1394 ~ 0%      -5.9%       1311 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
     12273 ~ 0%      +3.2%      12672 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
     12106 ~ 0%      +2.0%      12349 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
     27661 ~ 0%      +1.6%      28099 ~ 0%  TOTAL vmstat.system.cs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 7.941e+09 ~ 0%      +6.4%  8.451e+09 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
 4.571e+10 ~ 0%      +2.1%  4.666e+10 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 5.365e+10 ~ 0%      +2.7%  5.511e+10 ~ 0%  TOTAL perf-stat.cache-references

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 1.779e+08 ~ 0%      -4.5%  1.698e+08 ~ 2%  bay/micro/dd-write/1HDD-cfq-xfs-100dd
 2.702e+09 ~ 0%      -2.5%  2.634e+09 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
  2.88e+09 ~ 0%      -2.6%  2.804e+09 ~ 1%  TOTAL perf-stat.L1-dcache-prefetches

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
     15.16 ~ 1%      +2.5%      15.54 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      6.83 ~ 0%      +3.4%       7.07 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
      7.43 ~ 0%      +1.8%       7.56 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
     29.42 ~ 0%      +2.5%      30.17 ~ 0%  TOTAL turbostat.%c0

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
 1.253e+08 ~ 0%      +3.2%  1.294e+08 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
 1.237e+08 ~ 0%      +1.8%  1.259e+08 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
  2.49e+08 ~ 0%      +2.5%  2.553e+08 ~ 0%  TOTAL time.file_system_outputs

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       135 ~ 0%      +1.5%        137 ~ 0%  bay/micro/dd-write/1HDD-cfq-xfs-10dd
       135 ~ 0%      +1.5%        137 ~ 0%  TOTAL iostat.sda.avgqu-sz

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       139 ~ 0%      +1.1%        141 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       139 ~ 0%      +1.1%        141 ~ 0%  TOTAL iostat.sdg.avgqu-sz

836ecc5f024669e  6903673566d0289680e593dac  
---------------  -------------------------  
       139 ~ 0%      +0.9%        141 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       139 ~ 0%      +0.9%        141 ~ 0%  TOTAL iostat.sdj.avgqu-sz


Legend:
	~XX%    - stddev percent
	[+-]XX% - change percent


                           time.voluntary_context_switches

   3500 ++----------------------------------------*-------------------------+
        *...*...*..*...*...*...*..*...*...*...*.     *...*...*...*..*...*...*
   3000 ++                                                                  |
        |                                                                   |
        |                                                                   |
   2500 ++                                                                  |
        |                  O                                                |
   2000 ++                                                                  |
        |                         O                                         |
   1500 ++                                                                  |
        |       O              O      O              O       O              |
        |          O   O                      O   O      O       O      O   |
   1000 O+                                O                         O       |
        |   O                                                               |
    500 ++------------------------------------------------------------------+


	[*] bisect-good sample
	[O] bisect-bad  sample

Thanks,
Fengguang

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [writeback] 6903673566d: +2.5% fileio.requests_per_sec
  2014-04-10 12:41 [writeback] 6903673566d: +2.5% fileio.requests_per_sec Fengguang Wu
@ 2014-04-10 13:05 ` Fengguang Wu
  2014-04-10 19:27   ` Jan Kara
  2014-04-10 13:08 ` Fengguang Wu
  1 sibling, 1 reply; 6+ messages in thread
From: Fengguang Wu @ 2014-04-10 13:05 UTC (permalink / raw)
  To: Jan Kara; +Cc: LKML, linux-fsdevel, lkp

On Thu, Apr 10, 2014 at 08:41:37PM +0800, Fengguang Wu wrote:
> Hi Jan,
> 
> I tried your writeback dirty list patchset and noticed some ups/downs.
> The main performance changes are
> 
> 1) +2.5% fileio.requests_per_sec
> 2) -7.1% iostat.md0.wkB/s
> 
> git://bee.sh.intel.com/git/wfg/linux-devel.git jan-dirty-list
> commit 6903673566d0289680e593dac088c787d119b067 ("writeback: Replace several writeback lists with inode tagging")
> 
> 836ecc5f024669e  6903673566d0289680e593dac  
> ---------------  -------------------------  
>       6526 ~ 0%      +3.2%       6736 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
>       6441 ~ 0%      +1.8%       6558 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
>      12968 ~ 0%      +2.5%      13295 ~ 0%  TOTAL fileio.requests_per_sec
> 
> 836ecc5f024669e  6903673566d0289680e593dac  
> ---------------  -------------------------  
>     398147 ~ 0%      -7.1%     369866 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
>     398147 ~ 0%      -7.1%     369866 ~ 0%  TOTAL iostat.md0.wkB/s
> 

Here are the changed stats before/after the patchset:

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     58.98 ~102%     -73.2%      15.78       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
   2215.64 ~61%     -69.2%     682.57       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
    185.22 ~132%     -93.6%      11.80       snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndwr-sync
   2459.84 ~67%     -71.1%     710.15       TOTAL fileio.request_latency_max_ms

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      6251 ~ 0%      +4.0%       6503       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
      6532 ~ 0%      +3.2%       6737 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
      6444 ~ 0%      +1.7%       6554 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
     19227 ~ 0%      +3.0%      19795       TOTAL fileio.requests_per_sec

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    106344 ~ 0%  +19150.1%   20471397 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
    106344 ~ 0%  +19150.1%   20471397 ~ 0%  TOTAL proc-vmstat.numa_local

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
         0 ~ 0%      +Inf%          5       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-1dd
         0 ~ 0%      +Inf%          5       TOTAL ftrace.balance_dirty_pages.md0.period

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       301 ~ 0%     -95.4%         14       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-10dd
       299 ~ 0%     -95.0%         15       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       600 ~ 0%     -95.2%         29       TOTAL ftrace.writeback_single_inode.md0.age

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     11335 ~24%   +1627.5%     195821       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
     11335 ~24%   +1627.5%     195821       TOTAL numa-vmstat.node1.numa_other

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    126591 ~ 4%     -88.2%      14928       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
    126591 ~ 4%     -88.2%      14928       TOTAL numa-vmstat.node0.numa_other

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
         6 ~37%  +4.5e+08%   28490268       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
         6 ~37%  +4.5e+08%   28490268       TOTAL ftrace.balance_dirty_pages.sdj.think

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        27 ~ 8%    -1e+08%  -28490233       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
        27 ~ 8%    -1e+08%  -28490233       TOTAL ftrace.balance_dirty_pages.sdj.pause

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        60 ~24%  +15775.8%       9541 ~ 4%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
        60 ~24%  +15775.8%       9541 ~ 4%  TOTAL numa-vmstat.node1.nr_vmscan_immediate_reclaim

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        38 ~27%  +19600.4%       7584 ~ 3%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
        38 ~27%  +19600.4%       7584 ~ 3%  TOTAL numa-vmstat.node0.nr_vmscan_immediate_reclaim

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       113 ~12%  +45711.4%      51812 ~ 7%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       398 ~38%   +4145.0%      16912       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-1dd
       511 ~32%  +13335.9%      68724       TOTAL proc-vmstat.nr_vmscan_immediate_reclaim

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
         0 ~ 0%      +Inf%          7       brickland1/micro/will-it-scale/eventfd1
         0 ~ 0%      +Inf%          8       brickland1/micro/will-it-scale/malloc1
         0 ~ 0%      +Inf%         15       TOTAL numa-numastat.node3.other_node

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     43206 ~ 3%   +1379.5%     639229 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
     43206 ~ 3%   +1379.5%     639229 ~ 0%  TOTAL meminfo.Committed_AS

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       336 ~ 8%  +79377.7%     267363 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
       336 ~ 8%  +79377.7%     267363 ~ 0%  TOTAL meminfo.Shmem

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     19923 ~ 1%    +853.4%     189946 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
     19923 ~ 1%    +853.4%     189946 ~ 0%  TOTAL meminfo.AnonPages

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       113 ~14%  +18974.6%      21726 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
       113 ~14%  +18974.6%      21726 ~ 0%  TOTAL meminfo.Inactive(anon)

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     19815 ~ 0%   +2095.6%     435053 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
     19815 ~ 0%   +2095.6%     435053 ~ 0%  TOTAL meminfo.Active(anon)

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    139663 ~ 0%  +15894.2%   22338086 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
    139663 ~ 0%  +15894.2%   22338086 ~ 0%  TOTAL proc-vmstat.pgfault

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     42303 ~ 0%  +48170.1%   20419931 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
     42303 ~ 0%  +48170.1%   20419931 ~ 0%  TOTAL proc-vmstat.pgfree

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     53623 ~ 1%  +19416.6%   10465479 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
     53623 ~ 1%  +19416.6%   10465479 ~ 0%  TOTAL proc-vmstat.pgalloc_normal

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    106344 ~ 0%  +19150.1%   20471397 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
    106344 ~ 0%  +19150.1%   20471397 ~ 0%  TOTAL proc-vmstat.numa_hit

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        21 ~12%    +415.6%        112 ~ 2%  nhm-white/sysbench/oltp/600s-100%-1000000
        21 ~12%    +415.6%        112 ~ 2%  TOTAL proc-vmstat.nr_written

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        83 ~ 8%  +79558.4%      66833 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
        83 ~ 8%  +79558.4%      66833 ~ 0%  TOTAL proc-vmstat.nr_shmem

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      4962 ~ 1%    +856.9%      47485 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      4962 ~ 1%    +856.9%      47485 ~ 0%  TOTAL proc-vmstat.nr_anon_pages

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      0.19 ~ 0%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
      0.19 ~ 0%    -100.0%       0.00       TOTAL turbostat.GFX_W

(note: some turbostat stats are missing due to unreliable MSR reading)

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      4916 ~ 0%   +2112.4%     108762 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      4916 ~ 0%   +2112.4%     108762 ~ 0%  TOTAL proc-vmstat.nr_active_anon

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        28 ~15%  +19204.6%       5424 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
        28 ~15%  +19204.6%       5424 ~ 0%  TOTAL proc-vmstat.nr_inactive_anon

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
         0 ~ 0%      +Inf%          8 ~ 5%  nhm-white/sysbench/oltp/600s-100%-1000000
         0 ~ 0%      +Inf%          8 ~ 5%  TOTAL vmstat.procs.r

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
         6 ~41%  +7.1e+08%   43733639 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
         6 ~41%  +7.1e+08%   43733639 ~ 0%  TOTAL interrupts.TLB

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        54 ~ 9%  +6.4e+10%  3.436e+10 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
        54 ~ 9%  +6.4e+10%  3.436e+10 ~ 0%  TOTAL interrupts.CAL

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        82 ~15%  +5.5e+05%     454099 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
        82 ~15%  +5.5e+05%     454099 ~ 0%  TOTAL interrupts.LOC

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        25 ~39%    +6e+05%     151016 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
        25 ~39%    +6e+05%     151016 ~ 0%  TOTAL interrupts.44:HPET_MSI-edge.hpet6

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        35 ~42%  +4.3e+05%     151755 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
        35 ~42%  +4.3e+05%     151755 ~ 0%  TOTAL interrupts.43:HPET_MSI-edge.hpet5

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
         0 ~282%    -100.0%          0       lkp-a04/micro/netperf/300s-200%-UDP_RR
         0 ~282%    -100.0%          0       TOTAL last_state.is_incomplete_run

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        28 ~33%  +5.3e+05%     151455 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
        28 ~33%  +5.3e+05%     151455 ~ 0%  TOTAL interrupts.41:HPET_MSI-edge.hpet3

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        26 ~49%  +5.7e+05%     151608 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
        26 ~49%  +5.7e+05%     151608 ~ 0%  TOTAL interrupts.40:HPET_MSI-edge.hpet2

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1113 ~ 3%   +1427.7%      17015 ~15%  nhm-white/sysbench/oltp/600s-100%-1000000
      1113 ~ 3%   +1427.7%      17015 ~15%  TOTAL cpuidle.C6-NHM.usage

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   7250695 ~ 3%   +1121.2%   88543500 ~ 5%  nhm-white/sysbench/oltp/600s-100%-1000000
   7250695 ~ 3%   +1121.2%   88543500 ~ 5%  TOTAL cpuidle.C6-NHM.time

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       462 ~13%  +16780.7%      78140 ~ 8%  nhm-white/sysbench/oltp/600s-100%-1000000
       462 ~13%  +16780.7%      78140 ~ 8%  TOTAL cpuidle.C3-NHM.usage

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    353107 ~24%   +1136.1%    4364750 ~ 6%  nhm-white/sysbench/oltp/600s-100%-1000000
    353107 ~24%   +1136.1%    4364750 ~ 6%  TOTAL cpuidle.C3-NHM.time

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1.61 ~ 0%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
      1.61 ~ 0%    -100.0%       0.00       TOTAL turbostat.GHz

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      3.31 ~ 0%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
      3.31 ~ 0%    -100.0%       0.00       TOTAL turbostat.TSC

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      5.51 ~24%     -99.3%       0.04 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      2.54 ~ 4%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
      8.05 ~17%     -99.5%       0.04       TOTAL turbostat.%c3

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     79.94 ~ 7%     -98.2%       1.40 ~ 7%  nhm-white/sysbench/oltp/600s-100%-1000000
     87.61 ~ 0%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
    167.55 ~ 3%     -99.2%       1.40       TOTAL turbostat.%c6

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      7.01 ~ 4%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
      7.01 ~ 4%    -100.0%       0.00       TOTAL turbostat.%pc3

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     57.83 ~ 1%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
     57.83 ~ 1%    -100.0%       0.00       TOTAL turbostat.%pc6

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     18.12 ~15%   +3374.7%     629.51 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
     18.12 ~15%   +3374.7%     629.51 ~ 0%  TOTAL uptime.boot

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      4629 ~15%  +12872.8%     600509 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      4629 ~15%  +12872.8%     600509 ~ 0%  TOTAL softirqs.TIMER

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   1142757 ~33%   +2328.9%   27756867       grantley/micro/kbuild/200%
   1142757 ~33%   +2328.9%   27756867       TOTAL cpuidle.C1E-HSW.time

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     13345 ~ 0%     -59.6%       5397 ~ 9%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      4117 ~ 2%     -89.9%        416       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-1dd
     17462 ~ 0%     -66.7%       5813       TOTAL proc-vmstat.pgpgin

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      4.05 ~ 0%     +17.7%       4.77       lkp-snb01/micro/hackbench/50%-process-socket
      7.83 ~36%     -89.0%       0.86 ~ 7%  nhm-white/sysbench/oltp/600s-100%-1000000
      8.13 ~ 2%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
     20.01 ~15%     -71.9%       5.63       TOTAL turbostat.%c1

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    289344 ~ 0%     -28.0%     208207       brickland1/micro/will-it-scale/malloc1
      1935 ~34%   +1407.6%      29173 ~ 1%  nhm-white/sysbench/oltp/600s-100%-1000000
    291279 ~ 1%     -18.5%     237380       TOTAL softirqs.SCHED

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     10714 ~ 2%     +35.8%      14547       lkp-snb01/micro/hackbench/50%-threads-socket
     10714 ~ 2%     +35.8%      14547       TOTAL cpuidle.POLL.time

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1458 ~ 0%    +245.6%       5041 ~ 5%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       964 ~ 6%    +181.8%       2717       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-1dd
      2423 ~ 2%    +220.2%       7758       TOTAL meminfo.Buffers

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1464 ~ 0%    +243.8%       5033 ~ 5%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       963 ~ 6%    +181.9%       2715       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-1dd
      2427 ~ 2%    +219.2%       7748       TOTAL vmstat.memory.buff

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   1678626 ~ 1%     -16.8%    1396961       lkp-snb01/micro/hackbench/50%-threads-socket
     53471 ~ 1%  +18655.2%   10028644 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
   1732097 ~ 1%    +559.6%   11425605       TOTAL proc-vmstat.pgalloc_dma32

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    276111 ~ 0%    +189.1%     798315 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
    276111 ~ 0%    +189.1%     798315 ~ 0%  TOTAL meminfo.Active

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        40 ~13%    +199.8%        121 ~ 4%  nhm-white/sysbench/oltp/600s-100%-1000000
        40 ~13%    +199.8%        121 ~ 4%  TOTAL proc-vmstat.nr_dirtied

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1444 ~ 4%     -64.6%        512       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqwr-sync
      1444 ~ 4%     -64.6%        512       TOTAL proc-vmstat.slabs_scanned

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   3433682 ~ 3%     +76.1%    6047439       brickland1/micro/will-it-scale/context_switch1
 2.281e+08 ~ 0%     -26.5%  1.676e+08       lkp-snb01/micro/hackbench/50%-process-socket
        42 ~42%  +5.9e+05%     250922 ~ 8%  nhm-white/sysbench/oltp/600s-100%-1000000
 2.315e+08 ~ 0%     -24.9%  1.739e+08       TOTAL interrupts.RES

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      6509 ~ 1%    +122.8%      14502 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      6509 ~ 1%    +122.8%      14502 ~ 0%  TOTAL meminfo.Mapped

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1624 ~ 1%    +123.0%       3622 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      1624 ~ 1%    +123.0%       3622 ~ 0%  TOTAL proc-vmstat.nr_mapped

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     60148 ~ 0%    +119.0%     131746 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
     60148 ~ 0%    +119.0%     131746 ~ 0%  TOTAL proc-vmstat.pgactivate

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1299 ~ 0%    +113.1%       2770       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
      1299 ~ 0%    +113.1%       2770       TOTAL slabinfo.inode_cache.num_slabs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1299 ~ 0%    +113.1%       2770       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
      1299 ~ 0%    +113.1%       2770       TOTAL slabinfo.inode_cache.active_slabs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     36400 ~ 0%    +113.1%      77568       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
     36400 ~ 0%    +113.1%      77568       TOTAL slabinfo.inode_cache.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     36400 ~ 0%    +113.1%      77568       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
     36400 ~ 0%    +113.1%      77568       TOTAL slabinfo.inode_cache.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       871 ~ 3%    +111.9%       1847 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       871 ~ 3%    +111.9%       1847 ~ 1%  TOTAL slabinfo.journal_head.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       871 ~ 3%    +111.9%       1847 ~ 1%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       871 ~ 3%    +111.9%       1847 ~ 1%  TOTAL slabinfo.journal_head.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1004 ~ 1%     +98.2%       1992       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      1004 ~ 1%     +98.2%       1992       TOTAL slabinfo.blkdev_ioc.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1004 ~ 1%     +98.2%       1992       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      1004 ~ 1%     +98.2%       1992       TOTAL slabinfo.blkdev_ioc.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     52985 ~ 1%     +78.1%      94356       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
     52985 ~ 1%     +78.1%      94356       TOTAL slabinfo.dentry.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1310 ~ 2%     +74.6%       2288       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
      1310 ~ 2%     +74.6%       2288       TOTAL slabinfo.dentry.num_slabs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1310 ~ 2%     +74.6%       2288       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
      1310 ~ 2%     +74.6%       2288       TOTAL slabinfo.dentry.active_slabs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     55053 ~ 2%     +74.6%      96103       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
     55053 ~ 2%     +74.6%      96103       TOTAL slabinfo.dentry.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     77560 ~ 0%     +57.2%     121943       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
     77560 ~ 0%     +57.2%     121943       TOTAL numa-vmstat.node0.numa_interleave

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    443786 ~ 1%     +56.2%     693171       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
    443786 ~ 1%     +56.2%     693171       TOTAL numa-meminfo.node0.Unevictable

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    110946 ~ 1%     +56.2%     173293       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
    110946 ~ 1%     +56.2%     173293       TOTAL numa-vmstat.node0.nr_unevictable

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    888585 ~ 0%     +56.9%    1394516       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
    888585 ~ 0%     +56.9%    1394516       TOTAL meminfo.Unevictable

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    222138 ~ 0%     +56.9%     348629       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
    222138 ~ 0%     +56.9%     348629       TOTAL proc-vmstat.nr_unevictable

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    111193 ~ 1%     +57.7%     175319       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
    111193 ~ 1%     +57.7%     175319       TOTAL numa-vmstat.node1.nr_unevictable

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    444788 ~ 1%     +57.7%     701278       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
    444788 ~ 1%     +57.7%     701278       TOTAL numa-meminfo.node1.Unevictable

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    228867 ~ 0%     +56.8%     358782       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
    228867 ~ 0%     +56.8%     358782       TOTAL proc-vmstat.unevictable_pgs_culled

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    118645 ~ 0%     +56.0%     185035       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
    118645 ~ 0%     +56.0%     185035       TOTAL numa-vmstat.node1.numa_interleave

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    806025 ~ 0%     -32.0%     548209 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
    806025 ~ 0%     -32.0%     548209 ~ 0%  TOTAL meminfo.Inactive(file)

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    201314 ~ 0%     -31.9%     137056 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
    201314 ~ 0%     -31.9%     137056 ~ 0%  TOTAL proc-vmstat.nr_inactive_file

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     62735 ~ 0%     +44.8%      90811 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
     62735 ~ 0%     +44.8%      90811 ~ 0%  TOTAL proc-vmstat.nr_active_file

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    256295 ~ 0%     +41.7%     363261 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
    256295 ~ 0%     +41.7%     363261 ~ 0%  TOTAL meminfo.Active(file)

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    806139 ~ 0%     -29.3%     569936 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
    806139 ~ 0%     -29.3%     569936 ~ 0%  TOTAL meminfo.Inactive

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    501575 ~ 1%     +34.8%     676169       lkp-snb01/micro/hackbench/50%-process-socket
    501575 ~ 1%     +34.8%     676169       TOTAL cpuidle.C7-SNB.usage

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      7712 ~ 0%     -25.4%       5753       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      7712 ~ 0%     -25.4%       5753       TOTAL ftrace.writeback_single_inode.sdh.wrote

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      7721 ~ 1%     -25.6%       5746       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      7721 ~ 1%     -25.6%       5746       TOTAL ftrace.writeback_single_inode.sdn.wrote

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      7669 ~ 0%     -24.2%       5817       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      7669 ~ 0%     -24.2%       5817       TOTAL ftrace.writeback_single_inode.sdk.wrote

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      7732 ~ 1%     -23.9%       5885       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      7732 ~ 1%     -23.9%       5885       TOTAL ftrace.writeback_single_inode.sdd.wrote

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       735 ~ 2%     +33.6%        982 ~ 2%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       735 ~ 2%     +33.6%        982 ~ 2%  TOTAL slabinfo.dquot.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       735 ~ 2%     +33.6%        982 ~ 2%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
       735 ~ 2%     +33.6%        982 ~ 2%  TOTAL slabinfo.dquot.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1258 ~ 7%     +34.6%       1693 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      1258 ~ 7%     +34.6%       1693 ~ 0%  TOTAL meminfo.KernelStack

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      6582 ~ 0%     -23.1%       5061       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      6582 ~ 0%     -23.1%       5061       TOTAL ftrace.writeback_single_inode.sdf.wrote

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      6573 ~ 0%     -22.9%       5067       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      6573 ~ 0%     -22.9%       5067       TOTAL ftrace.writeback_single_inode.sde.wrote

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
  79778955 ~ 0%     +11.3%   88774228       lkp-snb01/micro/hackbench/50%-process-pipe
  7.14e+08 ~ 0%     +18.3%  8.445e+08       lkp-snb01/micro/hackbench/50%-process-socket
 2.796e+08 ~ 4%     +53.7%  4.299e+08       lkp-snb01/micro/hackbench/50%-threads-socket
 1.073e+09 ~ 1%     +27.0%  1.363e+09       TOTAL cpuidle.C1-SNB.time

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      7710 ~ 0%     -22.8%       5952       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      7710 ~ 0%     -22.8%       5952       TOTAL ftrace.writeback_single_inode.sdg.wrote

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      6937 ~ 1%     -22.5%       5376       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
      6937 ~ 1%     -22.5%       5376       TOTAL slabinfo.kmalloc-32.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      6937 ~ 1%     -22.5%       5376       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
      6937 ~ 1%     -22.5%       5376       TOTAL slabinfo.kmalloc-32.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      6584 ~ 1%     -21.9%       5146       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      6584 ~ 1%     -21.9%       5146       TOTAL ftrace.writeback_single_inode.sdl.wrote

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     50448 ~ 0%     -20.6%      40041       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     50448 ~ 0%     -20.6%      40041       TOTAL ftrace.writeback_single_inode.md0.wrote

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      7808 ~ 0%     -14.8%       6654       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
      7695 ~ 1%     -25.5%       5735       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
     15503 ~ 0%     -20.1%      12389       TOTAL ftrace.writeback_single_inode.sdj.wrote

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
  88970623 ~ 0%     +11.6%   99315909       lkp-snb01/micro/hackbench/50%-process-socket
   7645226 ~ 0%     +13.0%    8638062       lkp-snb01/micro/hackbench/50%-threads-pipe
  41232102 ~ 3%     +49.6%   61702366       lkp-snb01/micro/hackbench/50%-threads-socket
 137847952 ~ 1%     +23.1%  169656337       TOTAL cpuidle.C1-SNB.usage

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     68788 ~ 0%     +25.6%      86413       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
     68788 ~ 0%     +25.6%      86413       TOTAL slabinfo.radix_tree_node.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   5193355 ~ 0%     -20.2%    4145155       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-100dd
   5193355 ~ 0%     -20.2%    4145155       TOTAL meminfo.DirectMap2M

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      2525 ~ 0%     +25.0%       3156       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
      2525 ~ 0%     +25.0%       3156       TOTAL slabinfo.radix_tree_node.num_slabs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      2525 ~ 0%     +25.0%       3156       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
      2525 ~ 0%     +25.0%       3156       TOTAL slabinfo.radix_tree_node.active_slabs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     70733 ~ 0%     +24.9%      88377       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
     70733 ~ 0%     +24.9%      88377       TOTAL slabinfo.radix_tree_node.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      9212 ~ 0%     +22.2%      11259       lkp-snb01/micro/hackbench/50%-threads-socket
      9212 ~ 0%     +22.2%      11259       TOTAL slabinfo.anon_vma.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      9212 ~ 0%     +22.2%      11259       lkp-snb01/micro/hackbench/50%-threads-socket
      9212 ~ 0%     +22.2%      11259       TOTAL slabinfo.anon_vma.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   2938608 ~ 0%     -11.3%    2606174       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-10dd
   3037554 ~ 0%     -19.1%    2457633       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
   5976162 ~ 0%     -15.3%    5063807       TOTAL ftrace.writeback_single_inode.md0.index

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1696 ~ 0%     +17.8%       1999       lkp-snb01/micro/hackbench/50%-process-pipe
      1696 ~ 0%     +17.8%       1999       TOTAL numa-meminfo.node0.KernelStack

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     18537 ~ 1%     +16.1%      21522       lkp-snb01/micro/hackbench/50%-threads-socket
     18537 ~ 1%     +16.1%      21522       TOTAL slabinfo.kmalloc-512.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      3290 ~ 1%     +16.9%       3848       lkp-snb01/micro/hackbench/50%-threads-pipe
      3290 ~ 1%     +16.9%       3848       TOTAL numa-vmstat.node0.nr_active_anon

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     13163 ~ 1%     +16.9%      15393       lkp-snb01/micro/hackbench/50%-threads-pipe
     13163 ~ 1%     +16.9%      15393       TOTAL numa-meminfo.node0.Active(anon)

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     19720 ~ 1%     +15.3%      22730       lkp-snb01/micro/hackbench/50%-threads-socket
     19720 ~ 1%     +15.3%      22730       TOTAL slabinfo.kmalloc-256.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   3393952 ~ 0%     -14.0%    2917652       lkp-snb01/micro/hackbench/50%-threads-socket
   3393952 ~ 0%     -14.0%    2917652       TOTAL numa-numastat.node0.local_node

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   3396723 ~ 0%     -14.0%    2921810       lkp-snb01/micro/hackbench/50%-threads-socket
   3396723 ~ 0%     -14.0%    2921810       TOTAL numa-numastat.node0.numa_hit

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     13388 ~ 0%     +14.3%      15306       lkp-snb01/micro/hackbench/50%-threads-socket
     13388 ~ 0%     +14.3%      15306       TOTAL slabinfo.kmalloc-512.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   1033631 ~ 0%     +14.2%    1180789 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
   1033631 ~ 0%     +14.2%    1180789 ~ 0%  TOTAL vmstat.memory.cache

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1.00 ~ 0%     +13.6%       1.14       lkp-snb01/micro/hackbench/50%-process-pipe
      1.00 ~ 0%     +13.6%       1.14       TOTAL perf-profile.cpu-cycles._raw_spin_lock_irq.__schedule.schedule.pipe_wait.pipe_read

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     14401 ~ 0%     +13.2%      16307       lkp-snb01/micro/hackbench/50%-threads-socket
     14401 ~ 0%     +13.2%      16307       TOTAL slabinfo.kmalloc-256.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    264650 ~ 0%     +11.6%     295224 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
    264650 ~ 0%     +11.6%     295224 ~ 0%  TOTAL proc-vmstat.nr_file_pages

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   1064719 ~ 0%     +10.9%    1180924 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
   1064719 ~ 0%     +10.9%    1180924 ~ 0%  TOTAL meminfo.Cached

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1812 ~ 0%     +10.8%       2008       lkp-snb01/micro/hackbench/50%-threads-pipe
      1812 ~ 0%     +10.8%       2008       TOTAL slabinfo.shmem_inode_cache.num_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1812 ~ 0%     +10.8%       2008       lkp-snb01/micro/hackbench/50%-threads-pipe
      1812 ~ 0%     +10.8%       2008       TOTAL slabinfo.shmem_inode_cache.active_objs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    160064 ~ 0%      -9.6%     144705       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
    160064 ~ 0%      -9.6%     144705       TOTAL ftrace.global_dirty_state.writeback

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    636193 ~ 0%      -9.3%     577223       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
    636193 ~ 0%      -9.3%     577223       TOTAL meminfo.Writeback

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    159052 ~ 0%      -9.3%     144320       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
    159052 ~ 0%      -9.3%     144320       TOTAL proc-vmstat.nr_writeback

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     22706 ~ 0%     +10.0%      24983       lkp-snb01/micro/hackbench/50%-process-pipe
     22706 ~ 0%     +10.0%      24983       TOTAL numa-meminfo.node0.SUnreclaim

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      0.12 ~ 2%    +3e+05%     357.41 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      0.12 ~ 2%    +3e+05%     357.41 ~ 0%  TOTAL time.system_time

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      5.17 ~ 1%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
      5.17 ~ 1%    -100.0%       0.00       TOTAL turbostat.Pkg_W

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1.30 ~ 1%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
      1.30 ~ 1%    -100.0%       0.00       TOTAL turbostat.Cor_W

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    845987 ~24%  +1.5e+05%  1.281e+09       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
    845987 ~24%  +1.5e+05%  1.281e+09       TOTAL perf-stat.L1-dcache-prefetch-misses

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      0.18 ~ 0%  +3.4e+05%     612.05 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      0.18 ~ 0%  +3.4e+05%     612.05 ~ 0%  TOTAL time.elapsed_time

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      6.72 ~42%   +1353.6%      97.70 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      1.73 ~ 0%    -100.0%       0.00       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
      8.45 ~34%   +1056.6%      97.70       TOTAL turbostat.%c0

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     23955 ~ 0%     -66.3%       8066 ~13%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
     23955 ~ 0%     -66.3%       8066 ~13%  TOTAL time.file_system_inputs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   2426126 ~ 0%     -20.0%    1941432       lkp-snb01/micro/hackbench/50%-process-socket
      1874 ~ 0%  +15303.7%     288711 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
   2428000 ~ 0%      -8.1%    2230143       TOTAL vmstat.system.cs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   1331.09 ~ 0%      -5.7%    1255.69       lkp-snb01/micro/hackbench/50%-threads-pipe
      0.01 ~35%  +3.7e+06%     476.24 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
   1331.10 ~ 0%     +30.1%    1731.93       TOTAL time.user_time

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
 1.059e+09 ~ 0%     -20.5%  8.416e+08       lkp-snb01/micro/hackbench/50%-process-socket
 3.665e+09 ~ 0%      -5.3%  3.469e+09       lkp-snb01/micro/hackbench/50%-threads-pipe
      3313 ~ 1%     -60.9%       1295 ~ 6%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      1044 ~ 2%     -88.4%        121       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-1dd
       158 ~ 1%  +5.5e+07%   86532136 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
 4.724e+09 ~ 0%      -6.9%  4.397e+09       TOTAL time.voluntary_context_switches

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    389237 ~ 1%     -25.8%     288888       lkp-snb01/micro/hackbench/50%-process-socket
    799364 ~ 1%     -20.1%     638935       lkp-snb01/micro/hackbench/50%-threads-socket
       301 ~12%  +24385.9%      73727 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
   1188902 ~ 1%     -15.8%    1001550       TOTAL vmstat.system.in

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       542 ~ 1%     +88.6%       1023 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       542 ~ 1%     +88.6%       1023 ~ 1%  TOTAL iostat.sdc.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       128 ~ 1%     +88.5%        242 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       128 ~ 1%     +88.5%        242 ~ 1%  TOTAL iostat.sdc.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       129 ~ 3%     +86.3%        240 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       129 ~ 3%     +86.3%        240 ~ 1%  TOTAL iostat.sdb.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       544 ~ 3%     +86.4%       1015 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       544 ~ 3%     +86.4%       1015 ~ 1%  TOTAL iostat.sdb.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       556 ~ 2%     +83.0%       1018 ~ 3%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       556 ~ 2%     +83.0%       1018 ~ 3%  TOTAL iostat.sdi.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       131 ~ 2%     +82.7%        241 ~ 3%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       131 ~ 2%     +82.7%        241 ~ 3%  TOTAL iostat.sdi.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
        76 ~ 1%     +78.4%        135 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
        76 ~ 1%     +78.4%        135 ~ 0%  TOTAL time.percent_of_cpu_this_job_got

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       129 ~ 2%     +87.0%        241 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       152 ~ 1%     +44.2%        219       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       281 ~ 2%     +63.8%        460       TOTAL iostat.sdf.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       545 ~ 2%     +87.0%       1020 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       650 ~ 1%     +43.7%        935       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      1196 ~ 2%     +63.4%       1955       TOTAL iostat.sdf.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       551 ~ 2%     +89.1%       1042 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      1359 ~ 0%     +29.5%       1760       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      1910 ~ 1%     +46.7%       2803       TOTAL iostat.sdk.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       130 ~ 2%     +89.0%        246 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       321 ~ 0%     +29.7%        416       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       451 ~ 1%     +46.8%        663       TOTAL iostat.sdk.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       129 ~ 3%     +86.6%        240 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       320 ~ 1%     +29.6%        415       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       449 ~ 1%     +46.0%        656       TOTAL iostat.sdl.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       544 ~ 3%     +86.8%       1018 ~ 2%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      1357 ~ 1%     +29.4%       1756       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      1902 ~ 1%     +45.9%       2774       TOTAL iostat.sdl.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       126 ~ 2%     +90.0%        240 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       316 ~ 1%     +33.6%        422       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       151 ~ 1%     +46.5%        221       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       594 ~ 1%     +48.9%        884       TOTAL iostat.sde.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       535 ~ 2%     +90.1%       1017 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      1339 ~ 1%     +33.4%       1786       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       647 ~ 1%     +45.9%        943       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      2521 ~ 1%     +48.6%       3747       TOTAL iostat.sde.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       127 ~ 1%     +90.7%        243 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       318 ~ 1%     +30.1%        414       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       155 ~ 2%     +45.2%        225       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       601 ~ 1%     +46.9%        882       TOTAL iostat.sdd.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       131 ~ 2%     +88.6%        247 ~ 3%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       318 ~ 1%     +31.0%        416       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       156 ~ 2%     +43.7%        224       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       605 ~ 1%     +46.7%        888       TOTAL iostat.sdj.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       538 ~ 2%     +90.7%       1028 ~ 1%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      1348 ~ 1%     +29.9%       1752       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       663 ~ 2%     +44.6%        959       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      2551 ~ 1%     +46.6%       3739       TOTAL iostat.sdd.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       553 ~ 2%     +88.8%       1044 ~ 3%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      1346 ~ 1%     +30.8%       1762       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       666 ~ 2%     +43.1%        953       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      2566 ~ 1%     +46.5%       3760       TOTAL iostat.sdj.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       131 ~ 3%     +83.3%        241 ~ 3%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       317 ~ 1%     +32.7%        420       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       154 ~ 1%     +44.2%        222       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       602 ~ 2%     +46.7%        884       TOTAL iostat.sdg.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       555 ~ 3%     +83.4%       1018 ~ 3%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      1343 ~ 1%     +32.5%       1779       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       658 ~ 1%     +43.8%        946       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      2557 ~ 1%     +46.4%       3744       TOTAL iostat.sdg.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       132 ~ 1%     +82.1%        240 ~ 3%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       317 ~ 1%     +29.6%        411       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       152 ~ 1%     +44.4%        220       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
       602 ~ 1%     +44.9%        872       TOTAL iostat.sdh.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       558 ~ 1%     +82.2%       1017 ~ 3%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      1343 ~ 1%     +29.4%       1738       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       652 ~ 1%     +43.9%        939       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      2554 ~ 1%     +44.6%       3695       TOTAL iostat.sdh.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     32.15 ~ 0%     +35.0%      43.39       brickland2/fake/boot/1
     32.15 ~ 0%     +35.0%      43.39       TOTAL boottime.dhcp

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       319 ~ 1%     +30.8%        418       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       319 ~ 1%     +30.8%        418       TOTAL iostat.sdm.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1354 ~ 1%     +30.6%       1768       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      1354 ~ 1%     +30.6%       1768       TOTAL iostat.sdm.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
       320 ~ 1%     +27.5%        408       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
       320 ~ 1%     +27.5%        408       TOTAL iostat.sdn.rrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1357 ~ 1%     +27.3%       1728       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      1357 ~ 1%     +27.3%       1728       TOTAL iostat.sdn.rkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
 2.908e+08 ~ 0%     -30.6%  2.019e+08       lkp-snb01/micro/hackbench/50%-process-socket
  1.73e+09 ~ 0%      -6.1%  1.625e+09       lkp-snb01/micro/hackbench/50%-threads-pipe
 2.021e+09 ~ 0%      -9.6%  1.827e+09       TOTAL time.involuntary_context_switches

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   1143516 ~ 0%      -3.8%    1099560       lkp-snb01/micro/hackbench/1600%-threads-socket
   1043709 ~ 0%      +4.7%    1092509       lkp-snb01/micro/hackbench/50%-process-socket
     60606 ~ 0%      -4.3%      58016       lkp-snb01/micro/hackbench/50%-threads-pipe
     49922 ~ 0%      +5.3%      52557       lkp-snb01/micro/hackbench/50%-threads-socket
     21482 ~ 0%     +94.7%      41821 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
   2319237 ~ 0%      +1.1%    2344463       TOTAL time.minor_page_faults

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      4964 ~ 0%     +33.0%       6600       brickland2/fake/boot/1
      1135 ~ 0%     +11.8%       1269       lkp-ws02/fake/boot/1
       110 ~ 0%     +16.5%        128       xps2/fake/boot/1
      6210 ~ 0%     +28.8%       7998       TOTAL boottime.idle

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     52.02 ~ 1%     +28.7%      66.93       brickland2/fake/boot/1
     51.53 ~ 0%     +11.7%      57.55       lkp-ws02/fake/boot/1
     14.92 ~ 0%     +14.1%      17.02       xps2/fake/boot/1
    118.48 ~ 0%     +19.4%     141.50       TOTAL boottime.boot

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
 1.692e+10 ~ 0%     -14.2%  1.453e+10       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
 1.247e+10 ~ 4%     -17.5%  1.029e+10 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
 2.939e+10 ~ 2%     -15.6%  2.482e+10       TOTAL perf-stat.branch-misses

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      9650 ~ 0%      -6.7%       8999 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9650 ~ 0%      -6.7%       8999 ~ 0%  TOTAL iostat.sdb.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      9649 ~ 0%      -6.8%       8997 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      9649 ~ 0%      -6.8%       8997 ~ 0%  TOTAL iostat.sdc.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     39847 ~ 0%      -6.7%      37194 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39847 ~ 0%      -6.7%      37194 ~ 0%  TOTAL iostat.sdb.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     39846 ~ 0%      -6.7%      37185 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     39846 ~ 0%      -6.7%      37185 ~ 0%  TOTAL iostat.sdc.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
  1.06e+12 ~ 0%      -6.4%  9.925e+11       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
  1.06e+12 ~ 0%      -6.4%  9.925e+11       TOTAL perf-stat.branch-load-misses

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
 7.979e+10 ~ 0%      -6.1%  7.492e+10 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
 7.979e+10 ~ 0%      -6.1%  7.492e+10 ~ 0%  TOTAL perf-stat.L1-dcache-store-misses

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      9651 ~ 0%      -6.8%       8995 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      8707 ~ 0%      -5.1%       8263       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     18359 ~ 0%      -6.0%      17259       TOTAL iostat.sdj.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      3107 ~ 0%      -6.5%       2904 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      2823 ~ 0%      -5.3%       2675       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      5931 ~ 0%      -5.9%       5580       TOTAL iostat.md0.w/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     39855 ~ 0%      -6.7%      37178 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     36125 ~ 0%      -5.1%      34294       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     75980 ~ 0%      -5.9%      71473       TOTAL iostat.sdj.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     39851 ~ 0%      -6.7%      37188 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     36130 ~ 0%      -5.1%      34287       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     75982 ~ 0%      -5.9%      71475       TOTAL iostat.sdh.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     39855 ~ 0%      -6.7%      37186 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     36123 ~ 0%      -5.1%      34297       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     75979 ~ 0%      -5.9%      71483       TOTAL iostat.sdi.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     39847 ~ 0%      -6.7%      37182 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     36133 ~ 0%      -5.0%      34321       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     75981 ~ 0%      -5.9%      71504       TOTAL iostat.sde.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    397285 ~ 0%      -6.9%     369872 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    359312 ~ 0%      -5.5%     339685       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
    404981 ~ 0%      -4.5%     386775       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
   1161579 ~ 0%      -5.6%    1096334       TOTAL iostat.md0.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      9651 ~ 0%      -6.8%       8998 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      8708 ~ 0%      -5.1%       8262       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      9790 ~ 0%      -4.4%       9357       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     28150 ~ 0%      -5.4%      26617       TOTAL iostat.sdh.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      9652 ~ 0%      -6.8%       8997 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      8707 ~ 0%      -5.1%       8264       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      9790 ~ 0%      -4.4%       9359       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     28149 ~ 0%      -5.4%      26621       TOTAL iostat.sdi.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      9649 ~ 0%      -6.8%       8997 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      8707 ~ 0%      -5.1%       8266       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      9790 ~ 0%      -4.4%       9358       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     28147 ~ 0%      -5.4%      26622       TOTAL iostat.sdg.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      9649 ~ 0%      -6.8%       8996 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      8709 ~ 0%      -5.0%       8269       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      9792 ~ 0%      -4.4%       9359       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     28151 ~ 0%      -5.4%      26625       TOTAL iostat.sde.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      9651 ~ 0%      -6.8%       8999 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      8709 ~ 0%      -5.0%       8270       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      9792 ~ 0%      -4.5%       9355       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     28152 ~ 0%      -5.4%      26625       TOTAL iostat.sdk.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     39852 ~ 0%      -6.7%      37195 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     36133 ~ 0%      -5.0%      34322       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     40587 ~ 0%      -4.4%      38798       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    116573 ~ 0%      -5.4%     110316       TOTAL iostat.sdk.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     36126 ~ 0%      -5.1%      34289       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     36126 ~ 0%      -5.1%      34289       TOTAL iostat.sdd.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     36124 ~ 0%      -5.1%      34289       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     36124 ~ 0%      -5.1%      34289       TOTAL iostat.sdf.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     36124 ~ 0%      -5.0%      34306       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     36124 ~ 0%      -5.0%      34306       TOTAL iostat.sdg.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     36139 ~ 0%      -5.0%      34321       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     36139 ~ 0%      -5.0%      34321       TOTAL iostat.sdm.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      8707 ~ 0%      -5.1%       8262       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      9791 ~ 0%      -4.4%       9359       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     18499 ~ 0%      -4.7%      17621       TOTAL iostat.sdn.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      8707 ~ 0%      -5.1%       8262       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      9790 ~ 0%      -4.4%       9357       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     18497 ~ 0%      -4.7%      17619       TOTAL iostat.sdf.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      8707 ~ 0%      -5.1%       8262       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      9790 ~ 0%      -4.4%       9357       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     18498 ~ 0%      -4.7%      17619       TOTAL iostat.sdd.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      8710 ~ 0%      -5.1%       8263       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      9792 ~ 0%      -4.4%       9360       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     18503 ~ 0%      -4.8%      17624       TOTAL iostat.sdl.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      8710 ~ 0%      -5.1%       8269       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      9794 ~ 0%      -4.4%       9362       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     18504 ~ 0%      -4.7%      17632       TOTAL iostat.sdm.wrqm/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     36128 ~ 0%      -5.1%      34290       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     40587 ~ 0%      -4.4%      38816       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     76715 ~ 0%      -4.7%      73106       TOTAL iostat.sdn.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     36139 ~ 0%      -5.1%      34298       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
     40592 ~ 0%      -4.4%      38819       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     76731 ~ 0%      -4.7%      73118       TOTAL iostat.sdl.wkB/s

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    397303 ~ 0%      -6.7%     370499 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    359368 ~ 0%      -5.5%     339681       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
    404985 ~ 0%      -4.5%     386784       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
     99302 ~ 0%      +3.7%     103019       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
     97805 ~ 0%      +1.4%      99128       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqwr-sync
    102108 ~ 0%      +3.1%     105297 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
    100717 ~ 0%      +1.7%     102428 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
   1561591 ~ 0%      -3.5%    1506837       TOTAL vmstat.io.bo

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   1.2e+08 ~ 0%      +4.0%  1.249e+08       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
 1.254e+08 ~ 0%      +3.1%  1.294e+08 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
 1.237e+08 ~ 0%      +1.7%  1.259e+08 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
 3.692e+08 ~ 0%      +3.0%  3.801e+08       TOTAL time.file_system_outputs

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     99175 ~ 0%      +3.7%     102883       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
     97657 ~ 0%      +1.4%      98984       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqwr-sync
    101962 ~ 0%      +3.1%     105146 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
    100573 ~ 0%      +1.7%     102280 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
    399369 ~ 0%      +2.5%     409294       TOTAL iostat.sda.wkB/s

w

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [writeback] 6903673566d: +2.5% fileio.requests_per_sec
  2014-04-10 12:41 [writeback] 6903673566d: +2.5% fileio.requests_per_sec Fengguang Wu
  2014-04-10 13:05 ` Fengguang Wu
@ 2014-04-10 13:08 ` Fengguang Wu
  2014-04-10 13:17   ` Fengguang Wu
  1 sibling, 1 reply; 6+ messages in thread
From: Fengguang Wu @ 2014-04-10 13:08 UTC (permalink / raw)
  To: Jan Kara; +Cc: LKML, linux-fsdevel, lkp

On Thu, Apr 10, 2014 at 08:41:37PM +0800, Fengguang Wu wrote:
> Hi Jan,
> 
> I tried your writeback dirty list patchset and noticed some ups/downs.
> The main performance changes are
> 
> 1) +2.5% fileio.requests_per_sec
> 2) -7.1% iostat.md0.wkB/s
> 
> git://bee.sh.intel.com/git/wfg/linux-devel.git jan-dirty-list
> commit 6903673566d0289680e593dac088c787d119b067 ("writeback: Replace several writeback lists with inode tagging")
> 
> 836ecc5f024669e  6903673566d0289680e593dac  
> ---------------  -------------------------  
>       6526 ~ 0%      +3.2%       6736 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
>       6441 ~ 0%      +1.8%       6558 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
>      12968 ~ 0%      +2.5%      13295 ~ 0%  TOTAL fileio.requests_per_sec
> 
> 836ecc5f024669e  6903673566d0289680e593dac  
> ---------------  -------------------------  
>     398147 ~ 0%      -7.1%     369866 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
>     398147 ~ 0%      -7.1%     369866 ~ 0%  TOTAL iostat.md0.wkB/s

Here are the complete power performance comparisons:

# the higher index, the better
    98      perf-index  ea87e2e7e0905325c58cf5643
   105     power-index  ea87e2e7e0905325c58cf5643
    99   latency-index  ea87e2e7e0905325c58cf5643

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
   1193524           +8.9%    1299790       brickland2/micro/vm-scalability/300s-anon-cow-rand-64G
   2059999           -0.9%    2041914       brickland2/micro/vm-scalability/300s-anon-cow-rand-mt-64G
  10839519           -2.1%   10608884       brickland2/micro/vm-scalability/300s-anon-cow-seq-1T
  26035343          +22.6%   31908627       brickland2/micro/vm-scalability/300s-anon-cow-seq-mt-1T
   1814424 ~ 0%      -0.3%    1808366       brickland2/micro/vm-scalability/300s-anon-r-rand-mt
   3321379 ~14%     -14.9%    2824943       brickland2/micro/vm-scalability/300s-anon-r-rand
  10737450 ~ 8%     -13.4%    9300338       brickland2/micro/vm-scalability/300s-anon-r-seq-mt
  56930858 ~31%     -31.0%   39271193       brickland2/micro/vm-scalability/300s-anon-r-seq
   3895406 ~10%      -6.5%    3641748       brickland2/micro/vm-scalability/300s-anon-rx-rand-mt
   2815440 ~13%     -13.2%    2443920       brickland2/micro/vm-scalability/300s-anon-rx-seq-mt
   1744586           +0.5%    1752816       brickland2/micro/vm-scalability/300s-anon-w-rand-64G
   1485732           +0.5%    1493516       brickland2/micro/vm-scalability/300s-anon-w-rand-mt-64G
  23398782           -2.7%   22776628       brickland2/micro/vm-scalability/300s-anon-w-seq-1T
   6179895           -0.9%    6126126       brickland2/micro/vm-scalability/300s-anon-w-seq-mt-64G
   2050178           +8.8%    2230773       brickland2/micro/vm-scalability/300s-anon-wx-rand-mt-64G
    730440           -0.0%     730200       brickland2/micro/vm-scalability/300s-anon-wx-seq-mt-1T
   1753278 ~ 1%      -2.7%    1705762       brickland2/micro/vm-scalability/300s-lru-file-mmap-read-rand
   3548596 ~15%     -15.9%    2984023       brickland2/micro/vm-scalability/300s-lru-file-mmap-read
   2094887 ~ 0%      -0.3%    2088757       brickland2/micro/vm-scalability/300s-lru-file-readonce
   5288504 ~33%     -33.0%    3542054       brickland2/micro/vm-scalability/300s-lru-file-readtwice
  26681167           -1.5%   26273119       brickland2/micro/vm-scalability/300s-lru-shm-128G
   1352290           +2.7%    1388276       brickland2/micro/vm-scalability/300s-lru-shm-rand-64G
   1582183 ~ 4%     +10.1%    1742202       brickland2/micro/vm-scalability/300s-mmap-pread-rand-mt
   2530025 ~11%     -11.6%    2237193       brickland2/micro/vm-scalability/300s-mmap-pread-rand
   7963273 ~12%      -9.8%    7182114       brickland2/micro/vm-scalability/300s-mmap-pread-seq-mt
  38368788 ~37%     -39.9%   23048889       brickland2/micro/vm-scalability/300s-mmap-pread-seq
   1761540 ~ 1%      -0.3%    1755774       brickland2/micro/vm-scalability/300s-mmap-xread-rand-mt
  10933828 ~46%     -44.9%    6019920       brickland2/micro/vm-scalability/300s-mmap-xread-seq-mt
 3.384e+08 ~ 0%      +0.2%  3.391e+08       brickland2/micro/vm-scalability/300s-mremap-xread-rand-mt
   1291559           +1.6%    1311590       brickland2/micro/vm-scalability/300s-msync-mt-64G
   3555867           +4.8%    3728204       brickland2/micro/vm-scalability/300s-remap-128G
   3456703           +0.2%    3461950       brickland2/micro/vm-scalability/300s-shm-pread-rand-16G
   3294497           +0.2%    3299782       brickland2/micro/vm-scalability/300s-shm-pread-rand-mt-16G
  18343419           -1.6%   18056113       brickland2/micro/vm-scalability/300s-shm-pread-seq-1T
   8826997           -6.1%    8284733       brickland2/micro/vm-scalability/300s-shm-pread-seq-mt-1T
   3474590           -0.2%    3466782       brickland2/micro/vm-scalability/300s-shm-xread-rand-16G
   3277440           +0.5%    3294828       brickland2/micro/vm-scalability/300s-shm-xread-rand-mt-16G
  17871763           -0.3%   17818691       brickland2/micro/vm-scalability/300s-shm-xread-seq-1T
  11819716           -2.2%   11559350       brickland2/micro/vm-scalability/300s-shm-xread-seq-mt-1T
    221738 ~28%     -28.1%     159453       brickland2/micro/vm-scalability/300s-small-allocs-mt
   3334953 ~32%     -30.2%    2329160       brickland2/micro/vm-scalability/300s-small-allocs
 6.762e+08           -5.9%   6.36e+08       TOTAL vm-scalability.throughput

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    727.82 ~ 3%      +8.8%     791.84       brickland1/micro/will-it-scale/brk1
    507.58 ~ 2%      -0.7%     504.02       brickland1/micro/will-it-scale/context_switch1
   1205.64 ~ 1%      +0.6%    1212.98       brickland1/micro/will-it-scale/eventfd1
    666.91 ~ 2%      +5.8%     705.59       brickland1/micro/will-it-scale/futex1
    675.73 ~ 2%      +1.2%     683.64       brickland1/micro/will-it-scale/futex2
   1318.25 ~30%     -84.6%     203.10       brickland1/micro/will-it-scale/futex3
   1299.52 ~31%     -81.7%     237.83       brickland1/micro/will-it-scale/futex4
   1318.43 ~23%     -72.8%     358.46       brickland1/micro/will-it-scale/getppid1
   1029.00 ~18%     -34.0%     679.18       brickland1/micro/will-it-scale/lock1
   1304.56 ~11%     -76.5%     306.02       brickland1/micro/will-it-scale/lseek1
    204.65 ~ 1%      +2.1%     208.96       brickland1/micro/will-it-scale/malloc1
   1910.51 ~ 1%      +1.8%    1945.37       brickland1/micro/will-it-scale/malloc2
    199.50 ~ 1%      +0.9%     201.37       brickland1/micro/will-it-scale/mmap1
    195.08 ~ 1%      +5.0%     204.87       brickland1/micro/will-it-scale/mmap2
    740.77 ~14%      +7.3%     795.01       brickland1/micro/will-it-scale/open1
    742.22 ~15%      +8.0%     801.87       brickland1/micro/will-it-scale/open2
    419.75 ~13%      +4.0%     436.72       brickland1/micro/will-it-scale/page_fault1
    426.24 ~12%      +6.4%     453.69       brickland1/micro/will-it-scale/page_fault2
    494.03 ~13%      +3.6%     511.82       brickland1/micro/will-it-scale/page_fault3
   1169.21 ~14%      +6.7%    1247.89       brickland1/micro/will-it-scale/pipe1
   1423.79 ~15%      +6.0%    1508.78       brickland1/micro/will-it-scale/poll1
   1443.28 ~14%      +8.6%    1567.43       brickland1/micro/will-it-scale/poll2
    519.35 ~ 9%      +1.8%     528.65       brickland1/micro/will-it-scale/posix_semaphore1
   1627.45 ~11%      +0.3%    1632.45       brickland1/micro/will-it-scale/pread1
    217.45 ~12%      +4.4%     227.04       brickland1/micro/will-it-scale/pread2
    850.73 ~14%      +5.7%     899.39       brickland1/micro/will-it-scale/pthread_mutex1
   1083.32 ~15%      +5.8%    1146.68       brickland1/micro/will-it-scale/pthread_mutex2
   1381.38 ~15%      +5.7%    1459.67       brickland1/micro/will-it-scale/pwrite1
    484.41 ~ 8%      -8.4%     443.69       brickland1/micro/will-it-scale/pwrite2
   1143.32 ~15%      +2.7%    1174.07       brickland1/micro/will-it-scale/read1
    588.56 ~14%      +8.9%     641.00       brickland1/micro/will-it-scale/read2
   1478.60 ~12%      +5.6%    1561.00       brickland1/micro/will-it-scale/readseek
   1247.94 ~ 3%      +3.9%    1297.10       brickland1/micro/will-it-scale/sched_yield
    310.07 ~ 3%      -0.5%     308.53       brickland1/micro/will-it-scale/signal1
   1248.91 ~ 4%      -4.1%    1197.54       brickland1/micro/will-it-scale/unix1
    180.62 ~34%      -0.7%     179.37       brickland1/micro/will-it-scale/unlink1
    339.83 ~ 2%      +6.4%     361.52       brickland1/micro/will-it-scale/unlink2
   1219.38 ~ 0%      -0.3%    1215.65       brickland1/micro/will-it-scale/write1
   1389.61 ~ 2%      -3.2%    1345.16       brickland1/micro/will-it-scale/writeseek
    398.70           +2.8%     409.97       brickland2/micro/vm-scalability/300s-anon-cow-rand-64G
    398.85           +7.6%     429.08       brickland2/micro/vm-scalability/300s-anon-cow-rand-mt-64G
    441.56           +2.2%     451.41       brickland2/micro/vm-scalability/300s-anon-cow-seq-1T
    456.46          +11.1%     507.06       brickland2/micro/vm-scalability/300s-anon-cow-seq-mt-1T
    177.75 ~11%     -10.2%     159.55       brickland2/micro/vm-scalability/300s-anon-r-rand-mt
    494.00 ~16%     -16.7%     411.47       brickland2/micro/vm-scalability/300s-anon-r-rand
    409.63 ~ 9%     -12.1%     359.90       brickland2/micro/vm-scalability/300s-anon-r-seq-mt
   1332.45 ~38%     -38.3%     822.59       brickland2/micro/vm-scalability/300s-anon-r-seq
    512.37 ~ 5%      -3.8%     492.70       brickland2/micro/vm-scalability/300s-anon-rx-rand-mt
    483.40 ~ 0%      -0.6%     480.66       brickland2/micro/vm-scalability/300s-anon-rx-seq-mt
    449.67           +1.3%     455.43       brickland2/micro/vm-scalability/300s-anon-w-rand-64G
    273.69           -2.1%     268.03       brickland2/micro/vm-scalability/300s-anon-w-rand-mt-64G
    661.23           -0.6%     657.39       brickland2/micro/vm-scalability/300s-anon-w-seq-1T
    167.26           +0.7%     168.39       brickland2/micro/vm-scalability/300s-anon-w-seq-mt-64G
    461.64           +1.5%     468.45       brickland2/micro/vm-scalability/300s-anon-wx-rand-mt-64G
    476.92 ~14%     -13.8%     411.26       brickland2/micro/vm-scalability/300s-lru-file-mmap-read-rand
    585.97 ~16%     -17.7%     482.13       brickland2/micro/vm-scalability/300s-lru-file-mmap-read
    464.02 ~ 0%      -0.5%     461.53       brickland2/micro/vm-scalability/300s-lru-file-readonce
    523.67 ~11%     -11.9%     461.14       brickland2/micro/vm-scalability/300s-lru-file-readtwice
    132.25           +0.6%     133.00       brickland2/micro/vm-scalability/300s-lru-shm-128G
    226.65           +5.0%     237.93       brickland2/micro/vm-scalability/300s-lru-shm-rand-64G
    370.95 ~19%     -20.8%     293.64       brickland2/micro/vm-scalability/300s-mmap-pread-rand-mt
    429.04 ~17%     -17.2%     355.40       brickland2/micro/vm-scalability/300s-mmap-pread-rand
    319.46 ~15%     -15.1%     271.09       brickland2/micro/vm-scalability/300s-mmap-pread-seq-mt
    905.98 ~34%     -35.3%     586.51       brickland2/micro/vm-scalability/300s-mmap-pread-seq
    455.57 ~11%     -22.0%     355.47       brickland2/micro/vm-scalability/300s-mmap-xread-rand-mt
    541.86 ~13%     -13.3%     469.95       brickland2/micro/vm-scalability/300s-mmap-xread-seq-mt
    556.88 ~14%     -15.0%     473.44       brickland2/micro/vm-scalability/300s-mremap-xread-rand-mt
    309.70           +0.6%     311.51       brickland2/micro/vm-scalability/300s-msync-mt-64G
    194.81           -1.1%     192.72       brickland2/micro/vm-scalability/300s-remap-128G
    388.64           -0.5%     386.67       brickland2/micro/vm-scalability/300s-shm-pread-rand-16G
    102.90           +8.5%     111.61       brickland2/micro/vm-scalability/300s-shm-pread-rand-mt-16G
    576.40           -0.4%     574.33       brickland2/micro/vm-scalability/300s-shm-pread-seq-1T
    275.80           -3.1%     267.35       brickland2/micro/vm-scalability/300s-shm-pread-seq-mt-1T
    385.60           +0.4%     386.95       brickland2/micro/vm-scalability/300s-shm-xread-rand-16G
    372.72           +1.2%     377.03       brickland2/micro/vm-scalability/300s-shm-xread-rand-mt-16G
    573.73           +0.0%     573.87       brickland2/micro/vm-scalability/300s-shm-xread-seq-1T
    493.06           +0.1%     493.63       brickland2/micro/vm-scalability/300s-shm-xread-seq-mt-1T
    165.30 ~17%     -17.4%     136.53       brickland2/micro/vm-scalability/300s-small-allocs-mt
    386.38 ~24%     +40.0%     540.83       brickland2/micro/vm-scalability/300s-small-allocs
     50.36           +0.9%      50.79       brickland2/micro/vm-scalability/300s-truncate-16G
    141.92           -0.1%     141.71       grantley/micro/kbuild/200%-1HDD-ext4
    141.73 ~ 0%      +0.5%     142.44       grantley/micro/kbuild/200%
    116.55           -0.3%     116.21       grantley/micro/kbuild/50%-1HDD-ext4
    116.02           -0.5%     115.49       grantley/micro/kbuild/50%
     71.80           +0.2%      71.92       lkp-sb03/micro/nepim/300s-100%-tcp
     69.19           +0.9%      69.78       lkp-sb03/micro/nepim/300s-100%-tcp6
     82.00          -14.5%      70.07       lkp-sb03/micro/nepim/300s-100%-udp
     81.75          -14.7%      69.73       lkp-sb03/micro/nepim/300s-100%-udp6
     83.43          -14.5%      71.32       lkp-sb03/micro/nepim/300s-25%-tcp
     71.52           +0.2%      71.65       lkp-sb03/micro/nepim/300s-25%-tcp6
     81.74           +0.3%      82.01       lkp-sb03/micro/nepim/300s-25%-udp
     81.64           +0.5%      82.07       lkp-sb03/micro/nepim/300s-25%-udp6
     69.37 ~ 0%      +0.2%      69.53       lkp-sb03/micro/nuttcp/300s
    188.36 ~ 0%      +0.2%     188.76       lkp-snb01/micro/hackbench/1600%-process-pipe
    191.23 ~ 0%      -0.4%     190.49       lkp-snb01/micro/hackbench/1600%-process-socket
    198.03 ~ 0%      -0.2%     197.68       lkp-snb01/micro/hackbench/1600%-threads-pipe
    199.20 ~ 0%      -0.7%     197.85       lkp-snb01/micro/hackbench/1600%-threads-socket
    196.56 ~ 0%      -0.1%     196.35       lkp-snb01/micro/hackbench/50%-process-pipe
    196.24 ~ 0%      -0.0%     196.19       lkp-snb01/micro/hackbench/50%-process-socket
    199.15 ~ 0%      -0.7%     197.72       lkp-snb01/micro/hackbench/50%-threads-pipe
    197.18 ~ 0%      -0.3%     196.63       lkp-snb01/micro/hackbench/50%-threads-socket
      5.32 ~ 1%      +0.9%       5.37       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndrd-sync
  54896.61           -9.2%   49864.31       TOTAL turbostat.Pkg_W

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     14.91 ~ 0%      +0.0%      14.91       brickland1/micro/will-it-scale/brk1
     13.90 ~ 0%      +3.3%      14.36       brickland1/micro/will-it-scale/context_switch1
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/eventfd1
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/futex1
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/futex2
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/futex3
     14.89 ~ 0%      -0.0%      14.89       brickland1/micro/will-it-scale/futex4
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/getppid1
     14.89 ~ 0%      +0.1%      14.90       brickland1/micro/will-it-scale/lock1
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/lseek1
     14.91 ~ 0%      +0.0%      14.91       brickland1/micro/will-it-scale/malloc1
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/malloc2
     14.91 ~ 0%      +0.0%      14.91       brickland1/micro/will-it-scale/mmap1
     14.91 ~ 0%      +0.0%      14.91       brickland1/micro/will-it-scale/mmap2
     15.11 ~ 0%      +0.1%      15.12       brickland1/micro/will-it-scale/open1
     15.10 ~ 0%      +0.2%      15.13       brickland1/micro/will-it-scale/open2
     17.06 ~ 3%      +0.6%      17.17       brickland1/micro/will-it-scale/page_fault1
     20.31 ~ 7%      +3.4%      21.00       brickland1/micro/will-it-scale/page_fault2
     14.94 ~ 0%      -0.0%      14.94       brickland1/micro/will-it-scale/page_fault3
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/pipe1
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/poll1
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/poll2
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/posix_semaphore1
     14.89 ~ 0%      -0.0%      14.89       brickland1/micro/will-it-scale/pread1
     14.93 ~ 0%      +0.0%      14.93       brickland1/micro/will-it-scale/pread2
     14.89 ~ 0%      -0.0%      14.89       brickland1/micro/will-it-scale/pthread_mutex1
     14.89 ~ 0%      +0.1%      14.90       brickland1/micro/will-it-scale/pthread_mutex2
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/pwrite1
     14.89 ~ 0%      -0.0%      14.89       brickland1/micro/will-it-scale/pwrite2
     14.89 ~ 0%      -0.0%      14.89       brickland1/micro/will-it-scale/read1
     14.92 ~ 0%      -0.1%      14.91       brickland1/micro/will-it-scale/read2
     14.89 ~ 0%      -0.0%      14.89       brickland1/micro/will-it-scale/readseek
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/sched_yield
     14.89 ~ 0%      -0.0%      14.89       brickland1/micro/will-it-scale/signal1
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/unix1
     14.93 ~ 0%      -0.0%      14.92       brickland1/micro/will-it-scale/unlink1
     14.90 ~ 0%      -0.0%      14.90       brickland1/micro/will-it-scale/unlink2
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/write1
     14.89 ~ 0%      +0.0%      14.89       brickland1/micro/will-it-scale/writeseek
     15.78          -10.1%      14.19       brickland2/micro/vm-scalability/300s-anon-cow-rand-64G
     12.39           -0.8%      12.29       brickland2/micro/vm-scalability/300s-anon-cow-rand-mt-64G
     12.46           +0.6%      12.53       brickland2/micro/vm-scalability/300s-anon-cow-seq-1T
     12.14           -3.5%      11.72       brickland2/micro/vm-scalability/300s-anon-cow-seq-mt-1T
      8.75 ~ 0%      +0.1%       8.76       brickland2/micro/vm-scalability/300s-anon-r-rand-mt
      8.84 ~ 0%      -0.6%       8.78       brickland2/micro/vm-scalability/300s-anon-r-rand
      8.75 ~ 0%      +0.0%       8.75       brickland2/micro/vm-scalability/300s-anon-r-seq-mt
      8.75 ~ 0%      +0.0%       8.75       brickland2/micro/vm-scalability/300s-anon-r-seq
      8.75 ~ 0%      +0.0%       8.75       brickland2/micro/vm-scalability/300s-anon-rx-rand-mt
      8.75 ~ 0%      +0.0%       8.75       brickland2/micro/vm-scalability/300s-anon-rx-seq-mt
     17.57           +0.9%      17.72       brickland2/micro/vm-scalability/300s-anon-w-rand-64G
     13.77           -0.7%      13.68       brickland2/micro/vm-scalability/300s-anon-w-rand-mt-64G
     12.28           +2.0%      12.52       brickland2/micro/vm-scalability/300s-anon-w-seq-1T
      8.77           -0.1%       8.76       brickland2/micro/vm-scalability/300s-anon-w-seq-mt-64G
      8.75           +0.1%       8.76       brickland2/micro/vm-scalability/300s-anon-wx-rand-mt-64G
      8.93 ~ 0%      -0.6%       8.88       brickland2/micro/vm-scalability/300s-lru-file-mmap-read-rand
      8.86 ~ 0%      -0.8%       8.79       brickland2/micro/vm-scalability/300s-lru-file-mmap-read
      8.89 ~ 0%      +0.1%       8.90       brickland2/micro/vm-scalability/300s-lru-file-readonce
      9.53 ~ 4%      -4.5%       9.10       brickland2/micro/vm-scalability/300s-lru-file-readtwice
      8.86           +0.0%       8.86       brickland2/micro/vm-scalability/300s-lru-shm-128G
      8.97           -1.0%       8.88       brickland2/micro/vm-scalability/300s-lru-shm-rand-64G
      8.75 ~ 0%      +0.1%       8.76       brickland2/micro/vm-scalability/300s-mmap-pread-rand-mt
     10.46 ~16%     -16.2%       8.76       brickland2/micro/vm-scalability/300s-mmap-pread-rand
      9.61 ~ 8%      -8.8%       8.76       brickland2/micro/vm-scalability/300s-mmap-pread-seq-mt
     10.02 ~10%     -11.5%       8.87       brickland2/micro/vm-scalability/300s-mmap-pread-seq
      8.75 ~ 0%      -0.1%       8.75       brickland2/micro/vm-scalability/300s-mmap-xread-rand-mt
      8.79 ~ 0%      +0.0%       8.79       brickland2/micro/vm-scalability/300s-mmap-xread-seq-mt
      9.74 ~ 4%      -6.7%       9.09       brickland2/micro/vm-scalability/300s-mremap-xread-rand-mt
      8.80           +0.0%       8.80       brickland2/micro/vm-scalability/300s-msync-mt-64G
      8.84           -0.1%       8.83       brickland2/micro/vm-scalability/300s-remap-128G
      8.75           +0.0%       8.75       brickland2/micro/vm-scalability/300s-shm-pread-rand-16G
      8.77           +0.0%       8.77       brickland2/micro/vm-scalability/300s-shm-pread-rand-mt-16G
      8.88           +0.0%       8.88       brickland2/micro/vm-scalability/300s-shm-pread-seq-1T
      8.76           +0.0%       8.76       brickland2/micro/vm-scalability/300s-shm-pread-seq-mt-1T
      8.76           -0.1%       8.75       brickland2/micro/vm-scalability/300s-shm-xread-rand-16G
      8.79           +0.0%       8.79       brickland2/micro/vm-scalability/300s-shm-xread-rand-mt-16G
      8.88           +0.0%       8.88       brickland2/micro/vm-scalability/300s-shm-xread-seq-1T
      8.79           +0.0%       8.79       brickland2/micro/vm-scalability/300s-shm-xread-seq-mt-1T
      8.80 ~ 0%      +0.0%       8.80       brickland2/micro/vm-scalability/300s-small-allocs-mt
      8.80 ~ 0%      -0.3%       8.78       brickland2/micro/vm-scalability/300s-small-allocs
      8.77           +0.0%       8.77       brickland2/micro/vm-scalability/300s-truncate-16G
     12.65           -9.1%      11.50       grantley/micro/kbuild/200%-1HDD-ext4
     11.40 ~ 2%     +10.6%      12.61       grantley/micro/kbuild/200%
      8.64           -7.9%       7.96       grantley/micro/kbuild/50%-1HDD-ext4
      7.94           -5.8%       7.48       grantley/micro/kbuild/50%
   1029.69           -0.6%    1023.09       TOTAL turbostat.RAM_W

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      2.14 ~ 0%      +0.1%       2.14       lkp-a04/micro/netperf/300s-200%-SCTP_STREAM
     48.44 ~41%     -50.3%      24.08       lkp-a04/micro/netperf/900s-200%-SCTP_STREAM_MANY
    280.76 ~ 0%      -0.6%     279.04       lkp-a04/micro/netperf/900s-200%-TCP_MAERTS
    277.92 ~ 0%      -0.5%     276.44       lkp-a04/micro/netperf/900s-200%-TCP_STREAM
    609.26 ~ 3%      -4.5%     581.70       TOTAL netperf.Throughput_Mbps

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     34.61 ~ 0%      +0.2%      34.69       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndrd-sync
     33.90 ~ 0%      -0.5%      33.72       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndrw-sync
      0.03 ~ 0%      +0.0%       0.03       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
      2.56 ~ 0%      +0.0%       2.56       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrd-sync
      0.04 ~ 0%      +0.0%       0.04       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
      0.06 ~ 0%      +0.0%       0.06       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqwr-sync
     37.60 ~ 0%      +0.1%      37.62       snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrd-sync
     40.57 ~ 0%      +0.3%      40.68       snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndrw-sync
      0.02 ~ 0%      +0.0%       0.02       snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndwr-sync
      2.57 ~ 0%      +0.0%       2.57       snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrd-sync
      0.03 ~ 0%      +0.0%       0.03 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
      0.04 ~ 0%      +0.0%       0.04 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
    152.02 ~ 0%      +0.0%     152.06       TOTAL fileio.request_latency_95%_ms

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    249418 ~ 6%      -2.3%     243679       lkp-snb01/micro/hackbench/1600%-process-pipe
    158824 ~ 0%      -2.0%     155637       lkp-snb01/micro/hackbench/1600%-process-socket
    216465 ~ 3%      +1.4%     219484       lkp-snb01/micro/hackbench/1600%-threads-pipe
    164488 ~ 0%      -3.3%     158990       lkp-snb01/micro/hackbench/1600%-threads-socket
    136844 ~ 0%      +1.4%     138814       lkp-snb01/micro/hackbench/50%-process-pipe
    136781 ~ 0%      +4.7%     143245       lkp-snb01/micro/hackbench/50%-process-socket
    132993 ~ 0%      -2.6%     129573       lkp-snb01/micro/hackbench/50%-threads-pipe
    107699 ~ 0%      +6.6%     114823       lkp-snb01/micro/hackbench/50%-threads-socket
   1303516 ~ 2%      +0.1%    1304246       TOTAL hackbench.throughput

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     68.47 ~ 0%      -0.0%      68.44       xps2/micro/pigz/100%
     68.47 ~ 0%      -0.0%      68.44       TOTAL pigz.throughput

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      8392 ~ 0%      -1.8%       8239       nhm8/micro/dbench/100%
      8392 ~ 0%      -1.8%       8239       TOTAL dbench.throughput-MB/sec

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     11807           -5.0%      11221       lkp-nex04/micro/ebizzy/200%-100-10
     11807           -5.0%      11221       TOTAL ebizzy.throughput

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    671786           -1.0%     665130       lkp-sb03/micro/nepim/300s-100%-tcp
    640185           +2.5%     655892       lkp-sb03/micro/nepim/300s-100%-tcp6
   2048594          +39.8%    2864645       lkp-sb03/micro/nepim/300s-25%-tcp
   2734939           +0.8%    2755658       lkp-sb03/micro/nepim/300s-25%-tcp6
   6095506          +13.9%    6941327       TOTAL nepim.tcp.avg.kbps_in

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    671974           -1.0%     664986       lkp-sb03/micro/nepim/300s-100%-tcp
    640367           +2.5%     656073       lkp-sb03/micro/nepim/300s-100%-tcp6
   2048779          +39.8%    2864852       lkp-sb03/micro/nepim/300s-25%-tcp
   2735140           +0.8%    2755864       lkp-sb03/micro/nepim/300s-25%-tcp6
   6096261          +13.9%    6941777       TOTAL nepim.tcp.avg.kbps_out

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    133570          +63.5%     218380       lkp-sb03/micro/nepim/300s-100%-udp
    121428          +59.2%     193308       lkp-sb03/micro/nepim/300s-100%-udp6
    574674           +0.0%     574843       lkp-sb03/micro/nepim/300s-25%-udp
    519455           -1.4%     512438       lkp-sb03/micro/nepim/300s-25%-udp6
   1349129          +11.1%    1498971       TOTAL nepim.udp.avg.kbps_in

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    175444          +35.9%     238505       lkp-sb03/micro/nepim/300s-100%-udp
    139381          +38.7%     193318       lkp-sb03/micro/nepim/300s-100%-udp6
    640781           -3.0%     621650       lkp-sb03/micro/nepim/300s-25%-udp
    521341           +0.5%     523779       lkp-sb03/micro/nepim/300s-25%-udp6
   1476949           +6.8%    1577254       TOTAL nepim.udp.avg.kbps_out

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
  39437466 ~ 3%      +6.4%   41950249       lkp-a06/micro/qperf/600s
  39437466 ~ 3%      +6.4%   41950249       TOTAL qperf.sctp.bw

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
 2.705e+08 ~ 0%      -1.4%  2.669e+08       lkp-a06/micro/qperf/600s
 2.705e+08 ~ 0%      -1.4%  2.669e+08       TOTAL qperf.tcp.bw

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
 2.647e+08 ~ 0%      +1.0%  2.673e+08       lkp-a06/micro/qperf/600s
 2.647e+08 ~ 0%      +1.0%  2.673e+08       TOTAL qperf.udp.recv_bw

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
 2.701e+08 ~ 0%      +1.0%  2.728e+08       lkp-a06/micro/qperf/600s
 2.701e+08 ~ 0%      +1.0%  2.728e+08       TOTAL qperf.udp.send_bw

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    126792 ~ 0%      -0.8%     125820       lkp-a06/micro/qperf/600s
    126792 ~ 0%      -0.8%     125820       TOTAL qperf.sctp.latency

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     94015 ~ 0%      +0.6%      94623       lkp-a06/micro/qperf/600s
     94015 ~ 0%      +0.6%      94623       TOTAL qperf.tcp.latency

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     77865 ~ 0%      +0.9%      78587       lkp-a06/micro/qperf/600s
     77865 ~ 0%      +0.9%      78587       TOTAL qperf.udp.latency

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
     50103 ~ 1%      -1.3%      49450       lkp-sb03/micro/nuttcp/300s
     50103 ~ 1%      -1.3%      49450       TOTAL nuttcp.throughput_Mbps

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [writeback] 6903673566d: +2.5% fileio.requests_per_sec
  2014-04-10 13:08 ` Fengguang Wu
@ 2014-04-10 13:17   ` Fengguang Wu
  0 siblings, 0 replies; 6+ messages in thread
From: Fengguang Wu @ 2014-04-10 13:17 UTC (permalink / raw)
  To: Jan Kara; +Cc: LKML, linux-fsdevel, lkp

On Thu, Apr 10, 2014 at 09:08:21PM +0800, Fengguang Wu wrote:
> On Thu, Apr 10, 2014 at 08:41:37PM +0800, Fengguang Wu wrote:
> > Hi Jan,
> > 
> > I tried your writeback dirty list patchset and noticed some ups/downs.
> > The main performance changes are
> > 
> > 1) +2.5% fileio.requests_per_sec
> > 2) -7.1% iostat.md0.wkB/s
> > 
> > git://bee.sh.intel.com/git/wfg/linux-devel.git jan-dirty-list
> > commit 6903673566d0289680e593dac088c787d119b067 ("writeback: Replace several writeback lists with inode tagging")
> > 
> > 836ecc5f024669e  6903673566d0289680e593dac  
> > ---------------  -------------------------  
> >       6526 ~ 0%      +3.2%       6736 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
> >       6441 ~ 0%      +1.8%       6558 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
> >      12968 ~ 0%      +2.5%      13295 ~ 0%  TOTAL fileio.requests_per_sec
> > 
> > 836ecc5f024669e  6903673566d0289680e593dac  
> > ---------------  -------------------------  
> >     398147 ~ 0%      -7.1%     369866 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
> >     398147 ~ 0%      -7.1%     369866 ~ 0%  TOTAL iostat.md0.wkB/s
> 
> Here are the complete power performance comparisons:
> 
> # the higher index, the better
>     98      perf-index  ea87e2e7e0905325c58cf5643
>    105     power-index  ea87e2e7e0905325c58cf5643
>     99   latency-index  ea87e2e7e0905325c58cf5643

Note that some few performance changes are caused by CPU frequency
unstableness. Sorry for showing results with some defects - I only
realized that after reading through the results..

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
      1.12 ~ 0%      -0.4%       1.12       brickland1/micro/will-it-scale/brk1
      1.14 ~ 0%      +2.0%       1.16       brickland1/micro/will-it-scale/context_switch1
      1.15 ~ 1%      +0.6%       1.16       brickland1/micro/will-it-scale/eventfd1
      1.23 ~ 2%      +7.6%       1.32       brickland1/micro/will-it-scale/futex1
      1.24 ~ 4%      -4.2%       1.19       brickland1/micro/will-it-scale/futex2
      1.15 ~ 1%      -0.1%       1.15       brickland1/micro/will-it-scale/futex3
      1.18 ~ 3%      -4.2%       1.13       brickland1/micro/will-it-scale/futex4
      1.14 ~ 1%      -0.6%       1.13       brickland1/micro/will-it-scale/getppid1
      1.09 ~14%      +5.6%       1.15       brickland1/micro/will-it-scale/lock1
      1.13 ~ 1%      +1.9%       1.15       brickland1/micro/will-it-scale/lseek1
      1.18 ~ 2%      +3.6%       1.22       brickland1/micro/will-it-scale/malloc1
      1.13 ~ 0%      +0.6%       1.14       brickland1/micro/will-it-scale/malloc2
      1.21 ~ 1%      +2.3%       1.24       brickland1/micro/will-it-scale/mmap1
      1.18 ~ 1%      +6.6%       1.26       brickland1/micro/will-it-scale/mmap2
      1.10 ~15%      +5.8%       1.16       brickland1/micro/will-it-scale/open1
      1.11 ~15%      +4.9%       1.16       brickland1/micro/will-it-scale/open2
      1.08 ~13%      +4.2%       1.13       brickland1/micro/will-it-scale/page_fault1
      1.08 ~14%      +5.8%       1.14       brickland1/micro/will-it-scale/page_fault2
      1.09 ~14%      +5.0%       1.14       brickland1/micro/will-it-scale/page_fault3
      1.08 ~14%      +4.2%       1.13       brickland1/micro/will-it-scale/pipe1
      1.09 ~15%      +5.6%       1.15       brickland1/micro/will-it-scale/poll1
      1.07 ~14%      +5.2%       1.13       brickland1/micro/will-it-scale/poll2
      1.09 ~14%      +4.9%       1.14       brickland1/micro/will-it-scale/posix_semaphore1
      1.07 ~14%     +10.8%       1.19       brickland1/micro/will-it-scale/pread1
      1.12 ~15%      +4.5%       1.17       brickland1/micro/will-it-scale/pread2
      1.08 ~14%      +5.3%       1.14       brickland1/micro/will-it-scale/pthread_mutex1
      1.08 ~14%      +4.3%       1.13       brickland1/micro/will-it-scale/pthread_mutex2
      1.09 ~14%      +4.0%       1.13       brickland1/micro/will-it-scale/pwrite1
      1.07 ~14%      +5.1%       1.12       brickland1/micro/will-it-scale/pwrite2
      1.07 ~14%      +8.2%       1.16       brickland1/micro/will-it-scale/read1
      1.07 ~14%      +5.3%       1.13       brickland1/micro/will-it-scale/read2
      1.09 ~14%      +6.4%       1.16       brickland1/micro/will-it-scale/readseek
      1.14 ~ 0%      +0.4%       1.14       brickland1/micro/will-it-scale/sched_yield
      1.36 ~ 5%      +1.3%       1.38       brickland1/micro/will-it-scale/signal1
      1.15 ~ 2%      -2.4%       1.12       brickland1/micro/will-it-scale/unix1
      1.11 ~ 0%      +1.5%       1.13       brickland1/micro/will-it-scale/unlink1
      1.18 ~ 1%      +0.8%       1.19       brickland1/micro/will-it-scale/unlink2
      1.13 ~ 0%      +0.2%       1.13       brickland1/micro/will-it-scale/write1
      1.15 ~ 1%      +0.6%       1.16       brickland1/micro/will-it-scale/writeseek
      0.63           +0.0%       0.63       brickland2/micro/vm-scalability/300s-anon-cow-rand-64G
      0.63           +0.0%       0.63       brickland2/micro/vm-scalability/300s-anon-cow-rand-mt-64G
      0.62           +0.0%       0.62       brickland2/micro/vm-scalability/300s-anon-cow-seq-1T
      0.64           -1.6%       0.63       brickland2/micro/vm-scalability/300s-anon-cow-seq-mt-1T
      0.94 ~27%     -28.7%       0.67       brickland2/micro/vm-scalability/300s-anon-r-rand-mt
      0.88 ~28%     -29.1%       0.62       brickland2/micro/vm-scalability/300s-anon-r-rand
      0.94 ~28%     -28.3%       0.67       brickland2/micro/vm-scalability/300s-anon-r-seq-mt
      0.87 ~28%     -28.7%       0.62       brickland2/micro/vm-scalability/300s-anon-r-seq
      0.92 ~31%     -31.1%       0.63       brickland2/micro/vm-scalability/300s-anon-rx-rand-mt
      0.88 ~28%     -28.0%       0.63       brickland2/micro/vm-scalability/300s-anon-rx-seq-mt
      0.63           +0.0%       0.63       brickland2/micro/vm-scalability/300s-anon-w-rand-64G
      0.63           +0.0%       0.63       brickland2/micro/vm-scalability/300s-anon-w-rand-mt-64G
      0.62           +0.0%       0.62       brickland2/micro/vm-scalability/300s-anon-w-seq-1T
      0.66           +0.0%       0.66       brickland2/micro/vm-scalability/300s-anon-w-seq-mt-64G
      0.63           +0.0%       0.63       brickland2/micro/vm-scalability/300s-anon-wx-rand-mt-64G
      0.88 ~28%     -28.0%       0.63       brickland2/micro/vm-scalability/300s-lru-file-mmap-read-rand
      0.89 ~28%     -28.8%       0.63       brickland2/micro/vm-scalability/300s-lru-file-mmap-read
      0.63 ~ 0%      +0.0%       0.63       brickland2/micro/vm-scalability/300s-lru-file-readonce
      0.92 ~31%     -31.1%       0.63       brickland2/micro/vm-scalability/300s-lru-file-readtwice
      0.61           +0.0%       0.61       brickland2/micro/vm-scalability/300s-lru-shm-128G
      0.62           +0.0%       0.62       brickland2/micro/vm-scalability/300s-lru-shm-rand-64G
      0.87 ~28%     -28.7%       0.62       brickland2/micro/vm-scalability/300s-mmap-pread-rand-mt
      0.92 ~32%     -32.2%       0.62       brickland2/micro/vm-scalability/300s-mmap-pread-rand
      0.94 ~28%     -28.3%       0.67       brickland2/micro/vm-scalability/300s-mmap-pread-seq-mt
      0.89 ~30%     -30.3%       0.62       brickland2/micro/vm-scalability/300s-mmap-pread-seq
      0.87 ~28%     -28.7%       0.62       brickland2/micro/vm-scalability/300s-mmap-xread-rand-mt
      0.88 ~27%     -27.3%       0.64       brickland2/micro/vm-scalability/300s-mmap-xread-seq-mt
      0.89 ~30%     -30.3%       0.62       brickland2/micro/vm-scalability/300s-mremap-xread-rand-mt
      0.63           +0.0%       0.63       brickland2/micro/vm-scalability/300s-msync-mt-64G
      0.62           +0.0%       0.62       brickland2/micro/vm-scalability/300s-remap-128G
      0.62           +0.0%       0.62       brickland2/micro/vm-scalability/300s-shm-pread-rand-16G
      0.67           +0.0%       0.67       brickland2/micro/vm-scalability/300s-shm-pread-rand-mt-16G
      0.62           +0.0%       0.62       brickland2/micro/vm-scalability/300s-shm-pread-seq-1T
      0.67           +0.0%       0.67       brickland2/micro/vm-scalability/300s-shm-pread-seq-mt-1T
      0.62           +0.0%       0.62       brickland2/micro/vm-scalability/300s-shm-xread-rand-16G
      0.62           +0.0%       0.62       brickland2/micro/vm-scalability/300s-shm-xread-rand-mt-16G
      0.62           +0.0%       0.62       brickland2/micro/vm-scalability/300s-shm-xread-seq-1T
      0.63           -1.6%       0.62       brickland2/micro/vm-scalability/300s-shm-xread-seq-mt-1T
      0.89 ~27%     -27.7%       0.64       brickland2/micro/vm-scalability/300s-small-allocs-mt
      0.87 ~28%     -28.7%       0.62       brickland2/micro/vm-scalability/300s-small-allocs
      0.61           +0.0%       0.61       brickland2/micro/vm-scalability/300s-truncate-16G
      2.44           +0.0%       2.44       grantley/micro/kbuild/200%-1HDD-ext4
      2.44 ~ 0%      -0.0%       2.44       grantley/micro/kbuild/200%
      2.08           +0.0%       2.08       grantley/micro/kbuild/50%-1HDD-ext4
      2.08           +0.0%       2.08       grantley/micro/kbuild/50%
      2.26           +0.0%       2.26       lkp-nex04/micro/ebizzy/200%-100-10
      3.34           -0.3%       3.33       lkp-sb03/micro/nepim/300s-100%-tcp
      3.31           +0.6%       3.33       lkp-sb03/micro/nepim/300s-100%-tcp6
      3.49           -3.2%       3.38       lkp-sb03/micro/nepim/300s-100%-udp
      3.49           -2.6%       3.40       lkp-sb03/micro/nepim/300s-100%-udp6
      3.47           -4.0%       3.33       lkp-sb03/micro/nepim/300s-25%-tcp
      3.36           +0.0%       3.36       lkp-sb03/micro/nepim/300s-25%-tcp6
      3.49           +0.0%       3.49       lkp-sb03/micro/nepim/300s-25%-udp
      3.49           +0.0%       3.49       lkp-sb03/micro/nepim/300s-25%-udp6
      3.34 ~ 0%      +0.2%       3.35       lkp-sb03/micro/nuttcp/300s
      3.08 ~ 0%      +0.2%       3.09       lkp-snb01/micro/hackbench/1600%-process-pipe
      3.09 ~ 0%      +0.0%       3.09       lkp-snb01/micro/hackbench/1600%-process-socket
      3.09 ~ 0%      +0.0%       3.09       lkp-snb01/micro/hackbench/1600%-threads-pipe
      3.09 ~ 0%      +0.0%       3.09       lkp-snb01/micro/hackbench/1600%-threads-socket
      3.09 ~ 0%      +0.0%       3.09       lkp-snb01/micro/hackbench/50%-process-pipe
      3.09 ~ 0%      +0.0%       3.09       lkp-snb01/micro/hackbench/50%-process-socket
      3.09 ~ 0%      +0.0%       3.09       lkp-snb01/micro/hackbench/50%-threads-pipe
      3.09 ~ 0%      +0.0%       3.09       lkp-snb01/micro/hackbench/50%-threads-socket
      2.80 ~ 0%      -0.0%       2.80       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
      2.78 ~ 0%      -0.0%       2.78       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
      2.76 ~ 0%      +0.2%       2.77 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
      2.80 ~ 0%      -0.0%       2.80       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-100dd
      2.76 ~ 0%      -0.1%       2.76       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
      2.72 ~ 0%      -1.1%       2.69       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-1dd
      2.78 ~ 0%      +0.4%       2.79       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-100dd
      2.76 ~ 0%      +0.1%       2.76       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-10dd
      2.69 ~ 0%      -0.4%       2.68       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-1dd
      2.73 ~ 0%      -0.2%       2.72       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
      2.66 ~ 0%      -1.1%       2.63       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
      2.69 ~ 0%      +0.1%       2.69       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-1dd
      2.70 ~ 3%      +8.6%       2.93 ~ 0%  nhm-white/sysbench/oltp/600s-100%-1000000
      3.51 ~ 0%      -3.7%       3.38       nhm8/micro/dbench/100%
      1.79 ~ 0%      +0.1%       1.79       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndrd-sync
      2.93 ~ 0%      +0.0%       2.93       xps2/micro/pigz/100%
    185.24           -2.0%     181.62       TOTAL turbostat.GHz

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [writeback] 6903673566d: +2.5% fileio.requests_per_sec
  2014-04-10 13:05 ` Fengguang Wu
@ 2014-04-10 19:27   ` Jan Kara
  2014-04-11  5:12     ` Fengguang Wu
  0 siblings, 1 reply; 6+ messages in thread
From: Jan Kara @ 2014-04-10 19:27 UTC (permalink / raw)
  To: Fengguang Wu; +Cc: Jan Kara, LKML, linux-fsdevel, lkp

On Thu 10-04-14 21:05:52, Wu Fengguang wrote:
> On Thu, Apr 10, 2014 at 08:41:37PM +0800, Fengguang Wu wrote:
> Here are the changed stats before/after the patchset:
  Thanks for gathering the numbers!

>       v3.14-rc8  ea87e2e7e0905325c58cf5643
> ---------------  -------------------------
>      58.98 ~102%     -73.2%      15.78       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
>    2215.64 ~61%     -69.2%     682.57       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
>     185.22 ~132%     -93.6%      11.80       snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndwr-sync
>    2459.84 ~67%     -71.1%     710.15       TOTAL fileio.request_latency_max_ms
> 
>       v3.14-rc8  ea87e2e7e0905325c58cf5643
> ---------------  -------------------------
>       6251 ~ 0%      +4.0%       6503       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
>       6532 ~ 0%      +3.2%       6737 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
>       6444 ~ 0%      +1.7%       6554 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
>      19227 ~ 0%      +3.0%      19795       TOTAL fileio.requests_per_sec
> 
  So fileio got better latency and higher requests per second. That's good.
...

>       v3.14-rc8  ea87e2e7e0905325c58cf5643
> ---------------  -------------------------
>     397285 ~ 0%      -6.9%     369872 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
>     359312 ~ 0%      -5.5%     339685       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
>     404981 ~ 0%      -4.5%     386775       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
>    1161579 ~ 0%      -5.6%    1096334       TOTAL iostat.md0.wkB/s
  So dd writing tests got lower throughput reported by iostat. I'll try to
have a look whether I can reproduce that. BTW: Does that also correspond to
longer time-to-completion of the dd test?

>       v3.14-rc8  ea87e2e7e0905325c58cf5643
> ---------------  -------------------------
>    1.2e+08 ~ 0%      +4.0%  1.249e+08       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
>  1.254e+08 ~ 0%      +3.1%  1.294e+08 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
>  1.237e+08 ~ 0%      +1.7%  1.259e+08 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
>  3.692e+08 ~ 0%      +3.0%  3.801e+08       TOTAL time.file_system_outputs
  What's this measuring?

								Honza
-- 
Jan Kara <jack@suse.cz>
SUSE Labs, CR

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: [writeback] 6903673566d: +2.5% fileio.requests_per_sec
  2014-04-10 19:27   ` Jan Kara
@ 2014-04-11  5:12     ` Fengguang Wu
  0 siblings, 0 replies; 6+ messages in thread
From: Fengguang Wu @ 2014-04-11  5:12 UTC (permalink / raw)
  To: Jan Kara; +Cc: LKML, linux-fsdevel, lkp

On Thu, Apr 10, 2014 at 09:27:51PM +0200, Jan Kara wrote:
> On Thu 10-04-14 21:05:52, Wu Fengguang wrote:
> > On Thu, Apr 10, 2014 at 08:41:37PM +0800, Fengguang Wu wrote:
> > Here are the changed stats before/after the patchset:
>   Thanks for gathering the numbers!
> 
> >       v3.14-rc8  ea87e2e7e0905325c58cf5643
> > ---------------  -------------------------
> >      58.98 ~102%     -73.2%      15.78       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-rndwr-sync
> >    2215.64 ~61%     -69.2%     682.57       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
> >     185.22 ~132%     -93.6%      11.80       snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-rndwr-sync
> >    2459.84 ~67%     -71.1%     710.15       TOTAL fileio.request_latency_max_ms
> > 
> >       v3.14-rc8  ea87e2e7e0905325c58cf5643
> > ---------------  -------------------------
> >       6251 ~ 0%      +4.0%       6503       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
> >       6532 ~ 0%      +3.2%       6737 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
> >       6444 ~ 0%      +1.7%       6554 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
> >      19227 ~ 0%      +3.0%      19795       TOTAL fileio.requests_per_sec
> > 
>   So fileio got better latency and higher requests per second. That's good.
> ...
> 
> >       v3.14-rc8  ea87e2e7e0905325c58cf5643
> > ---------------  -------------------------
> >     397285 ~ 0%      -6.9%     369872 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
> >     359312 ~ 0%      -5.5%     339685       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
> >     404981 ~ 0%      -4.5%     386775       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
> >    1161579 ~ 0%      -5.6%    1096334       TOTAL iostat.md0.wkB/s
>   So dd writing tests got lower throughput reported by iostat. I'll try to
> have a look whether I can reproduce that. BTW: Does that also correspond to
> longer time-to-completion of the dd test?

Nope, there are no noticeable changes for time.elapsed_time:

      v3.14-rc8  ea87e2e7e0905325c58cf5643
---------------  -------------------------
    601.99 ~ 0%      +0.0%     602.07 ~ 0%  lkp-st02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    630.92 ~ 0%      -0.9%     625.24       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-100dd
    615.98 ~ 0%      -0.2%     614.74       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-10dd
    610.58 ~ 0%      -0.1%     609.92 ~ 0%  lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-ext4-1dd
    608.90 ~ 0%      +0.0%     609.09       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-100dd
    604.46 ~ 0%      +0.0%     604.66       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-10dd
    603.67 ~ 0%      +0.0%     603.70       lkp-ws02/micro/dd-write/11HDD-JBOD-cfq-xfs-1dd
    606.65 ~ 0%      +0.0%     606.93       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-100dd
    606.31 ~ 0%      +0.0%     606.49       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-10dd
    602.97 ~ 0%      -0.2%     601.89       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-ext4-1dd
    603.92 ~ 0%      -0.2%     603.01       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-100dd
    602.66 ~ 0%      -0.0%     602.63       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-10dd
    602.19 ~ 0%      +0.2%     603.52       lkp-ws02/micro/dd-write/11HDD-RAID5-cfq-xfs-1dd

> 
> >       v3.14-rc8  ea87e2e7e0905325c58cf5643
> > ---------------  -------------------------
> >    1.2e+08 ~ 0%      +4.0%  1.249e+08       snb-drag/sysbench/fileio/600s-100%-1HDD-ext4-64G-1024-seqrewr-sync
> >  1.254e+08 ~ 0%      +3.1%  1.294e+08 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqrewr-sync
> >  1.237e+08 ~ 0%      +1.7%  1.259e+08 ~ 0%  snb-drag/sysbench/fileio/600s-100%-1HDD-xfs-64G-1024-seqwr-sync
> >  3.692e+08 ~ 0%      +3.0%  3.801e+08       TOTAL time.file_system_outputs
>   What's this measuring?

It corresponds to the "File system outputs" line in the below output.
It should be the number of dirtied pages.

% /usr/bin/time -v sleep 1
        Command being timed: "sleep 1"
        User time (seconds): 0.00
        System time (seconds): 0.00
        Percent of CPU this job got: 0%
        Elapsed (wall clock) time (h:mm:ss or m:ss): 0:01.00
        Average shared text size (kbytes): 0
        Average unshared data size (kbytes): 0
        Average stack size (kbytes): 0
        Average total size (kbytes): 0
        Maximum resident set size (kbytes): 2608
        Average resident set size (kbytes): 0
        Major (requiring I/O) page faults: 0
        Minor (reclaiming a frame) page faults: 213
        Voluntary context switches: 2
        Involuntary context switches: 1
        Swaps: 0
        File system inputs: 0
        File system outputs: 0
        Socket messages sent: 0
        Socket messages received: 0
        Signals delivered: 0
        Page size (bytes): 4096
        Exit status: 0


^ permalink raw reply	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2014-04-11  5:12 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2014-04-10 12:41 [writeback] 6903673566d: +2.5% fileio.requests_per_sec Fengguang Wu
2014-04-10 13:05 ` Fengguang Wu
2014-04-10 19:27   ` Jan Kara
2014-04-11  5:12     ` Fengguang Wu
2014-04-10 13:08 ` Fengguang Wu
2014-04-10 13:17   ` Fengguang Wu

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).