public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
* [rcu] 34577530114: +247.4% qperf.tcp.bw, -3.3% turbostat.Pkg_W
@ 2014-06-26  2:00 Fengguang Wu
  2014-06-26  2:15 ` Paul E. McKenney
  0 siblings, 1 reply; 2+ messages in thread
From: Fengguang Wu @ 2014-06-26  2:00 UTC (permalink / raw)
  To: Paul E. McKenney; +Cc: Dave Hansen, LKML, lkp, Jet Chen

[-- Attachment #1: Type: text/plain, Size: 22943 bytes --]

Hi Paul,

We are pleased to notice huge throughput increases in the qperf/iperf
tests, together with noticeable reduce of power consumption!

git://git.kernel.org/pub/scm/linux/kernel/git/paulmck/linux-rcu.git rcu/dev
commit 34577530114e9b1de10f3aa9665bb28c8ce585ba ("rcu: Bind grace-period kthreads to non-NO_HZ_FULL CPUs")

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  8.23e+08 ~ 6%    +247.4%  2.859e+09 ~ 0%  bens/qperf/600s
  8.23e+08 ~ 6%    +247.4%  2.859e+09 ~ 0%  TOTAL qperf.tcp.bw

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
 7.065e+09 ~ 3%    +210.0%   2.19e+10 ~ 8%  bens/iperf/300s-tcp
 7.065e+09 ~ 3%    +210.0%   2.19e+10 ~ 8%  TOTAL iperf.tcp.sender.bps

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
 7.065e+09 ~ 3%    +210.0%   2.19e+10 ~ 8%  bens/iperf/300s-tcp
 7.065e+09 ~ 3%    +210.0%   2.19e+10 ~ 8%  TOTAL iperf.tcp.receiver.bps

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
 7.718e+08 ~ 3%    +177.8%  2.144e+09 ~ 1%  bens/qperf/600s
 7.718e+08 ~ 3%    +177.8%  2.144e+09 ~ 1%  TOTAL qperf.udp.recv_bw

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
 7.745e+08 ~ 3%    +177.0%  2.145e+09 ~ 1%  bens/qperf/600s
 7.745e+08 ~ 3%    +177.0%  2.145e+09 ~ 1%  TOTAL qperf.udp.send_bw

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  1.65e+09 ~ 1%      +4.3%  1.721e+09 ~ 0%  bens/qperf/600s
  1.65e+09 ~ 1%      +4.3%  1.721e+09 ~ 0%  TOTAL qperf.sctp.bw

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     13579 ~ 1%      -2.3%      13264 ~ 1%  bens/qperf/600s
     13579 ~ 1%      -2.3%      13264 ~ 1%  TOTAL qperf.sctp.latency

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      8545 ~ 0%      +1.9%       8705 ~ 0%  bens/qperf/600s
      8545 ~ 0%      +1.9%       8705 ~ 0%  TOTAL qperf.udp.latency

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     12770 ~ 0%      -1.0%      12637 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
     12770 ~ 0%      -1.0%      12637 ~ 0%  TOTAL netperf.Throughput_tps

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      1015 ~ 2%     -92.1%         80 ~24%  ivb43/netperf/300s-25%-TCP_CRR
      1015 ~ 2%     -92.1%         80 ~24%  TOTAL cpuidle.POLL.usage

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
    104620 ~31%     -83.2%      17544 ~11%  ivb43/netperf/300s-25%-TCP_CRR
    104620 ~31%     -83.2%      17544 ~11%  TOTAL numa-vmstat.node1.numa_other

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      0.12 ~ 7%     -73.3%       0.03 ~12%  ivb43/netperf/300s-25%-TCP_CRR
      0.12 ~ 7%     -73.3%       0.03 ~12%  TOTAL turbostat.%c3

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  53226067 ~ 3%     -78.2%   11579930 ~14%  ivb43/netperf/300s-25%-TCP_CRR
   3327687 ~28%     +86.6%    6208767 ~42%  ivb44/pigz/25%-128K
  56553754 ~ 4%     -68.5%   17788697 ~24%  TOTAL cpuidle.C1E-IVT.time

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
    878601 ~ 3%     -75.2%     217607 ~12%  ivb43/netperf/300s-25%-TCP_CRR
      9282 ~27%     +99.2%      18495 ~49%  ivb44/pigz/25%-128K
    887884 ~ 4%     -73.4%     236102 ~15%  TOTAL cpuidle.C1E-IVT.usage

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  28174239 ~ 6%     -61.0%   10981001 ~ 8%  ivb43/netperf/300s-25%-TCP_CRR
  28174239 ~ 6%     -61.0%   10981001 ~ 8%  TOTAL cpuidle.C3-IVT.time

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
       237 ~20%    +141.1%        572 ~ 9%  xbm/pigz/25%-512K
       237 ~20%    +141.1%        572 ~ 9%  TOTAL cpuidle.C3-SNB.usage

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
   8192746 ~ 3%    +202.8%   24806641 ~ 7%  bens/iperf/300s-tcp
  15458478 ~ 1%     +69.2%   26148854 ~ 0%  bens/qperf/600s
  23651225 ~ 2%    +115.4%   50955496 ~ 4%  TOTAL proc-vmstat.numa_hit

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
   8192746 ~ 3%    +202.8%   24806641 ~ 7%  bens/iperf/300s-tcp
  15458478 ~ 1%     +69.2%   26148854 ~ 0%  bens/qperf/600s
  23651225 ~ 2%    +115.4%   50955496 ~ 4%  TOTAL proc-vmstat.numa_local

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  63502648 ~ 3%    +209.1%  1.963e+08 ~ 8%  bens/iperf/300s-tcp
 2.191e+08 ~ 1%     +55.9%  3.416e+08 ~ 0%  bens/qperf/600s
 2.826e+08 ~ 2%     +90.3%  5.379e+08 ~ 3%  TOTAL proc-vmstat.pgfree

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  15752293 ~ 3%    +209.0%   48677753 ~ 8%  bens/iperf/300s-tcp
  54168455 ~ 1%     +56.0%   84483873 ~ 0%  bens/qperf/600s
  69920749 ~ 2%     +90.4%  133161627 ~ 3%  TOTAL proc-vmstat.pgalloc_normal

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
   9737163 ~ 2%     -56.7%    4213811 ~ 6%  ivb43/netperf/300s-25%-TCP_CRR
   9737163 ~ 2%     -56.7%    4213811 ~ 6%  TOTAL cpuidle.C6-IVT.usage

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
   5033341 ~ 3%    +192.9%   14743041 ~12%  bens/iperf/300s-tcp
  21147143 ~ 0%     +30.9%   27679992 ~ 0%  bens/qperf/600s
  26180485 ~ 1%     +62.0%   42423033 ~ 4%  TOTAL softirqs.NET_RX

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      0.45 ~37%    +109.7%       0.95 ~34%  bens/qperf/600s
      0.45 ~37%    +109.7%       0.95 ~34%  TOTAL perf-profile.cpu-cycles.copy_user_generic_string.skb_copy_datagram_iovec.tcp_recvmsg.inet_recvmsg.sock_aio_read

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     87907 ~29%    +145.9%     216127 ~27%  xbm/pigz/25%-512K
     87907 ~29%    +145.9%     216127 ~27%  TOTAL cpuidle.C3-SNB.time

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
    646521 ~ 7%     -49.5%     326622 ~ 9%  ivb43/netperf/300s-25%-TCP_CRR
    646521 ~ 7%     -49.5%     326622 ~ 9%  TOTAL cpuidle.C3-IVT.usage

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
       658 ~13%    +109.3%       1377 ~11%  xbm/pigz/25%-512K
       658 ~13%    +109.3%       1377 ~11%  TOTAL cpuidle.C1E-SNB.usage

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  47748828 ~ 3%    +209.2%  1.476e+08 ~ 8%  bens/iperf/300s-tcp
  1.65e+08 ~ 1%     +55.9%  2.571e+08 ~ 0%  bens/qperf/600s
   2741315 ~ 3%      +7.4%    2943780 ~ 5%  ivb43/netperf/300s-25%-TCP_CRR
 2.155e+08 ~ 2%     +89.2%  4.077e+08 ~ 3%  TOTAL proc-vmstat.pgalloc_dma32

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
 2.826e+08 ~ 9%     -31.4%  1.938e+08 ~16%  lkp-sb03/nuttcp/300s
 2.826e+08 ~ 9%     -31.4%  1.938e+08 ~16%  TOTAL cpuidle.C1-SNB.time

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     47008 ~ 4%     +52.7%      71784 ~ 4%  bens/qperf/600s
     20704 ~ 4%     +49.2%      30899 ~ 3%  xbm/pigz/25%-512K
     67712 ~ 4%     +51.6%     102683 ~ 4%  TOTAL softirqs.RCU

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      8643 ~ 7%     -32.8%       5805 ~ 1%  ivb43/netperf/300s-25%-TCP_CRR
      8643 ~ 7%     -32.8%       5805 ~ 1%  TOTAL proc-vmstat.numa_hint_faults

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      8949 ~ 7%     -31.5%       6129 ~ 1%  ivb43/netperf/300s-25%-TCP_CRR
      8949 ~ 7%     -31.5%       6129 ~ 1%  TOTAL proc-vmstat.numa_pte_updates

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     29.25 ~ 0%     +41.8%      41.49 ~ 1%  ivb43/netperf/300s-25%-TCP_CRR
     29.25 ~ 0%     +41.8%      41.49 ~ 1%  TOTAL turbostat.%c6

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
       486 ~ 6%     -26.3%        358 ~ 8%  ivb43/netperf/300s-25%-TCP_CRR
       524 ~ 9%     -24.4%        396 ~ 6%  ivb44/pigz/25%-128K
       486 ~ 6%     -31.6%        332 ~ 7%  lkp-sb03/nuttcp/300s
      1497 ~ 7%     -27.4%       1088 ~ 7%  TOTAL slabinfo.kmem_cache.num_objs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
       486 ~ 6%     -26.3%        358 ~ 8%  ivb43/netperf/300s-25%-TCP_CRR
       524 ~ 9%     -24.4%        396 ~ 6%  ivb44/pigz/25%-128K
       486 ~ 6%     -31.6%        332 ~ 7%  lkp-sb03/nuttcp/300s
      1497 ~ 7%     -27.4%       1088 ~ 7%  TOTAL slabinfo.kmem_cache.active_objs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      7914 ~ 6%     -29.6%       5575 ~ 1%  ivb43/netperf/300s-25%-TCP_CRR
      7914 ~ 6%     -29.6%       5575 ~ 1%  TOTAL proc-vmstat.numa_hint_faults_local

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     37.08 ~ 0%     -34.3%      24.36 ~ 2%  ivb43/netperf/300s-25%-TCP_CRR
     12.48 ~ 3%     -13.8%      10.76 ~ 6%  lkp-sb03/nuttcp/300s
     49.56 ~ 1%     -29.2%      35.11 ~ 3%  TOTAL turbostat.%c1

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
       596 ~ 5%     -21.5%        468 ~ 6%  ivb43/netperf/300s-25%-TCP_CRR
       634 ~ 7%     -20.2%        506 ~ 5%  ivb44/pigz/25%-128K
       596 ~ 5%     -25.8%        442 ~ 5%  lkp-sb03/nuttcp/300s
      1827 ~ 6%     -22.4%       1418 ~ 5%  TOTAL slabinfo.kmem_cache_node.active_objs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     98347 ~ 1%     +66.0%     163290 ~ 9%  bens/iperf/300s-tcp
    263164 ~ 0%     +15.4%     303781 ~ 1%  bens/qperf/600s
    181866 ~ 3%     -15.0%     154551 ~ 7%  ivb44/pigz/25%-128K
     16865 ~ 1%     +14.6%      19322 ~ 4%  xbm/pigz/25%-512K
    560243 ~ 1%     +14.4%     640945 ~ 5%  TOTAL softirqs.SCHED

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
       614 ~ 5%     -20.8%        486 ~ 6%  ivb43/netperf/300s-25%-TCP_CRR
       652 ~ 7%     -19.6%        524 ~ 4%  ivb44/pigz/25%-128K
       614 ~ 5%     -25.0%        460 ~ 5%  lkp-sb03/nuttcp/300s
      1881 ~ 5%     -21.8%       1472 ~ 5%  TOTAL slabinfo.kmem_cache_node.num_objs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      1.05 ~ 6%     -20.1%       0.84 ~ 5%  bens/qperf/600s
      1.05 ~ 6%     -20.1%       0.84 ~ 5%  TOTAL perf-profile.cpu-cycles.tcp_rcv_established.tcp_v4_do_rcv.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     10097 ~ 0%     +26.7%      12797 ~ 2%  bens/qperf/600s
     10097 ~ 0%     +26.7%      12797 ~ 2%  TOTAL softirqs.HRTIMER

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      0.78 ~ 3%     +22.5%       0.96 ~ 3%  bens/qperf/600s
      0.78 ~ 3%     +22.5%       0.96 ~ 3%  TOTAL perf-profile.cpu-cycles.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv_finish.ip_rcv

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
 2.835e+09 ~ 0%     -16.5%  2.368e+09 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
 2.835e+09 ~ 0%     -16.5%  2.368e+09 ~ 0%  TOTAL cpuidle.C1-IVT.time

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
   5915033 ~13%     +14.3%    6761676 ~ 7%  ivb43/netperf/300s-25%-TCP_CRR
   5915033 ~13%     +14.3%    6761676 ~ 7%  TOTAL meminfo.DirectMap2M

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
    264559 ~ 0%     +15.6%     305707 ~ 0%  bens/iperf/300s-tcp
    264559 ~ 0%     +15.6%     305707 ~ 0%  TOTAL softirqs.TIMER

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     92365 ~ 3%     -12.9%      80487 ~ 9%  ivb44/pigz/25%-128K
     92365 ~ 3%     -12.9%      80487 ~ 9%  TOTAL meminfo.DirectMap4k

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  24143956 ~ 3%      -8.1%   22198708 ~ 5%  ivb43/netperf/300s-25%-TCP_CRR
  24143956 ~ 3%      -8.1%   22198708 ~ 5%  TOTAL numa-numastat.node1.numa_hit

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  24140149 ~ 3%      -8.1%   22196166 ~ 5%  ivb43/netperf/300s-25%-TCP_CRR
  24140149 ~ 3%      -8.1%   22196166 ~ 5%  TOTAL numa-numastat.node1.local_node

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  12512229 ~ 3%      -7.6%   11556940 ~ 6%  ivb43/netperf/300s-25%-TCP_CRR
  12512229 ~ 3%      -7.6%   11556940 ~ 6%  TOTAL numa-vmstat.node1.numa_hit

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  12407607 ~ 3%      -7.0%   11539395 ~ 6%  ivb43/netperf/300s-25%-TCP_CRR
  12407607 ~ 3%      -7.0%   11539395 ~ 6%  TOTAL numa-vmstat.node1.numa_local

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  25536237 ~ 3%      +6.8%   27272147 ~ 5%  ivb43/netperf/300s-25%-TCP_CRR
  25536237 ~ 3%      +6.8%   27272147 ~ 5%  TOTAL numa-numastat.node0.local_node

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  25538777 ~ 3%      +6.8%   27275952 ~ 5%  ivb43/netperf/300s-25%-TCP_CRR
  25538777 ~ 3%      +6.8%   27275952 ~ 5%  TOTAL numa-numastat.node0.numa_hit

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      1159 ~ 3%     -10.9%       1033 ~ 1%  xbm/pigz/25%-512K
      1159 ~ 3%     -10.9%       1033 ~ 1%  TOTAL slabinfo.kmalloc-96.num_objs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      1159 ~ 3%     -10.9%       1033 ~ 1%  xbm/pigz/25%-512K
      1159 ~ 3%     -10.9%       1033 ~ 1%  TOTAL slabinfo.kmalloc-96.active_objs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      1.33 ~ 2%     -10.5%       1.19 ~ 3%  bens/qperf/600s
      1.33 ~ 2%     -10.5%       1.19 ~ 3%  TOTAL perf-profile.cpu-cycles.tcp_sendmsg.inet_sendmsg.sock_aio_write.do_sync_write.vfs_write

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      1126 ~ 1%      -9.7%       1017 ~ 1%  bens/iperf/300s-tcp
      1126 ~ 1%      -9.7%       1017 ~ 1%  TOTAL proc-vmstat.pgactivate

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     12269 ~ 4%      +5.5%      12946 ~ 4%  ivb43/netperf/300s-25%-TCP_CRR
     12269 ~ 4%      +5.5%      12946 ~ 4%  TOTAL slabinfo.kmalloc-192.num_objs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     12258 ~ 4%      +5.6%      12946 ~ 4%  ivb43/netperf/300s-25%-TCP_CRR
     12258 ~ 4%      +5.6%      12946 ~ 4%  TOTAL slabinfo.kmalloc-192.active_objs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      1.16 ~ 4%      +9.2%       1.26 ~ 3%  ivb43/netperf/300s-25%-TCP_CRR
      1.16 ~ 4%      +9.2%       1.26 ~ 3%  TOTAL perf-profile.cpu-cycles.get_next_timer_interrupt.tick_nohz_stop_sched_tick.__tick_nohz_idle_enter.tick_nohz_idle_enter.cpu_idle_loop

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      3135 ~ 2%      +8.4%       3398 ~ 1%  ivb44/pigz/25%-128K
      3135 ~ 2%      +8.4%       3398 ~ 1%  TOTAL slabinfo.task_xstate.active_objs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
      3135 ~ 2%      +8.4%       3398 ~ 1%  ivb44/pigz/25%-128K
      3135 ~ 2%      +8.4%       3398 ~ 1%  TOTAL slabinfo.task_xstate.num_objs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     11496 ~ 5%     -96.2%        435 ~12%  bens/iperf/300s-tcp
     23777 ~ 1%     -86.3%       3264 ~10%  bens/qperf/600s
     22961 ~ 1%     -76.7%       5351 ~ 4%  ivb44/pigz/25%-128K
     13976 ~ 2%     -97.5%        349 ~22%  lkp-sb03/nuttcp/300s
     11345 ~ 0%     -88.0%       1361 ~25%  xbm/pigz/25%-512K
     83555 ~ 2%     -87.1%      10761 ~ 9%  TOTAL time.involuntary_context_switches

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
  36820683 ~ 0%     +17.5%   43253042 ~ 0%  bens/qperf/600s
  36820683 ~ 0%     +17.5%   43253042 ~ 0%  TOTAL time.voluntary_context_switches

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     13302 ~ 0%     +49.0%      19817 ~14%  bens/iperf/300s-tcp
     62977 ~ 0%     +17.3%      73856 ~ 0%  bens/qperf/600s
     76279 ~ 0%     +22.8%      93674 ~ 3%  TOTAL vmstat.system.in

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     23681 ~ 0%     +48.9%      35273 ~15%  bens/iperf/300s-tcp
    122654 ~ 0%     +17.4%     143989 ~ 0%  bens/qperf/600s
    759769 ~ 0%     -10.5%     680088 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
    906105 ~ 0%      -5.2%     859351 ~ 1%  TOTAL vmstat.system.cs

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
       144 ~ 0%      +5.4%        152 ~ 0%  bens/qperf/600s
       144 ~ 0%      +5.4%        152 ~ 0%  TOTAL time.percent_of_cpu_this_job_got

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
       122 ~ 0%      -4.2%        116 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
           ~ 0%      -4.2%            ~ 0%  TOTAL turbostat.Cor_W

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
       299 ~ 0%      -2.8%        290 ~ 2%  bens/iperf/300s-tcp
       863 ~ 0%      +5.2%        908 ~ 0%  bens/qperf/600s
      1162 ~ 0%      +3.2%       1199 ~ 0%  TOTAL time.system_time

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
       153 ~ 0%      -3.3%        147 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
           ~ 0%      -3.3%            ~ 0%  TOTAL turbostat.Pkg_W

221031cb1b33258  34577530114e9b1de10f3aa96  
---------------  -------------------------  
     33.55 ~ 0%      +1.7%      34.12 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
     33.55 ~ 0%      +1.7%      34.12 ~ 0%  TOTAL turbostat.%c0


Legend:
	~XX%    - stddev percent
	[+-]XX% - change percent


                                 iperf.tcp.sender.bps

  2.4e+10 ++----------O--------------------------------------O--------------+
          O     O  O     O     O  O  O  O  O  O  O  O  O        O           |
  2.2e+10 ++ O              O                                      O        |
    2e+10 ++                                                                |
          |                                               O                 |
  1.8e+10 ++                                                                |
  1.6e+10 ++                                                                |
          |                                                                 |
  1.4e+10 ++                                                                |
  1.2e+10 ++                                                                |
          |                                                                 |
    1e+10 ++                                                                |
    8e+09 ++                                                                |
          *..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*
    6e+09 ++----------------------------------------------------------------+


                                iperf.tcp.receiver.bps

  2.4e+10 ++----------O--------------------------------------O--------------+
          O     O  O     O     O  O  O  O  O  O  O  O  O        O           |
  2.2e+10 ++ O              O                                      O        |
    2e+10 ++                                                                |
          |                                               O                 |
  1.8e+10 ++                                                                |
  1.6e+10 ++                                                                |
          |                                                                 |
  1.4e+10 ++                                                                |
  1.2e+10 ++                                                                |
          |                                                                 |
    1e+10 ++                                                                |
    8e+09 ++                                                                |
          *..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*
    6e+09 ++----------------------------------------------------------------+


                          time.involuntary_context_switches

  14000 ++------------------------------------------------------------------+
        |                                                                   |
  12000 *+.        .*..  ..*..*..*..*..  .*..*..*..*..*..  ..*..*..*..*..   *
        |    .*..*.    *.              *.                *.               ..|
  10000 ++ *.                                                            *  |
        |                                                                   |
   8000 ++                                                                  |
        |                                                                   |
   6000 ++                                                                  |
        |                                                                   |
   4000 ++                                                                  |
        |                                                                   |
   2000 ++                                                                  |
        |     O                                          O                  |
      0 O+-O-----O--O--O---O--O--O--O--O--O--O--O--O--O------O--O--O--------+


	[*] bisect-good sample
	[O] bisect-bad  sample


Disclaimer:
Results have been estimated based on internal Intel analysis and are provided
for informational purposes only. Any difference in system hardware or software
design or configuration may affect actual performance.

Thanks,
Fengguang

[-- Attachment #2: reproduce --]
[-- Type: text/plain, Size: 49 bytes --]

./iperf3 -s
./iperf3 -t 300 -f M -J -c 127.0.0.1

^ permalink raw reply	[flat|nested] 2+ messages in thread

* Re: [rcu] 34577530114: +247.4% qperf.tcp.bw, -3.3% turbostat.Pkg_W
  2014-06-26  2:00 [rcu] 34577530114: +247.4% qperf.tcp.bw, -3.3% turbostat.Pkg_W Fengguang Wu
@ 2014-06-26  2:15 ` Paul E. McKenney
  0 siblings, 0 replies; 2+ messages in thread
From: Paul E. McKenney @ 2014-06-26  2:15 UTC (permalink / raw)
  To: Fengguang Wu; +Cc: Dave Hansen, LKML, lkp, Jet Chen

On Thu, Jun 26, 2014 at 10:00:11AM +0800, Fengguang Wu wrote:
> Hi Paul,
> 
> We are pleased to notice huge throughput increases in the qperf/iperf
> tests, together with noticeable reduce of power consumption!

This one was identified by your testing efforts, so thank you for giving
me the hints needed to make this change!  Looks like some negatives to
go with the positives, though eyeballing it looks mostly positive.

Just out of curiosity, what hardware configuration is this running on?
I am guessing a largish number of CPUs.

							Thanx, Paul

> git://git.kernel.org/pub/scm/linux/kernel/git/paulmck/linux-rcu.git rcu/dev
> commit 34577530114e9b1de10f3aa9665bb28c8ce585ba ("rcu: Bind grace-period kthreads to non-NO_HZ_FULL CPUs")
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   8.23e+08 ~ 6%    +247.4%  2.859e+09 ~ 0%  bens/qperf/600s
>   8.23e+08 ~ 6%    +247.4%  2.859e+09 ~ 0%  TOTAL qperf.tcp.bw
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>  7.065e+09 ~ 3%    +210.0%   2.19e+10 ~ 8%  bens/iperf/300s-tcp
>  7.065e+09 ~ 3%    +210.0%   2.19e+10 ~ 8%  TOTAL iperf.tcp.sender.bps
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>  7.065e+09 ~ 3%    +210.0%   2.19e+10 ~ 8%  bens/iperf/300s-tcp
>  7.065e+09 ~ 3%    +210.0%   2.19e+10 ~ 8%  TOTAL iperf.tcp.receiver.bps
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>  7.718e+08 ~ 3%    +177.8%  2.144e+09 ~ 1%  bens/qperf/600s
>  7.718e+08 ~ 3%    +177.8%  2.144e+09 ~ 1%  TOTAL qperf.udp.recv_bw
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>  7.745e+08 ~ 3%    +177.0%  2.145e+09 ~ 1%  bens/qperf/600s
>  7.745e+08 ~ 3%    +177.0%  2.145e+09 ~ 1%  TOTAL qperf.udp.send_bw
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   1.65e+09 ~ 1%      +4.3%  1.721e+09 ~ 0%  bens/qperf/600s
>   1.65e+09 ~ 1%      +4.3%  1.721e+09 ~ 0%  TOTAL qperf.sctp.bw
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      13579 ~ 1%      -2.3%      13264 ~ 1%  bens/qperf/600s
>      13579 ~ 1%      -2.3%      13264 ~ 1%  TOTAL qperf.sctp.latency
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       8545 ~ 0%      +1.9%       8705 ~ 0%  bens/qperf/600s
>       8545 ~ 0%      +1.9%       8705 ~ 0%  TOTAL qperf.udp.latency
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      12770 ~ 0%      -1.0%      12637 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
>      12770 ~ 0%      -1.0%      12637 ~ 0%  TOTAL netperf.Throughput_tps
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       1015 ~ 2%     -92.1%         80 ~24%  ivb43/netperf/300s-25%-TCP_CRR
>       1015 ~ 2%     -92.1%         80 ~24%  TOTAL cpuidle.POLL.usage
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>     104620 ~31%     -83.2%      17544 ~11%  ivb43/netperf/300s-25%-TCP_CRR
>     104620 ~31%     -83.2%      17544 ~11%  TOTAL numa-vmstat.node1.numa_other
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       0.12 ~ 7%     -73.3%       0.03 ~12%  ivb43/netperf/300s-25%-TCP_CRR
>       0.12 ~ 7%     -73.3%       0.03 ~12%  TOTAL turbostat.%c3
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   53226067 ~ 3%     -78.2%   11579930 ~14%  ivb43/netperf/300s-25%-TCP_CRR
>    3327687 ~28%     +86.6%    6208767 ~42%  ivb44/pigz/25%-128K
>   56553754 ~ 4%     -68.5%   17788697 ~24%  TOTAL cpuidle.C1E-IVT.time
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>     878601 ~ 3%     -75.2%     217607 ~12%  ivb43/netperf/300s-25%-TCP_CRR
>       9282 ~27%     +99.2%      18495 ~49%  ivb44/pigz/25%-128K
>     887884 ~ 4%     -73.4%     236102 ~15%  TOTAL cpuidle.C1E-IVT.usage
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   28174239 ~ 6%     -61.0%   10981001 ~ 8%  ivb43/netperf/300s-25%-TCP_CRR
>   28174239 ~ 6%     -61.0%   10981001 ~ 8%  TOTAL cpuidle.C3-IVT.time
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>        237 ~20%    +141.1%        572 ~ 9%  xbm/pigz/25%-512K
>        237 ~20%    +141.1%        572 ~ 9%  TOTAL cpuidle.C3-SNB.usage
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>    8192746 ~ 3%    +202.8%   24806641 ~ 7%  bens/iperf/300s-tcp
>   15458478 ~ 1%     +69.2%   26148854 ~ 0%  bens/qperf/600s
>   23651225 ~ 2%    +115.4%   50955496 ~ 4%  TOTAL proc-vmstat.numa_hit
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>    8192746 ~ 3%    +202.8%   24806641 ~ 7%  bens/iperf/300s-tcp
>   15458478 ~ 1%     +69.2%   26148854 ~ 0%  bens/qperf/600s
>   23651225 ~ 2%    +115.4%   50955496 ~ 4%  TOTAL proc-vmstat.numa_local
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   63502648 ~ 3%    +209.1%  1.963e+08 ~ 8%  bens/iperf/300s-tcp
>  2.191e+08 ~ 1%     +55.9%  3.416e+08 ~ 0%  bens/qperf/600s
>  2.826e+08 ~ 2%     +90.3%  5.379e+08 ~ 3%  TOTAL proc-vmstat.pgfree
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   15752293 ~ 3%    +209.0%   48677753 ~ 8%  bens/iperf/300s-tcp
>   54168455 ~ 1%     +56.0%   84483873 ~ 0%  bens/qperf/600s
>   69920749 ~ 2%     +90.4%  133161627 ~ 3%  TOTAL proc-vmstat.pgalloc_normal
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>    9737163 ~ 2%     -56.7%    4213811 ~ 6%  ivb43/netperf/300s-25%-TCP_CRR
>    9737163 ~ 2%     -56.7%    4213811 ~ 6%  TOTAL cpuidle.C6-IVT.usage
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>    5033341 ~ 3%    +192.9%   14743041 ~12%  bens/iperf/300s-tcp
>   21147143 ~ 0%     +30.9%   27679992 ~ 0%  bens/qperf/600s
>   26180485 ~ 1%     +62.0%   42423033 ~ 4%  TOTAL softirqs.NET_RX
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       0.45 ~37%    +109.7%       0.95 ~34%  bens/qperf/600s
>       0.45 ~37%    +109.7%       0.95 ~34%  TOTAL perf-profile.cpu-cycles.copy_user_generic_string.skb_copy_datagram_iovec.tcp_recvmsg.inet_recvmsg.sock_aio_read
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      87907 ~29%    +145.9%     216127 ~27%  xbm/pigz/25%-512K
>      87907 ~29%    +145.9%     216127 ~27%  TOTAL cpuidle.C3-SNB.time
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>     646521 ~ 7%     -49.5%     326622 ~ 9%  ivb43/netperf/300s-25%-TCP_CRR
>     646521 ~ 7%     -49.5%     326622 ~ 9%  TOTAL cpuidle.C3-IVT.usage
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>        658 ~13%    +109.3%       1377 ~11%  xbm/pigz/25%-512K
>        658 ~13%    +109.3%       1377 ~11%  TOTAL cpuidle.C1E-SNB.usage
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   47748828 ~ 3%    +209.2%  1.476e+08 ~ 8%  bens/iperf/300s-tcp
>   1.65e+08 ~ 1%     +55.9%  2.571e+08 ~ 0%  bens/qperf/600s
>    2741315 ~ 3%      +7.4%    2943780 ~ 5%  ivb43/netperf/300s-25%-TCP_CRR
>  2.155e+08 ~ 2%     +89.2%  4.077e+08 ~ 3%  TOTAL proc-vmstat.pgalloc_dma32
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>  2.826e+08 ~ 9%     -31.4%  1.938e+08 ~16%  lkp-sb03/nuttcp/300s
>  2.826e+08 ~ 9%     -31.4%  1.938e+08 ~16%  TOTAL cpuidle.C1-SNB.time
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      47008 ~ 4%     +52.7%      71784 ~ 4%  bens/qperf/600s
>      20704 ~ 4%     +49.2%      30899 ~ 3%  xbm/pigz/25%-512K
>      67712 ~ 4%     +51.6%     102683 ~ 4%  TOTAL softirqs.RCU
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       8643 ~ 7%     -32.8%       5805 ~ 1%  ivb43/netperf/300s-25%-TCP_CRR
>       8643 ~ 7%     -32.8%       5805 ~ 1%  TOTAL proc-vmstat.numa_hint_faults
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       8949 ~ 7%     -31.5%       6129 ~ 1%  ivb43/netperf/300s-25%-TCP_CRR
>       8949 ~ 7%     -31.5%       6129 ~ 1%  TOTAL proc-vmstat.numa_pte_updates
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      29.25 ~ 0%     +41.8%      41.49 ~ 1%  ivb43/netperf/300s-25%-TCP_CRR
>      29.25 ~ 0%     +41.8%      41.49 ~ 1%  TOTAL turbostat.%c6
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>        486 ~ 6%     -26.3%        358 ~ 8%  ivb43/netperf/300s-25%-TCP_CRR
>        524 ~ 9%     -24.4%        396 ~ 6%  ivb44/pigz/25%-128K
>        486 ~ 6%     -31.6%        332 ~ 7%  lkp-sb03/nuttcp/300s
>       1497 ~ 7%     -27.4%       1088 ~ 7%  TOTAL slabinfo.kmem_cache.num_objs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>        486 ~ 6%     -26.3%        358 ~ 8%  ivb43/netperf/300s-25%-TCP_CRR
>        524 ~ 9%     -24.4%        396 ~ 6%  ivb44/pigz/25%-128K
>        486 ~ 6%     -31.6%        332 ~ 7%  lkp-sb03/nuttcp/300s
>       1497 ~ 7%     -27.4%       1088 ~ 7%  TOTAL slabinfo.kmem_cache.active_objs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       7914 ~ 6%     -29.6%       5575 ~ 1%  ivb43/netperf/300s-25%-TCP_CRR
>       7914 ~ 6%     -29.6%       5575 ~ 1%  TOTAL proc-vmstat.numa_hint_faults_local
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      37.08 ~ 0%     -34.3%      24.36 ~ 2%  ivb43/netperf/300s-25%-TCP_CRR
>      12.48 ~ 3%     -13.8%      10.76 ~ 6%  lkp-sb03/nuttcp/300s
>      49.56 ~ 1%     -29.2%      35.11 ~ 3%  TOTAL turbostat.%c1
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>        596 ~ 5%     -21.5%        468 ~ 6%  ivb43/netperf/300s-25%-TCP_CRR
>        634 ~ 7%     -20.2%        506 ~ 5%  ivb44/pigz/25%-128K
>        596 ~ 5%     -25.8%        442 ~ 5%  lkp-sb03/nuttcp/300s
>       1827 ~ 6%     -22.4%       1418 ~ 5%  TOTAL slabinfo.kmem_cache_node.active_objs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      98347 ~ 1%     +66.0%     163290 ~ 9%  bens/iperf/300s-tcp
>     263164 ~ 0%     +15.4%     303781 ~ 1%  bens/qperf/600s
>     181866 ~ 3%     -15.0%     154551 ~ 7%  ivb44/pigz/25%-128K
>      16865 ~ 1%     +14.6%      19322 ~ 4%  xbm/pigz/25%-512K
>     560243 ~ 1%     +14.4%     640945 ~ 5%  TOTAL softirqs.SCHED
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>        614 ~ 5%     -20.8%        486 ~ 6%  ivb43/netperf/300s-25%-TCP_CRR
>        652 ~ 7%     -19.6%        524 ~ 4%  ivb44/pigz/25%-128K
>        614 ~ 5%     -25.0%        460 ~ 5%  lkp-sb03/nuttcp/300s
>       1881 ~ 5%     -21.8%       1472 ~ 5%  TOTAL slabinfo.kmem_cache_node.num_objs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       1.05 ~ 6%     -20.1%       0.84 ~ 5%  bens/qperf/600s
>       1.05 ~ 6%     -20.1%       0.84 ~ 5%  TOTAL perf-profile.cpu-cycles.tcp_rcv_established.tcp_v4_do_rcv.tcp_prequeue_process.tcp_recvmsg.inet_recvmsg
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      10097 ~ 0%     +26.7%      12797 ~ 2%  bens/qperf/600s
>      10097 ~ 0%     +26.7%      12797 ~ 2%  TOTAL softirqs.HRTIMER
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       0.78 ~ 3%     +22.5%       0.96 ~ 3%  bens/qperf/600s
>       0.78 ~ 3%     +22.5%       0.96 ~ 3%  TOTAL perf-profile.cpu-cycles.tcp_v4_rcv.ip_local_deliver_finish.ip_local_deliver.ip_rcv_finish.ip_rcv
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>  2.835e+09 ~ 0%     -16.5%  2.368e+09 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
>  2.835e+09 ~ 0%     -16.5%  2.368e+09 ~ 0%  TOTAL cpuidle.C1-IVT.time
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>    5915033 ~13%     +14.3%    6761676 ~ 7%  ivb43/netperf/300s-25%-TCP_CRR
>    5915033 ~13%     +14.3%    6761676 ~ 7%  TOTAL meminfo.DirectMap2M
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>     264559 ~ 0%     +15.6%     305707 ~ 0%  bens/iperf/300s-tcp
>     264559 ~ 0%     +15.6%     305707 ~ 0%  TOTAL softirqs.TIMER
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      92365 ~ 3%     -12.9%      80487 ~ 9%  ivb44/pigz/25%-128K
>      92365 ~ 3%     -12.9%      80487 ~ 9%  TOTAL meminfo.DirectMap4k
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   24143956 ~ 3%      -8.1%   22198708 ~ 5%  ivb43/netperf/300s-25%-TCP_CRR
>   24143956 ~ 3%      -8.1%   22198708 ~ 5%  TOTAL numa-numastat.node1.numa_hit
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   24140149 ~ 3%      -8.1%   22196166 ~ 5%  ivb43/netperf/300s-25%-TCP_CRR
>   24140149 ~ 3%      -8.1%   22196166 ~ 5%  TOTAL numa-numastat.node1.local_node
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   12512229 ~ 3%      -7.6%   11556940 ~ 6%  ivb43/netperf/300s-25%-TCP_CRR
>   12512229 ~ 3%      -7.6%   11556940 ~ 6%  TOTAL numa-vmstat.node1.numa_hit
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   12407607 ~ 3%      -7.0%   11539395 ~ 6%  ivb43/netperf/300s-25%-TCP_CRR
>   12407607 ~ 3%      -7.0%   11539395 ~ 6%  TOTAL numa-vmstat.node1.numa_local
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   25536237 ~ 3%      +6.8%   27272147 ~ 5%  ivb43/netperf/300s-25%-TCP_CRR
>   25536237 ~ 3%      +6.8%   27272147 ~ 5%  TOTAL numa-numastat.node0.local_node
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   25538777 ~ 3%      +6.8%   27275952 ~ 5%  ivb43/netperf/300s-25%-TCP_CRR
>   25538777 ~ 3%      +6.8%   27275952 ~ 5%  TOTAL numa-numastat.node0.numa_hit
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       1159 ~ 3%     -10.9%       1033 ~ 1%  xbm/pigz/25%-512K
>       1159 ~ 3%     -10.9%       1033 ~ 1%  TOTAL slabinfo.kmalloc-96.num_objs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       1159 ~ 3%     -10.9%       1033 ~ 1%  xbm/pigz/25%-512K
>       1159 ~ 3%     -10.9%       1033 ~ 1%  TOTAL slabinfo.kmalloc-96.active_objs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       1.33 ~ 2%     -10.5%       1.19 ~ 3%  bens/qperf/600s
>       1.33 ~ 2%     -10.5%       1.19 ~ 3%  TOTAL perf-profile.cpu-cycles.tcp_sendmsg.inet_sendmsg.sock_aio_write.do_sync_write.vfs_write
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       1126 ~ 1%      -9.7%       1017 ~ 1%  bens/iperf/300s-tcp
>       1126 ~ 1%      -9.7%       1017 ~ 1%  TOTAL proc-vmstat.pgactivate
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      12269 ~ 4%      +5.5%      12946 ~ 4%  ivb43/netperf/300s-25%-TCP_CRR
>      12269 ~ 4%      +5.5%      12946 ~ 4%  TOTAL slabinfo.kmalloc-192.num_objs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      12258 ~ 4%      +5.6%      12946 ~ 4%  ivb43/netperf/300s-25%-TCP_CRR
>      12258 ~ 4%      +5.6%      12946 ~ 4%  TOTAL slabinfo.kmalloc-192.active_objs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       1.16 ~ 4%      +9.2%       1.26 ~ 3%  ivb43/netperf/300s-25%-TCP_CRR
>       1.16 ~ 4%      +9.2%       1.26 ~ 3%  TOTAL perf-profile.cpu-cycles.get_next_timer_interrupt.tick_nohz_stop_sched_tick.__tick_nohz_idle_enter.tick_nohz_idle_enter.cpu_idle_loop
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       3135 ~ 2%      +8.4%       3398 ~ 1%  ivb44/pigz/25%-128K
>       3135 ~ 2%      +8.4%       3398 ~ 1%  TOTAL slabinfo.task_xstate.active_objs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>       3135 ~ 2%      +8.4%       3398 ~ 1%  ivb44/pigz/25%-128K
>       3135 ~ 2%      +8.4%       3398 ~ 1%  TOTAL slabinfo.task_xstate.num_objs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      11496 ~ 5%     -96.2%        435 ~12%  bens/iperf/300s-tcp
>      23777 ~ 1%     -86.3%       3264 ~10%  bens/qperf/600s
>      22961 ~ 1%     -76.7%       5351 ~ 4%  ivb44/pigz/25%-128K
>      13976 ~ 2%     -97.5%        349 ~22%  lkp-sb03/nuttcp/300s
>      11345 ~ 0%     -88.0%       1361 ~25%  xbm/pigz/25%-512K
>      83555 ~ 2%     -87.1%      10761 ~ 9%  TOTAL time.involuntary_context_switches
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>   36820683 ~ 0%     +17.5%   43253042 ~ 0%  bens/qperf/600s
>   36820683 ~ 0%     +17.5%   43253042 ~ 0%  TOTAL time.voluntary_context_switches
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      13302 ~ 0%     +49.0%      19817 ~14%  bens/iperf/300s-tcp
>      62977 ~ 0%     +17.3%      73856 ~ 0%  bens/qperf/600s
>      76279 ~ 0%     +22.8%      93674 ~ 3%  TOTAL vmstat.system.in
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      23681 ~ 0%     +48.9%      35273 ~15%  bens/iperf/300s-tcp
>     122654 ~ 0%     +17.4%     143989 ~ 0%  bens/qperf/600s
>     759769 ~ 0%     -10.5%     680088 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
>     906105 ~ 0%      -5.2%     859351 ~ 1%  TOTAL vmstat.system.cs
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>        144 ~ 0%      +5.4%        152 ~ 0%  bens/qperf/600s
>        144 ~ 0%      +5.4%        152 ~ 0%  TOTAL time.percent_of_cpu_this_job_got
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>        122 ~ 0%      -4.2%        116 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
>            ~ 0%      -4.2%            ~ 0%  TOTAL turbostat.Cor_W
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>        299 ~ 0%      -2.8%        290 ~ 2%  bens/iperf/300s-tcp
>        863 ~ 0%      +5.2%        908 ~ 0%  bens/qperf/600s
>       1162 ~ 0%      +3.2%       1199 ~ 0%  TOTAL time.system_time
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>        153 ~ 0%      -3.3%        147 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
>            ~ 0%      -3.3%            ~ 0%  TOTAL turbostat.Pkg_W
> 
> 221031cb1b33258  34577530114e9b1de10f3aa96  
> ---------------  -------------------------  
>      33.55 ~ 0%      +1.7%      34.12 ~ 0%  ivb43/netperf/300s-25%-TCP_CRR
>      33.55 ~ 0%      +1.7%      34.12 ~ 0%  TOTAL turbostat.%c0
> 
> 
> Legend:
> 	~XX%    - stddev percent
> 	[+-]XX% - change percent
> 
> 
>                                  iperf.tcp.sender.bps
> 
>   2.4e+10 ++----------O--------------------------------------O--------------+
>           O     O  O     O     O  O  O  O  O  O  O  O  O        O           |
>   2.2e+10 ++ O              O                                      O        |
>     2e+10 ++                                                                |
>           |                                               O                 |
>   1.8e+10 ++                                                                |
>   1.6e+10 ++                                                                |
>           |                                                                 |
>   1.4e+10 ++                                                                |
>   1.2e+10 ++                                                                |
>           |                                                                 |
>     1e+10 ++                                                                |
>     8e+09 ++                                                                |
>           *..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*
>     6e+09 ++----------------------------------------------------------------+
> 
> 
>                                 iperf.tcp.receiver.bps
> 
>   2.4e+10 ++----------O--------------------------------------O--------------+
>           O     O  O     O     O  O  O  O  O  O  O  O  O        O           |
>   2.2e+10 ++ O              O                                      O        |
>     2e+10 ++                                                                |
>           |                                               O                 |
>   1.8e+10 ++                                                                |
>   1.6e+10 ++                                                                |
>           |                                                                 |
>   1.4e+10 ++                                                                |
>   1.2e+10 ++                                                                |
>           |                                                                 |
>     1e+10 ++                                                                |
>     8e+09 ++                                                                |
>           *..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*..*
>     6e+09 ++----------------------------------------------------------------+
> 
> 
>                           time.involuntary_context_switches
> 
>   14000 ++------------------------------------------------------------------+
>         |                                                                   |
>   12000 *+.        .*..  ..*..*..*..*..  .*..*..*..*..*..  ..*..*..*..*..   *
>         |    .*..*.    *.              *.                *.               ..|
>   10000 ++ *.                                                            *  |
>         |                                                                   |
>    8000 ++                                                                  |
>         |                                                                   |
>    6000 ++                                                                  |
>         |                                                                   |
>    4000 ++                                                                  |
>         |                                                                   |
>    2000 ++                                                                  |
>         |     O                                          O                  |
>       0 O+-O-----O--O--O---O--O--O--O--O--O--O--O--O--O------O--O--O--------+
> 
> 
> 	[*] bisect-good sample
> 	[O] bisect-bad  sample
> 
> 
> Disclaimer:
> Results have been estimated based on internal Intel analysis and are provided
> for informational purposes only. Any difference in system hardware or software
> design or configuration may affect actual performance.
> 
> Thanks,
> Fengguang

> ./iperf3 -s
> ./iperf3 -t 300 -f M -J -c 127.0.0.1


^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, other threads:[~2014-06-26  2:15 UTC | newest]

Thread overview: 2+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2014-06-26  2:00 [rcu] 34577530114: +247.4% qperf.tcp.bw, -3.3% turbostat.Pkg_W Fengguang Wu
2014-06-26  2:15 ` Paul E. McKenney

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox