* Re: [lkp] [rcu] b8084f70e0: No primary result change, 1414.7% unixbench.time.involuntary_context_switches [not found] <878u43fmpc.fsf@yhuang-dev.intel.com> @ 2016-01-06 3:30 ` Paul E. McKenney 2016-01-06 4:25 ` [LKP] " Huang, Ying 0 siblings, 1 reply; 3+ messages in thread From: Paul E. McKenney @ 2016-01-06 3:30 UTC (permalink / raw) To: kernel test robot Cc: lkp, LKML, Mike Galbraith, Thomas Gleixner, Sebastian Andrzej Siewior On Wed, Jan 06, 2016 at 10:47:43AM +0800, kernel test robot wrote: > FYI, we noticed the below changes on > > https://git.kernel.org/pub/scm/linux/kernel/git/rt/linux-rt-devel.git for-kbuild-bot/current-stable > commit b8084f70e028697b342d6388b244d6171717fc54 ("rcu: Eliminate softirq processing from rcutree") This is a performance degradation, correct? If so, looks like this commit is not ready for mainline unless set up to be configured on only for -rt workloads. Or am I missing the plot somewhere here? Thanx, Paul > ========================================================================================= > compiler/cpufreq_governor/kconfig/nr_task/rootfs/tbox_group/test/testcase: > gcc-4.9/performance/x86_64-rhel/1/debian-x86_64-2015-02-07.cgz/lkp-ivb-d02/fsbuffer/unixbench > > commit: > ee644236a506642e20637f954d286f49a76ed83a > b8084f70e028697b342d6388b244d6171717fc54 > > ee644236a506642e b8084f70e028697b342d6388b2 > ---------------- -------------------------- > %stddev %change %stddev > \ | \ > 257.25 ± 18% +1414.7% 3896 ± 13% unixbench.time.involuntary_context_switches > 4425148 ± 22% -61.9% 1684712 ± 29% cpuidle.C1E-IVB.time > 83.75 ± 48% +91.6% 160.50 ± 31% cpuidle.POLL.usage > 1902 ± 7% -12.0% 1674 ± 1% slabinfo.anon_vma.active_objs > 1902 ± 7% -12.0% 1674 ± 1% slabinfo.anon_vma.num_objs > 257.25 ± 18% +1414.7% 3896 ± 13% time.involuntary_context_switches > 8.15 ± 6% -14.1% 7.00 ± 1% time.user_time > 34345 ± 14% -33.3% 22908 ± 33% sched_debug.cfs_rq:/.exec_clock.2 > 34987 ± 13% -19.7% 28093 ± 15% sched_debug.cfs_rq:/.exec_clock.max > 642.75 ± 5% +59.6% 1025 ± 55% sched_debug.cfs_rq:/.exec_clock.min > 14639 ± 13% -21.8% 11443 ± 16% sched_debug.cfs_rq:/.exec_clock.stddev > 127.75 ± 16% -26.2% 94.25 ± 25% sched_debug.cfs_rq:/.load_avg.3 > 38865 ± 12% -36.0% 24885 ± 34% sched_debug.cfs_rq:/.min_vruntime.2 > 39385 ± 12% -22.8% 30395 ± 16% sched_debug.cfs_rq:/.min_vruntime.max > 1090 ± 11% +45.3% 1584 ± 32% sched_debug.cfs_rq:/.min_vruntime.min > 16286 ± 13% -25.1% 12200 ± 18% sched_debug.cfs_rq:/.min_vruntime.stddev > 2.00 ± 0% -50.0% 1.00 ± 0% sched_debug.cfs_rq:/.nr_spread_over.0 > 2.00 ± 0% -50.0% 1.00 ± 0% sched_debug.cfs_rq:/.nr_spread_over.max > 0.87 ± 0% -42.3% 0.50 ± 0% sched_debug.cfs_rq:/.nr_spread_over.stddev > 28.50 ± 62% +338.6% 125.00 ±114% sched_debug.cfs_rq:/.runnable_load_avg.1 > 16286 ± 13% -25.1% 12200 ± 18% sched_debug.cfs_rq:/.spread0.stddev > 127.75 ± 16% -26.0% 94.50 ± 25% sched_debug.cfs_rq:/.tg_load_avg_contrib.3 > 626662 ± 5% -13.2% 544121 ± 9% sched_debug.cpu.avg_idle.0 > 20.25 ± 28% +419.8% 105.25 ±132% sched_debug.cpu.cpu_load[3].1 > 692.40 ± 7% -15.2% 586.96 ± 9% sched_debug.cpu.curr->pid.avg > 36187 ± 12% -31.5% 24793 ± 29% sched_debug.cpu.nr_load_updates.2 > 15625 ± 11% +61.6% 25245 ± 23% sched_debug.cpu.nr_switches.0 > 20008 ± 4% +14.1% 22828 ± 4% sched_debug.cpu.nr_switches.avg > 23333 ± 8% +40.9% 32872 ± 18% sched_debug.cpu.sched_count.0 > 21974 ± 4% +12.7% 24771 ± 4% sched_debug.cpu.sched_count.avg > 31771 ± 9% +22.6% 38942 ± 5% sched_debug.cpu.sched_count.max > 9514 ± 28% +75.8% 16728 ± 7% sched_debug.cpu.ttwu_count.0 > 4323 ± 10% +40.6% 6080 ± 30% sched_debug.cpu.ttwu_count.2 > 10068 ± 4% +15.6% 11639 ± 4% sched_debug.cpu.ttwu_count.avg > 4101 ± 10% +21.7% 4990 ± 8% sched_debug.cpu.ttwu_count.min > 3676 ± 21% +102.5% 7443 ± 8% sched_debug.cpu.ttwu_local.0 > 2014 ± 15% +43.2% 2884 ± 10% sched_debug.cpu.ttwu_local.2 > 3508 ± 1% +24.8% 4377 ± 4% sched_debug.cpu.ttwu_local.avg > 5554 ± 19% +34.0% 7444 ± 8% sched_debug.cpu.ttwu_local.max > 1846 ± 16% +40.2% 2588 ± 6% sched_debug.cpu.ttwu_local.min > > ========================================================================================= > compiler/cpufreq_governor/kconfig/nr_task/rootfs/tbox_group/test/testcase: > gcc-4.9/performance/x86_64-rhel/1/debian-x86_64-2015-02-07.cgz/lkp-ivb-d02/fsdisk/unixbench > > commit: > ee644236a506642e20637f954d286f49a76ed83a > b8084f70e028697b342d6388b244d6171717fc54 > > ee644236a506642e b8084f70e028697b342d6388b2 > ---------------- -------------------------- > fail:runs %reproduction fail:runs > | | | > :4 25% 1:4 kmsg.DHCP/BOOTP:Reply_not_for_us,op[#]xid[#] > %stddev %change %stddev > \ | \ > 265.75 ± 18% +1313.4% 3756 ± 9% unixbench.time.involuntary_context_switches > 659.50 ± 6% +16.5% 768.00 ± 7% slabinfo.kmalloc-512.num_objs > 265.75 ± 18% +1313.4% 3756 ± 9% time.involuntary_context_switches > 5911312 ± 13% -55.9% 2606719 ± 10% cpuidle.C1E-IVB.time > 95195 ±172% +815.7% 871684 ±140% cpuidle.POLL.time > 51.75 ± 10% -30.9% 35.75 ± 24% cpuidle.POLL.usage > 13361 ± 22% -27.0% 9754 ± 4% sched_debug.cfs_rq:/.exec_clock.stddev > 14632 ± 24% -28.1% 10524 ± 5% sched_debug.cfs_rq:/.min_vruntime.stddev > 14632 ± 24% -28.1% 10524 ± 5% sched_debug.cfs_rq:/.spread0.stddev > 197.25 ± 14% +52.9% 301.50 ± 41% sched_debug.cfs_rq:/.util_avg.0 > 552666 ± 8% -7.7% 510200 ± 7% sched_debug.cpu.avg_idle.1 > 13610 ± 30% +59.7% 21734 ± 7% sched_debug.cpu.nr_switches.0 > 21145 ± 1% +12.3% 23752 ± 7% sched_debug.cpu.nr_switches.avg > 10105 ± 21% +62.1% 16380 ± 7% sched_debug.cpu.nr_switches.min > 11293 ± 28% -44.4% 6276 ± 16% sched_debug.cpu.nr_switches.stddev > 21314 ± 19% +38.1% 29437 ± 5% sched_debug.cpu.sched_count.0 > 11261 ± 22% +57.2% 17703 ± 9% sched_debug.cpu.sched_count.min > 11158 ± 27% -36.7% 7068 ± 12% sched_debug.cpu.sched_count.stddev > 5854 ± 35% +57.0% 9194 ± 8% sched_debug.cpu.sched_goidle.0 > 3713 ± 27% +68.4% 6253 ± 11% sched_debug.cpu.sched_goidle.min > 5638 ± 29% -44.5% 3131 ± 18% sched_debug.cpu.sched_goidle.stddev > 8286 ± 32% +85.0% 15333 ± 15% sched_debug.cpu.ttwu_count.0 > 10697 ± 1% +13.2% 12107 ± 7% sched_debug.cpu.ttwu_count.avg > 4845 ± 5% +17.8% 5707 ± 8% sched_debug.cpu.ttwu_count.min > 2886 ± 47% +105.5% 5931 ± 16% sched_debug.cpu.ttwu_local.0 > 3667 ± 3% +17.0% 4291 ± 1% sched_debug.cpu.ttwu_local.avg > 2127 ± 17% +29.2% 2748 ± 7% sched_debug.cpu.ttwu_local.min > > > lkp-ivb-d02: Ivy Bridge > Memory: 8G > > unixbench.time.involuntary_context_switches > > 5000 ++-------------------------------------------------------------------+ > 4500 O+ | > | O O O O O > 4000 ++ O O O | > 3500 ++O O O O O O O O O O O | > | O O O | > 3000 ++ O O | > 2500 ++ | > 2000 ++ | > | | > 1500 ++ | > 1000 ++ | > |.*.. .*.. .*. .*.*.. .*.. | > 500 *+ * *.*..*.*. *. .*.. .*.*..* *.*..*.* | > 0 ++----------O---------O-------*----*------O----O---------------------+ > > [*] bisect-good sample > [O] bisect-bad sample > > To reproduce: > > git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git > cd lkp-tests > bin/lkp install job.yaml # job file is attached in this email > bin/lkp run job.yaml > > > Disclaimer: > Results have been estimated based on internal Intel analysis and are provided > for informational purposes only. Any difference in system hardware or software > design or configuration may affect actual performance. > > > Thanks, > Ying Huang > --- > LKP_SERVER: inn > LKP_CGI_PORT: 80 > LKP_CIFS_PORT: 139 > testcase: unixbench > default-monitors: > wait: activate-monitor > kmsg: > uptime: > iostat: > vmstat: > numa-numastat: > numa-vmstat: > numa-meminfo: > proc-vmstat: > proc-stat: > interval: 10 > meminfo: > slabinfo: > interrupts: > lock_stat: > latency_stats: > softirqs: > bdi_dev_mapping: > diskstats: > nfsstat: > cpuidle: > cpufreq-stats: > turbostat: > pmeter: > sched_debug: > interval: 60 > cpufreq_governor: performance > default-watchdogs: > oom-killer: > watchdog: > commit: b8084f70e028697b342d6388b244d6171717fc54 > model: Ivy Bridge > nr_cpu: 4 > memory: 8G > nr_hdd_partitions: 1 > hdd_partitions: "/dev/disk/by-id/ata-ST1000DM003-1CH162_Z1DBQSB0-part1" > swap_partitions: "/dev/disk/by-id/ata-ST1000DM003-1CH162_Z1DBQSB0-part3" > rootfs_partition: "/dev/disk/by-id/ata-ST1000DM003-1CH162_Z1DBQSB0-part4" > netconsole_port: 66723 > category: benchmark > nr_task: 1 > unixbench: > test: fsdisk > queue: bisect > testbox: lkp-ivb-d02 > tbox_group: lkp-ivb-d02 > kconfig: x86_64-rhel > enqueue_time: 2016-01-05 16:24:11.468660360 +08:00 > id: 62c43434378ef50b95fcd4973759daf66a148734 > user: lkp > compiler: gcc-4.9 > head_commit: 5bae791e5bb8895ac3d65634231c99d79a0e0002 > base_commit: 168309855a7d1e16db751e9c647119fe2d2dc878 > branch: linux-devel/devel-hourly-2016010502 > rootfs: debian-x86_64-2015-02-07.cgz > result_root: "/result/unixbench/performance-1-fsdisk/lkp-ivb-d02/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/0" > job_file: "/lkp/scheduled/lkp-ivb-d02/bisect_unixbench-performance-1-fsdisk-debian-x86_64-2015-02-07.cgz-x86_64-rhel-b8084f70e028697b342d6388b244d6171717fc54-20160105-89027-193oala-0.yaml" > max_uptime: 922.0999999999999 > initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz" > bootloader_append: > - root=/dev/ram0 > - user=lkp > - job=/lkp/scheduled/lkp-ivb-d02/bisect_unixbench-performance-1-fsdisk-debian-x86_64-2015-02-07.cgz-x86_64-rhel-b8084f70e028697b342d6388b244d6171717fc54-20160105-89027-193oala-0.yaml > - ARCH=x86_64 > - kconfig=x86_64-rhel > - branch=linux-devel/devel-hourly-2016010502 > - commit=b8084f70e028697b342d6388b244d6171717fc54 > - BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/vmlinuz-4.4.0-rc6-00236-gb8084f7 > - max_uptime=922 > - RESULT_ROOT=/result/unixbench/performance-1-fsdisk/lkp-ivb-d02/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/0 > - LKP_SERVER=inn > - |2- > > > earlyprintk=ttyS0,115200 systemd.log_level=err > debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 > panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 > console=ttyS0,115200 console=tty0 vga=normal > > rw > lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz" > modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/modules.cgz" > bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/turbostat.cgz,/lkp/benchmarks/turbostat.cgz,/lkp/benchmarks/unixbench.cgz" > linux_headers_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/linux-headers.cgz" > repeat_to: 2 > kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/vmlinuz-4.4.0-rc6-00236-gb8084f7" > dequeue_time: 2016-01-05 16:39:47.706440461 +08:00 > job_state: finished > loadavg: 0.58 0.25 0.10 1/123 2689 > start_time: '1451983209' > end_time: '1451983353' > version: "/lkp/lkp/.src-20160105-162125" ^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [LKP] [lkp] [rcu] b8084f70e0: No primary result change, 1414.7% unixbench.time.involuntary_context_switches 2016-01-06 3:30 ` [lkp] [rcu] b8084f70e0: No primary result change, 1414.7% unixbench.time.involuntary_context_switches Paul E. McKenney @ 2016-01-06 4:25 ` Huang, Ying 2016-01-06 16:00 ` Paul E. McKenney 0 siblings, 1 reply; 3+ messages in thread From: Huang, Ying @ 2016-01-06 4:25 UTC (permalink / raw) To: Paul E. McKenney Cc: Mike Galbraith, Thomas Gleixner, lkp, LKML, Sebastian Andrzej Siewior "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> writes: > On Wed, Jan 06, 2016 at 10:47:43AM +0800, kernel test robot wrote: >> FYI, we noticed the below changes on >> >> https://git.kernel.org/pub/scm/linux/kernel/git/rt/linux-rt-devel.git for-kbuild-bot/current-stable >> commit b8084f70e028697b342d6388b244d6171717fc54 ("rcu: Eliminate softirq processing from rcutree") > > This is a performance degradation, correct? If so, looks like this commit > is not ready for mainline unless set up to be configured on only for > -rt workloads. Yes. This is a performance degradation. > Or am I missing the plot somewhere here? Which plot? Best Regards, Huang, Ying > Thanx, Paul > >> ========================================================================================= >> compiler/cpufreq_governor/kconfig/nr_task/rootfs/tbox_group/test/testcase: >> gcc-4.9/performance/x86_64-rhel/1/debian-x86_64-2015-02-07.cgz/lkp-ivb-d02/fsbuffer/unixbench >> >> commit: >> ee644236a506642e20637f954d286f49a76ed83a >> b8084f70e028697b342d6388b244d6171717fc54 >> >> ee644236a506642e b8084f70e028697b342d6388b2 >> ---------------- -------------------------- >> %stddev %change %stddev >> \ | \ >> 257.25 18% +1414.7% 3896 13% unixbench.time.involuntary_context_switches >> 4425148 22% -61.9% 1684712 29% cpuidle.C1E-IVB.time >> 83.75 48% +91.6% 160.50 31% cpuidle.POLL.usage >> 1902 7% -12.0% 1674 1% slabinfo.anon_vma.active_objs >> 1902 7% -12.0% 1674 1% slabinfo.anon_vma.num_objs >> 257.25 18% +1414.7% 3896 13% time.involuntary_context_switches >> 8.15 6% -14.1% 7.00 1% time.user_time >> 34345 14% -33.3% 22908 33% sched_debug.cfs_rq:/.exec_clock.2 >> 34987 13% -19.7% 28093 15% sched_debug.cfs_rq:/.exec_clock.max >> 642.75 5% +59.6% 1025 55% sched_debug.cfs_rq:/.exec_clock.min >> 14639 13% -21.8% 11443 16% sched_debug.cfs_rq:/.exec_clock.stddev >> 127.75 16% -26.2% 94.25 25% sched_debug.cfs_rq:/.load_avg.3 >> 38865 12% -36.0% 24885 34% sched_debug.cfs_rq:/.min_vruntime.2 >> 39385 12% -22.8% 30395 16% sched_debug.cfs_rq:/.min_vruntime.max >> 1090 11% +45.3% 1584 32% sched_debug.cfs_rq:/.min_vruntime.min >> 16286 13% -25.1% 12200 18% sched_debug.cfs_rq:/.min_vruntime.stddev >> 2.00 0% -50.0% 1.00 0% sched_debug.cfs_rq:/.nr_spread_over.0 >> 2.00 0% -50.0% 1.00 0% sched_debug.cfs_rq:/.nr_spread_over.max >> 0.87 0% -42.3% 0.50 0% sched_debug.cfs_rq:/.nr_spread_over.stddev >> 28.50 62% +338.6% 125.00 114% sched_debug.cfs_rq:/.runnable_load_avg.1 >> 16286 13% -25.1% 12200 18% sched_debug.cfs_rq:/.spread0.stddev >> 127.75 16% -26.0% 94.50 25% sched_debug.cfs_rq:/.tg_load_avg_contrib.3 >> 626662 5% -13.2% 544121 9% sched_debug.cpu.avg_idle.0 >> 20.25 28% +419.8% 105.25 132% sched_debug.cpu.cpu_load[3].1 >> 692.40 7% -15.2% 586.96 9% sched_debug.cpu.curr->pid.avg >> 36187 12% -31.5% 24793 29% sched_debug.cpu.nr_load_updates.2 >> 15625 11% +61.6% 25245 23% sched_debug.cpu.nr_switches.0 >> 20008 4% +14.1% 22828 4% sched_debug.cpu.nr_switches.avg >> 23333 8% +40.9% 32872 18% sched_debug.cpu.sched_count.0 >> 21974 4% +12.7% 24771 4% sched_debug.cpu.sched_count.avg >> 31771 9% +22.6% 38942 5% sched_debug.cpu.sched_count.max >> 9514 28% +75.8% 16728 7% sched_debug.cpu.ttwu_count.0 >> 4323 10% +40.6% 6080 30% sched_debug.cpu.ttwu_count.2 >> 10068 4% +15.6% 11639 4% sched_debug.cpu.ttwu_count.avg >> 4101 10% +21.7% 4990 8% sched_debug.cpu.ttwu_count.min >> 3676 21% +102.5% 7443 8% sched_debug.cpu.ttwu_local.0 >> 2014 15% +43.2% 2884 10% sched_debug.cpu.ttwu_local.2 >> 3508 1% +24.8% 4377 4% sched_debug.cpu.ttwu_local.avg >> 5554 19% +34.0% 7444 8% sched_debug.cpu.ttwu_local.max >> 1846 16% +40.2% 2588 6% sched_debug.cpu.ttwu_local.min >> >> ========================================================================================= >> compiler/cpufreq_governor/kconfig/nr_task/rootfs/tbox_group/test/testcase: >> gcc-4.9/performance/x86_64-rhel/1/debian-x86_64-2015-02-07.cgz/lkp-ivb-d02/fsdisk/unixbench >> >> commit: >> ee644236a506642e20637f954d286f49a76ed83a >> b8084f70e028697b342d6388b244d6171717fc54 >> >> ee644236a506642e b8084f70e028697b342d6388b2 >> ---------------- -------------------------- >> fail:runs %reproduction fail:runs >> | | | >> :4 25% 1:4 kmsg.DHCP/BOOTP:Reply_not_for_us,op[#]xid[#] >> %stddev %change %stddev >> \ | \ >> 265.75 18% +1313.4% 3756 9% unixbench.time.involuntary_context_switches >> 659.50 6% +16.5% 768.00 7% slabinfo.kmalloc-512.num_objs >> 265.75 18% +1313.4% 3756 9% time.involuntary_context_switches >> 5911312 13% -55.9% 2606719 10% cpuidle.C1E-IVB.time >> 95195 172% +815.7% 871684 140% cpuidle.POLL.time >> 51.75 10% -30.9% 35.75 24% cpuidle.POLL.usage >> 13361 22% -27.0% 9754 4% sched_debug.cfs_rq:/.exec_clock.stddev >> 14632 24% -28.1% 10524 5% sched_debug.cfs_rq:/.min_vruntime.stddev >> 14632 24% -28.1% 10524 5% sched_debug.cfs_rq:/.spread0.stddev >> 197.25 14% +52.9% 301.50 41% sched_debug.cfs_rq:/.util_avg.0 >> 552666 8% -7.7% 510200 7% sched_debug.cpu.avg_idle.1 >> 13610 30% +59.7% 21734 7% sched_debug.cpu.nr_switches.0 >> 21145 1% +12.3% 23752 7% sched_debug.cpu.nr_switches.avg >> 10105 21% +62.1% 16380 7% sched_debug.cpu.nr_switches.min >> 11293 28% -44.4% 6276 16% sched_debug.cpu.nr_switches.stddev >> 21314 19% +38.1% 29437 5% sched_debug.cpu.sched_count.0 >> 11261 22% +57.2% 17703 9% sched_debug.cpu.sched_count.min >> 11158 27% -36.7% 7068 12% sched_debug.cpu.sched_count.stddev >> 5854 35% +57.0% 9194 8% sched_debug.cpu.sched_goidle.0 >> 3713 27% +68.4% 6253 11% sched_debug.cpu.sched_goidle.min >> 5638 29% -44.5% 3131 18% sched_debug.cpu.sched_goidle.stddev >> 8286 32% +85.0% 15333 15% sched_debug.cpu.ttwu_count.0 >> 10697 1% +13.2% 12107 7% sched_debug.cpu.ttwu_count.avg >> 4845 5% +17.8% 5707 8% sched_debug.cpu.ttwu_count.min >> 2886 47% +105.5% 5931 16% sched_debug.cpu.ttwu_local.0 >> 3667 3% +17.0% 4291 1% sched_debug.cpu.ttwu_local.avg >> 2127 17% +29.2% 2748 7% sched_debug.cpu.ttwu_local.min >> >> >> lkp-ivb-d02: Ivy Bridge >> Memory: 8G >> >> unixbench.time.involuntary_context_switches >> >> 5000 ++-------------------------------------------------------------------+ >> 4500 O+ | >> | O O O O O >> 4000 ++ O O O | >> 3500 ++O O O O O O O O O O O | >> | O O O | >> 3000 ++ O O | >> 2500 ++ | >> 2000 ++ | >> | | >> 1500 ++ | >> 1000 ++ | >> |.*.. .*.. .*. .*.*.. .*.. | >> 500 *+ * *.*..*.*. *. .*.. .*.*..* *.*..*.* | >> 0 ++----------O---------O-------*----*------O----O---------------------+ >> >> [*] bisect-good sample >> [O] bisect-bad sample >> >> To reproduce: >> >> git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git >> cd lkp-tests >> bin/lkp install job.yaml # job file is attached in this email >> bin/lkp run job.yaml >> >> >> Disclaimer: >> Results have been estimated based on internal Intel analysis and are provided >> for informational purposes only. Any difference in system hardware or software >> design or configuration may affect actual performance. >> >> >> Thanks, >> Ying Huang > >> --- >> LKP_SERVER: inn >> LKP_CGI_PORT: 80 >> LKP_CIFS_PORT: 139 >> testcase: unixbench >> default-monitors: >> wait: activate-monitor >> kmsg: >> uptime: >> iostat: >> vmstat: >> numa-numastat: >> numa-vmstat: >> numa-meminfo: >> proc-vmstat: >> proc-stat: >> interval: 10 >> meminfo: >> slabinfo: >> interrupts: >> lock_stat: >> latency_stats: >> softirqs: >> bdi_dev_mapping: >> diskstats: >> nfsstat: >> cpuidle: >> cpufreq-stats: >> turbostat: >> pmeter: >> sched_debug: >> interval: 60 >> cpufreq_governor: performance >> default-watchdogs: >> oom-killer: >> watchdog: >> commit: b8084f70e028697b342d6388b244d6171717fc54 >> model: Ivy Bridge >> nr_cpu: 4 >> memory: 8G >> nr_hdd_partitions: 1 >> hdd_partitions: "/dev/disk/by-id/ata-ST1000DM003-1CH162_Z1DBQSB0-part1" >> swap_partitions: "/dev/disk/by-id/ata-ST1000DM003-1CH162_Z1DBQSB0-part3" >> rootfs_partition: "/dev/disk/by-id/ata-ST1000DM003-1CH162_Z1DBQSB0-part4" >> netconsole_port: 66723 >> category: benchmark >> nr_task: 1 >> unixbench: >> test: fsdisk >> queue: bisect >> testbox: lkp-ivb-d02 >> tbox_group: lkp-ivb-d02 >> kconfig: x86_64-rhel >> enqueue_time: 2016-01-05 16:24:11.468660360 +08:00 >> id: 62c43434378ef50b95fcd4973759daf66a148734 >> user: lkp >> compiler: gcc-4.9 >> head_commit: 5bae791e5bb8895ac3d65634231c99d79a0e0002 >> base_commit: 168309855a7d1e16db751e9c647119fe2d2dc878 >> branch: linux-devel/devel-hourly-2016010502 >> rootfs: debian-x86_64-2015-02-07.cgz >> result_root: "/result/unixbench/performance-1-fsdisk/lkp-ivb-d02/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/0" >> job_file: "/lkp/scheduled/lkp-ivb-d02/bisect_unixbench-performance-1-fsdisk-debian-x86_64-2015-02-07.cgz-x86_64-rhel-b8084f70e028697b342d6388b244d6171717fc54-20160105-89027-193oala-0.yaml" >> max_uptime: 922.0999999999999 >> initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz" >> bootloader_append: >> - root=/dev/ram0 >> - user=lkp >> - job=/lkp/scheduled/lkp-ivb-d02/bisect_unixbench-performance-1-fsdisk-debian-x86_64-2015-02-07.cgz-x86_64-rhel-b8084f70e028697b342d6388b244d6171717fc54-20160105-89027-193oala-0.yaml >> - ARCH=x86_64 >> - kconfig=x86_64-rhel >> - branch=linux-devel/devel-hourly-2016010502 >> - commit=b8084f70e028697b342d6388b244d6171717fc54 >> - BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/vmlinuz-4.4.0-rc6-00236-gb8084f7 >> - max_uptime=922 >> - RESULT_ROOT=/result/unixbench/performance-1-fsdisk/lkp-ivb-d02/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/0 >> - LKP_SERVER=inn >> - |2- >> >> >> earlyprintk=ttyS0,115200 systemd.log_level=err >> debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 >> panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 >> console=ttyS0,115200 console=tty0 vga=normal >> >> rw >> lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz" >> modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/modules.cgz" >> bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/turbostat.cgz,/lkp/benchmarks/turbostat.cgz,/lkp/benchmarks/unixbench.cgz" >> linux_headers_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/linux-headers.cgz" >> repeat_to: 2 >> kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/vmlinuz-4.4.0-rc6-00236-gb8084f7" >> dequeue_time: 2016-01-05 16:39:47.706440461 +08:00 >> job_state: finished >> loadavg: 0.58 0.25 0.10 1/123 2689 >> start_time: '1451983209' >> end_time: '1451983353' >> version: "/lkp/lkp/.src-20160105-162125" > > > _______________________________________________ > LKP mailing list > LKP@lists.01.org > https://lists.01.org/mailman/listinfo/lkp ^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [LKP] [lkp] [rcu] b8084f70e0: No primary result change, 1414.7% unixbench.time.involuntary_context_switches 2016-01-06 4:25 ` [LKP] " Huang, Ying @ 2016-01-06 16:00 ` Paul E. McKenney 0 siblings, 0 replies; 3+ messages in thread From: Paul E. McKenney @ 2016-01-06 16:00 UTC (permalink / raw) To: Huang, Ying Cc: Mike Galbraith, Thomas Gleixner, lkp, LKML, Sebastian Andrzej Siewior On Wed, Jan 06, 2016 at 12:25:55PM +0800, Huang, Ying wrote: > "Paul E. McKenney" <paulmck@linux.vnet.ibm.com> writes: > > > On Wed, Jan 06, 2016 at 10:47:43AM +0800, kernel test robot wrote: > >> FYI, we noticed the below changes on > >> > >> https://git.kernel.org/pub/scm/linux/kernel/git/rt/linux-rt-devel.git for-kbuild-bot/current-stable > >> commit b8084f70e028697b342d6388b244d6171717fc54 ("rcu: Eliminate softirq processing from rcutree") > > > > This is a performance degradation, correct? If so, looks like this commit > > is not ready for mainline unless set up to be configured on only for > > -rt workloads. > > Yes. This is a performance degradation. Thank you! > > Or am I missing the plot somewhere here? > > Which plot? Apologies, that was American slang, not so appropriate for this audience. I am asking the -rt guys if there is some problem with adjusting the patch so that it eliminates softirq only when the kernel is specifically build/booted for -rt. Thanx, Paul > Best Regards, > Huang, Ying > > > Thanx, Paul > > > >> ========================================================================================= > >> compiler/cpufreq_governor/kconfig/nr_task/rootfs/tbox_group/test/testcase: > >> gcc-4.9/performance/x86_64-rhel/1/debian-x86_64-2015-02-07.cgz/lkp-ivb-d02/fsbuffer/unixbench > >> > >> commit: > >> ee644236a506642e20637f954d286f49a76ed83a > >> b8084f70e028697b342d6388b244d6171717fc54 > >> > >> ee644236a506642e b8084f70e028697b342d6388b2 > >> ---------------- -------------------------- > >> %stddev %change %stddev > >> \ | \ > >> 257.25 18% +1414.7% 3896 13% unixbench.time.involuntary_context_switches > >> 4425148 22% -61.9% 1684712 29% cpuidle.C1E-IVB.time > >> 83.75 48% +91.6% 160.50 31% cpuidle.POLL.usage > >> 1902 7% -12.0% 1674 1% slabinfo.anon_vma.active_objs > >> 1902 7% -12.0% 1674 1% slabinfo.anon_vma.num_objs > >> 257.25 18% +1414.7% 3896 13% time.involuntary_context_switches > >> 8.15 6% -14.1% 7.00 1% time.user_time > >> 34345 14% -33.3% 22908 33% sched_debug.cfs_rq:/.exec_clock.2 > >> 34987 13% -19.7% 28093 15% sched_debug.cfs_rq:/.exec_clock.max > >> 642.75 5% +59.6% 1025 55% sched_debug.cfs_rq:/.exec_clock.min > >> 14639 13% -21.8% 11443 16% sched_debug.cfs_rq:/.exec_clock.stddev > >> 127.75 16% -26.2% 94.25 25% sched_debug.cfs_rq:/.load_avg.3 > >> 38865 12% -36.0% 24885 34% sched_debug.cfs_rq:/.min_vruntime.2 > >> 39385 12% -22.8% 30395 16% sched_debug.cfs_rq:/.min_vruntime.max > >> 1090 11% +45.3% 1584 32% sched_debug.cfs_rq:/.min_vruntime.min > >> 16286 13% -25.1% 12200 18% sched_debug.cfs_rq:/.min_vruntime.stddev > >> 2.00 0% -50.0% 1.00 0% sched_debug.cfs_rq:/.nr_spread_over.0 > >> 2.00 0% -50.0% 1.00 0% sched_debug.cfs_rq:/.nr_spread_over.max > >> 0.87 0% -42.3% 0.50 0% sched_debug.cfs_rq:/.nr_spread_over.stddev > >> 28.50 62% +338.6% 125.00 114% sched_debug.cfs_rq:/.runnable_load_avg.1 > >> 16286 13% -25.1% 12200 18% sched_debug.cfs_rq:/.spread0.stddev > >> 127.75 16% -26.0% 94.50 25% sched_debug.cfs_rq:/.tg_load_avg_contrib.3 > >> 626662 5% -13.2% 544121 9% sched_debug.cpu.avg_idle.0 > >> 20.25 28% +419.8% 105.25 132% sched_debug.cpu.cpu_load[3].1 > >> 692.40 7% -15.2% 586.96 9% sched_debug.cpu.curr->pid.avg > >> 36187 12% -31.5% 24793 29% sched_debug.cpu.nr_load_updates.2 > >> 15625 11% +61.6% 25245 23% sched_debug.cpu.nr_switches.0 > >> 20008 4% +14.1% 22828 4% sched_debug.cpu.nr_switches.avg > >> 23333 8% +40.9% 32872 18% sched_debug.cpu.sched_count.0 > >> 21974 4% +12.7% 24771 4% sched_debug.cpu.sched_count.avg > >> 31771 9% +22.6% 38942 5% sched_debug.cpu.sched_count.max > >> 9514 28% +75.8% 16728 7% sched_debug.cpu.ttwu_count.0 > >> 4323 10% +40.6% 6080 30% sched_debug.cpu.ttwu_count.2 > >> 10068 4% +15.6% 11639 4% sched_debug.cpu.ttwu_count.avg > >> 4101 10% +21.7% 4990 8% sched_debug.cpu.ttwu_count.min > >> 3676 21% +102.5% 7443 8% sched_debug.cpu.ttwu_local.0 > >> 2014 15% +43.2% 2884 10% sched_debug.cpu.ttwu_local.2 > >> 3508 1% +24.8% 4377 4% sched_debug.cpu.ttwu_local.avg > >> 5554 19% +34.0% 7444 8% sched_debug.cpu.ttwu_local.max > >> 1846 16% +40.2% 2588 6% sched_debug.cpu.ttwu_local.min > >> > >> ========================================================================================= > >> compiler/cpufreq_governor/kconfig/nr_task/rootfs/tbox_group/test/testcase: > >> gcc-4.9/performance/x86_64-rhel/1/debian-x86_64-2015-02-07.cgz/lkp-ivb-d02/fsdisk/unixbench > >> > >> commit: > >> ee644236a506642e20637f954d286f49a76ed83a > >> b8084f70e028697b342d6388b244d6171717fc54 > >> > >> ee644236a506642e b8084f70e028697b342d6388b2 > >> ---------------- -------------------------- > >> fail:runs %reproduction fail:runs > >> | | | > >> :4 25% 1:4 kmsg.DHCP/BOOTP:Reply_not_for_us,op[#]xid[#] > >> %stddev %change %stddev > >> \ | \ > >> 265.75 18% +1313.4% 3756 9% unixbench.time.involuntary_context_switches > >> 659.50 6% +16.5% 768.00 7% slabinfo.kmalloc-512.num_objs > >> 265.75 18% +1313.4% 3756 9% time.involuntary_context_switches > >> 5911312 13% -55.9% 2606719 10% cpuidle.C1E-IVB.time > >> 95195 172% +815.7% 871684 140% cpuidle.POLL.time > >> 51.75 10% -30.9% 35.75 24% cpuidle.POLL.usage > >> 13361 22% -27.0% 9754 4% sched_debug.cfs_rq:/.exec_clock.stddev > >> 14632 24% -28.1% 10524 5% sched_debug.cfs_rq:/.min_vruntime.stddev > >> 14632 24% -28.1% 10524 5% sched_debug.cfs_rq:/.spread0.stddev > >> 197.25 14% +52.9% 301.50 41% sched_debug.cfs_rq:/.util_avg.0 > >> 552666 8% -7.7% 510200 7% sched_debug.cpu.avg_idle.1 > >> 13610 30% +59.7% 21734 7% sched_debug.cpu.nr_switches.0 > >> 21145 1% +12.3% 23752 7% sched_debug.cpu.nr_switches.avg > >> 10105 21% +62.1% 16380 7% sched_debug.cpu.nr_switches.min > >> 11293 28% -44.4% 6276 16% sched_debug.cpu.nr_switches.stddev > >> 21314 19% +38.1% 29437 5% sched_debug.cpu.sched_count.0 > >> 11261 22% +57.2% 17703 9% sched_debug.cpu.sched_count.min > >> 11158 27% -36.7% 7068 12% sched_debug.cpu.sched_count.stddev > >> 5854 35% +57.0% 9194 8% sched_debug.cpu.sched_goidle.0 > >> 3713 27% +68.4% 6253 11% sched_debug.cpu.sched_goidle.min > >> 5638 29% -44.5% 3131 18% sched_debug.cpu.sched_goidle.stddev > >> 8286 32% +85.0% 15333 15% sched_debug.cpu.ttwu_count.0 > >> 10697 1% +13.2% 12107 7% sched_debug.cpu.ttwu_count.avg > >> 4845 5% +17.8% 5707 8% sched_debug.cpu.ttwu_count.min > >> 2886 47% +105.5% 5931 16% sched_debug.cpu.ttwu_local.0 > >> 3667 3% +17.0% 4291 1% sched_debug.cpu.ttwu_local.avg > >> 2127 17% +29.2% 2748 7% sched_debug.cpu.ttwu_local.min > >> > >> > >> lkp-ivb-d02: Ivy Bridge > >> Memory: 8G > >> > >> unixbench.time.involuntary_context_switches > >> > >> 5000 ++-------------------------------------------------------------------+ > >> 4500 O+ | > >> | O O O O O > >> 4000 ++ O O O | > >> 3500 ++O O O O O O O O O O O | > >> | O O O | > >> 3000 ++ O O | > >> 2500 ++ | > >> 2000 ++ | > >> | | > >> 1500 ++ | > >> 1000 ++ | > >> |.*.. .*.. .*. .*.*.. .*.. | > >> 500 *+ * *.*..*.*. *. .*.. .*.*..* *.*..*.* | > >> 0 ++----------O---------O-------*----*------O----O---------------------+ > >> > >> [*] bisect-good sample > >> [O] bisect-bad sample > >> > >> To reproduce: > >> > >> git clone git://git.kernel.org/pub/scm/linux/kernel/git/wfg/lkp-tests.git > >> cd lkp-tests > >> bin/lkp install job.yaml # job file is attached in this email > >> bin/lkp run job.yaml > >> > >> > >> Disclaimer: > >> Results have been estimated based on internal Intel analysis and are provided > >> for informational purposes only. Any difference in system hardware or software > >> design or configuration may affect actual performance. > >> > >> > >> Thanks, > >> Ying Huang > > > >> --- > >> LKP_SERVER: inn > >> LKP_CGI_PORT: 80 > >> LKP_CIFS_PORT: 139 > >> testcase: unixbench > >> default-monitors: > >> wait: activate-monitor > >> kmsg: > >> uptime: > >> iostat: > >> vmstat: > >> numa-numastat: > >> numa-vmstat: > >> numa-meminfo: > >> proc-vmstat: > >> proc-stat: > >> interval: 10 > >> meminfo: > >> slabinfo: > >> interrupts: > >> lock_stat: > >> latency_stats: > >> softirqs: > >> bdi_dev_mapping: > >> diskstats: > >> nfsstat: > >> cpuidle: > >> cpufreq-stats: > >> turbostat: > >> pmeter: > >> sched_debug: > >> interval: 60 > >> cpufreq_governor: performance > >> default-watchdogs: > >> oom-killer: > >> watchdog: > >> commit: b8084f70e028697b342d6388b244d6171717fc54 > >> model: Ivy Bridge > >> nr_cpu: 4 > >> memory: 8G > >> nr_hdd_partitions: 1 > >> hdd_partitions: "/dev/disk/by-id/ata-ST1000DM003-1CH162_Z1DBQSB0-part1" > >> swap_partitions: "/dev/disk/by-id/ata-ST1000DM003-1CH162_Z1DBQSB0-part3" > >> rootfs_partition: "/dev/disk/by-id/ata-ST1000DM003-1CH162_Z1DBQSB0-part4" > >> netconsole_port: 66723 > >> category: benchmark > >> nr_task: 1 > >> unixbench: > >> test: fsdisk > >> queue: bisect > >> testbox: lkp-ivb-d02 > >> tbox_group: lkp-ivb-d02 > >> kconfig: x86_64-rhel > >> enqueue_time: 2016-01-05 16:24:11.468660360 +08:00 > >> id: 62c43434378ef50b95fcd4973759daf66a148734 > >> user: lkp > >> compiler: gcc-4.9 > >> head_commit: 5bae791e5bb8895ac3d65634231c99d79a0e0002 > >> base_commit: 168309855a7d1e16db751e9c647119fe2d2dc878 > >> branch: linux-devel/devel-hourly-2016010502 > >> rootfs: debian-x86_64-2015-02-07.cgz > >> result_root: "/result/unixbench/performance-1-fsdisk/lkp-ivb-d02/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/0" > >> job_file: "/lkp/scheduled/lkp-ivb-d02/bisect_unixbench-performance-1-fsdisk-debian-x86_64-2015-02-07.cgz-x86_64-rhel-b8084f70e028697b342d6388b244d6171717fc54-20160105-89027-193oala-0.yaml" > >> max_uptime: 922.0999999999999 > >> initrd: "/osimage/debian/debian-x86_64-2015-02-07.cgz" > >> bootloader_append: > >> - root=/dev/ram0 > >> - user=lkp > >> - job=/lkp/scheduled/lkp-ivb-d02/bisect_unixbench-performance-1-fsdisk-debian-x86_64-2015-02-07.cgz-x86_64-rhel-b8084f70e028697b342d6388b244d6171717fc54-20160105-89027-193oala-0.yaml > >> - ARCH=x86_64 > >> - kconfig=x86_64-rhel > >> - branch=linux-devel/devel-hourly-2016010502 > >> - commit=b8084f70e028697b342d6388b244d6171717fc54 > >> - BOOT_IMAGE=/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/vmlinuz-4.4.0-rc6-00236-gb8084f7 > >> - max_uptime=922 > >> - RESULT_ROOT=/result/unixbench/performance-1-fsdisk/lkp-ivb-d02/debian-x86_64-2015-02-07.cgz/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/0 > >> - LKP_SERVER=inn > >> - |2- > >> > >> > >> earlyprintk=ttyS0,115200 systemd.log_level=err > >> debug apic=debug sysrq_always_enabled rcupdate.rcu_cpu_stall_timeout=100 > >> panic=-1 softlockup_panic=1 nmi_watchdog=panic oops=panic load_ramdisk=2 prompt_ramdisk=0 > >> console=ttyS0,115200 console=tty0 vga=normal > >> > >> rw > >> lkp_initrd: "/lkp/lkp/lkp-x86_64.cgz" > >> modules_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/modules.cgz" > >> bm_initrd: "/osimage/deps/debian-x86_64-2015-02-07.cgz/lkp.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/run-ipconfig.cgz,/osimage/deps/debian-x86_64-2015-02-07.cgz/turbostat.cgz,/lkp/benchmarks/turbostat.cgz,/lkp/benchmarks/unixbench.cgz" > >> linux_headers_initrd: "/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/linux-headers.cgz" > >> repeat_to: 2 > >> kernel: "/pkg/linux/x86_64-rhel/gcc-4.9/b8084f70e028697b342d6388b244d6171717fc54/vmlinuz-4.4.0-rc6-00236-gb8084f7" > >> dequeue_time: 2016-01-05 16:39:47.706440461 +08:00 > >> job_state: finished > >> loadavg: 0.58 0.25 0.10 1/123 2689 > >> start_time: '1451983209' > >> end_time: '1451983353' > >> version: "/lkp/lkp/.src-20160105-162125" > > > > > > _______________________________________________ > > LKP mailing list > > LKP@lists.01.org > > https://lists.01.org/mailman/listinfo/lkp > ^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2016-01-06 16:38 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <878u43fmpc.fsf@yhuang-dev.intel.com>
2016-01-06 3:30 ` [lkp] [rcu] b8084f70e0: No primary result change, 1414.7% unixbench.time.involuntary_context_switches Paul E. McKenney
2016-01-06 4:25 ` [LKP] " Huang, Ying
2016-01-06 16:00 ` Paul E. McKenney
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).