From: Matt Fleming <matt@codeblueprint.co.uk>
To: Peter Zijlstra <peterz@infradead.org>
Cc: Jon Maloy <jon.maloy@ericsson.com>,
"netdev@vger.kernel.org" <netdev@vger.kernel.org>,
"mingo@kernel.org" <mingo@kernel.org>,
"David Miller (davem@davemloft.net)" <davem@davemloft.net>,
Mike Galbraith <umgwanakikbuti@gmail.com>
Subject: Re: Serious performance degradation in Linux 4.15
Date: Wed, 14 Feb 2018 22:46:20 +0000 [thread overview]
Message-ID: <20180214224620.GA3421@codeblueprint.co.uk> (raw)
In-Reply-To: <20180212151642.GU25201@hirez.programming.kicks-ass.net>
On Mon, 12 Feb, at 04:16:42PM, Peter Zijlstra wrote:
> On Fri, Feb 09, 2018 at 05:59:12PM +0000, Jon Maloy wrote:
> > Command for TCP:
> > "netperf TCP_STREAM (netperf -n 4 -f m -c 4 -C 4 -P 1 -H 10.0.0.1 -t TCP_STREAM -l 10 -- -O THROUGHPUT)"
> > Command for TIPC:
> > "netperf TIPC_STREAM (netperf -n 4 -f m -c 4 -C 4 -P 1 -H 10.0.0.1 -t TCP_STREAM -l 10 -- -O THROUGHPUT)"
>
> That looks like identical tests to me. And my netperf (debian testing)
> doesn't appear to have -t TIPC_STREAM.
>
> Please try a coherent report and I'll have another look. Don't (again)
> forget to mention what kind of setup you're running this on.
>
>
> On my IVB-EP (2 sockets, 10 cores, 2 threads), performance cpufreq,
> PTI=n RETPOLINE=n, I get:
Here's some more numbers. This is with RETPOLINE=y but you'll see it
doesn't make much of a difference. Oh, this is also with powersave
cpufreq governor.
The 'tip+' column is tip/master, commit ca96ad6978c3 ("Merge branch 'x86/mm'")
The 'tip-plus-patch+' column is tip/master plus Peter's patch from
20180212151642.GU25201@hirez.programming.kicks-ass.net
netperf-tcp
4.15.0-rc1 4.15.0 4.16.0-rc1 4.16.0-rc1
vanilla vanilla tip+ tip-plus-patch+
Min 64 1804.73 ( 0.00%) 951.28 ( -47.29%) 956.77 ( -46.99%) 936.19 ( -48.13%)
Min 128 3352.00 ( 0.00%) 1847.80 ( -44.87%) 1831.41 ( -45.36%) 1808.88 ( -46.04%)
Min 256 5619.02 ( 0.00%) 3327.27 ( -40.79%) 3287.00 ( -41.50%) 3311.33 ( -41.07%)
Min 1024 17325.58 ( 0.00%) 11053.24 ( -36.20%) 11098.91 ( -35.94%) 10892.59 ( -37.13%)
Min 2048 27564.59 ( 0.00%) 18311.31 ( -33.57%) 18649.89 ( -32.34%) 18327.69 ( -33.51%)
Min 3312 33677.30 ( 0.00%) 25254.43 ( -25.01%) 24897.65 ( -26.07%) 25464.71 ( -24.39%)
Min 4096 35624.64 ( 0.00%) 28186.09 ( -20.88%) 27317.58 ( -23.32%) 27046.46 ( -24.08%)
Min 8192 42950.87 ( 0.00%) 33407.18 ( -22.22%) 34133.19 ( -20.53%) 33429.82 ( -22.17%)
Min 16384 46798.74 ( 0.00%) 40020.99 ( -14.48%) 40761.81 ( -12.90%) 40370.88 ( -13.74%)
Hmean 64 1818.68 ( 0.00%) 959.16 ( -47.26%) 962.40 ( -47.08%) 954.96 ( -47.49%)
Hmean 128 3405.06 ( 0.00%) 1860.21 ( -45.37%) 1844.12 ( -45.84%) 1849.44 ( -45.69%)
Hmean 256 5777.53 ( 0.00%) 3371.67 ( -41.64%) 3341.43 ( -42.17%) 3360.35 ( -41.84%)
Hmean 1024 17679.46 ( 0.00%) 11326.96 ( -35.93%) 11192.24 ( -36.69%) 11219.22 ( -36.54%)
Hmean 2048 27764.04 ( 0.00%) 18864.94 ( -32.05%) 18833.51 ( -32.17%) 18740.31 ( -32.50%)
Hmean 3312 35253.65 ( 0.00%) 25444.33 ( -27.82%) 25700.57 ( -27.10%) 25610.63 ( -27.35%)
Hmean 4096 36479.20 ( 0.00%) 28636.63 ( -21.50%) 28073.90 ( -23.04%) 27856.51 ( -23.64%)
Hmean 8192 43386.27 ( 0.00%) 34771.52 ( -19.86%) 35213.44 ( -18.84%) 34603.90 ( -20.24%)
Hmean 16384 47487.74 ( 0.00%) 41329.50 ( -12.97%) 41096.73 ( -13.46%) 40787.33 ( -14.11%)
Stddev 64 12.42 ( 0.00%) 6.35 ( 48.87%) 5.77 ( 53.54%) 12.21 ( 1.73%)
Stddev 128 45.84 ( 0.00%) 9.25 ( 79.82%) 13.49 ( 70.57%) 23.86 ( 47.95%)
Stddev 256 90.59 ( 0.00%) 30.55 ( 66.28%) 37.07 ( 59.08%) 28.66 ( 68.36%)
Stddev 1024 322.33 ( 0.00%) 164.75 ( 48.89%) 119.05 ( 63.07%) 265.42 ( 17.65%)
Stddev 2048 153.04 ( 0.00%) 424.98 (-177.70%) 176.40 ( -15.26%) 242.90 ( -58.72%)
Stddev 3312 1024.93 ( 0.00%) 182.58 ( 82.19%) 585.07 ( 42.92%) 108.93 ( 89.37%)
Stddev 4096 696.34 ( 0.00%) 433.20 ( 37.79%) 626.42 ( 10.04%) 712.05 ( -2.26%)
Stddev 8192 478.31 ( 0.00%) 808.23 ( -68.98%) 794.39 ( -66.08%) 698.27 ( -45.99%)
Stddev 16384 720.05 ( 0.00%) 816.70 ( -13.42%) 412.26 ( 42.75%) 325.43 ( 54.81%)
CoeffVar 64 0.68 ( 0.00%) 0.66 ( 3.05%) 0.60 ( 12.20%) 1.28 ( -87.13%)
CoeffVar 128 1.35 ( 0.00%) 0.50 ( 63.06%) 0.73 ( 45.66%) 1.29 ( 4.17%)
CoeffVar 256 1.57 ( 0.00%) 0.91 ( 42.21%) 1.11 ( 29.24%) 0.85 ( 45.59%)
CoeffVar 1024 1.82 ( 0.00%) 1.45 ( 20.22%) 1.06 ( 41.65%) 2.36 ( -29.74%)
CoeffVar 2048 0.55 ( 0.00%) 2.25 (-308.53%) 0.94 ( -69.91%) 1.30 (-135.12%)
CoeffVar 3312 2.91 ( 0.00%) 0.72 ( 75.30%) 2.28 ( 21.68%) 0.43 ( 85.36%)
CoeffVar 4096 1.91 ( 0.00%) 1.51 ( 20.74%) 2.23 ( -16.88%) 2.55 ( -33.88%)
CoeffVar 8192 1.10 ( 0.00%) 2.32 (-110.77%) 2.25 (-104.56%) 2.02 ( -82.99%)
CoeffVar 16384 1.52 ( 0.00%) 1.98 ( -30.31%) 1.00 ( 33.83%) 0.80 ( 47.37%)
Max 64 1832.51 ( 0.00%) 966.09 ( -47.28%) 970.35 ( -47.05%) 967.15 ( -47.22%)
Max 128 3476.62 ( 0.00%) 1873.20 ( -46.12%) 1865.28 ( -46.35%) 1869.10 ( -46.24%)
Max 256 5839.83 ( 0.00%) 3402.61 ( -41.73%) 3379.67 ( -42.13%) 3383.69 ( -42.06%)
Max 1024 18031.63 ( 0.00%) 11482.14 ( -36.32%) 11396.22 ( -36.80%) 11463.71 ( -36.42%)
Max 2048 27912.65 ( 0.00%) 19343.06 ( -30.70%) 19095.51 ( -31.59%) 18969.02 ( -32.04%)
Max 3312 36142.68 ( 0.00%) 25749.54 ( -28.76%) 26503.65 ( -26.67%) 25767.14 ( -28.71%)
Max 4096 37481.84 ( 0.00%) 29189.76 ( -22.12%) 28875.41 ( -22.96%) 28973.52 ( -22.70%)
Max 8192 44101.03 ( 0.00%) 35471.04 ( -19.57%) 35890.95 ( -18.62%) 35178.96 ( -20.23%)
Max 16384 48321.50 ( 0.00%) 42086.21 ( -12.90%) 41793.29 ( -13.51%) 41152.43 ( -14.84%)
Peter, if you want to run this test yourself you can do:
1. git clone https://github.com/gorman/mmmtests.git
2. cd mmtests
3. ./run-mmtests.sh --config=configs/config-global-dhp__network-netperf-unbound `uname -r`
next prev parent reply other threads:[~2018-02-14 22:46 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2018-02-09 17:59 Serious performance degradation in Linux 4.15 Jon Maloy
2018-02-10 14:01 ` Peter Zijlstra
2018-02-12 15:16 ` Peter Zijlstra
2018-02-13 8:14 ` Jon Maloy
2018-02-14 22:46 ` Matt Fleming [this message]
2018-02-15 8:38 ` Peter Zijlstra
2018-02-16 10:09 ` Peter Zijlstra
2018-02-16 10:17 ` Peter Zijlstra
2018-02-16 10:49 ` Mel Gorman
2018-02-16 14:38 ` Matt Fleming
2018-02-16 16:48 ` Peter Zijlstra
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20180214224620.GA3421@codeblueprint.co.uk \
--to=matt@codeblueprint.co.uk \
--cc=davem@davemloft.net \
--cc=jon.maloy@ericsson.com \
--cc=mingo@kernel.org \
--cc=netdev@vger.kernel.org \
--cc=peterz@infradead.org \
--cc=umgwanakikbuti@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.