public inbox for linux-kernel@vger.kernel.org
 help / color / mirror / Atom feed
From: Alex Shi <alex.shi@linaro.org>
To: Fengguang Wu <fengguang.wu@intel.com>
Cc: Yuanhan Liu <yuanhan.liu@intel.com>,
	"Huang, Ying" <ying.huang@intel.com>,
	lkp@01.org, LKML <linux-kernel@vger.kernel.org>
Subject: Re: [sched] perf-stat.cpu-migrations changes in dd write test
Date: Wed, 25 Dec 2013 11:30:27 +0800	[thread overview]
Message-ID: <52BA5153.9090008@linaro.org> (raw)
In-Reply-To: <20131223052426.GB31502@localhost>

On 12/23/2013 01:24 PM, Fengguang Wu wrote:
> On Mon, Dec 23, 2013 at 01:19:04PM +0800, Alex Shi wrote:
>> On 12/22/2013 08:30 AM, fengguang.wu@intel.com wrote:
>>> Alex,
>>>
>>> We noticed some perf-stat.cpu-migrations changes by your commit
>>
>> Thanks for your wonder testing, Fengguang!
>> How many CPU in your system and how many dd task running?
> 
> For the case
> 
>         kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd
> 
> It's a KVM with 4 CPUs, 16G memory. There are 4 virtual disks, on top
> of each disk there runs 10 dd tasks.

I don't know much of kvm. Where the data get from, VM guest or VM host?
Looks like any guest cpu usage will be counted as user usage in vmstat.
and Does the CS and cpu migration reducing cause dd performance increase?
> 
> Thanks,
> Fengguang
> 
>>>
>>> 6eb8b571283e64e96ca1a91aad085f9e08f857f0 is the first bad commit
>>> commit 6eb8b571283e64e96ca1a91aad085f9e08f857f0
>>> Author: Alex Shi <alex.shi@linaro.org>
>>> Date:   Tue Nov 19 20:29:51 2013 +0800
>>>
>>>     sched: remove rq->cpu_load[load_idx] array
>>>     
>>>     Since load_idx effect removed in load balance, we don't need the
>>>     load_idx decays in scheduler. that will save some process in sched_tick
>>>     and others places.
>>>     
>>>     Signed-off-by: Alex Shi <alex.shi@linaro.org>
>>>
>>>
>>> Here are the changed stats comparing to its parent commit:
>>>
>>> 1de157d718f6494       6eb8b571283e64e96ca1  
>>> ---------------  -------------------------  
>>>      37779 ~40%    +115.2%      81288 ~50%  kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd
>>>      37779         +115.2%      81288       TOTAL proc-vmstat.pgscan_direct_normal
>>>
>>> kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd: proc-vmstat.pgscan_direct_normal
>>>
>>>    160000 ++----------------------------------------------------------------+
>>>           |                                                                 |
>>>    140000 ++                                                                O
>>>           |                                                                 |
>>>    120000 ++                                                                |
>>>           |                O                                                |
>>>    100000 ++                                                                |
>>>           |                                                                 |
>>>     80000 ++                               O                                |
>>>           |                                                               ..*
>>>     60000 ++                                                          ....  |
>>>           |                                                       ....      |
>>>     40000 *+...............                                 O ....          |
>>>           O                *...............         ........*.              |
>>>     20000 ++-------------------------------*--------------------------------+
>>>
>>>
>>> 1de157d718f6494       6eb8b571283e64e96ca1  
>>> ---------------  -------------------------  
>>>     121579 ~ 6%     -50.8%      59852 ~13%  kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd
>>>     121579          -50.8%      59852       TOTAL softirqs.SCHED
>>>
>>>             kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd: softirqs.SCHED
>>>
>>>    140000 ++----------------------------------------------------------------+
>>>    130000 ++           ....*...........                 ....*.......        |
>>>           |    ........                ....     ........            ......  |
>>>    120000 *+...                            *....                          ..|
>>>    110000 ++                                                                *
>>>           |                                                                 |
>>>    100000 ++                                                                |
>>>     90000 ++                                                                |
>>>     80000 ++                                                                |
>>>           |                                                                 |
>>>     70000 ++                               O                O               |
>>>     60000 ++               O                                                |
>>>           |                                                                 O
>>>     50000 O+                                                                |
>>>     40000 ++----------------------------------------------------------------+
>>>
>>>
>>> 1de157d718f6494       6eb8b571283e64e96ca1  
>>> ---------------  -------------------------  
>>>       5636 ~ 4%     -22.1%       4392 ~17%  kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd
>>>       5636          -22.1%       4392       TOTAL proc-vmstat.nr_tlb_remote_flush
>>>
>>>  kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd: proc-vmstat.nr_tlb_remote_flush
>>>
>>>    6500 ++------------------------------------------------------------------+
>>>         |                                                                   |
>>>    6000 ++       ........*............                                      |
>>>         *........                     ....                                  |
>>>    5500 ++               O                *................*................|
>>>         |                                                                   *
>>>    5000 ++                                O                                 |
>>>         |                                                                   |
>>>    4500 ++                                                 O                |
>>>         |                                                                   |
>>>    4000 ++                                                                  |
>>>         |                                                                   O
>>>    3500 O+                                                                  |
>>>         |                                                                   |
>>>    3000 ++------------------------------------------------------------------+
>>>
>>>
>>> 1de157d718f6494       6eb8b571283e64e96ca1  
>>> ---------------  -------------------------  
>>>       5679 ~ 4%     -21.9%       4437 ~17%  kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd
>>>       5679          -21.9%       4437       TOTAL proc-vmstat.nr_tlb_remote_flush_received
>>>
>>>
>>>
>>>    6500 ++------------------------------------------------------------------+
>>>         |                                                                   |
>>>    6000 ++       ........*........                                          |
>>>         *........                 ......                                    |
>>>         |                               ..         ........*................|
>>>    5500 ++               O                *........                         *
>>>         |                                                                   |
>>>    5000 ++                                O                                 |
>>>         |                                                                   |
>>>    4500 ++                                                 O                |
>>>         |                                                                   |
>>>         |                                                                   |
>>>    4000 ++                                                                  |
>>>         |                                                                   O
>>>    3500 O+------------------------------------------------------------------+
>>>
>>>
>>> 1de157d718f6494       6eb8b571283e64e96ca1  
>>> ---------------  -------------------------  
>>>        167 ~11%     +19.4%        200 ~ 4%  kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd
>>>        167          +19.4%        200       TOTAL uptime.idle
>>>
>>>             kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd: uptime.idle
>>>
>>>    220 ++-------------------------------------------------------------------+
>>>        |                                                                    O
>>>    210 ++                                                                   |
>>>    200 O+                                 O                                 |
>>>        |              ..*.....                             O                |
>>>    190 ++         ....  O     ...                                           |
>>>    180 ++     ....               ....                                       |
>>>        |  ....                       ....                                   |
>>>    170 *+.                               .                                 .*
>>>    160 ++                                 *......                      .... |
>>>        |                                         ....               ...     |
>>>    150 ++                                            ....        ...        |
>>>    140 ++                                                ..  ....           |
>>>        |                                                   *.               |
>>>    130 ++-------------------------------------------------------------------+
>>>
>>>
>>> 1de157d718f6494       6eb8b571283e64e96ca1  
>>> ---------------  -------------------------  
>>>     154781 ~ 5%     -66.8%      51449 ~ 8%  kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd
>>>     154781          -66.8%      51449       TOTAL perf-stat.cpu-migrations
>>>
>>>        kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd: perf-stat.cpu-migrations
>>>
>>>    180000 ++----------------------------------------------------------------+
>>>           |            ....*...........                                     |
>>>    160000 ++   ........                ....         ........*...............|
>>>           *....                            *........                        *
>>>    140000 ++                                                                |
>>>           |                                                                 |
>>>    120000 ++                                                                |
>>>           |                                                                 |
>>>    100000 ++                                                                |
>>>           |                                                                 |
>>>     80000 ++                                                                |
>>>           |                                                                 |
>>>     60000 ++                                                O               |
>>>           |                O               O                                O
>>>     40000 O+----------------------------------------------------------------+
>>>
>>>
>>> 1de157d718f6494       6eb8b571283e64e96ca1  
>>> ---------------  -------------------------  
>>>       1943 ~ 3%      -7.8%       1792 ~ 4%  kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd
>>>       1943           -7.8%       1792       TOTAL vmstat.system.cs
>>>
>>>           kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd: vmstat.system.cs
>>>
>>>    2050 ++------------------------------------------------------------------+
>>>         |                         ........*................*.....           |
>>>    2000 ++              .*........                               ...        |
>>>    1950 ++          ....                                            ...     |
>>>         |        ...                                                   .... |
>>>    1900 ++    ...                                                          .|
>>>    1850 ++....                            O                O                *
>>>         *.                                                                  |
>>>    1800 ++               O                                                  O
>>>    1750 ++                                                                  |
>>>         |                                                                   |
>>>    1700 ++                                                                  |
>>>    1650 O+                                                                  |
>>>         |                                                                   |
>>>    1600 ++------------------------------------------------------------------+
>>>
>>>
>>> 1de157d718f6494       6eb8b571283e64e96ca1  
>>> ---------------  -------------------------  
>>>    1216177 ~ 3%      -9.4%    1101605 ~ 7%  kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd
>>>    1216177           -9.4%    1101605       TOTAL perf-stat.context-switches
>>>
>>>       kbuildx/micro/dd-write/4HDD-JBOD-cfq-ext4-10dd: perf-stat.context-switches
>>>
>>>     1.3e+06 ++--------------------------------------------------------------+
>>>             |             ..*...............                                |
>>>    1.25e+06 ++      ......                  *...............*.......        |
>>>             |  .....                                                ......  |
>>>     1.2e+06 *+.                             O                             ..|
>>>    1.15e+06 ++                                              O               *
>>>             |               O                                               |
>>>     1.1e+06 ++                                                              |
>>>             |                                                               O
>>>    1.05e+06 ++                                                              |
>>>       1e+06 ++                                                              |
>>>             |                                                               |
>>>      950000 O+                                                              |
>>>             |                                                               |
>>>      900000 ++--------------------------------------------------------------+
>>>
>>>
>>
>>
>> -- 
>> Thanks
>>     Alex


-- 
Thanks
    Alex

  reply	other threads:[~2013-12-25  3:30 UTC|newest]

Thread overview: 6+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2013-12-22  0:30 [sched] perf-stat.cpu-migrations changes in dd write test fengguang.wu
2013-12-23  5:19 ` Alex Shi
2013-12-23  5:24   ` Fengguang Wu
2013-12-25  3:30     ` Alex Shi [this message]
2013-12-25  3:56       ` Fengguang Wu
2013-12-25  6:32         ` Alex Shi

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=52BA5153.9090008@linaro.org \
    --to=alex.shi@linaro.org \
    --cc=fengguang.wu@intel.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=lkp@01.org \
    --cc=ying.huang@intel.com \
    --cc=yuanhan.liu@intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox