All of lore.kernel.org
 help / color / mirror / Atom feed
From: linhaifeng <haifeng.lin@huawei.com>
To: <nyc@holomorphy.com>, <tglx@linutronix.de>, <mingo@redhat.com>,
	<hpa@zytor.com>
Cc: <linux-kernel@vger.kernel.org>
Subject: LLC cache miss increases with the increases of hugepages
Date: Mon, 6 Mar 2017 10:53:06 +0800	[thread overview]
Message-ID: <58BCCF12.40804@huawei.com> (raw)

Hi,

I did a network forward test with ovs-dpdk, and found that LLC cache miss
increases with the increases of hugepages. ovs-dpdk only use 4 hugepages,
hugepage size is 1G.Why LLC cache miss increases ? I just echo more hugepages
but haven't been used yet.

some informations:

CPU: Intel(R) Xeon(R) CPU E5-2620 v3@ 2.40GHz
L1d cache:             32K
L1i cache:             32K
L2 cache:              256K
L3 cache:              15360K

echo 10 > /proc/sys/vm/nr_hugepages
ovs-dpdk's LLC-load-misses:3.88%
ovs-dpdk's iTLB-load-misses: 4.37%


echo 100 > /proc/sys/vm/nr_hugepages
reboot VM restart test.
ovs-dpdk's LLC-load-misses:31.55%
ovs-dpdk's iTLB-load-misses: 36.36%

I use perf to watch LLC-loads when not run test:

Samples: 1M of event 'LLC-loads', Event count (approx.): 57240206
Overhead  Shared Object                 Symbol
   9.19%  [kernel]                      [k] copy_page_rep
   5.03%  [kernel]                      [k] ktime_get
   4.06%  [unknown]                     [.] 0x000000000043e39d
   2.65%  bash                          [.] 0x000000000003e39d
   2.13%  [kernel]                      [k] rcu_check_callbacks

The function copy_page_rep seems like would prefetch all hugepages?

                 reply	other threads:[~2017-03-06  3:00 UTC|newest]

Thread overview: [no followups] expand[flat|nested]  mbox.gz  Atom feed

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=58BCCF12.40804@huawei.com \
    --to=haifeng.lin@huawei.com \
    --cc=hpa@zytor.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=mingo@redhat.com \
    --cc=nyc@holomorphy.com \
    --cc=tglx@linutronix.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.