All of lore.kernel.org
 help / color / mirror / Atom feed
From: Xishi Qiu <qiuxishi@huawei.com>
To: Andrew Morton <akpm@linux-foundation.org>,
	nao.horiguchi@gmail.com, Yinghai Lu <yinghai@kernel.org>,
	"H. Peter Anvin" <hpa@zytor.com>,
	Thomas Gleixner <tglx@linutronix.de>,
	mingo@elte.hu, Xiexiuqi <xiexiuqi@huawei.com>,
	Hanjun Guo <guohanjun@huawei.com>,
	"Luck, Tony" <tony.luck@intel.com>
Cc: Xishi Qiu <qiuxishi@huawei.com>, Linux MM <linux-mm@kvack.org>,
	LKML <linux-kernel@vger.kernel.org>
Subject: [RFC PATCH 00/12] mm: mirrored memory support for page buddy allocations
Date: Thu, 4 Jun 2015 20:54:22 +0800	[thread overview]
Message-ID: <55704A7E.5030507@huawei.com> (raw)

Intel Xeon processor E7 v3 product family-based platforms introduces support
for partial memory mirroring called as 'Address Range Mirroring'. This feature
allows BIOS to specify a subset of total available memory to be mirrored (and
optionally also specify whether to mirror the range 0-4 GB). This capability
allows user to make an appropriate tradeoff between non-mirrored memory range
and mirrored memory range thus optimizing total available memory and still
achieving highly reliable memory range for mission critical workloads and/or
kernel space.

Tony has already send a patchset to supprot this feature at boot time.
https://lkml.org/lkml/2015/5/8/521

This patchset can support the feature after boot time. It introduces mirror_info
to save the mirrored memory range. Then use __GFP_MIRROR to allocate mirrored 
pages. 

I think add a new migratetype is btter and easier than a new zone, so I use
MIGRATE_MIRROR to manage the mirrored pages. However it changed some code in the
core file, please review and comment, thanks.

TBD: 
1) call add_mirror_info() to fill mirrored memory info.
2) add compatibility with memory online/offline.
3) add more interface? others?

Xishi Qiu (12):
  mm: add a new config to manage the code
  mm: introduce mirror_info
  mm: introduce MIGRATE_MIRROR to manage the mirrored pages
  mm: add mirrored pages to buddy system
  mm: introduce a new zone_stat_item NR_FREE_MIRROR_PAGES
  mm: add free mirrored pages info
  mm: introduce __GFP_MIRROR to allocate mirrored pages
  mm: use mirrorable to switch allocate mirrored memory
  mm: enable allocate mirrored memory at boot time
  mm: add the buddy system interface
  mm: add the PCP interface
  mm: let slab/slub/slob use mirrored memory

 arch/x86/mm/numa.c     |   3 ++
 drivers/base/node.c    |  17 ++++---
 fs/proc/meminfo.c      |   6 +++
 include/linux/gfp.h    |   5 +-
 include/linux/mmzone.h |  23 +++++++++
 include/linux/vmstat.h |   2 +
 kernel/sysctl.c        |   9 ++++
 mm/Kconfig             |   8 +++
 mm/page_alloc.c        | 134 ++++++++++++++++++++++++++++++++++++++++++++++---
 mm/slab.c              |   3 +-
 mm/slob.c              |   2 +-
 mm/slub.c              |   2 +-
 mm/vmstat.c            |   4 ++
 13 files changed, 202 insertions(+), 16 deletions(-)

-- 
2.0.0


--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

WARNING: multiple messages have this Message-ID (diff)
From: Xishi Qiu <qiuxishi@huawei.com>
To: Andrew Morton <akpm@linux-foundation.org>,
	<nao.horiguchi@gmail.com>, Yinghai Lu <yinghai@kernel.org>,
	"H. Peter Anvin" <hpa@zytor.com>,
	"Thomas Gleixner" <tglx@linutronix.de>, <mingo@elte.hu>,
	Xiexiuqi <xiexiuqi@huawei.com>, Hanjun Guo <guohanjun@huawei.com>,
	"Luck, Tony" <tony.luck@intel.com>
Cc: Xishi Qiu <qiuxishi@huawei.com>, Linux MM <linux-mm@kvack.org>,
	LKML <linux-kernel@vger.kernel.org>
Subject: [RFC PATCH 00/12] mm: mirrored memory support for page buddy allocations
Date: Thu, 4 Jun 2015 20:54:22 +0800	[thread overview]
Message-ID: <55704A7E.5030507@huawei.com> (raw)

Intel Xeon processor E7 v3 product family-based platforms introduces support
for partial memory mirroring called as 'Address Range Mirroring'. This feature
allows BIOS to specify a subset of total available memory to be mirrored (and
optionally also specify whether to mirror the range 0-4 GB). This capability
allows user to make an appropriate tradeoff between non-mirrored memory range
and mirrored memory range thus optimizing total available memory and still
achieving highly reliable memory range for mission critical workloads and/or
kernel space.

Tony has already send a patchset to supprot this feature at boot time.
https://lkml.org/lkml/2015/5/8/521

This patchset can support the feature after boot time. It introduces mirror_info
to save the mirrored memory range. Then use __GFP_MIRROR to allocate mirrored 
pages. 

I think add a new migratetype is btter and easier than a new zone, so I use
MIGRATE_MIRROR to manage the mirrored pages. However it changed some code in the
core file, please review and comment, thanks.

TBD: 
1) call add_mirror_info() to fill mirrored memory info.
2) add compatibility with memory online/offline.
3) add more interface? others?

Xishi Qiu (12):
  mm: add a new config to manage the code
  mm: introduce mirror_info
  mm: introduce MIGRATE_MIRROR to manage the mirrored pages
  mm: add mirrored pages to buddy system
  mm: introduce a new zone_stat_item NR_FREE_MIRROR_PAGES
  mm: add free mirrored pages info
  mm: introduce __GFP_MIRROR to allocate mirrored pages
  mm: use mirrorable to switch allocate mirrored memory
  mm: enable allocate mirrored memory at boot time
  mm: add the buddy system interface
  mm: add the PCP interface
  mm: let slab/slub/slob use mirrored memory

 arch/x86/mm/numa.c     |   3 ++
 drivers/base/node.c    |  17 ++++---
 fs/proc/meminfo.c      |   6 +++
 include/linux/gfp.h    |   5 +-
 include/linux/mmzone.h |  23 +++++++++
 include/linux/vmstat.h |   2 +
 kernel/sysctl.c        |   9 ++++
 mm/Kconfig             |   8 +++
 mm/page_alloc.c        | 134 ++++++++++++++++++++++++++++++++++++++++++++++---
 mm/slab.c              |   3 +-
 mm/slob.c              |   2 +-
 mm/slub.c              |   2 +-
 mm/vmstat.c            |   4 ++
 13 files changed, 202 insertions(+), 16 deletions(-)

-- 
2.0.0



             reply	other threads:[~2015-06-04 13:11 UTC|newest]

Thread overview: 124+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2015-06-04 12:54 Xishi Qiu [this message]
2015-06-04 12:54 ` [RFC PATCH 00/12] mm: mirrored memory support for page buddy allocations Xishi Qiu
2015-06-04 12:56 ` [RFC PATCH 01/12] mm: add a new config to manage the code Xishi Qiu
2015-06-04 12:56   ` Xishi Qiu
2015-06-08 11:52   ` Leon Romanovsky
2015-06-08 11:52     ` Leon Romanovsky
2015-06-08 15:14     ` Luck, Tony
2015-06-08 15:14       ` Luck, Tony
2015-06-08 16:36       ` Leon Romanovsky
2015-06-08 16:36         ` Leon Romanovsky
2015-06-09  6:44   ` Kamezawa Hiroyuki
2015-06-09  6:44     ` Kamezawa Hiroyuki
2015-06-09 10:10     ` Xishi Qiu
2015-06-09 10:10       ` Xishi Qiu
2015-06-10  3:07       ` Kamezawa Hiroyuki
2015-06-10  3:07         ` Kamezawa Hiroyuki
2015-06-04 12:57 ` [RFC PATCH 02/12] mm: introduce mirror_info Xishi Qiu
2015-06-04 12:57   ` Xishi Qiu
2015-06-04 16:57   ` Luck, Tony
2015-06-04 16:57     ` Luck, Tony
2015-06-05  1:53     ` Xishi Qiu
2015-06-05  1:53       ` Xishi Qiu
2015-06-09  6:48   ` Kamezawa Hiroyuki
2015-06-09  6:48     ` Kamezawa Hiroyuki
2015-06-04 12:58 ` [RFC PATCH 03/12] mm: introduce MIGRATE_MIRROR to manage the mirrored, pages Xishi Qiu
2015-06-04 12:58   ` Xishi Qiu
2015-06-09  6:54   ` Kamezawa Hiroyuki
2015-06-09  6:54     ` Kamezawa Hiroyuki
2015-06-04 12:59 ` [RFC PATCH 04/12] mm: add mirrored pages to buddy system Xishi Qiu
2015-06-04 12:59   ` Xishi Qiu
2015-06-04 13:00 ` [RFC PATCH 05/12] mm: introduce a new zone_stat_item NR_FREE_MIRROR_PAGES Xishi Qiu
2015-06-04 13:00   ` Xishi Qiu
2015-06-04 13:01 ` [RFC PATCH 06/12] mm: add free mirrored pages info Xishi Qiu
2015-06-04 13:01   ` Xishi Qiu
2015-06-04 13:02 ` [RFC PATCH 07/12] mm: introduce __GFP_MIRROR to allocate mirrored pages Xishi Qiu
2015-06-04 13:02   ` Xishi Qiu
2015-06-09  7:01   ` Kamezawa Hiroyuki
2015-06-09  7:01     ` Kamezawa Hiroyuki
2015-06-04 13:02 ` [RFC PATCH 08/12] mm: use mirrorable to switch allocate mirrored memory Xishi Qiu
2015-06-04 13:02   ` Xishi Qiu
2015-06-04 17:01   ` Luck, Tony
2015-06-04 17:01     ` Luck, Tony
2015-06-04 18:41   ` Dave Hansen
2015-06-04 18:41     ` Dave Hansen
2015-06-05  3:13     ` Xishi Qiu
2015-06-05  3:13       ` Xishi Qiu
2015-06-09  7:06   ` Kamezawa Hiroyuki
2015-06-09  7:06     ` Kamezawa Hiroyuki
2015-06-09 10:09     ` Xishi Qiu
2015-06-09 10:09       ` Xishi Qiu
2015-06-10  3:09       ` Kamezawa Hiroyuki
2015-06-10  3:09         ` Kamezawa Hiroyuki
2015-06-12  8:05   ` Naoya Horiguchi
2015-06-12  8:05     ` Naoya Horiguchi
2015-06-04 13:03 ` [RFC PATCH 09/12] mm: enable allocate mirrored memory at boot time Xishi Qiu
2015-06-04 13:03   ` Xishi Qiu
2015-06-04 13:04 ` [RFC PATCH 10/12] mm: add the buddy system interface Xishi Qiu
2015-06-04 13:04   ` Xishi Qiu
2015-06-04 17:09   ` Luck, Tony
2015-06-04 17:09     ` Luck, Tony
2015-06-05  3:14     ` Xishi Qiu
2015-06-05  3:14       ` Xishi Qiu
2015-06-09  7:12   ` Kamezawa Hiroyuki
2015-06-09  7:12     ` Kamezawa Hiroyuki
2015-06-09 10:04     ` Xishi Qiu
2015-06-09 10:04       ` Xishi Qiu
2015-06-10  3:06       ` Kamezawa Hiroyuki
2015-06-10  3:06         ` Kamezawa Hiroyuki
2015-06-10 20:40         ` Luck, Tony
2015-06-10 20:40           ` Luck, Tony
2015-06-15  8:47           ` Kamezawa Hiroyuki
2015-06-15  8:47             ` Kamezawa Hiroyuki
2015-06-15 17:20             ` Luck, Tony
2015-06-15 17:20               ` Luck, Tony
2015-06-16  0:31               ` Kamezawa Hiroyuki
2015-06-16  0:31                 ` Kamezawa Hiroyuki
2015-06-25  9:44         ` Xishi Qiu
2015-06-25  9:44           ` Xishi Qiu
2015-06-25 23:54           ` Kamezawa Hiroyuki
2015-06-25 23:54             ` Kamezawa Hiroyuki
2015-06-26  1:43             ` Xishi Qiu
2015-06-26  1:43               ` Xishi Qiu
2015-06-26  8:34               ` Kamezawa Hiroyuki
2015-06-26  8:34                 ` Kamezawa Hiroyuki
2015-06-26 10:38                 ` Xishi Qiu
2015-06-26 10:38                   ` Xishi Qiu
2015-06-26 18:42                   ` Luck, Tony
2015-06-26 18:42                     ` Luck, Tony
2015-06-04 13:04 ` [RFC PATCH 11/12] mm: add the PCP interface Xishi Qiu
2015-06-04 13:04   ` Xishi Qiu
2015-06-04 18:44   ` Dave Hansen
2015-06-04 18:44     ` Dave Hansen
2015-06-04 13:05 ` [RFC PATCH 12/12] mm: let slab/slub/slob use mirrored memory Xishi Qiu
2015-06-04 13:05   ` Xishi Qiu
2015-06-04 17:14   ` Luck, Tony
2015-06-04 17:14     ` Luck, Tony
2015-06-12  8:42 ` [RFC PATCH 00/12] mm: mirrored memory support for page buddy allocations Naoya Horiguchi
2015-06-12  8:42   ` Naoya Horiguchi
2015-06-12  9:09   ` Xishi Qiu
2015-06-12  9:09     ` Xishi Qiu
2015-06-12 19:03   ` Luck, Tony
2015-06-12 19:03     ` Luck, Tony
2015-06-15  0:25     ` Naoya Horiguchi
2015-06-15  0:25       ` Naoya Horiguchi
2015-06-16  7:53 ` Vlastimil Babka
2015-06-16  7:53   ` Vlastimil Babka
2015-06-16  8:17   ` Xishi Qiu
2015-06-16  8:17     ` Xishi Qiu
2015-06-16  9:46     ` Vlastimil Babka
2015-06-16  9:46       ` Vlastimil Babka
2015-06-18  1:23       ` Xishi Qiu
2015-06-18  1:23         ` Xishi Qiu
2015-06-18  5:58         ` Vlastimil Babka
2015-06-18  5:58           ` Vlastimil Babka
2015-06-18  9:37           ` Xishi Qiu
2015-06-18  9:37             ` Xishi Qiu
2015-06-18  9:55             ` Vlastimil Babka
2015-06-18  9:55               ` Vlastimil Babka
2015-06-18 20:33               ` Luck, Tony
2015-06-18 20:33                 ` Luck, Tony
2015-06-19  1:36                 ` Xishi Qiu
2015-06-19  1:36                   ` Xishi Qiu
2015-06-19 18:42                   ` Luck, Tony
2015-06-19 18:42                     ` Luck, Tony

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=55704A7E.5030507@huawei.com \
    --to=qiuxishi@huawei.com \
    --cc=akpm@linux-foundation.org \
    --cc=guohanjun@huawei.com \
    --cc=hpa@zytor.com \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=mingo@elte.hu \
    --cc=nao.horiguchi@gmail.com \
    --cc=tglx@linutronix.de \
    --cc=tony.luck@intel.com \
    --cc=xiexiuqi@huawei.com \
    --cc=yinghai@kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.