All of lore.kernel.org
 help / color / mirror / Atom feed
From: Shaohui Zheng <shaohui.zheng@intel.com>
To: David Rientjes <rientjes@google.com>
Cc: Dave Hansen <dave@linux.vnet.ibm.com>,
	akpm@linux-foundation.org, linux-mm@kvack.org,
	linux-kernel@vger.kernel.org, haicheng.li@linux.intel.com,
	lethal@linux-sh.org, ak@linux.intel.com,
	shaohui.zheng@linux.intel.com,
	Haicheng Li <haicheng.li@intel.com>,
	Wu Fengguang <fengguang.wu@intel.com>, Greg KH <greg@kroah.com>
Subject: Re: [7/8,v3] NUMA Hotplug Emulator: extend memory probe interface to support NUMA
Date: Thu, 18 Nov 2010 12:48:50 +0800	[thread overview]
Message-ID: <20101118044850.GC2408@shaohui> (raw)
In-Reply-To: <alpine.DEB.2.00.1011171312590.10254@chino.kir.corp.google.com>

On Wed, Nov 17, 2010 at 01:18:50PM -0800, David Rientjes wrote:
> On Wed, 17 Nov 2010, Dave Hansen wrote:
> 
> > The other thing that Greg suggested was to use configfs.  Looking back
> > on it, that makes a lot of sense.  We can do better than these "probe"
> > files.
> > 
> > In your case, it might be useful to tell the kernel to be able to add
> > memory in a node and add the node all in one go.  That'll probably be
> > closer to what the hardware will do, and will exercise different code
> > paths that the separate "add node", "then add memory" steps that you're
> > using here.
> > 
> 
> That seems like a seperate issue of moving the memory hotplug interface 
> over to configfs and that seems like it will cause a lot of userspace 
> breakage.  The memory hotplug interface can already add memory to a node 
> without using the ACPI notifier, so what does it have to do with this 
> patchset?

Agree with you, I do not suggest to implement it in this patchset.

> 
> I think what this patchset really wants to do is map offline hot-added 
> memory to a different node id before it is onlined.  It needs no 
> additional command-line interface or kconfig options, users just need to 
> physically hot-add memory at runtime or use mem= when booting to reserve 
> present memory from being used.

I already send out the implementation in another email, you can help to do
a review.

> 
> Then, export the amount of memory that is actually physically present in 
> the e820 but was truncated by mem= and allow users to hot-add the memory 
> via the probe interface.  Add a writeable 'node' file to offlined memory 
> section directories and allow it to be changed prior to online.

for memory offlining, it is a known diffcult thing, and it is not supported 
well in current kernel, so I do not suggest to provide the offline interface
in the emulator, it just take more pains. We can consider to add it when
the memory offlining works well.

-- 
Thanks & Regards,
Shaohui


WARNING: multiple messages have this Message-ID (diff)
From: Shaohui Zheng <shaohui.zheng@intel.com>
To: David Rientjes <rientjes@google.com>
Cc: Dave Hansen <dave@linux.vnet.ibm.com>,
	akpm@linux-foundation.org, linux-mm@kvack.org,
	linux-kernel@vger.kernel.org, haicheng.li@linux.intel.com,
	lethal@linux-sh.org, ak@linux.intel.com,
	shaohui.zheng@linux.intel.com,
	Haicheng Li <haicheng.li@intel.com>,
	Wu Fengguang <fengguang.wu@intel.com>, Greg KH <greg@kroah.com>
Subject: Re: [7/8,v3] NUMA Hotplug Emulator: extend memory probe interface to support NUMA
Date: Thu, 18 Nov 2010 12:48:50 +0800	[thread overview]
Message-ID: <20101118044850.GC2408@shaohui> (raw)
In-Reply-To: <alpine.DEB.2.00.1011171312590.10254@chino.kir.corp.google.com>

On Wed, Nov 17, 2010 at 01:18:50PM -0800, David Rientjes wrote:
> On Wed, 17 Nov 2010, Dave Hansen wrote:
> 
> > The other thing that Greg suggested was to use configfs.  Looking back
> > on it, that makes a lot of sense.  We can do better than these "probe"
> > files.
> > 
> > In your case, it might be useful to tell the kernel to be able to add
> > memory in a node and add the node all in one go.  That'll probably be
> > closer to what the hardware will do, and will exercise different code
> > paths that the separate "add node", "then add memory" steps that you're
> > using here.
> > 
> 
> That seems like a seperate issue of moving the memory hotplug interface 
> over to configfs and that seems like it will cause a lot of userspace 
> breakage.  The memory hotplug interface can already add memory to a node 
> without using the ACPI notifier, so what does it have to do with this 
> patchset?

Agree with you, I do not suggest to implement it in this patchset.

> 
> I think what this patchset really wants to do is map offline hot-added 
> memory to a different node id before it is onlined.  It needs no 
> additional command-line interface or kconfig options, users just need to 
> physically hot-add memory at runtime or use mem= when booting to reserve 
> present memory from being used.

I already send out the implementation in another email, you can help to do
a review.

> 
> Then, export the amount of memory that is actually physically present in 
> the e820 but was truncated by mem= and allow users to hot-add the memory 
> via the probe interface.  Add a writeable 'node' file to offlined memory 
> section directories and allow it to be changed prior to online.

for memory offlining, it is a known diffcult thing, and it is not supported 
well in current kernel, so I do not suggest to provide the offline interface
in the emulator, it just take more pains. We can consider to add it when
the memory offlining works well.

-- 
Thanks & Regards,
Shaohui

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to majordomo@kvack.org.  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Fight unfair telecom policy in Canada: sign http://dissolvethecrtc.ca/
Don't email: <a href=mailto:"dont@kvack.org"> email@kvack.org </a>

  parent reply	other threads:[~2010-11-18  6:09 UTC|newest]

Thread overview: 139+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-11-17  2:07 [0/8,v3] NUMA Hotplug Emulator - Introduction & Feedbacks shaohui.zheng
2010-11-17  2:07 ` shaohui.zheng
2010-11-17  2:08 ` [1/8,v3] NUMA Hotplug Emulator: add function to hide memory region via e820 table shaohui.zheng
2010-11-17  2:08   ` shaohui.zheng
2010-11-17  8:16   ` David Rientjes
2010-11-17  8:16     ` David Rientjes
2010-11-18  9:20     ` Shaohui Zheng
2010-11-18  9:20       ` Shaohui Zheng
2010-11-18 21:16       ` David Rientjes
2010-11-18 21:16         ` David Rientjes
2010-11-19  0:12         ` Shaohui Zheng
2010-11-19  0:12           ` Shaohui Zheng
2010-11-21  0:45           ` David Rientjes
2010-11-21  0:45             ` David Rientjes
2010-11-21 14:00             ` Américo Wang
2010-11-21 14:00               ` Américo Wang
2010-11-21 21:33               ` David Rientjes
2010-11-21 21:33                 ` David Rientjes
2010-11-17  2:08 ` [2/8,v3] NUMA Hotplug Emulator: infrastructure of NUMA hotplug emulation shaohui.zheng
2010-11-17  2:08   ` shaohui.zheng
2010-11-17  8:16   ` David Rientjes
2010-11-17  8:16     ` David Rientjes
2010-11-17  7:51     ` Shaohui Zheng
2010-11-17  7:51       ` Shaohui Zheng
2010-11-17 21:10       ` David Rientjes
2010-11-17 21:10         ` David Rientjes
2010-11-18  4:14         ` Shaohui Zheng
2010-11-18  4:14           ` Shaohui Zheng
2010-11-18  6:27           ` Paul Mundt
2010-11-18  6:27             ` Paul Mundt
2010-11-18  5:27             ` Shaohui Zheng
2010-11-18  5:27               ` Shaohui Zheng
2010-11-18 21:24               ` David Rientjes
2010-11-18 21:24                 ` David Rientjes
2010-11-19  0:32                 ` Shaohui Zheng
2010-11-19  0:32                   ` Shaohui Zheng
2010-11-21  0:48                   ` David Rientjes
2010-11-21  0:48                     ` David Rientjes
2010-11-21  2:28                     ` [patch 1/2] x86: add numa=possible command line option David Rientjes
2010-11-21  2:28                       ` David Rientjes
2010-11-21  2:28                       ` [patch 2/2] mm: add node hotplug emulation David Rientjes
2010-11-21  2:28                         ` David Rientjes
2010-11-21 17:34                         ` Greg KH
2010-11-21 17:34                           ` Greg KH
2010-11-21 21:48                           ` David Rientjes
2010-11-21 21:48                             ` David Rientjes
2010-11-21 23:08                             ` [patch 2/2 v2] " David Rientjes
2010-11-21 23:08                               ` David Rientjes
2010-11-22  0:56                               ` Greg KH
2010-11-22  0:56                                 ` Greg KH
2010-11-28  1:52                                 ` David Rientjes
2010-11-28  1:52                                   ` David Rientjes
2010-11-28  5:17                                   ` Greg KH
2010-11-28  5:17                                     ` Greg KH
2010-11-30  0:04                                     ` David Rientjes
2010-11-30  0:04                                       ` David Rientjes
2010-11-21 14:26                       ` [patch 1/2] x86: add numa=possible command line option Américo Wang
2010-11-21 14:26                         ` Américo Wang
2010-11-21 21:46                         ` David Rientjes
2010-11-21 21:46                           ` David Rientjes
2010-11-22 15:43                           ` Américo Wang
2010-11-22 15:43                             ` Américo Wang
2010-11-21 15:14                     ` [2/8,v3] NUMA Hotplug Emulator: infrastructure of NUMA hotplug emulation Li, Haicheng
2010-11-21 15:14                       ` Li, Haicheng
2010-11-21 21:42                       ` David Rientjes
2010-11-21 21:42                         ` David Rientjes
2010-11-18 21:19           ` David Rientjes
2010-11-18 21:19             ` David Rientjes
2010-11-17  2:08 ` [3/8,v3] NUMA Hotplug Emulator: Userland interface to hotplug-add fake offlined nodes shaohui.zheng
2010-11-17  2:08   ` shaohui.zheng
2010-11-17  8:16   ` David Rientjes
2010-11-17  8:16     ` David Rientjes
2010-11-17  2:08 ` [4/8,v3] NUMA Hotplug Emulator: Abstract cpu register functions shaohui.zheng
2010-11-17  2:08   ` shaohui.zheng
2010-11-17  2:08 ` [5/8,v3] NUMA Hotplug Emulator: support cpu probe/release in x86 shaohui.zheng
2010-11-17  2:08   ` shaohui.zheng
2010-11-21 14:45   ` Américo Wang
2010-11-21 14:45     ` Américo Wang
2010-11-22  0:01     ` Shaohui Zheng
2010-11-22  0:01       ` Shaohui Zheng
2010-11-22 15:51       ` Américo Wang
2010-11-22 15:51         ` Américo Wang
2010-11-22 23:29         ` Shaohui Zheng
2010-11-22 23:29           ` Shaohui Zheng
2010-11-17  2:08 ` [6/8,v3] NUMA Hotplug Emulator: Fake CPU socket with logical CPU on x86 shaohui.zheng
2010-11-17  2:08   ` shaohui.zheng
2010-11-17  2:08 ` [7/8,v3] NUMA Hotplug Emulator: extend memory probe interface to support NUMA shaohui.zheng
2010-11-17  2:08   ` shaohui.zheng
2010-11-17 18:50   ` Dave Hansen
2010-11-17 18:50     ` Dave Hansen
2010-11-17 21:18     ` David Rientjes
2010-11-17 21:18       ` David Rientjes
2010-11-17 21:55       ` Dave Hansen
2010-11-17 21:55         ` Dave Hansen
2010-11-17 22:44         ` David Rientjes
2010-11-17 22:44           ` David Rientjes
2010-11-17 23:00           ` Dave Hansen
2010-11-17 23:00             ` Dave Hansen
2010-11-17 23:17             ` David Rientjes
2010-11-17 23:17               ` David Rientjes
2010-11-18 16:59           ` Aaron Durbin
2010-11-18 16:59             ` Aaron Durbin
2010-11-18  4:48       ` Shaohui Zheng [this message]
2010-11-18  4:48         ` Shaohui Zheng
2010-11-18  6:24         ` Paul Mundt
2010-11-18  6:24           ` Paul Mundt
2010-11-18 21:28           ` David Rientjes
2010-11-18 21:28             ` David Rientjes
2010-11-18 21:31         ` David Rientjes
2010-11-18 21:31           ` David Rientjes
2010-11-18  4:36     ` Shaohui Zheng
2010-11-18  4:36       ` Shaohui Zheng
2010-11-19  7:51     ` Shaohui Zheng
2010-11-19 16:36       ` Dave Hansen
2010-11-19 16:36         ` Dave Hansen
2010-11-17  2:08 ` [8/8,v3] NUMA Hotplug Emulator: documentation shaohui.zheng
2010-11-17  2:08   ` shaohui.zheng
2010-11-17 23:06   ` Randy Dunlap
2010-11-17 23:06     ` Randy Dunlap
2010-11-18  2:31     ` Shaohui Zheng
2010-11-18  2:31       ` Shaohui Zheng
2010-11-21 15:03   ` Américo Wang
2010-11-21 15:03     ` Américo Wang
2010-11-21 15:16     ` Li, Haicheng
2010-11-21 15:16       ` Li, Haicheng
2010-11-21 23:33     ` Shaohui Zheng
2010-11-21 23:33       ` Shaohui Zheng
2010-11-22 16:04       ` Américo Wang
2010-11-22 16:04         ` Américo Wang
2010-11-22 23:23         ` Shaohui Zheng
2010-11-22 23:23           ` Shaohui Zheng
2010-11-17  5:22 ` [0/8,v3] NUMA Hotplug Emulator - Introduction & Feedbacks Paul Mundt
2010-11-17  5:22   ` Paul Mundt
2010-11-19  5:54   ` Shaohui Zheng
2010-11-19  5:54     ` Shaohui Zheng
2010-11-17  9:26 ` Yinghai Lu
2010-11-17  9:26   ` Yinghai Lu
2010-11-18  2:03   ` Shaohui Zheng
2010-11-18  2:03     ` Shaohui Zheng

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20101118044850.GC2408@shaohui \
    --to=shaohui.zheng@intel.com \
    --cc=ak@linux.intel.com \
    --cc=akpm@linux-foundation.org \
    --cc=dave@linux.vnet.ibm.com \
    --cc=fengguang.wu@intel.com \
    --cc=greg@kroah.com \
    --cc=haicheng.li@intel.com \
    --cc=haicheng.li@linux.intel.com \
    --cc=lethal@linux-sh.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-mm@kvack.org \
    --cc=rientjes@google.com \
    --cc=shaohui.zheng@linux.intel.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.