* [XEN][vNUMA][PATCH 0/9] VM memory mgmt for NUMA
[not found] <1BEA8649F0C00540AB2811D7922ECB6C933256EA@orsmsx507.amr.corp.intel.com>
@ 2010-07-02 23:53 ` Dulloor
2010-08-01 22:00 ` [vNUMA v2][PATCH 0/8] " Dulloor
0 siblings, 1 reply; 5+ messages in thread
From: Dulloor @ 2010-07-02 23:53 UTC (permalink / raw)
To: xen-devel
[-- Attachment #1: Type: text/plain, Size: 3081 bytes --]
This series of patches implements the following ~
[1] Memory allocation schemes for VMs on NUMA platforms : The specific
allocation allocation strategies available as configuration parameters are -
* CONFINE - Confine the VM memory to a single NUMA node.
[config]
strategy = "confine"
* STRIPE - Stripe the VM memory across a specified number of nodes.
[config]
strategy = "stripe"
vnodes = <num>
stripesz = <in pages>
* SPLIT - Split the VM memory across a specified number of nodes
to construct virtual nodes, which are then exposed to the VM.
For now, we require the number of vnodes and number of vcpus to
be powers of 2 (for symmetric distribution), as opposed to using
multiples.
[config]
strategy = "split"
vnodes = <num>
* AUTO - Choose a scheme automatically, based on memory distribution
across the nodes. The strategy attempts CONFINE and STRIPE(by
dividing memory in equal parts) in that order. If both fail, then
it reverts to the existing non-numa allocation.
* No Configuration - No change from existing behaviour.
[2] HVM NUMA guests : If the user specifies "split" strategy, we expose the
virtual nodes to the HVM (SRAT/SLIT).
[3] Disable migration : For now, the allocation information is not preserved
across migration. We set disable_migrate for documentation, although it
doesn't really stop one from migrating VMs(?).
-Dulloor
Signed-off-by: Dulloor <dulloor@gmail.com>
--
xen/common/memory.c | 2 +
xen/common/page_alloc.c | 9 +
xen/include/public/memory.h | 3 +
xen/include/xen/mm.h | 2 +
tools/libxc/xenctrl.h | 19 +
tools/libxl/libxl.h | 1 +
tools/libxl/xl_cmdimpl.c | 50 +-
xen/include/public/dom_numa.h | 71 ++
tools/libxc/Makefile | 1 +
tools/libxc/xc_cpumap.c | 88 +++
tools/libxc/xc_cpumap.h | 113 +++
tools/libxc/Makefile | 1 +
tools/libxc/xc_dom_numa.c | 909 +++++++++++++++++++++++++++++++
tools/libxc/xc_dom_numa.h | 49 +
tools/libxc/xc_hvm_build.c | 320 ++++++-----
tools/libxc/ia64/xc_ia64_hvm_build.c | 1 +
tools/libxc/xc_dom_numa.c | 2 +-
tools/libxc/xc_dom_numa.h | 2 +-
tools/libxc/xc_hvm_build.c | 298 +++++++---
tools/libxc/xenguest.h | 1 +
tools/libxl/libxl_dom.c | 5 +-
tools/python/xen/lowlevel/xc/xc.c | 2 +-
tools/firmware/hvmloader/acpi/acpi2_0.h | 64 ++
tools/firmware/hvmloader/acpi/build.c | 118 ++++
tools/libxc/xc_hvm_build.c | 49 +-
xen/include/public/hvm/hvm_info_table.h | 8 +-
tools/libxc/xc_hvm_build.c | 2 +
27 files changed, 1939 insertions(+), 251 deletions(-)
[-- Attachment #2: Type: text/plain, Size: 138 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
^ permalink raw reply [flat|nested] 5+ messages in thread
* [vNUMA v2][PATCH 0/8] VM memory mgmt for NUMA
2010-07-02 23:53 ` [XEN][vNUMA][PATCH 0/9] VM memory mgmt for NUMA Dulloor
@ 2010-08-01 22:00 ` Dulloor
2010-08-02 16:16 ` Konrad Rzeszutek Wilk
0 siblings, 1 reply; 5+ messages in thread
From: Dulloor @ 2010-08-01 22:00 UTC (permalink / raw)
To: xen-devel
Sorry for the delay. I have been busy with other things.
Summary of the patches :
In this patch series, we implement the following ~
[1] Memory allocation schemes for VMs on NUMA platforms : The specific
allocation allocation strategies available as configuration parameters are -
* CONFINE - Confine the VM memory to a single NUMA node.
[config]
strategy = "confine"
* STRIPE - Stripe the VM memory across a specified number of nodes.
[config]
strategy = "stripe"
vnodes = <num>
stripesz = <in pages>
* SPLIT - Split the VM memory across a specified number of nodes
to construct virtual nodes, which are then exposed to the VM.
For now, we require the number of vnodes and number of vcpus to
be powers of 2 (for symmetric distribution), as opposed to using
multiples.
[config]
strategy = "split"
vnodes = <num>
* AUTO - Choose a scheme automatically, based on memory distribution
across the nodes. The strategy attempts CONFINE and STRIPE(by
dividing memory in equal parts) in that order. If both fail, then
it reverts to the existing non-numa allocation.
[config]
strategy = "auto"
* No Configuration - No change from existing behaviour.
[2] HVM NUMA guests : If the user specifies "split" strategy, we expose the
virtual nodes to the HVM (SRAT/SLIT).
[3] Disable migration : For now, the allocation information is not preserved
across migration, so we just disable migration. We will address this in the next
patch series.
[4] PoD (Populate on Demand) : For now, PoD is disabled internally if a NUMA
allocation strategy is specified and applied to a VM. We will address
this in the
next patch series.
Changes from previous version :
[1] The guest interface structure has been modified per Keir's suggestions.
Most changes from previous version are due to this.
[2] Cleaned up debug code in setup_guest (spotted by George).
-Dulloor
Signed-off-by: Dulloor <dulloor@gmail.com>
--
tools/firmware/hvmloader/acpi/acpi2_0.h | 64 ++++++
tools/firmware/hvmloader/acpi/build.c | 122 ++++++++++++
tools/libxc/Makefile | 2 +
tools/libxc/ia64/xc_ia64_hvm_build.c | 1 +
tools/libxc/xc_cpumap.c | 88 +++++++++
tools/libxc/xc_cpumap.h | 113 +++++++++++
tools/libxc/xc_dom_numa.c | 901
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
tools/libxc/xc_dom_numa.h | 73 +++++++
tools/libxc/xc_hvm_build.c | 574
++++++++++++++++++++++++++++++++++++++++------------------
tools/libxc/xenctrl.h | 19 +
tools/libxc/xenguest.h | 1 +
tools/libxl/libxl.h | 1 +
tools/libxl/libxl_dom.c | 1 +
tools/libxl/xl_cmdimpl.c | 44 ++++
tools/python/xen/lowlevel/xc/xc.c | 2 +-
xen/include/public/arch-x86/dom_numa.h | 91 +++++++++
xen/include/public/dom_numa.h | 33 +++
xen/include/public/hvm/hvm_info_table.h | 10 +-
18 files changed, 1954 insertions(+), 186 deletions(-)
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [vNUMA v2][PATCH 0/8] VM memory mgmt for NUMA
2010-08-01 22:00 ` [vNUMA v2][PATCH 0/8] " Dulloor
@ 2010-08-02 16:16 ` Konrad Rzeszutek Wilk
2010-08-02 17:03 ` Dulloor
0 siblings, 1 reply; 5+ messages in thread
From: Konrad Rzeszutek Wilk @ 2010-08-02 16:16 UTC (permalink / raw)
To: Dulloor, Andre Przywara; +Cc: xen-devel
On Sun, Aug 01, 2010 at 03:00:31PM -0700, Dulloor wrote:
> Sorry for the delay. I have been busy with other things.
Np. Can you CC these patches in the future to Andre?
His email is Andre Przywara <andre.przywara@amd.com>
In the meantime, I am CC-ing him here.
>
>
> Summary of the patches :
> In this patch series, we implement the following ~
>
> [1] Memory allocation schemes for VMs on NUMA platforms : The specific
> allocation allocation strategies available as configuration parameters are -
>
> * CONFINE - Confine the VM memory to a single NUMA node.
> [config]
> strategy = "confine"
>
> * STRIPE - Stripe the VM memory across a specified number of nodes.
> [config]
> strategy = "stripe"
> vnodes = <num>
> stripesz = <in pages>
>
> * SPLIT - Split the VM memory across a specified number of nodes
> to construct virtual nodes, which are then exposed to the VM.
> For now, we require the number of vnodes and number of vcpus to
> be powers of 2 (for symmetric distribution), as opposed to using
> multiples.
> [config]
> strategy = "split"
> vnodes = <num>
>
> * AUTO - Choose a scheme automatically, based on memory distribution
> across the nodes. The strategy attempts CONFINE and STRIPE(by
> dividing memory in equal parts) in that order. If both fail, then
> it reverts to the existing non-numa allocation.
> [config]
> strategy = "auto"
>
> * No Configuration - No change from existing behaviour.
>
> [2] HVM NUMA guests : If the user specifies "split" strategy, we expose the
> virtual nodes to the HVM (SRAT/SLIT).
>
> [3] Disable migration : For now, the allocation information is not preserved
> across migration, so we just disable migration. We will address this in the next
> patch series.
>
> [4] PoD (Populate on Demand) : For now, PoD is disabled internally if a NUMA
> allocation strategy is specified and applied to a VM. We will address
> this in the
> next patch series.
>
> Changes from previous version :
> [1] The guest interface structure has been modified per Keir's suggestions.
> Most changes from previous version are due to this.
> [2] Cleaned up debug code in setup_guest (spotted by George).
>
>
> -Dulloor
>
> Signed-off-by: Dulloor <dulloor@gmail.com>
>
> --
> tools/firmware/hvmloader/acpi/acpi2_0.h | 64 ++++++
> tools/firmware/hvmloader/acpi/build.c | 122 ++++++++++++
> tools/libxc/Makefile | 2 +
> tools/libxc/ia64/xc_ia64_hvm_build.c | 1 +
> tools/libxc/xc_cpumap.c | 88 +++++++++
> tools/libxc/xc_cpumap.h | 113 +++++++++++
> tools/libxc/xc_dom_numa.c | 901
> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
> tools/libxc/xc_dom_numa.h | 73 +++++++
> tools/libxc/xc_hvm_build.c | 574
> ++++++++++++++++++++++++++++++++++++++++------------------
> tools/libxc/xenctrl.h | 19 +
> tools/libxc/xenguest.h | 1 +
> tools/libxl/libxl.h | 1 +
> tools/libxl/libxl_dom.c | 1 +
> tools/libxl/xl_cmdimpl.c | 44 ++++
> tools/python/xen/lowlevel/xc/xc.c | 2 +-
> xen/include/public/arch-x86/dom_numa.h | 91 +++++++++
> xen/include/public/dom_numa.h | 33 +++
> xen/include/public/hvm/hvm_info_table.h | 10 +-
> 18 files changed, 1954 insertions(+), 186 deletions(-)
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xensource.com
> http://lists.xensource.com/xen-devel
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [vNUMA v2][PATCH 0/8] VM memory mgmt for NUMA
2010-08-02 16:16 ` Konrad Rzeszutek Wilk
@ 2010-08-02 17:03 ` Dulloor
2010-08-02 21:12 ` Andre Przywara
0 siblings, 1 reply; 5+ messages in thread
From: Dulloor @ 2010-08-02 17:03 UTC (permalink / raw)
To: Konrad Rzeszutek Wilk; +Cc: Andre Przywara, xen-devel, Nakajima, Jun
On Mon, Aug 2, 2010 at 9:16 AM, Konrad Rzeszutek Wilk
<konrad.wilk@oracle.com> wrote:
> On Sun, Aug 01, 2010 at 03:00:31PM -0700, Dulloor wrote:
>> Sorry for the delay. I have been busy with other things.
>
> Np. Can you CC these patches in the future to Andre?
> His email is Andre Przywara <andre.przywara@amd.com>
Sure, thanks ! :) I should be cc'ing Jun Nakajima too.
>
> In the meantime, I am CC-ing him here.
>>
>>
>> Summary of the patches :
>> In this patch series, we implement the following ~
>>
>> [1] Memory allocation schemes for VMs on NUMA platforms : The specific
>> allocation allocation strategies available as configuration parameters are -
>>
>> * CONFINE - Confine the VM memory to a single NUMA node.
>> [config]
>> strategy = "confine"
>>
>> * STRIPE - Stripe the VM memory across a specified number of nodes.
>> [config]
>> strategy = "stripe"
>> vnodes = <num>
>> stripesz = <in pages>
>>
>> * SPLIT - Split the VM memory across a specified number of nodes
>> to construct virtual nodes, which are then exposed to the VM.
>> For now, we require the number of vnodes and number of vcpus to
>> be powers of 2 (for symmetric distribution), as opposed to using
>> multiples.
>> [config]
>> strategy = "split"
>> vnodes = <num>
>>
>> * AUTO - Choose a scheme automatically, based on memory distribution
>> across the nodes. The strategy attempts CONFINE and STRIPE(by
>> dividing memory in equal parts) in that order. If both fail, then
>> it reverts to the existing non-numa allocation.
>> [config]
>> strategy = "auto"
>>
>> * No Configuration - No change from existing behaviour.
>>
>> [2] HVM NUMA guests : If the user specifies "split" strategy, we expose the
>> virtual nodes to the HVM (SRAT/SLIT).
>>
>> [3] Disable migration : For now, the allocation information is not preserved
>> across migration, so we just disable migration. We will address this in the next
>> patch series.
>>
>> [4] PoD (Populate on Demand) : For now, PoD is disabled internally if a NUMA
>> allocation strategy is specified and applied to a VM. We will address
>> this in the
>> next patch series.
>>
>> Changes from previous version :
>> [1] The guest interface structure has been modified per Keir's suggestions.
>> Most changes from previous version are due to this.
>> [2] Cleaned up debug code in setup_guest (spotted by George).
>>
>>
>> -Dulloor
>>
>> Signed-off-by: Dulloor <dulloor@gmail.com>
>>
>> --
>> tools/firmware/hvmloader/acpi/acpi2_0.h | 64 ++++++
>> tools/firmware/hvmloader/acpi/build.c | 122 ++++++++++++
>> tools/libxc/Makefile | 2 +
>> tools/libxc/ia64/xc_ia64_hvm_build.c | 1 +
>> tools/libxc/xc_cpumap.c | 88 +++++++++
>> tools/libxc/xc_cpumap.h | 113 +++++++++++
>> tools/libxc/xc_dom_numa.c | 901
>> +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
>> tools/libxc/xc_dom_numa.h | 73 +++++++
>> tools/libxc/xc_hvm_build.c | 574
>> ++++++++++++++++++++++++++++++++++++++++------------------
>> tools/libxc/xenctrl.h | 19 +
>> tools/libxc/xenguest.h | 1 +
>> tools/libxl/libxl.h | 1 +
>> tools/libxl/libxl_dom.c | 1 +
>> tools/libxl/xl_cmdimpl.c | 44 ++++
>> tools/python/xen/lowlevel/xc/xc.c | 2 +-
>> xen/include/public/arch-x86/dom_numa.h | 91 +++++++++
>> xen/include/public/dom_numa.h | 33 +++
>> xen/include/public/hvm/hvm_info_table.h | 10 +-
>> 18 files changed, 1954 insertions(+), 186 deletions(-)
>>
>> _______________________________________________
>> Xen-devel mailing list
>> Xen-devel@lists.xensource.com
>> http://lists.xensource.com/xen-devel
>
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [vNUMA v2][PATCH 0/8] VM memory mgmt for NUMA
2010-08-02 17:03 ` Dulloor
@ 2010-08-02 21:12 ` Andre Przywara
0 siblings, 0 replies; 5+ messages in thread
From: Andre Przywara @ 2010-08-02 21:12 UTC (permalink / raw)
To: Dulloor; +Cc: xen-devel@lists.xensource.com, Nakajima, Jun,
Konrad Rzeszutek Wilk
Dulloor wrote:
> On Mon, Aug 2, 2010 at 9:16 AM, Konrad Rzeszutek Wilk
> <konrad.wilk@oracle.com> wrote:
>> On Sun, Aug 01, 2010 at 03:00:31PM -0700, Dulloor wrote:
>>> Sorry for the delay. I have been busy with other things.
>> Np. Can you CC these patches in the future to Andre?
>> His email is Andre Przywara <andre.przywara@amd.com>
> Sure, thanks ! :) I should be cc'ing Jun Nakajima too.
Thanks for the heads up, although this time I spotted the patches
already myself. I already started the review and will send some comments
tomorrow.
Regards,
Andre.
--
Andre Przywara
AMD-Operating System Research Center (OSRC), Dresden, Germany
Tel: +49 351 488-3567-12
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2010-08-02 21:12 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <1BEA8649F0C00540AB2811D7922ECB6C933256EA@orsmsx507.amr.corp.intel.com>
2010-07-02 23:53 ` [XEN][vNUMA][PATCH 0/9] VM memory mgmt for NUMA Dulloor
2010-08-01 22:00 ` [vNUMA v2][PATCH 0/8] " Dulloor
2010-08-02 16:16 ` Konrad Rzeszutek Wilk
2010-08-02 17:03 ` Dulloor
2010-08-02 21:12 ` Andre Przywara
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).