From: Dario Faggioli <dario.faggioli@citrix.com>
To: butine@zju.edu.cn
Cc: xen-devel@lists.xen.org
Subject: Re: how to move the memory of a domain from one NUMA node to another?
Date: Wed, 7 Aug 2013 13:15:21 +0200 [thread overview]
Message-ID: <1375874121.3597.75.camel@Abyss> (raw)
In-Reply-To: <6d2084.4041b.140586a6a22.Coremail.butine@zju.edu.cn>
[-- Attachment #1.1: Type: text/plain, Size: 2148 bytes --]
On mer, 2013-08-07 at 18:55 +0800, butine@zju.edu.cn wrote:
> hello,Dario,
>
Hi,
> I have been studying in your patch about "memory migration",
>
Oh, you are? Cool... What do you think about'em? :-)
I'm working on a new version of that series from quite a while now, but
I keep being sidetracked by various things. Anyway, as of now, It
shouldn't take much longer to be able to repost something...
> how to recognize the hot memory,
>
And do you have any idea of that?
The two options I can think of are performance counters (but they're
coarse grained, they're not available on all archs, etc.) and 'hinting
page faults'. That is something Linux does, i.e., it periodically
removes the _PAGE_PRESENT bit from all the pages and, when the page
fault occurs, it make a note of where the page is and from where it is
being accessed (and at that point you can even count how many times,
etc.).
That being said, the point here is, would that be worth? I mean, for
Linux is not a big deal to migrate just one (or a bunch of) page(s) at a
time, for us here, it indeed is quite a big deal (PV guests!!). So I
honestly don't think we can take the same approach and hence, while it
would be useful to have some info about the above, I'm not sure it's
terribly important.
Thoughts?
> and how to gurantee no downtime.
>
And again, did you reach any conclusion on this? :-)
I do not think that, for PV guest, zero downtime is almost impossible.
Right now I'm doing a very quick suspend-resume alike cycle. We can (in
future) try to turn it into something even more lightweight (some kind
of quiescence state), but you don't change the PTEs under the feet of a
running domain! :-O
> At the same time,In the migration process,the P2M need to be locked?
>
Well, right now I'm suspending the domain, so I really think it does
not.
Dario
--
<<This happens because I choose it to happen!>> (Raistlin Majere)
-----------------------------------------------------------------
Dario Faggioli, Ph.D, http://about.me/dario.faggioli
Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)
[-- Attachment #1.2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 198 bytes --]
[-- Attachment #2: Type: text/plain, Size: 126 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
prev parent reply other threads:[~2013-08-07 11:15 UTC|newest]
Thread overview: 2+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-08-07 10:55 how to move the memory of a domain from one NUMA node to another? butine
2013-08-07 11:15 ` Dario Faggioli [this message]
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1375874121.3597.75.camel@Abyss \
--to=dario.faggioli@citrix.com \
--cc=butine@zju.edu.cn \
--cc=xen-devel@lists.xen.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.