From: Dario Faggioli <dario.faggioli@citrix.com>
To: Dan Magenheimer <dan.magenheimer@oracle.com>
Cc: Olaf Hering <olaf@aepfle.de>,
Ian Campbell <Ian.Campbell@citrix.com>,
Konrad Wilk <konrad.wilk@oracle.com>,
George Dunlap <George.Dunlap@eu.citrix.com>,
Andrew Cooper <Andrew.Cooper3@citrix.com>,
Juergen Gross <juergen.gross@ts.fujitsu.com>,
"Tim (Xen.org)" <tim@xen.org>,
xen-devel <xen-devel@lists.xen.org>,
David Vrabel <dvrabel@cantab.net>,
Keir Fraser <keir.xen@gmail.com>,
Andres Lagar-Cavilla <andres@lagarcavilla.org>,
Jan Beulich <JBeulich@suse.com>,
Roger Pau Monne <roger.pau@citrix.com>
Subject: Re: [PATCH 6 of 8 [RFC]] libxc: introduce xc_domain_move_memory
Date: Thu, 11 Apr 2013 16:16:40 +0200 [thread overview]
Message-ID: <1365689800.5135.24.camel@Solace> (raw)
In-Reply-To: <f094d076-bfcb-4587-8470-9d0b9457e161@default>
[-- Attachment #1.1: Type: text/plain, Size: 1797 bytes --]
On mar, 2013-04-09 at 18:43 +0100, Dan Magenheimer wrote:
> > From: Dario Faggioli [mailto:dario.faggioli@citrix.com]
> > Subject: [PATCH 6 of 8 [RFC]] libxc: introduce xc_domain_move_memory
>
> (NUMA discussion...)
>
Hi Dan,
> >
> > XXX Open issues are:
> > - TMEM: how to "move" it?
>
> (Konrad added to cc list.)
>
> Tmem memory is, by definition, the lowest priority memory
> for the domain and the hypervisor may already be storing it as
> efficiently as possible (i.e. the page may be deduplicated).
> When it is accessed by the domain (it is never directly
> addressable by a domain, and a hypercall is required
> to access it), an entire page is sequentially copied from
> a physical page in the hypervisor to the domain. Juergen may
> know otherwise, but I'd guess this inter-node copy would be
> very efficiently pipelined, cache-line by cache-line
> possibly even with hardware pre-fetching.
>
Ok, thanks for the clarification.
> So the best answer to "how to move it?" may be "don't
> move it at all!".
>
Ok. I sort of got the feeling that "not touching" would have been TRT
but, again, thanks for making it clear. :-)
> In fact, a good design for a NUMA-aware
> implementation of tmem might intentionally store the data on
> "any node other than the node making this tmem-put hypercall".
>
Well, we'll get there too, sooner or later. For now, and for the purpose
of this specific work, I'll put things in such a way that they live TMEM
alone.
Regards,
Dario
--
<<This happens because I choose it to happen!>> (Raistlin Majere)
-----------------------------------------------------------------
Dario Faggioli, Ph.D, http://about.me/dario.faggioli
Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK)
[-- Attachment #1.2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 198 bytes --]
[-- Attachment #2: Type: text/plain, Size: 126 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
next prev parent reply other threads:[~2013-04-11 14:16 UTC|newest]
Thread overview: 21+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-04-09 2:49 [PATCH 0 of 8 [RFC]] Move all the memory of a domain Dario Faggioli
2013-04-09 2:49 ` [PATCH 1 of 8 [RFC]] xl: allow for node-wise specification of vcpu pinning Dario Faggioli
2013-04-09 2:49 ` [PATCH 2 of 8 [RFC]] xl: allow for changing NUMA node affinity on-line Dario Faggioli
2013-04-09 2:49 ` [PATCH 3 of 8 [RFC]] libxc: introduce xc_domain_get_address_size Dario Faggioli
2013-04-09 2:49 ` [PATCH 4 of 8 [RFC]] libxc: introduce xc_map_domain_meminfo (and xc_unmap_domain_meminfo) Dario Faggioli
2013-04-09 2:49 ` [PATCH 5 of 8 [RFC]] libxc: allow for ctxt to be NULL in xc_vcpu_setcontext Dario Faggioli
2013-04-09 2:49 ` [PATCH 6 of 8 [RFC]] libxc: introduce xc_domain_move_memory Dario Faggioli
2013-04-09 5:23 ` Juergen Gross
2013-04-09 6:56 ` Dario Faggioli
2013-04-09 8:13 ` Juergen Gross
2013-04-09 8:51 ` Dario Faggioli
2013-04-09 9:16 ` Juergen Gross
2013-04-09 17:43 ` Dan Magenheimer
2013-04-11 14:16 ` Dario Faggioli [this message]
2013-05-02 14:32 ` Tim Deegan
2013-05-02 15:07 ` George Dunlap
2013-05-02 15:13 ` Tim Deegan
2013-05-06 17:37 ` Dario Faggioli
2013-05-06 17:29 ` Dario Faggioli
2013-04-09 2:49 ` [PATCH 7 of 8 [RFC]] libxl: introduce libxl_domain_move_memory Dario Faggioli
2013-04-09 2:49 ` [PATCH 8 of 8 [RFC]] tools/misc: introduce xen-mfndump Dario Faggioli
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1365689800.5135.24.camel@Solace \
--to=dario.faggioli@citrix.com \
--cc=Andrew.Cooper3@citrix.com \
--cc=George.Dunlap@eu.citrix.com \
--cc=Ian.Campbell@citrix.com \
--cc=JBeulich@suse.com \
--cc=andres@lagarcavilla.org \
--cc=dan.magenheimer@oracle.com \
--cc=dvrabel@cantab.net \
--cc=juergen.gross@ts.fujitsu.com \
--cc=keir.xen@gmail.com \
--cc=konrad.wilk@oracle.com \
--cc=olaf@aepfle.de \
--cc=roger.pau@citrix.com \
--cc=tim@xen.org \
--cc=xen-devel@lists.xen.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.