* Re: How to share data between guest domains [not found] ` <2967.67.184.68.1.1142737228.squirrel@67.184.68.1> @ 2006-03-20 12:45 ` Molle Bestefich 2006-03-20 13:49 ` [Xen-users] " Yura Pismerov 0 siblings, 1 reply; 4+ messages in thread From: Molle Bestefich @ 2006-03-20 12:45 UTC (permalink / raw) To: Todd; +Cc: xen-devel, xen-users Todd D. Esposito wrote: > However, on that note, I wonder if you could mount the same file system, > say something like /usr, into multiple domU's READ ONLY. That works for me. What doesn't work is mounting that file/device READ/WRITE in one domU to update the filesystem. For that, I have to take down *all* domUs. Not good... (When I try I get a vbd: error saying "already in use".) (I know about caching and that I need eg. a cluster-aware filesystem to do this.) I've spent a couple of hours hunting through various Xen source files. There's a lot of Python functions that are only 3-5 lines long and which does little else than calling the next function, which makes it very hard to figure out what's going on :-/. Could one of you devel guys please let me know where I need to go to remove this silly limitation? :-) ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [Xen-users] How to share data between guest domains 2006-03-20 12:45 ` How to share data between guest domains Molle Bestefich @ 2006-03-20 13:49 ` Yura Pismerov 2006-03-20 17:24 ` Xin Zhao 0 siblings, 1 reply; 4+ messages in thread From: Yura Pismerov @ 2006-03-20 13:49 UTC (permalink / raw) To: xen-devel I found that using NFS for things like this makes much more sense. You can run the domU with NFS root (read-only) and map certain areas you need read/write to tmpfs by mounting them with "mount --bind" in Linux). For example, if I use NFS root and want my /etc be writable I can always write its content to a tmpfs mounted area and run "mount --bind /tmpfs/etc /etc". This also will solve problems with centralized package updates when not only /usr is being updated, but some other areas (eg. /etc, /var/lib). You want those areas be shared between domU's as well. Molle Bestefich wrote: >Todd D. Esposito wrote: > > >>However, on that note, I wonder if you could mount the same file system, >>say something like /usr, into multiple domU's READ ONLY. >> >> > >That works for me. > >What doesn't work is mounting that file/device READ/WRITE in one domU >to update the filesystem. For that, I have to take down *all* domUs. >Not good... > >(When I try I get a vbd: error saying "already in use".) > >(I know about caching and that I need eg. a cluster-aware filesystem >to do this.) > >I've spent a couple of hours hunting through various Xen source files. > There's a lot of Python functions that are only 3-5 lines long and >which does little else than calling the next function, which makes it >very hard to figure out what's going on :-/. > >Could one of you devel guys please let me know where I need to go to >remove this silly limitation? :-) > >_______________________________________________ >Xen-users mailing list >Xen-users@lists.xensource.com >http://lists.xensource.com/xen-users > > -- Yuri Pismerov, System Administrator Armor Technologies (Canada) Inc. P: 905 305 1946 (x.3519) http://www.armorware.net Privacy Protection Guaranteed! ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Re: [Xen-users] How to share data between guest domains 2006-03-20 13:49 ` [Xen-users] " Yura Pismerov @ 2006-03-20 17:24 ` Xin Zhao 2006-03-21 13:06 ` Yura Pismerov 0 siblings, 1 reply; 4+ messages in thread From: Xin Zhao @ 2006-03-20 17:24 UTC (permalink / raw) To: Yura Pismerov; +Cc: xen-devel NFS combined with your solution is definitely a temporary solution. But our ongoing project "Virtual Librarian" should provide better support. VL is designed to allow mutliple VMs to share a base software environment. If a VM needs to modify a shared file, VL can do copy-on-write to create a private copy for this VM. All modifications are therefore visible only to this VM In addition, if multiple private copies are identical, VL can merge them back to a shared copy. The benefits of VL inlcude: 1. A VM can take advantage of the global disk cache and benefit from previous data accesses from other VMs. We will expect better performance. 2. VL allows finer granularity of sharing, instead of directory level sharing. 3. The shared file system is transparent to guest applications and should be easily adopted. 4. VL allows centralized software updates. These updates can take effect right after the files are updated. We will put a detailed description of VL soon, if someone is interested in that. :) Xin Yura Pismerov wrote: > I found that using NFS for things like this makes much more sense. > You can run the domU with NFS root (read-only) and map certain areas you > need read/write > to tmpfs by mounting them with "mount --bind" in Linux). For example, if > I use NFS root and want my /etc > be writable I can always write its content to a tmpfs mounted area and > run "mount --bind /tmpfs/etc /etc". > This also will solve problems with centralized package updates when not > only /usr is being updated, but some other areas (eg. /etc, /var/lib). > You want those areas be shared between domU's as well. > > > Molle Bestefich wrote: > > >> Todd D. Esposito wrote: >> >> >> >>> However, on that note, I wonder if you could mount the same file system, >>> say something like /usr, into multiple domU's READ ONLY. >>> >>> >>> >> That works for me. >> >> What doesn't work is mounting that file/device READ/WRITE in one domU >> to update the filesystem. For that, I have to take down *all* domUs. >> Not good... >> >> (When I try I get a vbd: error saying "already in use".) >> >> (I know about caching and that I need eg. a cluster-aware filesystem >> to do this.) >> >> I've spent a couple of hours hunting through various Xen source files. >> There's a lot of Python functions that are only 3-5 lines long and >> which does little else than calling the next function, which makes it >> very hard to figure out what's going on :-/. >> >> Could one of you devel guys please let me know where I need to go to >> remove this silly limitation? :-) >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xensource.com >> http://lists.xensource.com/xen-users >> >> >> > > > ^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Re: [Xen-users] How to share data between guest domains 2006-03-20 17:24 ` Xin Zhao @ 2006-03-21 13:06 ` Yura Pismerov 0 siblings, 0 replies; 4+ messages in thread From: Yura Pismerov @ 2006-03-21 13:06 UTC (permalink / raw) To: Xin Zhao; +Cc: xen-devel Looks interesting. There is also LVM persistent snapshots that allow doing something similar to what you described. We did not want to use LVM due to complexity it would bring in our setup. IMHO, in setups with hundreds and thousands VMs using NFS with a few powerful NAS boxes makes much more sense. So, ideally, NFS copy-on-write is what we are looking for. I know there is an alpha release of it out there, but the problem is we need it now, not a few years from now when it reaches production quality. Xin Zhao wrote: > NFS combined with your solution is definitely a temporary solution. > But our ongoing project "Virtual Librarian" should > provide better support. VL is designed to allow mutliple VMs to share > a base software environment. If a VM needs to modify a shared file, > VL can do copy-on-write to create a private copy for this VM. All > modifications are therefore visible only to > this VM In addition, if multiple private copies are identical, VL can > merge them back to a shared copy. > > The benefits of VL inlcude: > 1. A VM can take advantage of the global disk cache and benefit from > previous data accesses from other VMs. We will expect better performance. > 2. VL allows finer granularity of sharing, instead of directory level > sharing. > 3. The shared file system is transparent to guest applications and > should be easily adopted. > 4. VL allows centralized software updates. These updates can take > effect right after the files are updated. > > We will put a detailed description of VL soon, if someone is > interested in that. :) > > Xin > > Yura Pismerov wrote: >> I found that using NFS for things like this makes much more sense. >> You can run the domU with NFS root (read-only) and map certain areas you >> need read/write >> to tmpfs by mounting them with "mount --bind" in Linux). For example, if >> I use NFS root and want my /etc >> be writable I can always write its content to a tmpfs mounted area and >> run "mount --bind /tmpfs/etc /etc". >> This also will solve problems with centralized package updates when not >> only /usr is being updated, but some other areas (eg. /etc, /var/lib). >> You want those areas be shared between domU's as well. >> >> >> Molle Bestefich wrote: >> >> >>> Todd D. Esposito wrote: >>> >>> >>> >>>> However, on that note, I wonder if you could mount the same file >>>> system, >>>> say something like /usr, into multiple domU's READ ONLY. >>>> >>>> >>> That works for me. >>> >>> What doesn't work is mounting that file/device READ/WRITE in one domU >>> to update the filesystem. For that, I have to take down *all* >>> domUs. Not good... >>> >>> (When I try I get a vbd: error saying "already in use".) >>> >>> (I know about caching and that I need eg. a cluster-aware filesystem >>> to do this.) >>> >>> I've spent a couple of hours hunting through various Xen source files. >>> There's a lot of Python functions that are only 3-5 lines long and >>> which does little else than calling the next function, which makes it >>> very hard to figure out what's going on :-/. >>> >>> Could one of you devel guys please let me know where I need to go to >>> remove this silly limitation? :-) >>> >>> _______________________________________________ >>> Xen-users mailing list >>> Xen-users@lists.xensource.com >>> http://lists.xensource.com/xen-users >>> >>> >>> >> >> >> > -- Yuri Pismerov, System Administrator Armor Technologies (Canada) Inc. P: 905 305 1946 (x.3519) http://www.armorware.net Privacy Protection Guaranteed! ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2006-03-21 13:06 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
[not found] <1142710436.15319.1.camel@localhost>
[not found] ` <441C7352.7030401@hcsd.de>
[not found] ` <441CB16E.6090901@freemail.hu>
[not found] ` <200603182119.31607.javier@guerrag.com>
[not found] ` <2967.67.184.68.1.1142737228.squirrel@67.184.68.1>
2006-03-20 12:45 ` How to share data between guest domains Molle Bestefich
2006-03-20 13:49 ` [Xen-users] " Yura Pismerov
2006-03-20 17:24 ` Xin Zhao
2006-03-21 13:06 ` Yura Pismerov
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.