linux-fsdevel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Nikolai Joukov <kolya@cs.sunysb.edu>
To: Ed Tomlinson <edt@aei.ca>
Cc: Bryan Henderson <hbryan@us.ibm.com>,
	linux-fsdevel@vger.kernel.org, linux-raid@vger.kernel.org
Subject: Re: [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems
Date: Sat, 16 Dec 2006 12:57:27 -0500 (EST)	[thread overview]
Message-ID: <Pine.GSO.4.53.0612161240380.24531@compserv1> (raw)
In-Reply-To: <200612160946.20535.edt@aei.ca>

> On Friday 15 December 2006 19:20, Bryan Henderson wrote:
> > >The idea behind the cloneset is that most of the blocks (or files)
> > >do not change in either source or target.  This being the case its only
> > necessary
> > >to update the changed elements.  This means updates are incremental. Once
> > >the system has figured out what it needs to update its usable and if you
> > access
> > >an element that should be updated you will see the correctly updated
> > version - even
> > >though backgound resyncing is still in progress.
> >
> > I still can't tell what you're describing.  With RAID1 as well, only
> > changed elements ever get updated.  I have two identical filesystems,
> > members of a RAIF set.  I change one file.  One file in each member
> > filesystem gets updated, and I again have two identical filesystems.
>
> A cloneset is only syncronized at the point in time that you tell it to resync.
> The source and target fs are useable independently.  When you resync the
> target is reset to be indentical to the source at the point in time of the sync.
> Its also immediatly useable - the sync and access to the source and target
> are coordinated so users of the target see the correct data, even if the sync
> is still running in background.
>
> This allows things likes:
> set oracle in backup mode
> resync cloneset (this takes about 2 mins for a 2TB cloneset)
> set oracle out of backup mode
> (resyncing is still happening in background but accessing the cloneset gives a
> consistant image)
> backup oracle using cloneset files
> or
> start an instance of oracle using cloneset files (handly for a ro copy or if the main instance
> needs certian types of service)
>
> The overhead of the resync is minimized since it only updates the delta.  When
> dealing with 2TB of data this is an important feature, reducing IO.  You can
> only ask for a resync if the bg process from a previous resync is finished.

Although, it is not possible with the current code, it should be possible
to do via failing the branches.  First, you fail the branch intended for
backups and it becomes a backup copy.  Later you can "unfail" the same
branch and fail the newer branch to start the on-line recovery.  If you
enable atime updates on these lower file systems incremental (delta)
updates should not be a problem.

So I guess that if there is a demand for this functionality it won't be a
problem to implement it and automate it.

Nikolai.
---------------------
Nikolai Joukov, Ph.D.
Filesystems and Storage Laboratory
Stony Brook University

  reply	other threads:[~2006-12-16 17:57 UTC|newest]

Thread overview: 32+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2006-12-13 17:47 [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems Nikolai Joukov
2006-12-13 19:02 ` Phillip Susi
2006-12-13 19:17   ` Nikolai Joukov
2006-12-13 19:32     ` Nikolai Joukov
2006-12-13 19:33 ` Jan Engelhardt
2006-12-13 19:57   ` Nikolai Joukov
2006-12-13 19:57 ` Al Boldi
2006-12-14 21:01   ` Nikolai Joukov
2006-12-14 21:30     ` Charles Manning
2006-12-15 16:48       ` Nikolai Joukov
2006-12-14 22:48     ` berk walker
2006-12-15  5:02     ` Al Boldi
2006-12-15 17:41       ` Nikolai Joukov
     [not found]         ` <200612161635.49502.a1426z@gawab.com>
2006-12-16 17:39           ` Nikolai Joukov
2006-12-19 17:50             ` stacked filesystem cache waste Bryan Henderson
     [not found]             ` <200612172059.07941.a1426z@gawab.com>
2006-12-23  3:21               ` [ANNOUNCE] RAIF: Redundant Array of Independent Filesystems Nikolai Joukov
2006-12-14 11:12 ` Al Boldi
2006-12-14 23:44   ` Nikolai Joukov
2006-12-15  5:03     ` Al Boldi
2006-12-15 18:47       ` Nikolai Joukov
2006-12-15 12:47 ` Ed Tomlinson
2006-12-15 20:11   ` Nikolai Joukov
2006-12-15 23:58     ` Ed Tomlinson
2006-12-16  0:20       ` Bryan Henderson
2006-12-16  1:20         ` Nikolai Joukov
2006-12-16 14:46         ` Ed Tomlinson
2006-12-16 17:57           ` Nikolai Joukov [this message]
2006-12-16  0:02 ` David Lang
2006-12-16  0:58   ` Nikolai Joukov
  -- strict thread matches above, loose matches on Subject: below --
2006-12-15  1:13 Nikolai Joukov
     [not found] <OF582D7197.D6F604B1-ON88257248.0069CC60-88257248.006AE165@us.ibm.com>
2006-12-25 15:13 ` Nikolai Joukov
2007-01-06  5:17 Chaitanya Patti

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=Pine.GSO.4.53.0612161240380.24531@compserv1 \
    --to=kolya@cs.sunysb.edu \
    --cc=edt@aei.ca \
    --cc=hbryan@us.ibm.com \
    --cc=linux-fsdevel@vger.kernel.org \
    --cc=linux-raid@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).