All of lore.kernel.org
 help / color / mirror / Atom feed
From: "K. Richard Pixley" <rich@noir.com>
To: Fred van Zwieten <fvzwieten@gmail.com>
Cc: linux-btrfs@vger.kernel.org
Subject: Re: remote mirroring in the works?
Date: Mon, 30 Aug 2010 15:56:14 -0700	[thread overview]
Message-ID: <4C7C370E.1080901@noir.com> (raw)
In-Reply-To: <AANLkTimWJoYVf2nqoi7KkOKSFz2F7wp0gcV=XKvo5uzj@mail.gmail.com>

  If you can put the db into a consistent state, then rsync will do 
this.  Rsync does changed block transfers.

--rich

On 8/30/10 14:15 , Fred van Zwieten wrote:
> I just glanced over the DRBD/LVM combi, but I don't see it being
> functionally equal to SnapMirror. Let me (try to) explain how
> snapmirror works:
>
> On system A there is a volume (vol1). We let this vol1(A) replicate
> thru SnapMirror to vol1(B). This is done by creating a snap vol1sx(A)
> and replicate all changed blocks between this snapshot (x) and the
> previous snapshot (x-1). The first time, there is no x-1 and the whole
> volume will be replicated, but after this initial "full copy", only
> the changed blocks between the two snapshot's are being replicated to
> system B. This is also called snap based replication. Why we want
> this? Easy. To support consistent DB snap's. The proces works by first
> putting the DB in a consistent mode (depends on DB implementation),
> create a snapshot, let the DB continue, replicate the changes. This
> way a DB consistent state will be replicated. The cool thing about the
> NetApp implementation is that on system B the snap's (x, x-1, x-2,
> etc) are also available. When there is trouble, you can choose to
> online the DB on system B on any of the snap's, or, even cooler, to
> replicate one of those snap's back to system A, doing a block based
> rollback at the filesystem level.
>
> Fred
>
> On Mon, Aug 30, 2010 at 7:55 PM, K. Richard Pixley<rich@noir.com>  wrote:
>>   On 20100830 10:07, Fred van Zwieten wrote:
>>> Hi there,
>>>
>>> I would like to know if there is something functionally equivalent to
>>> NetApp's SnapMirror in the works or planning? It would require block
>>> level access to a snap and the ability to rebuild (subvolumes
>>> including it's) snap's on another machine.
>>>
>>> If not, what would be the best way to build something more or less
>>> equivalent using existing tools? rsync-ing a snap seems the same, but
>>> it isn't. First of all it 's file based, not very nice for DB's, and
>>> you don't get the snap's on "the other side" the same.
>>>
>>> Fred
>> I think drbd does precisely what you want.
>>
>> It's not useful for fault tolerance, nor for load balancing, but it will
>> produce a remote block copy that can be used as a sort of "hot backup".
>>
>> You can also do something very similar by combining LVM, (the logical volume
>> manager), with LVM snapshots and NBD, (the network block device) by
>> mirroring to an NBD device.
>>
>> Neither of these approaches can tolerate the remote file system being "live"
>> until and unless it takes over for the primary.  But either can maintain a
>> dynamic remote block device.
>>
>> --rich
>>

  parent reply	other threads:[~2010-08-30 22:56 UTC|newest]

Thread overview: 16+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <AANLkTinmSdHwXXq3s64sM39GjacafgwgTjPadZGHuway@mail.gmail.com>
2010-08-30 17:07 ` remote mirroring in the works? Fred van Zwieten
2010-08-30 17:21   ` Bryan Whitehead
2010-08-30 17:33   ` Roy Sigurd Karlsbakk
2010-08-30 17:55   ` K. Richard Pixley
2010-08-30 17:59     ` Roy Sigurd Karlsbakk
2010-08-30 18:14       ` K. Richard Pixley
2010-08-31  6:30         ` Simon Kirby
2010-08-31 18:44           ` Fred van Zwieten
2010-09-06 21:50         ` David Nicol
2010-09-07  0:04           ` K. Richard Pixley
2010-08-30 21:15     ` Fred van Zwieten
2010-08-30 21:23       ` Freddie Cash
2010-08-30 22:56       ` K. Richard Pixley [this message]
2010-08-31  5:07         ` Fred van Zwieten
2010-08-31  6:38           ` Simon Kirby
2010-08-31 18:29             ` Goffredo Baroncelli

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=4C7C370E.1080901@noir.com \
    --to=rich@noir.com \
    --cc=fvzwieten@gmail.com \
    --cc=linux-btrfs@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.