All of lore.kernel.org
 help / color / mirror / Atom feed
From: David Masover <ninja@slaphack.com>
To: Chris Mason <mason@suse.com>
Cc: reiserfs-list@namesys.com,
	Pierre Etchemaite <petchema@concept-micro.com>
Subject: Re: reiserfs3, rsync and hardlinks
Date: Mon, 07 Feb 2005 23:53:17 -0600	[thread overview]
Message-ID: <420853CD.80804@slaphack.com> (raw)
In-Reply-To: <200502071632.59292.mason@suse.com>

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Chris Mason wrote:
| On Monday 07 February 2005 15:50, Pierre Etchemaite wrote:
|
|>Le lun 07 fév 2005 13:22:51 CET, Vladimir Saveliev <vs@namesys.com> a
écrit
|>
|>
|>>Hello
|>
|>	Hi,
|>
|>
|>>yes, reiserfs reuses inode number of removed files for newly created
|>>files. However, ext2 also does that. Have  you ever noticed this problem
|>>on other filesystems?
|>
|>No, but I'm only using rsync -H for a few weeks. The problem may also
exist
|>with tar, but unnoticed (unless tar detects hardlinks in a different way,
|>or does more checks, like checking the consistency with references
|>counters, whatever, to avoid it). rsync handles hardlinks in a final pass,
|>so as soon as the verbosity level is raised, problems are easy to detect.
|>
|>I have only one server left that uses ext2. It's also saved with rsync, no
|>problem seen so far (a few weeks only, as I said).
|>But the filesystem used isn't the only difference. Usage pattern probably
|>matters a lot. On the system where it happens, hardlinked files are often
|>Maildir files (unsurprizingly) and mrtg log files (which are rotated every
|>5 minutes). inodes are probably freed by mrtg, and one reused for a new
|>email.
|>
|
| If you've got files being deleted in the middle of the backup,  then
it is
| extremely difficult for rsync (or any tool) to get the hard link
detection
| correct.  You've got a few choices:
|
| 1) put everything on lvm and backup snapshots instead of the live
filesystem.
| This has a number of benefits.

Isn't snapshot support planned for reiser4?  It would be saner than
lvm/device-mapper -- no dedicated partition needed...

| 2) link everyfile into some temp directory before the backup starts.
This
| will prevent that particular inode number from being reused during the
| backup, but won't help if new files are added during the rsync (since
those
| new files could also be deleted).

Is this just backup?  You could use (or writing) a backup utility which
indexes by a hash of each file.  Wouldn't be that much slower, and would
avoid any issues with hardlink detection.

Don't know of any existing utility that does that.  I think BackupPC was
close (backuppc.sf.net)

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.2.6 (GNU/Linux)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org

iQIVAwUBQghTzXgHNmZLgCUhAQIy5xAAiT/ip19yy169PLqDJhMB1vtI1bEWiZsl
CWvljdxP4keoaWd32pXzZ1PJ1c3GoCb6W3TgxwlLgW+dvx87cvCQDK3pTFIpqOnL
0EGBwEkYVDEpmBdbkizuL744LSP+eubHFRfzJa5VFuZMROGIU2M5GbXlNM1uTimG
3q9rZSTmJL1pdAJqqZjNX0SRmg7z26KFKQL/E1Sm7E/VUAKrZSubqxEif4wG7JZ4
llNEitQlW61CG2nX8qgtta8ufrmmiAm37Vt6G7+fRyrKLbCIgsOuPOr//XL3j8aR
Qg4KrlWgjH/Fu/CR+TB+PSKeSBFbh47gvHChY3eqZaBg7UJ/ftPfZ/hz/m4S6MXK
Ic/Ww91cF/t6vMiErlj2GObggEgzRMq4ayitwxz19PucmSbv1gwVgmzVBX9uRvuZ
r/qE2r38qhzveiik3Y/MO8I5/R8H4FaF7JIhxNcujYqyqx6H4l4qfVksOG4Ox3OH
/sh3h7Ev+266w9WVbshD+gmFThvzDAKvjcntDFXLXDXMFGMKkrwbNVONczNPDkm3
G+ZiPjWyuKCaiGVbRPdvdQ4Jlpw4559E4APiHD7I4mhmdmmUVJSUbiTpVCQUA2gQ
F3dtiLTp4zshvG8yRqHS/CtWPMQHGo9TbjIKv4ynSOwXuAETiCtze7w9tZwZgV5W
UFAQ8tBHS24=
=ogtF
-----END PGP SIGNATURE-----

  reply	other threads:[~2005-02-08  5:53 UTC|newest]

Thread overview: 15+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2005-02-06  2:41 reiserfs3, rsync and hardlinks Pierre Etchemaite
2005-02-06 19:18 ` David Masover
2005-02-06 21:55   ` Pierre Etchemaite
2005-02-07  5:33     ` David Masover
2005-02-08  9:42       ` mjt
2005-02-08 22:24         ` Hans Reiser
2005-02-07 10:22 ` Vladimir Saveliev
2005-02-07 20:50   ` Pierre Etchemaite
2005-02-07 21:32     ` Chris Mason
2005-02-08  5:53       ` David Masover [this message]
2005-02-08 22:14       ` Hans Reiser
2005-02-09  8:28         ` Pierre Etchemaite
2005-02-08 11:16     ` Vladimir Saveliev
2005-02-09  8:22       ` Pierre Etchemaite
2005-02-07 19:26 ` Hans Reiser

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=420853CD.80804@slaphack.com \
    --to=ninja@slaphack.com \
    --cc=mason@suse.com \
    --cc=petchema@concept-micro.com \
    --cc=reiserfs-list@namesys.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.