git.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Enrico Weigelt <weigelt@metux.de>
To: "git@vger.kernel.org" <git@vger.kernel.org>
Subject: Re: GIT as binary repository
Date: Thu, 21 Oct 2010 21:54:16 +0200	[thread overview]
Message-ID: <20101021195416.GF28700@nibiru.local> (raw)
In-Reply-To: <AANLkTim6qsUDf5LS7C9o+C92Aqh7CohLLJ=+13BE3Tze@mail.gmail.com>

* Tay Ray Chuan <rctay89@gmail.com> wrote:
> Hi,
> 
> On Thu, Oct 21, 2010 at 8:52 PM, Wilson, Kevin Lee (OpenView Engineer)
> <kevin.l.wilson@hp.com> wrote:
> > We are investigating the use of GIT as a binary repository solution. Our larger files are near 800MB and the total checked out repo size is about 3 GB the repo size in SVN is more like 20-30GB, if we could prune the history prior to MR, we could get these sizes down considerably. This binary repo is really for our super project build.  From what I have read and learned, this is not a good fit for the GIT tool. Have there been performance improvements lately? Some of the posts I have read have been quite old?
> 
> check this out:
> 
>   http://github.com/apenwarr/bup
> 
> It's a modified git system that's purpose-built for large files.
> That's just about all the sensible information I can share you with
> you.

Looks quite promising, perhaps it can help solving my current
backup problems.

Maybe we could implement some of the features, eg. the hashsplit
format (maybe it could even combined w/ xdelta ?) or the bupindex
and some extended metadata directly in git ?


BTW: how are the current tree objects structured ? Is there always
one big tree object representing the whole tree or can it be
splitted hierachically ?


cu
-- 
----------------------------------------------------------------------
 Enrico Weigelt, metux IT service -- http://www.metux.de/

 phone:  +49 36207 519931  email: weigelt@metux.de
 mobile: +49 151 27565287  icq:   210169427         skype: nekrad666
----------------------------------------------------------------------
 Embedded-Linux / Portierung / Opensource-QM / Verteilte Systeme
----------------------------------------------------------------------

  reply	other threads:[~2010-10-21 20:03 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2010-10-21 12:52 GIT as binary repository Wilson, Kevin Lee (OpenView Engineer)
2010-10-21 14:19 ` Tay Ray Chuan
2010-10-21 19:54   ` Enrico Weigelt [this message]
2010-10-21 21:23     ` Shawn Pearce
2010-10-22  5:02       ` Enrico Weigelt
2010-10-22 19:20         ` Shawn Pearce
2010-10-21 17:38 ` Shawn Pearce
2010-10-21 18:53   ` Wilson, Kevin Lee (OpenView Engineer)
2010-10-21 19:19 ` Enrico Weigelt

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20101021195416.GF28700@nibiru.local \
    --to=weigelt@metux.de \
    --cc=git@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).