git.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Qingning Huo <qingninghuo@gmail.com>
To: git@vger.kernel.org
Subject: out of memory error with git push and pull
Date: Wed, 1 Jun 2011 23:33:33 +0100	[thread overview]
Message-ID: <BANLkTin3-XnVsVd1-CAiWDBzQG6m=a4Rvw@mail.gmail.com> (raw)

Hi All,

I tried to use git to manage my digital photos but encountered some
problems. The typical file sizes are hundreds of KB or a few MB. In
total, about 15GB data in about 10,000 files. My intention is to get
them into a git repository and cloned into a few computers. Probably I
will make some occasionally changes like editing and deleting. But I
think most of the files would stay at version one.

The setup I used is a centralized repository for pulling from and
pushing into. There is a gitweb interface for the centralised repo.

I started by creating a small repository on the server (ubuntu), and
keeps pushing data into it from a windows machine (using cygwin). Half
way through the process, (after pushed about 8GB of data), I found
that I cannot run git push any more. This is the error message I got:

$ git push
Counting objects: 621, done.
Delta compression using up to 4 threads.
fatal: Out of memory? mmap failed: Cannot allocate memory
error: pack-objects died with strange error
error: failed to push some refs to 'ssh://huo@ubuntu/mnt/share/git/photo.git'

At the same time, I found that I cannot pull from this repository either.

$ git pull
remote: Counting objects: 8088, done.
error: pack-objects died of signal 983/8057)
error: git upload-pack: git-pack-objects died with error.
fatal: git upload-pack: aborting due to possible repository corruption
on the remote side.
remote: aborting due to possible repository corruption on the remote side.
fatal: protocol error: bad pack header

[The second line is probably "died of signal 9", because it was
counting ???/8057 upwards before the crash.]

I wonder whether anyone has tried using git in a similar scenario. Is
git capable of handling this kind of data? And, are there any settings
and/or command line options that I should use? I had a quick look of
git help push (and pull/fetch) but cannot see anything obvious.

BTW, I am using git version 1.7.0.4 on the ubuntu server, and version
1.7.2.3 for cygwin on the client side.

Thanks in advance.

Qingning

             reply	other threads:[~2011-06-01 22:33 UTC|newest]

Thread overview: 3+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-06-01 22:33 Qingning Huo [this message]
2011-06-02  4:46 ` out of memory error with git push and pull Joey Hess
2011-06-02 22:13   ` Qingning Huo

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='BANLkTin3-XnVsVd1-CAiWDBzQG6m=a4Rvw@mail.gmail.com' \
    --to=qingninghuo@gmail.com \
    --cc=git@vger.kernel.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).