From: Qingning Huo <qingninghuo@gmail.com>
To: git@vger.kernel.org
Subject: out of memory error with git push and pull
Date: Wed, 1 Jun 2011 23:33:33 +0100 [thread overview]
Message-ID: <BANLkTin3-XnVsVd1-CAiWDBzQG6m=a4Rvw@mail.gmail.com> (raw)
Hi All,
I tried to use git to manage my digital photos but encountered some
problems. The typical file sizes are hundreds of KB or a few MB. In
total, about 15GB data in about 10,000 files. My intention is to get
them into a git repository and cloned into a few computers. Probably I
will make some occasionally changes like editing and deleting. But I
think most of the files would stay at version one.
The setup I used is a centralized repository for pulling from and
pushing into. There is a gitweb interface for the centralised repo.
I started by creating a small repository on the server (ubuntu), and
keeps pushing data into it from a windows machine (using cygwin). Half
way through the process, (after pushed about 8GB of data), I found
that I cannot run git push any more. This is the error message I got:
$ git push
Counting objects: 621, done.
Delta compression using up to 4 threads.
fatal: Out of memory? mmap failed: Cannot allocate memory
error: pack-objects died with strange error
error: failed to push some refs to 'ssh://huo@ubuntu/mnt/share/git/photo.git'
At the same time, I found that I cannot pull from this repository either.
$ git pull
remote: Counting objects: 8088, done.
error: pack-objects died of signal 983/8057)
error: git upload-pack: git-pack-objects died with error.
fatal: git upload-pack: aborting due to possible repository corruption
on the remote side.
remote: aborting due to possible repository corruption on the remote side.
fatal: protocol error: bad pack header
[The second line is probably "died of signal 9", because it was
counting ???/8057 upwards before the crash.]
I wonder whether anyone has tried using git in a similar scenario. Is
git capable of handling this kind of data? And, are there any settings
and/or command line options that I should use? I had a quick look of
git help push (and pull/fetch) but cannot see anything obvious.
BTW, I am using git version 1.7.0.4 on the ubuntu server, and version
1.7.2.3 for cygwin on the client side.
Thanks in advance.
Qingning
next reply other threads:[~2011-06-01 22:33 UTC|newest]
Thread overview: 3+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-06-01 22:33 Qingning Huo [this message]
2011-06-02 4:46 ` out of memory error with git push and pull Joey Hess
2011-06-02 22:13 ` Qingning Huo
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to='BANLkTin3-XnVsVd1-CAiWDBzQG6m=a4Rvw@mail.gmail.com' \
--to=qingninghuo@gmail.com \
--cc=git@vger.kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).