From: Piotr Krukowiecki <piotr.krukowiecki@gmail.com>
To: Jeff King <peff@peff.net>
Cc: Junio C Hamano <gitster@pobox.com>,
Shawn Pearce <spearce@spearce.org>,
Git Mailing List <git@vger.kernel.org>,
Ingo Molnar <mingo@elte.hu>
Subject: Re: pack-object poor performance (with large number of objects?)
Date: Tue, 4 Oct 2011 15:21:24 +0200 [thread overview]
Message-ID: <CAA01Csp2rouKk4jvCH0Wu+0gc3+cvyH__d-yw8EHEkeZhRpX1Q@mail.gmail.com> (raw)
In-Reply-To: <20111004124502.GB30162@sigill.intra.peff.net>
On Tue, Oct 4, 2011 at 2:45 PM, Jeff King <peff@peff.net> wrote:
> On Tue, Oct 04, 2011 at 02:22:55PM +0200, Piotr Krukowiecki wrote:
>
>> > So my guess is that it is simply taking an enormous amount of disk
>> > space, and git is mostly waiting on the disk to read in files. What does
>> > "du -sh .git/objects" say?
>>
>> It isn't that big - it's 11G.
>> .git/objects/pack/ is 666MB currently.
>
> But you have 4G of RAM, no? So depending on the access patterns, you are
> thrashing your disk cache and always pulling each object straight from
> disk.
I have 4GB ram + 4GB swap. Is it possible the RAM is the problem if I
always have free RAM left and my swap is almost not used?
For example at the moment repack finished counting objects ("Counting
objects: 1742200, done."):
$ free -m
total used free shared buffers cached
Mem: 3960 3814 146 0 441 215
-/+ buffers/cache: 3157 803
Swap: 6143 694 5449
$ ps auxwwww | grep git
pkruk 13541 0.0 0.0 15704 716 pts/2 S+ 13:19 0:00 git
repack -a -d -f
pkruk 13542 0.0 0.0 4220 540 pts/2 S+ 13:19 0:00
/bin/sh /usr/local/stow/git-master/libexec/git-core/git-repack -a -d
-f
pkruk 13556 3.9 9.8 1143628 401232 pts/2 DN+ 13:19 4:25 git
pack-objects --keep-true-parents --honor-pack-keep --non-empty --all
--reflog --no-reuse-delta --delta-base-offset
/home/pkruk/dv/devel1_git_repos/.git/objects/pack/.tmp-13542-pack
I have updated to 1.7.7 btw.
--
Piotr Krukowiecki
next prev parent reply other threads:[~2011-10-04 13:21 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2011-10-03 14:43 pack-object poor performance (with large number of objects?) Piotr Krukowiecki
2011-10-03 16:05 ` Shawn Pearce
2011-10-03 17:17 ` Piotr Krukowiecki
2011-10-03 19:34 ` Junio C Hamano
2011-10-04 7:59 ` Piotr Krukowiecki
2011-10-04 11:07 ` Jeff King
2011-10-04 12:22 ` Piotr Krukowiecki
2011-10-04 12:45 ` Jeff King
2011-10-04 13:21 ` Piotr Krukowiecki [this message]
2011-10-04 18:08 ` Jeff King
2011-10-05 8:48 ` Piotr Krukowiecki
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=CAA01Csp2rouKk4jvCH0Wu+0gc3+cvyH__d-yw8EHEkeZhRpX1Q@mail.gmail.com \
--to=piotr.krukowiecki@gmail.com \
--cc=git@vger.kernel.org \
--cc=gitster@pobox.com \
--cc=mingo@elte.hu \
--cc=peff@peff.net \
--cc=spearce@spearce.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).