From: Ingo Molnar <mingo@elte.hu>
To: "Shawn O. Pearce" <spearce@spearce.org>
Cc: git@vger.kernel.org
Subject: Re: q: git-fetch a tad slow?
Date: Wed, 30 Jul 2008 21:06:57 +0200 [thread overview]
Message-ID: <20080730190657.GC26389@elte.hu> (raw)
In-Reply-To: <20080730044855.GA7225@spearce.org>
* Shawn O. Pearce <spearce@spearce.org> wrote:
> > should i pack on both repos? I dont explicitly pack anything, but on
> > the server it goes into regular gc runs. (which will pack most
> > stuff, right?)
>
> git-gc automatically runs `git pack-refs --all --prune` like I
> recommended, unless you disabled it with config gc.packrefs = false.
> So its probably already packed.
>
> What does `find .git/refs -type f | wc -l` give for the repository on
> the central server? If its more than a handful (~20) I would suggest
> running git-gc before testing again.
ah, you are right, it gave 275, then git-gc brought it down to two:
earth4:~/tip> find .git/refs -type f | wc -l
275
earth4:~/tip> git gc
earth4:~/tip> find .git/refs -type f | wc -l
2
i turned off auto-gc recently (two weeks ago) because it was
auto-triggering _way_ too frequently. (like on every fifth merge i was
doing or so)
alas, fetching still seems to be slow:
titan:~/tip> time git-fetch origin
real 0m5.112s
user 0m0.972s
sys 0m3.380s
(but the gc run has not finished yet on the central repo so this isnt
fully valid.)
> But I'm really suspecting that this is just our quadratic matching
> algorithm running up against a large number of branches, causing it to
> suck.
>
> jgit at least uses an O(N) algorithm here, but since it is written in
> Java its of course slow compared to C Git. Takes a while to get that
> JVM running.
>
> I'll try to find some time to reproduce the issue and look at the
> bottleneck here. I'm two days into a new job so my git time has been
> really quite short this week. :-|
fetching the -tip repo:
http://people.redhat.com/mingo/tip.git/README
and then running 'git remote update' will i think already show this
problem for you too. People have been complaining about how slow the
update is.
Ingo
next prev parent reply other threads:[~2008-07-30 19:08 UTC|newest]
Thread overview: 10+ messages / expand[flat|nested] mbox.gz Atom feed top
2008-07-28 16:01 q: git-fetch a tad slow? Ingo Molnar
2008-07-29 5:50 ` Shawn O. Pearce
2008-07-29 9:08 ` Ingo Molnar
2008-07-30 4:48 ` Shawn O. Pearce
2008-07-30 19:06 ` Ingo Molnar [this message]
2008-07-30 22:38 ` Shawn O. Pearce
2008-07-31 4:45 ` Shawn O. Pearce
2008-07-31 21:03 ` Ingo Molnar
2008-07-31 21:11 ` Ingo Molnar
2008-07-31 21:19 ` Shawn O. Pearce
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20080730190657.GC26389@elte.hu \
--to=mingo@elte.hu \
--cc=git@vger.kernel.org \
--cc=spearce@spearce.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).