git.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Pierre Ossman <ossman@cendio.se>
To: Patrick Steinhardt <ps@pks.im>
Cc: Han Young <hanyang.tony@bytedance.com>, git@vger.kernel.org
Subject: Re: [External] git keeps recreating packs, exploding backup increments
Date: Mon, 24 Feb 2025 10:10:23 +0100	[thread overview]
Message-ID: <b0b1007c-34a6-4e3f-9982-cfe617affe1a@cendio.se> (raw)
In-Reply-To: <Z7g2aEpEboL5mvRa@pks.im>

On 21/02/2025 09:16, Patrick Steinhardt wrote:
>>
>> Anything I/we can do to shed more light on the issue?
> 
> Well, one of the interesting things to learn would be how often you end
> up updating those repositories. You have discovered "gc.autoPackLimit"
> already, which determines when exactly Git is going to repack existing
> packfiles into one, and mentioned that it doesn't seem to help you. But
> whether it does or doesn't help really depends on how frequently you
> gain new packfiles in the impacted repositories.
> 
> When you have fast-moving repositories and developers fetch several
> times per day, then it is quite likely that they accumulate multiple new
> packfiles per day. And thus, it's not all that unexpected that you will
> have to repack the whole repository rather regularly. If so, this is
> working as designed. You can tune the parameters for how often Git will
> do an all-into-one repack, but also have to keep in mind that the more
> packfiles there are, the less efficient Git will in general be.
> 

I don't think the most problematic repo should be moving that fast. But 
I might be wrong. We've reverted all settings to default, and we'll try 
to keep an eye on what happens to the pack files to gain more understanding.

> That being said, there is an alternative: Git nowadays doesn't use
> git-gc(1) anymore to perform auto-maintenance, but instead it invokes
> git-maintenance(1). And that command allows the user to pick what tasks
> should be performed. By default it uses git-gc(1) under the hood indeed,
> but you also ask it to not do so and instead use an alternative
> mechanism to pack your objects.
> 

Thanks. This is definitely something we can try. We'll observe the 
system for now, to establish a new baseline. Then we'll try some of 
these settings and see how it affect things.

Regards,
-- 
Pierre Ossman           Software Development
Cendio AB               https://cendio.com
Teknikringen 8          https://twitter.com/ThinLinc
583 30 Linköping        https://facebook.com/ThinLinc
Phone: +46-13-214600

A: Because it messes up the order in which people normally read text.
Q: Why is top-posting such a bad thing?

  reply	other threads:[~2025-02-24  9:10 UTC|newest]

Thread overview: 7+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-02-19  9:38 git keeps recreating packs, exploding backup increments Pierre Ossman
2025-02-20  3:03 ` [External] " Han Young
2025-02-20  8:26   ` Pierre Ossman
2025-02-21  8:16     ` Patrick Steinhardt
2025-02-24  9:10       ` Pierre Ossman [this message]
2025-05-09 10:27         ` Pierre Ossman
  -- strict thread matches above, loose matches on Subject: below --
2025-05-11 18:03 OryAkerbay

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=b0b1007c-34a6-4e3f-9982-cfe617affe1a@cendio.se \
    --to=ossman@cendio.se \
    --cc=git@vger.kernel.org \
    --cc=hanyang.tony@bytedance.com \
    --cc=ps@pks.im \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).