From: Pierre Ossman <ossman@cendio.se>
To: Patrick Steinhardt <ps@pks.im>
Cc: Han Young <hanyang.tony@bytedance.com>, git@vger.kernel.org
Subject: Re: [External] git keeps recreating packs, exploding backup increments
Date: Mon, 24 Feb 2025 10:10:23 +0100 [thread overview]
Message-ID: <b0b1007c-34a6-4e3f-9982-cfe617affe1a@cendio.se> (raw)
In-Reply-To: <Z7g2aEpEboL5mvRa@pks.im>
On 21/02/2025 09:16, Patrick Steinhardt wrote:
>>
>> Anything I/we can do to shed more light on the issue?
>
> Well, one of the interesting things to learn would be how often you end
> up updating those repositories. You have discovered "gc.autoPackLimit"
> already, which determines when exactly Git is going to repack existing
> packfiles into one, and mentioned that it doesn't seem to help you. But
> whether it does or doesn't help really depends on how frequently you
> gain new packfiles in the impacted repositories.
>
> When you have fast-moving repositories and developers fetch several
> times per day, then it is quite likely that they accumulate multiple new
> packfiles per day. And thus, it's not all that unexpected that you will
> have to repack the whole repository rather regularly. If so, this is
> working as designed. You can tune the parameters for how often Git will
> do an all-into-one repack, but also have to keep in mind that the more
> packfiles there are, the less efficient Git will in general be.
>
I don't think the most problematic repo should be moving that fast. But
I might be wrong. We've reverted all settings to default, and we'll try
to keep an eye on what happens to the pack files to gain more understanding.
> That being said, there is an alternative: Git nowadays doesn't use
> git-gc(1) anymore to perform auto-maintenance, but instead it invokes
> git-maintenance(1). And that command allows the user to pick what tasks
> should be performed. By default it uses git-gc(1) under the hood indeed,
> but you also ask it to not do so and instead use an alternative
> mechanism to pack your objects.
>
Thanks. This is definitely something we can try. We'll observe the
system for now, to establish a new baseline. Then we'll try some of
these settings and see how it affect things.
Regards,
--
Pierre Ossman Software Development
Cendio AB https://cendio.com
Teknikringen 8 https://twitter.com/ThinLinc
583 30 Linköping https://facebook.com/ThinLinc
Phone: +46-13-214600
A: Because it messes up the order in which people normally read text.
Q: Why is top-posting such a bad thing?
next prev parent reply other threads:[~2025-02-24 9:10 UTC|newest]
Thread overview: 7+ messages / expand[flat|nested] mbox.gz Atom feed top
2025-02-19 9:38 git keeps recreating packs, exploding backup increments Pierre Ossman
2025-02-20 3:03 ` [External] " Han Young
2025-02-20 8:26 ` Pierre Ossman
2025-02-21 8:16 ` Patrick Steinhardt
2025-02-24 9:10 ` Pierre Ossman [this message]
2025-05-09 10:27 ` Pierre Ossman
-- strict thread matches above, loose matches on Subject: below --
2025-05-11 18:03 OryAkerbay
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=b0b1007c-34a6-4e3f-9982-cfe617affe1a@cendio.se \
--to=ossman@cendio.se \
--cc=git@vger.kernel.org \
--cc=hanyang.tony@bytedance.com \
--cc=ps@pks.im \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).