All of lore.kernel.org
 help / color / mirror / Atom feed
From: Derrick Stolee <stolee@gmail.com>
To: Taylor Blau <me@ttaylorr.com>
Cc: git@vger.kernel.org, Junio C Hamano <gitster@pobox.com>,
	Jeff King <peff@peff.net>, Elijah Newren <newren@gmail.com>
Subject: Re: [PATCH v2 2/4] pack-objects: support reachability bitmaps with `--path-walk`
Date: Fri, 19 Jun 2026 11:33:47 -0400	[thread overview]
Message-ID: <7afdaf77-07f5-4d48-955d-e153d148f647@gmail.com> (raw)
In-Reply-To: <ajVXlcHgIF2XkmMQ@nand.local>

On 6/19/2026 10:52 AM, Taylor Blau wrote:
> On Fri, Jun 19, 2026 at 10:40:51AM -0400, Derrick Stolee wrote:
>>> [...]
>>> , which gives us:
>>>
>>>     Test                                            HEAD^             HEAD
>>>     ----------------------------------------------------------------------------------------
>>>     5311.3: size of bitmapped pack                           278.8M            278.8M -0.0%
>>>     5311.38: size of bitmapped pack (--path-walk)            278.7M            278.7M +0.0%
>>>
>>> (eliding other tests). I considered whether there are other interesting
>>> tests, but I think "repack" is the right layer to run perf tests, since
>>> you're always writing a closed pack. We could try different subsets of
>>> the repository's objects (which would also have to be closed), but I
>>> don't think this is that interesting.
>>
>> This sort of thing does help to show that we're getting different
>> behavior when repacking with and without --path-walk. And this test
>> is showing the slightest change for git.git, but is likely more
>> impactful for the other repos I've used to demonstrate the benefits.
>>
>> So this is the kind of data I'm hoping to see, but also with data
>> from other repos whose data shapes benefit from --path-walk more
>> than git.git and repos where name-hash v1 is sufficient to give a
>> similar result.
> 
> I'm glad this is the sort of data you're looking for. I'm happy to run
> this on other repositories.
> 
>> I'd also like to see if the repack _time_ changes with this, but
>> these direct size comparisons are the biggest indicator I'd like to
>> see.
> 
> Unfortunately a timing comparison is kind of a pain here. We'd have to
> use test_perf, which will perform the same repack multiple times. We
> could do that, though it's wasteful, and changes like bf4a60874af
> (p5326: generate pack bitmaps before writing the MIDX bitmap,
> 2021-09-17) move us in the opposite direction.
> 
> I'm not opposed to changing this to test_perf if you feel strongly about
> it.
Repacking is expensive and time-consuming. I care a bit about it,
but not as much as I care about the size difference. Feel free to
skip the time performance impact for now.

Thanks,
-Stolee


  reply	other threads:[~2026-06-19 15:33 UTC|newest]

Thread overview: 25+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2026-05-27 23:18 [PATCH 0/3] pack-objects: support bitmaps and delta-islands with `--path-walk` Taylor Blau
2026-05-27 23:18 ` [PATCH 1/3] pack-objects: support reachability bitmaps " Taylor Blau
2026-05-27 23:18 ` [PATCH 2/3] pack-objects: extract `record_tree_depth()` helper Taylor Blau
2026-05-27 23:18 ` [PATCH 3/3] pack-objects: support `--delta-islands` with `--path-walk` Taylor Blau
2026-05-28 15:28 ` [PATCH 0/3] pack-objects: support bitmaps and delta-islands " Derrick Stolee
2026-05-29 17:26   ` Derrick Stolee
2026-05-29 20:07     ` Taylor Blau
2026-05-29 21:28       ` Derrick Stolee
2026-05-29 22:20         ` Taylor Blau
2026-06-02 22:21 ` [PATCH v2 0/4] " Taylor Blau
2026-06-02 22:21   ` [PATCH v2 1/4] t/perf: drop p5311's lookup-table permutation Taylor Blau
2026-06-02 22:21   ` [PATCH v2 2/4] pack-objects: support reachability bitmaps with `--path-walk` Taylor Blau
2026-06-12 13:03     ` Derrick Stolee
2026-06-19 14:16       ` Taylor Blau
2026-06-19 14:36         ` Derrick Stolee
2026-06-19 14:46           ` Taylor Blau
2026-06-12 13:24     ` Derrick Stolee
2026-06-19 14:28       ` Taylor Blau
2026-06-19 14:40         ` Derrick Stolee
2026-06-19 14:52           ` Taylor Blau
2026-06-19 15:33             ` Derrick Stolee [this message]
2026-06-15 20:57     ` Junio C Hamano
2026-06-19 14:08       ` Taylor Blau
2026-06-02 22:21   ` [PATCH v2 3/4] pack-objects: extract `record_tree_depth()` helper Taylor Blau
2026-06-02 22:21   ` [PATCH v2 4/4] pack-objects: support `--delta-islands` with `--path-walk` Taylor Blau

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=7afdaf77-07f5-4d48-955d-e153d148f647@gmail.com \
    --to=stolee@gmail.com \
    --cc=git@vger.kernel.org \
    --cc=gitster@pobox.com \
    --cc=me@ttaylorr.com \
    --cc=newren@gmail.com \
    --cc=peff@peff.net \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.