git.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Patrick Steinhardt <ps@pks.im>
To: git@vger.kernel.org
Cc: Taylor Blau <me@ttaylorr.com>, Derrick Stolee <stolee@gmail.com>,
	 Oswald Buddenhagen <oswald.buddenhagen@gmx.de>,
	 Junio C Hamano <gitster@pobox.com>
Subject: [PATCH v4 0/6] commit-graph: remove reliance on global state
Date: Fri, 15 Aug 2025 07:49:46 +0200	[thread overview]
Message-ID: <20250815-b4-pks-commit-graph-wo-the-repository-v4-0-b6b651178cce@pks.im> (raw)
In-Reply-To: <20250804-b4-pks-commit-graph-wo-the-repository-v1-0-850d626eb2e8@pks.im>

Hi,

this patch series is another step on our long road towards not having
global state. In addition to that, as commit-graphs are part of the
object database layer, this is also another step towards pluggable
object databases.

Changes in v2:
  - Use `unsigned` instead of `size_t` to count number of Bloom filters.
  - Use `uint32_t` instead of `size_t` for number of commit graphs,
    as this type is also used to iterate through this count already.
  - Refactor `parse_commit_graph()` to take a repository instead of both
    repo settings and a hash algo.
  - Link to v1: https://lore.kernel.org/r/20250804-b4-pks-commit-graph-wo-the-repository-v1-0-850d626eb2e8@pks.im

Changes in v3:
  - Use `unsigned` for commit-graph options instead of `size_t`.
  - Link to v2: https://lore.kernel.org/r/20250806-b4-pks-commit-graph-wo-the-repository-v2-0-911bae638e61@pks.im

Changes in v4:
  - Drop the patches that fix `-Wsign-compare` warnings.
  - Link to v3: https://lore.kernel.org/r/20250807-b4-pks-commit-graph-wo-the-repository-v3-0-82edef830a1e@pks.im

Thanks!

Patrick

---
Patrick Steinhardt (6):
      commit-graph: stop using `the_hash_algo` via macros
      commit-graph: store the hash algorithm instead of its length
      commit-graph: refactor `parse_commit_graph()` to take a repository
      commit-graph: stop using `the_hash_algo`
      commit-graph: stop using `the_repository`
      commit-graph: stop passing in redundant repository

 builtin/commit-graph.c       |   9 +-
 builtin/commit.c             |   2 +-
 builtin/merge.c              |   2 +-
 commit-graph.c               | 283 +++++++++++++++++++++----------------------
 commit-graph.h               |  21 ++--
 oss-fuzz/fuzz-commit-graph.c |   6 +-
 t/helper/test-read-graph.c   |   2 +-
 7 files changed, 157 insertions(+), 168 deletions(-)

Range-diff versus v3:

 1:  26daf74e02 <  -:  ---------- trace2: introduce function to trace unsigned integers
 2:  646805924e <  -:  ---------- commit-graph: stop using signed integers to count Bloom filters
 3:  01e38f39cf <  -:  ---------- commit-graph: fix type for some write options
 4:  a362f63472 <  -:  ---------- commit-graph: fix sign comparison warnings
 5:  041d9c07a0 =  1:  f7083b7e3b commit-graph: stop using `the_hash_algo` via macros
 6:  6c1fa6be4f =  2:  336e35e93b commit-graph: store the hash algorithm instead of its length
 7:  ed04f7b787 =  3:  1446e1d66f commit-graph: refactor `parse_commit_graph()` to take a repository
 8:  1eb6316e8d !  4:  368e5ada3e commit-graph: stop using `the_hash_algo`
    @@ commit-graph.c: int open_commit_graph_chain(const char *chain_file,
      		close(*fd);
      		return 0;
      	}
    --	if (st->st_size < (ssize_t) the_hash_algo->hexsz) {
    -+	if (st->st_size < (ssize_t) hash_algo->hexsz) {
    +-	if (st->st_size < the_hash_algo->hexsz) {
    ++	if (st->st_size < hash_algo->hexsz) {
      		close(*fd);
      		if (!st->st_size) {
      			/* treat empty files the same as missing */
     @@ commit-graph.c: struct commit_graph *load_commit_graph_chain_fd_st(struct repository *r,
    + 	int i = 0, valid = 1, count;
      	FILE *fp = xfdopen(fd, "r");
    - 	size_t count;
      
     -	count = st->st_size / (the_hash_algo->hexsz + 1);
     +	count = st->st_size / (r->hash_algo->hexsz + 1);
    @@ commit-graph.c: static struct tree *load_tree_for_commit(struct repository *r,
      
      	oidread(&oid, commit_data, the_repository->hash_algo);
     @@ commit-graph.c: static int write_graph_chunk_oids(struct hashfile *f,
    - 
    + 	int count;
      	for (count = 0; count < ctx->commits.nr; count++, list++) {
      		display_progress(ctx->progress, ++ctx->progress_cnt);
     -		hashwrite(f, (*list)->object.oid.hash, the_hash_algo->rawsz);
    @@ commit-graph.c: static int write_graph_chunk_data(struct hashfile *f,
      
      		parent = (*list)->parents;
      
    -@@ commit-graph.c: static size_t write_graph_chunk_base_1(struct hashfile *f,
    +@@ commit-graph.c: static int write_graph_chunk_base_1(struct hashfile *f,
      		return 0;
      
      	num = write_graph_chunk_base_1(f, g->base_graph);
 9:  8d599f5a37 !  5:  a51cccec0d commit-graph: stop using `the_repository`
    @@ builtin/merge.c: int cmd_merge(int argc,
      ## commit-graph.c ##
     @@
     -#define USE_THE_REPOSITORY_VARIABLE
    --
    + #define DISABLE_SIGN_COMPARE_WARNINGS
    + 
      #include "git-compat-util.h"
    - #include "config.h"
    - #include "csum-file.h"
     @@
      #include "tree.h"
      #include "chunk-format.h"
10:  41ccdd6da1 !  6:  841d280105 commit-graph: stop passing in redundant repository
    @@ commit-graph.c: int open_commit_graph_chain(const char *chain_file,
      						   int *incomplete_chain)
      {
     @@ commit-graph.c: struct commit_graph *load_commit_graph_chain_fd_st(struct repository *r,
    + 	int i = 0, valid = 1, count;
      	FILE *fp = xfdopen(fd, "r");
    - 	size_t count;
      
     -	count = st->st_size / (r->hash_algo->hexsz + 1);
     +	count = st->st_size / (odb->repo->hash_algo->hexsz + 1);
    @@ commit-graph.c: struct commit_graph *load_commit_graph_chain_fd_st(struct reposi
     -	odb_prepare_alternates(r->objects);
     +	odb_prepare_alternates(odb);
      
    - 	for (size_t i = 0; i < count; i++) {
    + 	for (i = 0; i < count; i++) {
      		struct odb_source *source;
     @@ commit-graph.c: struct commit_graph *load_commit_graph_chain_fd_st(struct repository *r,
      		if (strbuf_getline_lf(&line, fp) == EOF)

---
base-commit: e813a0200a7121b97fec535f0d0b460b0a33356c
change-id: 20250717-b4-pks-commit-graph-wo-the-repository-1dc2cacbc8e3


  parent reply	other threads:[~2025-08-15  5:49 UTC|newest]

Thread overview: 69+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2025-08-04  8:17 [PATCH 0/9] commit-graph: remove reliance on global state Patrick Steinhardt
2025-08-04  8:17 ` [PATCH 1/9] trace2: introduce function to trace unsigned integers Patrick Steinhardt
2025-08-04 21:33   ` Taylor Blau
2025-08-04  8:17 ` [PATCH 2/9] commit-graph: stop using signed integers to count bloom filters Patrick Steinhardt
2025-08-04  9:13   ` Oswald Buddenhagen
2025-08-04 11:18     ` Patrick Steinhardt
2025-08-04 18:34       ` Junio C Hamano
2025-08-04 21:44         ` Taylor Blau
2025-08-06  6:23           ` Patrick Steinhardt
2025-08-06 12:54             ` Oswald Buddenhagen
2025-08-06 19:04               ` Junio C Hamano
2025-08-06 15:41             ` Junio C Hamano
2025-08-07  7:04               ` Patrick Steinhardt
2025-08-07 22:41                 ` Junio C Hamano
2025-08-11  8:05                   ` Patrick Steinhardt
2025-08-05 15:13         ` Junio C Hamano
2025-08-04 21:42   ` Taylor Blau
2025-08-04  8:17 ` [PATCH 3/9] commit-graph: fix type for some write options Patrick Steinhardt
2025-08-04 21:52   ` Taylor Blau
2025-08-04  8:17 ` [PATCH 4/9] commit-graph: fix sign comparison warnings Patrick Steinhardt
2025-08-04 22:04   ` Taylor Blau
2025-08-06  6:52     ` Patrick Steinhardt
2025-08-04  8:17 ` [PATCH 5/9] commit-graph: stop using `the_hash_algo` via macros Patrick Steinhardt
2025-08-04 22:05   ` Taylor Blau
2025-08-04  8:17 ` [PATCH 6/9] commit-graph: store the hash algorithm instead of its length Patrick Steinhardt
2025-08-04 22:07   ` Taylor Blau
2025-08-04  8:17 ` [PATCH 7/9] commit-graph: stop using `the_hash_algo` Patrick Steinhardt
2025-08-04 22:10   ` Taylor Blau
2025-08-06  6:53     ` Patrick Steinhardt
2025-08-04  8:17 ` [PATCH 8/9] commit-graph: stop using `the_repository` Patrick Steinhardt
2025-08-04 22:11   ` Taylor Blau
2025-08-04  8:17 ` [PATCH 9/9] commit-graph: stop passing in redundant repository Patrick Steinhardt
2025-08-05  4:27 ` [PATCH 0/9] commit-graph: remove reliance on global state Derrick Stolee
2025-08-06  6:53   ` Patrick Steinhardt
2025-08-06 12:00 ` [PATCH v2 00/10] " Patrick Steinhardt
2025-08-06 12:00   ` [PATCH v2 01/10] trace2: introduce function to trace unsigned integers Patrick Steinhardt
2025-08-06 12:00   ` [PATCH v2 02/10] commit-graph: stop using signed integers to count Bloom filters Patrick Steinhardt
2025-08-06 12:00   ` [PATCH v2 03/10] commit-graph: fix type for some write options Patrick Steinhardt
2025-08-06 12:34     ` Oswald Buddenhagen
2025-08-06 15:40       ` Junio C Hamano
2025-08-07  7:07         ` Patrick Steinhardt
2025-08-06 12:00   ` [PATCH v2 04/10] commit-graph: fix sign comparison warnings Patrick Steinhardt
2025-08-06 12:00   ` [PATCH v2 05/10] commit-graph: stop using `the_hash_algo` via macros Patrick Steinhardt
2025-08-06 12:00   ` [PATCH v2 06/10] commit-graph: store the hash algorithm instead of its length Patrick Steinhardt
2025-08-06 12:00   ` [PATCH v2 07/10] commit-graph: refactor `parse_commit_graph()` to take a repository Patrick Steinhardt
2025-08-06 12:00   ` [PATCH v2 08/10] commit-graph: stop using `the_hash_algo` Patrick Steinhardt
2025-08-06 12:00   ` [PATCH v2 09/10] commit-graph: stop using `the_repository` Patrick Steinhardt
2025-08-06 12:00   ` [PATCH v2 10/10] commit-graph: stop passing in redundant repository Patrick Steinhardt
2025-08-07  8:04 ` [PATCH v3 00/10] commit-graph: remove reliance on global state Patrick Steinhardt
2025-08-07  8:04   ` [PATCH v3 01/10] trace2: introduce function to trace unsigned integers Patrick Steinhardt
2025-08-07  8:04   ` [PATCH v3 02/10] commit-graph: stop using signed integers to count Bloom filters Patrick Steinhardt
2025-08-07  8:04   ` [PATCH v3 03/10] commit-graph: fix type for some write options Patrick Steinhardt
2025-08-07 22:40     ` Junio C Hamano
2025-08-11  8:24       ` Patrick Steinhardt
2025-08-07  8:04   ` [PATCH v3 04/10] commit-graph: fix sign comparison warnings Patrick Steinhardt
2025-08-07  8:04   ` [PATCH v3 05/10] commit-graph: stop using `the_hash_algo` via macros Patrick Steinhardt
2025-08-07  8:04   ` [PATCH v3 06/10] commit-graph: store the hash algorithm instead of its length Patrick Steinhardt
2025-08-07  8:04   ` [PATCH v3 07/10] commit-graph: refactor `parse_commit_graph()` to take a repository Patrick Steinhardt
2025-08-07  8:04   ` [PATCH v3 08/10] commit-graph: stop using `the_hash_algo` Patrick Steinhardt
2025-08-07  8:04   ` [PATCH v3 09/10] commit-graph: stop using `the_repository` Patrick Steinhardt
2025-08-07  8:04   ` [PATCH v3 10/10] commit-graph: stop passing in redundant repository Patrick Steinhardt
2025-08-15  5:49 ` Patrick Steinhardt [this message]
2025-08-15  5:49   ` [PATCH v4 1/6] commit-graph: stop using `the_hash_algo` via macros Patrick Steinhardt
2025-08-15  5:49   ` [PATCH v4 2/6] commit-graph: store the hash algorithm instead of its length Patrick Steinhardt
2025-08-15  5:49   ` [PATCH v4 3/6] commit-graph: refactor `parse_commit_graph()` to take a repository Patrick Steinhardt
2025-08-15  5:49   ` [PATCH v4 4/6] commit-graph: stop using `the_hash_algo` Patrick Steinhardt
2025-08-15  5:49   ` [PATCH v4 5/6] commit-graph: stop using `the_repository` Patrick Steinhardt
2025-08-15  5:49   ` [PATCH v4 6/6] commit-graph: stop passing in redundant repository Patrick Steinhardt
2025-08-15 15:17   ` [PATCH v4 0/6] commit-graph: remove reliance on global state Derrick Stolee

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20250815-b4-pks-commit-graph-wo-the-repository-v4-0-b6b651178cce@pks.im \
    --to=ps@pks.im \
    --cc=git@vger.kernel.org \
    --cc=gitster@pobox.com \
    --cc=me@ttaylorr.com \
    --cc=oswald.buddenhagen@gmx.de \
    --cc=stolee@gmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).