From: Toon Claes <toon@iotcl.com>
To: Patrick Steinhardt <ps@pks.im>, git@vger.kernel.org
Cc: Junio C Hamano <gitster@pobox.com>, Justin Tobler <jltobler@gmail.com>
Subject: Re: [PATCH v2 3/5] setup: defer object database creation
Date: Tue, 04 Aug 2026 20:48:42 +0200 [thread overview]
Message-ID: <87bjbh67sl.fsf@emacs.iotcl.com> (raw)
In-Reply-To: <20260804-pks-odb-create-on-disk-v2-3-ddf8b59bd207@pks.im>
Patrick Steinhardt <ps@pks.im> writes:
> In a subsequent commit we'll make the creation of the on-disk data
> structures of an object database pluggable. This will lead to an
> in-between state where we have already configured the repository's
> object database, but it's not usable yet until we eventually call
> `create_object_directory()`.
>
> Defer the object database creation so that we handle both steps in the
> same function.
>
> Signed-off-by: Patrick Steinhardt <ps@pks.im>
> ---
> setup.c | 35 +++++++++++++++++++++++++++--------
> setup.h | 9 +++++++++
> 2 files changed, 36 insertions(+), 8 deletions(-)
>
> diff --git a/setup.c b/setup.c
> index 825572f5f1..a7b1b9eaef 100644
> --- a/setup.c
> +++ b/setup.c
> @@ -1760,6 +1760,13 @@ enum discovery_result discover_git_directory_reason(struct strbuf *commondir,
> return result;
> }
>
> +static void get_object_directories(char **object_directory,
> + char **alternate_object_directories)
> +{
> + *object_directory = xstrdup_or_null(getenv(DB_ENVIRONMENT));
> + *alternate_object_directories = xstrdup_or_null(getenv(ALTERNATE_DB_ENVIRONMENT));
> +}
Would it make sense to wrap these in a APPLY_REPOSITORY_FORMAT_HONOR_ENV
guard?
I mean, below we call this function *only* when flags has that bit set.
But the return values of that function are used at the bottom of
apply_repository_format(), that's a bit awkard.
So can I suggest the following patch instead? That would remove the
weird double pointer passing around, which feels a bit unneeded.
--- >8 ---
Subject: [PATCH] setup: defer object database creation
In a subsequent commit we'll make the creation of the on-disk data
structures of an object database pluggable. This will lead to an
in-between state where we have already configured the repository's
object database, but it's not usable yet until we eventually call
`create_object_directory()`.
Defer the object database creation so that we handle both steps in the
same function.
Signed-off-by: Toon Claes <toon@iotcl.com>
---
setup.c | 35 +++++++++++++++++++++++++++--------
setup.h | 9 +++++++++
2 files changed, 36 insertions(+), 8 deletions(-)
diff --git a/setup.c b/setup.c
index 825572f5f1..2e9bc92481 100644
--- a/setup.c
+++ b/setup.c
@@ -1760,13 +1760,28 @@ enum discovery_result discover_git_directory_reason(struct strbuf *commondir,
return result;
}
+static void setup_objects_odb_new(struct repository *repo,
+ bool from_env)
+{
+ char *object_directory = NULL, *alternate_object_directories = NULL;
+
+ if (from_env) {
+ object_directory = xstrdup_or_null(getenv(DB_ENVIRONMENT));
+ alternate_object_directories = xstrdup_or_null(getenv(ALTERNATE_DB_ENVIRONMENT));
+ }
+
+ repo->objects = odb_new(repo, object_directory,
+ alternate_object_directories);
+
+ free(alternate_object_directories);
+ free(object_directory);
+}
+
int apply_repository_format(struct repository *repo,
const struct repository_format *format,
enum apply_repository_format_flags flags,
struct strbuf *err)
{
- char *object_directory = NULL, *alternate_object_directories = NULL;
-
if (verify_repository_format(format, err) < 0)
return -1;
@@ -1779,8 +1794,6 @@ int apply_repository_format(struct repository *repo,
if (flags & APPLY_REPOSITORY_FORMAT_HONOR_ENV) {
const char *shallow_file;
- object_directory = xstrdup_or_null(getenv(DB_ENVIRONMENT));
- alternate_object_directories = xstrdup_or_null(getenv(ALTERNATE_DB_ENVIRONMENT));
shallow_file = getenv(GIT_SHALLOW_FILE_ENVIRONMENT);
if (shallow_file)
set_alternate_shallow_file(repo, shallow_file);
@@ -1803,11 +1816,11 @@ int apply_repository_format(struct repository *repo,
repo->repository_format_precious_objects =
format->precious_objects;
- repo->objects = odb_new(repo, object_directory,
- alternate_object_directories);
+ if (flags & APPLY_REPOSITORY_FORMAT_SKIP_ODB_CREATION)
+ return 0;
+
+ setup_objects_odb_new(repo, flags & APPLY_REPOSITORY_FORMAT_HONOR_ENV);
- free(alternate_object_directories);
- free(object_directory);
return 0;
}
@@ -2654,11 +2667,13 @@ static int create_default_files(struct repository *repo,
return reinit;
}
-static void create_object_directory(struct repository *repo)
+static void create_object_database(struct repository *repo)
{
struct strbuf path = STRBUF_INIT;
size_t baselen;
+ setup_objects_odb_new(repo, true);
+
strbuf_addstr(&path, repo_get_object_directory(repo));
baselen = path.len;
@@ -2867,9 +2882,10 @@ int init_db(struct repository *repo,
*/
read_and_verify_repository_format(&repo_fmt, repo_get_git_dir(repo), NULL);
repository_format_configure(&repo_fmt, hash, ref_storage_format);
- if (apply_repository_format(repo, &repo_fmt, APPLY_REPOSITORY_FORMAT_HONOR_ENV, &err) < 0)
+ if (apply_repository_format(repo, &repo_fmt,
+ APPLY_REPOSITORY_FORMAT_HONOR_ENV |
+ APPLY_REPOSITORY_FORMAT_SKIP_ODB_CREATION, &err) < 0)
die("%s", err.buf);
- startup_info->have_repository = 1;
/*
* Ensure `core.hidedotfiles` is processed. This must happen after we
@@ -2885,7 +2901,9 @@ int init_db(struct repository *repo,
if (!(flags & INIT_DB_SKIP_REFDB))
create_reference_database(repo, initial_branch, flags & INIT_DB_QUIET);
- create_object_directory(repo);
+ create_object_database(repo);
+
+ startup_info->have_repository = 1;
if (repo_settings_get_shared_repository(repo)) {
char buf[10];
diff --git a/setup.h b/setup.h
index 654f10e059..e55d647b70 100644
--- a/setup.h
+++ b/setup.h
@@ -241,6 +241,15 @@ enum apply_repository_format_flags {
* relate to the object database.
*/
APPLY_REPOSITORY_FORMAT_HONOR_ENV = (1 << 0),
+
+ /*
+ * Usually, the object database is created after the repository format
+ * was applied. This step is skipped if this flag is set, which leaves
+ * us with a partially-working repository.
+ *
+ * This is useful when initializing a new repository.
+ */
+ APPLY_REPOSITORY_FORMAT_SKIP_ODB_CREATION = (1 << 1),
};
/*
--
2.55.0.629.g250fe7f194
next prev parent reply other threads:[~2026-08-04 18:48 UTC|newest]
Thread overview: 68+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-07-24 3:48 [PATCH 0/5] odb: make creation of object database pluggable Patrick Steinhardt
2026-07-24 3:48 ` [PATCH 1/5] loose: load loose object map for the correct source Patrick Steinhardt
2026-07-24 17:26 ` Junio C Hamano
2026-07-28 20:14 ` Justin Tobler
2026-07-30 12:47 ` Toon Claes
2026-08-04 7:21 ` Patrick Steinhardt
2026-07-24 3:48 ` [PATCH 2/5] setup: detangle loading of loose object maps Patrick Steinhardt
2026-07-24 18:41 ` Junio C Hamano
2026-08-04 7:21 ` Patrick Steinhardt
2026-07-28 20:32 ` Justin Tobler
2026-07-30 14:27 ` Toon Claes
2026-08-04 7:21 ` Patrick Steinhardt
2026-07-24 3:48 ` [PATCH 3/5] setup: defer object database creation Patrick Steinhardt
2026-07-24 18:50 ` Junio C Hamano
2026-08-04 7:21 ` Patrick Steinhardt
2026-07-28 21:13 ` Justin Tobler
2026-08-04 7:21 ` Patrick Steinhardt
2026-08-04 7:28 ` Patrick Steinhardt
2026-07-24 3:48 ` [PATCH 4/5] odb/source: introduce function to map source type to name Patrick Steinhardt
2026-07-26 20:34 ` Junio C Hamano
2026-08-04 7:21 ` Patrick Steinhardt
2026-07-24 3:48 ` [PATCH 5/5] odb: make creation of on-disk structures pluggable Patrick Steinhardt
2026-07-26 20:42 ` Junio C Hamano
2026-08-04 7:21 ` Patrick Steinhardt
2026-07-28 21:23 ` Justin Tobler
2026-08-04 8:29 ` [PATCH v2 0/5] odb: make creation of object database pluggable Patrick Steinhardt
2026-08-04 8:29 ` [PATCH v2 1/5] loose: load loose object map for the correct source Patrick Steinhardt
2026-08-04 8:29 ` [PATCH v2 2/5] setup: detangle loading of loose object maps Patrick Steinhardt
2026-08-04 8:29 ` [PATCH v2 3/5] setup: defer object database creation Patrick Steinhardt
2026-08-04 18:48 ` Toon Claes [this message]
2026-08-05 7:27 ` Patrick Steinhardt
2026-08-04 8:29 ` [PATCH v2 4/5] odb/source: introduce function to map source type to name Patrick Steinhardt
2026-08-04 8:29 ` [PATCH v2 5/5] odb: make creation of on-disk structures pluggable Patrick Steinhardt
2026-08-04 16:36 ` [PATCH v2 0/5] odb: make creation of object database pluggable Justin Tobler
2026-08-05 9:28 ` [PATCH v3 0/6] " Patrick Steinhardt
2026-08-05 9:28 ` [PATCH v3 1/6] loose: load loose object map for the correct source Patrick Steinhardt
2026-08-05 9:28 ` [PATCH v3 2/6] setup: detangle loading of loose object maps Patrick Steinhardt
2026-08-05 9:28 ` [PATCH v3 3/6] setup: handle ODB-related environment variables in `odb_new()` Patrick Steinhardt
2026-08-05 13:29 ` Toon Claes
2026-08-06 6:04 ` Patrick Steinhardt
2026-08-05 9:28 ` [PATCH v3 4/6] setup: defer object database creation Patrick Steinhardt
2026-08-05 14:21 ` Toon Claes
2026-08-06 6:02 ` Patrick Steinhardt
2026-08-05 9:28 ` [PATCH v3 5/6] odb/source: introduce function to map source type to name Patrick Steinhardt
2026-08-05 9:28 ` [PATCH v3 6/6] odb: make creation of on-disk structures pluggable Patrick Steinhardt
2026-08-05 15:57 ` Toon Claes
2026-08-06 7:50 ` [PATCH v4 0/6] odb: make creation of object database pluggable Patrick Steinhardt
2026-08-06 7:50 ` [PATCH v4 1/6] loose: load loose object map for the correct source Patrick Steinhardt
2026-08-06 7:51 ` [PATCH v4 2/6] setup: detangle loading of loose object maps Patrick Steinhardt
2026-08-06 7:51 ` [PATCH v4 3/6] setup: handle ODB-related environment variables in `odb_new()` Patrick Steinhardt
2026-08-06 7:51 ` [PATCH v4 4/6] setup: defer object database creation Patrick Steinhardt
2026-08-06 14:23 ` Toon Claes
2026-08-06 14:54 ` Patrick Steinhardt
2026-08-06 17:39 ` Junio C Hamano
2026-08-06 7:51 ` [PATCH v4 5/6] odb/source: introduce function to map source type to name Patrick Steinhardt
2026-08-06 7:51 ` [PATCH v4 6/6] odb: make creation of on-disk structures pluggable Patrick Steinhardt
2026-08-06 14:26 ` [PATCH v4 0/6] odb: make creation of object database pluggable Toon Claes
2026-08-07 3:34 ` [PATCH v5 " Patrick Steinhardt
2026-08-07 3:34 ` [PATCH v5 1/6] loose: load loose object map for the correct source Patrick Steinhardt
2026-08-07 3:34 ` [PATCH v5 2/6] setup: detangle loading of loose object maps Patrick Steinhardt
2026-08-07 3:34 ` [PATCH v5 3/6] setup: handle ODB-related environment variables in `odb_new()` Patrick Steinhardt
2026-08-07 3:34 ` [PATCH v5 4/6] setup: defer object database creation Patrick Steinhardt
2026-08-07 4:28 ` Junio C Hamano
2026-08-07 7:16 ` Toon Claes
2026-08-07 3:34 ` [PATCH v5 5/6] odb/source: introduce function to map source type to name Patrick Steinhardt
2026-08-07 3:34 ` [PATCH v5 6/6] odb: make creation of on-disk structures pluggable Patrick Steinhardt
2026-08-07 7:17 ` [PATCH v5 0/6] odb: make creation of object database pluggable Toon Claes
2026-08-07 9:10 ` Patrick Steinhardt
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=87bjbh67sl.fsf@emacs.iotcl.com \
--to=toon@iotcl.com \
--cc=git@vger.kernel.org \
--cc=gitster@pobox.com \
--cc=jltobler@gmail.com \
--cc=ps@pks.im \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox