From: Florian Achleitner <florian.achleitner.2.6.31@gmail.com>
To: GIT Mailing-list <git@vger.kernel.org>
Cc: "David Michael Barr" <b@rr-dav.id.au>,
"Jonathan Nieder" <jrnieder@gmail.com>,
"Ramsay Jones" <ramsay@ramsay1.demon.co.uk>,
"Torsten Bögershausen" <tboegi@web.de>,
"Joachim Schmitz" <jojo@schmitz-digital.de>,
"Erik Faye-Lund" <kusmabite@gmail.com>,
"Florian Achleitner" <florian.achleitner.2.6.31@gmail.com>,
"Junio C Hamano" <gitster@pobox.com>
Subject: [PATCH v7 15/16] remote-svn: add marks-file regeneration
Date: Tue, 28 Aug 2012 10:49:49 +0200 [thread overview]
Message-ID: <1346143790-23491-16-git-send-email-florian.achleitner.2.6.31@gmail.com> (raw)
In-Reply-To: <1346143790-23491-15-git-send-email-florian.achleitner.2.6.31@gmail.com>
fast-import mark files are stored outside the object database and are
therefore not fetched and can be lost somehow else. marks provide a
svn revision --> git sha1 mapping, while the notes that are attached
to each commit when it is imported provide a git sha1 --> svn revision
mapping.
If the marks file is not available or not plausible, regenerate it by
walking through the notes tree. , i.e. The plausibility check tests
if the highest revision in the marks file matches the revision of the
top ref. It doesn't ensure that the mark file is completely correct.
This could only be done with an effort equal to unconditional
regeneration.
Signed-off-by: Florian Achleitner <florian.achleitner.2.6.31@gmail.com>
Signed-off-by: Junio C Hamano <gitster@pobox.com>
---
remote-testsvn.c | 68 ++++++++++++++++++++++++++++++++++++++++++++++++++++++
1 file changed, 68 insertions(+)
diff --git a/remote-testsvn.c b/remote-testsvn.c
index e90d221..d0b81d5 100644
--- a/remote-testsvn.c
+++ b/remote-testsvn.c
@@ -86,6 +86,73 @@ static int parse_rev_note(const char *msg, struct rev_note *res) {
return 0;
}
+static int note2mark_cb(const unsigned char *object_sha1,
+ const unsigned char *note_sha1, char *note_path,
+ void *cb_data) {
+ FILE *file = (FILE *)cb_data;
+ char *msg;
+ unsigned long msglen;
+ enum object_type type;
+ struct rev_note note;
+ if (!(msg = read_sha1_file(note_sha1, &type, &msglen)) ||
+ !msglen || type != OBJ_BLOB) {
+ free(msg);
+ return 1;
+ }
+ if (parse_rev_note(msg, ¬e))
+ return 2;
+ if (fprintf(file, ":%d %s\n", note.rev_nr, sha1_to_hex(object_sha1)) < 1)
+ return 3;
+ return 0;
+}
+
+static void regenerate_marks(void)
+{
+ int ret;
+ FILE *marksfile;
+ marksfile = fopen(marksfilename, "w+");
+ if (!marksfile)
+ die_errno("Couldn't create mark file %s.", marksfilename);
+ ret = for_each_note(NULL, 0, note2mark_cb, marksfile);
+ if (ret)
+ die("Regeneration of marks failed, returned %d.", ret);
+ fclose(marksfile);
+}
+
+static void check_or_regenerate_marks(int latestrev) {
+ FILE *marksfile;
+ struct strbuf sb = STRBUF_INIT;
+ struct strbuf line = STRBUF_INIT;
+ int found = 0;
+
+ if (latestrev < 1)
+ return;
+
+ init_notes(NULL, notes_ref, NULL, 0);
+ marksfile = fopen(marksfilename, "r");
+ if (!marksfile) {
+ regenerate_marks();
+ marksfile = fopen(marksfilename, "r");
+ if (!marksfile)
+ die_errno("cannot read marks file %s!", marksfilename);
+ fclose(marksfile);
+ } else {
+ strbuf_addf(&sb, ":%d ", latestrev);
+ while (strbuf_getline(&line, marksfile, '\n') != EOF) {
+ if (!prefixcmp(line.buf, sb.buf)) {
+ found++;
+ break;
+ }
+ }
+ fclose(marksfile);
+ if (!found)
+ regenerate_marks();
+ }
+ free_notes(NULL);
+ strbuf_release(&sb);
+ strbuf_release(&line);
+}
+
static int cmd_import(const char *line)
{
int code;
@@ -111,6 +178,7 @@ static int cmd_import(const char *line)
free(note_msg);
}
}
+ check_or_regenerate_marks(startrev - 1);
if (dump_from_file) {
dumpin_fd = open(url, O_RDONLY);
--
1.7.9.5
next prev parent reply other threads:[~2012-08-28 8:52 UTC|newest]
Thread overview: 26+ messages / expand[flat|nested] mbox.gz Atom feed top
2012-08-28 8:49 [PATCH v7 00/16] GSOC remote-svn Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 01/16] Implement a remote helper for svn in C Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 02/16] Add git-remote-testsvn to Makefile Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 03/16] Add svndump_init_fd to allow reading dumps from arbitrary FDs Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 04/16] Add argv_array_detach and argv_array_free_detached Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 05/16] Connect fast-import to the remote-helper via pipe, adding 'bidi-import' capability Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 06/16] Add documentation for the 'bidi-import' capability of remote-helpers Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 07/16] When debug==1, start fast-import with "--stats" instead of "--quiet" Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 08/16] remote-svn, vcs-svn: Enable fetching to private refs Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 09/16] Allow reading svn dumps from files via file:// urls Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 10/16] vcs-svn: add fast_export_note to create notes Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 11/16] Create a note for every imported commit containing svn metadata Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 12/16] remote-svn: Activate import/export-marks for fast-import Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 13/16] remote-svn: add incremental import Florian Achleitner
2012-08-28 8:49 ` [PATCH v7 14/16] Add a svnrdump-simulator replaying a dump file for testing Florian Achleitner
2012-08-28 8:49 ` Florian Achleitner [this message]
2012-08-28 8:49 ` [PATCH v7 16/16] Add a test script for remote-svn Florian Achleitner
2012-08-28 18:01 ` Junio C Hamano
2012-08-28 17:59 ` [PATCH v7 15/16] remote-svn: add marks-file regeneration Junio C Hamano
2012-08-28 17:54 ` [PATCH v7 13/16] remote-svn: add incremental import Junio C Hamano
2012-08-28 17:06 ` [PATCH v7 09/16] Allow reading svn dumps from files via file:// urls Junio C Hamano
2012-08-28 17:53 ` [PATCH v7 08/16] remote-svn, vcs-svn: Enable fetching to private refs Junio C Hamano
2012-08-28 17:02 ` [PATCH v7 03/16] Add svndump_init_fd to allow reading dumps from arbitrary FDs Junio C Hamano
2012-08-28 16:55 ` [PATCH v7 02/16] Add git-remote-testsvn to Makefile Junio C Hamano
2012-08-28 17:08 ` [PATCH v7 01/16] Implement a remote helper for svn in C Junio C Hamano
2012-08-28 8:59 ` [PATCH v7 00/16] GSOC remote-svn Florian Achleitner
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1346143790-23491-16-git-send-email-florian.achleitner.2.6.31@gmail.com \
--to=florian.achleitner.2.6.31@gmail.com \
--cc=b@rr-dav.id.au \
--cc=git@vger.kernel.org \
--cc=gitster@pobox.com \
--cc=jojo@schmitz-digital.de \
--cc=jrnieder@gmail.com \
--cc=kusmabite@gmail.com \
--cc=ramsay@ramsay1.demon.co.uk \
--cc=tboegi@web.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).