From: Jeff King <peff@peff.net>
To: Junio C Hamano <gitster@pobox.com>
Cc: git@vger.kernel.org
Subject: Re: propagating repo corruption across clone
Date: Mon, 25 Mar 2013 16:05:25 -0400 [thread overview]
Message-ID: <20130325200525.GA3902@sigill.intra.peff.net> (raw)
In-Reply-To: <7vboa7xn7s.fsf@alter.siamese.dyndns.org>
On Mon, Mar 25, 2013 at 01:01:59PM -0700, Junio C Hamano wrote:
> Jeff King <peff@peff.net> writes:
>
> > We _do_ see a problem during the checkout phase, but we don't propagate
> > a checkout failure to the exit code from clone. That is bad in general,
> > and should probably be fixed. Though it would never find corruption of
> > older objects in the history, anyway, so checkout should not be relied
> > on for robustness.
>
> It is obvious that we should exit with non-zero status when we see a
> failure from the checkout, but do we want to nuke the resulting
> repository as in the case of normal transport failure? A checkout
> failure might be due to being under quota for object store but
> running out of quota upon populating the working tree, in which case
> we probably do not want to.
I'm just running through my final tests on a large-ish patch series
which deals with this (among other issues). I had the same thought,
though we do already die on a variety of checkout errors. I left it as a
die() for now, but I think we should potentially address it with a
further patch.
> > $ git init non-local && cd non-local && git fetch ..
> > remote: Counting objects: 3, done.
> > remote: Total 3 (delta 0), reused 3 (delta 0)
> > Unpacking objects: 100% (3/3), done.
> > fatal: missing blob object 'd95f3ad14dee633a758d2e331151e950dd13e4ed'
> > error: .. did not send all necessary objects
> >
> > we do notice.
>
> Yes, it is OK to add connectedness check to "git clone".
That's in my series, too. Unfortunately, in the local clone case, it
slows down the clone considerably (since we otherwise would not have to
traverse the objects at all).
-Peff
next prev parent reply other threads:[~2013-03-25 20:05 UTC|newest]
Thread overview: 60+ messages / expand[flat|nested] mbox.gz Atom feed top
2013-03-24 18:31 propagating repo corruption across clone Jeff King
2013-03-24 19:01 ` Ævar Arnfjörð Bjarmason
2013-03-24 19:23 ` Jeff King
2013-03-25 13:43 ` Jeff Mitchell
2013-03-25 14:56 ` Jeff King
2013-03-25 15:31 ` Duy Nguyen
2013-03-25 15:56 ` Jeff King
2013-03-25 16:32 ` Jeff Mitchell
2013-03-25 20:07 ` Jeff King
2013-03-26 13:43 ` Jeff Mitchell
2013-03-26 16:55 ` Jeff King
2013-03-26 21:59 ` Philip Oakley
2013-03-26 22:03 ` Jeff King
2013-03-26 23:20 ` Rich Fromm
2013-03-27 1:25 ` Jonathan Nieder
2013-03-27 18:23 ` Rich Fromm
2013-03-27 19:49 ` Jeff King
2013-03-27 20:04 ` Jeff King
2013-03-27 3:47 ` Junio C Hamano
2013-03-27 6:19 ` Sitaram Chamarty
2013-03-27 15:03 ` Junio C Hamano
2013-03-27 15:47 ` Sitaram Chamarty
2013-03-27 18:51 ` Rich Fromm
2013-03-27 19:13 ` Junio C Hamano
2013-03-28 13:52 ` Jeff Mitchell
2013-03-28 13:48 ` Jeff Mitchell
2013-03-26 1:06 ` Duy Nguyen
2013-03-24 19:16 ` Ilari Liusvaara
2013-03-25 20:01 ` Junio C Hamano
2013-03-25 20:05 ` Jeff King [this message]
2013-03-25 20:14 ` [PATCH 0/9] corrupt object potpourri Jeff King
2013-03-25 20:16 ` [PATCH 1/9] stream_blob_to_fd: detect errors reading from stream Jeff King
2013-03-26 21:27 ` Junio C Hamano
2013-03-25 20:17 ` [PATCH 2/9] check_sha1_signature: check return value from read_istream Jeff King
2013-03-25 20:18 ` [PATCH 3/9] read_istream_filtered: propagate read error from upstream Jeff King
2013-03-25 20:21 ` [PATCH 4/9] avoid infinite loop in read_istream_loose Jeff King
2013-03-25 20:21 ` [PATCH 5/9] add test for streaming corrupt blobs Jeff King
2013-03-25 21:10 ` Jonathan Nieder
2013-03-25 21:26 ` Jeff King
2013-03-27 20:27 ` Jeff King
2013-03-27 20:35 ` Junio C Hamano
2013-03-25 20:22 ` [PATCH 6/9] streaming_write_entry: propagate streaming errors Jeff King
2013-03-25 21:35 ` Eric Sunshine
2013-03-25 21:37 ` Jeff King
2013-03-25 21:39 ` Jonathan Nieder
2013-03-25 21:49 ` [PATCH v2 " Jeff King
2013-03-25 23:29 ` Jonathan Nieder
2013-03-26 21:38 ` Junio C Hamano
2013-03-25 20:22 ` [PATCH 7/9] add tests for cloning corrupted repositories Jeff King
2013-03-25 20:23 ` [PATCH 8/9] clone: die on errors from unpack_trees Jeff King
2013-03-26 21:40 ` Junio C Hamano
2013-03-26 22:22 ` [PATCH 10/9] clone: leave repo in place after checkout errors Jeff King
2013-03-26 22:32 ` Jonathan Nieder
2013-03-27 1:03 ` Jeff King
2013-03-25 20:26 ` [PATCH 9/9] clone: run check_everything_connected Jeff King
2013-03-26 0:53 ` Duy Nguyen
2013-03-26 22:24 ` Jeff King
2013-03-26 21:50 ` Junio C Hamano
2013-03-28 0:40 ` Duy Nguyen
2013-03-31 7:57 ` Duy Nguyen
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20130325200525.GA3902@sigill.intra.peff.net \
--to=peff@peff.net \
--cc=git@vger.kernel.org \
--cc=gitster@pobox.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).