git.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: "David Tweed" <david.tweed@gmail.com>
To: "Nicolas Pitre" <nico@cam.org>
Cc: "David Steven Tweed" <d.s.tweed@reading.ac.uk>,
	git@vger.kernel.org, Johannes.Schindelin@gmx.de
Subject: Re: [PATCH] Make git prune remove temporary packs that look like write failures
Date: Wed, 6 Feb 2008 20:02:34 +0000	[thread overview]
Message-ID: <e1dab3980802061202i39c42432k4dd9f95560a7ea62@mail.gmail.com> (raw)
In-Reply-To: <alpine.LFD.1.00.0802061420510.2732@xanadu.home>

On Feb 6, 2008 7:31 PM, Nicolas Pitre <nico@cam.org> wrote:
> On Wed, 6 Feb 2008, David Tweed wrote:
>
> > I guess the -n ought to be honoured. However, unless I'm missing
> > something, the case of expiring objects is different. The primary
> > reason is that objects can get orphaned by "semantic" decisions
> > (delete this branch, rewind, etc) so they contain valid content that
> > you might want to later rescue (using low-level command like git cat
> > if necessary).
>
> You can also get loose unconnected objects when fetching and the number
> of objects is lower than the transfer.unpackLimit value.

I didn't know that, but the key point is that these are still
well-formed objects, so rescuing data from them makes sense. In
contrast, I'm concerned with packs which are ill-formed from a
write-error, which I don't believe git will even read. (I've just
tried truncating a finished pack file and none of the git commands
I've tried will read any objects in it. So you'll have to do low-level
hacking to get data out of a write-error pack. WARNING: be aware of
how to do a non-hardlinked clone before trying this.)

> > In contrast, the only way to get a temporary pack when
> > the repository is quiescent is resulting from a _write error_ and thus
> > is a corrupt entity which it would take a great deal of work to
> > extract any valid data from.
>
> Or when a fetch is in progress, just like the case above, but with the
> number of objects greater than transfer.unpackLimit.

Being "in progress" contradicts the presumption of "being quiescent".

> This is uncommon to have a prune occurring at the same time as a fetch,
> but the --expire argument is there if for example you do a prune from a
> cron job but still want to be safe by giving a grace period to garbage
> files which might not be so after all.

Ah, I hadn't realised this was an intended usage of --expire. Since as
you note there's no way to tell an abandoned tmp pack from one that's
in the process of being written, following expire is probably
necessary for safety. I'll look at adding support for that.

Many thanks for the advice,

-- 
cheers, dave tweed__________________________
david.tweed@gmail.com
Rm 124, School of Systems Engineering, University of Reading.
"while having code so boring anyone can maintain it, use Python." --
attempted insult seen on slashdot

  reply	other threads:[~2008-02-06 20:03 UTC|newest]

Thread overview: 20+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2008-02-05 18:49 [PATCH] Make git prune remove temporary packs that look like write failures David Steven Tweed
2008-02-05 19:02 ` Nicolas Pitre
2008-02-05 20:06   ` [PATCH] prune: heed --expire for stale packs, add a test Johannes Schindelin
2008-02-05 20:13     ` Nicolas Pitre
2008-02-06  5:15       ` Junio C Hamano
2008-02-06  7:41         ` Johannes Schindelin
2008-02-06 14:12         ` Nicolas Pitre
2008-02-06 20:30           ` Junio C Hamano
2008-02-06 16:48   ` [PATCH] Make git prune remove temporary packs that look like write failures Brandon Casey
2008-02-06 18:59     ` David Tweed
2008-02-06 19:41       ` Brandon Casey
2008-02-06 19:57         ` David Tweed
2008-02-06 20:07           ` Nicolas Pitre
2008-02-06 20:43           ` Brandon Casey
2008-02-06 19:10   ` David Tweed
2008-02-06 19:31     ` Nicolas Pitre
2008-02-06 20:02       ` David Tweed [this message]
2008-02-06 20:16         ` Nicolas Pitre
2008-02-06 20:25           ` David Tweed
2008-02-06 10:02 ` Junio C Hamano

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=e1dab3980802061202i39c42432k4dd9f95560a7ea62@mail.gmail.com \
    --to=david.tweed@gmail.com \
    --cc=Johannes.Schindelin@gmx.de \
    --cc=d.s.tweed@reading.ac.uk \
    --cc=git@vger.kernel.org \
    --cc=nico@cam.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).