From: Junio C Hamano <junkio@cox.net>
To: Alexander Litvinov <lan@ac-sw.com>
Cc: git@vger.kernel.org
Subject: Re: [PATCH] git-mv is not able to handle big directories
Date: Tue, 22 Nov 2005 22:14:48 -0800 [thread overview]
Message-ID: <7voe4b7uw7.fsf@assigned-by-dhcp.cox.net> (raw)
In-Reply-To: <200511231141.57683.lan@ac-sw.com> (Alexander Litvinov's message of "Wed, 23 Nov 2005 11:41:57 +0600")
Alexander Litvinov <lan@ac-sw.com> writes:
> When moving directory with large number of files git-mv says:
>> git-mv jsp* .
> Can't exec "git-update-index": Argument list too long at /usr/local/bin/git-mv
> line 193.
> git-update-index failed to add new names with code -1
>
> This patch fixes this by building list of files with limited len (currently
> 5000) and executing git-update-index few times until all files will be
> processed. I don't know how to determinate limit of command line but 5000
> seems safe enougth to me.
Two comments.
(1) the argument limit is enforced by the operating system in
bytes (including environment size unfortunately) so we might
want to count bytes not number of paths. I heard GNU xargs
uses 131072 as the default limit.
(2) I wonder if we can detect this particular failure case and
then fall back on splitting the arguments dynamically, maybe
something like this:
sub xargs_system {
my ($cmd, @args) = @_;
my $rc = system(@$cmd, @args);
if ($rc == 'argument list too long error') {
my (@args0) = splice(@args, 0, @args/2);
$rc = xargs_system($cmd, @args0);
return $c if ($rc);
return xargs_system($cmd, @args);
}
return $rc;
}
and:
$rc = xargs_system([qw(git-update-index --)], @changedfiles);
$rc = xargs_system([qw(git-update-index --add --)], @addedfiles);
...
next prev parent reply other threads:[~2005-11-23 6:14 UTC|newest]
Thread overview: 23+ messages / expand[flat|nested] mbox.gz Atom feed top
2005-11-23 5:41 [PATCH] git-mv is not able to handle big directories Alexander Litvinov
2005-11-23 6:14 ` Junio C Hamano [this message]
2005-11-23 6:32 ` Junio C Hamano
2005-11-23 7:55 ` Randal L. Schwartz
2005-11-23 8:37 ` Junio C Hamano
2005-11-23 13:56 ` Ryan Anderson
2005-11-23 14:27 ` Perl version support (was Re: [PATCH] git-mv is not able to handle big directories) Randal L. Schwartz
2005-11-23 19:47 ` Perl version support Junio C Hamano
2005-11-23 19:59 ` Randal L. Schwartz
2005-11-23 21:56 ` Perl version support (was Re: [PATCH] git-mv is not able to handle big directories) H. Peter Anvin
2005-11-23 22:01 ` Randal L. Schwartz
2005-11-23 22:02 ` Morten Welinder
2005-11-28 1:46 ` Ryan Anderson
2005-11-28 8:49 ` Andreas Ericsson
2005-11-23 18:53 ` [PATCH] git-mv is not able to handle big directories Junio C Hamano
2005-11-23 19:54 ` Ryan Anderson
[not found] ` <200511231619.41497.lan@ac-sw.com>
2005-11-23 14:29 ` Randal L. Schwartz
2005-11-23 7:26 ` git-mv is not able to handle directory with one file in it Alexander Litvinov
2005-11-23 7:57 ` Andreas Ericsson
2005-11-23 9:57 ` Alexander Litvinov
2005-11-23 10:21 ` Alexander Litvinov
2005-11-23 11:07 ` Josef Weidendorfer
2005-11-23 14:47 ` Josef Weidendorfer
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=7voe4b7uw7.fsf@assigned-by-dhcp.cox.net \
--to=junkio@cox.net \
--cc=git@vger.kernel.org \
--cc=lan@ac-sw.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).