From mboxrd@z Thu Jan 1 00:00:00 1970 From: "Jon Smirl" Subject: Re: [PATCH] RFC: git lazy clone proof-of-concept Date: Fri, 8 Feb 2008 15:24:02 -0500 Message-ID: <9e4733910802081224k28310b0cj171453c96802ec7f@mail.gmail.com> References: <200802081828.43849.kendy@suse.cz> <9e4733910802081126r5bf19c95rec817a1b6648ee4d@mail.gmail.com> <1202502007.12966.30.camel@brick> Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: "Jakub Narebski" , "Jan Holesovsky" , git@vger.kernel.org, gitster@pobox.com To: "Harvey Harrison" X-From: git-owner@vger.kernel.org Fri Feb 08 21:24:45 2008 Return-path: Envelope-to: gcvg-git-2@gmane.org Received: from vger.kernel.org ([209.132.176.167]) by lo.gmane.org with esmtp (Exim 4.50) id 1JNZm5-00082W-GH for gcvg-git-2@gmane.org; Fri, 08 Feb 2008 21:24:41 +0100 Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1761606AbYBHUYG (ORCPT ); Fri, 8 Feb 2008 15:24:06 -0500 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S1761366AbYBHUYF (ORCPT ); Fri, 8 Feb 2008 15:24:05 -0500 Received: from wa-out-1112.google.com ([209.85.146.178]:62340 "EHLO wa-out-1112.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1761370AbYBHUYE (ORCPT ); Fri, 8 Feb 2008 15:24:04 -0500 Received: by wa-out-1112.google.com with SMTP id v27so631762wah.23 for ; Fri, 08 Feb 2008 12:24:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=UNHLyO09PgcaYDJoXrFT/XE2GRL91YUKwtMc5hvWQdY=; b=G3Tb63rsNMaiOy8jeLsWhrOkCVlv29iCEPoRvwVvlastB+qwUoZVfG03dF5JwKcaLhH9yVXlDeyznF00vH+i3N6afsfyU9mZeF1KSiGFqEVF0QI4kW3PhNLnE+z5k4ExACr8Xq/LOlrh41TCWqHss/GO337Jae5+Ea/yIU12hSk= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=ssX6KqbL6x19WoHnMm40fMZiwW4HSOPq+yLnnI0ceWAacxsLsMVuQkrjUcW7Fr5IizaN7dlJoIQGpggm02kb+ZsApoA0b9ZIaygB8rk655pMdxTnH94VZokSXk42/6a5Bi4P9ISlfMfLqihInhL37RKmv8LyR+oZ57ahlb+s4qs= Received: by 10.114.151.13 with SMTP id y13mr7808957wad.60.1202502242076; Fri, 08 Feb 2008 12:24:02 -0800 (PST) Received: by 10.114.200.7 with HTTP; Fri, 8 Feb 2008 12:24:02 -0800 (PST) In-Reply-To: <1202502007.12966.30.camel@brick> Content-Disposition: inline Sender: git-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org Archived-At: On 2/8/08, Harvey Harrison wrote: > On Fri, 2008-02-08 at 14:26 -0500, Jon Smirl wrote: > > On 2/8/08, Jakub Narebski wrote: > > > Jan Holesovsky writes: > > > One of the reasons why 'lazy clone' was not implemented was the fact > > > that by using large enough window, and larger than default delta > > > length you can repack "archive pack" (and keep it from trying to > > > repack using .keep files, see git-config(1)) much tighter than with > > > default (time and CPU conserving) options, and much, much tighter than > > > pack which is result of fast-import driven import. > > > > > > Both Mozilla import, and GCC import were packed below 0.5 GB. Warning: > > > you would need machine with large amount of memory to repack it > > > tightly in sensible time! > > > > A lot of memory is 2-4GB. Without this much memory you will trigger > > swapping and the pack process will finish in about a month. > > Well, my modest little Celeron M laptop w/ 1GB of ram did the full > repack overnight on the gcc repo, so a month is a bit of an > exaggeration. Try it again with window=250 and depth=250. That's how you get the really small packs. > > Cheers, > > Harvey > > -- Jon Smirl jonsmirl@gmail.com