From mboxrd@z Thu Jan 1 00:00:00 1970 From: Enrico Weigelt Subject: Re: large files and low memory Date: Tue, 5 Oct 2010 02:59:02 +0200 Message-ID: <20101005005902.GC2768@nibiru.local> References: <20101004092046.GA4382@nibiru.local> <4CAA1BEB.3050908@workspacewhiz.com> Reply-To: weigelt@metux.de Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii To: git@vger.kernel.org X-From: git-owner@vger.kernel.org Tue Oct 05 03:04:12 2010 Return-path: Envelope-to: gcvg-git-2@lo.gmane.org Received: from vger.kernel.org ([209.132.180.67]) by lo.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1P2vwy-0004yB-3d for gcvg-git-2@lo.gmane.org; Tue, 05 Oct 2010 03:04:12 +0200 Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1755752Ab0JEBED (ORCPT ); Mon, 4 Oct 2010 21:04:03 -0400 Received: from caprica.metux.de ([82.165.128.25]:46196 "EHLO mailgate.caprica.metux.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1755092Ab0JEBD7 (ORCPT ); Mon, 4 Oct 2010 21:03:59 -0400 Received: from mailgate.caprica.metux.de (localhost.localdomain [127.0.0.1]) by mailgate.caprica.metux.de (8.14.4/8.14.4) with ESMTP id o95151x5013159 for ; Tue, 5 Oct 2010 03:05:01 +0200 Received: (from uucp@localhost) by mailgate.caprica.metux.de (8.14.4/8.14.4/Submit) with UUCP id o9514Uee013146 for git@vger.kernel.org; Tue, 5 Oct 2010 03:04:30 +0200 Received: (from weigelt@localhost) by nibiru.metux.de (8.12.10/8.12.10) id o950x2PZ029231 for git@vger.kernel.org; Tue, 5 Oct 2010 02:59:02 +0200 Mail-Followup-To: git@vger.kernel.org Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.1i X-Terror: bin laden, kill bush, Briefbombe, Massenvernichtung, KZ, X-Nazi: Weisse Rasse, Hitlers Wiederauferstehung, 42, X-Antichrist: weg mit schaeuble, ausrotten, heiliger krieg, al quaida, X-Killer: 23, endloesung, Weltuntergang, X-Doof: wer das liest ist doof Sender: git-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: git@vger.kernel.org Archived-At: * Shawn Pearce wrote: > Laziness. Git originally assumed it would only be used for smaller > source files written by humans. Its easier to write the code as a > single malloc'd buffer than to stream it. We'd like to fix it, but > its harder than it sounds. Today we copy the file into a buffer > before we deflate and compute the SHA-1 as this prevents us from > getting into a consistency error when the file is modified between > these two stages. hmm, perhaps copy it to a temporary file, if it's too large ? cu -- ---------------------------------------------------------------------- Enrico Weigelt, metux IT service -- http://www.metux.de/ phone: +49 36207 519931 email: weigelt@metux.de mobile: +49 151 27565287 icq: 210169427 skype: nekrad666 ---------------------------------------------------------------------- Embedded-Linux / Portierung / Opensource-QM / Verteilte Systeme ----------------------------------------------------------------------