From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S261540AbVEEUhL (ORCPT ); Thu, 5 May 2005 16:37:11 -0400 Received: (majordomo@vger.kernel.org) by vger.kernel.org id S262195AbVEEUhK (ORCPT ); Thu, 5 May 2005 16:37:10 -0400 Received: from waste.org ([216.27.176.166]:46045 "EHLO waste.org") by vger.kernel.org with ESMTP id S261540AbVEEUhC (ORCPT ); Thu, 5 May 2005 16:37:02 -0400 Date: Thu, 5 May 2005 13:36:58 -0700 From: Matt Mackall To: Jeff Garzik Cc: linux-kernel , git@vger.kernel.org, Linus Torvalds Subject: Re: Mercurial v0.4d Message-ID: <20050505203658.GG22038@waste.org> References: <20050504025852.GK22038@waste.org> <20050504181802.GS22038@waste.org> <427A6E3F.5090904@pobox.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <427A6E3F.5090904@pobox.com> User-Agent: Mutt/1.5.6+20040907i Sender: linux-kernel-owner@vger.kernel.org X-Mailing-List: linux-kernel@vger.kernel.org On Thu, May 05, 2005 at 03:04:31PM -0400, Jeff Garzik wrote: > Matt Mackall wrote: > >The web protocol is painfully slow, mostly because it makes an http > >round trip per file revision to pull. I'm about to start working on a > >replacement that minimizes round trips. > > Can you make it do HTTP 1.1 pipelining? Yes, a zsync-like protocol ought to be doable. But you'll still potentially be doing 16k requests to pull something the size of the kernel, which isn't very friendly to a web server. So I'm working on a stand-alone or possibly CGI-based replacement. My goal is to do something like this: client server I last saw change N from you W, X, Y, and Z are newer here Send me X, Y, and Z relative to N Here you go, deltas from N to X to Y to Z, sorted by file So not only can we be efficient in number of round trips and data transferred, we can reduce seeks by applying all per-file changes together. We can also usually avoid decompress/recompress and patch/diff because both ends will end up storing the same delta. -- Mathematics is the supreme nostalgia of our time.