large publicly accessible HTTP archive?

large publicly accessible HTTP archive?

[Bryan Larsen]

Hello,

I'm one of the maintainers of MacPorts git port.

A long time ago, we had problems pulling extremely large archives over 
HTTP on PowerPC machines.  By large, I mean on the order of 500 
megabytes: I was testing using an embedded Linux distribution.

We "fixed" the problem by turning off CURL_MULTI and ignored the 
problem.  Yes, bad form, I know.

Our problems were against curl 7.16.2.

However, in recent git's, CURL_MULTI is required to do an HTTP push, so 
we've had users complaining.

Curl is up to 7.19.0, they may have fixed our problem.  Unfortunately, 
the distribution I used for testing is gone now.  Putting up a local 
archive doesn't exhibit the problem either.

Is anybody aware of a very large HTTP accessible repository that 
wouldn't mind me doing a few test pulls from?  By large, I mean >500 
megabytes of network traffic for a single pull.

thanks,
Bryan

Re: large publicly accessible HTTP archive?

[Daniel Stenberg]

On Fri, 31 Oct 2008, Bryan Larsen wrote:

> We "fixed" the problem by turning off CURL_MULTI and ignored the problem. 
>
> Our problems were against curl 7.16.2.

Right, libcurl has had 8 releases since with perhaps an average of 30 bugfixes 
per release so...

I'm not aware of any current known libcurl bugs with the multi interface and 
"simple" HTTP transfers such as this.

-- 

  / daniel.haxx.se - libcurl hacker