Load testing of git

Load testing of git

[Yuri Mikhailov]

Dear Git community,

I am a Software Developer and I have been using git for a while.
Currently my company is looking for a version control system to use
and we find Git a good candidate for us. But what is important for us
to know is scalability of this VCS. Does anyone performed load testing
of Git? What is the practical maximum number of files and revisions
this system can handle?

Best regards,
Iurii Mykhailov

Re: Load testing of git

[Thomas Koch]

Yuri Mikhailov:
> Dear Git community,
> 
> I am a Software Developer and I have been using git for a while.
> Currently my company is looking for a version control system to use
> and we find Git a good candidate for us. But what is important for us
> to know is scalability of this VCS. Does anyone performed load testing
> of Git? What is the practical maximum number of files and revisions
> this system can handle?
> 
> Best regards,
> Iurii Mykhailov

Have a look at the projects using Git[1]. There are for sure projects that 
exceeds the scalability you're thinking about. The linux Kernel might be the 
biggest project.

[1] https://git.wiki.kernel.org/index.php/GitProjects

Thomas Koch, http://www.koch.ro

Re: Load testing of git

[Shawn Pearce]

On Sun, Feb 24, 2013 at 8:58 AM, Thomas Koch <thomas@koch.ro> wrote:
> Yuri Mikhailov:
>> Dear Git community,
>>
>> I am a Software Developer and I have been using git for a while.
>> Currently my company is looking for a version control system to use
>> and we find Git a good candidate for us. But what is important for us
>> to know is scalability of this VCS. Does anyone performed load testing
>> of Git? What is the practical maximum number of files and revisions
>> this system can handle?
>>
>> Best regards,
>> Iurii Mykhailov
>
> Have a look at the projects using Git[1]. There are for sure projects that
> exceeds the scalability you're thinking about. The linux Kernel might be the
> biggest project.

I highly doubt the Linux kernel is the biggest project.

IIRC WebKit has more objects, more files, etc. Its repository's
compressed form is >4G.

I know of at least some proprietary repositories with 96G in them. Not
much history, but a lot of binary blobs around 128M each doesn't
compress well. And bup wasn't used so we didn't get very good
compression over the files.

Re: Load testing of git

[Yuri Mikhailov]

Thanks to everyone. The information was useful.

On 24 February 2013 21:31, Shawn Pearce <spearce@spearce.org> wrote:
> On Sun, Feb 24, 2013 at 8:58 AM, Thomas Koch <thomas@koch.ro> wrote:
>> Yuri Mikhailov:
>>> Dear Git community,
>>>
>>> I am a Software Developer and I have been using git for a while.
>>> Currently my company is looking for a version control system to use
>>> and we find Git a good candidate for us. But what is important for us
>>> to know is scalability of this VCS. Does anyone performed load testing
>>> of Git? What is the practical maximum number of files and revisions
>>> this system can handle?
>>>
>>> Best regards,
>>> Iurii Mykhailov
>>
>> Have a look at the projects using Git[1]. There are for sure projects that
>> exceeds the scalability you're thinking about. The linux Kernel might be the
>> biggest project.
>
> I highly doubt the Linux kernel is the biggest project.
>
> IIRC WebKit has more objects, more files, etc. Its repository's
> compressed form is >4G.
>
> I know of at least some proprietary repositories with 96G in them. Not
> much history, but a lot of binary blobs around 128M each doesn't
> compress well. And bup wasn't used so we didn't get very good
> compression over the files.

Re: Load testing of git

[Jeff Epler]

In 2012 there was a thread about git's performance on large
repositories.  One archive of the discussion begins here:
http://mid.gmane.org/CB5074CF.3AD7A%25joshua.redstone%40fb.com

> The test repo has 4 million commits, linear history and about 1.3
> million files.

I'm not sure to what extent git performance may have changed since then,
e.g., by improving the index format.

Jeff