From: Hin-Tak Leung <htl10@users.sourceforge.net>
To: normalperson@yhbt.net, stoklund@2pi.dk
Cc: fabian.schmied@gmail.com, git@vger.kernel.org, sam@vilain.net,
stevenrwalter@gmail.com, waste.manager@gmx.de, amyrick@apple.com
Subject: Anomaly with the new code - Re: git-svn performance
Date: Fri, 24 Oct 2014 08:06:26 +0100 [thread overview]
Message-ID: <1414134386.28852.YahooMailBasic@web172306.mail.ir2.yahoo.com> (raw)
In-Reply-To: <1413999510.36832.YahooMailBasic@web172305.mail.ir2.yahoo.com>
I keep tabs of a particular svn repository over many years
and run "git svn fetch --all" every few days. So that's the old clone.
Since this discussion started, I made a new one with git 2.1.0 patched
with the first two patches below, a couple of weeks ago. And I ran
'git svn fetch --all' on both every few days since.
I have added a few more patches, so the whole list is the 6
below against 2.1.0. The latest fetch is really strange - the fetch against
the new clone took almost twice as long and uses almost twice
as much memory, vs against the old. 17 min, 800 MB vs 10 min 400MB.
Details below. Maybe this is a performance issue about how the clones
were made?
0001-git-svn-only-look-at-the-new-parts-of-svn-mergeinfo.patch
0002-git-svn-only-look-at-the-root-path-for-svn-mergeinfo.patch
0003-git-svn-reduce-check_cherry_pick-cache-overhead.patch
0004-git-svn-cache-only-mergeinfo-revisions.patch
0006-git-svn-clear-global-SVN-pool-between-get_log-invoca.patch
0007-git-svn-remove-mergeinfo-rev-caching.patch
(I dropped #5 because it doesn't seem interesting?)
<---
$ /usr/bin/time -v git svn fetch --all
...
Command being timed: "git svn fetch --all"
User time (seconds): 622.20
System time (seconds): 12.52
Percent of CPU this job got: 98%
Elapsed (wall clock) time (h:mm:ss or m:ss): 10:42.21
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 399588
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 320
Minor (reclaiming a frame) page faults: 383987
Voluntary context switches: 2088
Involuntary context switches: 68304
Swaps: 0
File system inputs: 168288
File system outputs: 148960
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
[Hin-Tak@localhost R]$ cd ../R-2/
[Hin-Tak@localhost R-2]$ /usr/bin/time -v git svn fetch --all
M src/library/stats/R/hclust.R
M src/library/stats/R/dendrogram.R
r66853 = 7c18b2e4084529d5912cf789c045f2eab7d4083c (refs/remotes/trunk)
M doc/manual/R-exts.texi
r66854 = bc7b131e34eaf04859fede1ecedb796c0a33be02 (refs/remotes/trunk)
M doc/manual/R-exts.texi
Checking svn:mergeinfo changes since r66844: 6 sources, 1 changed
W:svn cherry-pick ignored (/trunk:66824,66854) - missing 1084 commit(s) (eg 6453a2d844e27f2963ba87142028b023c50385ef)
r66855 = de5daf8db948732fa96c3d5b32077d8057e2a7e7 (refs/remotes/R-3-1-branch)
M src/modules/internet/internet.c
r66856 = a1e9300c6dd49ec4c3dd11f861bca0dbe3ca65b4 (refs/remotes/trunk)
M doc/manual/R-admin.texi
r66857 = eb5f3175e67a806482c39def71246f5d18bf8660 (refs/remotes/trunk)
M doc/manual/R-admin.texi
Checking svn:mergeinfo changes since r66855: 6 sources, 1 changed
W:svn cherry-pick ignored (/trunk:66854,66857) - missing 1086 commit(s) (eg e8cc0c31ddeeea3f8fa1ad47105d09a2c19e1a98)
r66858 = 10c8013f103d57c8a717b738e2a51c8d397c88f0 (refs/remotes/R-3-1-branch)
M VERSION
r66859 = 0f865f247da3191431bb17bcc3c307e8735dbd97 (refs/remotes/R-3-1-branch)
Command being timed: "git svn fetch --all"
User time (seconds): 1023.06
System time (seconds): 15.30
Percent of CPU this job got: 99%
Elapsed (wall clock) time (h:mm:ss or m:ss): 17:27.65
Average shared text size (kbytes): 0
Average unshared data size (kbytes): 0
Average stack size (kbytes): 0
Average total size (kbytes): 0
Maximum resident set size (kbytes): 785332
Average resident set size (kbytes): 0
Major (requiring I/O) page faults: 884
Minor (reclaiming a frame) page faults: 527668
Voluntary context switches: 2792
Involuntary context switches: 107718
Swaps: 0
File system inputs: 194704
File system outputs: 170032
Socket messages sent: 0
Socket messages received: 0
Signals delivered: 0
Page size (bytes): 4096
Exit status: 0
--->
next prev parent reply other threads:[~2014-10-24 7:06 UTC|newest]
Thread overview: 11+ messages / expand[flat|nested] mbox.gz Atom feed top
2014-10-22 17:38 git-svn performance Hin-Tak Leung
2014-10-24 7:06 ` Hin-Tak Leung [this message]
2014-10-24 23:34 ` Anomaly with the new code - " Eric Wong
2014-10-25 0:02 ` Eric Wong
-- strict thread matches above, loose matches on Subject: below --
2014-10-25 5:29 Anomaly with the new code - " Hin-Tak Leung
2014-10-25 5:51 ` Eric Wong
2014-10-27 6:38 ` Eric Wong
2014-10-27 16:56 ` Eric Wong
2014-10-27 23:08 Hin-Tak Leung
2014-10-27 23:26 Hin-Tak Leung
2014-10-28 7:45 ` Eric Wong
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1414134386.28852.YahooMailBasic@web172306.mail.ir2.yahoo.com \
--to=htl10@users.sourceforge.net \
--cc=amyrick@apple.com \
--cc=fabian.schmied@gmail.com \
--cc=git@vger.kernel.org \
--cc=normalperson@yhbt.net \
--cc=sam@vilain.net \
--cc=stevenrwalter@gmail.com \
--cc=stoklund@2pi.dk \
--cc=waste.manager@gmx.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox