From: Harvey Harrison <harvey.harrison@gmail.com>
To: Jon Smirl <jonsmirl@gmail.com>
Cc: Nicolas Pitre <nico@cam.org>, Git Mailing List <git@vger.kernel.org>
Subject: Re: Something is broken in repack
Date: Fri, 07 Dec 2007 19:48:20 -0800 [thread overview]
Message-ID: <1197085700.22471.47.camel@brick> (raw)
In-Reply-To: <9e4733910712071929h17a7d88dv37686ec7cd858c63@mail.gmail.com>
On Fri, 2007-12-07 at 22:29 -0500, Jon Smirl wrote:
> The kernel repo has the same problem but not nearly as bad.
>
> Starting from a default pack
> git repack -a -d -f --depth=1000 --window=1000
> Uses 1GB of physical memory
>
> Now do the command again.
> git repack -a -d -f --depth=1000 --window=1000
> Uses 1.3GB of physical memory
>
> I suspect the gcc repo has much longer revision chains than the kernel
> one since the kernel repo is only a few years old. The Mozilla repo
> contained revision chains with over 2,000 revisions. Longer revision
> chains result in longer delta chains.
I sent out a partial delta breakdown for the gcc repo earlier, here's
the whole list.
breakdown of the gcc packfile:
Total objects
1017922
ChainLength Objects Cumulative
1: 103817 103817
2: 67332 171149
3: 57520 228669
4: 52570 281239
5: 43910 325149
6: 37520 362669
7: 35248 397917
8: 29819 427736
9: 27619 455355
10: 22656 478011
11: 21073 499084
12: 18738 517822
13: 16674 534496
14: 14882 549378
15: 14424 563802
16: 12765 576567
17: 11662 588229
18: 11845 600074
19: 11694 611768
20: 9625 621393
21: 9031 630424
22: 8437 638861
23: 8217 647078
24: 7927 655005
25: 7955 662960
26: 7092 670052
27: 7004 677056
28: 6724 683780
29: 6626 690406
30: 5875 696281
31: 5970 702251
32: 5726 707977
33: 6025 714002
34: 5354 719356
35: 6413 725769
36: 4933 730702
37: 4888 735590
38: 4561 740151
39: 4366 744517
40: 4166 748683
41: 4531 753214
42: 4029 757243
43: 3701 760944
44: 3647 764591
45: 3553 768144
46: 3509 771653
47: 3473 775126
48: 3442 778568
49: 3379 781947
50: 3395 785342
51: 3315 788657
52: 3168 791825
53: 3345 795170
54: 3166 798336
55: 3237 801573
56: 2795 804368
57: 2768 807136
58: 2666 809802
59: 2723 812525
60: 2547 815072
61: 2565 817637
62: 2622 820259
63: 2521 822780
64: 2492 825272
65: 2529 827801
66: 2566 830367
67: 2685 833052
68: 2458 835510
69: 2457 837967
70: 2440 840407
71: 2410 842817
72: 2337 845154
73: 2301 847455
74: 2201 849656
75: 2127 851783
76: 2256 854039
77: 2038 856077
78: 1925 858002
79: 1965 859967
80: 1929 861896
81: 1890 863786
82: 1873 865659
83: 1964 867623
84: 1898 869521
85: 1839 871360
86: 1933 873293
87: 1876 875169
88: 1851 877020
89: 1789 878809
90: 1790 880599
91: 1804 882403
92: 1696 884099
93: 1863 885962
94: 1889 887851
95: 1766 889617
96: 1731 891348
97: 1775 893123
98: 1750 894873
99: 1767 896640
100: 1644 898284
101: 1642 899926
102: 1489 901415
103: 1532 902947
104: 1564 904511
105: 1477 905988
106: 1461 907449
107: 1383 908832
108: 1422 910254
109: 1316 911570
110: 1480 913050
111: 1329 914379
112: 1375 915754
113: 1292 917046
114: 1224 918270
115: 1123 919393
116: 1216 920609
117: 1252 921861
118: 1252 923113
119: 1346 924459
120: 1320 925779
121: 1277 927056
122: 1234 928290
123: 1200 929490
124: 1255 930745
125: 1206 931951
126: 1155 933106
127: 1246 934352
128: 1226 935578
129: 1194 936772
130: 1268 938040
131: 1334 939374
132: 1146 940520
133: 1220 941740
134: 1055 942795
135: 1110 943905
136: 1095 945000
137: 1294 946294
138: 1204 947498
139: 1218 948716
140: 1101 949817
141: 993 950810
142: 975 951785
143: 1014 952799
144: 968 953767
145: 957 954724
146: 1069 955793
147: 996 956789
148: 967 957756
149: 964 958720
150: 954 959674
151: 949 960623
152: 1001 961624
153: 1042 962666
154: 1057 963723
155: 948 964671
156: 966 965637
157: 833 966470
158: 959 967429
159: 907 968336
160: 854 969190
161: 847 970037
162: 836 970873
163: 769 971642
164: 747 972389
165: 755 973144
166: 707 973851
167: 774 974625
168: 777 975402
169: 783 976185
170: 707 976892
171: 738 977630
172: 775 978405
173: 781 979186
174: 698 979884
175: 801 980685
176: 712 981397
177: 679 982076
178: 775 982851
179: 696 983547
180: 760 984307
181: 740 985047
182: 752 985799
183: 704 986503
184: 683 987186
185: 690 987876
186: 741 988617
187: 642 989259
188: 672 989931
189: 679 990610
190: 691 991301
191: 648 991949
192: 703 992652
193: 675 993327
194: 687 994014
195: 625 994639
196: 607 995246
197: 583 995829
198: 632 996461
199: 540 997001
200: 652 997653
201: 600 998253
202: 628 998881
203: 624 999505
204: 582 1000087
205: 548 1000635
206: 520 1001155
207: 648 1001803
208: 556 1002359
209: 563 1002922
210: 508 1003430
211: 570 1004000
212: 530 1004530
213: 575 1005105
214: 527 1005632
215: 521 1006153
216: 515 1006668
217: 513 1007181
218: 460 1007641
219: 491 1008132
220: 474 1008606
221: 471 1009077
222: 482 1009559
223: 485 1010044
224: 439 1010483
225: 385 1010868
226: 385 1011253
227: 403 1011656
228: 380 1012036
229: 376 1012412
230: 377 1012789
231: 415 1013204
232: 394 1013598
233: 362 1013960
234: 334 1014294
235: 366 1014660
236: 317 1014977
237: 362 1015339
238: 343 1015682
239: 392 1016074
240: 317 1016391
241: 305 1016696
242: 319 1017015
243: 276 1017291
244: 247 1017538
245: 179 1017717
246: 111 1017828
247: 61 1017889
248: 27 1017916
249: 6 1017922
Harvey
next prev parent reply other threads:[~2007-12-08 3:48 UTC|newest]
Thread overview: 82+ messages / expand[flat|nested] mbox.gz Atom feed top
2007-12-07 23:05 Something is broken in repack Jon Smirl
2007-12-08 0:37 ` Linus Torvalds
2007-12-08 1:27 ` [PATCH] pack-objects: fix delta cache size accounting Nicolas Pitre
2007-12-08 1:46 ` Something is broken in repack Nicolas Pitre
2007-12-08 2:04 ` Jon Smirl
2007-12-08 2:28 ` Nicolas Pitre
2007-12-08 3:29 ` Jon Smirl
2007-12-08 3:37 ` David Brown
2007-12-08 4:22 ` Jon Smirl
2007-12-08 4:30 ` Nicolas Pitre
2007-12-08 5:01 ` Jon Smirl
2007-12-08 5:12 ` Nicolas Pitre
2007-12-08 3:48 ` Harvey Harrison [this message]
2007-12-08 2:22 ` Jon Smirl
2007-12-08 3:44 ` Harvey Harrison
2007-12-08 22:18 ` Junio C Hamano
2007-12-09 8:05 ` Junio C Hamano
2007-12-09 15:19 ` Jon Smirl
2007-12-09 18:25 ` Jon Smirl
2007-12-10 1:07 ` Nicolas Pitre
2007-12-10 2:49 ` Nicolas Pitre
2007-12-08 2:56 ` David Brown
2007-12-10 19:56 ` Nicolas Pitre
2007-12-10 20:05 ` Jon Smirl
2007-12-10 20:16 ` Morten Welinder
2007-12-11 2:25 ` Jon Smirl
2007-12-11 2:55 ` Junio C Hamano
2007-12-11 3:27 ` Nicolas Pitre
2007-12-11 11:08 ` David Kastrup
2007-12-11 12:08 ` Pierre Habouzit
2007-12-11 12:18 ` David Kastrup
2007-12-11 3:49 ` Nicolas Pitre
2007-12-11 5:25 ` Jon Smirl
2007-12-11 5:29 ` Jon Smirl
2007-12-11 7:01 ` Jon Smirl
2007-12-11 7:34 ` Andreas Ericsson
2007-12-11 13:49 ` Nicolas Pitre
2007-12-11 15:00 ` Nicolas Pitre
2007-12-11 15:36 ` Jon Smirl
2007-12-11 16:20 ` Nicolas Pitre
2007-12-11 16:21 ` Jon Smirl
2007-12-12 5:12 ` Nicolas Pitre
2007-12-12 8:05 ` David Kastrup
2007-12-14 16:18 ` Wolfram Gloger
2007-12-12 15:48 ` Nicolas Pitre
2007-12-12 16:17 ` Paolo Bonzini
2007-12-12 16:37 ` Linus Torvalds
2007-12-12 16:42 ` David Miller
2007-12-12 16:54 ` Linus Torvalds
2007-12-12 17:12 ` Jon Smirl
2007-12-14 16:12 ` Wolfram Gloger
2007-12-14 16:45 ` David Kastrup
2007-12-14 16:59 ` Wolfram Gloger
2007-12-13 13:32 ` Nguyen Thai Ngoc Duy
2007-12-13 15:32 ` Paolo Bonzini
2007-12-13 16:29 ` Paolo Bonzini
2007-12-13 16:39 ` Johannes Sixt
2007-12-14 1:04 ` Jakub Narebski
2007-12-14 6:14 ` Paolo Bonzini
2007-12-14 6:24 ` Nguyen Thai Ngoc Duy
2007-12-14 8:20 ` Paolo Bonzini
2007-12-14 9:01 ` Harvey Harrison
2007-12-14 10:40 ` Jakub Narebski
2007-12-14 10:52 ` Nguyen Thai Ngoc Duy
2007-12-14 13:25 ` Nicolas Pitre
2007-12-12 16:13 ` Nicolas Pitre
2007-12-13 7:32 ` Andreas Ericsson
2007-12-14 16:03 ` Wolfram Gloger
2007-12-11 16:33 ` Linus Torvalds
2007-12-11 17:21 ` Nicolas Pitre
2007-12-11 17:24 ` David Miller
2007-12-11 17:44 ` Nicolas Pitre
2007-12-11 20:26 ` Andreas Ericsson
2007-12-11 18:43 ` Jon Smirl
2007-12-11 18:57 ` Nicolas Pitre
2007-12-11 19:17 ` Linus Torvalds
2007-12-11 19:40 ` Junio C Hamano
2007-12-11 20:34 ` Andreas Ericsson
2007-12-11 17:28 ` Daniel Berlin
2007-12-11 13:31 ` Nicolas Pitre
2007-12-11 6:01 ` Sean
2007-12-11 6:20 ` Jon Smirl
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=1197085700.22471.47.camel@brick \
--to=harvey.harrison@gmail.com \
--cc=git@vger.kernel.org \
--cc=jonsmirl@gmail.com \
--cc=nico@cam.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.