From: "H. Peter Anvin" <hpa@zytor.com>
To: Willy Tarreau <w@1wt.eu>
Cc: Linus Torvalds <torvalds@osdl.org>,
git@vger.kernel.org, nigel@nigel.suspend2.net,
"J.H." <warthog9@kernel.org>,
Randy Dunlap <randy.dunlap@oracle.com>,
Andrew Morton <akpm@osdl.org>, Pavel Machek <pavel@ucw.cz>,
kernel list <linux-kernel@vger.kernel.org>,
webmaster@kernel.org
Subject: Re: How git affects kernel.org performance
Date: Sun, 07 Jan 2007 00:58:38 -0800 [thread overview]
Message-ID: <45A0B63E.2020803@zytor.com> (raw)
In-Reply-To: <20070107085526.GR24090@1wt.eu>
Willy Tarreau wrote:
>
> At work, we had the same problem on a file server with ext3. We use rsync
> to make backups to a local IDE disk, and we noticed that getdents() took
> about the same time as Peter reports (0.2 to 2 seconds), especially in
> maildir directories. We tried many things to fix it with no result,
> including enabling dirindexes. Finally, we made a full backup, and switched
> over to XFS and the problem totally disappeared. So it seems that the
> filesystem matters a lot here when there are lots of entries in a
> directory, and that ext3 is not suitable for usages with thousands
> of entries in directories with millions of files on disk. I'm not
> certain it would be that easy to try other filesystems on kernel.org
> though :-/
>
Changing filesystems would mean about a week of downtime for a server.
It's painful, but it's doable; however, if we get a traffic spike during
that time it'll hurt like hell.
However, if there is credible reasons to believe XFS will help, I'd be
inclined to try it out.
-hpa
next prev parent reply other threads:[~2007-01-07 8:59 UTC|newest]
Thread overview: 115+ messages / expand[flat|nested] mbox.gz Atom feed top
2006-12-14 22:37 kernel.org lies about latest -mm kernel Pavel Machek
2006-12-14 23:01 ` Randy Dunlap
2006-12-14 23:38 ` Sergio Monteiro Basto
2006-12-16 17:44 ` [KORG] " Randy Dunlap
2006-12-16 17:57 ` Andrew Morton
2006-12-16 18:02 ` Randy Dunlap
2006-12-16 19:30 ` J.H.
2006-12-16 20:30 ` Russell King
2006-12-26 16:47 ` H. Peter Anvin
2006-12-16 21:21 ` Nigel Cunningham
2006-12-26 16:49 ` H. Peter Anvin
2007-01-07 3:35 ` Nigel Cunningham
2007-01-07 4:10 ` Jeff Garzik
2007-01-07 4:47 ` Nigel Cunningham
2007-01-07 4:22 ` Jeff Garzik
2007-01-07 4:29 ` Linus Torvalds
2007-01-07 20:11 ` Greg KH
2007-01-07 21:30 ` H. Peter Anvin
2007-01-07 21:54 ` Junio C Hamano
2007-01-07 22:21 ` Jeff Garzik
2007-01-07 22:53 ` Linus Torvalds
2007-01-07 23:32 ` Martin Langhoff
2007-01-07 5:17 ` H. Peter Anvin
2007-01-07 5:24 ` How git affects kernel.org performance H. Peter Anvin
2007-01-07 5:39 ` Linus Torvalds
2007-01-07 8:55 ` Willy Tarreau
2007-01-07 8:58 ` H. Peter Anvin [this message]
2007-01-07 9:03 ` Willy Tarreau
2007-01-07 10:28 ` Christoph Hellwig
2007-01-07 10:52 ` Willy Tarreau
2007-01-07 18:17 ` Linus Torvalds
2007-01-07 19:13 ` Linus Torvalds
[not found] ` <9e4733910701071126r7931042eldfb73060792f4f41@mail.gmail.com>
2007-01-07 19:35 ` Linus Torvalds
2007-01-07 10:50 ` Jan Engelhardt
2007-01-07 18:49 ` Randy Dunlap
2007-01-07 19:07 ` Jan Engelhardt
2007-01-07 19:28 ` Randy Dunlap
2007-01-07 19:37 ` Linus Torvalds
2007-01-07 9:15 ` Andrew Morton
2007-01-07 9:38 ` Rene Herman
2007-01-08 3:05 ` Suparna Bhattacharya
2007-01-08 12:58 ` Theodore Tso
2007-01-08 13:41 ` Johannes Stezenbach
2007-01-08 13:56 ` Theodore Tso
2007-01-08 13:59 ` Pavel Machek
2007-01-08 14:17 ` Theodore Tso
2007-01-08 13:43 ` Jeff Garzik
2007-01-09 1:09 ` Paul Jackson
2007-01-09 2:18 ` Jeremy Higdon
2007-01-09 7:59 ` Fengguang Wu
2007-01-09 7:59 ` Fengguang Wu
2007-01-09 16:23 ` Linus Torvalds
2007-01-10 1:57 ` Fengguang Wu
2007-01-10 1:57 ` Fengguang Wu
2007-01-10 3:20 ` Nigel Cunningham
2007-01-10 14:07 ` Fengguang Wu
2007-01-10 14:07 ` Fengguang Wu
2007-01-12 10:54 ` Nigel Cunningham
2007-01-07 14:57 ` Robert Fitzsimons
2007-01-07 19:12 ` J.H.
2007-01-08 1:51 ` Jakub Narebski
2007-01-08 1:51 ` Jakub Narebski
2007-01-07 15:06 ` Krzysztof Halasa
2007-01-07 20:31 ` Shawn O. Pearce
2007-01-08 14:46 ` Nicolas Pitre
2007-01-09 4:29 ` [KORG] Re: kernel.org lies about latest -mm kernel Nigel Cunningham
2007-01-09 5:09 ` Adrian Bunk
2007-01-09 5:51 ` Nigel Cunningham
2006-12-17 12:32 ` Pavel Machek
2006-12-17 13:13 ` Jeff Garzik
2006-12-17 18:23 ` Randy Dunlap
2006-12-17 22:37 ` Matti Aarnio
2006-12-18 0:42 ` J.H.
2006-12-19 6:46 ` Willy Tarreau
2006-12-19 7:39 ` J.H.
2006-12-19 13:32 ` Willy Tarreau
2006-12-19 14:36 ` Dave Jones
2006-12-19 14:38 ` Willy Tarreau
2006-12-26 16:14 ` H. Peter Anvin
2007-01-08 20:10 ` Jean Delvare
2006-12-19 6:34 ` Willy Tarreau
2006-12-19 6:52 ` J.H.
2007-01-06 18:33 ` Randy Dunlap
2007-01-06 19:18 ` H. Peter Anvin
2007-01-06 19:35 ` Willy Tarreau
2007-01-06 19:37 ` Nicholas Miell
2007-01-06 20:13 ` Andrew Morton
2007-01-06 20:18 ` H. Peter Anvin
2007-03-19 19:27 ` [PATCH] sysctl: vfs_cache_divisor Randy Dunlap
2007-03-19 20:36 ` Andrew Morton
2007-03-19 20:42 ` Randy Dunlap
2007-03-20 4:22 ` H. Peter Anvin
2007-03-21 23:01 ` Randy Dunlap
2007-03-21 23:11 ` Andrew Morton
2007-03-23 0:07 ` Kyle Moffett
2007-03-23 20:36 ` Randy Dunlap
2007-03-23 20:59 ` H. Peter Anvin
2007-03-24 0:45 ` Kyle Moffett
2007-03-24 1:17 ` Kyle Moffett
2007-03-20 19:53 ` Ingo Oeser
2007-01-06 23:50 ` [KORG] Re: kernel.org lies about latest -mm kernel H. Peter Anvin
2007-01-06 20:13 ` Jeff Garzik
2007-01-06 20:17 ` Andrew Morton
2007-01-06 20:20 ` H. Peter Anvin
2007-01-06 20:36 ` Andrew Morton
2007-01-06 19:21 ` J.H.
2007-01-07 19:52 ` Randy Dunlap
2007-01-07 23:56 ` H. Peter Anvin
2006-12-26 17:02 ` H. Peter Anvin
2007-01-08 19:31 ` Jean Delvare
2007-01-08 19:37 ` Willy Tarreau
2007-01-08 22:05 ` Jean Delvare
2006-12-19 15:37 ` Tim Schmielau
2007-01-08 21:20 ` Jean Delvare
2007-01-08 21:33 ` J.H.
2007-01-09 7:01 ` Jean Delvare
2007-01-09 7:25 ` J.H.
2007-01-09 13:36 ` Jean Delvare
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=45A0B63E.2020803@zytor.com \
--to=hpa@zytor.com \
--cc=akpm@osdl.org \
--cc=git@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=nigel@nigel.suspend2.net \
--cc=pavel@ucw.cz \
--cc=randy.dunlap@oracle.com \
--cc=torvalds@osdl.org \
--cc=w@1wt.eu \
--cc=warthog9@kernel.org \
--cc=webmaster@kernel.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.