Re: ext3_dx_add_entry: Directory index full!

[Theodore Tso <tytso@mit.edu>]

On Sun, May 18, 2008 at 05:36:02PM +0200, Bernie Innocenti wrote:
>
> Some background: I'm moving users' Maildirs to a separate filesystem tuned
> for small files to increase performance.  One of our users intentionally
> collected spam for 5 years in one folder and likes it this way.
> We could easily work it around, but first I'd like to understand whether
> the particular parameters we used trigger a bug in ext3 or if we're just
> hitting a (possibly undocumented) limit.

No, not a bug, but a limit.  Ext3's hash directores are limited to a
depth of 3 blocks, which normally isn't a problem if you are using a
4k blocksize, since each internal node is small; only 8 bytes.  So you
have a fanout of 508 for each internal node, and two internal nodes
gets you to over 250,000 4k directory blocks.  But with a 1k
blocksize, the internal node fanout is only 124, so that only gets you
a bit more than 15,000 1k directory blocks.

We could remove this limit at some point; the problem is that Daniel
Phillip's original code had this as a limitation, and fixing it would
mean replacing the tree implementation.  We actually have some code
from Lustre that we could use for this purpose, but to date we've been
focused on some other higher priority items for ext4.

							- Ted