public inbox for linux-xfs@vger.kernel.org
 help / color / mirror / Atom feed
* [PATCH 0 of 4] Radix tree based inode caching
@ 2007-08-08 23:07 David Chinner
  0 siblings, 0 replies; only message in thread
From: David Chinner @ 2007-08-08 23:07 UTC (permalink / raw)
  To: xfs-dev; +Cc: xfs-oss

One of the perpetual scaling problems XFS has is indexing
it's incore inodes. We currently uses hashes and the default
hash sizes chosen can only ever be a tradeoff between memory
consumption and the maximum realistic size of the cache.

As a result, anyone who has millions of inodes cached on a
filesystem needs to tunes the size of the cache via the ihashsize
mount option to allow decent scalability with inode cache
operations.

A further problem is the separate inode cluster hash, whose size is
based on the ihashsize but is smaller, and so under certain
conditions (sparse cluster cache population) this can become
a limitation long before the inode hash is causing issues.

The following patchset removes the inode hash and cluster hash
and replaces them with radix trees to avoid the scalability
limitations of the hashes. It also reduces the size of the
inodes by 3 pointers....

-- 
Dave Chinner
Principal Engineer
SGI Australian Software Group

^ permalink raw reply	[flat|nested] only message in thread

only message in thread, other threads:[~2007-08-08 23:07 UTC | newest]

Thread overview: (only message) (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2007-08-08 23:07 [PATCH 0 of 4] Radix tree based inode caching David Chinner

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox