High speed filesystems

High speed filesystems

[Brian Beattie]

I investigating options for very high speed datalogging.  I was
wondering if anybody could point me at any information and/or code in
this area.
-- 
Brian Beattie            | Experienced kernel hacker/embedded systems
beattie@beattie-home.net | programmer, direct or contract, short or
www.beattie-home.net     | long term, available immediately.

"Honor isn't about making the right choices.
It's about dealing with the consequences." -- Midori Koto

Re: High speed filesystems

[Joseph D. Wagner]

On Saturday 11 October 2003 01:19 am, Brian Beattie wrote:
> I investigating options for very high speed datalogging.  I was
> wondering if anybody could point me at any information and/or code in
> this area.

http://www.sgi.com/products/storage/tech/file_systems.html

If you don't like CXFS, scroll down to XFS and follow the links.

Joseph D. Wagner

Re: High speed filesystems

[Charles Manning]

On Saturday 11 October 2003 08:19, Brian Beattie wrote:
> I investigating options for very high speed datalogging.  I was
> wondering if anybody could point me at any information and/or code in
> this area.

You'll get different results depending on how your data logging application 
works and the equipemt you are using. Things to consider:

* Robustness: apart from the speed, do you have robustness concerns? eg. Do 
you expect power loss etc. If so, you'll need a fs that tolerates this.

* Does you applicaion typically just do large append style transactions? If 
so, a fs that is inclined that way will do better than one designed for itty 
bitty transactions. Indeed if all you want to do is create a single monster 
file, then you could probably get the best performance without any file 
system (ie just write lumps of data directly to a block driver).

* Are you using wierdo media like flash instead of a hard disk? If so, then a 
flash oriented fs like JFFS2 or YAFFS might be the thing.

-- CHarles