End to end data integrity checking in Ceph?

[Craig Dunwoody <cdunwoody@graphstream.com>]

Hi Sage,

-   Some of my customers are particularly paranoid about data integrity.
    I believe that there are some parallel/distributed storage systems
    (Panasas? Others?)  that claim to provide options for some kind of
    data integrity checking within the fault domain of the client, as a
    final step before delivering read-data to the application, and
    perhaps also as a first step after receiving write-data from the
    application.

    The hope would be to catch any data corruption that could possibly
    take place between clients and servers, even if relatively unlikely
    (e.g.  bits getting flipped in network transport).

-   Does the current Ceph implementation already do some variation of
    this?  If not, how difficult do you think it might be to add as a
    future optional feature?  Could it be added without breaking
    compatibility of wire-protocol and on-disk format?

Thanks in advance for any comments/suggestions on this.

Craig Dunwoody
GraphStream Incorporated

------------------------------------------------------------------------------
Download Intel® Parallel Studio Eval
Try the new software tools for yourself. Speed compiling, find bugs
proactively, and fine-tune applications for parallel performance.
See why Intel Parallel Studio got high marks during beta.
http://p.sf.net/sfu/intel-sw-dev