Re: md on shared storage

[Lars Marowsky-Bree <lmb@suse.de>]

On 2002-11-12T18:25:29,
   Brian Jackson <brian-kernel-list@mdrx.com> said:

> Does the MD driver work with shared storage? I would also be interested to 
> know if the new DM driver works with shared storage(though I must admit I 
> didn't really try to answer this one myself, just hoping somebody will 
> know). 

The short answer is "Not sanely", as far as I know.

RAID0 might be okay, however RAID1/5 get into issues if two nodes update the
same data in parallel; they do not coordinate the writes, and thus might stomp
over each other.

In theory, given a RAID1 with disks {d1,d2}, node n1 might write in order
(d2,d1) while n2 writes as (d1,d2), resulting in inconsistent mirrors. This
becomes a bigger race window for RAID5, obviously, because more disks are
involved.

The "multiple nodes beginning to reconstruct the same md device" is also a
problem; but even if that was solved that only one node does the recovery, the
others would be blocked from doing any IO on that drive for the time being.

Another issue that any node will want to update the md superblock regularly.

LVM is fine, MD doesn't seem to be.

With the MD patches I posted weeks ago, at least MD multipathing should work
appropriately; even if the ugliness of multiple nodes scribbling over the
superblock remains, it shouldn't matter because the autodetection is based
only on the UUID for m-p.

In short, you can do "MD", if you don't use it as "shared"; have only one node
have a given md device active at any point in time. Thus, no autostart, but
manual activation. This rules out "GFS over md", basically.

If you want to fix that, it would be cool; it will just require a DLM,
membership and communication services in the kernel. ;-)


Sincerely,
    Lars Marowsky-Brée <lmb@suse.de>

-- 
Principal Squirrel 
SuSE Labs - Research & Development, SuSE Linux AG
  
"If anything can go wrong, it will." "Chance favors the prepared (mind)."
  -- Capt. Edward A. Murphy            -- Louis Pasteur