[linux-lvm] massive LV corruption

[Tracy R Reed <treed@copilotconsulting.com>]

[-- Attachment #1: Type: text/plain, Size: 1769 bytes --]

I am running Fedora Core 1 with stock RedHat kernel 2.4.22-1.2188.nptl. I
filled my /usr/local to 100% and decided I needed some more space so I ran
the lvextend and resize_reiserfs commands like I have done many times
before to add a couple gig to the volume. A few hours later I began
noticing very strange behaviors. My .vimrc file was filled with garbage.
All of my email disappeared. Lots of filesystem errors began appearing on
the console.  I rebooted the machine and upon the reboot my entire /home
logical volume was nowhere to be found. The /usr/local lv existed but the
fs was corrupted very badly. I tried restoring the lvm config with vgcfg
restore to no avail. I tested the memory with memtest and found no
problems. I did a non-destructive badblocks test of all 80G of the drive
with everything unmounted and / mounted RO and came up with no problems.
The symptoms really look like disk was allocated improperly and diskspace
already in use got overwritten. I have saved a bunch of output from
various lvm commands and other things and the backup vgcfg file from right
after I made the change which probably caused the damage in case they are
of use to someone. They can be found here:
 
http://ultraviolet.org/tmp

Unfortunately I had to get the server back up and running so I didn't have
time to try to reproduce it or do any more debugging although I am afraid
to use lvm on this box now. I eventually deleted the corrupted lv's and
remade from scratch and all seems well for the moment. I am SO glad to
have made a backup a couple days before so I didn't lose too much.

-- 
Tracy Reed                     The attachment is a digital signature.
http://copilotconsulting.com   More info: http://copilotconsulting.com/sig

[-- Attachment #2: Type: application/pgp-signature, Size: 189 bytes --]