corruption? how do I fix?

corruption? how do I fix?

[kenny gorman]

I am running a semi-large oracle database on reiserfs and lvm.  I 
started receiving block corruption messages in oracle.  So I started 
checking out the filesystem.  I ran debugreiserfs and I get the 
following.  Is this bad?  I can't seem to find docs on 
repair/restoration of reiserfs filesystems around.. am I just missing 
em?  We are down so any help would be really great.  Thx!

See output of debugreiserfs:

# debugreiserfs /dev/datagrp/datavol

<-------------debugreiserfs, 2001------------->
reiserfsprogs 3.x.0j
reiserfs_open: bitmap 45 was marked free
<repeated until>
reiserfs_open: bitmap 69 was marked free
Super block of format 3.5 found on the 0x3 in block 16
Block count 7752704
Blocksize 4096
Free blocks 2361789
Busy blocks (skipped 16, bitmaps - 237, journal blocks - 8193
1 super blocks, 5382468 data blocks
Root block 8384
Journal block (first) 18
Journal dev 0
Journal orig size 8192
Filesystem state ERROR
Tree height 4
Hash function used to sort names: "r5"
Objectid map size 2, max 1004
Version 0

Re: corruption? how do I fix?

[kenny gorman]

Just to add a bit to this.  I ran reiserfsck, and it returned 0.  Does 
that mean the filesystem is actually ok? Thats what the man pages see to 
suggest...

byte 286719: bm1: ffffffbd bm2 ffffffff
on-disk bitmap does not match to the correct one. 102400 bytes differ
ok
Checking Semantic tree...ok
# echo $?
0


kenny gorman wrote:
> I am running a semi-large oracle database on reiserfs and lvm.  I 
> started receiving block corruption messages in oracle.  So I started 
> checking out the filesystem.  I ran debugreiserfs and I get the 
> following.  Is this bad?  I can't seem to find docs on 
> repair/restoration of reiserfs filesystems around.. am I just missing 
> em?  We are down so any help would be really great.  Thx!
> 
> See output of debugreiserfs:
> 
> # debugreiserfs /dev/datagrp/datavol
> 
> <-------------debugreiserfs, 2001------------->
> reiserfsprogs 3.x.0j
> reiserfs_open: bitmap 45 was marked free
> <repeated until>
> reiserfs_open: bitmap 69 was marked free
> Super block of format 3.5 found on the 0x3 in block 16
> Block count 7752704
> Blocksize 4096
> Free blocks 2361789
> Busy blocks (skipped 16, bitmaps - 237, journal blocks - 8193
> 1 super blocks, 5382468 data blocks
> Root block 8384
> Journal block (first) 18
> Journal dev 0
> Journal orig size 8192
> Filesystem state ERROR
> Tree height 4
> Hash function used to sort names: "r5"
> Objectid map size 2, max 1004
> Version 0
> 
> 
> 
> 
> .
> 

Re: corruption? how do I fix?

[Dieter Nützel]

Am Mittwoch, 13. November 2002 06:38 schrieb kenny gorman:
> Just to add a bit to this.  I ran reiserfsck, and it returned 0.  Does
> that mean the filesystem is actually ok? Thats what the man pages see to
> suggest...
>
> byte 286719: bm1: ffffffbd bm2 ffffffff
> on-disk bitmap does not match to the correct one. 102400 bytes differ
> ok
> Checking Semantic tree...ok
> # echo $?
> 0
>
> kenny gorman wrote:
> > I am running a semi-large oracle database on reiserfs and lvm.  I
> > started receiving block corruption messages in oracle.  So I started
> > checking out the filesystem.  I ran debugreiserfs and I get the
> > following.  Is this bad?  I can't seem to find docs on
> > repair/restoration of reiserfs filesystems around.. am I just missing
> > em?  We are down so any help would be really great.  Thx!
> >
> > See output of debugreiserfs:
> >
> > # debugreiserfs /dev/datagrp/datavol
> >
> > <-------------debugreiserfs, 2001------------->
> > reiserfsprogs 3.x.0j
> > reiserfs_open: bitmap 45 was marked free
> > <repeated until>
> > reiserfs_open: bitmap 69 was marked free
> > Super block of format 3.5 found on the 0x3 in block 16
> > Block count 7752704
> > Blocksize 4096
> > Free blocks 2361789
> > Busy blocks (skipped 16, bitmaps - 237, journal blocks - 8193
> > 1 super blocks, 5382468 data blocks
> > Root block 8384
> > Journal block (first) 18
> > Journal dev 0
> > Journal orig size 8192
> > Filesystem state ERROR
> > Tree height 4
> > Hash function used to sort names: "r5"
> > Objectid map size 2, max 1004
> > Version 0

Kenny,

please start with the latest reiserfsprogs version 3.6.4.
ftp://ftp.namesys.com/pub/reiserfsprogs

Run it in "scan mode" readonly, again.

Good luck!

-Dieter
-- 
Dieter Nützel
Graduate Student, Computer Science

University of Hamburg
Department of Computer Science
@home: Dieter.Nuetzel at hamburg.de (replace at with @)

Re: corruption? how do I fix?

[kenny gorman]

downloaded and built the latest reiserfsprogs, and ran debugreiserfs and 
reiserfsck  here is the output.. Notice the '1 round of corruption can 
be fixed msg' at the bottom.

<-------------debugreiserfs, 2001------------->
reiserfsprogs 3.x.0j
reiserfs_open: bitmap 45 was marked free
reiserfs_open: bitmap 46 was marked free
<continued until>
reiserfs_open: bitmap 67 was marked free
reiserfs_open: bitmap 68 was marked free
reiserfs_open: bitmap 69 was marked free
Super block of format 3.5 found on the 0x3 in block 16
Block count 7752704
Blocksize 4096
Free blocks 2361789
Busy blocks (skipped 16, bitmaps - 237, journal blocks - 8193
1 super blocks, 5382468 data blocks
Root block 8384
Journal block (first) 18
Journal dev 0
Journal orig size 8192
Filesystem state VALID
Tree height 4
Hash function used to sort names: "r5"
Objectid map size 2, max 1004
Version 0

reiserfsck:<-------------reiserfsck, 2002------------->
reiserfsprogs 3.6.4

   *************************************************************
   ** If you are using the latest reiserfsprogs and  it fails **
   ** please  email bug reports to reiserfs-list@namesys.com, **
   ** providing  as  much  information  as  possible --  your **
   ** hardware,  kernel,  patches,  settings,  all  reiserfsk **
   ** messages  (including version),  the reiserfsck logfile, **
   ** check  the  syslog file  for  any  related information. **
   ** If you would like advice on using this program, support **
   ** is available  for $25 at  www.namesys.com/support.html. **
   *************************************************************

Will read-only check consistency of the filesystem on /dev/datagrp/datavol
Will put log info to 'stdout'

Do you want to run this program?[N/Yes] (note need to type Yes if you 
do):Yes
###########
reiserfsck --check started at Wed Nov 13 07:00:41 2002
###########
Replaying journal..
0 transactions replayed
Checking internal tree..finished
Comparing bitmaps..vpf-10640: The on-disk and the correct bitmaps differs.
Checking Semantic tree:
finished
1 found corruptions can be fixed with --fix-fixable
###########
reiserfsck finished at Wed Nov 13 07:00:48 2002
###########




Yury Umanets wrote:
> kenny gorman wrote:
> 
>> I am running a semi-large oracle database on reiserfs and lvm.  I 
>> started receiving block corruption messages in oracle.  So I started 
>> checking out the filesystem.  I ran debugreiserfs and I get the 
>> following.  Is this bad?  I can't seem to find docs on 
>> repair/restoration of reiserfs filesystems around.. am I just missing 
>> em?  We are down so any help would be really great.  Thx!
> 
> 
> First of all you have very old reiserfsprogs. The last one is:
> ftp://ftp.namesys.com/pub/reiserfsprogs/reiserfsprogs-3.6.4.tar.gz
> 
> Build this version and check you partition by fsck. What does it say?
> 
>>
>> See output of debugreiserfs:
>>
>> # debugreiserfs /dev/datagrp/datavol
>>
>> <-------------debugreiserfs, 2001------------->
>> reiserfsprogs 3.x.0j
>> reiserfs_open: bitmap 45 was marked free
>> <repeated until>
>> reiserfs_open: bitmap 69 was marked free
>> Super block of format 3.5 found on the 0x3 in block 16
>> Block count 7752704
>> Blocksize 4096
>> Free blocks 2361789
>> Busy blocks (skipped 16, bitmaps - 237, journal blocks - 8193
>> 1 super blocks, 5382468 data blocks
>> Root block 8384
>> Journal block (first) 18
>> Journal dev 0
>> Journal orig size 8192
>> Filesystem state ERROR
>> Tree height 4
>> Hash function used to sort names: "r5"
>> Objectid map size 2, max 1004
>> Version 0
>>
>>
>>
>>
>>
> 
> 

Re: corruption? how do I fix?

[kenny gorman]

Yury,

Thx for the quick response.  Is there a way to 'see' if the
reiserfsck --fix-fixable .... command would work?  like a dry run? 
Running another backup is going to take a while, so I need to gauge the 
risks.  What is this command going to do?  Is it permanent when I do it 
(seems like it from the docs)

-kg

Yury Umanets wrote:
> kenny gorman wrote:
> 
>> downloaded and built the latest reiserfsprogs, and ran debugreiserfs 
>> and reiserfsck  here is the output.. Notice the '1 round of corruption 
>> can be fixed msg' at the bottom.
>>
>> <-------------debugreiserfs, 2001------------->
>> reiserfsprogs 3.x.0j
>> reiserfs_open: bitmap 45 was marked free
>> reiserfs_open: bitmap 46 was marked free
>> <continued until>
>> reiserfs_open: bitmap 67 was marked free
>> reiserfs_open: bitmap 68 was marked free
>> reiserfs_open: bitmap 69 was marked free
>> Super block of format 3.5 found on the 0x3 in block 16
>> Block count 7752704
>> Blocksize 4096
>> Free blocks 2361789
>> Busy blocks (skipped 16, bitmaps - 237, journal blocks - 8193
>> 1 super blocks, 5382468 data blocks
>> Root block 8384
>> Journal block (first) 18
>> Journal dev 0
>> Journal orig size 8192
>> Filesystem state VALID
>> Tree height 4
>> Hash function used to sort names: "r5"
>> Objectid map size 2, max 1004
>> Version 0
>>
>> reiserfsck:<-------------reiserfsck, 2002------------->
>> reiserfsprogs 3.6.4
>>
>>   *************************************************************
>>   ** If you are using the latest reiserfsprogs and  it fails **
>>   ** please  email bug reports to reiserfs-list@namesys.com, **
>>   ** providing  as  much  information  as  possible --  your **
>>   ** hardware,  kernel,  patches,  settings,  all  reiserfsk **
>>   ** messages  (including version),  the reiserfsck logfile, **
>>   ** check  the  syslog file  for  any  related information. **
>>   ** If you would like advice on using this program, support **
>>   ** is available  for $25 at  www.namesys.com/support.html. **
>>   *************************************************************
>>
>> Will read-only check consistency of the filesystem on /dev/datagrp/datavol
>> Will put log info to 'stdout'
>>
>> Do you want to run this program?[N/Yes] (note need to type Yes if you 
>> do):Yes
>> ###########
>> reiserfsck --check started at Wed Nov 13 07:00:41 2002
>> ###########
>> Replaying journal..
>> 0 transactions replayed
>> Checking internal tree..finished
>> Comparing bitmaps..vpf-10640: The on-disk and the correct bitmaps differs.
>> Checking Semantic tree:
>> finished
>> 1 found corruptions can be fixed with --fix-fixable
>> ###########
>> reiserfsck finished at Wed Nov 13 07:00:48 2002
>> ###########
>>
> Okay, now you should backup your data and type:
> reiserfsck --fix-fixable /dev/datagrp/datavol
> 
> What does it say?
> 

Re: corruption? how do I fix?

[Vitaly Fertman]

Hi,

> >> I am running a semi-large oracle database on reiserfs and lvm.  I
> >> started receiving block corruption messages in oracle.  So I started

Do you mean I/O error messages? reiserfsck does not check partitions
for badblocks so I would suggest you to run /sbin/badblocks utility first.
If you have badblocks on your device, it is a bad idea to continue using
your harddrive, you probably should get a working one.

> Yury,
>
> Thx for the quick response.  Is there a way to 'see' if the
> reiserfsck --fix-fixable .... command would work?  like a dry run?

No, there is no a such.

> Running another backup is going to take a while, so I need to gauge the
> risks.  What is this command going to do?  Is it permanent when I do it
> (seems like it from the docs)
>

If you do not have badblocks, then the only problem is bitmaps. reiserfsck
--fix-fixable should fix it easily - it is not a severe corruption and the
latest reiserfsck is considered as quite stable.

Thanks,
Vitaly Fertman

Re: corruption? how do I fix?

[Ed Tomlinson]

On November 13, 2002 04:41 pm, Vitaly Fertman wrote:
> Hi,
>
> > >> I am running a semi-large oracle database on reiserfs and lvm.  I
> > >> started receiving block corruption messages in oracle.  So I started
>
> Do you mean I/O error messages? reiserfsck does not check partitions
> for badblocks so I would suggest you to run /sbin/badblocks utility first.
> If you have badblocks on your device, it is a bad idea to continue using
> your harddrive, you probably should get a working one.

Vitaly, Bad blocks on an oracle db do not (necessarily) imply io errors.  In 
this case there is fs corruption as reported by reiserfsck 3.6.4.

Kenny, if I were you I would make sure I have a backup and logs and they
run with fix-fixable - reiserfsck has worked well here.

Ed Tomlinsons