Am I missing partiy/redundancy - WARNING: RAID56 detected, not implemented

Am I missing partiy/redundancy - WARNING: RAID56 detected, not implemented

[Jeff Smith]

I am just getting started with btrfs and wanted to test raid5.  I set
it up and thought it was setup correctly but when I run " btrfs fi
usage /mnt/btrdata"  I get the message "WARNING: RAID56 detected, not
implemented".   Does this mean I have no redundancy?  I know it is
experimental and I am not relying on it for production data (or data
that cannot be replaced).  I don't think I do.  When I check the free
space (3.7TB) it is the same as all the drive together (4x931MB).


Any assistance in helping me understand would be appreciated greatly.

------
uname -a
Linux alexandria.localdomain 3.17.8-300.fc21.x86_64 #1 SMP Thu Jan 8
23:32:49 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

------
btrfs --version
Btrfs v3.18.1

------
btrfs fi show
Label: 'btrfsMain'  uuid: a111f6f0-4dfd-4327-932a-
2eb87e173632
    Total devices 4 FS bytes used 566.93GiB
    devid    1 size 931.51GiB used 192.02GiB path /dev/sdb
    devid    2 size 931.51GiB used 192.00GiB path /dev/sdd
    devid    3 size 931.51GiB used 192.00GiB path /dev/sde
    devid    4 size 931.51GiB used 192.00GiB path /dev/sdg

Btrfs v3.18.1

-----
btrfs fi df /mnt/btrdata
Data, single: total=8.00MiB, used=0.00B
Data, RAID5: total=585.00GiB, used=580.04GiB
System, single: total=4.00MiB, used=0.00B
System, RAID5: total=12.00MiB, used=64.00KiB
Metadata, single: total=8.00MiB, used=0.00B
Metadata, RAID5: total=3.00GiB, used=642.98MiB
GlobalReserve, single: total=224.00MiB, used=0.00B


-----
btrfs fi usage /mnt/btrdata
WARNING: RAID56 detected, not implemented
WARNING: RAID56 detected, not implemented
WARNING: RAID56 detected, not implemented
Overall:
    Device size:           3.64TiB
    Device allocated:          20.00MiB
    Device unallocated:           3.64TiB
    Used:                 0.00B
    Free (estimated):         267.45PiB    (min: 4.21TiB)
    Data ratio:                  0.00
    Metadata ratio:              0.00
    Global reserve:         224.00MiB    (used: 0.00B)

Data,single: Size:8.00MiB, Used:0.00B
   /dev/sdb       8.00MiB

Data,RAID5: Size:588.00GiB, Used:584.31GiB
   /dev/sdb     196.00GiB
   /dev/sdd     196.00GiB
   /dev/sde     196.00GiB
   /dev/sdg     196.00GiB

Metadata,single: Size:8.00MiB, Used:0.00B
   /dev/sdb       8.00MiB

Metadata,RAID5: Size:3.00GiB, Used:649.06MiB
   /dev/sdb       1.00GiB
   /dev/sdd       1.00GiB
   /dev/sde       1.00GiB
   /dev/sdg       1.00GiB

System,single: Size:4.00MiB, Used:0.00B
   /dev/sdb       4.00MiB

System,RAID5: Size:12.00MiB, Used:64.00KiB
   /dev/sdb       4.00MiB
   /dev/sdd       4.00MiB
   /dev/sde       4.00MiB
   /dev/sdg       4.00MiB

Unallocated:
   /dev/sdb     734.49GiB
   /dev/sdd     734.51GiB
   /dev/sde     734.51GiB
   /dev/sdg     734.51GiB

Re: Am I missing partiy/redundancy - WARNING: RAID56 detected, not implemented

[Duncan]

Jeff Smith posted on Tue, 27 Jan 2015 02:21:24 -0700 as excerpted:

> I am just getting started with btrfs and wanted to test raid5.  I set it
> up and thought it was setup correctly but when I run " btrfs fi usage
> /mnt/btrdata"  I get the message "WARNING: RAID56 detected, not
> implemented".   Does this mean I have no redundancy?  I know it is
> experimental and I am not relying on it for production data (or data
> that cannot be replaced).  I don't think I do.  When I check the free
> space (3.7TB) it is the same as all the drive together (4x931MB).
> 
> 
> Any assistance in helping me understand would be appreciated greatly.
> 
> ------
> uname -a Linux alexandria.localdomain 3.17.8-300.fc21.x86_64 #1 SMP Thu
> Jan 8 23:32:49 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux

On that kernel (or even a current 3.18 kernel), yes, in effect, no 
redundancy.

As the announcement stated, the raid56 mode code wasn't entirely complete 
at original commit, and as of current stable kernels, that hasn't 
changed, tho it's actually changing right now.

Basically, normal operation works -- the kernel calculates and writes the 
parity strips as expected.  However, the code to recover in case of 
device drop or filesystem damage isn't complete, so in effect, raid56 
mode is currently slow raid0 -- no redundancy -- in terms of recovery, 
except that when the code /is/ completed, you'll effectively get a "free" 
upgrade, as it has been writing the parity strips all along, it simply 
didn't have the code to recover properly if anything went wrong.

Meanwhile, the still in development 3.19 kernel (and corresponding 
userspace) /finally/ has very nearly complete raid56 code, altho at 
present there's still known bugs, and I'd not recommend actually 
upgrading from the "no redundancy" consideration until kernel/userspace 
3.20, tho 3.19 should give you significantly better chances at recovery 
on raid56 than previous versions did.

In addition to the announcement, status is documented on the wiki[1], and 
is well known on the list, so with a bit of research you'd have known 
that before trying it.  Well at least you tried it before relying on it. 
=:^)

---
[1] https://btrfs.wiki.kernel.org

-- 
Duncan - List replies preferred.   No HTML msgs.
"Every nonfree program has a lord, a master --
and if you use the program, he is your master."  Richard Stallman

Re: Am I missing partiy/redundancy - WARNING: RAID56 detected, not implemented

[David Sterba]

On Tue, Jan 27, 2015 at 02:21:24AM -0700, Jeff Smith wrote:
> I am just getting started with btrfs and wanted to test raid5.  I set
> it up and thought it was setup correctly but when I run " btrfs fi
> usage /mnt/btrdata"  I get the message "WARNING: RAID56 detected, not
> implemented".   Does this mean I have no redundancy?  I know it is
> experimental and I am not relying on it for production data (or data
> that cannot be replaced).  I don't think I do.  When I check the free
> space (3.7TB) it is the same as all the drive together (4x931MB).
> 
> 
> Any assistance in helping me understand would be appreciated greatly.
> 
> -----
> btrfs fi usage /mnt/btrdata
> WARNING: RAID56 detected, not implemented
> WARNING: RAID56 detected, not implemented
> WARNING: RAID56 detected, not implemented

The message is confusing, it means that space reporting for raid56 is
not implemted. I'll fix that, thanks for the report.