All of lore.kernel.org
 help / color / mirror / Atom feed
* cannot repair raid6 volume rescue zero-log crashed
@ 2016-02-27  9:11 Jan Koester
  2016-03-25 11:02 ` Aw: " Jan Koester
  0 siblings, 1 reply; 3+ messages in thread
From: Jan Koester @ 2016-02-27  9:11 UTC (permalink / raw)
  To: linux-btrfs

Hi,
 
cannot recover my home filesystem.
 
Linux dibsi 4.2.0-30-generic #35-Ubuntu SMP Fri Feb 19 13:52:26 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
 
btrfs --version
btrfs-progs v4.4

btrfs fi show
Label: 'root'  uuid: 3d279e92-d021-4a57-92b8-db3bfcbba79d
        Total devices 1 FS bytes used 74.47GiB
        devid    1 size 111.79GiB used 82.02GiB path /dev/sdf1

Label: none  uuid: 73d4dc77-6ff3-412f-9b0a-0d11458faf32
        Total devices 5 FS bytes used 1.17TiB
        devid    1 size 931.51GiB used 420.78GiB path /dev/sdb
        devid    2 size 931.51GiB used 420.78GiB path /dev/sdc
        devid    3 size 931.51GiB used 420.78GiB path /dev/sdd
        devid    4 size 931.51GiB used 420.78GiB path /dev/sde
        devid    5 size 931.51GiB used 420.78GiB path /dev/sda

 
btrfs rescue zero-log:

root@dibsi:/home/jan# gdb --args btrfs rescue zero-log /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32
GNU gdb (Ubuntu 7.10-1ubuntu2) 7.10
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fgnu.org%2Flicenses%2Fgpl.html]>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fbugs%2F]>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fdocumentation%2F]>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from btrfs...done.
(gdb) r
Starting program: /usr/local/bin/btrfs rescue zero-log /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
parent transid verify failed on 2280450637824 wanted 861168 found 860380
parent transid verify failed on 2280450637824 wanted 861168 found 860380
checksum verify failed on 2280450637824 found BF5F5D16 wanted AE725F92
checksum verify failed on 2280450637824 found BF5F5D16 wanted AE725F92
bytenr mismatch, want=2280450637824, have=15938376490240
Clearing log on /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32, previous log_root 2280534142976, level 0
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
btrfs unable to find ref byte nr 2280388792320 parent 0 root 2  owner 3 offset 0
parent transid verify failed on 2280394903552 wanted 861168 found 860376
parent transid verify failed on 2280394903552 wanted 861168 found 860376
checksum verify failed on 2280394903552 found 49326465 wanted 1DF607C0
checksum verify failed on 2280394903552 found 49326465 wanted 1DF607C0
bytenr mismatch, want=2280394903552, have=15938169211392
btrfs unable to find ref byte nr 2280244973568 parent 0 root 2  owner 0 offset 0
parent transid verify failed on 2280389988352 wanted 861168 found 860375
parent transid verify failed on 2280389988352 wanted 861168 found 860375
checksum verify failed on 2280389988352 found 9EFF3657 wanted C933E8C1
checksum verify failed on 2280389988352 found 9EFF3657 wanted C933E8C1
bytenr mismatch, want=2280389988352, have=15938306902528
btrfs unable to find ref byte nr 2280388808704 parent 0 root 2  owner 2 offset 0
parent transid verify failed on 2280389992448 wanted 861168 found 860375
parent transid verify failed on 2280389992448 wanted 861168 found 860375
checksum verify failed on 2280389992448 found 1AF14813 wanted B3ED8CAB
checksum verify failed on 2280389992448 found 1AF14813 wanted B3ED8CAB
bytenr mismatch, want=2280389992448, have=15938306939392
btrfs unable to find ref byte nr 2280388935680 parent 0 root 2  owner 1 offset 0
Failed to find [2280445247488, 168, 4096]
btrfs unable to find ref byte nr 2280445247488 parent 0 root 2  owner 0 offset 0
Failed to find [2280463486976, 168, 4096]
btrfs unable to find ref byte nr 2280463486976 parent 0 root 2  owner 1 offset 0
Failed to find [2280463491072, 168, 4096]
btrfs unable to find ref byte nr 2280463491072 parent 0 root 2  owner 0 offset 0
parent transid verify failed on 2280458645504 wanted 861168 found 860380
parent transid verify failed on 2280458645504 wanted 861168 found 860380
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
bytenr mismatch, want=2280458645504, have=15938383793408
btrfs unable to find ref byte nr 2280458211328 parent 0 root 1  owner 1 offset 0
parent transid verify failed on 2280458645504 wanted 861168 found 860380
parent transid verify failed on 2280458645504 wanted 861168 found 860380
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
bytenr mismatch, want=2280458645504, have=15938383793408
parent transid verify failed on 2280458645504 wanted 861168 found 860380
parent transid verify failed on 2280458645504 wanted 861168 found 860380
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
bytenr mismatch, want=2280458645504, have=15938383793408
Program received signal SIGSEGV, Segmentation fault.
alloc_reserved_tree_block (trans=trans@entry=0x69b230, root=root@entry=0x69c850, root_objectid=root_objectid@entry=1,
    generation=generation@entry=861169, flags=flags@entry=0, key=key@entry=0x7fffffffe070, level=0, ins=0x7fffffffdf50) at extent-tree.c:2731
warning: Source file is more recent than executable.
2731            extent_item = btrfs_item_ptr(leaf, path->slots[0],
(gdb) bt
#0  alloc_reserved_tree_block (trans=trans@entry=0x69b230, root=root@entry=0x69c850, root_objectid=root_objectid@entry=1,
    generation=generation@entry=861169, flags=flags@entry=0, key=key@entry=0x7fffffffe070, level=0, ins=0x7fffffffdf50) at extent-tree.c:2731
#1  0x000000000044b2a9 in alloc_tree_block (ins=0x7fffffffdf50, search_end=18446744073709551615, hint_byte=2279553892352, empty_size=0,
    level=0, key=0x7fffffffe070, flags=0, generation=861169, root_objectid=1, num_bytes=4096, root=0x69c850, trans=0x69b230)
    at extent-tree.c:2794
#2  btrfs_alloc_free_block (trans=trans@entry=0x69b230, root=root@entry=0x69c850, blocksize=4096, root_objectid=1,
    key=key@entry=0x7fffffffe070, level=level@entry=0, hint=2279553892352, empty_size=0) at extent-tree.c:2817
#3  0x000000000043a55c in __btrfs_cow_block (trans=0x69b230, root=0x69c850, buf=0x6b1260, parent=0x6c3d40, parent_slot=0,
    cow_ret=0x7fffffffe2a8, search_start=2279553892352, empty_size=0) at ctree.c:278
#4  0x000000000043afe1 in btrfs_cow_block (trans=trans@entry=0x69b230, root=root@entry=0x69c850, buf=<optimized out>,
    parent=<optimized out>, parent_slot=<optimized out>, cow_ret=cow_ret@entry=0x7fffffffe2a8) at ctree.c:371
#5  0x000000000043da90 in btrfs_search_slot (trans=trans@entry=0x69b230, root=root@entry=0x69c850, key=key@entry=0x69cc77,
    p=p@entry=0x6cefe0, ins_len=ins_len@entry=0, cow=cow@entry=1) at ctree.c:1122
#6  0x000000000044f3a9 in btrfs_update_root (trans=trans@entry=0x69b230, root=root@entry=0x69c850, key=key@entry=0x69cc77,
    item=item@entry=0x69cac0) at root-tree.c:78
#7  0x0000000000440935 in update_cowonly_root (root=0x69cab0, trans=0x69b230) at disk-io.c:492
#8  commit_tree_roots (trans=trans@entry=0x69b230, fs_info=fs_info@entry=0x69c5f0) at disk-io.c:523
#9  0x000000000044271f in btrfs_commit_transaction (trans=0x69b230, root=root@entry=0x6b7330) at disk-io.c:582
#10 0x0000000000430d0a in cmd_rescue_zero_log (argc=<optimized out>, argv=<optimized out>) at cmds-rescue.c:195
#11 0x0000000000409e39 in handle_command_group (grp=grp@entry=0x694380 <rescue_cmd_group>, argc=2, argv=<optimized out>) at btrfs.c:135
#12 0x0000000000430d3a in cmd_rescue (argc=<optimized out>, argv=<optimized out>) at cmds-rescue.c:218
#13 0x0000000000409f93 in main (argc=3, argv=0x7fffffffe600) at btrfs.c:243
 
btrfsck --repair :
 
root@dibsi:/home/jan# gdb --args btrfsck --repair --init-extent-tree /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32
GNU gdb (Ubuntu 7.10-1ubuntu2) 7.10
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fgnu.org%2Flicenses%2Fgpl.html]>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fbugs%2F]>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fdocumentation%2F]>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from btrfsck...done.
(gdb) r
Starting program: /usr/local/bin/btrfsck --repair --init-extent-tree /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
enabling repair mode
repair mode will force to clear out log tree, Are you sure? [y/N]: y
Unable to find block group for 0
extent-tree.c:289: find_search_start: Assertion `1` failed.
btrfs check(btrfs_reserve_extent+0x99e)[0x44ad51]
btrfs check(btrfs_alloc_free_block+0x60)[0x44b0e4]
btrfs check(__btrfs_cow_block+0x1a7)[0x43a55c]
btrfs check(btrfs_cow_block+0x102)[0x43afe1]
btrfs check[0x440880]
btrfs check(btrfs_commit_transaction+0xec)[0x44271f]
btrfs check(cmd_check+0x65b)[0x42a35d]
btrfs check(main+0x155)[0x409f93]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7ffff6f8ea40]
btrfs check(_start+0x29)[0x409b89]
[Inferior 1 (process 1916) exited with code 01]

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Aw: cannot repair raid6 volume rescue zero-log crashed
  2016-02-27  9:11 cannot repair raid6 volume rescue zero-log crashed Jan Koester
@ 2016-03-25 11:02 ` Jan Koester
  2016-03-25 13:06   ` Duncan
  0 siblings, 1 reply; 3+ messages in thread
From: Jan Koester @ 2016-03-25 11:02 UTC (permalink / raw)
  To: linux-btrfs


 
with btrfs tools 4.5 i got this message:

Starting program: /root/btrfs-progs/btrfsck --repair --init-extent-tree /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
enabling repair mode
repair mode will force to clear out log tree, Are you sure? [y/N]: y
Unable to find block group for 0
extent-tree.c:289: find_search_start: Assertion `1` failed.
btrfs check(btrfs_reserve_extent+0x99e)[0x4500e6]
btrfs check(btrfs_alloc_free_block+0x60)[0x450479]
btrfs check(__btrfs_cow_block+0x1a7)[0x43f394]
btrfs check(btrfs_cow_block+0x102)[0x43fe19]
btrfs check[0x4458a2]
btrfs check(btrfs_commit_transaction+0xec)[0x447758]
btrfs check(cmd_check+0x633)[0x42c2a9]
btrfs check(main+0x155)[0x40a193]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7ffff6f8ea40]
btrfs check(_start+0x29)[0x409d89]
[Inferior 1 (process 5460) exited with code 01]

Starting program: /root/btrfs-progs/btrfs rescue zero-log /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
parent transid verify failed on 2280450637824 wanted 861168 found 860380
parent transid verify failed on 2280450637824 wanted 861168 found 860380
checksum verify failed on 2280450637824 found BF5F5D16 wanted AE725F92
checksum verify failed on 2280450637824 found BF5F5D16 wanted AE725F92
bytenr mismatch, want=2280450637824, have=15938376490240
Clearing log on /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32, previous log_root 2280534142976, level 0
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
extent-tree.c:2728: alloc_reserved_tree_block: Assertion `ret` failed.
/root/btrfs-progs/btrfs[0x44ba64]
/root/btrfs-progs/btrfs[0x44bce3]
/root/btrfs-progs/btrfs(btrfs_alloc_free_block+0x23b)[0x450654]
/root/btrfs-progs/btrfs(__btrfs_cow_block+0x1a7)[0x43f394]
/root/btrfs-progs/btrfs(btrfs_cow_block+0x102)[0x43fe19]
/root/btrfs-progs/btrfs[0x4458a2]
/root/btrfs-progs/btrfs(btrfs_commit_transaction+0xec)[0x447758]
/root/btrfs-progs/btrfs[0x432888]
/root/btrfs-progs/btrfs(handle_command_group+0x5d)[0x40a039]
/root/btrfs-progs/btrfs(cmd_rescue+0x15)[0x4328bc]
/root/btrfs-progs/btrfs(main+0x155)[0x40a193]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7ffff6f8ea40]
/root/btrfs-progs/btrfs(_start+0x29)[0x409d89]
 

Gesendet: Samstag, 27. Februar 2016 um 10:11 Uhr
Von: "Jan Koester" <jan.koester@gmx.net>
An: linux-btrfs@vger.kernel.org
Betreff: cannot repair raid6 volume rescue zero-log crashed
Hi,
 
cannot recover my home filesystem.
 
Linux dibsi 4.2.0-30-generic #35-Ubuntu SMP Fri Feb 19 13:52:26 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
 
btrfs --version
btrfs-progs v4.4

btrfs fi show
Label: 'root' uuid: 3d279e92-d021-4a57-92b8-db3bfcbba79d
Total devices 1 FS bytes used 74.47GiB
devid 1 size 111.79GiB used 82.02GiB path /dev/sdf1

Label: none uuid: 73d4dc77-6ff3-412f-9b0a-0d11458faf32
Total devices 5 FS bytes used 1.17TiB
devid 1 size 931.51GiB used 420.78GiB path /dev/sdb
devid 2 size 931.51GiB used 420.78GiB path /dev/sdc
devid 3 size 931.51GiB used 420.78GiB path /dev/sdd
devid 4 size 931.51GiB used 420.78GiB path /dev/sde
devid 5 size 931.51GiB used 420.78GiB path /dev/sda

 
btrfs rescue zero-log:

root@dibsi:/home/jan# gdb --args btrfs rescue zero-log /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32
GNU gdb (Ubuntu 7.10-1ubuntu2) 7.10
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fgnu.org%2Flicenses%2Fgpl.html[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fgnu.org%2Flicenses%2Fgpl.html]]>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/[http://www.gnu.org/software/gdb/bugs/][https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fbugs%2F[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fbugs%2F]]>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/[http://www.gnu.org/software/gdb/documentation/][https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fdocumentation%2F[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fdocumentation%2F]]>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from btrfs...done.
(gdb) r
Starting program: /usr/local/bin/btrfs rescue zero-log /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
parent transid verify failed on 2280450637824 wanted 861168 found 860380
parent transid verify failed on 2280450637824 wanted 861168 found 860380
checksum verify failed on 2280450637824 found BF5F5D16 wanted AE725F92
checksum verify failed on 2280450637824 found BF5F5D16 wanted AE725F92
bytenr mismatch, want=2280450637824, have=15938376490240
Clearing log on /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32, previous log_root 2280534142976, level 0
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
parent transid verify failed on 2280260939776 wanted 861166 found 860368
parent transid verify failed on 2280260939776 wanted 861166 found 860368
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
checksum verify failed on 2280260939776 found 816E966C wanted CB60A223
bytenr mismatch, want=2280260939776, have=15937230354176
btrfs unable to find ref byte nr 2280388792320 parent 0 root 2  owner 3 offset 0
parent transid verify failed on 2280394903552 wanted 861168 found 860376
parent transid verify failed on 2280394903552 wanted 861168 found 860376
checksum verify failed on 2280394903552 found 49326465 wanted 1DF607C0
checksum verify failed on 2280394903552 found 49326465 wanted 1DF607C0
bytenr mismatch, want=2280394903552, have=15938169211392
btrfs unable to find ref byte nr 2280244973568 parent 0 root 2  owner 0 offset 0
parent transid verify failed on 2280389988352 wanted 861168 found 860375
parent transid verify failed on 2280389988352 wanted 861168 found 860375
checksum verify failed on 2280389988352 found 9EFF3657 wanted C933E8C1
checksum verify failed on 2280389988352 found 9EFF3657 wanted C933E8C1
bytenr mismatch, want=2280389988352, have=15938306902528
btrfs unable to find ref byte nr 2280388808704 parent 0 root 2  owner 2 offset 0
parent transid verify failed on 2280389992448 wanted 861168 found 860375
parent transid verify failed on 2280389992448 wanted 861168 found 860375
checksum verify failed on 2280389992448 found 1AF14813 wanted B3ED8CAB
checksum verify failed on 2280389992448 found 1AF14813 wanted B3ED8CAB
bytenr mismatch, want=2280389992448, have=15938306939392
btrfs unable to find ref byte nr 2280388935680 parent 0 root 2  owner 1 offset 0
Failed to find [2280445247488, 168, 4096]
btrfs unable to find ref byte nr 2280445247488 parent 0 root 2  owner 0 offset 0
Failed to find [2280463486976, 168, 4096]
btrfs unable to find ref byte nr 2280463486976 parent 0 root 2  owner 1 offset 0
Failed to find [2280463491072, 168, 4096]
btrfs unable to find ref byte nr 2280463491072 parent 0 root 2  owner 0 offset 0
parent transid verify failed on 2280458645504 wanted 861168 found 860380
parent transid verify failed on 2280458645504 wanted 861168 found 860380
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
bytenr mismatch, want=2280458645504, have=15938383793408
btrfs unable to find ref byte nr 2280458211328 parent 0 root 1  owner 1 offset 0
parent transid verify failed on 2280458645504 wanted 861168 found 860380
parent transid verify failed on 2280458645504 wanted 861168 found 860380
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
bytenr mismatch, want=2280458645504, have=15938383793408
parent transid verify failed on 2280458645504 wanted 861168 found 860380
parent transid verify failed on 2280458645504 wanted 861168 found 860380
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
checksum verify failed on 2280458645504 found 609E8D90 wanted 62B88736
bytenr mismatch, want=2280458645504, have=15938383793408
Program received signal SIGSEGV, Segmentation fault.
alloc_reserved_tree_block (trans=trans@entry=0x69b230, root=root@entry=0x69c850, root_objectid=root_objectid@entry=1,
    generation=generation@entry=861169, flags=flags@entry=0, key=key@entry=0x7fffffffe070, level=0, ins=0x7fffffffdf50) at extent-tree.c:2731
warning: Source file is more recent than executable.
2731            extent_item = btrfs_item_ptr(leaf, path->slots[0],
(gdb) bt
#0  alloc_reserved_tree_block (trans=trans@entry=0x69b230, root=root@entry=0x69c850, root_objectid=root_objectid@entry=1,
    generation=generation@entry=861169, flags=flags@entry=0, key=key@entry=0x7fffffffe070, level=0, ins=0x7fffffffdf50) at extent-tree.c:2731
#1  0x000000000044b2a9 in alloc_tree_block (ins=0x7fffffffdf50, search_end=18446744073709551615, hint_byte=2279553892352, empty_size=0,
    level=0, key=0x7fffffffe070, flags=0, generation=861169, root_objectid=1, num_bytes=4096, root=0x69c850, trans=0x69b230)
    at extent-tree.c:2794
#2  btrfs_alloc_free_block (trans=trans@entry=0x69b230, root=root@entry=0x69c850, blocksize=4096, root_objectid=1,
    key=key@entry=0x7fffffffe070, level=level@entry=0, hint=2279553892352, empty_size=0) at extent-tree.c:2817
#3  0x000000000043a55c in __btrfs_cow_block (trans=0x69b230, root=0x69c850, buf=0x6b1260, parent=0x6c3d40, parent_slot=0,
    cow_ret=0x7fffffffe2a8, search_start=2279553892352, empty_size=0) at ctree.c:278
#4  0x000000000043afe1 in btrfs_cow_block (trans=trans@entry=0x69b230, root=root@entry=0x69c850, buf=<optimized out>,
    parent=<optimized out>, parent_slot=<optimized out>, cow_ret=cow_ret@entry=0x7fffffffe2a8) at ctree.c:371
#5  0x000000000043da90 in btrfs_search_slot (trans=trans@entry=0x69b230, root=root@entry=0x69c850, key=key@entry=0x69cc77,
    p=p@entry=0x6cefe0, ins_len=ins_len@entry=0, cow=cow@entry=1) at ctree.c:1122
#6  0x000000000044f3a9 in btrfs_update_root (trans=trans@entry=0x69b230, root=root@entry=0x69c850, key=key@entry=0x69cc77,
    item=item@entry=0x69cac0) at root-tree.c:78
#7  0x0000000000440935 in update_cowonly_root (root=0x69cab0, trans=0x69b230) at disk-io.c:492
#8  commit_tree_roots (trans=trans@entry=0x69b230, fs_info=fs_info@entry=0x69c5f0) at disk-io.c:523
#9  0x000000000044271f in btrfs_commit_transaction (trans=0x69b230, root=root@entry=0x6b7330) at disk-io.c:582
#10 0x0000000000430d0a in cmd_rescue_zero_log (argc=<optimized out>, argv=<optimized out>) at cmds-rescue.c:195
#11 0x0000000000409e39 in handle_command_group (grp=grp@entry=0x694380 <rescue_cmd_group>, argc=2, argv=<optimized out>) at btrfs.c:135
#12 0x0000000000430d3a in cmd_rescue (argc=<optimized out>, argv=<optimized out>) at cmds-rescue.c:218
#13 0x0000000000409f93 in main (argc=3, argv=0x7fffffffe600) at btrfs.c:243
 
btrfsck --repair :
 
root@dibsi:/home/jan# gdb --args btrfsck --repair --init-extent-tree /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32
GNU gdb (Ubuntu 7.10-1ubuntu2) 7.10
Copyright (C) 2015 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html[http://gnu.org/licenses/gpl.html][https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fgnu.org%2Flicenses%2Fgpl.html[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fgnu.org%2Flicenses%2Fgpl.html]]>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/[http://www.gnu.org/software/gdb/bugs/][https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fbugs%2F[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fbugs%2F]]>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/[http://www.gnu.org/software/gdb/documentation/][https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fdocumentation%2F[https://deref-gmx.net/mail/client/dereferrer/?redirectUrl=http%3A%2F%2Fwww.gnu.org%2Fsoftware%2Fgdb%2Fdocumentation%2F]]>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from btrfsck...done.
(gdb) r
Starting program: /usr/local/bin/btrfsck --repair --init-extent-tree /dev/disk/by-uuid/73d4dc77-6ff3-412f-9b0a-0d11458faf32
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
enabling repair mode
repair mode will force to clear out log tree, Are you sure? [y/N]: y
Unable to find block group for 0
extent-tree.c:289: find_search_start: Assertion `1` failed.
btrfs check(btrfs_reserve_extent+0x99e)[0x44ad51]
btrfs check(btrfs_alloc_free_block+0x60)[0x44b0e4]
btrfs check(__btrfs_cow_block+0x1a7)[0x43a55c]
btrfs check(btrfs_cow_block+0x102)[0x43afe1]
btrfs check[0x440880]
btrfs check(btrfs_commit_transaction+0xec)[0x44271f]
btrfs check(cmd_check+0x65b)[0x42a35d]
btrfs check(main+0x155)[0x409f93]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7ffff6f8ea40]
btrfs check(_start+0x29)[0x409b89]
[Inferior 1 (process 1916) exited with code 01]
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at http://vger.kernel.org/majordomo-info.html[http://vger.kernel.org/majordomo-info.html]

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: Aw: cannot repair raid6 volume rescue zero-log crashed
  2016-03-25 11:02 ` Aw: " Jan Koester
@ 2016-03-25 13:06   ` Duncan
  0 siblings, 0 replies; 3+ messages in thread
From: Duncan @ 2016-03-25 13:06 UTC (permalink / raw)
  To: linux-btrfs

Jan Koester posted on Fri, 25 Mar 2016 12:02:29 +0100 as excerpted:

> with btrfs tools 4.5 i got this message:

Unfortunately this isn't going to be a lot of direct help in regard to 
your specific situation as I'm simply a btrfs using admin and list 
regular, not a dev, and I don't use btrfs raid56 mode here at all, both 
because it doesn't fit my use-case (I use raid1 mode, with backups =:^), 
and because btrfs raid56 mode isn't yet appropriately mature enough to 
handle my use-case even if parity raid would otherwise be an appropriate 
choice.  However, as I don't see any other answers, here's some rather 
generic notes:

These first points are btrfs generic, not specific to raid56 mode.

1) Btrfs in general is considered stabilizing, but not yet fully stable 
and mature.  As such, backups are extremely strongly recommended, more so 
than with fully stable and mature filesystems, unless you are using 
purely testing data that's trivial enough you simply don't care if it 
dies.

2) Additionally, given the speed at which btrfs is still changing and the 
fact that this list is mainline focused, not specific distro focused, 
list-recommended kernels are in two tracks based on mainline kernels, 
current track and LTS.  On the current track, the latest two current 
kernel series are recommended and best supported.  With 4.5 out, that's 
kernel series 4.5 and 4.4.

On the LTS track, until recently it was again the latest two, but 
mainline LTS kernel versions, which would be the 4.4 and 4.1 LTS kernel 
series.  However, as btrfs stabilizes and because the previous LTS 
kernel, 3.18, was relatively stable as well, while newer is recommended, 
we do recognize that more conservative users may wish to stay a bit 
further back, and as such LTS series 3.18 remains supported to some 
extent as well.

3) While this list is mainline focused, we do recognize that various 
distros support btrfs on kernels outside the above recommended mainline 
current and LTS track versions.  However, as we're mainline focused, we 
don't track what patches they may or may not have backported to whatever 
kernels they are running, and thus, while we'll do our best to help, 
often that "best" is going to be asking that you try with something newer 
and report back the results from that, if need be.

Alternatively, you may of course turn to the support your distro is 
providing for btrfs on that kernel, as they're better positioned to know 
what exactly they've backported and what they haven't, which would then 
make it a matter between you and your distro, rather than between you and 
the list.

It can be noted here that kernel 4.2, specifically, is not a mainline LTS 
track kernel, which means it's subject to the current track kernel 
upgrade rules, and support for mainline 4.2 series is now expired with no 
further patches being backported to it.  Therefore, the recommendation, 
both from a general mainline kernel perspective and from the btrfs 
specific perspective, would be to upgrade to something within current 
support scope, presently 4.4 and 4.5, or switch to the LTS track, as 
mentioned, 4.4, 4.1 and 3.18, the alternative being looking to your 
distro for longer term support if they've chosen to provide it for 4.2.

4) In terms of the btrfs-progs userspace, during normal runtime, most 
commands simply invoke kernel code, so userspace code isn't as critical.  
However, once you're dealing with a filesystem that's failing to mount, 
and trying to repair it using btrfs check and other userspace tools, or 
retrieve files from the unmounted filesystem using btrfs restore, then 
it's actually userspace code doing the work, and it's at that point that 
the userspace version becomes critical, as newer versions have the newest 
repair and restore code to best deal with problems only recently 
understood.

In this regard you're current, as you're now running btrfs-progs 4.5.


Those are the generic points applying to btrfs in general.  For btrfs 
raid56 mode more specifically...

5) Btrfs raid56 mode, while nominally complete with kernel 3.19, had show-
stopper-critical bugs into the 4.1 development cycle, and while those 
were fixed by 4.1 and later 4.2 release, btrfs raid56 mode code remains 
somewhat less stable than btrfs code in general.  As such, using the very 
latest code, kernel 4.5 and its matching 4.5 userspace, is extremely 
strongly recommended.

6) In addition, while there's no specific show-stopper level bugs with 
the raid56 code that I know of, there remains one known in-practice 
critical bug that hasn't been tracked down, the fact that in some cases, 
device replacement and array rebuild can be /extremely/ slow, to the 
point where it can take weeks to return to full undegraded mode.  
Unfortunately, the entire filesystem is at risk during that extended 
rebuild, due to the real risk of further loss of devices while the 
filesystem is already degraded.  With the length of that high-risk 
rebuild time so extended, the raid5/raid6 functionality may actually be 
of little practical use, since dropping of further devices may kill the 
array before it's fully rebuilt.

7) It shouldn't need to be said, but to make it explicit, with raid56 
mode not yet as stable as btrfs in general, having backups is even *MORE* 
strongly recommended.  IOW, unless the data really is of only trivial 
"just testing and I don't care if I lose it" value, putting it on btrfs 
raid56 in its current state without backups in case that btrfs dies, is 
irresponsiblity to the highest degree.

* IOW, when it comes to btrfs raid56 mode: Just. Have. That. Backup. Or. 
You. Have. Defined. Your. Data. As. Not. Worth. Saving. *

8) Of course people who care about their data are going to do their 
research when choosing the filesystem they wish to put it on.  Therefore, 
anyone not knowing btrfs, and in particular, btrfs raid56, status, while 
having data on it, simply means they don't value that data enough to do 
the research to know the above, particularly point #7.


Given all the above, particularly points #7 and 8, even if you can't 
recover the data from the filesystem, it's no big deal.  Either you had 
backups and can recover from them, or you didn't.  If you did, no big 
deal, restore from backups.  If you didn't have backups then by virtue of 
points 7 and 8, you defined the data as not valuable enough to be worth 
the trouble, either of the backup if you knew the risk, or of the 
research to know the risk in the first place.  Thus, you can be happy at 
saving that hassle which you defined to be of more value than your data, 
even if the data itself ends up being unrecoverable.

So either way you save what was of more value to you.  =:^)

-- 
Duncan - List replies preferred.   No HTML msgs.
"Every nonfree program has a lord, a master --
and if you use the program, he is your master."  Richard Stallman


^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2016-03-25 13:06 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2016-02-27  9:11 cannot repair raid6 volume rescue zero-log crashed Jan Koester
2016-03-25 11:02 ` Aw: " Jan Koester
2016-03-25 13:06   ` Duncan

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.